Vaga de parceiro

Data Engineer - São Paulo / SP

Disponível para Assinantes

Salvar nos Favoritos

Detalhes da Vaga

Youll own data ingestion, transformation, quality and delivery pipelines that power real-time dashboards and ML workloads for our clients.
What Youll Do Design and implement robust ETL/ELT pipelines in Databricks using PySpark Model data in Delta Lake and optimise tables for performance and cost Automate pipeline tests and data-quality checks with TDD patterns Collaborate with ML engineers to productionise features and track experiments (MLflow a plus) Tune clusters, jobs and query plans for reliable throughput and low latency Ship everything through Azure DevOps CI/CD Must-Have Skills Azure (Data Lake Gen2, Key Vault) Databricks & Delta Lake (job orchestration, cluster management, Workspace APIs, Unity Catalog) Python & PySpark SQL (analytical queries, window functions, performance tuning) Test-Driven Development (pytest, db-test, Great Expectations or similar) Nice-to-Have LangGraph or other LLM-workflow tooling MLflow for feature & model lifecycle management Why Join Us? Cutting-edge data-engineering architecture Budget for Databricks and Azure certifications Flexible remote-first culture Competitive remuneration International Company Diverse Nationality team

Vaga Encerrada