Vaga de parceiro

Data Engineer - São Paulo / SP

Disponível para Assinantes
Salvar nos Favoritos
  • Compartilhe:

Detalhes da Vaga

  • Escolaridade Não Informado
  • Segmento Não Informado
  • Salário Não Informado
  • Área de AtuaçãoDiversos / Outros

O que você irá fazer

  • The ideal scenario to expand ideas through the right tools, contributing to our success in a collaborative environment.
  • We are looking for Data Engineer focused on Databricks and Azure.
  • Required skills are even more specific, combining in-depth knowledge of the Databricks platform, Azure services, modern data architecture, and data engineering best practices.
  • Hard Skills (Technical Skills) Programming Languages - Python (main language for data manipulation and creation of pipelines in Databricks) - SQL (for modeling, queries, and data optimization) - Scala (desirable for high performance in Spark) - Bash (for automation and administration scripts in Azure) D ata Processing and ETL/ELT - Apache Spark (PySpark, Spark SQL, Delta Engine).
  • Distributed processing optimized for Databricks - Databricks Workflows and Jobs.
  • Automation of ETL pipelines and scheduled tasks - Delta Lake.
  • Transactional data architecture for reliable pipelines (ACID, data versioning) A zure Services for Data Engineering - Azure Data Lake Storage (ADLS Gen2).
  • Scalable storage for raw and transformed data - Azure Data Factory (ADF).
  • Orchestration of integrated ETL pipelines with Databricks - Azure Synapse Analytics.
  • Integration between Databricks and enterprise data warehouses - Azure Event Hubs / Azure Kafka.
  • Real-time data ingestion for streaming - Azure Functions & Logic Apps.
  • Automation of data-related tasks D ata Modeling and Architecture - Data Lakehouse Architecture.
  • Hybrid between Data Lake and Data W arehouse (Databricks-supported architecture) D ata modeling (Dimensional, Star Schema, S nowflake Schema) - SQL query optimization (indexing, caching, partitioning, Ordering) D evOps & Automation - CI/CD for Databricks (GitHub Actions, Azure DevOps, Terraform) - Monitoring and Logging.
  • Azure Monitor, Databricks Logging, MLflow for pipeline tracking S ecurity, Governance and Compliance - Azure Purview (Data Catalog and Lineage) - RBAC (Role-Based Access Control) in Azure - Encryption and Masking of Sensitive Data - Implementation of Compliance Rules (GDPR, LGPD, HIPAA) What do we offer? CS Benefits Brazil:H ealth InsuranceD ental PlanL ife insuranceT ransportation VoucherM eal/Food VoucherD aycare AssistanceG ym workoutT CS Cares a free 0800 number that provides psychological (24 hours/day), legal, social and financial assistance to membersP artnership with SESCC ertification RefundT CS Free Learning Portal Online Courses and Live TrainingO pportunity for international experienceD iscount Partnership with Universities and Language SchoolsB ring Your Buddy By referring people you become eligible to receive a bonus for each hireT CS Gems Performance RecognitionX celerate Career platform with free mentoring At TATA Consultancy Services, we promote an inclusive culture and always work towards equity.
  • This applies to gender, people with disabilities, LGBTQIA+, religion, race, ethnicity, that is, all our opportunities are developed with these principles in mind.
  • We think about various actions for inclusion and social responsibility, in order to build a TCS that respects individuality.
  • B e a TCSer!# VempraTCS RGS-9970115

Informações Adicionais

  • Quantidade de Vagas 1
  • Jornada Não Informado
 

Envie esta vaga para um amigo!

 

Cadastro Inicial

Preencha os campos abaixo
  • Ao criar uma conta, você aceita nossa Política de Privacidade e nosso Termo de Adesão
 

Acesse sua Conta

Preencha os campos abaixo

ou acesse com seu provedor
 

Recuperação de Dados de Acesso

Informe seu e-mail cadastrado