Vaga de parceiro

Senior Data Engineer - Campinas / SP

Disponível para Assinantes
Salvar nos Favoritos
  • Compartilhe:

Detalhes da Vaga

  • Escolaridade Não Informado
  • Segmento Não Informado
  • Salário Não Informado
  • Área de AtuaçãoDiversos / Outros

O que você irá fazer

  • The role holder will design and implement data acquisition strategies and will own and extend the businesss data pipeline through the collection, storage, processing, and transformation of large datasets.
  • This role will lead the data architecture in the LatAm region and manage a small team to implement this strategy.
  • To be successful in this role, you will need to have excellent analytic skills related to working with structured, semi-structured, and unstructured datasets, expert SQL knowledge, and experience with relational as well as NoSQL database systems.
  • You must have expert-level programming skills in Python/PySpark, and it would be beneficial to have experience in Java/Scala programming.
  • RequirementsUniversity Degree in Computer Science, Information Systems, Statistics, or related field.
  • Expertise with Data Lake/Big Data Projects implementation in Cloud (preferably MS Azure) and/or On-premise platforms.
  • Experience with Cloud Azure technology stack: ADLS Gen2, Databricks EventHub, Stream Analytics, Synapse Analytics, AKS, Key Vault; On-Premise: Spark, HDFS, Hive, Hadoop distributions (Cloudera or MapR), Kafka, Airflow (or any other scheduler).
  • Experience with designing and building lakehouse architectures in Parquet/Delta and Synapse Serverless or Databricks SQL (knowledge of Unity Catalogue is a big plus).
  • Ability to develop, maintain and distribute code in a modularized fashion; working experience with DevOps framework.
  • Very good understanding of Software Development Lifecycle, source code management, code reviews, etc.
  • Experience in performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Experience in building processes supporting data transformation, data structures, metadata, dependency, and workload management.
  • Ability to collaborate across different teams/geographies/stakeholders/levels of seniority; energetic, enthusiastic, and results-oriented personality.
  • Customer focus with an eye on continuous improvement.
  • Motivation and ability to perform as a consultant in data engineering projects.
  • Ability to work independently but also within a team; leadership skills to develop teams strategy & a team of 3 people; strong will to overcome the complexities involved in developing and supporting data pipelines; agile mindset.
  • Language Requirements: English - Fluent spoken and written Spanish Nice to have.
  • Key ResponsibilitiesDevelopment & Lead data engineers (3 people).
  • Building scalable, performant, supportable, and reliable data pipelines; you must enjoy optimizing data systems as well as building them from the ground up.
  • Setting up new and monitoring existing metrics, analyzing data, and in cooperation with other Data & Analytics team members to identify and implement system and process improvements.
  • Supporting the collection of metadata into our data catalogue system where all available, ensuring data is maintained and cataloged accurately; defining and implementing DevOps framework using CI/CD.
  • Working closely with big data architects, data analysts, data warehouse engineers, and data scientists.
  • Supporting and promoting Agile way of working using SCRUM framework.
  • #J-18808-Ljbffr

Informações Adicionais

  • Quantidade de Vagas 1
  • Jornada Não Informado
 

Envie esta vaga para um amigo!

 

Cadastro Inicial

Preencha os campos abaixo
  • Ao criar uma conta, você aceita nossa Política de Privacidade e nosso Termo de Adesão
 

Acesse sua Conta

Preencha os campos abaixo

ou acesse com seu provedor
 

Recuperação de Dados de Acesso

Informe seu e-mail cadastrado