[Job-32192] Senior Data Engineer - Databricks
Summary
Senior Data Engineer at CI&T building and maintaining large-scale data pipelines in Databricks (PySpark, Delta Lake, SQL), integrating data from APIs, relational databases, and files while ensuring data quality, governance, and DataOps practices (Git, CI/CD, testing). Also mentors peers and collaborates with data scientists and analysts; advanced English is essential.
At CI&T, we help large enterprises transform the potential of AI into real business impact with AI Deployment, AI-native execution, and tech-integrated business solutions.
With 30 years of experience in technological transformation, we accelerate innovation with expertise in Agentic SDLC, Application modernization, Data & AI, Martech and Business strategy.
We are 8,000 CI&Ters across more than 25 countries, collaborating to build solutions with real impact. AI is already part of how we work, evolve, and innovate every day.
We are looking for a Senior Data Developer with strong knowledge in developing and maintaining data pipelines in Databricks, Medallion Architecture, integrating and transforming data from various sources, such as APIs, relational databases, files, and many others!
As a senior member of the team, you will also provide technical guidance, mentor peers, and collaborate with cross-functional teams including data scientists, analysts, and platform engineers.
As a Senior Data Developer, you will lead the design and development of robust data pipelines, integrating and transforming data from diverse data sources such as APIs, relational databases, and files. Collaborating closely with business and analytics teams, you will ensure high-quality deliverables that meet the strategic needs of our organization.
Your expertise will be pivotal in maintaining the quality, reliability, security and governance of the ingested data, therefore driving our mission of Collaboration, Innovation, & Transformation.
Key Responsibilities
-
Develop and maintain data pipelines.
-
Integrate data from various sources (APIs, relational databases, files, etc.).
-
Collaborate with business and analytics teams to understand data requirements.
-
Ensure quality, reliability, security and governance of the ingested data.
-
Follow modern DataOps practices such as Code Versioning, Data Tests and CI/CD.
-
Document processes and best practices in data engineering.
Required Skills and Qualifications
Must-have Skills
-
Proven experience in building and managing large-scale data pipelines in Databricks (PySpark, Delta Lake, SQL).
-
Strong programming skills in Python and SQL for data processing and transformation.
-
Deep understanding of ETL/ELT frameworks, data warehousing, and distributed data processing.
-
Hands-on experience with modern DataOps practices: version control (Git), CI/CD pipelines, automated testing, infrastructure-as-code.
-
Familiarity with cloud platforms (AWS, Azure, or GCP) and related data services.
-
Strong problem-solving skills with the ability to troubleshoot performance, scalability, and reliability issues.
-
Proficiency in Git.
-
Advanced English is essential.
Nice-to-have Skills
-
Experience with data contracts, schema evolution, and ensuring compatibility across services.
-
Expertise in data quality frameworks (e.g., Great Expectations, Soda, dbt tests, or custom-built solutions).
-
Integration with Power BI.
Skills
As published by lever · 21 questions
Basics
Resume/CV, Full name, Pronouns, Email, Phone, Current location, Current company, LinkedIn URL
Short answers (7)
- If the previous answer is Yes, please share the name(s) of these individuals. optional
- What is your salary expectation for this position? (Brazilian Reals - CLT)
- How comfortable do you feel working in an English-speaking environment?
- Confirm the name of the company where you work/ Confirme o nome da empresa em que você trabalha atualmente
- What is your salary expectation? Only the numeric value (no currency, text, or benefits)/ Qual é a sua pretensão salarial? Apenas o valor numérico (sem moeda, texto ou benefícios).
- If you feel comfortable, please share your current or last salary and benefits / Caso se sinta confortável, compartilhe seu salário atual ou ultimo e benefícios optional
- Which city/state do you currently reside in? Qual cidade/estado reside atualmente? optional
Pick from a list (13)
- How did you hear about our job opening? optional
- Do you have any relatives (such as parents, siblings, in-laws, spouses, or children, stepchildren, stepfather/stepmother, son-in-law/daughter-in-law), close friends, or acquaintances (with whom you have a significant and ongoing relationship) who currently work at CI&T? optional
- Do you have availability for on-site work at the Campinas office (Brazil) every day? Just for informational purposes, in case your application is considered for other open positions. optional
- Do you require any type of accessibility for the selection process and/or in your daily life?? optional
- The answers below are optional. This data will be used for our affirmative actions. Considering this scenario, do you feel comfortable answering the questions below? optional
- Would you like to tell us your gender identity? optional
- Are you part of the LGBTQIAP+ community? optional
- How do you self-declare your color/race? optional
- Are you a person with disabilities? optional
- If so, tell us what type of disability you have optional
- [EN] What is your level of confidence when communicating and collaborating in an English-speaking work environment? optional
- [ES] What is your level of confidence when communicating and collaborating in an Spanish-speaking work environment? optional
- By selecting the option below, I declare that I have read, understood, and agree to the terms of this document, and I consent to the processing of my personal data by CI&T and Lever for the purposes described herein. Read the document here: https://drive.google.com/file/d/1dMaskYl2VD1AtN9MfiHrZiA-YFYwq8aI/view optional
Attachments (1)
- IMPORTANT! If you answered that you are a person with a disability, this step is mandatory. Attach the medical report here optional