Senior Data Engineer: Scale Pipelines, Spark & Data Lakes
Summary
Design, build, and optimize scalable data pipelines using Databricks, Spark, and Delta Lake for analytics and ML workloads, ensuring data quality and governance.
Capgemini Engineering Colombia is seeking a data engineer to design, build, and optimize data pipelines for analytics. You will work with Databricks, Spark, and Delta Lake to ensure data quality and scalable architectures, collaborating with data scientists and analysts on ML workloads.
The role emphasizes data governance, security, and production support. Responsibilities include integrating data from diverse sources, supporting CI/CD workflows, and contributing to data migration and