Azure Data Factory Data Engineer — Scalable ETL Pipelines
Posted Updated
Description
Capgemini Engineering is seeking a Data Engineer with Azure Data Factory expertise to design, develop, and maintain scalable data pipelines. You will collaborate with data analysts, data scientists, and stakeholders to ensure reliable and optimized data for analytics and reporting.
The role requires 3+ years in data engineering, Python proficiency, and strong ETL/ELT knowledge, with familiarity in Azure services and Databricks.
Identify and troubleshoot root causes of failures in pipelines built with Azure Data Factory. Review team monitoring reports to identify issues and create corresponding PBIs for resolution. Monitor the status of Databricks jobs and ADF pipelines. Understand ETL and ELT concepts and apply them in design. Work with Azure Cloud Services, Azure Data Factory and Python / SPARK (Azure Databricks). Bachelor’s degree in CS/Engineering/IS or related field. 3+ years of data engineering experience. Proficiency in Python. Strong understanding of ETL/ELT processes. Experience with Azure Cloud Services, especially Azure Data Factory. Ability to review monitoring reports and create PBIs for fixes. Meaningful projects Continuous learning Career acceleration programsSkills
Sign in to read and join the discussion.