Senior Data Engineer - Azure Databricks & Medallion Pipeline
Summary
Senior Data Engineer building and optimizing enterprise data pipelines with Azure Databricks, ADLS, ADF, PostgreSQL, and Azure DevOps in Mexico City, implementing Medallion architecture, data quality controls, and CI/CD in production while collaborating with architects, BI, QA, and analysts.
Papigen is seeking a Senior Data Engineer / Databricks Engineer to design, develop, and optimize enterprise data pipelines using Azure Databricks, ADLS, ADF, PostgreSQL, and Azure DevOps in Mexico City. The role focuses on building ingestion, transformation, and reporting-ready datasets, implementing Medallion architecture, data quality controls, and CI/CD processes in a production environment.
You will collaborate with architects, BI teams, QA, and business analysts to ensure robust pipelines