Senior Data Engineer
Posted Updated
Summary
Senior Data Engineer building and optimizing scalable data pipelines and ETL/ELT solutions with Azure Databricks, PySpark, SQL, and Delta Lake for a large enterprise client's cloud and data transformation program, plus developing analytics-ready datasets and improving data governance.
You will be working with a leading enterprise organization in driving large-scale cloud and data transformation initiatives.
What you will do
- Build and optimize scalable data pipelines and ETL/ELT solutions using Azure Databricks, PySpark, SQL, and Delta Lake.
- Develop analytics-ready datasets and support reporting and business intelligence needs.
- Collaborate with business and technical teams to deliver reliable, high-quality data solutions.
- Improve data performance, reliability, security, and governance across the platform.
What we are looking for
- Strong experience with Azure, Azure Databricks, PySpark, Spark SQL, SQL, Delta Lake, and ETL/ELT development.
- Experience designing data pipelines, data models, and supporting production environments.
- Ability to work directly with stakeholders and translate business requirements into technical solutions.
- Exposure to Azure Data Factory, Azure Data Lake, Git, CI/CD, and DevOps practices is an advantage.
- Nice to have: Experience with streaming technologies, Kafka, Event Hubs, CDC, Auto Loader, or lakehouse architecture.