Senior Azure Data Engineer: Databricks & PySpark
Summary
The Senior Azure Data Engineer will design, develop, and maintain robust, scalable data pipelines using Databricks, PySpark, Azure Data Factory, and Python. The role focuses on implementing data governance, data quality, and data lineage within enterprise-grade data solutions.
- Design, develop, and maintain robust data pipelines using Databricks, PySpark, Azure Data Factory, and Python.
- Implement scalable data solutions with a strong focus on data governance, data quality, and data lineage.
- Develop and optimize data processing workflows to support reliable and high-quality data delivery.
- Work with cloud-based data engineering technologies to build and maintain enterprise-grade data solutions.
- 10+ years of experience in Data Engineering.
- Strong hands-on experience with Databricks.
- Strong experience with PySpark.
- Experience with Azure Data Factory (ADF).
- Strong Python scripting skills.
- Experience implementing data governance, data quality, and data lineage.
- Proven experience designing and maintaining robust data pipelines.
- Build scalable and reliable data pipelines.
- Apply data governance and data quality principles across data solutions.
- Develop efficient data processing solutions using PySpark and Python.
- Work effectively with Databricks and Azure Data Factory.
- Troubleshoot and optimize data pipelines and processing workflows.
- Opportunity to work on large-scale data engineering solutions.
- Exposure to modern data technologies including Databricks, PySpark, Azure Data Factory, and Python.
- Opportunity to contribute to data governance, data quality, and data lineage initiatives.
- A professional environment focused on building robust and scalable data solutions.
Want to discuss this opportunity in more detail? Feel free to reach out.