Azure Data Engineer
Summary
Build and maintain scalable data pipelines using Databricks, PySpark, Azure Data Factory, and Python, ensuring data governance and quality for enterprise solutions.
- Design, develop, and maintain robust data pipelines using Databricks, PySpark, Azure Data Factory, and Python.
- Implement scalable data solutions with a strong focus on data governance, data quality, and data lineage.
- Develop and optimize data processing workflows to support reliable and high-quality data delivery.
- Work with cloud-based data engineering technologies to build and maintain enterprise-grade data solutions.
What You Bring to the Table
- 10+ years of experience in Data Engineering.
- Strong hands-on experience with Databricks.
- Strong experience with PySpark.
- Experience with Azure Data Factory (ADF).
- Strong Python scripting skills.
- Experience implementing data governance, data quality, and data lineage.
- Proven experience designing and maintaining robust data pipelines.
You should possess the ability to
- Build scalable and reliable data pipelines.
- Apply data governance and data quality principles across data solutions.
- Develop efficient data processing solutions using PySpark and Python.
- Work effectively with Databricks and Azure Data Factory.
- Troubleshoot and optimize data pipelines and processing workflows.
What We Bring to the Table
- Opportunity to work on large-scale data engineering solutions.
- Exposure to modern data technologies including Databricks, PySpark, Azure Data Factory, and Python.
- Opportunity to contribute to data governance, data quality, and data lineage initiatives.
- A professional environment focused on building robust and scalable data solutions.