Databricks Data Engineer
In this role you will design and maintain data ingestion pipelines in a modern Azure/Databricks environment. You will connect to multiple sources, build robust pipelines, and ensure scalable, reliable data flows for the organization. You’ll implement ingestion strategies, develop ETL/ELT processes, and apply transformation modeling to enable data-driven decisions. This contract role focuses on practical data ingestion and engineering, collaborating with cross-functional teams to support analytics and data platforms. The opportunity offers hands-on work with Databricks, Azure services, and contemporary data architectures to shape data pipelines at scale.
Responsibilities- Build and maintain data ingestion pipelines using Databricks
- Connect to multiple data sources including SQL databases, APIs and Azure services
- Develop pipelines using Azure Data Factory and Databricks Lakeflow
- Implement ingestion strategies including incremental and batch loads
- Develop ETL/ELT processes using Databricks Medallion Architecture
- Write and maintain Python data engineering code
- Use dbt for data transformation and modelling
- Ensure pipelines are scalable, reliable and maintainable
- Strong commercial Databricks experience
- Proven data ingestion experience
- Azure Data Factory
- Databricks Lakeflow
- SQL and API integration
- Medallion Architecture
- Strong Python
- dbt
- Experience with incremental/batch data ingestion
- Databricks
- Azure Data Factory
- Databricks Lakeflow
- SQL
- APIs
- Medallion Architecture