Data Engineer
Contract Opportunity | Data & AI Consultancy | Databricks
yLocation: Fully Remote – U
KStart: ASA
g
The Opportuni
tyPrimus Connect is working with a growng Data & AI Consultancy that is delivering modern data platforms and Databricks solutions for a range of enterprise client
s.They are expanding their engineering capability and are looking for a Mid-Level Data Engineer with strong commercial Databricks and Spark experience to join an active delivery tea
m.This is a hands-on engineering position where you will take ownership of data pipeline development, work with modern Databricks technologies and collaborate closely with senior engineers and wider delivery team
s.
Key Responsibilit
- iesDesign, build and maintain ETL/ELT data pipelines using Databricks, PySpark and Spark
- SQLDevelop and optimise Delta Lake tables using Bronze, Silver and Gold medallion architect
- ureIngest data from a variety of source systems into Databri
- cksWrite clean, maintainable and well-tested Python/data engineering c
- odeImplement data quality checks, validation and monitor
- ingParticipate in code reviews and collaborative developm
- entContribute to CI/CD pipelines for data engineering worklo
- adsWork with senior engineers to deliver scalable data platform soluti
- onsCollaborate with technical, analytics and business stakehold
- ersParticipate in Agile ceremonies and delivery activit
- enceCommercial experience building data pipelines using Databr
- icksStrong PySpark and Spark SQL sk
- illsSolid Python experience within data enginee
- ringPractical experience with Delta
- LakeUnderstanding of medallion architecture and modern data platform princi
- plesExperience working with Azure, AWS or
- GCPGood understanding of Git and collaborative development pract
- icesExperience working within Agile delivery environm
- entsStrong communication skills and the ability to work effectively in a remote