Databricks Data Engineer
Posted 1
view
Summary
TechShack is recruiting an experienced Databricks Data Engineer for a 12-month B2B contract with a client in North Dublin (hybrid, 3-4 days onsite). Day to day: design, build and optimise Databricks Lakehouse data pipelines using PySpark, Spark SQL, Delta Lake, Unity Catalog and CI/CD tooling.
Location: North Dublin, Ireland (Hybrid)
Contract: B2B, 12 months
TechShack is partnering with a leading organisation in North Dublin to find an experienced Databricks Data Engineer for a 12-month B2B contract. You’ll join a growing data team to design, build and optimise modern data platforms on Databricks, delivering reliable, scalable pipelines that drive key business decisions.
What you’ll be doing
- Designing, building and maintaining scalable data pipelines on Databricks
- Developing ETL/ELT processes with PySpark, Spark SQL and Delta Lake
- Putting Lakehouse architecture and Medallion (Bronze, Silver, Gold) design patterns in place
- Working with stakeholders to turn business needs into strong data solutions
- Tuning Spark jobs and Databricks clusters for performance and cost
- Setting up data quality, governance and security best practice, including Unity Catalog
- Building CI/CD pipelines and following engineering best practice across the data platform
- Supporting migration of legacy data workloads to Databricks
What we’re looking for
- Strong commercial experience as a Data Engineer with hands‑on Databricks delivery
- Advanced skills in Python/PySpark and SQL
- Solid experience with Delta Lake, Spark and Lakehouse architecture
- Experience with at least one major cloud platform (Azure, AWS or GCP)
- Knowledge of Unity Catalog, Databricks Workflows and Delta Live Tables
- Experience with CI/CD, Git and infrastructure as code (e.g. Terraform)
- Strong communication skills and confidence working directly with stakeholders
- Able to work onsite in North Dublin 3-4 days per week
Nice to have
- Databricks certifications (Data Engineer Professional)
- Experience with streaming data (Structured Streaming, Kafka, Event Hubs)
- Experience with dbt, Airflow or similar orchestration tools
- Background in consultancy or enterprise data delivery
Why apply?
- 12-month contract with a long-term, high-impact data programme
- Work with a modern Databricks Lakehouse stack
- Hybrid working with a collaborative onsite team in North Dublin
- ASAP start for the right candidate