Senior Software Engineer (f/m/d) - Databricks Data Engineering & Analytics (part-/full-time)
Gruppe Deutsche Börse Senior Software Engineer (f/m/d) - Databricks Data Engineering & Analytics (part-/full-time)
Summary
A senior data engineer who designs and builds production-grade data pipelines on Databricks (on GCP) using Spark SQL, Python/Scala, Delta Lake, and Databricks Workflows. The role also involves optimizing lakehouse architecture, mentoring colleagues, and raising engineering standards across the Data Development team.
In this role you design and build production-grade data pipelines on Databricks in a cloud-native environment, driving scalable analytics and reliable data flows. You will help raise the capabilities of the Data Development team and shape engineering standards across the organization. You’ll work to optimize lakehouse architectures and mentor colleagues, delivering impact that supports Europe’s green future. This position combines hands-on data engineering with teaching and governance, within a collaborative, international team.
Leistungen / Benefits- attractive salary package
- childcare
- meal allowance
- job ticket
- sports and leisure events
- flexible hybrid work concept
- Design and implement production-grade data pipelines on Databricks (GCP) using Databricks Workflows, Spark SQL, and Python
- Lead adoption of Databricks best practices, including Delta Lake optimization, Photon acceleration, cost governance, and performance tuning
- Architect scalable lakehouse solutions supporting analytics and operational workloads using medallion architecture and data mesh principles
- Mentor the team through code reviews, pairing, and knowledge-sharing sessions
- Document and teach practices to enable team independence
- Hands-on production Databricks experience (1+ years)
- ETL/ELT pipeline development with Apache Spark (PySpark or Scala)
- Delta Lake design, optimization, and troubleshooting
- Databricks Workflows for orchestration
- Performance tuning, cost optimization, and monitoring
- Backend data engineering: distributed data pipelines; Python and/or Scala; SQL
- Git-based version control, CI/CD, and testing for data code
- Cloud experience with Google Cloud Platform (or AWS/Azure)
- Analytical thinking and trade-off evaluation
- Fluent Business English and German (intermediate minimum)
- strong communication with non-technical stakeholders
- mentoring and collaborative mindset
- problem solving with a focus on scalable, reliable solutions
- Databricks
- Spark (PySpark/Scala)
- Delta Lake