Senior Data Engineer
Summary
Senior Data Engineer at a disruptive FinTech in Manchester, building and evolving a Databricks-native data platform on Azure — handling high-volume ingestion and ETL/ELT pipelines with Python, SQL and Spark, plus CI/CD, platform reliability and governance, and support for data science, ML and agentic workflows.
As a Senior Data Engineer in a disruptive FinTech, you will help build and evolve a Databricks-native data platform that supports large-scale data processing and data science workflows. You will work in a cross-functional team to deliver reliable, scalable ingestion, transformation, and platform capabilities, enabling data science and automated workflows. The role focuses on production engineering, platform reliability, and governance within Azure, with opportunities to shape the data foundation for ML and agentic processes. You’ll operate in an output-driven, collaborative environment with autonomy and continuous learning.
Responsibilities- Develop and evolve Databricks-based data pipelines and platform capabilities
- Handle high-volume data ingestion and transformation across the stack
- Build production ETL/ELT pipelines
- Implement APIs, SFTP/FTPS data retrieval
- Contribute to CI/CD, automated testing and deployment processes
- Ensure platform reliability, monitoring and troubleshooting
- Manage Azure infrastructure, security and governance
- Support Data Science, ML, and agentic workflows
- Work within a cross-functional team to move toward a Databricks-native environment
- Databricks experience (essential)
- strong Python, SQL/Spark and ETL/ELT能力
- good knowledge of databases and data warehousing, incl. dimensional/Kimball
- understanding of platform, DevOps and systems engineering
- genuine technical curiosity
- STEM background beneficial but not essential
- collaboration
- curiosity
- autonomy
- Databricks
- Python
- SQL