Data Engineer — AI-Driven Pipelines & Delta Lake
• Designing, developing, and optimising data warehouse solutions
• Building and maintaining ETL/ELT pipelines to transform raw data into usable insights
• Developing and managing integrations between systems (including APIs)
• Ensuring data quality, integrity, and consistency across platforms
• Implementing monitoring, alerting, and performance optimisation
• Supporting medallion architecture and modern data lake practices (e.g., Delta Lakes)
• Contributing to CI/CD pipelines, DevOps practices, and source control (Git)
• Collaborating with stakeholders to deliver valuable, data-driven outcomes
• Supporting AI, machine learning, and advanced analytics use cases
• Driving automation across data pipelines and processes
Requirements
- Experience with data warehousing concepts and architectures
- Strong knowledge of ETL/ELT processes and data transformation
- Experience integrating systems using APIs or other methods
- Familiarity with modern data technologies (e.g., Parquet, Delta tables/lakes)
- Ability to perform exploratory data analysis using tools such as Excel or programming languages
- Experience with Git, CI/CD, and DevOps practices
- Strong problem-solving skills and attention to detail
- A collaborative mindset with the ability to work with technical and non-technical stakeholders
ATS Optimization Keywords
Below are skills and terms extracted directly from this job posting to improve Applicant Tracking System (ATS) visibility. This unique feature helps candidates tailor their applications more effectively — a feature exclusive to JobTailor job listings.
Hard Skills
- data warehousing
- ETL
- ELT
- API integration
- data quality
- performance optimisation
- CI/CD
- DevOps
- data analysis
- automation
Soft Skills
- problem-solving
- attention to detail
- collaboration
- stakeholder engagement