Data Engineer
Summary
A Data Engineer at Jobtailor designs and optimizes data warehouse solutions, builds ETL/ELT pipelines, manages system integrations, ensures data quality, and supports AI/ML use cases using technologies like data lakes (Delta) and CI/CD.
Responsibilities
- Designing, developing, and optimising data warehouse solutions
- Building and maintaining ETL/ELT pipelines to transform raw data into usable insights
- Developing and managing integrations between systems (including APIs)
- Ensuring data quality, integrity, and consistency across platforms
- Implementing monitoring, alerting, and performance optimisation
- Supporting medallion architecture and modern data lake practices (e.g., Delta Lakes)
- Contributing to CI/CD pipelines, DevOps practices, and source control (Git)
- Collaborating with stakeholders to deliver valuable, data-driven outcomes
- Supporting AI, machine learning, and advanced analytics use cases
- Driving automation across data pipelines and processes
Requirements
- Experience with data warehousing concepts and architectures
- Strong knowledge of ETL/ELT processes and data transformation
- Experience integrating systems using APIs or other methods
- Familiarity with modern data technologies (e.g., Parquet, Delta tables/lakes)
- Ability to perform exploratory data analysis using tools such as Excel or programming languages
- Experience with Git, CI/CD, and DevOps practices
- Strong problem-solving skills and attention to detail
- A collaborative mindset with the ability to work with technical and non-technical stakeholders