Data Engineer, Big Data (18-months contract)
Summary
The Data Engineer will design, build, and maintain scalable ETL pipelines and data models using big data technologies like Hadoop and Spark. This 18-month contract role involves collaborating with stakeholders to deliver BI insights and ensuring data quality and security.
This is an 18-months contract.
As a Data Engineer, you will design, build, and maintain scalable data pipelines and analytics solutions to support business decision-making. You will work closely with business and technical stakeholders to translate data requirements into robust data models, ETL pipelines, and BI dashboards, while ensuring data quality, security, and governance.
Responsibilities
- Design and maintain ETL pipelines and data models for large-scale datasets
- Analyze complex data and deliver insights through BI dashboards and reports
- Collaborate with stakeholders to translate business requirements into technical solutions
- Build and maintain CI/CD pipelines for data platforms
- Ensure data quality, security, and compliance
- Troubleshoot data issues and optimize pipeline performance
Requirements
- Experience with big data technologies (e.g. Hadoop, Spark, Hive)
- 5+ years of experience in data engineering or related roles
- Strong SQL expertise; experience with Python and/or Java
- Solid understanding of data warehousing, ETL design patterns, and data modeling
- Experience with cloud data platforms (e.g. GCP, BigQuery, AWS, Azure)
- Familiarity with BI tools (Tableau, Power BI, Looker)