Senior Data Engineer 02
Senior Data Engineer
Workload: Full-time
Duration: TBD (long-term)
Location: Europe (No RF / No RB)
Rate: up to 23 USD/hour
Project
Our client is a large dropshipping company that receives product catalogs from 50+ suppliers in various formats. The goal is to build a scalable data platform that automatically ingests, validates, transforms, and distributes product data to downstream systems.
A major challenge is inconsistent data quality across suppliers. The engineer will help establish a Single Source of Truth, implement automated data quality checks, and migrate existing ETL processes from Talend to a modern cloud-native stack.
Responsibilities
Design and build scalable data pipelines for product data ingestion and transformation.
Develop a centralized data platform serving as the Single Source of Truth.
Automate ingestion of supplier feeds from multiple file formats and sources.
Build data quality validation and monitoring processes.
Create reporting on data quality issues for external suppliers.
Design reusable and maintainable ETL/ELT frameworks.
Migrate existing Talend ETL jobs to the new platform.
Optimize pipeline performance and reliability.
Collaborate with business and engineering teams on data integration requirements.
Build infrastructure using Infrastructure as Code.
Tech Stack
Python
Google BigQuery
Dataform
Cloud Composer (Apache Airflow)
Terraform
Requirements
5+ years of experience as a Data Engineer.
Strong Python development skills.
Hands-on experience with BigQuery.
Experience building modern ETL/ELT pipelines.
Experience with Cloud Composer (or strong Apache Airflow background).
Experience with Infrastructure as Code using Terraform.
Strong SQL skills.
Experience designing data models and scalable data architectures.
Experience working with messy, inconsistent, or high-volume datasets.
Knowledge of data quality validation, reconciliation, and monitoring.
Experience migrating legacy ETL solutions is a strong advantage.
Ability to work independently and design technical solutions.
Nice to Have
Dataform experience.
Talend migration experience.
Experience with product catalogs or e-commerce data.
Experience with dropshipping, retail, or supply chain data.
Experience working with multiple third-party data providers.