Data Engineer
Posted Updated
Description
X4 Technology is seeking a Data Engineer (GCP) to lead data-engineering efforts in a hybrid role in North Rhine-Westphalia. You will drive migrations from legacy ETL and data warehouses to Google Cloud, design orchestration strategies, and build scalable Dataproc pipelines in Spark/PySpark while ensuring data integrity and performance.
The role requires fluent German and English, strong GCP experience, and solid Python/PySpark development skills.
Provide technical leadership on GCP data engineering solutions focusing on BigQuery, Dataproc and Cloud Composer. Support migration of legacy ETL and data warehouse workloads to Google Cloud. Develop scalable Dataproc (Spark/PySpark) pipelines while preserving business logic. Collaborate with engineering and migration teams to validate data pipelines during testing and deployment. Optimize BigQuery datasets and Dataproc workloads for performance and cost efficiency. Proven hands-on experience with GCP data technologies (BigQuery, Dataproc, Cloud Composer/Airflow). Strong Python and/or PySpark development for data pipelines. Solid understanding of Airflow design, scheduling, dependencies, and SQL modelling.Skills
Sign in to read and join the discussion.