Senior GCP Data Engineer
Summary
12-month B2B contract through consultancy emagine, building scalable batch and real-time data platforms for a telecommunications client on GCP. Day to day: designing end-to-end streaming architectures with Kafka and Flink, plus data lakes and ETL/ELT pipelines using Python, Spark, and SQL.
Details:
Industry: Telecommunications
Work model: Remote
Team Size: Approximately 10 people
Assignment type: B2B
Project Duration: 12 months, starting ASAP
The role of the Senior GCP Data Engineer revolves around building scalable data platforms for the telecommunications industry, contributing to a critical project at the onset of team development.
Responsibilities:
Design and build scalable batch and real-time data platforms.
Develop high-throughput, event-driven streaming pipelines processing large volumes of events per second.
Implement end-to-end streaming architectures.
Work with temporal joins, watermarks, state management, checkpointing, and exactly-once processing.
Monitor backpressure and optimize pipeline performance.
Design and develop data lakes, ETL/ELT pipelines and analytics-ready data platforms.
Write production-ready code and successfully complete live coding assessments.
Must Haves:
Strong Google Cloud Platform (GCP) Data Engineering experience.
Strong hands-on coding skills.
Proven streaming experience.
Experience with Apache Kafka and Apache Flink.
Proficiency in Python, Spark, PySpark, and SQL.
Experience with Hadoop and Snowflake, including data lakes and ETL/ELT pipelines.
Fluent in English.
Nice to Haves:
Experience with Agile methodologies.
Keen problem-solving abilities.
Familiarity with telecom industry standards.