Data Engineer
Summary
Capgemini is hiring a Data Engineer in Hong Kong to build and maintain batch and streaming data pipelines end-to-end — from design through production support — using Python/Java, advanced SQL, Spark, Airflow, Kafka, and cloud data platforms (Azure/AWS/GCP), with a focus on data quality, performance, and documentation.
Build and maintain batch and/or streaming data pipelines end-to-end (ingest, transform, validate, publish)
Develop reusable data transformation patterns and curated datasets for analytics and operational use cases
Work from requirements through to production delivery: design, build, test, deploy, and support
Implement data quality checks, reconciliations, and monitoring/alerting to keep data trustworthy
Optimize performance and cost (query tuning, partitioning, efficient compute usage)
Maintain clear documentation, data definitions, and runbooks for supported pipelines
Troubleshoot production issues, perform root cause analysis, and implement permanent fixes
Collaborate with upstream/downstream teams to resolve data issues and improve interfaces/contracts
Follow security and governance expectations for sensitive data (access controls, auditability)
Required skills and experience
- Minimum 5 years of strong hands-on experience delivering data engineering solutions
- Strong programming skills in Python and/or Java experience, with advanced SQL and solid data modelling skills
- Experience with distributed processing (e.g. Spark) and orchestration (e.g. Airflow or equivalent)
- Experience with streaming/event platforms (e.g. Kafka/PubSub) is beneficial; ability to learn quickly if not
- Strong engineering discipline: Git, code reviews, automated testing, CI/CD, and observability
- Experience working with cloud data platforms (Azure/AWS/GCP) and lake/lakehouse/warehouse patterns
- Proven ability to manage multiple data requests, priorities effectively, and deliver at pace
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem.
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem.