Data Engineer (ESG)
Summary
Build and maintain data pipelines and warehouses for a Singapore government agency, ensuring clean, secure, and accessible datasets for analytics and policy work.
About the role
This role involves developing and managing data pipelines and structured datasets to support analytics and data science initiatives. You will work within the Enterprise Singapore team to ensure data remains accessible, accurate, and reliable for various business stakeholders.
Key facts
- Location: Singapore
- Engagement: 2-year fixed term contract
- Team: Enterprise Singapore
What you'll do
- Design and construct ingestion pipelines to aggregate and standardize data from various systems.
- Manage database capacity, monitor system performance, and perform maintenance to ensure high uptime.
- Create and test reusable data models to facilitate downstream analytics.
- Build secure access mechanisms for data warehouse users.
- Evaluate and implement new technologies to enhance agency data infrastructure.
- Partner with data stewards to apply governance policies and maintain a comprehensive data catalogue.
- Perform data validation and reconciliation to maintain high quality standards.
- Apply security protocols such as encryption, masking, and access controls to protect sensitive information.
- Coordinate with cross-functional teams, including product managers and data scientists, to translate requirements into technical solutions.
- Align technical stacks and infrastructure with government IT security standards.
Requirements
- Proficiency in Python, Java, or Scala.
- Advanced SQL skills for database management.
- Experience in system design, data modeling, and data structure/algorithm implementation.
- Practical knowledge of cloud platforms including AWS, Azure, or Google Cloud.
- Background in architecting IT and data systems.
- Experience with distributed computing technologies like Spark or Hadoop.
- Familiarity with DevOps practices including Docker, Git, and Terraform.
- Experience with CI/CD pipeline implementation.
- Strong understanding of ETL/ELT workflows and data warehousing practices.
Nice to have
- Bachelor degree in Computer Science, Software Engineering, Data Engineering, Information Technology, or a related field.
- Experience building both batch and real-time data pipelines.
- Proficiency with Databricks.
- Prior experience with government data governance, security policies, and infrastructure.
- Experience implementing formal data quality and security frameworks.
Skills & tools
- Python, Java, Scala, SQL
- AWS, Azure, Google Cloud, Databricks
- Spark, Hadoop
- Docker, Git, Terraform
- CI/CD pipelines
- ETL/ELT orchestration
Practical notes
- This position operates under a total rewards compensation model including leave benefits and wellness programs.
- Flexible work arrangements are available depending on the specific requirements of the role.