Data Engineer (MSF)

Data Engineer (MSF) at GovTech

About the role In this position, you will be responsible for constructing and overseeing the data infrastructure that underpins analytics and strategic decision-making within the organization. The role requires close collaboration with various business units and technical teams to develop scalable solutions that convert raw data into meaningful insights, thereby enhancing operational efficiency and effectiveness.

Key facts

• Location: Singapore
• Engagement: 2-year fixed-term contract

What you'll do

• Collaborate with stakeholders to gather and analyze requirements, transforming them into technical specifications that guide data architecture design.
• Design and implement comprehensive data pipelines that facilitate the movement of data across raw, technical, and business layers, ensuring seamless integration.
• Develop and deploy automated workflows that support both batch and real-time data processing, optimizing performance and resource utilization.
• Continuously monitor and enhance existing data infrastructure to maintain high levels of performance, reliability, and cost-effectiveness.
• Create data models utilizing various structures, including star, snowflake, and wide table formats, to support diverse analytical needs.
• Implement Slowly Changing Dimension (SCD) strategies to effectively manage and track historical data changes over time.
• Identify and resolve data quality issues and pipeline failures, ensuring data integrity and availability for end-users.
• Work with cross-functional teams to ensure that data solutions align with organizational goals and meet compliance standards.
• Document processes and maintain clear communication with team members and stakeholders to facilitate knowledge sharing and project continuity.
• Stay updated with industry trends and emerging technologies to continuously improve data engineering practices within the organization.
• Participate in code reviews and provide constructive feedback to peers, fostering a culture of continuous improvement and learning.
• Assist in training and mentoring junior data engineers, sharing expertise and best practices to enhance team capabilities.

Requirements

• A minimum of 3 to 5 years of hands‑on experience in data engineering or analytics roles, demonstrating a solid understanding of data processes.
• Proven ability to design and implement complex data pipelines that meet business requirements and technical specifications.
• Strong proficiency in Python, particularly with data manipulation libraries such as pandas and numpy, as well as experience in API development.
• Advanced SQL skills for effective querying, data transformation, and database management, ensuring optimal data access and performance.
• Familiarity with data modeling concepts, including Slowly Changing Dimensions (SCD), to manage evolving data structures.
• Knowledge of various data architecture patterns, including Data Lakes, Data Warehouses, Data Lakehouses, and Data Mesh, to inform design decisions.
• Experience with data ingestion processes, quality assurance practices, and orchestration tools to streamline data workflows.
• Excellent problem‑solving skills and the ability to troubleshoot complex data issues in a timely manner.
• Strong communication skills, enabling effective collaboration with both technical and non‑technical stakeholders.

Nice to have

• Experience working with Databricks for data processing and analytics, enhancing the efficiency of data workflows.
• Familiarity with AWS cloud services and managed analytics tools, contributing to cloud‑based data solutions.
• Understanding of infrastructure‑as‑code principles and DevOps practices, promoting automation and efficiency in data engineering processes.

Skills & tools

• Proficient in Python (including libraries like pandas and numpy)
• Strong SQL capabilities
• Expertise in Data Modeling (Star/Snowflake/Wide Table)
• Knowledge of Data Pipeline Orchestration techniques
• Familiarity with Data Governance and Lineage practices

Practical notes

GovTech offers a comprehensive rewards package that includes wellness programs and various leave benefits to support employee well‑being. The organization is committed to fostering a flexible work environment, allowing for adaptable work arrangements based on the specific requirements of the role. This commitment to flexibility ensures that employees can maintain a healthy work‑life balance while contributing effectively to the team and the organization's objectives.