Senior Data Engineer

Senior Data Engineer

📌 Important Notice: This role has TWO tracks. You only need to meet ONE track’s criteria to apply. Please clearly state Track A or Track B in your application.

Track A: Data Warehouse & Database

Track B: Data Integration & Data Security Compliance

About the Role

You will build, operate and maintain our enterprise data platform, covering end-to-end workflow: data ingestion, data modelling, data transformation, API service delivery, monitoring and data governance. You are responsible for platform stability, query performance, cloud cost control and adherence to regional data privacy regulations.

Key Responsibilities

• Design and develop multi-source data ingestion pipelines (CDC, direct database connection, HTTP/TCP, push feed) using NiFi, Kafka Connector, Events Hub, Flink for batch and real-time data integration

• Build Snowflake layered data warehouse modelling (Landing / Current State / Business layer), conduct performance tuning and cost governance

• Design, optimise and maintain PostgreSQL databases; expose data APIs via PostgREST + APIM for downstream teams

• Develop and schedule data transformation pipelines with Airflow (Astronomer) & dbt; implement CI/CD workflow on Azure DevOps

• Deliver data security & compliance controls: RBAC permission management, data masking, encryption, access audit, data classification and retention policy, support external & internal compliance audits

• Maintain metadata, data lineage and data quality rules via Atlan; build monitoring & alerting dashboards with Splunk and Grafana

• Collaborate with analysts, BI developers and business stakeholders, support downstream systems including Power BI and troubleshoot data issues

Job Requirements

You may apply for EITHER Track A OR Track B, satisfy only one track.

Track A: Data Warehouse & Database

• Bachelor’s degree in Computer Science, Information Technology or related discipline

• 3+ years hands-on Snowflake experience: virtual warehouse setup, permission model, data sharing, performance tuning and cost optimisation

• Strong PostgreSQL skills: index tuning, execution plan analysis, table partitioning, replication, backup & disaster recovery

• Advanced SQL skills, practical experience with dimensional modelling or layered data warehouse modelling

Track B: Data Integration & Data Security Compliance

• Bachelor’s degree in Computer Science, Information Technology or related discipline

• 3+ years data integration experience, familiar with CDC, stream & batch processing; hands-on experience with NiFi / Kafka / Flink or equivalent tools

• Proven experience implementing data security controls: RBAC, data masking, encryption, access audit and data classification

• Familiar with data protection laws including PDPA, GDPR; able to translate compliance requirements into technical controls and pass audits

Mandatory Common Requirements (for both tracks)

• Proficient in Python or other programming language

• Practical hands-on experience with Git and CI/CD pipelines

• Able to communicate and collaborate cross-region in English OR Mandarin

Preferred Skills (Bonus)

Airflow, dbt, Astronomer, Azure Services (Events Hub, APIM, DevOps), Atlan, Splunk, Grafana, Power BI, REST API development, Snowflake / Azure / cybersecurity certifications

What We Offer

• Attractive remuneration package

• Flexible working arrangement

• Exposure to regional cross-border enterprise data projects

Please feel free to contact Cathy Liu via WhatsApp 601151165891 for further detail.