Senior Data Engineer
Summary
Senior Data Engineer in Kuala Lumpur building and operating an enterprise data platform: ingestion pipelines, Snowflake layered warehouse modelling, PostgreSQL, data APIs, monitoring and data governance. Applicants qualify via one of two tracks: data warehouse & database, or data integration & security compliance (NiFi/Kafka/Flink, RBAC, PDPA/GDPR).
Important Notice: This role has TWO tracks. You only need to meet ONE track’s criteria to apply. Please clearly state Track A or Track B in your application.
Track A: Data Warehouse & Database
Track B: Data Integration & Data Security Compliance
About the Role
You will build, operate and maintain our enterprise data platform, covering end-to-end workflow: data ingestion, data modelling, data transformation, API service delivery, monitoring and data governance. You are responsible for platform stability, query performance, cloud cost control and adherence to regional data privacy regulations.
Key Responsibilities
Design and develop multi-source data ingestion pipelines (CDC, direct database connection, HTTP/TCP, push feed) using NiFi, Kafka Connector, Events Hub, Flink for batch and real-time data integration
Build Snowflake layered data warehouse modelling (Landing / Current State / Business layer), conduct performance tuning and cost governance
Design, optimise and maintain PostgreSQL databases; expose data APIs via PostgREST + APIM for downstream teams
Develop and schedule data transformation pipelines with Airflow (Astronomer) & dbt; implement CI/CD workflow on Azure DevOps
Deliver data security & compliance controls: RBAC permission management, data masking, encryption, access audit, data classification and retention policy, support external & internal compliance audits
Maintain metadata, data lineage and data quality rules via Atlan; build monitoring & alerting dashboards with Splunk and Grafana
Collaborate with analysts, BI developers and business stakeholders, support downstream systems including Power BI and troubleshoot data issues
Job Requirements
You may apply for EITHER Track A OR Track B, satisfy only one track.
Track A: Data Warehouse & Database
Bachelor's degree in Computer Science, Information Technology or related discipline
3+ years hands-on Snowflake experience: virtual warehouse setup, permission model, data sharing, performance tuning and cost optimisation
Strong PostgreSQL skills: index tuning, execution plan analysis, table partitioning, replication, backup & disaster recovery
Advanced SQL skills, practical experience with dimensional modelling or layered data warehouse modelling
Track B: Data Integration & Data Security Compliance
Bachelor's degree in Computer Science, Information Technology or related discipline
3+ years data integration experience, familiar with CDC, stream & batch processing; hands-on experience with NiFi / Kafka / Flink or equivalent tools
Proven experience implementing data security controls: RBAC, data masking, encryption, access audit and data classification
Familiar with data protection laws including PDPA, GDPR; able to translate compliance requirements into technical controls and pass audits
Mandatory Common Requirements (for both tracks)
Proficient in Python or other programming language
Practical hands-on experience with Git and CI/CD pipelines
Able to communicate and collaborate cross-region in English OR Mandarin
Preferred Skills (Bonus)
What We Offer
- Attractive remuneration package
- Flexible working arrangement
- Exposure to regional cross-border enterprise data projects
We provide end-to-end IT consulting, integration, software development, EIV/ODC projects, maintenance, testing, and staffing. Serving key industries worldwide, we deliver large-scale solutions from Beijing.
We provide end-to-end IT consulting, integration, software development, EIV/ODC projects, maintenance, testing, and staffing. Serving key industries worldwide, we deliver large-scale solutions from Beijing.