Senior Data Engineer(Snowflake / PostgreSQL)

Salary: RM 4,600 – RM 6,800 per month

About the Role
Build and operate an enterprise data platform covering ingestion, storage, modeling, orchestration and data serving — ensuring reliability, security and compliance.

Responsibilities

• Design and build batch and real-time data ingestion pipelines (CDC, database, HTTP/TCP, push sources) using NiFi, Kafka, Events Hub and Flink.

• Own Snowflake layered modeling (Landing, Current State, Business layers), performance tuning and cost control.

• Own PostgreSQL schema design, performance optimization and operations; expose data via PostgREST and APIM.

• Build scheduling and transformation workflows with Airflow (Astronomer) and dbt; implement CI/CD via Azure DevOps.

• Implement data security and compliance: RBAC, data masking, encryption, access auditing, data classification and retention.

• Maintain metadata, lineage and data quality via Atlan; set up monitoring and alerting with Splunk and Grafana.

• Support downstream consumers (e.g. Power BI) and work with analysts, BI developers and business teams.

Requirements (meet either track)

• Track A – Databases & Warehousing: 2+ years hands-on Snowflake (virtual warehouses, access model, data sharing, performance/cost optimization); strong PostgreSQL (indexing, execution plans, partitioning, replication, backup/recovery); advanced SQL and data modeling.

• Track B – Integration & Security Compliance: 3+ years data integration (CDC, batch/stream, NiFi/Kafka/Flink or similar); hands-on data security and compliance (RBAC, masking, encryption, auditing, classification) and knowledge of relevant regulations (GDPR, PDPA, PIPL); able to translate compliance requirements into technical controls.

General

• Bachelor's degree or above, preferably in Computer Science or a data-related field.

• Proficient in Python or another programming language; Git and CI/CD practice.

• Strong communication skills; able to collaborate with cross-regional teams in Chinese or English.

Nice to Have

• Airflow, dbt, Astronomer.

• Azure cloud services (Events Hub, APIM, DevOps).

• Atlan or similar data catalog; data quality and lineage management.

• Splunk and Grafana.

• Power BI integration or REST API data services.

• Snowflake, Azure or security certifications.

Tech Stack

• Ingestion: NiFi, Kafka Connector, Events Hub, Flink

• Data: Snowflake, PostgreSQL, PostgREST

• Orchestration: Airflow (Astronomer), dbt, Azure DevOps

• Application & Presentation: APIM, Atlan, Power BI

• Monitoring: Splunk, Grafana