Data Engineer
Posted Updated
Summary
Data Engineer with 4-7+ years' experience designing scalable ingestion pipelines, historical migrations/backfills, and monitoring for enterprise data platforms. Core stack: Python, SQL, Apache Spark, data lake formats (Iceberg/Delta Lake/Hudi) and orchestrators like Airflow.
Data Engineer
Job Summary
We are looking for a
Data Engineer
with 4-7+ years of experience in building and maintaining scalable data pipelines. You will be responsible for designing data ingestion solutions, managing historical data loads, ensuring data reliability, and supporting enterprise data platforms. Key Responsibilities
Data Engineering
Design and develop data pipelines to ingest data from APIs, databases, and enterprise systems. Build and maintain data ingestion frameworks for centralized data platforms. Develop solutions for data recovery, replay, and pipeline resilience. Ensure data quality through deduplication, incremental loading, and handling late-arriving data. Data Migration & Backfill
Perform historical data migrations and large-scale backfills. Validate migrated data and reconcile it with source systems. Support historical data loading for newly onboarded business units or sites. Monitoring & Support
Create dashboards and monitoring solutions for data pipelines. Implement automated alerts and remediation processes. Troubleshoot production issues and participate in on-call support rotations. Governance & Collaboration
Work with stakeholders to define data requirements and data contracts. Ensure compliance with data governance, security, and retention policies. Maintain technical documentation and operational runbooks. Participate in code reviews and contribute to engineering best practices. Required Skills & Experience
Technical Skills
4-7+ years of experience in Data Engineering. Strong programming skills in
Python
and
SQL . Experience building data pipelines from APIs and relational databases. Hands-on experience with: Change Data Capture (CDC) Incremental data loading Data migration and historical backfills Strong experience with
Apache Spark . Experience with modern data lake technologies such as: Apache Iceberg Delta Lake Apache Hudi Experience with workflow orchestration tools: Apache Airflow Dagster Prefect Strong knowledge of: Linux Docker Git Experience supporting production environments and resolving incidents. Preferred Experience
Experience managing on-premise or self-hosted data platforms. Understanding of data governance, security, and access controls. Experience implementing data contracts with upstream systems. Exposure to large-scale time-series or telemetry data. Familiarity with: Airbyte Debezium Kafka Connect dlt Nice-to-Have Skills
Kubernetes Trino or other distributed SQL engines S3-compatible object storage (MinIO, Ceph, Dell ObjectScale) Experience integrating Finance, HR, Procurement, or ERP systems If you are eager to contribute your IT skills to a respected company in the relevant sector, we encourage you to apply today!
Contact: Lily Tran (Lic No: R24123492/ EA no:18S9099) Phone number: +65 64169807
Job Summary
We are looking for a
Data Engineer
with 4-7+ years of experience in building and maintaining scalable data pipelines. You will be responsible for designing data ingestion solutions, managing historical data loads, ensuring data reliability, and supporting enterprise data platforms. Key Responsibilities
Data Engineering
Design and develop data pipelines to ingest data from APIs, databases, and enterprise systems. Build and maintain data ingestion frameworks for centralized data platforms. Develop solutions for data recovery, replay, and pipeline resilience. Ensure data quality through deduplication, incremental loading, and handling late-arriving data. Data Migration & Backfill
Perform historical data migrations and large-scale backfills. Validate migrated data and reconcile it with source systems. Support historical data loading for newly onboarded business units or sites. Monitoring & Support
Create dashboards and monitoring solutions for data pipelines. Implement automated alerts and remediation processes. Troubleshoot production issues and participate in on-call support rotations. Governance & Collaboration
Work with stakeholders to define data requirements and data contracts. Ensure compliance with data governance, security, and retention policies. Maintain technical documentation and operational runbooks. Participate in code reviews and contribute to engineering best practices. Required Skills & Experience
Technical Skills
4-7+ years of experience in Data Engineering. Strong programming skills in
Python
and
SQL . Experience building data pipelines from APIs and relational databases. Hands-on experience with: Change Data Capture (CDC) Incremental data loading Data migration and historical backfills Strong experience with
Apache Spark . Experience with modern data lake technologies such as: Apache Iceberg Delta Lake Apache Hudi Experience with workflow orchestration tools: Apache Airflow Dagster Prefect Strong knowledge of: Linux Docker Git Experience supporting production environments and resolving incidents. Preferred Experience
Experience managing on-premise or self-hosted data platforms. Understanding of data governance, security, and access controls. Experience implementing data contracts with upstream systems. Exposure to large-scale time-series or telemetry data. Familiarity with: Airbyte Debezium Kafka Connect dlt Nice-to-Have Skills
Kubernetes Trino or other distributed SQL engines S3-compatible object storage (MinIO, Ceph, Dell ObjectScale) Experience integrating Finance, HR, Procurement, or ERP systems If you are eager to contribute your IT skills to a respected company in the relevant sector, we encourage you to apply today!
Contact: Lily Tran (Lic No: R24123492/ EA no:18S9099) Phone number: +65 64169807