Senior Data Engineer
Posted
Summary
Leads a team of 10-12 ETL engineers on a one-time data warehouse migration away from Netezza in Kuala Lumpur — hands-on design, optimization, and execution of ETL pipelines, stored procedures, and batch jobs with data validation and reconciliation. Core stack: SQL, Python, Oracle/Netezza/MS SQL, Talend or NiFi, Hadoop/Cloudera.
We are looking for a Senior ETL Engineer to support a one-time Data Warehouse migration project (Netezza). This role is highly hands-on, focusing on developing, optimizing, and executing ETL pipelines to ensure accurate and efficient data migration.
Key Responsibilities
- Lead and manage a team of 10-12 ETL engineers
- Design, develop, and maintain ETL pipelines (extract, transform, load)
- Perform data extraction from Netezza and load into target systems
- Develop and optimize stored procedures and transformation logic
- Execute migration jobs and support batch processing activities
- Perform performance tuning for ETL jobs and SQL queries
- Troubleshoot data and pipeline issues during migration runs
- Implement data validation checks and support reconciliation
- Work closely with Lead, QA, and business teams to ensure data accuracy
- Prepare technical documentation and job runbooks
Requirements
- 3–5 years of experience as a Data / ETL Engineer
- Strong hands-on experience with databases (Oracle, Netezza, MS SQL)
- Proficient in SQL, Python, and scripting
- Experience with ETL tools such as Talend, NiFi, or similar
- Experience developing stored procedures and ETL workflows
- Strong knowledge of performance tuning and query optimization
- Basic knowledge of Linux/Unix commands
- Experience in Data Warehouse / Data migration projects
- Familiar with Hadoop / Cloudera ecosystem
- Exposure to Data Warehouse and Data Lake environments
Nice to Have
- Banking or financial services experience
- Experience in large-scale or enterprise data migration projects
- Exposure to Huawei stack (GaussDB, MRS)