Data Engineer
Summary
Senior Data Engineer on R Systems' Data & Analytics team in Kuala Lumpur, building and optimizing AWS-based data pipelines, ETL/ELT across Data Lake and Data Warehouse environments, and Apache Iceberg datasets, with DR and data governance duties. Core stack: AWS, SQL, Python, PySpark, Terraform, Apache Iceberg.
Location- KL
We are looking for an experienced Senior Data Engineer to join our Data & Analytics team within the Insurance domain.
This role is ideal for a hands‑on data engineer with strong AWS, Data Lake/Data Warehouse, ETL/ELT, PySpark, Python, SQL, Terraform, and Apache Iceberg experience, with an interest in modern AI-enabled software development.
- Design and develop scalable, secure, and high-performing data pipelines
- Build and optimize ETL/ELT processes across Data Lake and Data Warehouse environments
- Develop batch and near real-time data processing solutions
- Design and maintain Apache Iceberg datasets
- Build and support cloud-native data platforms on AWS
- Monitor, troubleshoot, and optimize data pipelines and platform performance
- Support Disaster Recovery (DR), failover/failback, RTO/RPO, and business continuity activities
- Implement data quality, reconciliation, governance, and metadata management controls
- Support AWS DataZone initiatives and enterprise data governance
- Collaborate with Architects, Business Analysts, Data Analysts, BI Developers, Product Owners, and business stakeholders
- Prepare technical documentation, runbooks, solution designs, and data flow diagrams
- Conduct knowledge transfer sessions and mentor junior engineers
- 3+ years of experience in Data Engineering, Data Warehousing, or Data Platform Engineering
- Strong hands‑on experience with SQL, Python, PySpark, and Terraform
- Experience designing and supporting Enterprise Data Lake & Data Warehouse solutions
- Hands‑on experience with Apache Iceberg
- Strong understanding of ETL/ELT, data modeling, and data integration
- Experience with Terraform / Infrastructure as Code
- Understanding of cloud security, IAM, permissions, and access control
- Experience supporting Disaster Recovery and Business Continuity activities
- Knowledge of Generative AI, Agentic AI, and AI‑assisted software development
- Experience using AI‑powered coding assistants to improve engineering productivity and code quality
- Strong analytical, troubleshooting, communication, and problem‑solving skills
Good to Have
- AWS Certifications such as AWS Certified Data Engineer / Solutions Architect / Developer / Cloud Practitioner
- AWS DataZone and enterprise data governance experience
- Data Lakehouse architecture experience
- DevOps, CI/CD, and cloud automation experience
- Experience in Insurance or Financial Services
AWS | Glue | Redshift | S3 | RDS | Step Functions | CloudWatch | IAM | EventBridge | DataZone | SQL | Python | PySpark | Terraform | Apache Iceberg | Data Lake | Data Warehouse | Power BI | Generative AI
Skills
- Agentic AI
- AI
- Analytics
- Automation
- AWS
- CI/CD
- Cloud
- Cloud Native
- Cloud Security
- CloudWatch
- Data Engineering
- Data Governance
- Data Lake
- Data Modeling
- Data Pipelines
- Data Quality
- Data Warehousing
- DevOps
- ELT
- ETL
- Eventbridge
- Generative AI
- IAM
- Iceberg
- Infrastructure as Code
- Lakehouse
- Metadata Management
- Power BI
- PySpark
- Python
- RDS
- Redshift
- S3
- SQL
- Terraform