Data Engineer – AWS / Cloud Data Migration
Description
Salary: RM 12,000 – RM 17,000 per month
About the role
We are looking for experienced Data Engineers to support a major data platform transformation and migration project, moving data products and workloads from Microsoft Azure to AWS. You will work on maintaining and optimising the enterprise data warehouse platform, developing and supporting data engineering pipelines, and contributing to the reliability, performance and continuous improvement of cloud-based data platforms.
Key responsibilities
Maintain and optimise the enterprise data warehouse and data platform.
Support the migration of data warehouse capabilities from Microsoft Azure to AWS.
Design, develop, enhance and support data engineering pipelines and data warehouse workloads.
Build and maintain scalable data pipelines for large-scale data processing.
Monitor platform performance and identify opportunities for performance and cost optimisation.
Troubleshoot data platform incidents and contribute to platform reliability.
Apply data warehousing, data modelling and data engineering best practices.
Support data engineers across the organisation in delivering high-quality data solutions.
Work closely with Data Engineers, Architects, Business Stakeholders and other technical teams.
Contribute to continuous improvement of data platform processes and operational practices.
About you
Bachelor's Degree in Computer Science, Software Engineering, Data Engineering, Information Technology or equivalent.
Strong hands-on experience in Python and SQL.
Solid understanding of data warehousing, data modelling and data engineering concepts.
Experience developing and supporting ETL/ELT and data pipelines.
Hands-on experience with AWS data platforms and services, such as AWS Glue, Amazon Redshift, Amazon S3, AWS EMR, Databricks.
Experience with cloud-based data platforms and large-scale data workloads.
Experience with Microsoft Azure is highly advantageous, particularly exposure to Azure-to-AWS/cloud migration.
Good understanding of DevOps and CI/CD, with exposure to tools such as GitHub Actions, Azure DevOps or similar.
Experience in performance optimisation, monitoring and production support within data environments.
Strong troubleshooting and problem-solving skills.