Cloud Data Engineer: Build & Optimize Pipelines (Azure/AWS)
Summary
Design and maintain cloud data pipelines on Azure/AWS, automate ETL workflows, and build web scrapers to feed a data lake and warehouse.
Inter Island Group in Kuala Lumpur is seeking a Data Engineer to design and manage robust data pipelines for diverse sources powering our data lake and warehouse.
You will collaborate with analysts to implement transformations, develop web scraping scripts for data acquisition, and automate deployment and testing of pipelines using CI/CD. Proficiency with Azure, AWS, Spark/Hadoop, and data modeling standards is required to ensure data quality, security, and scalable solutions.