Lead Big Data & Analytics Engineer (Flexible Hours)
Summary
Design and optimize large-scale data platforms and build data processing pipelines using Spark, Hadoop, and Kafka for an in-house digital technology division.
Sunway Digital Hub, Digital Technology Solutions & Group Cybersecurity – Petaling is seeking a data professional to design and optimize large-scale data platforms. You will develop data processing pipelines using Spark, Hadoop, and Kafka, ensuring data quality and scalable architectures.
Requirements include experience with Python, SQL, Terraform, Docker, and familiarity with Huawei Cloud DLI, Databricks, Airflow, and data warehousing concepts.