Senior Data Platform Engineer
Posted 5
views
Summary
Senior Data Platform Engineer for a software house in Kuala Lumpur: builds and optimizes large-scale batch/streaming data pipelines and platform infrastructure using Kafka, Spark, Hadoop, Databricks, Snowflake and cloud (AWS/GCP/Azure), defines data engineering standards, and mentors junior data engineers.
Job Summary:
Our Esteemed and Reputable Client is a software house with presence in Asia Pacific.In this data engineering role, the Senior Data Platform Engineer brings a background in data engineering with detailed responsibilities drafted below:
- Custom development, integration, and performance optimization from group up, extending to the development of service layer infrastructure components, application layer, and data processing, including third-party data integration
- Automate large-scale, high-performance distributed data processing systems (batch/streaming) to drive business growth
- Advocate for high-quality software engineering practices to establish scalable data infrastructure and pipelines
- Contribute to defining shared data engineering tool standards to enhance the productivity
- Provide guidance to Junior Data Engineers
Requirements:
- Min 5+ years of experience as a Data Engineer, or an ETL Developer
- Prior experiences with Java / Scala / Python / SQL
- Experiences with Kafka, Data Lake, Spark, Hadoop, Databricks and Snowflake
- Involvement in end to end data architecture
- AWS/GCP/Azure Cloud serverless integration