Information Technology - Lead Data Engineer
Posted Updated
Description
Singapore Airlines Limited is seeking a Lead Data Engineer to architect and build open-source-based data ingestion and MLOps platforms. The role emphasizes handling large and near-real-time datasets with a focus on data quality and automation.
You will design data models, implement robust pipelines, and enable self-service data platform features for business users across cloud and on-prem environments. The position involves collaboration with data scientists and engineers to deliver scalable
Design and develop data engineering services and their ecosystem using distributed databases, orchestration (Airflow), and stream/batch processing (Kafka, Kinesis, Spark). Develop MLOps pipelines and support ML/DL models deployed at scale across cloud and on-premises environments. Build scalable, fault-tolerant data ingestion pipelines and intuitive self-service data platform functions for business users. Lead evaluation of next-generation technologies in data ingestion workflows and contribute to cloud-architecture discussions. BS in Computer Science or related field is required. Advanced degrees (MS/PhD) are highly desirable. 5+ years of experience in data engineering, data ingestion, and pipelines using open-source platforms.Skills
Sign in to read and join the discussion.