Data & AI Platform Engineer - GenAI Pipelines
Summary
Build and maintain data ingestion and transformation pipelines using Databricks, Kafka, PySpark, and SQL to support analytics, reporting, and GenAI knowledge-base solutions.
Singapore Telecommunications Limited, through its AIDA unit, seeks a data engineer to build data ingestion and transformation pipelines on a modern hybrid cloud platform. You will develop basic batch and streaming pipelines using Databricks and Kafka under guidance from senior engineers.
You will transform data with PySpark and SQL for analytics, reporting, and machine learning use cases, and help implement a knowledge-base and retrieval-augmented generation (RAG) solution to support GenAI