Senior Data Ingestion & AI Platform Engineer
Summary
A senior data engineer at insurer Great Eastern in Singapore who builds and oversees data ingestion pipelines and data lake integration, automating validation, scripts, and reports, and working with data engineering and IT teams to ensure high-availability data delivery using Hadoop, Spark, Hive, and Scala/PySpark.
Great Eastern in Singapore seeks a seasoned Data and AI professional to oversee ingestion pipelines and data lake integration. You will automate validation, scripts, and reports, and collaborate with data engineering and IT teams to ensure high-availability data delivery.
The role requires 8+ years with Hadoop stack, Scala/PySpark, and experience with Spark, Hive, and ETL tools. Knowledge of Autosys/Control-M and cloud platforms is a plus. This is based at SG-GE Centre in Singapore.