Senior Cloud Data Engineer: Spark, Iceberg & Real-Time
Posted
Summary
Senior Data Engineer at OCBC, a Singapore bank, designing scalable cloud data pipelines, lakehouse solutions with Apache Iceberg, and real-time streaming via Spark Structured Streaming, while modernizing SQL workloads and building ETL/ELT workflows with Python and shell scripting.
OCBC seeks a Senior Data Engineer with cloud-native data engineering expertise on major cloud platforms. You will design scalable data pipelines, implement lakehouse solutions with Apache Iceberg, and build real-time streaming using Spark Structured Streaming.
You will modernize SQL workloads, develop end-to-end ETL/ELT workflows with Python and shell scripting, and contribute to data governance using Open Data Catalogue/OpenMetadata/DataHub.