Senior Data Engineer
Posted Updated 7
views
Summary
Senior Data Engineer at OCBC (Singapore bank) building cloud-native data pipelines and lakehouse solutions using Spark, PySpark, Apache Iceberg, and streaming systems. Day-to-day involves ETL/ELT development with Python, SQL, and Linux scripting, plus data governance and pipeline modernization.
We are seeking a highly skilled and motivated
Senior Data Engineer
with expertise in
cloud-native data engineering
on any major cloud platform. The ideal candidate will have hands-on experience with
Spark, PySpark, Iceberg, streaming systems, and open data catalogue/governance frameworks
. This role is suitable for individuals with
minimum 3 years of relevant industry experience
and have strong fundamentals, high learning agility, and a passion for building modern data systems. Key Responsibilities Cloud-Native Data Engineering Design and build scalable, reliable data pipelines using native services provided by the chosen cloud platform.
Implement data lakehouse solutions using
Apache Iceberg
and open, interoperable metadata/catalogue frameworks.
Modernize existing data processing pipelines with cloud-first architectural principles.
Streaming & Real-Time Processing Develop and maintain
real-time streaming pipelines
using the platform's native streaming, messaging, and event ingestion services.
Build structured streaming logic using
Spark Structured Streaming
or equivalent cloud-native stream processing tools.
Migration & Modernization Participate in the migration of complex SQL workloads and legacy processing systems into a cloud-native architecture.
Optimize SQL and transformation logic to leverage cloud-scalable compute and storage.
Data Engineering & Automation Build end-to-end ETL/ELT workflows using
Python
and
Unix/Linux shell scripting
.
Write efficient SQL for complex data transformations and analytics.
Develop automated data quality checks, validation processes, and operational monitoring.
Data Governance & Catalogue Leverage open-source catalogue/governance solutions (e.g.,
Open Data Catalogue, OpenMetadata, DataHub
) to ensure lineage, metadata capture, and data accessibility.
Support data governance practices across domains and teams.
Collaboration & Delivery Work closely with analysts, data scientists, and stakeholders to deliver robust, scalable data solutions.
Troubleshoot pipeline issues, ensure data reliability, and optimize processing performance.
Continuously explore new technologies and best practices within the data engineering ecosystem.
Why Join Imagine being part of a team that builds innovative digital solutions for one of Asia's leading banks. As a Software Engineer at OCBC, you'll have the opportunity to work on cutting-edge projects that transform the way we deliver financial services. You'll be part of a collaborative team that values creativity, innovation, and continuous learning. How you succeed To succeed in this role, you'll need to be passionate about software development and committed to delivering high-quality solutions. You'll work closely with cross-functional teams to understand business requirements, design and develop software applications, and ensure seamless integration with existing systems. Your ability to collaborate, innovate, and adapt to changing requirements will be key to your success. What you do - Design, develop, and test software applications using various programming languages and technologies - Collaborate with business stakeholders to understand requirements and develop solutions that meet their needs - Work with cross-functional teams to ensure seamless integration with existing systems - Participate in code reviews and contribute to the improvement of the overall code quality - Troubleshoot and resolve technical issues in a timely and efficient manner Who you are - A degree in Computer Science, Information Technology, or a related field - At least 3 years of experience in software development, preferably in a banking or financial services environment - Proficient in one or more programming languages, such as Java, Python, or C++ - Experience with Agile development methodologies and version control systems such as Git - Strong problem-solving skills, with the ability to analyze complex technical issues and develop creative solutions - Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams
Senior Data Engineer
with expertise in
cloud-native data engineering
on any major cloud platform. The ideal candidate will have hands-on experience with
Spark, PySpark, Iceberg, streaming systems, and open data catalogue/governance frameworks
. This role is suitable for individuals with
minimum 3 years of relevant industry experience
and have strong fundamentals, high learning agility, and a passion for building modern data systems. Key Responsibilities Cloud-Native Data Engineering Design and build scalable, reliable data pipelines using native services provided by the chosen cloud platform.
Implement data lakehouse solutions using
Apache Iceberg
and open, interoperable metadata/catalogue frameworks.
Modernize existing data processing pipelines with cloud-first architectural principles.
Streaming & Real-Time Processing Develop and maintain
real-time streaming pipelines
using the platform's native streaming, messaging, and event ingestion services.
Build structured streaming logic using
Spark Structured Streaming
or equivalent cloud-native stream processing tools.
Migration & Modernization Participate in the migration of complex SQL workloads and legacy processing systems into a cloud-native architecture.
Optimize SQL and transformation logic to leverage cloud-scalable compute and storage.
Data Engineering & Automation Build end-to-end ETL/ELT workflows using
Python
and
Unix/Linux shell scripting
.
Write efficient SQL for complex data transformations and analytics.
Develop automated data quality checks, validation processes, and operational monitoring.
Data Governance & Catalogue Leverage open-source catalogue/governance solutions (e.g.,
Open Data Catalogue, OpenMetadata, DataHub
) to ensure lineage, metadata capture, and data accessibility.
Support data governance practices across domains and teams.
Collaboration & Delivery Work closely with analysts, data scientists, and stakeholders to deliver robust, scalable data solutions.
Troubleshoot pipeline issues, ensure data reliability, and optimize processing performance.
Continuously explore new technologies and best practices within the data engineering ecosystem.
Why Join Imagine being part of a team that builds innovative digital solutions for one of Asia's leading banks. As a Software Engineer at OCBC, you'll have the opportunity to work on cutting-edge projects that transform the way we deliver financial services. You'll be part of a collaborative team that values creativity, innovation, and continuous learning. How you succeed To succeed in this role, you'll need to be passionate about software development and committed to delivering high-quality solutions. You'll work closely with cross-functional teams to understand business requirements, design and develop software applications, and ensure seamless integration with existing systems. Your ability to collaborate, innovate, and adapt to changing requirements will be key to your success. What you do - Design, develop, and test software applications using various programming languages and technologies - Collaborate with business stakeholders to understand requirements and develop solutions that meet their needs - Work with cross-functional teams to ensure seamless integration with existing systems - Participate in code reviews and contribute to the improvement of the overall code quality - Troubleshoot and resolve technical issues in a timely and efficient manner Who you are - A degree in Computer Science, Information Technology, or a related field - At least 3 years of experience in software development, preferably in a banking or financial services environment - Proficient in one or more programming languages, such as Java, Python, or C++ - Experience with Agile development methodologies and version control systems such as Git - Strong problem-solving skills, with the ability to analyze complex technical issues and develop creative solutions - Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams