Senior Data Engineer: Spark, Databricks & AWS Pipelines
Summary
A senior data engineer designs, develops, and maintains scalable ETL/ELT data pipelines for structured and semi-structured data on AWS, using Databricks, PySpark, and Apache Spark for large-volume processing. Strong SQL and Python skills with a focus on performance, reliability, and data quality are core to the role.
NOVACLOUD SYSTEMS PTE. LTD. is seeking a data engineer to design, develop and maintain scalable data pipelines for structured and semi-structured data. You will leverage Databricks, PySpark, and Apache Spark for large-volume processing and build robust ETL/ELT workflows across AWS.
Expertise in SQL and Python with a focus on performance, reliability, and data quality is required, along with experience in Delta Lake and Delta Live Tables where available.
