Senior Data Engineer: Spark on AWS and Cloud Modernisation
Summary
Senior Data Engineer designing, building, and optimizing large-scale Spark/PySpark data pipelines on AWS (Glue, S3, Airflow, DBT, Presto), migrating legacy systems to modern cloud architectures.
Xpert Consulting T/A Novon is seeking a seasoned Data Engineer to design, build, and optimise large-scale data pipelines using Spark and PySpark in an enterprise environment.
You'll work with AWS-native data solutions including Glue, Glue Catalog, S3, Airflow, DBT, and Starburst/Presto, migrating legacy assets to modern cloud architectures, ensuring data quality, performance, and scalable delivery while collaborating closely with architects and stakeholders.