Senior Data Engineer
Posted 2
views
Summary
Senior Data Engineer at XPT Software Australia (onsite, Denistone West, Ryde Area) building and optimizing big-data pipelines on Azure — Data Lake Gen2, Synapse, and Databricks with PySpark/Spark SQL and complex SQL. The role also involves performance tuning, mentoring junior engineers, and CI/CD via Azure DevOps or GitHub Actions.
Job Description: Must Have Skills: Strong hands‑on experience with Azure Data Lake Gen2, Synapse, Databricks Solid experience in PySpark / Spark SQL, Databricks performance tuning & job optimization Proficient in Complex SQL (window functions, CTEs, execution plans) Strong understanding in Mentoring junior and mid‑level engineers, Communicating trade‑offs to architects and product teams Experience working with Azure DevOps or GitHub Actions Nice to Have Skills: Experience with Streaming & Real‑…