Senior Data Engineer: Synapse to Databricks (Remote)
Posted
Summary
Fully remote 2-month contract migrating an Azure Synapse Dedicated SQL Pool codebase to Databricks: refactoring ~72 T-SQL procedures, optimising Spark/PySpark queries, and validating datasets for downstream consumption. Core stack: Azure Synapse, Databricks, T-SQL, PySpark.
Consult is seeking a Senior Data Engineer for a fully remote, 2-month contract to migrate an Azure Synapse Dedicated SQL Pool codebase to Databricks, delivering parity or improved performance and ensuring data accuracy.
You will refactor ~72 T-SQL procedures, optimise Spark/PySpark queries and validate datasets for downstream consumption, addressing architecture differences between Synapse and Databricks.