Senior Data Engineer - Remote Databricks Lakehouse
Summary
A Senior Data Engineer will migrate a 15-year-old legacy data warehouse to a governed Databricks Lakehouse, designing batch and streaming pipelines with PySpark and Delta Lake across bronze/silver/gold layers. They own data quality, governance, and performance while moving legacy workloads with minimal disruption.
AgileEngine is seeking a Senior Data Engineer to transform a 15-year-old data warehouse into a governed Databricks Lakehouse. You will design batch and streaming pipelines with PySpark and Delta Lake across bronze, silver, and gold layers, leveraging AI tools to accelerate development.
You will own data quality, governance, and performance, partner with analytics teams, and help migrate legacy workloads while preserving data parity and minimizing disruption.