Senior Data Engineer - Remote & Flexible Hours
Summary
Senior Data Engineer role to modernize a 15-year-old legacy data warehouse into a governed Databricks Lakehouse, building batch and streaming pipelines with PySpark and Delta Lake across bronze/silver/gold medallion layers. Involves migrating legacy workloads, ensuring data parity, and collaborating with DevOps and analytics teams; remote with flexible hours.
AgileEngine is seeking a Senior Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will build batch and streaming pipelines with PySpark and Delta Lake, leveraging a medallion architecture across bronze, silver, and gold layers. AI tools like Claude and Copilot speed development.
You will migrate legacy workloads, ensure data parity, and collaborate across DevOps and analytics teams to deliver scalable data platforms with strong governance.