Senior Data Engineer - Remote, Databricks Lakehouse
Summary
Senior Data Engineer who will migrate a 15-year-old data warehouse to a governed Databricks Lakehouse, building batch and streaming pipelines with PySpark and Delta Lake using a medallion architecture. The role involves clean Python/SQL development, data governance, and using AI tools like Claude and GitHub Copilot to speed up work.
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and startups across 17+ industries.
We are seeking a Senior Data Engineer to transform a 15-year-old data warehouse into a governed Databricks Lakehouse, building batch and streaming pipelines with PySpark and Delta Lake. You will implement a medallion architecture and leverage AI tools like Claude and GitHub Copilot to accelerate development, while writing clean Python/SQL and ensuring governance and