Remote Senior Data Engineer - Databricks Lakehouse
Summary
AgileEngine is hiring a Senior Data Engineer to modernize a 15-year data warehouse into a governed Databricks Lakehouse, designing batch and streaming pipelines with PySpark and Delta Lake using a medallion architecture, while using AI tools like Claude and GitHub Copilot to speed up development.
AgileEngine is seeking a Senior Data Engineer to modernize a 15-year data warehouse into a governed Databricks Lakehouse. You will design batch and streaming pipelines with PySpark and Delta Lake, applying a medallion architecture for analytics and ML workflows.
You will also leverage AI tools like Claude and GitHub Copilot to accelerate development, while enforcing data governance, quality checks, and scalable best practices in a distributed, remote-friendly environment.