Senior Data Engineer - Remote, Databricks Lakehouse Architect
Posted 2
views
Summary
Senior Data Engineer modernizing a data warehouse into a governed Databricks Lakehouse: building batch and streaming pipelines with PySpark and Delta Lake in a medallion (bronze/silver/gold) architecture, while leveraging AI tools like Claude and GitHub Copilot to speed up development, tests, and documentation.
AgileEngine is seeking a Senior Data Engineer to modernize a data warehouse into a governed Databricks Lakehouse. You will build batch and streaming pipelines with PySpark and Delta Lake, following a medallion architecture across bronze, silver, and gold layers.
You will also leverage AI tools like Claude and GitHub Copilot to speed up development, tests, and documentation. Strong Python and SQL skills are required.