Mid Data Engineer - Databricks Lakehouse (Remote)
Posted
Summary
Mid-level Data Engineer modernizing a data warehouse into a governed Databricks Lakehouse: building batch and streaming pipelines with PySpark and Delta Lake in a medallion (bronze/silver/gold) architecture, and using AI tools like Claude and GitHub Copilot to speed up development.
AgileEngine is seeking a Middle Data Engineer to modernize a data warehouse into a governed Databricks Lakehouse. You will build batch and streaming pipelines with PySpark and Delta Lake, following a medallion architecture across bronze, silver, and gold layers.
You will use AI tools like Claude and GitHub Copilot to speed up development, and collaborate with cross-functional teams to ensure data quality and governance. This is a remote, globally distributed role.