Senior Databricks Data Engineer - Lakehouse & ML Pipelines
Summary
Designs, builds, and operates batch and streaming data pipelines on Databricks using PySpark and Delta Lake, migrating legacy workloads to a governed medallion-architecture Lakehouse that powers analytics, dashboards, and AI use cases. Core stack: Databricks, PySpark, Delta Lake, Unity Catalog, SQL, Python.
AgileEngine is seeking a Senior Data Engineer to design, build, and operate batch and streaming data pipelines on Databricks, leveraging PySpark and Delta Lake to migrate legacy workloads to a governed Lakehouse. You will model a medallion architecture powering analytics, dashboards, and AI use cases.
The role requires strong SQL, Python, and experience with Unity Catalog governance, plus collaboration with DevOps and analytics teams to ensure performance, reliability, and data quality.
#J-18808-Ljbffr