Senior Databricks Engineer: Lakehouse Data Platform Lead
Summary
A senior data engineer role focused on designing, building, and operating batch and streaming data pipelines on Databricks using PySpark and Delta Lake. Day to day involves modeling a medallion-architecture Lakehouse, migrating legacy ETL workloads, and enforcing governance with Unity Catalog.
AgileEngine is seeking a Senior Data Engineer to design, build, and operate batch and streaming pipelines on Databricks using PySpark and Delta Lake. You will model a medallion architecture and migrate legacy ETL workloads to a governed Lakehouse, ensuring data parity and governance with Unity Catalog.
Strong SQL and Python are required, along with experience in Spark, Delta Lake, and orchestration tools. You will collaborate with DevOps and analytics teams to maintain high reliability and