Senior Databricks Engineer: Lakehouse Data Platform Lead
Summary
A senior data engineer leads the design, build, and operation of batch and streaming data pipelines on Databricks using PySpark and Delta Lake. The role models a medallion architecture, migrates legacy ETL workloads to a governed Lakehouse with Unity Catalog, and collaborates with DevOps and analytics teams.
AgileEngine is seeking a Senior Data Engineer to design, build, and operate batch and streaming pipelines on Databricks using PySpark and Delta Lake. You will model a medallion architecture and migrate legacy ETL workloads to a governed Lakehouse, ensuring data parity and governance with Unity Catalog.
Strong SQL and Python are required, along with experience in Spark, Delta Lake, and orchestration tools. You will collaborate with DevOps and analytics teams to maintain high reliability and
#J-18808-Ljbffr