Senior Databricks Engineer | Hybrid Data Platform Architect
Summary
Senior Data Engineer building batch and streaming pipelines on Databricks with PySpark and Delta Lake, migrating legacy workloads to a governed Lakehouse using a medallion architecture. Core stack includes Databricks, PySpark, Delta Lake, SQL, Python, and Unity Catalog, with focus on data quality, observability, and compliance.
AgileEngine seeks a Senior Data Engineer to build batch and streaming pipelines on Databricks using PySpark and Delta Lake. You will migrate legacy data workloads to a governed Lakehouse, modeling a medallion architecture powering analytics and AI use cases.
Strong SQL, Python, and Unity Catalog governance will round out the role. You will design pipelines, maintain data quality, and collaborate with DevOps and analytics engineers to ensure observability, security, and compliance while
#J-18808-Ljbffr