Senior Databricks Data Engineer: Lakehouse & Streaming
Summary
Senior Data Engineer building batch and streaming pipelines on Databricks with PySpark and Delta Lake, migrating legacy workloads to a governed Lakehouse using a medallion architecture for analytics and AI. Requires strong SQL/Python, Unity Catalog governance, and a focus on data quality, observability, and collaboration with DevOps and analytics teams.
AgileEngine in Cartagena, Colombia, seeks a Senior Data Engineer to build batch and streaming pipelines on Databricks using PySpark and Delta Lake. You will migrate legacy workloads to a governed Lakehouse while modeling a medallion architecture that powers analytics and AI use cases.
Strong SQL and Python, plus Unity Catalog governance, complete the profile. The role emphasizes data quality, observability, and collaboration with DevOps and analytics teams to ensure scalable, secure data