Senior Data Engineer: Databricks, Lakehouse & Streaming
Summary
Senior Data Engineer at AgileEngine in Medellín, Colombia, designing and operating batch and streaming data pipelines on Databricks with PySpark and Delta Lake. The role migrates legacy ETL to a governed Lakehouse, models a medallion architecture for analytics and AI, and focuses on Unity Catalog governance, performance, and data quality.
AgileEngine in Medellín, Colombia is seeking a Senior Data Engineer to design and operate batch and streaming data pipelines on Databricks using PySpark and Delta Lake. You will migrate legacy ETL workloads to a governed Lakehouse and model a medallion architecture powering analytics and AI use cases.
The role requires strong SQL, Python, and experience with Unity Catalog governance, with a focus on performance optimization and data quality. Join a people-first culture and impactful projects.