Remote Data Engineer — Databricks Lakehouse & AI Pipelines
Posted
Summary
Mid-level data engineer modernizing a 15-year-old legacy data warehouse into a governed Databricks Lakehouse, building and operating batch and streaming pipelines with PySpark and Delta Lake using a medallion (bronze/silver/gold) architecture. Posting is via AgileEngine for a Bogotá, Colombia-based role.
AgileEngine is seeking a Middle Data Engineer to modernize a 15-year-old data warehouse into a governed Databricks Lakehouse. You will design and operate batch and streaming pipelines using PySpark and Delta Lake, applying a medallion architecture across bronze, silver, and gold layers.
You will migrate legacy workloads, validate data parity, and collaborate with DevOps and analytics teams to ensure observability, security, and compliance.