Azure Data Engineer - Databricks, PySpark & TB-Scale ETL
Summary
Builds and maintains TB-scale ETL pipelines on Azure Databricks using PySpark and Python, ensuring data quality and lake architecture integrity.
A consulting firm in Colombia is seeking a skilled Data Engineer at the mid-senior level. The ideal candidate will have over 5 years of hands-on experience with Azure Databricks, Spark, and proficient coding in Python and SQL. Responsibilities include developing data processing pipelines, maintaining data lake architecture, and ensuring data quality. This role is a contract position that requires excellent technical writing skills and the ability to manage large-scale data effectively.