Data Engineer – Databricks | Taguig City
Summary
An experienced Data Engineer designs, builds, and maintains Databricks-based data pipelines and ETL processes, monitors data quality, and serves as a Databricks subject matter expert. Core stack: Databricks (Unity Catalog, Delta Live Tables, Auto Loader), Python/PySpark, SQL, and Azure Data Factory.
About the role
We are looking for an experienced Data Engineer with strong expertise in Databricks to design, develop, and maintain data solutions, pipelines, and ETL processes. The role will work closely with multiple teams to improve data accessibility, quality, and processing efficiency while providing technical expertise and solutions to complex data engineering requirements.
Key responsibilities
Develop, optimize, and maintain data pipelines and ETL processes.
Work with Databricks to build and manage scalable data solutions.
Monitor and troubleshoot data quality and pipeline issues.
Implement corrective actions to ensure reliable data processing.
Collaborate with cross-functional teams on data engineering initiatives.
Provide technical solutions and guidance to the team.
Participate in key technical decisions and contribute to data-related projects.
Document data processes, workflows, and technical solutions.
Serve as a subject matter expert in Databricks and data engineering.
About you
5+ years of experience in Data Engineering, with strong hands-on experience in Databricks.
Expert knowledge of Databricks Unified Data Analytics Platform.
Experience with Databricks Unity Catalog.
Experience with Delta Live Tables (DLT).
Experience with Auto Loader.
Python / PySpark experience.
SQL experience.
Experience with Azure Data Factory.
Strong understanding of data modeling and database design.
Experience with ETL, data integration, and data warehousing.