Lead Data Engineer - Databricks
Summary
Lead Data Engineer responsible for designing and optimizing Databricks-based ETL pipelines, mentoring engineers, and ensuring scalable data integration across systems. Focuses on medallion architecture, dimensional modeling, and cross-functional collaboration to support analytics and reporting.
At OZ we are looking for a Lead Data Engineer who will:
- Serve as the technical lead for the project-owning solution design decisions, guiding implementation standards, and mentoring other engineers through coaching, reviews, and knowledge sharing.
- Design, develop, and maintain complex ETL pipelines using Databricks, ensuring scalable, high-performance data integration across multiple source systems.
- Implement and optimize medallion architecture within Databricks, establishing clear data zones (raw, curated, trusted) to support governed, enterprise-wide reporting.
- Develop and refine dimensional data models that enable unified, analytics-ready views of business domains and support automated dashboarding and KPI frameworks.
- Collaborate closely with cross-functional teams (data stewards, IT, business stakeholders) to translate operational requirements into technical solutions, proactively clarifying dependencies and driving alignment.
- Contribute to architectural decisions, leveraging your expertise to recommend best practices, challenge assumptions, and ensure data platform durability and flexibility.
- Identify and address integration challenges, data quality issues, and process bottlenecks early, providing actionable insights and thoughtfully pushing back when project risks or inefficiencies arise.
- Support knowledge transfer and documentation, empowering colleagues and clients to maintain and evolve data solutions independently.