Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Improving

Lead Data Engineer

Posted Updated

Description

Lead Data Engineer – Databricks & Azure

  • We are looking for a Lead Data Engineer with 5–7 years of experience in Azure, Databricks, and Microsoft Fabric to lead and mentor the data engineering team. The role involves implementing scalable data solutions using Databricks as the core platform, building modern data pipelines, and enabling seamless integration with Microsoft Fabric and Power BI.

Responsibilities & Requirements:

  • Lead and mentor data engineers while driving hands-on technical delivery.
  • Implement approved Databricks and Microsoft Fabric architectures and solutions.
  • Develop metadata-driven bronze, silver, and gold data pipelines.
  • Build reusable batch, incremental, CDC, and streaming ingestion pipelines.
  • Strong hands-on experience with Azure Databricks, PySpark, SQL, and Delta Lake.
  • Experience with Microsoft Fabric, OneLake, Direct Lake, and Power BI integration.
  • Implement data quality checks, reconciliation, source-to-target mapping, and metadata management.
  • Configure Unity Catalog for data governance, access control, auditing, and lineage.
  • Implement CI/CD, automated deployments, and Datadog monitoring.
  • Drive testing, documentation, operational readiness, and knowledge transfer.

Good to have:

  • Experience with MDM and master data integration.
  • Exposure to Azure DevOps or GitHub Actions.
  • Experience with automated data testing and reconciliation frameworks.
  • Experience working with onshore stakeholders and distributed engineering teams.
  • Strong communication, problem-solving, and team leadership skills.
Skills:- Microsoft Fabric, Delta Lake, ETL, Data Pipelines, CDC, PowerBI, CI/CD, Python, ADF and Apache Spark

Skills

What Middle Data Engineering jobs ask for — and how much of it you have →
Apply

See also

Data Engineering jobs by country — openings, pay and top skills →