Lead Data Engineer
Posted Updated 20
views
Description
Job Description: Python, PySpark, Scala and SQL – strong production-level data engineering skills. Azure Databricks – Delta Lake, Spark performance tuning, Jobs/Workflows and Unity Catalog. Azure data services – ADLS Gen2 and Azure Data Factory (ADF). Lakehouse / Medallion Architecture – proven experience implementing Bronze, Silver and Gold layers at enterprise scale. Data Pipeline Engineering – metadata-driven ingestion frameworks, data transformation, data quality and large-scale pipeline op…
Skills
Sign in to read and join the discussion.