Lead Data Engineer / Data Architect
Posted Updated 2
views
Summary
Lead data engineer/architect role based in Cary, NC, designing and optimizing large-scale batch and streaming data pipelines. Core stack includes Python, Scala, PySpark, Spark, Delta Lake, Databricks, and strong SQL with dimensional and normalized data modeling.
MUST-HAVE SKILLS & EXPERIENCE Programming & Data Engineering Expert - level proficiency in Python, Scala, and PySpark, with a strong track record of designing and delivering production-ready, modular, and well-tested solutions; developing and troubleshooting Spark workloads; and optimizing large-scale batch and streaming data pipelines using Delta Lake and Spark technologies. Strong SQL and data modelling - dimensional and normalised; schema design and data contract definition. Databricks exper…