Lead Data Engineer in Cloud Data Systems
Summary
Lead Data Engineer designing a multi-tier cloud lakehouse and enterprise data platform for a national broadband infrastructure: building pipelines from on-prem databases and APIs, setting governance, quality, and CI/CD standards, and mentoring engineers. Core stack includes Python, Scala, SQL tuning, Salesforce integration, and cloud data systems.
You will be pivotal in creating an enterprise data platform that consolidates diverse data into scalable architectures. This involves setting governance standards, building data pipelines, and establishing performance metrics for continuous improvement. Your leadership will shape the engineering practices that support BI and AI initiatives across the organization.
Key Responsibilities: • Design and deliver a multi-tier lakehouse architecture • Create reliable data pipelines from on-prem databases and APIs • Implement data governance and quality assurance mechanisms • Define CI/CD processes and infrastructure standards • Develop reusable architecture patterns while mentoring teams
Requirements: • Over 10 years of data engineering experience • At least 4 years leading technology initiatives • Proficiency in Python, Scala, and SQL tuning • Experience integrating cloud environments with Salesforce • Strong knowledge of enterprise data governance principles
Lead the transformation of data engineering practices with your expertise in governance and cloud architectures.