Lead / Principal Data Engineer – Snowflake & dbt
Description
Role : Lead / Principal Data Engineer – Snowflake & dbt
Employment Type: Contract
Experience: 12–15 years preferred
About the Role
Our client is looking for an experienced Lead / Principal Data Engineer – Snowflake & dbt to support enterprise data engineering and modernisation initiatives. The ideal candidate will have strong hands-on expertise in Snowflake, dbt, advanced SQL, and modern data engineering practices.
This role involves developing and optimising scalable data transformation pipelines, modernising legacy data systems, and ensuring data accuracy, performance, and reliability. The successful candidate will take ownership of complex technical deliverables, provide technical guidance to other engineers, and contribute to architectural and implementation decisions.
This is a primarily hands-on engineering role, requiring strong problem-solving skills, independent decision-making, and the ability to deliver high-quality solutions with minimal supervision.
Key Responsibilities
- Design, develop, and maintain scalable data transformation pipelines using Snowflake and dbt.
- Build and optimise complex SQL queries, dbt models, reusable macros, and Jinja templates.
- Develop structured data models across staging, intermediate, core, and reporting layers.
- Analyse existing legacy data processing systems and modernise them using Snowflake and dbt.
- Investigate data discrepancies, troubleshoot pipeline failures, and implement reliable solutions.
- Optimise query performance, warehouse utilisation, and data processing efficiency.
- Implement data quality checks, automated testing, reconciliation, and validation processes.
- Maintain code quality, documentation, version control, and deployment standards using Git/GitHub and CI/CD workflows.
- Take end-to-end ownership of assigned engineering deliverables, from requirement analysis to production deployment.
- Conduct code reviews, mentor engineers, and provide technical guidance to the offshore development team.
- Collaborate with architects, technical leads, business analysts, and other stakeholders to deliver effective solutions.
- Identify technical risks, improve existing processes, and adopt modern engineering tools and practices, including AI-assisted development where appropriate.
Required Qualifications and Experience
- Bachelor's degree in Computer Science, Information Technology, Software Engineering, or a related field.
- 12–15 years of overall experience in data engineering, data warehousing, ETL/ELT, or related software engineering roles preferred.
- At least 5 years of substantial hands-on experience with Snowflake in production environments.
- At least 5 years of hands-on experience with dbt Core and/or dbt Cloud.
- Advanced proficiency in SQL, including complex joins, CTEs, window functions, aggregations, and query optimisation.
- Strong experience developing dbt models, incremental models, reusable macros, Jinja templates, and data transformation frameworks.
- Solid understanding of data modelling, enterprise data warehousing, and modern ETL/ELT architectures.
- Experience with data migration, legacy system modernisation, data reconciliation, and troubleshooting complex data issues.
- Strong knowledge of Git/GitHub, version control, code reviews, testing, and structured software release practices.
- Previous experience in a Senior, Lead, Staff, or Principal Data Engineer role, or equivalent technical leadership experience.
- Ability to independently analyse requirements, design solutions, and deliver production-ready implementations.
- Strong analytical, problem-solving, communication, and collaboration skills.
Preferred Skills
- Experience with Python for data processing, automation, and testing.
- Familiarity with AWS services, particularly Amazon S3 and cloud-based data ingestion.
- Experience migrating legacy data pipelines from Microsoft SQL Server, PostgreSQL, SSIS, or other ETL platforms.
- Knowledge of CI/CD automation, dbt Fusion, and modern dbt development environments.
- dbt Analytics Engineering Certification or dbt Architect Certification.
- Experience with AI-assisted coding tools such as Claude Code or GitHub Copilot.
- Familiarity with enterprise ETL tools such as KNIME and experience working with multi-client data platforms.
- Experience working with JIRA and Agile delivery methodologies.
Ideal Candidate Profile
The ideal candidate is a technically strong, hands-on engineer who combines deep Snowflake and dbt expertise with practical architectural knowledge and technical leadership capabilities. They should be comfortable solving complex data engineering challenges independently, taking ownership of deliverables, mentoring team members, and maintaining high standards of code quality and data reliability.
Interested candidates with strong hands-on Snowflake, dbt, and advanced SQL experience are encouraged to apply.
Send your CV careers@talentstudio.io
Skills
Sign in to read and join the discussion.