Data Engineer (Snowflake & Kafka)
Posted Updated 1
view
Summary
A 6-month contract Data Engineer role (posting calls it Data Analyst) placed by recruiter Lorien with a leading UK banking client. Day-to-day work centers on building scalable data pipelines and warehousing with Snowflake, Airflow, Kafka, AWS (S3, Lambda), and Python, plus mentoring and code reviews.
Our UK leading banking client are looking for a Data Analyst to join their team on an initial 6-month contract.
Core Technical Requirements
- Strong experience with Snowflake for data warehousing, including writing efficient SQL and managing schemas.
- Proficiency in Airflow for orchestration and workflow management.
- Hands-on experience with AWS services, particularly S3 for storage and Lambda for serverless processing.
- Familiarity with Kafka concepts (producers, consumers, topics) and ability to integrate with streaming data pipelines.
- Solid understanding of data modelling, ETL/ELT processes, and performance optimization.
- Proficiency in Python for data engineering tasks and automation.
- Ability to design and implement scalable, maintainable data pipelines.
- Experience with version control systems (e.g., Git) and collaborative development workflows.
- Ability to lead technical initiatives within the team and drive best practices.
- Experience in mentoring junior engineers, providing guidance on coding standards, design patterns, and career development.
- Comfortable with code reviews and fostering a culture of continuous improvement.
Best Practices & Mindset
- Strong grasp of data quality principles, including validation and monitoring.
- Ability to read, understand, and refactor existing code effectively.
- Familiarity with CI/CD practices for data pipeline deployment.
- Comfortable working in cloud-native environments and following security/compliance standards.
Nice-to-Have
- Exposure to streaming data architectures and event-driven systems.
- Knowledge of Snowflake performance tuning and cost optimization.