Senior Data Engineer
Summary
Designs and optimizes scalable ETL/ELT and real-time Kafka pipelines in Snowflake for a cloud-based platform, ensuring data integrity and performance while collaborating with cross-functional teams.
Senior Data Engineer - Snowflake & Kafka
Portugal, Mostly Remote
We are working with an established technology consultancy that is looking to hire two Senior Data Engineers for a major data modernisation programme.
You will join a team responsible for designing, building and optimising the data pipelines supporting a new cloud-based platform. The work will cover both batch and real-time data, with Snowflake serving as the core data warehouse and Kafka/Confluent supporting streaming data ingestion and processing.
What you’ll be doing
- Designing, building and maintaining scalable ETL/ELT pipelines
- Developing and optimising data models within Snowflake
- Ingesting and processing real-time data using Kafka and Confluent
- Building reliable data transformation and integration processes
- Ensuring data quality, integrity and performance throughout the data lifecycle
- Working closely with architects, analysts and other technical stakeholders
- Contributing to cloud-native data solutions within an Azure environment
What we’re looking for
- Strong commercial experience as a Senior Data Engineer
- Deep, hands-on experience with Snowflake
- Strong practical experience with Kafka and/or Confluent
- Excellent SQL skills
- Experience using Python for data engineering
- Experience building cloud-native data platforms and pipelines
- A strong understanding of data modelling, transformation and performance optimisation
- The ability to work independently and communicate effectively with technical and non-technical stakeholders
Desirable experience
Any of the following would be beneficial, but they are not essential:
- Kafka Streams, KStreams, KSQL or ksqlDB
- Microsoft Azure
- Airflow or another orchestration platform
- Insurance, banking or wider financial-services experience
- Guidewire or other policy administration systems
- Consultancy or client-facing delivery experience
- CI/CD and DevOps practices
Location and working arrangements
The position is mostly remote, but applicants must already be living in Portugal and within reasonable reach of either Lisbon or Porto for very occasional meetings.
Portuguese language skills are not required; the working language is English.
This is an excellent opportunity for an experienced Data Engineer to join a significant data transformation programme and work with modern cloud, warehouse and real-time streaming technologies.
Apply now for a confidential conversation.