(Senior) Data Engineer (Kafka)

Hi, we're glad you're here! We are hiring to our Aviva Services Excellence Centre! Take a look at our job description - maybe it suits you or one of your friends? As a (Senior) Data Engineer you will be responsible for designing, building and supporting scalable data ingestion and transformation pipelines that power the enterprise Operational Data Store (ODS). You will work within a cloud-native AWS environment, developing event-driven data solutions using Kafka (MSK), AWS Glue and Python-based engineering services. You will collaborate closely with Technical Leads, Solution Architects, API Engineers and Domain Teams to onboard new data domains into the ODS platform using reusable, metadata-driven patterns and enterprise data standards. This role focuses on delivering high-quality, reliable and scalable data pipelines that enable trusted business data across the organisation.

What will you be doing?

• Building and maintaining scalable data pipelines using Kafka/MSK, AWS Glue, Python and PySpark.
• Designing and implementing ingestion, transformation, validation and publishing processes.
• Delivering end-to-end Operational Data Store (ODS) data flows integrating APIs, event streams and batch sources.
• Developing reusable frameworks, metadata-driven solutions and onboarding patterns across business domains.
• Ensuring data quality, integrity, traceability and adherence to enterprise data models and standards.
• Writing clean, testable and maintainable code while participating in code reviews and technical discussions.
• Supporting CI/CD pipelines, monitoring, logging and operational excellence initiatives.
• Identifying opportunities to improve platform performance, scalability and reliability.
• Collaborating with Product Owners, Architects, Domain SMEs and engineering teams to deliver business outcomes.
• Contributing to technical documentation, design artefacts and domain onboarding activities.

What we’re looking for?

• Essential Strong experience in Data Engineering (Senior over 5 years, regular over 3 years).
• Experience with Kafka or event-driven architectures.
• Hands-on experience with AWS services including: AWS Glue, S3, ECS, MSK , Aurora/PostgreSQL.
• Strong Python development skills.
• Experience building ETL/ELT pipelines.
• Good understanding of data modelling concepts.
• Experience working with JSON, Avro and schema-based integrations.
• Familiarity with CI/CD and DevOps practices.
• Knowledge of data quality and data validation techniques.

Desirable

• Experience with Apache Kafka/MSK.
• Experience with CDC technologies such as Debezium.
• Knowledge of metadata-driven data platforms.
• Experience working within Financial Services or Insurance organisations.

In Aviva Services Excellence Centre, we provide:

• Contract of employment
• Performance Bonus
• Private medical care (ENEL-MED)
• Cafeteria system of benefits (e.g. MultiSport card)
• Additional parent privileges - baby leave - 6 weeks leave for second parent
• Shortened working time after parental leave
• Employer-funded group insurance
• Employee Shares Plan
• Extra day off for birthday
• Paid time off to volunteerAdditional leave acquired over the years in the company (even 5 days more in a year)
• Wellbeing Leave - additional two weeks paid leave after 10 years of service
• Psychological support consultations
• Access to the e-learning platforms
• Internal employee referral program
• Hybrid working model from Poland with a few days in Warsaw office per month
• Attractive office location in Warsaw – Gdański Business Center
• Additional entitlements for people with disabilities - Work Without Barriers
• Work environment that promotes diversity – Diversity Charter

We do not require from candidates the date of birth, marital status and attached photos to your CV.