Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Brightwater Recruitment

NewBe an early applicant

Senior Data Engineer

Posted

Description

Senior Data Engineer


Our client is an established international (re)insurance organisation investing in a new technology and innovation team in Dublin. We are supporting an exciting greenfield build-out and are looking for a Data Engineering Lead to help shape a modern, cloud-native data platform from the ground up.


About the Company


Our client operates across global markets, providing specialist risk solutions to businesses across a range of industries. The organisation combines technical expertise, advanced analytics and sophisticated risk modelling to support complex underwriting and business decisions.

With a strong focus on innovation and long-term growth, the company is investing in modern data infrastructure to enhance its analytical capabilities and support the development of new technology-driven solutions.


About the Position


This is a rare opportunity to join a genuine greenfield environment, building a modern data platform without the constraints of extensive legacy systems or complex migrations.

As a Senior Data Engineer, you will report to the senior leadership team responsible for risk analytics and data science. You will play a central role in designing and implementing the organisation’s data platform, working within a small, multidisciplinary team of actuaries, data scientists, AI engineers and platform engineers.


The platform will be built on AWS and will integrate a broad range of internal and external datasets to support risk analytics, complex modelling workflows and proprietary business applications.

This is a senior individual contributor role, ideal for an experienced data engineer who enjoys combining hands-on development with architectural decision-making. As the first dedicated engineer on the platform, you will help establish the architecture, tooling and engineering standards that underpin its future development.


Key Responsibilities


Data Platform Ownership & Architecture


  • Play a central role in the design and ongoing evolution of the data platform.
  • Implementation of core platform components, including pipeline frameworks, data models and shared libraries.
  • Follow engineering standards focused on data quality, reliability, scalability and maintainability.
  • Design schemas and storage structures across different layers of the platform.


Data Engineering & Delivery


  • Translate architectural designs and business requirements into robust, scalable implementations.
  • Design and build ingestion and transformation pipelines integrating fragmented datasets, modelling outputs, internal analytics and unstructured information.
  • Develop reusable libraries and components to enable consistent data access across applications.
  • Build and maintain datasets that support advanced analytics, AI and modelling workflows.


Data Governance, Quality & Reliability


  • Define core data definitions, calculation logic and standards.
  • Design and implement a data catalogue and metadata framework.
  • Establish data validation, testing, monitoring and quality assurance practices.
  • Ensure pipelines provide appropriate levels of auditability, consistency, traceability and reproducibility.


Collaboration & Engineering Excellence


  • Work closely with risk, underwriting, finance and operations stakeholders to ensure datasets are reliable, consistent and well-defined.
  • Collaborate with platform and integration teams to establish best practices across CI/CD, infrastructure-as-code and automated testing.


Experience & Attributes


  • Proven experience building and operating production-grade data pipelines in AWS.
  • Strong understanding of the end-to-end data lifecycle, including ingestion, transformation, storage and consumption.
  • Experience contributing to or designing data platform architecture.
  • A degree in Computer Science, Engineering, Mathematics, Physics or a related discipline, or equivalent practical experience.
  • A hands-on approach, strong problem-solving skills and the ability to work effectively in a collaborative, evolving environment.


Technical Skills


Programming & Data Processing

  • Strong Python and SQL skills.
  • Experience with data processing libraries such as Pandas, Polars, Dask or PyArrow.


Cloud & Data Platforms

  • Practical AWS experience, ideally including S3, Glue, Lambda, ECS and DynamoDB.
  • Experience with Redshift or comparable analytical database technologies.


Data Engineering

  • Strong ETL/ELT pipeline design and optimisation skills.
  • Data modelling and schema design.
  • Integration with APIs and external data providers.
  • Data quality, validation and monitoring.


Software Engineering & DevOps

  • Git and GitHub.
  • CI/CD pipeline development.
  • Infrastructure-as-code.
  • Strong understanding of modern software engineering and cloud architecture principles.


Nice to Have

  • Experience with open table formats such as Apache Iceberg, Delta Lake or similar technologies.


What You’ll Build

  • A modern, cloud-native data platform on AWS.
  • Scalable data ingestion and transformation pipelines integrating internal systems, third-party models, APIs and unstructured data.
  • Canonical data models and consistent definitions supporting analytics and AI workflows.
  • Reusable data access libraries and shared platform components.
  • A data catalogue and metadata framework supporting dataset discovery and lineage.
  • Reliable, well-tested pipelines with strong monitoring, validation and traceability.


Skills

What Senior Data Engineering jobs ask for — and how much of it you have →
Apply

See also

Data Engineering jobs by country — openings, pay and top skills →