Senior Data Integration Engineer
About the Role
We are looking for a Senior Data Integration Engineer to deliver end-to-end data integration solutions for our client, a multilateral financial institution, supporting their Integrity Risk Management platform. In this role, you will take ownership of environment setup and management, data integration pipeline development, and pipeline operations. As a valued member of the Product Team, you will collaborate closely with vendors, business analysts, and source systems teams to ensure integration requirements are consistently met.
What You'll Do
Data Integration Pipeline Development
Design, develop, and test data pipelines to extract, transform, and load data from diverse source systems into target data models and destinations.
Partner with business analysts to define data mapping and transformation rules.
Ensure data accuracy and integrity through rigorous testing, validation, and quality checks.
Produce high-level and detailed technical designs, including comprehensive documentation for all data pipelines.
Explore and evaluate emerging solutions, such as agentic AI, to improve the efficiency, accuracy, and automation of data delivery processes.
Environment Setup & Management
Design and implement Azure-based, cloud-native solutions using Azure Data Factory, Databricks, Azure Container Apps, and Azure Service Bus.
Support the configuration and maintenance of development and production environments for data integration projects.
Maintain CI/CD deployment pipelines in alignment with enterprise standards.
Ensure scalable, secure, and event-driven data integrations aligned with banking and enterprise architecture standards, leveraging templates and tools such as Azure Data Factory, Databricks, and the client's Right Integration Pattern (RIP).
Pipeline Operations
Monitor and maintain data pipelines to ensure alignment with evolving source systems.
Troubleshoot and resolve issues to maintain reliable, uninterrupted operations.
Collaboration & Continuous Improvement
Participate in Agile development processes, including Scrum and Kanban events.
Support project planning and manage planning dependencies.
Apply best practices in coding, testing, and deployment, including CI/CD pipelines.
Stay current with emerging trends in data engineering and recommend process improvements.
Perform other relevant tasks as assigned.
What We're Looking For
Requirements & Qualifications
Bachelor's degree in Computer Science, Information Systems, or Information Technology.
5 years of experience as an integration developer and/or data engineer, preferably within the banking or financial services sector.
Strong expertise in the Azure Data Ecosystem, including Azure Data Factory, Azure Data Lake, Databricks, Azure Blob Storage, and Azure SQL Databases.
Proficiency in at least one of the following programming languages used for data integration: Python, Quarkus (Java), C#, Node.js, or Golang.
Experience with REST API programming in an enterprise context.
Experience setting up development and production environments, including implementing CI/CD pipelines.
Hands-on experience with Azure DevOps for version control and deployment automation.
Strong ability to collaborate effectively with IT teams to design and deliver robust data integration solutions.
Excellent written and verbal communication skills in English.
Familiarity with ITIL practices and experience working within Scrum/Agile frameworks.
Preferred Qualifications
Experience with Azure Service Bus, the client's Right Integration Pattern (RIP), and/or the Quarkus framework for microservices development.
Experience with other public cloud providers, such as AWS or OCI.
Experience with the Oracle ecosystem.
Azure certifications such as AZ-900 and/or DP-900 or higher.