Skip to content

Search jobs inside your AI agent. ClaudeChatGPTCursorGrok Bot

Connect

IDbase Software

NewBe an early applicant

Senior data integration engineer

Posted
Discussion

Summary

Senior data integration engineer designing and running enterprise data flows — ETL/ELT pipelines in Qlik Talend, log-based CDC and real-time replication with Qlik Replicate, and virtual data layers with Denodo — connecting legacy, cloud, and SaaS systems via APIs and batch jobs, with emphasis on reliability, governance, and performance.

About the Role

We are seeking a highly specialized Senior Data Integration Engineer to design, build, and maintain robust, scalable integrations across a complex enterprise ecosystem. This role focuses on enabling seamless system-to-system data flows, ensuring high availability, and providing real-time access to data across legacy, cloud, and Saa S platforms.

You will act as a subject matter expert in enterprise data movement and virtualization, bridging the gap between disparate technologies while ensuring integration reliability, governance, and performance at scale.

Key Responsibilities Integration Architecture & Design Design and implement complex enterprise integration patterns, including API-led connectivity, event-driven architectures, and batch ETL Architect scalable, secure, and resilient system-to-system data flows across heterogeneous environments Develop reusable integration frameworks and enforce enterprise integration standards Collaborate with enterprise architects and business stakeholders to align integrations with strategic objectives Pipeline Development & Real-Time Data Movement Build and maintain high-throughput ETL/ELT pipelines using Qlik Talend (Cloud or On-Premise) Implement and optimize log-based Change Data Capture (CDC) and low-latency replication using Qlik Replicate Support zero-downtime migrations and real-time streaming integrations Perform complex data mapping, transformation, validation, and reconciliation across source and target systems Optimize performance and ensure scalability of integration pipelines Data Virtualization & System Connectivity Leverage Denodo (or similar platforms) to create enterprise data virtualization layers for real-time data access without physical movement Design and implement semantic layers and virtual data services Integrate diverse platforms including on-premise databases, legacy mainframes, cloud data warehouses, and Saa S applications (e.g., Salesforce, Workday, SAP) Design and consume REST and SOAP APIs and manage integrations across multiple protocols (SFTP, JDBC, messaging queues) Reliability, Governance & Leadership Implement robust error handling, monitoring, logging, and alerting mechanisms Ensure data integrity, security, and high availability of integration services Enforce governance standards including data lineage, metadata management, and compliance controls Provide technical leadership, define coding standards, and promote best practices in integration design Mentor junior engineers and support continuous improvement within integration teams Requirements & Qualifications

Must-Have Skills & Experience:
• 6+ years of professional experience in data integration, ETL development, middleware administration, or enterprise application integration
• Deep, hands-on expertise with Qlik Talend (Cloud or On-Premise) for designing complex workflows and transformations
• Proven experience configuring and tuning Qlik Replicate for log-based CDC and real-time replication across heterogeneous systems
• Strong experience with Denodo (or similar enterprise data virtualization platforms)
• Expert-level SQL skills with advanced data mapping, transformation, and validation capabilities
• Strong understanding of enterprise integration patterns including batch processing, messaging, and API-led connectivity
• Experience ensuring high availability, monitoring, and operational stability of integration services

Highly Desirable Skills:
• Experience with cloud integration services such as AWS Glue, Azure Data Factory, or Google Cloud Dataflow
• Experience designing RESTful APIs and working with API gateways (Apigee, Mule Soft, Kong)
• Familiarity with messaging and streaming platforms such as Kafka, Rabbit MQ, or IBM MQ
• Proficiency in scripting languages (Python, Shell) for automation and enhancement of integrations
• Understanding of data governance principles, data lineage, and metadata management
• Experience implementing CI/CD pipelines for integration deployments using Git, Jenkins, or Azure Dev Ops Education

• Bachelor’s degree in Computer Science, Information Technology, Software Engineering, or related field

Additional Information Employment Type: Full-time Salary: Market Related/Negotiable Location Options: Johannesburg / Cape Town / Remote Must be located in South Africa or have a valid work permit for South Africa

Skills

What Senior Software Engineering jobs ask for — and how much of it you have →
Apply

See also

Software Engineering jobs by country — openings, pay and top skills →