Senior Integration Data Engineer

Job Description :

We are looking for an experienced Senior Integration Data Engineer to design, develop and manage reliable data integrations between cloud-based data platforms and existing data-processing applications.

The ideal candidate will have strong expertise in Python, SQL, APIs and data transformation, with the ability to build production-grade integration solutions that ensure data accuracy, consistency, compatibility and traceability across multiple systems.

Total Experience : 10+ years

Key Responsibilities :

- Design and implement source-to-application integrations, integration adapters and data transformation workflows.

- Develop and maintain batch-processing and change-data-processing pipelines using Python and SQL.

- Work with REST APIs, XML, JSON and integration services to enable seamless data exchange.

- Ensure record identity, data consistency and compatibility across existing applications and systems.

- Implement robust logging, monitoring, retry, error-handling and replay mechanisms.

- Develop automated tests and validate integrations across multiple services.

- Troubleshoot end-to-end data flows and trace individual records across different systems and processing layers.

- Evaluate and recommend appropriate integration approaches, including application modifications, integration adapters and shared data models.

- Collaborate with cross-functional engineering teams to deliver reliable, scalable and maintainable integration solutions.

- Ensure production readiness, system reliability and maintainability of integration workflows.

Required Skills & Qualifications :

- 9+ years of experience building and managing production-grade data integrations (overall role requirement : 10+ years).

- Strong hands-on experience with Python and SQL.

- Experience working with REST APIs and data formats such as XML and JSON.

- Strong understanding of batch processing and change-data processing.

- Experience developing integration adapters and data transformation workflows.

- Hands-on experience with automated testing, logging, retries and replay mechanisms.

- Ability to troubleshoot and trace data across multiple services and processing layers.

- Strong understanding of data consistency, record identity and end-to-end data traceability.

Good to Have Skills :

- Experience with AWS cloud services.

- Hands-on experience with RabbitMQ.

- Experience with MongoDB and Solr.

- Knowledge of cloud-based data platforms and distributed systems.

- Familiarity with CI/CD pipelines and DevOps practices.

Desired Competencies :

- Strong analytical, problem-solving and troubleshooting skills.

- Ability to make sound technical and architectural decisions.

- Focus on data accuracy, reliability and system compatibility.

- Strong communication and collaboration skills.

- Ability to work independently and take end-to-end ownership.

- Focus on maintainability, testability and production readiness.

Interview Process :

- 2 rounds of discussion