Data & Integration Engineer (GenAI)
Summary
A data & integration engineer who analyzes business requirements and builds the data flows, APIs, and pipelines (Informatica, Cloudera, REST, SFTP, batch) that move and prepare enterprise data for GenAI use cases like RAG and document ingestion. Day to day involves integration design, data transformation, and coordination across upstream/downstream teams.
We are looking for a Data & Integration Engineer who operates effectively at the intersection of system analysis, enterprise integration and data engineering to support GenAI initiatives.
- The successful candidate will:
- Understand business and functional requirements
- Translate them into data flows and integration designs
- Work across upstream and downstream systems
- Ensure reliable movement, transformation and availability of data for GenAI use cases
- Develop scripts / programs to get data from different integration systems
- Develop APIs to integrated with relevant systems.
- Analyse business/technical requirements and translate them into data flows and integration designs
- Work with upstream and downstream teams to define data contracts and interfaces
- Support data ingestion and preparation for GenAI use cases
- Coordinate integrations across systems in the DataLake ecosystem (Informatica, Cloudera, etc.)
- Design and implement data movement across systems using:
- APIs
- SFTP and file based transfers
- Batch pipelines
Requirements
Key Requirements
Below are the key skillsets that will be required for all relevant tasks mentioned:
- Good years of experience in system analysis, integration engineering, data engineering or technical delivery roles.
- Strong ability to translate requirements into system flows, data flows, interface specifications and implementation plans.
- Experience working with upstream and downstream teams to define and deliver enterprise integrations.
- Practical experience with REST APIs, SFTP, batch processing, file based integration and data pipeline orchestration.
- Good understanding of data mapping, transformation, aggregation, reconciliation and data quality controls.
- Good SQL skills and basic to moderate Python skills for data handling, scripting, automation and troubleshooting.
- Exposure to Java
- Exposure to Informatica, Cloudera or similar enterprise data platforms.
- Working knowledge of Git, branching, pull requests, code reviews and controlled release practices.
- Familiarity with CI/CD, Jira, Confluence and enterprise deployment processes.
- Experience with Control M or equivalent scheduling tools.
- Familiarity with logging (OTEL) and monitoring tools such as Splunk Elastic Stack.
- Exposure to GenAI concepts such as document ingestion, RAG, embeddings and data preparation for AI workflows.
- Working experience with Informatica is preferable.
Strong communication skills, with the ability to challenge weak designs and coordinate across business, application, data, infrastructure and security teams.
- System Integrations,
- Python, SQL, Informatica
Unlock job insights
Hirer responsiveness Salary match Number of applicants
Unison Consulting established in the year 2012 in Singapore. We provide technology consulting, systems implementation, and integrations service to Asia Pacific customers. We help transform enterprise data in actionable insights. Our consultants have wide range of functional expertise within Banking and Financial services spectrum, working closely with clients to anticipate, illuminate and overcome complex business challenges.
Our objective is to be a one-stop solution provider all enterprise business intelligence and data warehousing needs of organizations.
Our mission is to consistently deliver our services to our clients in a cost-effective way without compromising the quality.
Our current clients include - DBS, OCBC, Standard Chartered Bank and Maybank.
Unison Consulting established in the year 2012 in Singapore. We provide technology consulting, systems implementation, and integrations service to Asia Pacific customers. We help transform enterprise data in actionable insights. Our consultants have wide range of functional expertise within Banking and Financial services spectrum, working closely with clients to anticipate, illuminate and overcome complex business challenges.
Our objective is to be a one-stop solution provider all enterprise business intelligence and data warehousing needs of organizations.
Our mission is to consistently deliver our services to our clients in a cost-effective way without compromising the quality.
Our current clients include - DBS, OCBC, Standard Chartered Bank and Maybank.
Researching careers? Find all the information and tips you need on career advice.