Data Engineer (PERM)

Overview

We are looking to recruit several Data Engineers to design, develop, and maintain scalable, secure, and high-performance data platforms that enable efficient data collection, storage, processing, and analytics. In this role, you will build robust batch and real-time data pipelines, optimise data architectures, and ensure data quality, governance, and availability to support business intelligence and advanced analytics initiatives.

Responsibilities

• Collaborate with customers, business stakeholders, partners, and internal teams to understand data requirements and provide technical solutions.
• Partner closely with data scientists and analytics teams to support data modelling and machine learning initiatives.
• Design, develop, document, and maintain scalable data models, ETL/ELT processes, data warehouses, and data pipelines for large volumes of structured and unstructured data.
• Build and optimise batch, near real-time, and real-time data processing solutions.
• Monitor, maintain, and improve the performance, reliability, and scalability of data platforms and pipelines.
• Define, monitor, and report Service Level Agreements (SLAs) for data pipelines and data products.
• Implement data security, governance, and compliance standards across data platforms.
• Drive data quality assurance initiatives and establish best practices for data integrity and consistency.
• Support pre-sales activities by providing technical expertise for data management solutions, proposal development, and post-implementation support.

Requirements

• Minimum 3 years of experience designing, building, and optimising data pipelines, data architectures, and datasets using ETL/Data Integration tools such as Informatica, Talend, or equivalent.
• Hands-on experience with data transformation, metadata management, workload management, and big data technologies such as Apache Spark, Hadoop, and Hive.
• Strong proficiency in: SQL, Python, Database Management Systems (DBMS), Data Wrangling, Data Visualisation.
• Experience working with diverse data sources, including: flat files, SQL databases, SAP databases, PostgreSQL, unstructured data (text, documents, images, audio, video, sensor data).
• Good understanding of data security, governance, and data quality best practices.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and stakeholder management abilities.
• Note: Only shortlisted candidates will be notified.