Data Engineer
Summary
Data Engineer at AFFIN Group (a Malaysian bank) in Kuala Lumpur, developing and maintaining the bank's Enterprise Data Hub — building ETL/ELT pipelines and data marts, automating reporting and data acquisition, and handling day-to-day monitoring, upgrades, and incident support. Stack includes SQL/SAS/DB2, Talend or Airflow, Control-M scheduling, and Unix/Linux scripting.
Create your future with Affin! You too can make a difference. Join us at AFFIN, where the open minds meet and be inspired by a shared commitment to great work. Here, you don’t just stay at the forefront of the industry – you can make a difference too.
Job Purpose
Performs a broad range of various work activities mostly development, implementation, maintaining and improving the bank’s single-source-of-truth to support businesses via automation processes and data engineering’s related activities.
Job Responsibilities
- Develop thorough understanding of data acquisition, data transformation, data monitoring, data retention, data mobilization, automation, and access and change management.
- Manage and monitor Daily and Monthly data in Data Acceleration Office data marts to ensure data availability, quality and consistency.
- Gather, assess, and design the data integration (ETL/ELT) of related bank’s initiative from Data Acceleration Office or business units
- Consolidate, plan and execute the data acquisition, data extraction, data integration, and data mobilization activities based on requirement from Data Acceleration Office or business units.
- Coordinate with the project manager to provide exceptional service to our clients; communicate with clients on a regular basis for requirements status updates and gathering issue resolution.
- Create, maintain and manage Automation initiatives/activities with regards to; Automation of repetitive reporting from the reports designed by Data Acceleration Office.
- Automation of new data acquisition or data mobilization processes with regards to Data Acceleration Office data mart enrichment, analytics initiatives or database campaign improvement.
- Automation of processes within pillars of Data Acceleration Office or within Business Performance Management with regards of business process improvement and efficiencies.
- Management and continuous development of the bank’s single-source-of-truth (Enterprise Data Hub) architecture and applications on behalf of Data Acceleration Office which covers and not limited to the areas of.
- Day-to-day support and maintenance which involving monitoring as well as assessment of the data-pipelines related incident, performance and capacity.
- Any upgrade/patching activities for the Enterprise Data Hub applications for product version/patch and software upgrade.
- Any enhancement or integration initiative of Enterprise Data Hub (EDH) and infrastructure of other Affin systems.
- Managing and anticipating the operational risk available/exposed to the current Enterprise Data Hub application and architecture.
- Coordination with IT & Vendor team with regards to continuous improvement and performance stability.
- Project Management:
- Assist in creating project plans for small projects in conjunction with the business.
- Assist with managing, supporting, and following up with the project team on these projects.
- Monitor and manage project progress
- Key Liaison:
- Collaborate with IT team on new data sources or data fields and incorporate them into EDH data marts
- Ensure EDH data marts and reporting batch jobs aligned with the bank’s database batch activities.
- Collaborate with Data Governance with regards to data quality, data governance and enterprise data house development.
- Collaborate with Data Analytics with regards to data extraction/statistics, leads/campaigns generation, reports/dashboards, and AI/ML model
Job Requirements
- Bachelor's Degree in Computer Science, Information Technology, Software Engineering, Data Engineering, Data Science, Information Systems, or a related discipline.
- Relevant professional certifications in Cloud Technologies (Azure, AWS, GCP), Data Engineering, ETL Development, or Database Management will be an added advantage.
- Hands-on experience in ETL development using data integration tools such as Talend, Apache Airflow, or similar platforms.
- Knowledge of workload automation and job scheduling tools such as Control-M, Dollar Universe, or similar solutions.
- Proficient in database querying and programming languages, including SQL, SAS, DB2, or equivalent technologies.
- Familiarity with Unix/Linux environments and scripting languages such as Shell or Bash.
- Understanding of financial data and business processes, preferably within the banking or financial services industry.
- Strong analytical and critical thinking skills with the ability to interpret complex data sets.
- Excellent problem-solving skills with the ability to identify issues, recommend solutions, and drive resolution effectively.
- Excellent communication and interpersonal skills and strong business writing and documentation capabilities.
Skills
Sign in to read and join the discussion.