Data Platform Engineer
Posted 8
views
Summary
Supports day-to-day operations of a data platform in Singapore: monitoring and recovering data pipelines, troubleshooting incidents, fixing security vulnerabilities, and setting up DevOps pipelines. Core skills are SQL and Python for data work plus dashboard development in QuickSight or Tableau, with cloud/AWS and IaC (Terraform) experience valued.
Key Responsibilities
- Support the daily operations of the data platform (e.g. handling error notifications, job monitoring & recovery, testing data pipelines);
- Investigate and troubleshoot reported incidents related to technical setup (e.g. connectivity failure, API timeout, service failure);
- Document changes to existing setup (e.g. data sources, pipelines, accounts);
- Research, propose and document technical requirements;
- Review and implement fixes for reported security vulnerabilities;
- Collaborate with the infrastructure team on the data team requests;
- Support product managers in cloud transformation journey for data products;
- Provide technical support and consultancy to business users;
- Develop reports to monitor usage, performance and security events;
- Generate mockup data and create unit tests;
- Set up DevOps pipelines;
- Optimise performance of data pipelines;
- Review data pipelines to ensure adherence to data management standards, policies and procedures.
To meet the challenges of this role, you must have/ be:
- Minimum of Bachelor’s Degree in Computer Science, Computer Engineering, or related disciplines;
- 3-5 years of work experience in Data Engineering, Data Science, Software Engineering or IT Infrastructure
- Proficient in developing dashboards (preferably with QuickSight or Tableau);
- Proficient in dashboard UX design;
- Proficient in SQL scripting to analyze, transform and integrate data sources;
- Proficient in Python;
- Experience IT infrastructure (server, database, network administration experience is an advantage);
- Experience or certification in Tableau Server administration;
- Experience or certification in Talend administration;
- Experience or certification in MS SQL Server administration;
- Experience or certification in SAS Viya administration;
- Proficient in PowerShell;
- Experience in AWS or cloud services;
- Experience in SHIP-HATS or DevOps tools;
- Experience in Terraform or IaC;
- Experience with agile or other rapid application development methodologies;