Data Engineer
Posted Updated 5
views
Summary
Maintain and optimize data pipelines, troubleshoot incidents, and support cloud-based data products for enterprise clients using Python, SQL, and DevOps tools.
- Support the daily operations of the data platform (e.g. handling error notifications, job monitoring & recovery, testing data pipelines);
- Investigate and troubleshoot reported incidents related to technical setup (e.g. connectivity failure, API timeout, service failure);
- Document changes to existing setup (e.g. data sources, pipelines, accounts);
- Research, propose and document technical requirements;
- Review and implement fixes for reported security vulnerabilities;
- Collaborate with the infrastructure team on the data team requests;
- Support product managers in cloud transformation journey for data products;
- Provide technical support and consultancy to business users;
- Develop reports to monitor usage, performance and security events;
- Generate mockup data and create unit tests;
- Set up DevOps pipelines;
- Optimise performance of data pipelines;
- Review data pipelines to ensure adherence to data management standards, policies and procedures.
Job Requirement
- Minimum of Bachelor's Degree in Computer Science, Computer Engineering, or related discipline
- 3-5 years of work experience in Data Engineering, Data Science, Software Engineering or IT Infrastructure
- Proficient in developing dashboards (preferably with QuickSight or Tableau)
- Proficient in SQL scripting to analyze, transform and integrate data source
- Proficient in Python
- Ability to work effectively under time constraints and potentially changing priorities, while maintaining a high level of attention to detail
- Ability to work independently
- Singaporean and PR preferred
Good to have
- Experience with IT infrastructure (server, database, network administration; experience is an advantage)
- Experience or certification in Tableau Server administration
- Experience or certification in Talend administration
- Experience or certification in MS SQL Server administration
- Experience or certification in SAS Viya administration
- Proficient in PowerShell
- Experience in AWS or cloud services
- Experience in SHIP-HATS or DevOps tools
- Experience in Terraform
- Experience with agile or other rapid application development methodologies