Data Engineer (Consultant)

Open 25d

Your roles and responsibilities would include the following:

· Support the daily operations of the data platform(e.g. handling error notifications, job monitoring & recovery, testing data pipelines);

· Investigate and troubleshoot reported incidents related to technical setup (e.g. connectivity failure, API timeout, service failure);

· Document changes to existing setup (e.g. datasources, pipelines, accounts);

· Research, propose and document technical requirements;

· Review and implement fixes for reported security vulnerabilities;

· Collaborate with the infrastructure team on the data team requests;

· Support product managers in cloud transformation journey for data products;

· Provide technical support and consultancy to business users;

· Develop reports to monitor usage, performance and security events;

· Generate mockup data and create unit tests;

· Set up DevOps pipelines;

· Optimise performance of data pipelines;

· Review data pipelines to ensure adherence to data management standards, policies and procedures.

JOB REQUIREMENTS

To meet the challenges of this role, you must have/ be:

· Minimum of Bachelor’s Degree in Computer Science, Computer Engineering, or related disciplines;

· 3-5 years of work experience in Data Engineering, Data Science, Software Engineering or IT Infrastructure

· Proficient in developing dashboards (preferably with QuickSight or Tableau);

· Proficient in dashboard UX design;

· Proficient in SQL scripting to analyze, transform and integrate data sources;

· Proficient in Python;

· Ability to work effectively under time constraints and potentially changing priorities, while maintaining a high level of attention to details;

· Ability to work independently; and

Good to haves:

· Experience IT infrastructure (server, database, network administration experience is an advantage);

· Experience or certification in Tableau Server administration;

· Experience or certification in Talend administration;

· Experience or certification in MS SQL Server administration;

· Experience or certification in SAS Viya administration;

· Proficient in PowerShell;

· Experience in AWS or cloud services;

· Experience in SHIP-HATS or DevOps tools;

· Experience in Terraform or IaC;

· Experience with agile or other rapid application development methodologies;

See also