Senior Data Engineer
Posted Updated 3
views
Summary
Designs and builds scalable data pipelines and storage solutions to collect, process, and secure data for analytics and reporting.
Job Type: Permanent
Work Hours: Mon – Fri; 8.30am – 6pm
Salary: Up to $6400 + VB
Work Location: Island wide (most likely AMK/Bukit Merah/Science Park)
- Identify suitable data structures based on business needs to ensure availability and accessibility of data.
- Determine technical system requirements based on data needs.
- Keep abreast of latest technologies and products in database and data processing software, and technologies.
- Build scalable data pipelines to extract, transform, load and integrate data.
- Develop codes and scripts to process structured and unstructured data in real-time from a variety of data sources.
- Test data pipelines for scalability and reliability to process high data volume, variety and velocity.
- Implement and monitor data security and privacy measures on data solutions.
- Consolidate and create data storage solutions for storage and retrieval of information.
- Assist in the integration of data systems with existing infrastructure.
- Develop tools to improve data flows between internal and/or external systems and the data warehouse.
- Automate the data collection and analysis processes, data releasing and reporting tools.
- Test data system configurations to increase efficiency.
- Bachelor’s degree in computer science, Computer Engineering, Information Systems, Information Engineering, or equivalent.
- At least 5 years of data engineering experience.
- Experience in building and optimizing data pipelines, architectures, and data sets.
- Experience working with stakeholders to identify business needs and analytics opportunities.