Software Engineer-Big Data
Posted 1
view
Summary
A big data software engineer in Clementi, Singapore builds ETL pipelines to switch LMS data ingestion from Canvas to D2L across 5 data sources, handles big data aggregation, migrates MongoDB from EC2 to MongoDB Atlas, and does deployment, testing, and security fixes. Stack: Node.js, TypeScript, Angular/React, HTML5/CSS3, MongoDB Atlas.
Location- Clementi
Responsibilities
Big Data Ingestion Enhancement to switch from Canvas to D2L (Learning Management System) which will affect all 5 existing data sources.
Extract (taking the data from its current location).
Transform (cleansing and normalizing the data).
Load (placing the data in a database where it can be analyzed).
Big Data Aggregation.
Database Migration from MongoDB Enterprise on Amazon EC2 to MongoDB Altas
Application Deployment and Testing.
Security Vulnerability Fixing.
Required Skills
Node JS
Typescript
AngularJS/ReactJS
HTML5/CSS3
MongoDB Altas