M08 - Data Engineer

Responsibility

The Full Stack Engineer / Data Engineer is responsible for designing, developing, deploying, and maintaining scalable, high-performance, and secure web applications. The role requires expertise in frontend and backend development, cloud technologies, DevOps automation, and application security. Engineers must work in an agile, DevOps-driven environment, ensuring high software quality, security, and maintainability.

• Be responsible for developing backend APIs & working on databases to support the applications.


• Experience on data transformation, flow and cleaning


• Design, develop and deploy databases and datasets with operational data store, data lake and data virtualization.


• Take full ownership of end-to-end application development, integrating frontend, backend, and cloud infrastructure.


• Design, develop, and maintain responsive, accessible, and performant web applications.


• Implement modern frontend architectures, ensuring reusability, scalability, and security.


• Develop high-performance backend services and APIs, ensuring reliability, security, and observability.


• Work with Quality Assurance (QA) engineers to ensure automated test coverage and proactively fix bugs and defects.


• Optimize full-stack CI/CD deployment strategies, ensuring seamless and automated releases.


• Work with DevOps teams to automate infrastructure provisioning, monitoring, and cloud deployments.


• Ensure full-stack security, including authentication, authorization, API security, and frontend security best practices.


• Continuously evaluate and adopt emerging technologies to improve application performance and developer productivity.


• Manage and resolve day-to-day IT related issues pertaining to application, infrastructure or security, to facilitate smooth running of daily operations


• Troubleshoot and resolve complex technical issues in low-code applications

Educational Background

• Tertiary education in Computer/Computer Science or Electronics Engineering or Information Technology or equivalent

Experience and Skills Needed

• Proficient in database design and various databases (e.g. SQL, PostgreSQL, AWS S3, Athena, etc).


• Familiar with W3C Document Object Model and customized web scraping (e.g. BeautifulSoup, react, CasperJS, PhantomJS, Selenium, Nodejs, etc).


• Comfortable in at least one scripting language (eg. SQL, Python).


• Proficient in building batch jobs (e.g. AWS Database Migration Services (DMS), Python, AWS Lambda, ECS Container task, Eventbridge, AWS Glue).


• Knowledge about system design, data structure and algorithms.


• Relevant working experience as a developer or equivalent in at least 3 Agile/ full project development life cycle and a minimum of 5 years experience in relevant role.


• Strong proficiency in both frontend and backend development


• Strong problem-solving skills and able to prioritise and manage multiple tasks


• Ability to work both independently and as part of a team with professionals at all levels

Frontend Technologies:

• JavaScript and TypeScript.


• Frontend frameworks such as React.js, Next.js, Vue.js


• Experience with wireframing and prototyping tools (Figma).

Backend Technologies:

• Node.js


• RESTful APIs, GraphQL, gRPC, and WebSockets for service communication.

Backend Scalability & API Design:

• Strong experience in API design principles, including REST, GraphQL, gRPC, and WebSockets.


• Familiarity with backend service scalability strategies (horizontal scaling, autoscaling, load balancing).

DevOps, Cloud, and Infrastructure:

• Experience with CI/CD pipelines (GitHub Actions, GitLab CI, ArgoCD, Jenkins).


• Cloud solutioning and hand-on experience with AWS Cloud (ECS Fargate containers, API Gateway, RDS PostgreSQL, Networking). Government Commercial Cloud – GCC will be beneficial.


• Experience with containerization and orchestration (Docker, Kubernetes).


• Familiarity with Infrastructure as Code (IaC) tools (Terraform, CloudFormation)

Security Best Practices:

• Strong knowledge of frontend security (CSP, CORS, XSS prevention).


• Able to build Scripts and API Integrations with knowledge of JWT, JWKS, Cognito and Authorisers.


• Familiarity with cloud security (IAM, Secrets Management, OWASP Top 10).

Software Quality & Testing:

• Experience with unit and integration testing (Jest, Cypress, Playwright, Pact).


• Backend testing using Postman, Supertest, contract testing.

Bonus Experience (Added Advantage):

• Relevant experience in and knowledge of microservice architecture


• Experience in working will LLM, e.g. Open AI, Amazon Q, Gemini


• Familiarity with governance, adoption of digital services in enterprise IT environments.


• Work experience and strong troubleshooting skills in resolving application, infrastructure (including desktop, server, network) and security related issues