Data Engineer - Real-Time Pipelines & AWS Cloud
Posted Updated
Description
Trust Recruit Pte. Ltd. in Singapore seeks a driven data engineering assistant to help build and maintain data pipelines for DRUMS and remote monitoring.
You will process time-series sensor data, support ETL/ELT workflows, and work with AWS services to ensure reliable data ingestion and access. You will gain exposure to Pandas, NumPy, SQL databases, APIs, and backend services, while collaborating with a small team and contributing to AI/ML projects.
Assist data engineering team in developing and maintaining data pipelines for DRUMS and remote monitoring apps. Support collection, cleaning, transformation, and processing of time-series sensor data from shipboard machinery. Help develop and test ETL/ELT processes for reliable data ingestion, storage, and retrieval. Work with AWS cloud services including S3, RDS, Lambda, and AWS Glue. Assist with database operations, SQL queries, data validation, and data quality checks. Support development and testing of APIs and back-end services using Python and SQL for AI/ML apps and web platforms. Monitor data pipelines, troubleshoot issues, and improve processing efficiency. Prepare technical docs, test reports, and data processing procedures. Collaborate with data engineers on ongoing projects and tasks. Perform other duties and ad-hoc assignments as directed. Degree or Diploma in Computer Science, Data Engineering, Data Science, IT or related field. Strong Python and SQL skills for data processing, DBs, and API development. Solid understanding of ETL/ELT pipelines, data integration and transformation. Hands-on experience with pandas, NumPy, and SQL databases (MySQL, PostgreSQL). Familiarity with AWS services (S3, RDS, Lambda, Glue) from coursework, internships or projects. Able to use AI coding assistants effectively while reviewing and testing generated code. Comfortable with Linux, Git and basic scripting. Nice-to-have: real-time data pipelines, Docker, Airflow, or data streaming concepts.Skills
Sign in to read and join the discussion.