Urgent! IT Data Engineer (West Area)
Posted
Summary
Junior-oriented data engineer role in Singapore supporting a maritime monitoring team: building and maintaining ETL/ELT data pipelines and APIs for time-series sensor data from shipboard machinery, using Python, SQL, and AWS services (S3, RDS, Lambda, Glue), under senior guidance with training provided.
Key Responsibilities
- Assist the data engineering team in developing and maintaining data pipelines for DRUMS and remote monitoring applications.
- Support the collection, cleaning, transformation and processing of time-series sensor data from shipboard machinery.
- Assist in developing and testing ETL/ELT processes for reliable data ingestion, storage and retrieval.
- Work with the team to support AWS cloud services, including S3, RDS, Lambda and AWS Glue.
- Assist with database operations, SQL queries, data validation and data quality checks under the guidance of senior team members.
- Support the development and testing of APIs and backend services using Python and SQL for AI/ML applications and web platforms.
- Monitor data pipelines, troubleshoot issues and support improvements in data processing efficiency.
- Prepare technical documentation, test reports and data processing procedures.
- Collaborate with data engineers and other team members on ongoing projects and technical tasks.
- Perform other duties and ad-hoc assignments as assigned by the team lead or department manager.
- Diploma or Degree in Computer Science, Data Engineering, Data Science, Information Technology or a related field.
- Proficiency in Python and working knowledge of SQL for database management, data processing and API development.
- Understanding of data engineering fundamentals, including ETL/ELT pipelines, data integration, data transformation and database optimization.
- Familiarity with pandas, NumPy and SQL databases such as MySQL or PostgreSQL.
- Knowledge of AWS cloud services, particularly S3, RDS, Lambda and AWS Glue, through academic projects, internships or practical experience.
- Ability to use AI coding assistants such as Claude Code, Codex or Cursor to support development, review generated code and conduct appropriate testing.
- Familiarity with Linux, Git and basic scripting.
- Knowledge of real-time data pipelines, Docker, Apache Airflow or data streaming technologies would be an advantage. Training will be provided where necessary.
- Good communication, problem-solving and teamwork skills.