Data Engineer
Posted
Summary
Data Engineer at HCL Comnet in Singapore supporting day-to-day operations and cloud transformation of enterprise data platforms: monitoring data pipelines, troubleshooting incidents, remediating security vulnerabilities, and maintaining CI/CD/DevOps pipelines. Core stack includes SQL, Python, and BI tools such as Amazon QuickSight and Tableau.
About the role
We are seeking a highly motivated Data Engineer to support the operation, enhancement, and cloud transformation of enterprise data platforms. This role will be responsible for managing data pipelines, troubleshooting platform issues, implementing security controls, supporting DevOps practices, and working closely with business and infrastructure teams to ensure reliable and secure data services.
Key responsibilities
Monitor and support day-to-day operations of the data platform, including job monitoring, failure recovery, error resolution, and data pipeline testing.
Investigate and troubleshoot platform-related incidents such as connectivity failures, API timeouts, system outages, and integration issues.
Maintain and document changes to platform configurations, data sources, pipelines, user accounts, and technical environments.
Gather, analyze, and document technical and business requirements for platform enhancements.
Identify, assess, and remediate security vulnerabilities across data platforms and supporting systems.
Collaborate with infrastructure, security, and application teams to support data platform initiatives and operational requirements.
Support cloud transformation initiatives for data products and analytics platforms.
Provide technical consultation and support to business users and stakeholders.
Develop and maintain operational dashboards and reports to monitor platform usage, performance, capacity, and security events.
Build, maintain, and optimize CI/CD and DevOps pipelines.
Requirements Bachelor's Degree in Computer Science, Computer Engineering, Information Technology, or a related discipline.
3-5 years of experience in Data Engineering, Software Engineering, Data Science, Cloud Engineering, or IT Infrastructure.
Strong proficiency in SQL for data extraction, transformation, and analysis.
Proficient in Python for scripting, automation, and data processing.
Experience developing dashboards and visualizations using tools such as Amazon QuickSight, Tableau, or equivalent BI platforms.
Good understanding of dashboard design principles and user experience (UX).
Familiarity with data pipelines, ETL processes, and cloud-based data platforms.
Ability to work independently and manage multiple priorities in a fast-paced environment.
Strong analytical, troubleshooting, and problem-solving skills.
Excellent communication and stakeholder management abilities.
Investigate and troubleshoot platform-related incidents such as connectivity failures, API timeouts, system outages, and integration issues.
Maintain and document changes to platform configurations, data sources, pipelines, user accounts, and technical environments.
Gather, analyze, and document technical and business requirements for platform enhancements.
Identify, assess, and remediate security vulnerabilities across data platforms and supporting systems.
Collaborate with infrastructure, security, and application teams to support data platform initiatives and operational requirements.
Support cloud transformation initiatives for data products and analytics platforms.
Provide technical consultation and support to business users and stakeholders.
Develop and maintain operational dashboards and reports to monitor platform usage, performance, capacity, and security events.
Build, maintain, and optimize CI/CD and DevOps pipelines.
Requirements Bachelor's Degree in Computer Science, Computer Engineering, Information Technology, or a related discipline.
3-5 years of experience in Data Engineering, Software Engineering, Data Science, Cloud Engineering, or IT Infrastructure.
Strong proficiency in SQL for data extraction, transformation, and analysis.
Proficient in Python for scripting, automation, and data processing.
Experience developing dashboards and visualizations using tools such as Amazon QuickSight, Tableau, or equivalent BI platforms.
Good understanding of dashboard design principles and user experience (UX).
Familiarity with data pipelines, ETL processes, and cloud-based data platforms.
Ability to work independently and manage multiple priorities in a fast-paced environment.
Strong analytical, troubleshooting, and problem-solving skills.
Excellent communication and stakeholder management abilities.