Data Engineer
Posted Updated
Description
Horizon Computer Management Pte. Ltd. is seeking an experienced Data Engineer with 7+ years to design, develop, and maintain scalable data pipelines and data infrastructure.
You will build ETL/ELT processes, manage large datasets, optimise data workflows, and support analytics and BI initiatives. The role requires strong SQL/Python, hands-on experience with Spark/Hadoop, Airflow, and cloud data platforms such as Snowflake, Redshift, BigQuery, or Synapse.
Design, develop, and maintain scalable data pipelines and data integration solutions. Build and manage ETL/ELT workflows for structured and unstructured data. Develop data models and optimize data warehouse solutions. Integrate data from databases, APIs, and cloud platforms. Implement data processing with batch and real-time streaming technologies. Ensure data quality, accuracy, consistency, and reliability. Collaborate with data scientists, analysts, architects, and business stakeholders. Develop and optimize SQL queries and database performance. Implement data governance, security, and access controls. Monitor, troubleshoot, and resolve pipeline failures and performance issues. Work with cloud-based data platforms and distributed processing frameworks. Maintain technical documentation and follow software development best practices. 7+ years of data engineering experience in designing scalable pipelines and data infrastructure. Experience building and maintaining ETL/ELT processes for structured and unstructured data. Proficiency in SQL and Python with strong data modelling skills. Experience with cloud data platforms (AWS/Azure/GCP) and big data technologies. Knowledge of data governance, security, and quality frameworks; ability to implement data quality controls. Excellent collaboration with data scientists, analysts, architects, and stakeholders.Skills
Sign in to read and join the discussion.