Data Engineer
Summary
Designs, builds, and maintains scalable data pipelines, warehouses/lakes, and streaming systems, integrating data from multiple sources to support analytics, ML, and BI at ETHOZ Capital. Needs 3+ years in data engineering with SQL, Python/Java/Scala, orchestration tools (Airflow/Prefect), cloud platforms, and warehouses like Snowflake/BigQuery/Redshift.
Key Responsibilities
Design, develop, and maintain robust, scalable data pipelines and ETL/ELT processes
Build and manage data architectures including data lakes, data warehouses, and real-time streaming systems
Integrate data from multiple internal and external sources, ensuring data accuracy, consistency, and timeliness
Collaborate with data scientists, analysts, and software engineers to support analytics, machine learning, and business intelligence use cases
Optimise data storage, processing performance, and cost efficiency
Implement data quality checks, monitoring, and documentation
Ensure data governance, security, and compliance with PDPA and internal data policies
Troubleshoot data issues and provide ongoing operational support
Participate in system design reviews, technical documentation, and knowledge sharing
Requirements and Competencies:
Bachelor Degree in Computer Science, Information Systems, Engineering, or a related discipline
Minimum 3 years of relevant experience in data engineering or related roles
Relevant professional certifications (cloud, data, or analytics) are an advantage
Strong proficiency in SQL and at least one programming language such as Python, Java, or Scala
Experience with data pipeline and workflow orchestration tools (e.g. Airflow, Prefect, PowerBI or equivalent)
Hands-on experience with data warehousing technologies (e.g. Snowflake, BigQuery, Redshift, or similar)
Familiarity with cloud platforms (AWS, Azure, or GCP), including data storage and processing services
Experience working with structured and unstructured data
Understanding of data modelling, schema design, and performance optimisation
Knowledge of data security, access control, and governance best practices