Senior Data Engineer | Big Data | Data Warehouse
Morgan Half International (Hong Kong) Limited Senior Data Engineer | Big Data | Data Warehouse
Summary
A Senior Data Engineer designs, builds, and maintains big data pipelines and enterprise-scale data warehouses for a client's data engineering team in Hong Kong, optimizing ETL/ELT workflows and database performance while mentoring junior engineers. Core stack includes Spark, Hadoop, Hive, cloud data platforms (Snowflake/Redshift/BigQuery), SQL, Python/Java/Scala, and AWS/GCP/Azure.
About the role
Our client is seeking a Senior Data Engineer to join the data engineering team. This pivotal role will focus on designing, developing, and maintaining robust big data solutions and data warehouse infrastructure. As a Senior Data Engineer, you will play a crucial strategic role in building scalable data platforms that support our client's data-driven decision-making processes. This position offers the opportunity to lead complex data engineering initiatives, mentor junior team members, and drive innovation in our data infrastructure capabilities.
Key responsibilities
Design and develop enterprise-scale data warehouse solutions and big data architectures that support analytical and operational requirements
Build and optimise data pipelines and ETL processes to extract, transform, and load data from multiple sources into centralised data repositories
Implement data quality frameworks and monitoring systems to ensure data accuracy, completeness, and consistency across all data platforms
Collaborate with data analysts, business intelligence teams, and stakeholders to understand data requirements and translate them into technical solutions
Optimise database performance through query tuning, indexing strategies, and infrastructure optimisation
Lead the selection and implementation of appropriate big data technologies and tools (such as Hadoop, Spark, Hive, and cloud-based data solutions)
Develop comprehensive documentation for data systems, including architecture diagrams, data lineage, and operational procedures
Mentor and provide technical guidance to junior data engineers and support team development initiatives
Manage and troubleshoot production data environments to ensure system reliability and minimal downtime
Stay current with emerging data engineering trends and technologies, recommending enhancements to existing systems
What we're looking for
5+ years of professional experience in data engineering, big data development, or database administration roles
Advanced proficiency in big data technologies such as Apache Spark, Hadoop, Hive, or equivalent distributed computing platforms
Strong expertise in designing and implementing data warehouse solutions using tools like Snowflake, Redshift, BigQuery, or similar cloud data platforms
Demonstrated experience with ETL/ELT tools and frameworks; knowledge of tools such as Talend, Informatica, Apache Airflow, or custom-built solutions is highly valuable
Solid understanding of SQL and relational database design principles; expertise in writing optimised and complex queries
Proficiency in programming languages such as Python, Java, or Scala for data processing and automation
Experience with cloud platforms (AWS, Google Cloud Platform, or Microsoft Azure) and their data services
Strong knowledge of data modelling, data governance, and best practices in data architecture
Proven experience working with large datasets and handling data at scale
Excellent problem-solving skills and the ability to troubleshoot complex technical issues
Strong communication and interpersonal skills, with the ability to work effectively in collaborative environments and mentor others
Leadership experience or demonstrated capability to lead technical projects and guide junior team members
Relevant certifications (such as cloud platform certifications or big data specialisations) are preferred
Apply now
If you meet the above requirements and are interested in joining Morgan Half International (Hong Kong) Limited as a Senior Data Engineer, we would like to hear from you. Please submit your CV, a cover letter outlining your relevant experience, and any additional supporting documents.