Data Engineer
Posted Updated
Description
Alphv Recruit in Malaysia is seeking a mid to senior data engineer to design scalable lakehouse architectures and data pipelines for a healthcare project. Based in Petaling Jaya, you will build ETL/ELT workflows and optimize storage while supporting ML workflows.
Join a project focused on healthcare data, with an emphasis on data privacy and reliable, real-time processing. This onsite role offers opportunities to advance in cloud and big data technologies.
Design scalable data lakehouse architectures for large datasets. Build and maintain ETL/ELT pipelines for batch and real-time processing. Develop data ingestion frameworks from APIs, databases, files and streams. Optimize storage, partitioning and query performance in lakehouse environments. Support ML workflows and model deployment pipelines. Design disaster recovery and data backup strategies for critical assets. Proficient in Python, Scala, Java and SQL for data engineering tasks. Experience with big data frameworks and lakehouse tech stacks. Strong scripting skills for automation and data ops.Skills
Sign in to read and join the discussion.