Senior Data Engineer
Posted Updated
Description
Focal Consulting in Kuala Lumpur is seeking a data engineer to build scalable data pipelines and optimize data lake architectures for clean analytics data.
You will design batch and real-time ingestion, maintain data lake layers, and develop robust ETL/ELT workflows using Python, PySpark, and dbt, while monitoring data quality and optimizing performance and cost.
Design, build, and maintain scalable batch and real-time data ingestion pipelines. Architect and maintain structured data lake layers (raw, staged, curated) and optimize storage and query performance. Develop robust ETL/ELT workflows using Python, PySpark, and dbt. Implement automated data validation, profiling, and monitoring for reliability and accuracy. Continuously optimize system performance, pipelines, and cost efficiency. 3–5+ years of hands-on experience in data engineering. Advanced proficiency in SQL and Python, with distributed processing experience (Spark/PySpark). Solid understanding of data modeling, data warehousing concepts, CDC methodologies, and message brokers. Ownership-driven with a strong engineering mindset to debug complex data flows. 13th month salary Annual bonus Transport allowance Housing subsidySkills
Sign in to read and join the discussion.