Data Engineer
Summary
Design and maintain scalable data pipelines and cloud infrastructure to support analytics and AI initiatives for a healthcare and pharmacy retail company.
We are looking for a skilled and motivated Data Engineer to join our growing data team.
In this role, you will design, build, and maintain scalable data solutions that enable data-driven decision-making across the organization. You will play a key role in developing robust data pipelines, optimizing cloud-based data infrastructure, and supporting analytics and AI initiatives.
Responsibilities
Design, build, and maintain scalable and reliable data pipelines for data ingestion, transformation, and storage.
Develop and optimize ETL/ELT processes to ensure data quality and consistency.
Automate data workflows and implement monitoring solutions to ensure pipeline reliability.
Data Storage and Management
Architect and implement efficient data storage solutions, including data warehouses, data lakes, and databases.
Ensure data security, integrity, and compliance with relevant regulatory standards.
Optimize data storage structures and query performance for scalability and efficiency
Data Infrastructure & Technology
Evaluate, recommend, and implement modern data technologies to enhance data infrastructure capabilities.
Manage and optimize cloud-based data environments (e.g., Google Cloud Platform, BigQuery).
Develop and maintain comprehensive data documentation, including metadata and data lineage.
Partner with data scientists, analysts, AI engineers, and business stakeholders to gather and translate data requirements into scalable solutions.
Clearly communicate technical concepts to both technical and non-technical audiences.
Participate in code reviews and contribute to knowledge sharing and best practices within the team.
Performance Optimization & Support
Continuously optimize data pipelines and infrastructure for performance, scalability, and reliability.
Troubleshoot and resolve data-related issues in a timely manner.
Monitor system performance and proactively identify opportunities for improvement.
Prepare curated "gold layer" datasets for business consumption.
Develop and maintain user-friendly dashboards using BI tools (e.g., Looker Studio or similar platforms).
Guide and support business users in leveraging datasets to design or enhance dashboards effectively.
AI-Driven Data Analytics
Collaborate with AI Engineers to co-develop AI-powered analytics solutions, including chatbot interfaces.
Design scalable data models and define structured schemas to ensure context-ready data for AI applications.
Requirements
Bachelor’s degree in Computer Science, Data Engineering, or a related discipline (or equivalent practical experience).
Proven experience in a Data Engineer or similar role.
Strong proficiency in SQL and at least one programming language (e.g., Python, Java, or similar).
Hands-on experience with data warehousing and data lake technologies (e.g., BigQuery, Hadoop, Spark).
Experience designing and maintaining ETL/ELT processes and tools.
Familiarity with cloud platforms (e.g., GCP) and their data services.
Solid understanding of data modeling and database design principles.
Strong analytical and problem-solving abilities.
Excellent communication and collaboration skills.
Knowledge of end-to-end supply chain logistics is an added advantage.
Willing to travel and relocate to Bukit Raja, Klang
Perks and benefits
- Health Insurance
- Awards Programme
- Bonus
- Study L