Data Engineer

Job summary

• We are looking for a skilled and motivated Data Engineer to join our growing data team.

• In this role, you will design, build, and maintain scalable data solutions that enable data-driven decision-making across the organization. You will play a key role in developing robust data pipelines, optimizing cloud-based data infrastructure, and supporting analytics and AI initiatives.
  

Responsibilities:

Data Pipeline Development:

• Design, build, and maintain scalable and reliable data pipelines for data ingestion, transformation, and storage.

• Develop and optimize ETL/ELT processes to ensure data quality and consistency.

• Automate data workflows and implement monitoring solutions to ensure pipeline reliability.
  

Data Storage and Management:

• Architect and implement efficient data storage solutions, including data warehouses, data lakes, and databases.

• Ensure data security, integrity, and compliance with relevant regulatory standards.

• Optimize data storage structures and query performance for scalability and efficiency
  

Data Infrastructure & Technology:

• Evaluate, recommend, and implement modern data technologies to enhance data infrastructure capabilities.

• Manage and optimize cloud-based data environments (e.g., Google Cloud Platform, BigQuery).

• Develop and maintain comprehensive data documentation, including metadata and data lineage.
  

Collaboration & Communication

• Partner with data scientists, analysts, AI engineers, and business stakeholders to gather and translate data requirements into scalable solutions.

• Clearly communicate technical concepts to both technical and non-technical audiences.

• Participate in code reviews and contribute to knowledge sharing and best practices within the team.
  

Performance Optimization & Support

• Continuously optimize data pipelines and infrastructure for performance, scalability, and reliability.

• Troubleshoot and resolve data-related issues in a timely manner.

• Monitor system performance and proactively identify opportunities for improvement.

Business Intelligence & Dashboard Development

• Prepare curated “gold layer” datasets for business consumption.

• Develop and maintain user-friendly dashboards using BI tools (e.g., Looker Studio or similar platforms).

• Guide and support business users in leveraging datasets to design or enhance dashboards effectively.

AI-Driven Data Analytics

• Collaborate with AI Engineers to co-develop AI-powered analytics solutions, including chatbot interfaces.

• Design scalable data models and define structured schemas to ensure context-ready data for AI applications.

Requirements:

• Bachelor’s degree in Computer Science, Data Engineering, or a related discipline (or equivalent practical experience).
  Proven experience in a Data Engineer or similar role.

• Strong proficiency in SQL and at least one programming language (e.g., Python, Java, or similar).

• Hands-on experience with data warehousing and data lake technologies (e.g., BigQuery, Hadoop, Spark).

• Experience designing and maintaining ETL/ELT processes and tools.

• Familiarity with cloud platforms (e.g., GCP) and their data services.

• Solid understanding of data modeling and database design principles.

• Strong analytical and problem-solving abilities.

• Excellent communication and collaboration skills.

• Knowledge of end-to-end supply chain logistics is an added advantage.

• Willing to travel and relocate to Bukit Raja, Klang