Data Engineer
Posted 15
views
Description
Deskripsi Pekerjaan
- Design, develop, and optimize data pipelines to ensure efficient processing, scalability, and reliability.
- Develop and implement monitoring strategies for 500+ existing data pipelines and tables to ensure system stability and detect issues proactively.
- Monitor pipeline execution, investigate failures, identify root causes, and implement preventive measures to minimize recurring issues.
- Collaborate closely with Data Analytics and Data Operations teams to troubleshoot data-related issues and deliver reliable data solutions.
- Apply critical thinking and data-driven problem-solving approaches to investigate complex issues and identify effective solutions.
- Maintain data pipeline documentation, monitoring procedures, and operational standards.
- Continuously improve data engineering processes, automation, and data quality management.
- Bachelor’s degree in Computer Science, Information Systems, Mathematics, Engineering, or related field (or equivalent experience).
- Minimum of 1 year of experience in Data Engineering, Data Warehousing, or a related role.
- Proficiency in programming languages such as Python, SQL, and JavaScript
- Strong understanding of ETL/ELT pipeline development, Data Warehouse concepts, and modern data architecture.
- Understanding of batch and streaming data processing.
- Proficient in SQL (including analytical functions and performance optimization).
- Experience in building, maintaining, and optimizing scalable and reliable data pipelines.
- Experience in Artificial Intelligence (AI), Machine Learning (ML), and their applications in data engineering is a plus
