Data Engineer
Posted 8
views
Deskripsi Pekerjaan
Job Description
- Develop, maintain, and optimize ETL/ELT data pipelines to ensure performance, scalability, and reliability.
- Design and maintain data warehouse architecture and data models, including star/snowflake schemas and partitioning.
- Build automated pipeline monitoring, alerting, data quality checks, and error-handling mechanisms.
- Develop robust data ingestion processes from REST APIs, e-commerce/ad platforms, Excel/CSV, and other data sources.
- Manage and optimize cloud data infrastructure, primarily using AWS, to improve efficiency and control costs.
- Collaborate with Data Analysts and cross-functional teams to translate business requirements into reliable data solutions.
- Develop, maintain, and optimize ETL/ELT data pipelines to ensure performance, scalability, and reliability.
- Design and maintain data warehouse architecture and data models, including star/snowflake schemas and partitioning.
- Build automated pipeline monitoring, alerting, data quality checks, and error-handling mechanisms.
- Develop robust data ingestion processes from REST APIs, e-commerce/ad platforms, Excel/CSV, and other data sources.
- Manage and optimize cloud data infrastructure, primarily using AWS, to improve efficiency and control costs.
- Collaborate with Data Analysts and cross-functional teams to translate business requirements into reliable data solutions.
Qualifications
- Minimum Bachelor’s Degree (S1) in Computer Science or Information Technology with a minimum GPA of 3.00/4.00.
- 2–4 years of experience as a Data Engineer or in a related data role.
- Advanced proficiency in SQL and experience in query optimization and complex data transformations.
- Hands‑on experience with ETL/orchestration tools such as Apache Airflow, AWS Glue, GCP Composer, or Azure Data Factory.
- Strong experience with AWS, GCP, or Azure; AWS experience is highly preferred.
- Good understanding of data warehousing, dimensional modeling, APIs, data quality, and data pipeline monitoring.
- Experience with AWS Glue, S3, Athena, EventBridge, CloudWatch, Spark/PySpark is a strong plus.