Data Engineer
Key Responsibilities
Develop and maintain data ingestion and transformation pipelines.
Integrate data from various sources into enterprise data platforms.
Perform data transformation, validation, error handling, reprocessing, and incremental/batch/stream processing.
Conduct unit testing, troubleshooting, and technical documentation.
Ensure data pipelines are reliable, scalable, and maintainable.
Collaborate with other teams to support data quality and downstream data requirements.
Requirements
Minimum Bachelor's Degree (S1) in Information Technology, Information Systems, Computer Science, Mathematics, or a related field.
Minimum 2 years of experience as a Data Engineer, ETL Developer, or similar role.
Experience developing and maintaining data pipelines in an enterprise environment.
Strong knowledge of SQL, ETL/ELT, and data pipelines.
Familiarity with data transformation, data quality, Git, Linux, and debugging.
Experience with one or more of Kafka, Talend, Cloudera/Hadoop, Greenplum/PostgreSQL is a plus.
Proficiency in Python or other scripting languages is preferred.