Data Engineer
Summary
A data engineer role in Indonesia focused on building and maintaining ETL/ELT pipelines and data integrations. Day to day work spans SQL optimization, SSIS and Informatica, IBM InfoSphere tools (DataStage, DB2), big data processing with Apache Spark (PySpark, Spark R, Scala), and Python/R scripting, plus data modeling and warehousing support.
Job Description
Develop and maintain ETL/ELT processes and data integration workflows. Develop and optimize SQL queries for data processing. Build and maintain ETL processes using SSIS and Informatica. Work with IBM InfoSphere tools, including DataStage, IA, BPM, RAD/Workbench, PME, and DB2. Develop big data processing solutions using Apache Spark, including PySpark, Spark R, or Scala. Develop data processing scripts using Python and/or R. Support data modeling, data architecture, and data warehousing activities. Automate data flows and data integration across different platforms. Monitor, troubleshoot, and optimize data processing and integration processes. Ensure data quality, consistency, and integrity. Work closely with technical teams and business stakeholders to support data requirements.
Requirements
Minimum 1 year of experience in Data Engineering, ETL, Data Integration, or a related field. Equivalent skills or experience may be considered. Good knowledge of SQL and data processing. Experience with SSIS. Experience with IBM InfoSphere Family (DataStage, IA, BPM, RAD/Workbench, PME, DB2). Experience with Informatica Data Engineering Integration. Experience with Apache Spark using PySpark, Spark R, or Scala. Experience with Python and/or R. Understanding of ETL, data modeling, data architecture, and data warehousing. Knowledge of data integration, data flow automation, and data processing. Knowledge of various database technologies. Good analytical and problem-solving skills.