Data Engineer
Summary
Data Engineer in Southeast Asia (Indonesia) who designs, builds, and optimizes large-scale data processing systems and pipelines, ensures data quality and security, and partners with data scientists and analysts. Core stack: AWS Databricks, Python/Java/Scala, cloud data warehouses, SQL/NoSQL, and big data tools like Spark and Kafka.
Description
We are seeking a skilled Data Engineer to join our team in Southeast Asia. The ideal candidate will have experience in designing and optimizing data systems, ensuring data quality, and collaborating with cross-functional teams to deliver impactful data solutions.
Responsibilities
- Design, construct, install and maintain large-scale data processing systems and other infrastructure components.
- Develop data set processes for data modeling, mining, and production.
- Analyze and optimize data pipelines for performance and efficiency.
- Collaborate with data scientists and analysts to understand data needs and deliver high-quality data.
- Implement data security and privacy measures to protect sensitive information.
Skills and Qualifications
- 3-6 years of experience in a Data Engineering role or related field With AWS DataBricks experience and certification.
- Proficiency in programming languages such as Python, Java, or Scala.
- Experience with data warehousing solutions (e.g., Amazon Redshift, Google BigQuery).
- Solid understanding of SQL and NoSQL databases (e.g., MySQL, MongoDB).
- Familiarity with big data technologies such as Hadoop, Spark, or Kafka.
- Knowledge of ETL processes and tools (e.g., Apache NiFi, Talend).
- Experience with cloud platforms (e.g., AWS, GCP, Azure).
- Strong analytical and problem-solving skills.