IT資料工程師(Data Engineer)
Description
【Job Description】
We are looking for a skilled and motivated IT Data Engineer to join our team in Taiwan. In this role, you will design, build, and maintain scalable data solutions that support reliable data processing, analytics, and business decision-making.
You will work with modern data technologies such as Spark, Iceberg, Dremio, Kafka, Qlik, and Airflow to build scalable, reliable, and business-oriented data platforms.
This role is ideal for someone who enjoys solving complex data problems, working across systems and teams, and turning data into practical business value.
【Responsibilities】
- Design, build, and optimize scalable batch and real-time data pipelines.
- Develop and maintain data models, data warehouses, and lakehouse solutions.
- Build reliable data orchestration and workflow automation processes.
- Work with business and IT teams to deliver data solutions, dashboards, and analytics use cases.
- Support BI, reporting, and self-service analytics through tools such as Qlik.
- Improve data platform reliability through monitoring, troubleshooting, scripting, and automation.
【Skills】
1. Essential
- Hands-on experience with Spark for large-scale data processing.
- Experience with Iceberg, Dremio, or similar lakehouse / modern data platform technologies.
- Experience with Kafka or other streaming data technologies.
- Strong SQL skills and experience with databases such as Oracle, MSSQL, or PostgreSQL.
- Proficiency in Python or Scala for data processing and automation.
- Experience with workflow orchestration tools such as Airflow or similar scheduling tools.
- Understanding of data modeling, data warehousing, and lakehouse architecture.
- Experience with BI or analytics tools such as Qlik, Tableau, or Power BI.
- Familiarity with Docker, Kubernetes, Linux, and shell scripting.
2. Desirable / Nice to Have
- Experience with Hadoop or legacy big data platforms.
- Experience with S3-compatible object storage or large-scale data lake environments.
- Ability to develop and deploy REST APIs or web services.
- Familiarity with AI/ML pipelines and related data preparation processes.
- Experience or strong interest in GraphDB / Knowledge Graph concepts, including entity relationship modeling, relationship discovery, and graph-based analysis.
3. Preferred Skills
- Strong analytical and problem-solving skills.
- Good communication and cross-functional collaboration abilities.
- Detail-oriented, proactive, and comfortable working in a fast-paced environment.
- Willingness to learn new technologies and continuously improve data solutions.