【TENG1502】Senior Data Engineer

【 What You'll be Doing 】

• Develop, operate, and monitor ETL and real-time data pipelines for data collection, cleansing, processing, storage, and analytics
• Design and maintain data schemas, and perform database performance tuning
• Develop backend APIs and maintain data visualization platforms for SHOPLINE merchants

【 Who We are Looking for 】

• Fluent in Python and SQL; experience with API frameworks (Flask, FastAPI, Django) is a plus
• Expertise in designing and developing ETL and real-time streaming jobs (Apache Airflow preferred)
• Solid experience with real-time data processing and stream-processing systems, such as Apache Flink, RisingWave, and Apache Kafka
• Proficient in SQL and NoSQL databases; experience with TiDB, BigQuery, PostgreSQL, MySQL, and MongoDB is a plus
• Experience with cloud services such as AWS / GCP, especially data-related services
• Familiar with Linux/Unix environments and containerization tools such as Docker / Kubernetes
• It’s a plus if you have experience in the e-commerce industry and strong skills in data analysis