Big Data Cloud Operations Engineer
Posted 1
view
Summary
Operate and maintain big data platforms (StarRocks/Doris, Flink, Kafka) plus databases, middleware, and cloud networking in Kuala Lumpur. Day to day involves monitoring, cluster tuning and upgrades, CI/CD pipelines, incident troubleshooting, and Python/Shell automation, collaborating with China-based technical teams.
- Operate and maintain big data platforms, including StarRocks / Doris, Flink, Kafka, and related components.
- Monitor system health, platform performance, resource utilization, and data processing status.
- Perform cluster expansion, configuration, performance tuning, upgrades, and disaster recovery exercises.
- Manage databases and middleware, including MySQL, Redis, RabbitMQ, and ZooKeeper.
- Maintain cloud infrastructure and networking components, including VPC, routing, security groups, load balancing, DNS, and CDN.
- Build and maintain CI/CD pipelines, deployment processes, and rollback procedures.
- Troubleshoot production incidents, conduct root cause analysis, and implement preventive improvements.
- Develop automation scripts and tools using Python or Shell.
- Collaborate with China-based technical teams and overseas business teams.