Operations & DevOps Engineer
Description
Salary: $21,000 – $31,000 per month
About the role
Datago's products run on a large-scale data processing platform, with infrastructure hosted across public cloud and on-premises environments. Parts of the codebase were developed by former team members, and documentation is being progressively updated. Engineers are expected to review existing code before modifying it and to address root causes rather than symptoms. AI assistants are in the workflow but responsibility for all delivered code remains with the submitting engineer.
Key responsibilities
Maintain the stability of the crawler fleet. As target websites change frequently, failures are to be diagnosed from logs and resolved at the root cause.
Manage deployments and configuration, including Docker and Compose services, Kubernetes for the production environment, CI pipelines and scheduled jobs.
Monitor data quality and investigate anomalies as they arise.
Maintain cloud infrastructure, covering instances, networking, access control and resource management.
Perform backups, secrets rotation and system upgrades, and provide incident response for pipeline outages.
Work closely with other teams to safeguard collection quality.
About you
1-4 years in a Linux, operations, DevOps or backend role. Recent graduates with demonstrable operations experience are also welcome to apply.
Fluent Cantonese, working proficiency in English for documentation and code, ability to read both Traditional and Simplified Chinese.
Strong command-line and bash proficiency, with a track record of diagnosing issues through log analysis rather than trial-and-error restarts.
Daily hands-on experience with Docker; exposure to Kubernetes, which is deployed in production, is an advantage. Proficiency with Git in team workflows.
Python proficiency sufficient to read and modify crawler code, working knowledge of SQL for data validation.
Solid grasp of HTTP, HTML and JavaScript debugging with browser developer tools.
A degree in Computer Science or Engineering, or equivalent experience demonstrable through systems previously shipped or operated.
Preferred: Scrapy, Playwright or Selenium, proxies, rate limiting.
Preferred: ClickHouse, Prometheus/Grafana, NAS administration.
Benefits
Competitive salary
Annual leave and group medical insurance
Good team culture
About us
As a FinTech company, Datago Technology Limited focuses mainly on providing text data analytics in finance. By leveraging big data and AI technologies to process large-scale text data from comprehensive sources like news, reports and social media, we provide quantitative and easy-to-use structured data analytics for wide spread of sectors like hedge funds, security brokers, banks and research institutions around the world. Our products help clients enhance return, reduce risk, conduct research, and improve operational efficiency.