Data Engineer, Product Data Development
Summary
Build and optimize real-time and batch data pipelines for a crypto exchange using Flink, Kafka, and cloud data stacks to power analytics and product features.
OKX will be prioritising applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visa. Who We Are At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto trading and decentralized crypto applications (dApps). OKX is also a trusted brand by hundreds of large institutions seeking access to crypto markets. We are safe and reliable, backed by our Proof of Reserves. Across our multiple offices globally, we are united by our core principles: We Before Me , Do the Right Thing , and Get Things Done . These shared values drive our culture, shape our processes, and foster a friendly, rewarding, and diverse environment for every OK-er. OKX is part of OKG, a group that brings the value of Blockchain to users around the world, through our leading products OKX, OKX Wallet, OKLink and more. About The Team OKX data team is responsible for the whole data scope of OKG, from techincal selection, architecture design, data ingestion, data storage, ETL, data visualization to business intelligence and data science. We are data engineers, data analysts and data scientists. The team has end-to-end ownership of most of the data at OKx throughout the whole data lifecycle including data ingestion, data ETL, data warehouse and data services. As a data engineer of the team, you will work with the team to leverage data technologies to empower evidence-based decision-making and improve the quality of the company's products and services. Responsibilities
- Proficient in mainstream cloud computing and big data technologies such as Hadoop, Hive, Flink, YARN, Elasticsearch (ES), Kafka, etc.
- Expert in real-time big data processing using Flink, with solid experience in Flink SQL development.
- Build and optimize offline and real-time data pipelines to ensure data timeliness and accuracy.
- Independently manage end-to-end business requirements, responsible for the R&D design and construction of the online (customer-facing) product data pipeline, including performance optimization, and empower business growth through data products and services.
- Bachelor's degree or higher from an accredited university in Computer Science or a related field.
- 3+ years of experience independently handling end-to-end business requirements, with strong self-motivation, a high sense of responsibility, excellent communication and teamwork skills, and a passion for continuous learning and self-challenge.
- Proficiency in both English and Chinese (listening, speaking, reading, and writing).
- Familiar with data warehouse modeling, with successful experience in designing and refactoring large-scale data warehouses.
- Mastery of multiple big data architectures, especially Alibaba Cloud DataWorks/MaxCompute, AWS Spark, Databricks, and StarRocks/Doris.
- In-depth understanding of real-time processing, expert in Flink performance tuning and stress testing, and Flink source code reading experience is preferred.
- IELTS score of 7 or above in all four components.
- 3+ years of work experience in English-speaking regions.
- Experience in cross border e-commerce, and familiarity with multi-country, multi-language architectural design is a plus.
- Solid foundation in Java, with backend development experience.
- Competitive total compensation package
- L&D programs and Education subsidy for employees' growth and development
- Various team building programs and company events
- Wellness and meal allowances
- Comprehensive healthcare schemes for employees and dependants
- More that we love to tell you along the process!