Senior Staff Data Engineer Product Data Development
Summary
Senior staff data engineer at crypto exchange OKX in Singapore, owning the customer-facing product data pipeline end to end — building and optimizing offline and real-time pipelines using Flink, Kafka, Hadoop/Hive, Elasticsearch, and big-data platforms like MaxCompute, Spark, Databricks, and StarRocks/Doris.
About the Team OKX data team is responsible for the whole data scope of OKG, from technical selection, architecture design, data ingestion, data storage, ETL, data visualization to business intelligence and data science. We are data engineers, data analysts and data scientists. The team has end-to-end ownership of most of the data at OKX throughout the whole data lifecycle including data ingestion, data ETL, data warehouse and data services. As a data engineer of the team, you will work with the team to leverage data technologies to empower evidence-based decision-making and improve the quality of the company's products and services.
The Role OKX will be prioritizing applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visa.
Responsibilities
Proficient in mainstream cloud computing and big data technologies such as
Hadoop, Hive, Flink, YARN, Elasticsearch (ES), Kafka , etc.
Expert in
real-time big data processing using Flink , with solid experience in
Flink SQL development .
Build and optimize
offline and real-time data pipelines
to ensure
data timeliness and accuracy .
Independently manage end-to-end business requirements , responsible for the R&D design and construction of the
online (customer-facing) product data pipeline , including
performance optimization , and empower business growth through
data products and services .
Requirements
Bachelor's degree or higher from an accredited university in
Computer Science
or a related field.
3+ years
of experience independently handling
end-to-end business requirements , with strong self-motivation, a high sense of responsibility, excellent communication and teamwork skills, and a passion for continuous learning and self-challenge.
Proficiency in both English and Chinese (listening, speaking, reading, and writing) .
Familiar with
data warehouse modeling , with successful experience in designing and refactoring
large-scale data warehouses .
Mastery of multiple big data architectures, especially
Alibaba Cloud DataWorks/MaxCompute ,
AWS Spark ,
Databricks , and
StarRocks/Doris .
In-depth understanding of real-time processing, expert in
Flink performance tuning and stress testing , and
Flink source code reading
experience is preferred.
Preferred Qualifications
IELTS score of 7 or above
in all four components.
3+ years of work experience
in English-speaking regions.
Experience in
cross border e-commerce , and familiarity with
multi-country, multi-language architectural design
is a plus.
Solid foundation in
Java , with
backend development experience .
Perks & Benefits
Competitive total compensation package
L&D programs and Education subsidy for employees' growth and development
Various team building programs and company events
Wellness and meal allowances
Comprehensive healthcare schemes for employees and dependants
More that we love to tell you along the process!