Senior Staff Data Engineer
Posted
Summary
Senior data engineer on OKX's data engineering team, owning analytics-ready Data Marts and building resilient batch and real-time streaming ETL pipelines on cloud infrastructure. Core stack includes Spark, Flink, SQL/NoSQL databases, and big data tools like MaxCompute and Hive.
About Us
At OKX, we believe that the future will be reshaped by crypto, and ultimately contribute to every individual's freedom. OKX is a leading crypto exchange, and the developer of OKX Wallet, giving millions access to crypto trading and decentralized crypto applications (dApps). OKX is also a trusted brand by hundreds of large institutions seeking access to crypto markets. We are safe and reliable, backed by our Proof of Reserves. Across our multiple offices globally, we are united by our core principles:
We Before Me ,
Do the Right Thing , and
Get Things Done . These shared values drive our culture, shape our processes, and foster a friendly, rewarding, and diverse environment for every OK-er. OKX is part of OKG, a group that brings the value of Blockchain to users around the world, through our leading products OKX, OKX Wallet, OKLink and more.
About the Team The OKX Data Engineering team is responsible for the whole data scope of OKG, from technical selection, architecture design, data ingestion, data storage, ETL, data visualization to business intelligence and data science. The team has end-to-end ownership of most of the data at OKX throughout the whole data lifecycle including data ingestion, data ETL, data warehouse and data services. As a data engineer of the team, you will work with the team to leverage data technologies to empower evidence-based decision-making and improve the quality of the company's products and services.
Responsibilities
Design, build, and maintain
analytics-ready Data Marts
using best-practice dimensional modeling (star/snowflake schemas)
Partner with analytics and business teams to understand requirements and deliver trusted, well-documented datasets
Design and build resilient and efficient data pipelines for both batch and real-time streaming data
Architect and design data infrastructure on cloud using industry standard tools
Ensure data integrity and scalability through enforcement of data standards. Improve data validation and monitoring processes to proactively prevent, identify and resolve issues
Define, understand, and test external/internal opportunities to improve our products and services
Requirements
Bachelor's Degree in Computer Science and at least 7+ years of experience in
Data Engineering
with significant focus on
Data Marts
Solid experience with data processing tools such as Spark and Flink
Solid experience implementing batch and streaming data pipelines
In-depth knowledge of both SQL and NoSQL databases, including performance tuning and troubleshooting
Be proficient in SQL, familiar with advanced SQL features such as window functions, aggregate functions and creating scalar functions/user-defined functions
Proven successful and trackable experience in full end-to-end data solutions involving data ingestion, data persistence, data extraction and data analysis
Preferred Qualifications
Experience with Data Analysis platforms like Datawind
Experience in Big Data tools such as Ali Cloud DataWorks, MaxCompute, AWS DataBricks, Hadoop, Hive, Spark and HBase
Benefits
Competitive total compensation package
L&D programs and Education subsidy for employees' growth and development
Various team building programs and company events
Wellness and meal allowances
Comprehensive healthcare schemes for employees and dependants
More that we love to tell you along the process
Note:
OKX will be prioritising applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visa.
We Before Me ,
Do the Right Thing , and
Get Things Done . These shared values drive our culture, shape our processes, and foster a friendly, rewarding, and diverse environment for every OK-er. OKX is part of OKG, a group that brings the value of Blockchain to users around the world, through our leading products OKX, OKX Wallet, OKLink and more.
About the Team The OKX Data Engineering team is responsible for the whole data scope of OKG, from technical selection, architecture design, data ingestion, data storage, ETL, data visualization to business intelligence and data science. The team has end-to-end ownership of most of the data at OKX throughout the whole data lifecycle including data ingestion, data ETL, data warehouse and data services. As a data engineer of the team, you will work with the team to leverage data technologies to empower evidence-based decision-making and improve the quality of the company's products and services.
Responsibilities
Design, build, and maintain
analytics-ready Data Marts
using best-practice dimensional modeling (star/snowflake schemas)
Partner with analytics and business teams to understand requirements and deliver trusted, well-documented datasets
Design and build resilient and efficient data pipelines for both batch and real-time streaming data
Architect and design data infrastructure on cloud using industry standard tools
Ensure data integrity and scalability through enforcement of data standards. Improve data validation and monitoring processes to proactively prevent, identify and resolve issues
Define, understand, and test external/internal opportunities to improve our products and services
Requirements
Bachelor's Degree in Computer Science and at least 7+ years of experience in
Data Engineering
with significant focus on
Data Marts
Solid experience with data processing tools such as Spark and Flink
Solid experience implementing batch and streaming data pipelines
In-depth knowledge of both SQL and NoSQL databases, including performance tuning and troubleshooting
Be proficient in SQL, familiar with advanced SQL features such as window functions, aggregate functions and creating scalar functions/user-defined functions
Proven successful and trackable experience in full end-to-end data solutions involving data ingestion, data persistence, data extraction and data analysis
Preferred Qualifications
Experience with Data Analysis platforms like Datawind
Experience in Big Data tools such as Ali Cloud DataWorks, MaxCompute, AWS DataBricks, Hadoop, Hive, Spark and HBase
Benefits
Competitive total compensation package
L&D programs and Education subsidy for employees' growth and development
Various team building programs and company events
Wellness and meal allowances
Comprehensive healthcare schemes for employees and dependants
More that we love to tell you along the process
Note:
OKX will be prioritising applicants who have a current right to work in Singapore, and do not require OKX's sponsorship of a visa.