Senior/Staff Data Engineer, Analytics and Reporting
Summary
Senior/Staff Data Engineer at OKX, a crypto exchange, responsible for designing analytics-ready data marts, building batch and real-time data pipelines, and collaborating with analytics teams using technologies like Spark, Flink, and SQL.
Who We Are
About the team:
The OKX Data Engineering team is responsible for the whole data scope of OKG, from techincal selection, architecture design, data ingestion, data storage, ETL, data visualization to business intelligence and data science. The team has end-to-end ownership of most of the data at OKx throughout the whole data lifecycle including data ingestion, data ETL, data warehouse and data services. As a data engineer of the team, you will work with the team to leverage data technologies to empower evidence-based decision-making and improve the quality of the company's products and services.
Responsibilities:
-
Design, build, and maintain analytics-ready Data Marts using best-practice dimensional modeling (star/snowflake schemas)
-
Partner with analytics and business teams to understand requirements and deliver trusted, well-documented datasets
-
Design and build resilient and efficient data pipelines for both batch and real-time streaming data
-
Architect and design data infrastructure on cloud using industry standard tools
-
Ensure data integrity and scalability through enforcement of data standards. Improve data validation and monitoring processes to proactively prevent, identify and resolve issues
-
Define, understand, and test external/internal opportunities to improve our products and services
Requirements:
-
Bachelor’s Degree in Computer Science and at least 4+ years of experience in Data Engineering with significant focus on Data Marts
-
Solid Experience with data processing tools such as Spark and Flink
-
Solid Experience implementing batch and streaming data pipelines
-
In-depth knowledge of both SQL and NoSQL databases, including performance tuning and troubleshooting
-
Be proficient in SQL, familiar with advanced SQL features such as window functions, aggregate functions and creating scalar functions/user-defined functions
-
Proven successful and trackable experience in full end-to-end data solutions involving data ingestion, data persistence, data extraction and data analysis
Preferred Qualifications:
- Experience with Data Analysis platforms like Datawind
-
Experience in Big Data tools such as Ali Cloud DataWorks, MaxCompute, AWS DataBricks, Hadoop, Hive, Spark and HBase
Perks & Benefits:
-
Competitive total compensation package
-
L&D programs and Education subsidy for employees' growth and development
-
Various team building programs and company events
-
Wellness and meal allowances
-
Comprehensive healthcare schemes for employees and dependants
-
More that we love to tell you along the process!
Skills
As published by greenhouse · 7 questions
Basics
First Name, Last Name, Email, Phone, Resume/CV, Cover Letter, Location
Short answers (2)
- LinkedIn Profile optional
- Website optional
Pick from a list (5)
- Would you require work visa sponsorship to work in the advertised location for this role?
- Please indicate if you are a Singapore Citizen, Permanent Resident, or if you require a work pass to work and reside in Singapore. For work pass holders, kindly also specify which pass you are currently holding, if applicable.
- Do you have any tech experience working in SQL, PySpark and/or Flink in any part of your career?
- What is your notice period to your current employer?
- What language(s) are you fluent in? optional