Senior/Staff Data Engineer, Analytics and Reporting
Summary
Build and maintain analytics-ready data marts and pipelines for a crypto exchange, using SQL, Spark, Flink, and cloud data tools to power business decisions.
- Design, build, and maintain analytics-ready Data Marts using best-practice dimensional modeling (star/snowflake schemas)
- Partner with analytics and business teams to understand requirements and deliver trusted, well-documented datasets
- Design and build resilient and efficient data pipelines for both batch and real-time streaming data
- Architect and design data infrastructure on cloud using industry standard tools
- Ensure data integrity and scalability through enforcement of data standards. Improve data validation and monitoring processes to proactively prevent, identify and resolve issues
- Define, understand, and test external/internal opportunities to improve our products and services
- Bachelor's Degree in Computer Science and at least 4+ years of experience in Data Engineering with significant focus on Data Marts
- Solid Experience with data processing tools such as Spark and Flink
- Solid Experience implementing batch and streaming data pipelines
- In-depth knowledge of both SQL and NoSQL databases, including performance tuning and troubleshooting
- Be proficient in SQL, familiar with advanced SQL features such as window functions, aggregate functions and creating scalar functions/user-defined functions
- Proven successful and trackable experience in full end-to-end data solutions involving data ingestion, data persistence, data extraction and data analysis
- Experience with Data Analysis platforms like Datawind
- Experience in Big Data tools such as Ali Cloud DataWorks, MaxCompute, AWS DataBricks, Hadoop, Hive, Spark and HBase
- Competitive total compensation package
- L&D programs and Education subsidy for employees' growth and development
- Various team building programs and company events
- Wellness and meal allowances
- Comprehensive healthcare schemes for employees and dependants
- More that we love to tell you along the process!