Senior Staff Data Engineer Analytics and Reporting
Summary
Design and maintain analytics-ready data marts, build batch and real-time pipelines, and architect cloud data infrastructure for a crypto exchange.
You will design and maintain analytics-ready data marts, partner with analytics and business teams to deliver trusted datasets, build batch and real-time data pipelines, architect cloud data infrastructure, enforce data standards, and improve data validation and monitoring.
Responsibilities
- Design, build, and maintain analytics-ready data marts using dimensional modeling
- Partner with analytics and business teams to understand requirements
- Deliver trusted and well-documented datasets
- Design and build batch and real-time streaming data pipelines
- Architect and design cloud data infrastructure
- Enforce data standards to ensure data integrity and scalability
- Improve data validation and monitoring processes
- Define and test opportunities to improve products and services
Requirements
- Bachelor's degree in Computer Science
- 4+ years of experience in Data Engineering with significant focus on data marts
- Experience with Spark and Flink
- Experience implementing batch and streaming data pipelines
- In-depth knowledge of SQL and NoSQL databases, performance tuning, and troubleshooting
- Proficiency in SQL, including window functions, aggregate functions, and user-defined functions
- Trackable experience delivering end-to-end data solutions covering ingestion, persistence, extraction, and analysis
- Experience with Datawind
- Experience with Ali Cloud DataWorks, MaxCompute, AWS DataBricks, Hadoop, Hive, Spark, or HBase
Benefits
- L&D programs
- Education subsidy
- Team-building programs
- Company events
- Wellness allowance
- Meal allowance
- Comprehensive healthcare schemes for employees and dependants