Data Engineer
You will design and optimise systems that process large-scale blockchain and off-chain datasets, enabling organisations worldwide to make trusted, data-driven decisions. Whether you join one of our platform-focused teams or those that work directly on product data, you will tackle challenges spanning batch and streaming processing, building high-quality, scalable solutions for a rapidly evolving ecosystem. You will fit right in if you enjoy writing clean, well-tested, efficient code, use data and experimentation to make informed decisions, and are curious about new technologies including AI and automation.
Responsibilities
- Build and maintain distributed data pipelines using Scala, Spark, and cloud technologies
- Collaborate with engineers, data scientists, and product teams to deliver reliable, scalable data systems
- Design and optimise data ingestion and transformation workflows across blockchain and traditional datasets
- Ensure accuracy, scalability, and efficiency in systems processing hundreds of millions of daily data points
- Evaluate design options and trade-offs across performance, scalability, reliability, and cost
- Contribute to the full lifecycle of data platform development from design and deployment to continuous improvement
- Strengthen pipeline reliability, observability, and automation through code and tooling improvements
- Grow influence and take on greater responsibility as understanding of distributed systems and platform architecture deepens
Requirements
- Experience delivering and maintaining distributed data pipelines
- Practical knowledge of Spark, Databricks, or similar big data frameworks
- Familiarity with cloud infrastructure (AWS, Azure, or GCP)
- Understanding of data-architecture trade-offs, such as scalability, resilience, and observability
- Interest or experience in functional programming
- Experience in streaming processing concepts like delivery semantics, ordering or partitioning
- Hands-on work with Infrastructure as Code (Terraform or CloudFormation)
- Knowledge of container orchestration (Docker, Kubernetes, Helm)
- An interest in blockchain and cryptocurrency technology, or a desire to learn
- Experience applying AI or automation within deployed services
Benefits
- Hybrid working and the option to work from almost anywhere for up to 90 days per year
- £500 Remote working budget to set up your home office space
- $1,000 Learning & Development budget
- 25 days of annual leave plus bank holidays
- An extra day off for your birthday
- Enhanced parental leave: 16 weeks of fully paid leave
- Private Health Insurance (Vitality)
- Full access to Spill Mental Health Support
- Life Assurance covering 4 times your salary
- Cycle to Work Scheme