Senior Big Data Engineer (Spark/Scala/Java)
Summary
Build and maintain the ACQA big-data platform on Azure Databricks using Spark, Scala, Java, and Kubernetes to support valuation and risk systems for finance teams.
ACQA is built on Microsoft Azure cloud computing technology. It aims to deliver:
- Scalable cost‑efficient infrastructure, using cloud PaaS components.
- Single core platform, open architecture, designed for change, itemised cost metrics, automated data lineage.
- Shared across Front Office, Finance and Risk, improving regulatory compliance.
- One‑Platform / One‑Experience – fast to train, easy to operate, retaining talent.
The ACQA platform is made up of a series of components providing the next generation valuation and risk management services.
Responsibilities:
- Work with multiple federated teams to enable them to build Big Data solutions
- Manage the ACQA Databricks platform – provide monitoring and other tooling
Mandatory Skills Description:
- Development of big data technologies like Apache Spark and Azure Databricks
- Programming complex production systems in Java and Scala
- Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)
- Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab
- Experience with containerisation in development, build, and runtime environments, including experience with Kubernetes
Mode of work: hybrid 3 days/ week from the office
What do we offer our employees?
- Copyrights which means higher net salary for Developers
- Fully remote recruitment process
- Stable employment based on an employment contract
- MyBenefit program (sports card, well‑being program etc.)
- Employee assistance program for you and your family! (consultations with a psychologist, coaching sessions, assistance in private life)
- LuxTalent platform (webinars, training, courses with certificates)
- Internal Mobility program - possibility of rotation between projects, locations, accounts