Senior Data Platform Engineer
Summary
Senior engineer on a data infrastructure team doing ~85% platform engineering and ~15% data engineering: operating, upgrading and optimizing production-critical data platforms, running Airflow, building and tuning Spark workloads in Scala and Python, and contributing to CI/CD and platform automation. Stockholm-based with remote or hybrid possible.
We are looking for a Senior Data Platform Engineer to join a data infrastructure team. This is not a traditional ETL developer role. We want a senior engineer who has built, scaled and operated production-critical data platforms.
We are looking for a Senior Data Platform Engineer to join a data infrastructure team. This is not a traditional ETL developer role. We want a senior engineer who has built, scaled and operated production-critical data platforms. The role is mainly platform engineering (about 85%) with some data engineering (about 15%).
Your Responsibilities
- Operate, upgrade, optimize and manage production data platform environments
- Run and maintain Airflow in production
- Build and tune Spark workloads in Scala and Python
- Work with large data sets and complex data flows
- Contribute to CI/CD and platform automation
- Take operational responsibility for reliability, performance and scalability
Requirements
- 5-10+ years of relevant experience
- Spark (Scala and Python)
- Airflow in a production environment
- Operational responsibility for a data platform or data infrastructure
- Cloud experience (GCP, AWS or Azure)
- CI/CD (Git, Jenkins or equivalent)
- Experience with large data sets and complex ETL flows
Meritorious
- Kubernetes / GKE
- Kafka or another streaming platform
- BigQuery or Redshift
- Experience with self-service analytics platforms
Technologies
Spark, Scala, Python, Airflow, Kubernetes, NGO, Kafka, BigQuery, Jenkins, Git
Important
Your CV must clearly show your own responsibility for operating, upgrading, optimizing and managing production environments. If you have only used tools such as Airflow or Kubernetes, without operational ownership, then you will likely not be a match for this role.
Location: Stockholm possible to work Remote or hybrid