Senior Data Engineer - Open-Source Data Pipelines
Summary
Build and maintain open-source data pipelines using Python, Kafka, and Hadoop tools in an Agile startup, focusing on ingestion, storage, processing, and security.
Overview
Hiring for two roles: Business Analyst in Paris, France and GCP Data Engineer in Stockholm, Sweden. Contract positions (6 months) with potential extension. Experience level: 6+ years.
Job Description
This role is for developers who have experience with building software solutions from development to production, and who have hands-on experience with debugging, log analysis and other operations-related activities for running and maintaining software solutions. A medior level is expected to work autonomously but will receive support when needed to learn on the job and grow in experience and skill set. The role involves data engineering / Python development within an Agile startup environment. Responsibilities include contributing to up-to-date documentation, enabling continuous delivery (Jenkins, ArgoCD, Azure DevOps, GitHub Actions), and preventing technical debt. Required experience includes Python software development, unit testing in Python, data ingestion/storage/processing and data security principles at scale, and substantial experience with Open-Source tools. Technologies include Kafka, Hadoop ecosystem (HDFS, Hive, Impala), Git, Jenkins, Docker, Kubernetes.
Responsibilities
- Understand and operate within an Agile startup methodology.
- Contribute to up-to-date technical documentation.
- Contribute to continuous delivery pipelines (Jenkins, ArgoCD, Azure DevOps, GitHub Actions).
- Help prevent technical debt.
- Engineer data solutions with a focus on data ingestion, storage, processing and security at scale.
- Work in a largely Open-Source environment with technologies such as Kafka, Hadoop ecosystem components (HDFS, Hive, Impala), Git, Jenkins, Docker, and Kubernetes.
Qualifications
- More than 3 years of Python software development experience.
- Experience with unit testing in Python.
- Experience with data ingestion, data storage, data processing and data security principles at scale.
- Demonstrable engineering experience in an Open-Source environment.
Seniorities & Employment
- Seniority level: Mid-Senior level
- Employment type: Contract
- Duration: 6 months contract, extendable
Locations
- Paris, France — Business Analyst
- Stockholm, Sweden — GCP Data Engineer
Referrals and additional postings may appear in the system, but the core responsibilities and qualifications above define the roles.