Data Engineer (m/f/d)
Summary
Data Engineer at Schwarz Digits (the IT arm of Schwarz Group) in Barcelona: builds and maintains batch and real-time data pipelines, runs data operations, and develops statistics/ML algorithms to deliver business insights. Core stack includes Python, SQL, Spark, Kafka, and Kubernetes.
Schwarz Digits seeks a Data Engineer to design and scale data solutions, drive data operations, and develop ML algorithms that deliver business value. You will build batch and real-time data pipelines, ensure data quality and availability, and extract actionable insights while collaborating with stakeholders. The role sits at the intersection of agility and security within Schwarz Group, contributing to digital sovereignty in Europe. You’ll work in a dynamic, multicultural environment and stay current with emerging technologies.
Responsabilidades- Design, build, and maintain batch and real-time data pipelines
- Conduct data operations including exploration, provisioning, cleaning, testing, and ALM
- Develop and implement algorithms in statistics and machine learning
- Collaborate with business stakeholders to translate requirements into technical solutions
- Ensure data integrity, quality, and availability across all systems
- Extract actionable business insights
- Python
- SQL
- Spark
- Kafka
- Kubernetes
- Hive
- SQL Server
- MongoDB
- ELK
- Cassandra
- Agile methodology experience
- Creative, innovative thinker
- Proactive mindset
- Strong problem-solving skills
- Scikit-Learn
- Pandas
- Spark ML