Data Engineer (M/F/D)
Posted Updated
Summary
Data Engineer building scalable batch and real-time data pipelines, conducting data operations, and developing ML algorithms using Python, SQL, Spark, Kafka, and Kubernetes for Schwarz Digits, the IT division of retail group Schwarz (Lidl/Kaufland).
Schwarz Digits creates the technological foundation for digital sovereignty in Europe.
Si desea saber un poco más sobre esta oportunidad, o está considerando presentar su candidatura, por favor, lea la siguiente información del puesto.
As the IT and digital division of the Schwarz Group, we develop and manage the IT infrastructures for the retail divisions Lidl and Kaufland, as well as Schwarz Production and PreZero.
At the same time, we operate as an independent provider in the external market to support companies across Europe in their digital transformation.
We bundle our core services in the areas of Cloud, Cyber Security, Data & AI, Communication, and Workspace.Join us and contribute to digital sovereignty in Europe.
With us, you will work at the intersection of agility and security: You will benefit from fast decision-making processes, enjoy genuine creative freedom in your projects, and be able to build upon the stable foundation of the Schwarz Group. Your tasksWe are seeking a highly skilled and motivated Data Engineer to join our team.
In this role, you will be involved in building scalable data solutions, driving data operations, and developing statistical and machine learning algorithms that deliver real business value.This is an exciting opportunity for someone who thrives in dynamic, agile environments and is passionate about using data to solve complex problems.Design, build, and maintain batch and real-time data pipelines.Conduct data operations, including exploration, provisioning, cleaning, testing, and ALM.Develop and implement algorithms in statistics and machine learning.Collaborate closely with business stakeholders to translate requirements into technical solutions.Ensure data integrity, quality, and availability across all systems.Extract actionable business insights.Your profileMust-have: Programming languages: Python, SQL.Must-have: Experience with Big Data frameworks such as Spark, Kafka, Kubernetes, Hive.Must-have: Familiarity with relational (e.G., SQL Server) and non-relational databases (e.G., MongoDB, ELK, Cassandra).Agile methodology experience.Nice-to-have: Knowledge of Machine Learning tools: Scikit-Learn, Pandas, Spark ML, MLflow.Nice-to-have: Knowledge of deploying infrastructure and devops.Nice-to-have: Experience in .NET.Passion for continuous learning and staying up to date with emerging technologies.Creative, innovative thinker with a proactive mindset.Strong problem-solving skills and ability to adapt quickly to change.Collaborative spirit with excellent communication skills.Comfortable working in a multi-cultural environment with fluency in English. xhfqzwm We look forward to receiving your application.Aidan Cutanda Lundy · Reference no.
48246 Stiftsbergstraße 1 · 74172 Neckarsulm, Germany
Si desea saber un poco más sobre esta oportunidad, o está considerando presentar su candidatura, por favor, lea la siguiente información del puesto.
As the IT and digital division of the Schwarz Group, we develop and manage the IT infrastructures for the retail divisions Lidl and Kaufland, as well as Schwarz Production and PreZero.
At the same time, we operate as an independent provider in the external market to support companies across Europe in their digital transformation.
We bundle our core services in the areas of Cloud, Cyber Security, Data & AI, Communication, and Workspace.Join us and contribute to digital sovereignty in Europe.
With us, you will work at the intersection of agility and security: You will benefit from fast decision-making processes, enjoy genuine creative freedom in your projects, and be able to build upon the stable foundation of the Schwarz Group. Your tasksWe are seeking a highly skilled and motivated Data Engineer to join our team.
In this role, you will be involved in building scalable data solutions, driving data operations, and developing statistical and machine learning algorithms that deliver real business value.This is an exciting opportunity for someone who thrives in dynamic, agile environments and is passionate about using data to solve complex problems.Design, build, and maintain batch and real-time data pipelines.Conduct data operations, including exploration, provisioning, cleaning, testing, and ALM.Develop and implement algorithms in statistics and machine learning.Collaborate closely with business stakeholders to translate requirements into technical solutions.Ensure data integrity, quality, and availability across all systems.Extract actionable business insights.Your profileMust-have: Programming languages: Python, SQL.Must-have: Experience with Big Data frameworks such as Spark, Kafka, Kubernetes, Hive.Must-have: Familiarity with relational (e.G., SQL Server) and non-relational databases (e.G., MongoDB, ELK, Cassandra).Agile methodology experience.Nice-to-have: Knowledge of Machine Learning tools: Scikit-Learn, Pandas, Spark ML, MLflow.Nice-to-have: Knowledge of deploying infrastructure and devops.Nice-to-have: Experience in .NET.Passion for continuous learning and staying up to date with emerging technologies.Creative, innovative thinker with a proactive mindset.Strong problem-solving skills and ability to adapt quickly to change.Collaborative spirit with excellent communication skills.Comfortable working in a multi-cultural environment with fluency in English. xhfqzwm We look forward to receiving your application.Aidan Cutanda Lundy · Reference no.
48246 Stiftsbergstraße 1 · 74172 Neckarsulm, Germany