Senior Data Engineer
Posted Updated 6
views
Summary
Devop.One is hiring a Senior Data Engineer in Berlin to independently design, build, and operate scalable data processing pipelines and ETL processes for mass data, ensuring data quality and availability and applying machine learning/statistical methods. The role requires several years of cloud application, software development, and agile experience.
Senior Data Engineer
Goal: Independent conception, implementation and operation of data processing pipelines for the provision and preparation of mass data. Ensuring data quality and data availability.
Services & responsibilities:
§ Monitoring and ensuring data quality, data availability and processing performance
§ Provision of interfaces for data exchange
§ Conception, implementation and testing of scalable data processing architectures
§ Conception, implementation and testing of ETL processes in coordination with data scientists and business analysts
§ Close coordination with front-end, back-end engineers, product managers and analysts
§ Application and provision of machine learning and statistical methods for evaluating and predicting patterns in the data
§ Continuous coordination and proactive communication with data protection functions
§ Evaluation and analysis of data sets of various complexity and the development and optimization of the data processing infrastructure based on them
§ Development of solution options in order to get from the actual to the target state as well as evaluation and presentation of the solution options
Experience:
§ Several years of experience in the development of cloud-based applications
§ Several years of experience as a software developer or comparable position
§ Several years of experience in the area of agile software development