Senior Data Engineer - BigData Development
Summary
Senior Data Engineer at Luxoft (DXC) in Kraków, building production-grade data pipelines, transformations and analysis-ready datasets for an automotive client's observability and embedded analytics project, processing logs, events, telemetry and high-volume time-series data with automated data-quality checks.
We are looking for an experienced Senior Data Engineer to join a project within observability and embedded analytics for a leading automotive Client.
The project focuses on transforming logs, events, measurements and telemetry from embedded, cloud, test and application systems into trusted and reusable datasets and engineering insights.
You will have a hands-on role in building production data pipelines, transformations and analysis-ready datasets that support faster troubleshooting, reliability analysis, product-quality follow-up and improved understanding of platform performance in real-world conditions.
- Design, build and maintain production-grade data pipelines and transformations.
- Develop data models, schemas and curated datasets for different engineering use cases.
- Process logs, events, telemetry and high-volume time-series data.
- Integrate data from embedded, cloud, test and application sources using APIs and other data interfaces.
- Implement automated data-quality checks and pipeline monitoring.
- Build analysis-ready datasets supporting troubleshooting, reliability and product-quality analysis.
- Improve pipeline reliability, performance and maintainability.
- Support dashboards and analytical use cases.
- Document delivered solutions and support knowledge transfer.