Senior Data Engineer - Data Platform Engineering
Posted Updated
Description
Luxoft is seeking a Senior Data Engineer specializing in Data Platform Engineering to join a project focused on observability and embedded analytics for a leading automotive client. You will architect and build scalable data foundations, transforming logs, events, telemetry from various systems into reusable data products.
You will design production-grade pipelines, data models, and quality controls, while ensuring performance and cost efficiency across platforms and teams.
Design and implement the target data architecture and production data foundation. Build and maintain robust, automated data pipelines and transformations. Develop shared data models, schemas and analysis-ready datasets. Implement data orchestration, data-quality controls, monitoring and lineage. Integrate data from embedded, cloud, test and application systems using APIs and other data interfaces. Improve platform reliability, scalability, performance and maintainability. Support analytical use cases while keeping the underlying data platform reusable. Produce operational documentation and support knowledge transfer to Client teams. Must have strong experience designing and operating production-grade data platforms and pipelines. Proficient in Python and SQL. Experience with cloud-based data solutions. Strong knowledge of data modelling, schemas and transformations. Experience with data orchestration and automated workflows. Experience integrating systems through APIs. Experience with data quality, pipeline monitoring and observability.Skills
Sign in to read and join the discussion.