Senior Data Engineer/ Databricks, PySpark, Python
Posted Updated
Description
EPAM Systems is seeking a Senior Data Engineer / Databricks Engineer to join a project focused on collecting, processing, and analyzing vehicle telemetry data for a major European automotive manufacturer. The platform operates at scale in Azure Databricks, running about 200 Databricks jobs across Europe, North America, and China, with a new China deployment planned.
The role emphasizes building scalable, cost-aware infrastructure, improving observability, and optimizing PySpark workloads for
Monitor health, stability, and performance of production data platform. Investigate and resolve performance issues and incidents. Analyze Databricks workloads and optimize PySpark jobs for performance and cost. Support 200+ existing Databricks jobs and pipelines. Design scaling strategies with cost-focused infrastructure. 3+ years hands-on data engineering experience. Experience with Azure Databricks and PySpark. Strong Python development skills. Experience optimizing large-scale Spark workloads. Background in production data platforms and monitoring. Upskilling program Mentoring programs Certification support English courses Private health insurance Well-being eventsSkills
Sign in to read and join the discussion.