Lead Data Software Engineer
Posted Updated
Description
EPAM Systems Inc is seeking a Lead Data Software Engineer to design scalable data pipelines, implement ingestion from multiple sources, and deliver clean, rigorously tested Spark-based code within an agile environment.
You will mentor teams, ensure data quality, and collaborate across functions while advancing Delta Lake, Unity Catalog, and Databricks workloads in a distributed data platform.
Design and assemble scalable data pipelines across platforms. Build and maintain ingestion from multiple source systems. Write clean, tested code using solid software engineering practices. Collaborate with cross-functional teams to translate data needs into solutions. Monitor pipeline performance and ensure reliability; participate in code reviews. 5+ years of hands-on data engineering experience. Leadership experience in development teams (1+ year). Strong PySpark and Spark SQL experience for large-scale data. Experience with data orchestration tools (Lakeflow). Delta Lake/Unity Catalog for data storage and governance.Skills
Sign in to read and join the discussion.