Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

EPAM Systems Inc

NewBe an early applicant

Senior Data Engineer — Databricks, Medallion Modeling

Posted Updated

Summary

Senior Data Engineer at EPAM in Sydney designing Bronze/Silver/Gold medallion-architecture data models and building Databricks pipelines with Delta Lake, Delta Live Tables, PySpark/Spark SQL, and Structured Streaming/Kafka ingestion, while strengthening governance, data quality, and lineage via Unity Catalog and CI/CD practices.

EPAM Systems Inc. seeks a Senior Data Engineer to model large-scale data across Bronze, Silver and Gold layers using medallion architecture.

You will build Databricks pipelines with Delta Lake and Delta Live Tables, develop Spark workloads in PySpark and Spark SQL, and implement streaming with Structured Streaming and Kafka. You’ll collaborate with stakeholders to deliver governed data products and strengthen data quality and lineage.

Design trusted Bronze, Silver and Gold layers using medallion architecture principles. Model large-scale batch and streaming datasets into reusable, governed data models for reporting use cases. Build Databricks pipelines using Delta Lake, Delta Live Tables or Lakeflow aligned to quality and lineage needs. Develop Spark workloads using PySpark and Spark SQL for performance, reliability and maintainability. Implement streaming ingestion and processing using Spark Structured Streaming and Kafka or similar. Partner with business and regulatory stakeholders to translate reporting needs into data products and model definitions. Strengthen governance with cataloging, lineage and data quality checks using Unity Catalog or equivalent patterns. Contribute to CI/CD for data pipelines, Git-based workflows, testing and release practices. Data modeling background across conceptual, logical and physical models using dimensional, Data Vault or similar approaches. Databricks experience, including Delta Lake plus governance concepts such as Unity Catalog. Apache Spark skill sets using PySpark and Spark SQL in production environments. Streaming data experience using Spark Structured Streaming, Kafka or similar technologies. Python capability for pipeline development and orchestration patterns. Advanced SQL skill sets for transformation logic, validation and performance tuning. Data governance experience covering quality, lineage, controls and well-defined data contracts. AI-assisted development tooling exposure, with Claude preferred, to accelerate build, testing and documentation. Great Place To Work-Certified Glassdoor Top 100 Best Places to Work Most Loved Workplace (Newsweek 2021-23 Voice-driven ideas culture

Skills

What Senior Data Engineering jobs ask for — and how much of it you have →
Apply

See also

Data Engineering jobs by country — openings, pay and top skills →