Senior Data Engineer - GenAI Pipelines on AWS & Spark
Posted Updated
Description
EPAM Systems Inc is seeking a Senior Data Engineer to design, build, and maintain large-scale data pipelines and distributed processing systems that power AI-driven initiatives. The role emphasizes Spark-based development, AWS cloud architectures, and strong SQL skills to support Gen AI and ML applications.
Responsibilities include building data platforms, ETL/ELT workflows, data modeling for lakehouse architectures, governance, and collaboration with cross-functional teams.
Design, build, and maintain large-scale data pipelines and distributed processing systems using Spark. Develop and support data platforms that enable AI/ML and Generative AI applications. Architect and implement solutions within AWS cloud environments using cloud-native patterns. Build and optimize ETL/ELT workflows to support analytical and operational use cases. Implement data modeling strategies aligned with modern data lakehouse architectures. Ensure data quality, governance, and monitoring across all data assets. Deliver secure, scalable, and highly available data solutions following operational best practices. Collaborate with cross-functional teams to support AI-driven business initiatives. Write advanced SQL queries and production-grade code in Java, Scala, or Python. 5+ years of experience in Data Engineering with exposure to Gen AI/ML-based applications. Experience building and maintaining large-scale data pipelines and distributed processing systems using Spark with Java/Scala/Python. Familiarity with AI/ML, Generative AI, or data platforms supporting AI-driven initiatives. Expertise in AWS cloud environments and cloud-native architectures. Advanced proficiency in SQL. Skills in data modeling and modern data lakehouse architectures. Understanding of data quality, governance, monitoring, and operational best practices. Competency in building secure, scalable, and highly available data solutions. ETL/ELT development experience. Proficiency in English at an Upper-Intermediate level (B2) or higher. Nice to have Databricks or Snowflake experience across cloud platforms.Skills
Sign in to read and join the discussion.