Lead Data Engineer: Scalable Cloud Pipelines & Automation
Summary
Lead Data Engineer at EPAM building scalable cloud data pipelines on AWS: authoring Airflow DAGs, automating infrastructure with Terraform and GitHub Actions CI/CD, and processing large-scale data with Python/Pandas and PySpark, while ensuring testing, monitoring, and data quality in an Agile, cross-functional team.
EPAM Systems Inc. is seeking a hands-on Lead Data Engineer to build scalable data pipelines on AWS and craft cloud-based data solutions. You will lead development, implement DAGs with Airflow, and drive automation with Terraform and CI/CD via GitHub Actions.
You will apply Python (Pandas) and PySpark to large-scale data processing, coordinate with cross-functional teams in an Agile setup, and ensure robust testing, monitoring, and data quality across production pipelines.
#J-18808-LjbffrSkills
Sign in to read and join the discussion.