Lead Data Engineer
Posted Updated
Description
EPAM Systems Inc is seeking a hands-on Lead Data Engineer to build scalable data pipelines and cloud-based data solutions on AWS. You will leverage Python, Pandas, and PySpark to process large datasets, orchestrate workflows via MWAA, and query data with Athena.
Automation with Terraform and GitHub Actions will streamline deployments and CI/CD pipelines. You will lead development efforts in an Agile environment, review code, and promote sound engineering practices across cross-functional teams,
Build scalable data pipelines on AWS infrastructure. Develop data solutions using Python, Pandas and PySpark. Orchestrate workflows with MWAA/Airflow; coordinate via AWS services like Athena. Automate infrastructure with Terraform and GitHub Actions. Implement testing, monitoring, and data quality safeguards. Review code and promote engineering best practices in an Agile setting. Five+ years of professional experience in data engineering. Experience leading development teams (minimum 1 year). Strong Python data engineering background with Pandas. Hands-on PySpark for large-scale processing. Experience with AWS MWAA/Airflow for data orchestration. Healthcare benefits Learning & development programs Global career opportunitiesSkills
Sign in to read and join the discussion.