Senior Data Engineer — Scale Pipelines on AWS & Airflow
Posted Updated
Description
EPAM Systems Inc. is seeking a hands-on Senior Data Engineer in Colombia to design, build, and support scalable data pipelines on AWS. You will leverage Python, Pandas, and PySpark to deliver robust data processing solutions and orchestrate workflows with MWAA.
Automate infrastructure with Terraform and GitHub Actions, and enforce data quality in an Agile setting. The role emphasizes production-grade engineering, DevOps practices, and collaboration with cross-functional teams on complex data
Design, build, and maintain scalable data pipelines on AWS. Develop data processing solutions using Python, Pandas, and PySpark. Orchestrate workflows with MWAA/Airflow. Query data with Athena to support analysis. Automate infrastructure with Terraform and GitHub Actions. Implement testing, monitoring, and data quality controls. Collaborate in an Agile environment and participate in code reviews. 3+ years of data engineering experience. Strong Python and Pandas for data processing. Hands-on PySpark for large-scale workloads. Experience with AWS MWAA or Airflow orchestration. CI/CD and DevOps practices. Healthcare benefits Employee financial programs Paid time offSkills
Sign in to read and join the discussion.