Data DevOps Engineer
Summary
Builds and maintains AWS-based CI/CD pipelines and Terraform infrastructure for data operations, focusing on Kubernetes and scalable data services.
We are seeking a skilled Data DevOps Engineer to configure CI/CD for data pipeline rollouts and build robust AWS infrastructure using Terraform, ensuring reliable and scalable data operations.
Responsibilities
- Collaborate with architects and data engineers to gather requirements and translate them into CI and infrastructure setups
- Create and manage AWS infrastructure through Terraform to support data operations
- Document CI/CD processes meticulously to ensure repeatability and maintain standards
Requirements
- 2+ years of experience building and maintaining complex CI/CD pipelines on AWS, including automated testing, artifact management and multi-environment deployments with quality gates, security scanning and infrastructure validation
- Expertise in AWS core services including S3, VPC and EC2, with particular need for operating production-grade systems on Amazon Elastic Kubernetes Service
- Proficiency in Terraform including modular infrastructure design, reusable modules, environment isolation and integration with CI/CD pipelines for automated infrastructure provisioning and updates
Nice to have
- Familiarity with Redshift, Glue, Spark and Athena for data processing and analytics workloads
- Familiarity with AWS Cloud Development Kit, AWS CloudFormation and Amazon Managed Workflows for Apache Airflow
- Skills in Jira and Confluence
We offer
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn