Senior DevOps Engineer

We are looking for a hands-on Senior DevOps Engineer to design, build, manage, and optimize scalable AWS cloud infrastructure supporting large-scale distributed platforms. The role involves working on competitive intelligence platforms that support large-scale web crawling and data collection workloads. The ideal candidate should have strong hands-on experience in AWS infrastructure, Kubernetes, Terraform, CI/CD automation, and production operations.

Responsibilities:

• Design, provision, and manage scalable AWS cloud infrastructure.
• Build and manage containerized workloads using Docker and Kubernetes.
• Develop and maintain Terraform-based infrastructure automation.
• Build and optimize CI/CD pipelines.
• Implement monitoring, logging, alerting, and observability solutions.
• Troubleshoot infrastructure issues and drive production incident resolution.
• Improve infrastructure reliability, scalability, availability, and performance.
• Implement cloud security best practices.
• Optimize AWS resource utilization and infrastructure costs.
• Support high-volume distributed workloads.
• Collaborate with engineering teams to improve automation and deployment processes.
• Contribute to high availability, disaster recovery, and resilience engineering.

Requirements:

• AWS Cloud Infrastructure: Strong hands-on experience with EC2, EKS/ECS, VPC, IAM, S3, CloudWatch, Auto Scaling, and Load Balancers.
• Docker and Kubernetes: Experience in containerization, orchestration, cluster management, deployments, and troubleshooting.
• Infrastructure as Code (IaC): Hands-on experience with Terraform or equivalent tools for infrastructure provisioning and automation.
• CI/CD: Experience building and maintaining pipelines using Jenkins, GitHub Actions, GitLab CI, or similar tools.
• Scripting and Automation: Proficiency in Python and/or Bash scripting.
• Monitoring and Observability: Experience with Prometheus, Grafana, CloudWatch, ELK, OpenSearch, or equivalent tools.
• Linux and Networking: Strong Linux administration skills and understanding of DNS, HTTP/HTTPS, TCP/IP, and cloud networking.
• Cloud Security: Knowledge of AWS IAM, least-privilege access, secrets management, and infrastructure hardening.
• Production Infrastructure Management: Experience managing production environments, troubleshooting incidents, and improving system reliability, availability, and performance.

Good to Have:

• Experience with large-scale web crawling, scraping, or data collection platforms.
• Exposure to proxy infrastructure and outbound networking.
• Experience managing high-volume, dynamically scaling container workloads.
• Knowledge of Kubernetes autoscaling and workload optimization.
• Experience with cloud cost optimization and FinOps.
• Exposure to Kafka, RabbitMQ, or AWS SQS.
• Familiarity with PostgreSQL, Redis, MongoDB, DynamoDB, and OpenSearch.
• Experience with GitOps tools such as ArgoCD or Flux.
• Knowledge of disaster recovery, high availability, and resilience engineering.
• Exposure to Java, Spring, or Kotlin.

Ideal Candidate Profile:

• 7+ years of experience in DevOps, cloud infrastructure, or platform engineering preferred.
• Strong hands-on expertise in AWS, Kubernetes, Docker, and Terraform.
• Experience managing production infrastructure independently.
• Strong understanding of automation, monitoring, networking, and cloud security.
• Proven experience in infrastructure scalability, reliability, and performance optimization.
• Candidates with large-scale web crawling, scraping, or proxy infrastructure experience will have an added advantage.