DevOps / Platform Engineer (AI Evaluation)
Summary
This role involves designing and reviewing production-style DevOps and infrastructure engineering tasks to help evaluate and improve AI systems. Engineers will create technical scenarios covering CI/CD, container orchestration, and cloud infrastructure while providing feedback on AI-generated outputs.
About Us
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
Role Overview
Our client is supporting the development of advanced AI systems through realistic engineering tasks based on modern cloud and infrastructure environments.
We are looking for experienced DevOps, SRE, and Platform Engineers to design and review production-style technical scenarios across CI/CD, containers, Kubernetes, cloud infrastructure, Infrastructure as Code, observability, and incident response. The role combines hands-on engineering with evaluation and technical review. No prior AI experience is required.
COMMITMENT: Minimum 20 hours per week
LOCATIONS: Remote
NOTES: This role requires hands-on coding ability in addition to infrastructure and automation expertise.
Responsibilities
- Design realistic DevOps and infrastructure tasks based on production-style scenarios.
- Create working reference solutions with clear setup, execution, and validation steps.
- Develop scenarios covering CI/CD, containers, orchestration, Infrastructure as Code, monitoring, and incident response.
- Review AI-generated technical outputs for correctness, completeness, and reproducibility.
- Identify configuration, infrastructure, or implementation failures and provide precise corrections.
- Validate that technical tasks can be reproduced consistently in the intended environment.
- Apply a high quality bar to infrastructure design, automation, and operational workflows.
- Document technical reasoning, expected outcomes, and troubleshooting steps clearly.
- Provide structured feedback to improve future task and evaluation design.
Requirements
- At least 3 years of professional experience in DevOps, SRE, Platform Engineering, or Infrastructure Engineering.
- Strong programming ability in Python, Go, Bash, or TypeScript, beyond basic scripting.
- Hands-on experience with CI/CD using tools such as GitHub Actions, GitLab CI, or Jenkins.
- Strong practical experience with Docker and Kubernetes.
- Professional experience with at least one major cloud platform: AWS, GCP, or Azure.
- Hands-on Infrastructure as Code experience with Terraform, Ansible, Pulumi, or CloudFormation.
- Advanced working knowledge of Linux and Git.
As published by workable
First name, Last name, Email, Phone, Address, Education, Experience, Summary, Resume
- Please provide a valid and up-to-date LinkedIn profile URL that clearly reflects your professional experience, technical skills, and employment history relevant to the job. Example format: https://www.linkedin.com/in/yourprofile Applications with incomplete, inactive, or non-professional LinkedIn profiles may not be considered.
- You will be paid per accepted task with minimum expected weekly output. Please confirm you agree with this model. yes / no
- Please attach any GitHub, Articles, Youtube Channels, any public content regarding your experience you'd like to share with us. written answer
- How soon can you start the work? (in days)
- How many hours per week are you available to work?
- What is your expected hourly rate in USD?