AI Model Evaluation DevOps Engineer
Summary
Evaluates AI coding agents by running infrastructure tasks on cloud platforms, reviewing outputs for reliability issues, and iterating on automation workflows.
Obsidian is seeking contributors for a Frontier Code Agents project where you will use AI coding agents to complete and evaluate complex infrastructure engineering tasks. The role focuses on reviewing model outputs and identifying reliability issues using various cloud platforms and automation tools.
Applicants should have over 2 years of professional experience in DevOps or Cloud Engineering, especially with AWS, Azure, GCP, and Kubernetes. Compensation is tied to accepted tasks and ranges approximately $400 for each task completed in 2-3 hours.