Search jobs right inside Claude, ChatGPT or Cursor. Connect freehire over MCP — free, no account needed to search.
Builds and scales the data pipelines and infrastructure that process tens of millions of user votes powering Arena's AI model evaluation platform. Day to day: designing production pipelines, ensuring data quality, and creating dashboards/reports using SQL, Python, and big data tools like Spark, Databricks, or Snowflake.
Designs and runs ML experiments to evaluate how AI models perform in the real world using human preference data — training reward/preference models, fine-tuning LLMs (RLHF, DPO), and building evaluation metrics that power Arena's public leaderboard. Core stack: Python, PyTorch/JAX/TensorFlow, statistics, and large-scale deep learning research.
A hands-on security engineering role at Arena (the LLM evaluation platform): you own authentication, authorization, multi-tenant isolation, and AI-specific security in the product codebase, designing and shipping production code rather than routing findings. Stack includes TypeScript, Go, Python, and Postgres.
Senior hands-on IT & security engineer at Arena (an AI model evaluation platform) to own identity, endpoint, and access management: Okta SSO/SCIM and lifecycle automation, Apple-heavy fleet management (Intune, Apple Business Manager, CrowdStrike), extending entitlement controls to production/developer systems, automating manual workflows, and documenting operations for compliance. Onsite in San Fr
About Arena Intelligence Arena is the platform for evaluating how AI models perform in the real world. Founded by researchers from UC Berkeley's SkyLab, we're on a mission to measure and advance the frontier of…