Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Programmers.io

NewBe an early applicant

SDET / Automation Testing with Python and Java

Posted Updated

Summary

Full-time SDET role in Austin, TX focused on automation testing with Python and Java for AI/ML and LLM-based systems. Day-to-day work spans evaluation pipelines (faithfulness, hallucination detection), LLM-as-a-Judge scoring, adversarial/safety testing, telemetry analysis, and CI/CD quality gates.

Position: SDET / Automation Testing with Python and Java

Location: Austin, TX

Employment Type: Full-Time


Key Requirements:

  • Strong Python automation testing experience
  • Testing AI/ML and LLM-based systems
  • Evaluation pipelines: faithfulness, hallucination detection, task completion
  • LLM-as-a-Judge and rubric-based scoring
  • Adversarial/safety testing (prompt injection, jailbreaks, PII validation)
  • Log, trace, and telemetry analysis
  • Synthetic data and persona generation
  • Exposure to LLMs, Agentic AI systems, Claude Code, MCP
  • CI/CD quality gates and QA automation expertise


Skills

Apply

See also

QA jobs by country — openings, pay and top skills →