Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Programmers.io

NewBe an early applicant

Software Engineer in Test - Python Automation

Posted Updated

Summary

SDET (Software Engineer in Test) working onsite in Austin, TX, focused on Python-based testing of ML/LLM systems: building eval pipelines (faithfulness, hallucination), LLM-as-a-judge scoring, adversarial/safety testing, and CI/CD quality gates, using AI-assisted engineering tools like Claude Code and MCP.

Role: SDET - Python Automation

Location: Austin, TX - Onsite

Role: Fulltime


Job Description:

  • Python ML side testing mainly.
  • Eval pipelines (faithfulness, hallucination, task completion)
  • LLM-as-a-Judge / rubric scoring
  • Adversarial / safety testing (injection, jailbreak, PII)
  • Trace / log / telemetry triage
  • Synthetic data / persona generation
  • Python
  • LLM / agentic system exposure
  • AI-assisted engineering (Claude Code, MCP)
  • CI/CD gating
  • QA automation depth

Skills

Apply

See also

Software Engineering jobs by country — openings, pay and top skills →