SDET / Automation Testing with Python and Java
Posted Updated
Summary
Full-time SDET role in Austin, TX focused on automation testing with Python and Java for AI/ML and LLM-based systems. Day-to-day work spans evaluation pipelines (faithfulness, hallucination detection), LLM-as-a-Judge scoring, adversarial/safety testing, telemetry analysis, and CI/CD quality gates.
Position: SDET / Automation Testing with Python and Java
Location: Austin, TX
Employment Type: Full-Time
Key Requirements:
- Strong Python automation testing experience
- Testing AI/ML and LLM-based systems
- Evaluation pipelines: faithfulness, hallucination detection, task completion
- LLM-as-a-Judge and rubric-based scoring
- Adversarial/safety testing (prompt injection, jailbreaks, PII validation)
- Log, trace, and telemetry analysis
- Synthetic data and persona generation
- Exposure to LLMs, Agentic AI systems, Claude Code, MCP
- CI/CD quality gates and QA automation expertise
Skills
Sign in to read and join the discussion.