Software Engineer in Test - Python Automation
Posted Updated
Summary
SDET (Software Engineer in Test) working onsite in Austin, TX, focused on Python-based testing of ML/LLM systems: building eval pipelines (faithfulness, hallucination), LLM-as-a-judge scoring, adversarial/safety testing, and CI/CD quality gates, using AI-assisted engineering tools like Claude Code and MCP.
Role: SDET - Python Automation
Location: Austin, TX - Onsite
Role: Fulltime
Job Description:
- Python ML side testing mainly.
- Eval pipelines (faithfulness, hallucination, task completion)
- LLM-as-a-Judge / rubric scoring
- Adversarial / safety testing (injection, jailbreak, PII)
- Trace / log / telemetry triage
- Synthetic data / persona generation
- Python
- LLM / agentic system exposure
- AI-assisted engineering (Claude Code, MCP)
- CI/CD gating
- QA automation depth
Skills
Sign in to read and join the discussion.