AI Quality & Reliability Engineer – QA/SRE
Posted Updated
Description
D4 Insight is seeking an AI Quality & Reliability Engineer in Abu Dhabi to own production readiness for cloud AI solutions. This hybrid role blends automated testing, AI evaluation, and SRE practices to ensure resilient, secure platforms with strict banking standards.
You will build automated test frameworks, implement monitoring, and drive reliability initiatives across Azure/AWS environments. The ideal candidate has 7+ years of experience, strong Python expertise, and hands-on cloud
Design and execute automated testing frameworks for AI services such as Azure OpenAI and AWS Bedrock. Test AI solutions for model hallucinations, accuracy, content safety, and latency. Build CI/CD-integrated test suites using Python to validate application logic and infrastructure state. Implement Chaos Engineering and load testing for banking-scale web and mobile backends. Define and monitor SLIs and SLOs; configure monitoring with Azure Monitor or AWS CloudWatch. Automate security scans and align AI data handling with banking data residency and privacy requirements. 7+ years of relevant experience in AI testing, reliability engineering, or SRE roles. Proficient in Python and automation frameworks (PyTest, Selenium, Robot Framework). Hands-on with Azure or AWS networking, scaling, and serverless reliability. Familiarity with AI evaluation methods (RAG, ROUGE/ BLEU) and LLM benchmarks.Skills
Sign in to read and join the discussion.