Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Tech Junction Ltd

AI QA & Reliability Engineer (SRE) – Banking Cloud

Posted Updated

Description

Halian in Abu Dhabi, UAE is seeking an experienced AI Quality & Reliability Engineer (QA/SRE) to own testing of AI/LLM systems within a banking-industry client. You’ll drive production readiness, implement automated test suites with PyTest, Selenium, and Robot Framework, and oversee observability with Grafana and Prometheus.

Ideal candidates have 6+ years in software quality assurance, cloud engineering, and SRE, strong Python proficiency, hands-on Azure/AWS experience, and a track record in

Design, build, and execute automated testing frameworks for cloud-based AI solutions and LLM applications. Spearhead SRE initiatives, observability monitoring, and incident response runbooks in banking environments. Conduct load testing, stress testing, chaos engineering, and scalability evaluations using K6 and JMeter. Perform specialized AI/LLM testing, prompt evaluation, and Retrieval-Augmented Generation (RAG) evaluation. Configure, maintain, and analyze infrastructure monitoring telemetry via Grafana, Prometheus, Azure Monitor, and AWS CloudWatch. Implement CI/CD pipelines with automated infrastructure validation checks. Validate banking-grade security baselines, data compliance protocols, and high-availability production architectures. Write robust test automation scripts utilizing Python, PyTest, Selenium, and Robot Framework. Collaborate with ML developers, cloud architects, and financial stakeholders. Maintain comprehensive technical documentation, test coverage reports, failure analysis logs, and SRE post-mortem reviews. Bachelor's or Master's degree in Computer Science, Software Engineering, Information Technology, or a related technical discipline. Minimum 6+ years of professional experience spanning software quality assurance, cloud engineering, and site reliability engineering (SRE). Strong programming proficiency in Python and hands-on expertise with testing frameworks (PyTest, Selenium, Robot Framework). Practical hands-on experience deploying and managing enterprise workloads on Azure and/or AWS cloud platforms. Proven experience conducting load testing, performance tuning, and chaos engineering (K6, JMeter). Specialized expertise in AI/LLM testing, prompt evaluation, and RAG pipeline accuracy verification. Solid operational knowledge of observability platforms including Grafana, Prometheus, Azure Monitor, and CloudWatch. Familiarity with security, compliance, and auditing requirements in banking-grade production environments. Professional availability for full-time employment in Abu Dhabi, UAE.

Skills

Apply

See also

SRE jobs by country — openings, pay and top skills →