freehire launches on Product Hunt on 26 August.

Follow →

AI QA Engineer

Summary

QA Engineer testing AI-driven cybersecurity tools: design test cases, validate AI outputs, automate workflows, and ensure reliability, accuracy, and security of AI systems.

About Us: CyTech is an international cybersecurity company with offices in the USA, Israel, Singapore, and the Philippines, offering 24/7 high-end services. It specializes in CISO-focused solutions, executive training, and develops cybersecurity technologies that align business goals with security needs for seamless collaboration.

Qualifications:

  • Bachelor's degree in Computer Science, IT, or related field
  • 2-3+ years of experience in QA, including testing and validating AI-driven applications
  • Hands-on experience testing AI-powered applications, chatbots, or Generative AI solutions (required)
  • Strong experience in manual and automation testing
  • Proficient in Python or other scripting languages
  • Experience with API testing, AI data validation, and standard QA tools
  • Hands-on experience evaluating the performance, accuracy, and reliability of AI tools is required.
  • Knowledge of security testing is a strong advantage
  • Proven ability to take ownership, work independently, and deliver results in a fast-paced, AI-driven environment

Key Responsibilities:

Technical Skills

  • Serve as the main point of responsibility for the overall quality of AI-driven systems and processes.
  • Design and execute AI testing strategies, test cases, and automated testing workflows.
  • Test and validate AI Tools and applications to ensure quality and performance.
  • Check AI-generated outputs for accuracy, consistency, and reliability, using AI tools along with manual review.
  • Evaluate prompts and AI responses across various scenarios and use cases.
  • Review training datasets and data pipelines to ensure data quality and integrity.
  • Build and maintain AI testing tools and automated evaluation processes.
  • Analyze test results, identify defects, and recommend improvements to AI models and applications.
  • Ensure AI systems meet reliability, scalability, security, and compliance standards.
  • Support AI deployment and release activities through continuous testing and validation.
  • Work with developers and other teams to resolve issues and improve AI system performance.

Soft Skills

  • Takes full ownership of QA processes within a fast-paced, AI-driven environment
  • Communicate defects, vulnerabilities, and testing results clearly and constructively
  • Strong analytical and problem-solving skills
  • Self-motivated, proactive, and able to work with minimal supervision
  • Detail-oriented, particularly when reviewing AI-generated results
  • Adaptable in a fast-paced environment
  • Strong written and verbal communication skills

What We Offer:

  • A supportive and employee-focused work culture.
  • Opportunities for professional and personal growth.
  • Government-mandated benefits.
  • Two days off weekly for rest and personal time.

See also