AI Quality Assurance Engineer
Posted Updated
Description
Tawantech is seeking an AI Quality Assurance Engineer to safeguard the quality, reliability, and performance of AI/ML solutions across development and production. The role designs and implements testing strategies for models, data pipelines, APIs, and deployments, ensuring alignment with business, security, and regulatory requirements.
You will collaborate with Data Scientists, AI Engineers, and stakeholders to automate tests, monitor drift, and enforce quality gates within CI/CD pipelines.
Develop and execute QA/testing strategies for AI/ML solutions. Validate AI models for accuracy, consistency, robustness, and performance. Design test cases for ML models, AI apps, APIs, and data pipelines. Perform data quality, data validation, and data integrity testing. Test AI outputs for accuracy, bias, hallucination, reliability, and consistency where applicable. Conduct regression, integration, functional, performance, and automated testing. Establish quality gates and acceptance criteria for AI model deployment. Monitor model performance and identify model/data drift in production. Collaborate with Data Scientists, AI Engineers, Data Engineers, and Business stakeholders. Automate testing processes and integrate QA activities into CI/CD pipelines. Document defects, test results, risks, and remediation activities. Support model governance, auditability, and compliance requirements. Bachelor’s degree in CS, data science, AI, engineering, or related field. 5+ years in QA, AI/ML testing, software testing, or data quality. Strong understanding of ML lifecycle processes. Experience with Python and automated testing frameworks. Knowledge of SQL and data validation techniques. Experience with APIs, cloud platforms, CI/CD, and version control. Understanding of ML evaluation metrics and model monitoring. Strong analytical, problem-solving, and communication skills.Skills
Sign in to read and join the discussion.