Senior Quality Engineer, AI and Automation
C3 AI (NYSE: AI), is the Enterprise AI application software company. C3 AI delivers a family of fully integrated products including the C3 Agentic AI Platform, an end-to-end platform for developing, deploying, and operating enterprise AI applications, C3 AI applications, a portfolio of industry-specific SaaS enterprise AI applications that enable the digital transformation of organizations globally, and C3 Generative AI, a suite of domain-specific generative AI offerings for the enterprise. Learn more at: C3 AI
C3 AI is looking for a Senior Quality Engineer, AI and Automation to define and drive the quality strategy for our next generation of AI-enabled products and platforms. In this role, you will design and build scalable automated test frameworks, develop novel approaches for validating AI-generated outputs and agentic workflows, and establish the metrics that keep our products reliable at enterprise scale. You will work at the intersection of software quality engineering and applied AI, ensuring that quality is engineered into every stage of the development lifecycle.
This is a great role for an experienced quality engineer who is passionate about AI and automation and wants to operate with a high degree of autonomy on complex, high-visibility initiatives. You will influence quality strategy across multiple teams, provide technical leadership and mentorship, and partner closely with software engineering, product, and AI stakeholders to raise the bar on how enterprise AI is tested and delivered.
Responsibilities
- Define and execute quality strategies for AI-enabled products and platforms.
- Design, develop, and maintain scalable, automated test frameworks across UI, API, and end-to-end testing.
- Create test plans covering functional, integration, end-to-end, performance, and reliability testing.
- Develop automated validation approaches for AI-generated outputs and agentic workflows, including accuracy, reliability, consistency, and safety.
- Establish quality metrics and dashboards to measure product health and AI system effectiveness.
- Integrate automated tests into CI/CD pipelines and build automated quality gates for AI workflows.
- Identify quality risks early and drive resolution strategies across complex systems.
- Evaluate and implement AI-powered testing tools and methodologies.
- Mentor engineers, promote quality engineering best practices, and drive continuous improvement initiatives across the organization.
Qualifications
- Bachelor's degree in Computer Science, Software Engineering, Computer Engineering, or a related field.
- 5+ years of experience in Quality Engineering, Test Automation, SDET, or Software Engineering roles.
- Strong programming experience in Java, Python, or a similar object-oriented language.
- Hands-on experience developing and maintaining automated test frameworks, with UI, API, and end-to-end automation testing.
- Experience with modern test automation tools such as Playwright, Selenium, Cypress, or equivalent.
- Experience integrating automated tests into CI/CD pipelines and working with Git.
- Strong understanding of the software development lifecycle, Agile methodologies, and quality engineering best practices.
- Demonstrated ability to analyze complex systems, architect test frameworks, and identify quality risks.
- Excellent written and verbal communication skills.
Preferred Qualifications
- Experience testing AI-powered applications, machine learning systems, LLMs, or AI agents.
- Experience designing evaluation strategies for AI outputs, including accuracy, reliability, consistency, and safety.
- Familiarity with AI evaluation frameworks such as DeepEval, LangSmith, Ragas, or similar tools.
- Experience validating Retrieval-Augmented Generation (RAG) systems and knowledge of prompt engineering and AI model evaluation techniques.
- Experience building automated quality gates for AI workflows and AI-assisted test generation.
- Experience with cloud platforms such as AWS, Azure, or GCP, containerized environments, and observability and monitoring tools.
- Experience mentoring engineers and driving quality initiatives across teams.
C3 AI provides a competitive compensation package and excellent benefits.
C3 AI is proud to be an Equal Opportunity and Affirmative Action Employer. We do not discriminate on the basis of any legally protected characteristics, including disabled and veteran status.
Skills
As published by greenhouse · 8 questions
Basics
First Name, Last Name, Email, Phone, Resume/CV, Location
Short answers (2)
- LinkedIn Profile
- Where are you currently located?
Pick from a list (6)
- How did you hear about C3 AI?
- What is the highest level of education you have completed?
- Do you currently hold your professional license (cédula)?
- Are you willing to work onsite from our Guadalajara office, 5 days/week?
- Do you now or will you in the future require immigration sponsorship to work at C3 AI in Mexico?
- By clicking the “I Accept” button, you confirm that you have read C3 AI’s Applicant & Candidate Privacy Notice [https://c3.ai/c3ai-inc-applicant-and-candidate-privacy-notice] and you provide the specific consents identified below. Except where C3 AI expressly asks for your consent, C3 AI processes your personal data for recruitment on the basis of its legitimate interests and to take steps at your request before any employment relationship, and you are not required to consent to that processing: C3 AI collects your personal data for the purposes of managing C3 AI's recruitment related activities as well as for organizational planning purposes globally. Consequently, C3 AI may use your personal data in relation to the evaluation and selection of applicants including for example setting up and conducting interviews and tests, evaluating and assessing the results thereto and as is otherwise needed in the recruitment processes including the final recruitment. Some evaluations are assisted by automated tools: C3 AI uses AI-based matching to compare your application against the requirements of the role and, for some roles, an AI-based “Voice AI” tool that records and analyzes a voice screening interview. A member of our team reviews the results and makes the final decision, and no decision is made based solely on automated processing. You may request more information about the logic involved, request a review by a person, and — for voice interviews — decline to be recorded and request a standard interview instead, in each case without any penalty to your application. C3 AI does not disclose your personal data to unauthorized third parties. However, as a global corporation consisting of multiple affiliated companies in various countries, C3 AI has international sites and C3 AI uses resources located throughout the world. C3 AI may from time to time also use third parties to act on C3 AI's behalf. You agree to the fact that to the extent necessary your personal data may be transferred and/or disclosed to any company within C3 AI group of companies as well as to third parties acting on C3 AI's behalf, including also transfers to servers and databases outside the country where you provided C3 AI with your personal data. Such transfers may include for example transfers and/or disclosures outside the European Economic Area (“EEA”) and in the United States of America; in such cases, the transfer is based on, as applicable, the Standard Contractual Clauses (according to Commission Implementing Decision (EU) 2021/914, and, for transfers from the United Kingdom, the UK International Data Transfer Addendum), the EU-US Data Privacy Framework where applicable, or other GDPR-compliant mechanisms. You may withdraw any consent at any time, and exercise your rights of access, correction, deletion, objection, and (where applicable) your ARCO rights, by contacting C3 Legal at c3legal@c3.ai withdrawing consent will not affect processing carried out before the withdrawal. C3 AI will not retaliate against you for exercising these rights or for declining to consent. Full details of how C3 AI handles your information, how long it is kept, and your rights are set out in our Applicant & Candidate Privacy Notice [https://c3.ai/c3ai-inc-applicant-and-candidate-privacy-notice].