AI Quality Engineer

Unlock your potential with Dassault Systèmes, a global leader in Scientific Software Engineering, as we are hiring an AI Quality Engineer in Kuala Lumpur, Malaysia!

Join us in building a next-generation AI Virtual Companion for Operation Planning & Optimization. Powered by Large Language Models (LLMs) and agentic AI, you'll help create intelligent systems that can reason, retrieve information, and act autonomously.

Role Responsibilities & Job Description:

• Prompt Engineering & Evaluation: Design and execute sophisticated test cases using prompt injection and adversarial testing to evaluate the AI’s boundaries and responses.
• LLM Benchmarking: Utilize advanced frameworks to measure performance in critical areas like hallucination rates, sentiment consistency, and context retention.
• Automated Validation: Build and maintain automated pipelines that leverage "LLM-as-a-judge" patterns to evaluate model outputs at scale.
• Safety & Bias Auditing: Lead "Red Teaming" sessions to identify potential biases, toxic content, or PII (Personally Identifiable Information) leaks.
• Regression Testing: Manage the evaluation of model performance across different versions to ensure seamless upgrades and stability.
• Collaboration & Delivery: Work with Product Owner, Developers, AI Engineers and UX Designers to deliver the Virtual Companion. Contribute to sprint planning, code reviews and documentation.
  

Requirements & Qualifications:

• Bachelor’s degree or above, with 2-5 years in software development and relevant experience specifically within the AI/ML development landscape.
• AI/ML Literacy: A strong grasp of LLM fundamentals, including tokens, temperature, top-p, and context windows.
• Programming: Proficiency in Python.
• API Testing: Expertise in testing RESTful APIs and WebSocket connections for real-time AI interactions.
  

What's in it for you?

• You will be working at the intersection of Software Engineering, Data Science, and Ethics. You will play a pivotal role in defining what "quality" means for the next generation of Virtual Companions, helping us build AI that users can trust and enjoy.
• Impact: Directly shape a product that will be used by global supply chain leaders.
• Innovation: Work at the intersection of Generative AI, agentic systems, and real world optimization.
• Culture: Collaborative, ethically driven, and inclusive environment.
• Growth: Dedicated learning budget, hands on exposure to real world supply chain challenges, clear career pathways