Android AI System SDET (Software Development Engineer in Test)

Job Responsibilities

1. Quality Assurance & Testing

• Perform manual and automated testing for Android AI system features, applications, services, and both in-market and pre-release builds.

• Create detailed test plans, write and execute test cases, and deliver test reports for new and existing functionalities.

• Ensure comprehensive functional and non-functional test coverage, including device resource validation (memory, CPU, battery).

• Add, update, maintain, and execute regression test suites and feature-based test cases.

• Maintain test scripts, documentation, and continuously improve test coverage and quality.

2. Build & Test Management

• Monitor automated and manual build and test executions, including follow-through on failures or unexpected behaviors.

• Perform and monitor manual/automated release processes for software builds, AI models, datasets, and configuration updates.

• Review test code and configuration changes, and update test logic to accommodate new scenarios or feature updates.

3. Issue Triage & Escalation

• Conduct first-level triage for new issues and analyze logs, behavior mismatches, and failure patterns.

• Provide daily updates on outstanding bugs, next steps, and clear recommendations for engineering teams.

• Track, validate, and verify defects for each release cycle.

• Escalate unresolved build errors, test harness failures, or complex issues when required.

4. AI Model Quality Analysis

• Receive and distribute new model/data files for internal experimentation and development.

• Perform essential model soundness checks (e.g., perplexity-based tests, basic validation).

• Execute performance and accuracy benchmark tests (e.g., XSum, COCO-Text) and generate structured reports.

• Monitor automated on-device AI model tests and triage or escalate unexpected output discrepancies.

• Produce performance evaluation reports based on defined guidelines.

5. Test Resource & Device Management

• Maintain test devices and lab resources, including re-installing, configuring, and preparing devices for test execution.

• Provide regular device-specific health and test result summaries to support system quality evaluation.

Requirements

Required Qualifications

• Experience in Android, Linux, embedded systems, or mobile software testing.

• Strong skills in manual and automated testing.

• Familiarity with writing/maintaining test cases and test scripts (Python, Bash, or similar).

• Ability to analyze logs and perform first-level issue triage.

• Experience with Git or similar version control systems.

• Good communication and documentation skills.

Preferred Qualifications

• Experience with AI/ML model testing, validation, or benchmarking.

• Hands-on experience with automated test frameworks or CI/CD pipelines (Jenkins, GitLab CI, etc.).

• Knowledge of Android platform internals or on-device AI components.

• Experience working with large codebases and multi-branch development environments.