Point your AI agent at freehire and let it find you a job.

Get the CLI →

Apple

NewBe an early applicant

Engineering Leader, AI Safety Engineering & Evaluation, Apple Services Engineering

Posted Updated
Discussion

Summary

Leads a new multidisciplinary AI Safety Engineering & Evaluation org inside Apple's Human-Centered AI group, building automated, scientifically rigorous safety evaluation of AI models across Apple services (App Store, Music, TV). Day to day: set technical direction, grow managers/teams, and drive ML/LLM-based assessment, adversarial testing, and risk mitigation, primarily in Python.

Apple Services Engineering (ASE) powers AI and machine learning experiences across the App Store, Apple Music, Apple TV, and more. We build intelligent, deeply personal experiences designed to serve users around the world. Ensuring these experiences are safe, trustworthy, and representative of the diverse communities we serve is fundamental to how we develop and deploy AI.

We are seeking an experienced engineering leader to lead AI Safety Engineering & Evaluation within the Human-Centered AI organization. This role combines software engineering, machine learning, evaluation science, and Responsible AI to develop scalable capabilities for identifying, measuring, and mitigating risks associated with AI-powered experiences.

You will lead an emerging, multidisciplinary organization of engineering managers, engineers, and applied scientists, building the technical expertise, engineering practices, and organizational capabilities needed to scale AI safety evaluation. This is an opportunity to shape a growing function, developing its technical foundations while transforming manual safety assessments into automated, scientifically rigorous processes.

The ideal candidate brings strong engineering leadership, practical expertise in machine learning and modern AI systems, and demonstrated success building technical organizations and translating complex challenges into measurable engineering outcomes.

As the Engineering Leader for AI Safety Engineering & Evaluation, you will lead the development and operationalization of technical capabilities to systematically assess AI model behavior, identify potential harms, and measure the effectiveness of safety mitigations.

Your organization will advance safety evaluation methodologies, model-based assessment, adversarial testing, automated risk identification, and failure analysis. In partnership with Evaluation Systems & Research (ESR), which provides shared evaluation infrastructure and services, you will integrate safety-specific models, assessment workflows, and measurement capabilities into scalable evaluation systems.

You will establish the technical direction, organizational structure, and engineering practices needed for a growing team to operate effectively. This requires a leader who can engage deeply in technical decisions, develop engineering managers and senior contributors, and progressively build the organization's ability to deliver complex technical solutions.

You will work closely with machine learning engineering, research, product, privacy, legal, and safety policy teams to translate safety requirements into measurable technical standards and actionable insights that inform AI development and deployment decisions.

Minimum Qualifications

  • 12+ years of experience in software engineering, machine learning engineering, applied AI, or related technical disciplines, including demonstrated experience delivering complex production-quality systems.
  • 8+ years of engineering or applied machine learning management experience, including at least 3 years managing engineering managers or leading multiple technical teams through established managers.
  • Demonstrated experience building or transforming engineering organizations, including developing technical talent, establishing engineering practices, and scaling teams through periods of organizational or technical growth.
  • Strong software engineering foundation, including experience guiding architecture, implementation, and operationalization of complex software or AI/ML solutions.
  • Practical expertise in machine learning and modern AI architectures, including model development, inference, and evaluation methodologies.
  • Strong technical foundation in Python and modern software development practices, with the ability to assess technical tradeoffs and guide engineering execution.
  • Demonstrated ability to develop technical roadmaps, establish priorities, manage resources, and deliver measurable outcomes in ambiguous environments.
  • Excellent communication and stakeholder management skills, with experience influencing senior technical and cross-functional leaders.
  • Bachelor's degree in Computer Science, Machine Learning, Engineering, or a related technical field, or equivalent practical experience.

Preferred Qualifications

  • Experience leading teams developing AI/ML evaluation systems, automated model assessment, or applied machine learning solutions.
  • Experience with generative AI and large language models, including LLM-based evaluation, agentic systems, model orchestration, or adversarial testing.
  • Applied experience with machine learning modeling, statistical analysis, experimental design, and quantitative evaluation methods.
  • Experience developing automated model assessors, synthetic data generation, red teaming, or systematic failure analysis capabilities.
  • Familiarity with Responsible AI principles and technical approaches to fairness, bias, robustness, harmful content, and safety risk assessment.
  • Experience integrating evaluation capabilities into existing engineering platforms, development workflows, or continuous measurement processes.
  • Experience leading multidisciplinary engineering organizations through technical transformation, particularly involving automation or applied machine learning.
  • Ability to translate emerging research techniques into reliable engineering implementations.
  • Advanced degree in Computer Science, Machine Learning, Artificial Intelligence, or a related technical discipline.

Skills

Apply

See also

ML / AI jobs by country — openings, pay and top skills →

Tailor your CV for this role?

We couldn't check your fit for this role — add a CV to your profile to see it next time.

A new version of freehire is available