Senior Machine Learning Engineering Manager, Ads Quality

Apple Apple · Big Tech · Cupertino, CA · Software and Services

This role is for a Senior Machine Learning Engineering Manager for Ads Quality at Apple. The primary focus is on leading a team to build and deploy ML models that ensure the quality and integrity of the ad network, with a specific emphasis on using LLMs for relevance, safety, and trustworthiness. The role involves developing and applying advanced ML techniques in a large-scale production environment, working across product, policy, and engineering teams, and analyzing large-scale experiments.

What you'd actually do

  1. You'll lead our Ads Quality team, where you will be responsible for building and deploying the machine learning models that define, measure, and enforce the quality and integrity of our advertising platform.
  2. You'll work across Product, Policy, and Engineering teams to deliver solutions that uphold the high-quality experience users expect from Apple and maintain a trustworthy advertising ecosystem.
  3. You'll have the opportunity to push the state-of-the-art in applying and fine-tuning Large Language Models (LLMs) to solve complex ad relevance and policy challenges at massive scale.
  4. You should have experience developing systems for content understanding, such as ad relevance and policy enforcement within a large-scale production environment.
  5. You have a proven ability to lead investigations into complex data streams, draw clear conclusions, and drive engineering actions that directly impact platform quality.

Skills

Required

  • applying and leading teams that apply advanced statistical/ML methods
  • work with large, complex data sets
  • investigations into multiple streams of ads quality data
  • draw conclusions, and recommend actions
  • Algorithms
  • Architecture
  • Artificial Intelligence
  • Database Systems
  • Data Mining
  • Distributed Systems
  • Machine Learning
  • Networking
  • Statistics
  • Game Theory
  • Auction Design
  • rigorous Quantitative Analysis
  • Systems Software implementation
  • mathematics behind modern machine learning
  • linear algebra
  • statistics
  • developing and leading teams who develop in Python or Java
  • databases
  • SQL
  • scripting languages
  • take requirements from design through to implementation
  • working closely with operational teams on deployment, monitoring, and management concerns
  • actively manage the performance of the team reporting to you
  • take responsibility to drive its outcome
  • MS in AI/ML, Computer Science, Mathematics, or a related field, or equivalent practical experience

Nice to have

  • 10+ years applying and leading teams that apply advanced statistical/ML methods and work with large, complex data sets
  • PhD in AI/ML, Computer Science, Mathematics, or a related field

What the JD emphasized

  • advanced statistical/ML methods
  • large, complex data sets
  • rigorous Quantitative Analysis
  • mathematics behind modern machine learning
  • Python or Java
  • large-scale experiments
  • ad relevance and policy enforcement
  • Large Language Models (LLMs)

Other signals

  • leading development and application of advanced techniques and algorithms to ensure the quality and integrity of our ad network
  • oversee the strategy and development of the machine learning models that define, measure, and enforce the quality of our ads
  • pioneering the use of Large Language Models to ensure ads are relevant, safe, and trustworthy
  • applying and fine-tuning Large Language Models (LLMs) to solve complex ad relevance and policy challenges at massive scale
  • developing systems for content understanding, such as ad relevance and policy enforcement within a large-scale production environment