Principal Product Manager, Foundational AI Research

Microsoft Microsoft · Big Tech · Mountain View, CA +2 · Product Management

The Principal Product Manager, Foundational AI Research role at Microsoft AI focuses on advancing the next generation of LLM models. Responsibilities include working on pre-training/post-training data and evaluations, training infrastructure, or API/Platform. The role involves prioritizing research based on customer needs, building evaluations and datasets, and collaborating with AI researchers to execute project plans. Experience in building data collection or evaluation pipelines for AI models and collaborating with ML researchers/engineers is required.

What you'd actually do

  1. Identify and prioritize language / coding / multimodal issues and work with researchers to find a path to resolution.
  2. Create novel data collection tasks for taskers to evaluate models and to collect training data for fine-tuning.
  3. Create model prototypes to prove out new feature directions and scope projects.
  4. Collaborate closely with teams on infrastructure, data engineering, pre-training, post-training, and product feedback
  5. Foster a culture of collaboration, continuous improvement, and growth.
  6. Advance the AI frontier responsibly

Skills

Required

  • Product Management
  • ML/AI Model Research Collaboration
  • Data Pipelines
  • Evaluation Systems
  • Customer Needs Analysis
  • Project Planning
  • Prioritization

Nice to have

  • Technical postgraduate degree
  • PhD
  • Enterprise or developer product go-to-market experience

What the JD emphasized

  • pushing the boundaries of scale, performance, and product deployment
  • train the world’s most capable AI frontier models
  • developing many of today’s most influential LLM models
  • MAI-1 models, including MAI-1-image debuting in top 10 in LMarena
  • advancing the next generation of LLM models
  • pre-training and post-training data and evaluations
  • training infrastructure
  • API and Platform
  • working backward from customer needs to prioritize new research
  • build evals and datasets
  • work closely with AI researchers to build and execute project plans
  • built data collection or evaluation pipelines for pre-training or post-training AI models
  • experience in working side-by-side with ML researchers or ML infrastructure teams to build large scale ML / AI models
  • Take the initiative and enjoys finding paths through complexity in a fast-paced environment, innovative environment
  • Are passionate about managing high stakes time-sensitive large-scale goals, and drive to relentlessly unblock progress
  • Demonstrate a proactive attitude and enthusiasm for exploring new methods and are familiar with research and technical advancement in their area
  • worked backwards from customer needs to deliver robust, scalable solutions that empower developers and enterprise customers.
  • Identify and prioritize language / coding / multimodal issues and work with researchers to find a path to resolution.
  • Create novel data collection tasks for taskers to evaluate models and to collect training data for fine-tuning.
  • Create model prototypes to prove out new feature directions and scope projects.
  • Collaborate closely with teams on infrastructure, data engineering, pre-training, post-training, and product feedback
  • Advance the AI frontier responsibly
  • Bachelor's Degree AND 8+ years experience in product/service/program management or software development OR equivalent experience.
  • 2+ years direct, hands-on collaboration with model researchers and ML engineers in areas such as training runs, data evaluation, infrastructure, coding, or safety.
  • Experience building and shipping data pipelines or evaluation systems personally.

Other signals

  • train the world’s most capable AI frontier models
  • developing many of today’s most influential LLM models
  • MAI-1 models, including MAI-1-image debuting in top 10 in LMarena
  • advancing the next generation of LLM models
  • pre-training and post-training data and evaluations
  • training infrastructure
  • API and Platform
  • working backward from customer needs to prioritize new research
  • build evals and datasets
  • work closely with AI researchers to build and execute project plans