Principal Pm Manager

Microsoft Microsoft · Big Tech · Bengaluru, KA, IN · Product Management

This Principal PM Manager role at Microsoft AI focuses on managing a team to design, evaluate, and improve AI systems' interactions with tools, APIs, and users. The role involves prompt engineering, policy design, and safety, ensuring AI workflows are accurate, compliant, and user-friendly. Responsibilities include creating policies, designing/refining prompts, evaluating AI responses, and improving model quality and safety for Microsoft AI Monetization.

What you'd actually do

  1. Create, document, and maintain policies and guidelines governing AI interactions, content handling, and tool workflows.
  2. Document edge cases, decision rationales, and recommendations with clear, concise written communication.
  3. Design, review, and refine prompts and instructions for AI systems interacting with tools, APIs, and external services.
  4. Collaborate with product, engineering, and safety teams to iterate on prompts, policies, and workflows.
  5. Evaluate AI responses for critical reasoning quality, correctness of parameters, and adherence to policies.

Skills

Required

  • Bachelor's Degree AND 8+ years experience in product/service/program management or software development.
  • 1+ year(s) people management experience.
  • 8+ years of experience in AI quality, content review, trust and safety program or operation roles.
  • Proven ability to lead high performing teams with measurable impact.
  • Proven policy interpretation skills: drafting, interpreting, and applying guidelines or policies in an operational setting.
  • Hands-on experience with prompt design, context window management, and model evaluation.
  • Proven ability to translate complex data engineering and analytics concepts into annotation frameworks, quality standards, and training materials.
  • Demonstrated experience with prompt engineering or writing clear, structured instructions for AI or automation systems.
  • Solid attention to detail, particularly in checking parameters, arguments, and compliance with specified schemas or policies.
  • Solid communication skills, with the ability to write clear, concise rationales and explanations; comfort working with multilingual contexts across many locales.
  • Excellent critical reasoning and judgment, especially when evaluating ambiguous or complex cases.

Nice to have

  • Bachelor’s Degree in Computer Science, Philosophy, Linguistics, Psychology, Literature, or related discipline AND 2+ years experience in language or context engineering.

What the JD emphasized

  • 8+ years of experience in AI quality, content review, trust and safety program or operation roles.
  • Proven policy interpretation skills: drafting, interpreting, and applying guidelines or policies in an operational setting.
  • Hands-on experience with prompt design, context window management, and model evaluation.
  • Demonstrated experience with prompt engineering or writing clear, structured instructions for AI or automation systems.
  • Solid attention to detail, particularly in checking parameters, arguments, and compliance with specified schemas or policies.
  • Excellent critical reasoning and judgment, especially when evaluating ambiguous or complex cases.

Other signals

  • managing a team of model specialists
  • design, evaluate, and improve how AI systems interact with tools, APIs, and users
  • prompt engineering, policy design, and safety
  • AI-driven workflows are accurate, compliant, and user-friendly
  • review, refine, and design prompts, evaluation frameworks and guidelines for AI systems
  • evaluate AI responses for critical reasoning quality, correctness of parameters, and adherence to policies
  • improve the models that power quality and safety efforts