Senior Applied Scientist - Copilot & Agents

Microsoft Microsoft · Big Tech · London, United Kingdom +1 · Applied Sciences

Senior Applied Scientist role focused on developing and scaling LLM-based agentic capabilities for Microsoft 365 Copilot. The role involves driving the development of reasoning systems, orchestration platforms, and evaluating/improving model performance for millions of enterprise users. It requires translating research into production and influencing product strategy.

What you'd actually do

  1. Develop scientific approaches for evaluating and improving LLM reasoning, grounding, retrieval and agentic behaviors using offline benchmarking, online experimentation and large-scale telemetry analysis.
  2. Drive complex technical investigations, model evaluations and experimentation to improve quality, reliability, latency, cost efficiency and user experience.
  3. Define and execute rigorous evaluation methodologies, offline benchmarks, online experimentation frameworks and data-driven approaches for measuring model and product performance.
  4. Partner closely with engineering and product teams to translate research innovations into scalable, production-ready systems used by millions of customers.
  5. Deeply analyze model behavior, failure modes, grounding effectiveness, reasoning quality, tool use, retrieval performance and orchestration outcomes to identify opportunities for improvement.

Skills

Required

  • Bachelor's Degree in Statistics, Econometrics, Computer Science, Electrical or Computer Engineering, or related field AND demonstrated professional related experience
  • Ability to meet Microsoft, customer and/or government security screening requirements

Nice to have

  • Ph.D. in Computer Science, Math, Physics, Statistics, or related areas
  • master’s degree with industry experience or publication record in the areas of Information Retrieval, Machine Learning, Natural Language Processing
  • Demonstrated professional working as an IC in Machine Learning, Large Language Models, Natural Language Processing, Information Retrieval, Recommendation Systems or related fields.
  • Professional experience developing ML models for scaled production services, with a proven track record of successfully shipping applied research to production
  • Experience designing and implementing agentic AI models and systems

What the JD emphasized

  • proven track record of delivering innovative, user-facing AI experiences at scale
  • drive the development of advanced LLM-based capabilities, reasoning systems, and real-time orchestration platforms
  • translate state-of-the-art research into impactful experiences for millions of enterprise users
  • directly influence product strategy, model quality, and the next generation of intelligent productivity solutions
  • rigorous evaluation methodologies
  • scalable, production-ready systems
  • Deeply analyze model behavior
  • agentic AI models and systems

Other signals

  • delivering innovative, user-facing AI experiences at scale
  • drive the development of advanced LLM-based capabilities, reasoning systems, and real-time orchestration platforms
  • translate state-of-the-art research into impactful experiences for millions of enterprise users
  • directly influence product strategy, model quality, and the next generation of intelligent productivity solutions