Principal Research Scientist

Microsoft Microsoft · Big Tech · Bengaluru, KA, IN · Research Sciences

This role focuses on applied research for M365, aiming to improve the efficiency of Generative AI systems at enterprise scale. The Principal Research Scientist will conduct research on cross-stack optimizations for LLMs, focusing on models, AI frameworks, cloud infrastructure, and hardware. The goal is to achieve significant efficiency gains and enable broader access to generative AI experiences. The role involves end-to-end research, publication, and collaboration with product groups for real-world impact.

What you'd actually do

  1. Conduct novel research to advance the state-of-the-art of efficiency optimizations across AI stacks: models, AI frameworks, cloud infrastructure, and hardware.
  2. Work with a small group of fellow researchers and product engineering teams to execute on practical innovation for real-world impact.
  3. Drive the end-to-end research agenda from establishing the problem definition to building algorithms and models, and act as a mentor for more team members.
  4. Publish and contribute to top scientific conferences and journals.

Skills

Required

  • Doctorate in relevant field OR Master's Degree with 4+ years experience OR Bachelor's Degree with 10+ years experience
  • PhD in Computer Science, Statistics, Engineering, Mathematics, Physics, or related field AND 5+ years related research experience
  • Research experience and publications in top conferences/journals (NeurIPS, ICML, ICLR, AISTATS, ACL, EMNLP, NAACL, ISCA, MICRO, ASPLOS, HPCA, SOSP, OSDI, NSDI, etc.)
  • Natural language processing
  • Statistics
  • Machine learning
  • Optimization
  • Large Language Models (LLMs)
  • Serving infrastructure
  • Generative AI systems
  • AI frameworks

Nice to have

  • model architectures
  • systems research
  • hardware optimization

What the JD emphasized

  • Doctorate in relevant field AND 3+ years related research experience
  • PhD in Computer Science, Statistics, Engineering, Mathematics, Physics, or related field AND 5+ years related research experience
  • Research experience and publications in top conferences/journals (NeurIPS, ICML, ICLR, AISTATS, ACL, EMNLP, NAACL, ISCA, MICRO, ASPLOS, HPCA, SOSP, OSDI, NSDI, etc.) in at least one of the following areas: natural language processing, statistics, machine learning, and optimization.
  • Solid knowledge of state-of-the-art Large Language Models (LLMs), serving infrastructure, and their application in complex systems.
  • Hands on experience in improving the design and efficiency of generative AI systems and related frameworks.

Other signals

  • driving applied research and innovation efforts
  • advancing efficiency across AI systems
  • cross-layer optimization
  • delivering significant efficiency gains for Large Language Model / Generative AI experiences
  • intersection of LLMs and systems research
  • apply this research in a meaningful real-world setting