Senior Software Engineering

Microsoft Microsoft · Big Tech · Mountain View, CA +2 · Software Engineering

The AI Frameworks team at Microsoft develops software for training and deploying advanced AI models, collaborating with hardware teams and partners on supercomputers and AI accelerators. This role involves developing and evaluating core algorithmic and hardware technologies for large-scale AI model training and inference, working closely with ML researchers and developers, and with OpenAI on Azure OpenAI service models. The position requires hands-on software design and development skills in languages like Python, C/C++, and CUDA, focusing on LLM optimization technologies, model scripting, and kernel languages.

What you'd actually do

  1. Develop technologies and build software tools to support validation, exploration, and productionization of LLM optimization technologies.
  2. Perform software development in model scripting and/or kernel languages, such as Python, C/C++, CUDA.
  3. Identify requirements, scope solutions, estimate work, schedule deliverables.

Skills

Required

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.

Nice to have

  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Experience in training or serving Deep Neural Network models.
  • Experience with Language Models and ML system optimization.

What the JD emphasized

  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Other signals

  • AI Frameworks team
  • train and deploy the world’s most advanced AI models
  • Maia AI accelerators
  • optimize and scale out model training and inference
  • OpenAI on the models hosted on the Azure OpenAI service
  • large scale inferencing and training of the most advanced AI models on novel AI hardware