Senior Software Engineer

Microsoft Microsoft · Big Tech · Bengaluru, KA, IN · Software Engineering

Senior Software Engineer on the AI Foundry team within Microsoft's AI Platform organization. This role focuses on building and operating the engineering system for Large Language Models and GenAI Services, specifically scaling the inferencing cloud for Azure OpenAI and expanding GenAI model offerings. The engineer will design, implement, and support scalable, reliable, high-performance services for Azure Machine Learning and Azure OpenAI.

What you'd actually do

  1. Design, implement, and support scalable, reliable, high-performance services.
  2. Write clean and concise code with unit tests.
  3. Design, implement, and support new features as well as extend existing systems.
  4. Investigate live site issues and implement and deploy fixes.
  5. Participate in an on-call rotation.

Skills

Required

  • production code in building internet-scale services
  • distributed systems
  • debugging
  • reading code
  • large and increasing codebase
  • machine learning systems
  • data pipelines
  • mentoring other developers
  • working with partners
  • team player
  • collaboration with diverse remote teams
  • presentation skills
  • large-scale distributed systems design and implementation

Nice to have

  • Azure

What the JD emphasized

  • 10+ years of experience writing production code in building internet-scale services and distributed systems.
  • Experience with large-scale distributed systems design and implementation

Other signals

  • building and scaling inferencing cloud
  • large scale engineering system for LLMs and GenAI
  • Model as A Service
  • expand Gen AI Model Offerings