Overview
**Business Group Overview **
Do you want to build the systems that deliver generative AI to the world at massive scale? Our team builds and operates the cloud services that run large-scale AI model inference for customers across the globe, processing enormous volumes of requests reliably and efficiently. You will work where distributed systems, capacity, and performance meet, solving problems that only exist at hyperscale.
**Job Purpose Overview **
As a Software Engineer on our team, you will design and deliver backend services that process high-volume, asynchronous AI workloads and intelligently direct traffic to the right compute at the right time. This role gives you deep, hands-on exposure to distributed systems, large-scale scheduling, capacity and throughput optimization, and service reliability, with room to grow into adjacent parts of the platform. You'll learn to build and operate services that stay fast, efficient, and dependable under intense scale, working alongside a talented and supportive team in a flexible hybrid environment (up to 50% work from home).
Microsoft's mission is to empower every person and every organization on the planet to achieve more, and we're dedicated to this mission across every aspect of our company. Our culture is centered on embracing a growth mindset and encouraging teams and leaders to bring their best each day. Join us and help shape the future of the world.
Responsibilities
**Responsibilities **
Design, build, and operate scalable, reliable backend services that process high-volume, asynchronous AI inference workloads.
Develop intelligent scheduling and request-routing capabilities that make efficient, load-aware use of available compute capacity.
Improve throughput, latency, and cost efficiency of large-scale workloads through profiling, tuning, and thoughtful system design.
Instrument services with strong telemetry, monitoring, and alerting, and participate in on-call rotations to ensure high availability.
Partner with product and platform teams to onboard new models and capabilities and to support growing enterprise adoption.
Write clean, testable, maintainable code and contribute actively to design discussions and code reviews.
Continuously identify and drive improvements in reliability, scalability, and engineering quality.
Qualifications
**Required Qualifications **
Bachelor's degree in Computer Science or a related technical field AND 3+ years of technical engineering experience, OR equivalent experience.
2+ years of experience designing and building backend or distributed services in a modern programming language such as C#, Java, Go, or C++.
1+ years of experience building and operating services on a public cloud platform such as Azure, AWS, or GCP.
**Preferred Qualifications **
1+ years of experience with large-scale distributed systems, high-throughput data processing, or asynchronous/batch workloads.
Experience with scheduling, queueing, load balancing, or request-routing systems.
Experience with observability tooling and operating production services in an on-call model.
Familiarity with containerized services and orchestration (e.g., Docker and Kubernetes)
Other Requirements:Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about **requesting accommodations.**