Overview
As Microsoft continues to push the boundaries of AI, we are on the lookout for seasoned engineering leaders to help shape the future of our AI products and organization. Our vision is bold and broad — to build systems that have true artificial intelligence across agents, applications, services, and infrastructure. It's also inclusive: we aim to make AI accessible to all — consumers, businesses, developers — so that everyone can realize its benefits.
Microsoft AI (MAI) is seeking an experienced Senior Engineering Leader to build, scale, and run a high-performing engineering organization responsible for Copilot AI Evaluation. This is a role for a proven people leader who has built and managed multi-team organizations — someone who has hired and developed engineering managers, set organizational strategy, and delivered large-scale technical programs across multiple workstreams. You will own the engineering vision for LLM evaluation at Copilot, partnering directly with senior Eng and Product leadership to define priorities, drive execution, and raise the bar on engineering excellence. We are looking for a leader who combines deep technical judgment with a passion for growing people and building high-trust, high-velocity teams.
Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Starting January 26, 2026, MAI employees are expected to work from a designated Microsoft office at least four days a week if they live within 50 miles (U.S.) or 25 miles (non-U.S., country-specific) of that location. This expectation is subject to local law and may vary by jurisdiction.
Responsibilities
- Build and lead a multi-team engineering organization (30+ engineers across multiple teams), including hiring and developing engineering managers who lead their own teams.
- Set the technical and organizational strategy for Copilot AI Evaluation and response quality, aligning with MAI's broader product and engineering vision.
- Partner with senior Eng and Product leadership (Partner+ level) to define priorities, influence roadmaps, and drive cross-organizational initiatives.
- Own end-to-end delivery of evaluation platforms, novel evaluation techniques, and agentic solutions for measuring and improving Copilot quality at scale.
- Recruit, develop, and retain world-class engineering talent — building a culture of technical excellence, accountability, and continuous learning.
- Drive operational rigor: establish engineering processes, quality bars, and delivery cadences that enable predictable, high-quality execution across multiple concurrent workstreams.
- Navigate ambiguity and make high-judgment tradeoff decisions on technology, staffing, and investment priorities in a fast-moving AI landscape.
- Foster a diverse, inclusive team culture where engineers at all levels can do their best work and grow their careers.
- Embody our Culture and Values.
Qualifications
Required Qualifications
- Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, Javascript, or Python OR equivalent experience
Preferred Qualifications
- Bachelor's Degree in Computer Science or related technical discipline AND 12+ years of technical engineering experience, including 6+ years of engineering management experience with direct reports who are themselves people managers (managing managers).
- Master's Degree or PhD in Computer Science or related technical field AND 15+ years of engineering experience, including 8+ years of people management experience.
- Demonstrated track record of building and scaling engineering organizations (hiring teams from scratch, structuring orgs, growing managers).
- Experience delivering large-scale software systems in AI, machine learning, or related fields.
- Experience managing organizations of 30+ engineers across multiple teams and workstreams.
- Deep expertise in LLM evaluation, AI quality measurement, or ML infrastructure at scale.
- Track record of partnering with senior leadership (VP/CVP level) to set strategy and drive cross-organizational programs.
- Experience recruiting and developing senior engineering talent (principal engineers, engineering managers) in a competitive market.
- Proven ability to operate effectively in fast-paced, ambiguous environments — comfortable making decisions with incomplete information and course-correcting quickly.
- Strong technical judgment: ability to evaluate architectural tradeoffs, assess technical risk, and guide teams toward sound engineering decisions without needing to write the code yourself.
- Experience leading distributed or multi-site engineering teams.
Software Engineering M5 - The typical base pay range for this role across the U.S. is USD $139,900 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
Software Engineering M6 - The typical base pay range for this role across the U.S. is USD $163,000 - $296,400 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $220,800 - $331,200 per year.
Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.
Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about **requesting accommodations.**