Are you a proven engineering leader who thrives at the intersection of people development, technical strategy, and operational excellence? We are looking for a Senior Manager, Software Development to lead multiple engineering teams building AWS Mantle—the next-generation distributed inference engine that powers Amazon Bedrock. In this role, you will own a multi-year technical and organizational strategy, build and develop high-performing engineering teams, and drive the delivery of globally distributed AI infrastructure that serves millions of customers. You will operate independently in a space where the business opportunity and technology strategy are still being defined, shaping both as you go.
- Own the organizational strategy and multi-year technical roadmap for multiple engineering teams building Mantle's inference platform
- Build, hire, mentor, and develop engineering leaders and senior engineers—creating a sustainable culture of innovation and engineering excellence
- Drive delivery of complex, cross-organizational programs that span distributed systems, ML infrastructure, and security
- Define and execute on staffing, resourcing, and team structure decisions that align engineering capacity with business priorities
- Serve as a visible leader across Amazon Bedrock, partnering with Directors, Principal Engineers, and product leaders to shape the future of AI inference at AWS
Key job responsibilities As a Senior Manager, Software Development on the Mantle team, you will lead multiple two-pizza teams delivering mission-critical AI infrastructure at global scale. You will set the engineering culture, drive operational rigor, and balance short-term delivery with long-term strategic investments—all while growing the next generation of engineering leaders on your team.
- Lead and manage multiple software development teams (including managing other managers) responsible for core Mantle subsystems such as capacity management, model onboarding, inference routing, and Zero Operator Access security
- Define the long-term resource and staffing plan for your organization, making hiring, team structure, and succession planning decisions that support sustainable growth
- Set and balance goals across your teams to optimize for customer outcomes, engineering quality, and employee development
- Drive operational excellence across your portfolio—establishing mechanisms for monitoring, alarming, incident response, and continuous improvement at organizational scale
- Partner with Principal Engineers, Applied Scientists, and cross-functional stakeholders to align technical architecture decisions with business strategy and product roadmaps
About the team The AWS Mantle team is building the next-generation inference engine that powers Amazon Bedrock—providing secure, enterprise-grade access to high-performing foundation models from the world's leading AI companies. Our mission is to simplify and accelerate how models are served at global scale, with an unwavering commitment to customer trust through innovations like our Zero Operator Access architecture, designed so that no person—whether from AWS, a customer, or a model provider—can ever access customer inference data.
- We operate at massive scale, serving inference requests across all major AWS regions with sophisticated automated capacity management and unified resource pools
- Our team values builders who thrive in ambiguity, think long-term, and are excited to define the future of AI infrastructure from the ground up
- We foster a collaborative, inclusive environment where diverse perspectives drive better solutions—and where the best ideas win regardless of where they originate
- We ship fast and iterate with purpose, having rapidly expanded from launch to supporting models from OpenAI, DeepSeek, Google, Mistral, NVIDIA, and more
- We believe work should be meaningful and fun—you'll join a team that takes pride in making history at the forefront of generative AI
Basic Qualifications
- 10+ years of engineering experience
- 5+ years of engineering team management experience
- 10+ years of planning, designing, developing and delivering consumer software experience
- Experience partnering with product or program management teams
- Experience delivering results for large, cross-functional initiatives/projects
- Experience hiring, developing and promoting engineering talent
- Experience in written and verbal communication skills to communicate with technical and non-technical audiences, including senior leadership
Preferred Qualifications
- Experience partnering with product and program management teams
- Master's degree in computer science, computer engineering, or related field, or PhD
- Experience with training and deploying machine learning systems to solve large-scale optimizations, or experience operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
- Experience with design, implementation, support, and evaluation of security-focused tools and services
- Experience in influencing senior leadership through data driven insights
- Experience as a manager of managers, leading multiple engineering teams simultaneously
- Deep familiarity with distributed systems design, GPU/accelerator infrastructure, or high-performance computing environments
- Strong business and technical vision with a track record of creating and executing against long-term technology roadmaps
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, WA, Seattle - 220,100.00 - 297,700.00 USD annually