Senior Software Engineer

Microsoft Microsoft · Big Tech · Redmond, WA +1 · Software Engineering

The role is for a Senior Software Engineer on the Evaluation Platform Team at Microsoft, focusing on building and improving systems that measure and evaluate AI quality for M365 AI products. The goal is to create reliable, scalable, and user-friendly tools to support various stages of AI evaluation, from fine-tuning to launching new features and onboarding partners.

What you'd actually do

  1. Collaborate with appropriate stakeholders to determine user requirements for a scenario.
  2. Drive identification of dependencies and the development of design documents for a product, application, service, or platform.
  3. Create, implement, optimize, debug, refactor, and reuse code to establish and improve performance and maintainability, effectiveness, and return on investment (ROI).
  4. Leverage subject-matter expertise of product features and partners with appropriate stakeholders (e.g., project managers) to drive a workgroup's project plans, release plans, and work items.
  5. Act as a Designated Responsible Individual (DRI) and guides other engineers by developing and following the playbook, working on call to monitor system/product/service for degradation, downtime, or interruptions, alerting stakeholders about status and initiates actions to restore system/product/service for simple and complex problems when appropriate.

Skills

Required

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • Ability to meet Microsoft, customer and/or government security screening requirements
  • Microsoft Cloud Background Check

Nice to have

  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • Experience building systems to evaluate and drive quality in a product and using data to drive engineering decisions.
  • A passion for building reliable, scalable infrastructure and making your users successful.
  • Comfortable at operating in a dynamic environment; takes initiative to bring clarity and momentum.
  • Self-motivated and outcomes-focused, with a strong sense of ownership and accountability.
  • Platform engineering mindset: building reusable components, reducing time‑to‑launch, improving debuggability, and delivering well‑documented tooling.

What the JD emphasized

  • evaluation system
  • evaluation platform
  • eval system
  • user journeys of an eval system
  • reduce the time to launch
  • improving debuggability
  • observability

Other signals

  • evaluation platform
  • AI products
  • user journeys of an eval system
  • reusable components
  • reduce the time to launch
  • improving debuggability