(senior) Software Engineer, Experimentation Platform - Coreai

Microsoft Microsoft · Big Tech · Redmond, WA +4 · Software Engineering

This role is for a Software Engineer on the Experimentation Platform team within Microsoft's CoreAI division. The platform enables high-scale online experimentation to accelerate product learning and drive progress across Microsoft's AI ecosystem. The engineer will build and maintain services that allow teams to evaluate, refine, and safely deploy AI innovations. While the role uses AI tools and supports AI product development, the core craft is building the experimentation infrastructure, not directly shipping AI models or agents.

What you'd actually do

  1. Design, implement, and maintain clean, reliable, testable code using best practices and responsible AI-assisted development while escalating blockers early.
  2. Use AI tools responsibly across the SDLC, reviewing and validating AI-generated changes to ensure correctness and maintainability.
  3. Work with partner engineering teams, PMs, and experts (privacy, security, SRE) to understand requirements, apply customer feedback/telemetry, and deliver scalable, reliable, user-centric features.
  4. Build extensible, maintainable services and features with strong diagnosability, reliability, and production-readiness.
  5. Participate in on-call rotations, troubleshoot live-site issues using least-privileged access, and improve TSGs, telemetry, and fixes that reduce future incidents.

Skills

Required

  • Bachelor's Degree in Computer Science or related technical field
  • 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • Ability to meet Microsoft, customer and/or government security screening requirements

Nice to have

  • Master's Degree in Computer Science or related technical field AND 3+ years technical engineering experience
  • Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience
  • Experience working with cloud platforms (Azure, AWS, GCP), building and maintaining distributed systems including deployment, monitoring and troubleshooting of production workloads.
  • Experience using observability tools (logging, metrics, tracing) to diagnose service issues and improve system reliability.
  • Experience with experimentation platforms, A/B testing at scale, and statistical methodologies for measuring product impact and driving data-informed ship decisions.
  • Familiarity with AI-assisted development workflows or responsible use of AI coding tools.

What the JD emphasized

  • responsible AI-assisted development
  • Use AI tools responsibly
  • responsible use of AI coding tools