(senior) Software Engineer, Experimentation Platform - Coreai

Microsoft Microsoft · Big Tech · Redmond, WA +2 · Software Engineering

The role is for a Software Engineer on the Experimentation Platform team within CoreAI at Microsoft. This platform enables high-scale online experimentation for AI systems and product features, helping teams ship better AI experiences faster. The engineer will design, implement, and maintain reliable, scalable services and features for this platform, contributing to its operational excellence and supporting AI innovation across Microsoft.

What you'd actually do

  1. Design, implement, and maintain clean, reliable, testable code using best practices and responsible AI-assisted development while escalating blockers early.
  2. Use AI tools responsibly across the SDLC, reviewing and validating AI-generated changes to ensure correctness and maintainability.
  3. Work with partner engineering teams, PMs, and experts (privacy, security, SRE) to understand requirements, apply customer feedback/telemetry, and deliver scalable, reliable, user-centric features.
  4. Build extensible, maintainable services and features with strong diagnosability, reliability, and production-readiness.
  5. Participate in on-call rotations, troubleshoot live-site issues using least-privileged access, and improve TSGs, telemetry, and fixes that reduce future incidents.

Skills

Required

  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements

Nice to have

  • Master's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
  • Experience working with cloud platforms (Azure, AWS, GCP), building and maintaining distributed systems including deployment, monitoring and troubleshooting of production workloads.
  • Experience using observability tools (logging, metrics, tracing) to diagnose service issues and improve system reliability.
  • Experience with experimentation platforms, A/B testing at scale, and statistical methodologies for measuring product impact and driving data-informed ship decisions.
  • Familiarity with AI-assisted development workflows or responsible use of AI coding tools.

What the JD emphasized

  • responsible AI-assisted development
  • Use AI tools responsibly
  • responsible use of AI coding tools