Senior Applied AI Engineer

Microsoft Microsoft · Big Tech · Mountain View, CA +2 · Software Engineering

Senior Applied AI Engineer for the Customer Service Applications Team, focusing on developing and integrating AI technologies, including foundation models, prompt engineering, RAG, graphs, and multi-agent architectures, into Microsoft products. The role involves fine-tuning models, evaluating their behavior, building prototypes, contributing to production deployment, and translating research into scalable, impactful solutions. Emphasis on responsible AI practices and leveraging AI for real-world customer service outcomes.

What you'd actually do

  1. Research and implement state-of-the-art using foundation models, prompt engineering, RAG, graphs, multi-agent architectures, as well as classical machine learning techniques.
  2. Fine-tune foundation models using domain-specific datasets.
  3. Evaluate model behavior on relevance, bias, hallucination, and response quality via offline evaluations, shadow experiments, online experiments, and ROI analysis.
  4. Build rapid AI solution prototypes, contribute to production deployment of these solutions, debug production code, support MLOps/AIOps.
  5. Translate research into production-ready solutions and measure their impact through A/B testing and telemetry that address customer needs.

Skills

Required

  • Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • 1+ years of experience with generative AI OR LLM/ML algorithms
  • Python
  • Generative AI
  • LLM/ML algorithms

Nice to have

  • foundation models
  • prompt engineering
  • RAG
  • graphs
  • multi-agent architectures
  • classical machine learning techniques
  • fine-tuning
  • model evaluation
  • MLOps/AIOps
  • A/B testing
  • telemetry
  • deep learning
  • NLP
  • multi-modal models
  • small and large language models architecture
  • optimization techniques
  • data preparation and analysis for machine learning
  • machine learning model and algorithm development
  • large-scale computing frameworks
  • model monitoring
  • responsible AI practices
  • fairness and bias in AI
  • XPIA (Cross-Prompt Injection Attack)

What the JD emphasized

  • proven programming expertise (e.g., in Python or leveraging AI-first IDEs and SWE agents), with a strong record of building reliable, well-documented research code that drives rapid experimentation, scalable evaluation, and efficient deployment from prototype to production in applied AI research
  • Deep understanding of small and large language models architecture, Deep learning, fine tuning techniques, multi-agent architectures, classical ML, and optimization techniques to adapt out-of-the-box solutions to particular business problems

Other signals

  • applying AI to customer service applications
  • developing and integrating AI technologies into products
  • building AI agents and multi-agent architectures
  • fine-tuning foundation models
  • evaluating model behavior (relevance, bias, hallucination, quality)
  • prototyping and deploying AI solutions
  • translating research into production-ready solutions