Senior Technical Support Engineer

Microsoft Microsoft · Big Tech · Charlotte, NC +4 · Technical Support Engineering

Senior Technical Support Engineer role focused on owning, designing, and shipping AI and software systems to resolve complex customer technical problems at scale. This involves partnering with applied science and engineering to shape architecture, develop agentic pipelines, design prompts and tooling, implement safety guardrails, and manage the AI development lifecycle. The role also includes building an agent platform, production engineering rails for safe AI deployment, language-model pipelines (training, fine-tuning, evaluation), quality evaluation systems, intelligent case-routing services, and privacy-preserving data tooling.

What you'd actually do

  1. You'll own complex AI initiatives end to end: partnering with applied science and engineering to shape architecture and integrated customer solutions — model selection, retrieval-augmented and agentic pipelines, prompt and tooling design, and safety guardrails.
  2. You'll drive the roadmap, schedules, and staging and release plans against clear objectives; lead governance across the AI development lifecycle (Responsible AI review, model-risk, privacy, and compliance); and validate outcomes against real telemetry.
  3. You'll own the customer supportability experience and act as a trusted technical person who evangelizes and drives the right work.
  4. You'll design and ship scalable AI and software systems, including:
  5. An agent platform - an extensible, Model Context Protocol (MCP)–based system of AI diagnostic skills integrated with enterprise data services, run inside engineers' existing tools (CLI, VS Code, and chat).
  6. Production engineering rails - CI-enforced quality gates, evaluation regression testing, comprehensive data science telemetry, and supply-chain security that let us ship AI safely and at scale. Every system is instrumented to surface performance, adoption, and quality signals in real time.
  7. Language-model pipelines - training, fine-tuning (including RLHF), and automated evaluation of models that reason over and assess support cases.
  8. Quality-evaluation systems - rubric-based, LLM-as-judge evaluation that scores case handling and surfaces coaching and compliance signals.
  9. Intelligent case-routing services - classification and ranking models that route cases to the right team and catch misrouted cases early.
  10. Privacy-preserving data tooling - a redaction pipeline (pattern-matching → transformer models → LLM) that protects PII and secrets across every data flow, forming the trusted substrate the rest of the platform depends on.

Skills

Required

  • Bachelor's Degree in Computer Science, Information Technology (IT), or related field AND 5+ years technical support, technical consulting experience, or information technology experience OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements

Nice to have

  • Bachelor's Degree in Computer Science, Information Technology, or related field AND 12+ years of technical support, technical consulting experience, or information technology experience OR equivalent experience.
  • Microsoft Technology Certifications
  • Industry IT-Based Certifications (e.g. Comp-TIA, CCNA, ISC2)
  • 3+ years of experience developing and shipping production software services using TypeScript/Node.js, Python, or C#/.NET.
  • Experience building AI-powered applications using large language models (LLMs), AI agents, MCP tools, prompt engineering, or machine learning techniques.
  • Experience designing solutions that leverage Azure cloud services, large-scale datasets, Azure Data Explorer (Kusto), and retrieval technologies such as keyword, vector, or semantic search.
  • Experience evaluating AI systems through model evaluation frameworks, labeled datasets, RLHF, preference-based training, or LLM-as-a-judge methodologies.
  • Experience implementing software quality and security practices, including automated testing, code reviews, CI/CD pipelines, code scanning, dependency management, and branch governance.
  • Experience developing privacy, compliance, or data protection solutions, including PII detection and data redacti

What the JD emphasized

  • own, design, and ship the AI and software systems
  • complex customer technical problems at fleet scale
  • applied AI
  • production engineering
  • own complex AI initiatives end to end
  • shape architecture
  • retrieval-augmented and agentic pipelines
  • prompt and tooling design
  • safety guardrails
  • drive the roadmap, schedules, and staging and release plans
  • lead governance across the AI development lifecycle
  • Responsible AI review
  • model-risk
  • privacy
  • compliance
  • validate outcomes against real telemetry
  • design and ship scalable AI and software systems
  • agent platform
  • production engineering rails
  • CI-enforced quality gates
  • evaluation regression testing
  • comprehensive data science telemetry
  • supply-chain security
  • ship AI safely and at scale
  • language-model pipelines
  • training, fine-tuning (including RLHF)
  • automated evaluation of models
  • quality-evaluation systems
  • LLM-as-judge evaluation
  • intelligent case-routing services
  • classification and ranking models
  • privacy-preserving data tooling
  • redaction pipeline
  • protect PII and secrets

Other signals

  • shipping AI systems
  • agent platform
  • production engineering rails
  • language-model pipelines
  • quality-evaluation systems
  • intelligent case-routing services
  • privacy-preserving data tooling