Principal Machine Learning Scientist - Agentic Experiences

Expedia Expedia · Hospitality · Seattle, WA +1

Expedia Group is seeking a Principal Machine Learning Scientist to design, build, and evaluate multi-step agentic AI systems. This role involves developing agent orchestration frameworks, integrating LLMs with external tools, and defining evaluation frameworks for agentic systems. The position requires strong Python and ML framework proficiency, experience with LLM APIs and orchestration libraries, and a solid understanding of prompt engineering techniques. The ideal candidate will have demonstrated experience deploying agentic systems in production or research settings and will collaborate with product and engineering teams to deliver production-grade solutions.

What you'd actually do

  1. Design, build, and evaluate multi-step agentic AI systems, including autonomous agents capable of planning, tool use, memory management, and multi-agent collaboration
  2. Research and implement state-of-the-art techniques in agentic architectures, such as ReAct, reflection loops, chain-of-thought prompting, and tool-augmented reasoning
  3. Develop and maintain agent orchestration frameworks, defining how agents decompose tasks, delegate to sub-agents, and handle failure and recovery
  4. Integrate large language models (LLMs) with external tools, APIs, databases, and code execution environments to enable real-world task completion
  5. Define and own evaluation frameworks for agentic systems, measuring task success, reliability, latency, cost, and safety across diverse benchmarks and production scenarios

Skills

Required

  • Python
  • ML frameworks (PyTorch, TensorFlow, or JAX)
  • LLM APIs
  • orchestration libraries (e.g., LangChain, LlamaIndex, or similar)
  • integrating LLMs with external tools, APIs, and structured data sources
  • prompt engineering techniques (chain-of-thought, few-shot prompting, structured output generation)
  • defining and running evaluation frameworks for ML systems
  • taking models from prototype to production

Nice to have

  • Advanced degree (PhD or MS) in Computer Science, Machine Learning, Statistics, Engineering
  • Experience in the travel or e-commerce industry
  • Publications in top-tier ML conferences or journals
  • Patented Inventions, pending and issued
  • Contributions to open-source ML projects

What the JD emphasized

  • agentic AI systems
  • multi-step agentic AI systems
  • agent orchestration frameworks
  • evaluation frameworks for agentic systems
  • agentic systems
  • agentic design patterns

Other signals

  • designing and deploying agentic or multi-step AI systems
  • agent orchestration frameworks
  • integrating LLMs with external tools
  • evaluation frameworks for agentic systems