Applied Scientist Iii, Alexa International

Amazon Amazon · Big Tech · IN, KA, Bengaluru · Applied Science

This role focuses on advancing the state of the art with LLMs and multimodal systems for Alexa's international products. The scientist will develop novel algorithms, build evaluation metrics, fine-tune/post-train LLMs using advanced techniques (SFT, DPO, RLHF, RLAIF), and contribute to industry-first research. The role involves end-to-end delivery from research to production, influencing cross-team scientific strategy, and mentoring junior scientists. Key areas include multi-lingual applications, text, speech, and vision domains, with a strong emphasis on LLM evaluation and post-training methodologies.

What you'd actually do

  1. Develop novel algorithms and modeling techniques to advance the state of the art with LLMs, particularly delivering industry-leading scientific research and applied AI for multi-lingual applications
  2. Build novel online & offline evaluation metrics and methodologies for multimodal personal digital assistants.
  3. Fine-tune/post-train LLMs using advanced and innovative techniques like SFT, DPO, Reinforcement Learning (RLHF and RLAIF) for supporting model performance specific to a customer’s location and language.
  4. Contribute through industry-first research to drive innovation forward.
  5. Lead end-to-end delivery of scientifically complex solutions from research to production, including reusable science components and services that resolve architecture deficiencies across teams.

Skills

Required

  • PhD, or Master's degree and 10+ years of applied research experience
  • 5+ years of building machine learning models for business application experience
  • Experience with neural deep learning methods and machine learning
  • Experience in building speech recognition, machine translation and natural language processing systems
  • Experience with large scale machine learning systems
  • Deep expertise in state-of-the-art LLM architectures, training, evaluation, and post-training techniques (SFT, DPO, RLHF, RLAIF)

Nice to have

  • Experience in patents or publications at top-tier peer-reviewed conferences or journals
  • Experience in professional software and systems development

What the JD emphasized

  • industry-leading scientific research
  • multi-lingual applications
  • LLM evaluation & tooling
  • LLM evaluation frameworks
  • post-training methodologies
  • state-of-the-art LLM architectures
  • training, evaluation, and post-training techniques

Other signals

  • LLMs
  • multimodal systems
  • deep learning
  • generative models
  • large-scale computing
  • international products
  • customer behavior modeling
  • LLM evaluation & tooling
  • agile model and data analysis
  • A/B testing
  • industry-first research
  • scientific thought leader
  • mentoring junior scientists
  • publications