Applied Scientist, Alexa Connections

Amazon Amazon · Big Tech · IN, KA, Bengaluru · Applied Science

Applied Scientist role focused on building and evaluating LLMs and multimodal systems for Alexa Connections, involving fine-tuning, post-training, and contributing to research and production delivery.

What you'd actually do

  1. Analyze, understand, and model customer behavior and the customer experience based on large-scale data.
  2. Build novel online & offline evaluation metrics and methodologies for multimodal personal digital assistants.
  3. Fine-tune/post-train LLMs using techniques like SFT, DPO, RLHF, and RLAIF.
  4. Set up experimentation frameworks for agile model analysis and A/B testing.
  5. Collaborate with partner teams on LLM evaluation frameworks and post-training methodologies.

Skills

Required

  • building models for business application
  • PhD or Master's degree
  • CS, CE, ML or related field experience
  • patents or publications at top-tier peer-reviewed conferences or journals
  • programming in Java, C++, Python or related language
  • algorithms and data structures
  • parsing
  • numerical optimization
  • data mining
  • parallel and distributed computing
  • high-performance computing

Nice to have

  • professional software development
  • PhD in computer science, computer engineering, or related field
  • building speech recognition, machine translation and natural language processing systems
  • building machine learning models for business application experience

What the JD emphasized

  • novel algorithms
  • modeling techniques
  • LLM evaluation & tooling
  • multimodal systems
  • LLMs
  • deep learning
  • generative models
  • text, voice, and vision domains
  • SFT, DPO, RLHF, and RLAIF

Other signals

  • LLMs
  • multimodal systems
  • deep learning
  • generative models