Applied Scientist Ii, Core Search

Amazon Amazon · Big Tech · Seattle, WA · Applied Science

Applied Scientist II role at Amazon Search focused on improving search experiences using LLMs and ML techniques. Responsibilities include analyzing data, designing/building/deploying ML/LLM solutions, evaluating solutions via offline and online tests, and publishing research. Key areas involve fine-tuning LLMs for real-time suggestions, personalization, evaluation frameworks, and guardrails for LLM content.

What you'd actually do

  1. Analyze the data and metrics resulting from traffic into Amazon's product search service.
  2. Design, build, and deploy effective and innovative ML and LLM solutions to improve search experiences.
  3. Evaluate the proposed solutions via offline benchmark tests as well as online A/B tests in production.
  4. Publish and present your work at internal and external scientific venues in the fields of ML/NLP/IR.

Skills

Required

  • PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience
  • Experience programming in Java, C++, Python or related language
  • Experience in any of the following areas: algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high-performance computing

Nice to have

  • Experience using Unix/Linux
  • Experience in professional software development
  • Experience in state-of-the-art deep learning models architecture design and deep learning training and optimization and model pruning
  • Experience building machine learning models or developing algorithms for business application

What the JD emphasized

  • strict latency constraints
  • evaluation frameworks for model selection
  • designing data-driven guardrails for LLM-generated content

Other signals

  • LLM fine-tuning for real-time suggestion generation
  • personalizing recommended content
  • building evaluation frameworks for model selection
  • designing data-driven guardrails for LLM-generated content