Applied Scientist Ii, Alexa Sensitive Content Intelligence (asci)

Amazon Amazon · Big Tech · Bellevue, WA · Applied Science

This role focuses on building AI safety systems for conversational AI, specifically for Alexa. It involves pioneering solutions in Responsible AI, training models for safety standards, designing automated testing for vulnerabilities, creating intelligent evaluation systems, building models to understand human values, and crafting feedback mechanisms. A key aspect is building AI agents for real-time detection and fixing of production issues. The role emphasizes frontier research with real-world impact, focusing on training truthful and grounded models, building reward models for human values, and creating automated systems to discover and address issues. Collaboration with scientists, PMs, and engineers is expected to transform ideas into production systems. The role also involves leading certification processes, advancing optimization techniques, building human-like evaluation systems, and mentoring others.

What you'd actually do

  1. architect breakthrough Responsible AI solutions that become industry benchmarks
  2. pioneering algorithms that eliminate false information
  3. designing frameworks that hunt down vulnerabilities before bad actors find them
  4. developing models that understand human values across every culture we serve
  5. transforming bold research into production systems that protect millions of customers daily

Skills

Required

  • Deep expertise in state-of-the-art NLP and Large Language Models
  • Track record of building scalable ML systems
  • Experience in patents or publications at top-tier peer-reviewed conferences or journals
  • Experience programming in Java, C++, Python or related language
  • 3+ years of building models for business application experience
  • PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience

Nice to have

  • Experience building machine learning models or developing algorithms for business application
  • Experience in investigating, designing, prototyping, and delivering new and innovative system solutions

What the JD emphasized

  • building models for business application
  • patents or publications at top-tier peer-reviewed conferences or journals
  • building machine learning models or developing algorithms for business application

Other signals

  • AI safety systems
  • Responsible AI
  • LLMs
  • evaluation systems
  • training models