AI Editor, Alexa for Shopping - Content and Marketing Experiences

Amazon Amazon · Big Tech · Seattle, WA · Editorial, Writing, & Content Management

This role focuses on improving the quality and fluency of AI models for Alexa Shopping through human-in-the-loop evaluations and LLM judge audits. The AI Editor will uphold quality, style, and tone guidelines, use customer feedback for model improvement, and collaborate with Product, Science, and Design teams. While the role uses AI tools and evaluates AI models, it does not involve shipping ML models or core AI development.

What you'd actually do

  1. improving the fluency of our AI models through human-in-the-loop evaluations and LLM judge audits
  2. uphold and contribute to quality, style, and tone guidelines
  3. using customer feedback to continually improve Amazon’s ability to be helpful to customers
  4. evaluate CX metrics, develop scalable reporting systems, and ensure continual model improvements

Skills

Required

  • Exceptional written and oral communication skills
  • Excellent judgment
  • Strong project management
  • Deep curiosity about how things work
  • Passion for serving customers
  • Context-switching and partnering at all levels of the organization
  • Bachelor's degree in English, Communications, Linguistics, or a related field
  • 2+ years of technical writer, editor, or content strategist experience
  • Experience with human-in-the-loop AI evaluation, prompt engineering, or AI model quality assessment

Nice to have

  • Experience effectively managing a substantial and time-sensitive workload
  • Experience in content creation or copy editing, including online publishing
  • Experience working cross-functionally across marketing, product management, analytics, UX, and research

What the JD emphasized

  • human-in-the-loop AI evaluation
  • prompt engineering
  • AI model quality assessment