AI Tutor, Rufus, Amazon Rufus

Amazon Amazon · Big Tech · Seattle, WA · Editorial, Writing, & Content Management

This role involves training and improving Amazon's generative AI-powered shopping assistant, Rufus, by conducting high-judgment evaluations and labeling data across various modalities (text, image, video, audio). The goal is to enhance the model's fluency, provide better product research, comparisons, and recommendations to customers.

What you'd actually do

  1. Deliver high-quality labelled data, using guidelines provided to meet our KPIs and using in-house tools and software, as part of Amazon's commitment to developing and deploying AI responsibly.
  2. Demonstrate proficiency in generating high-quality human insight data across a range of modalities, inclusive of text, image, video, and audio.
  3. Make sound judgments and logical decisions when faced with ambiguous or incomplete information while performing tasks.
  4. Pivot from one category of requirement to another instantaneously, maintaining a keen eye for detail and a high bar for quality.
  5. Analyze root causes, identify error patterns, and propose solutions to enhance the quality of labeling tasks and their outputs.

Skills

Required

  • natural language data labeling
  • data annotation
  • linguistic annotation
  • data markup
  • strong attention to safety
  • ability to follow detailed procedures
  • developing and evaluating data annotation and data quality metrics
  • annotation strategies

Nice to have

  • technical writer
  • editor
  • content strategist
  • leading cross-functional teams
  • managing workload during times of stress
  • working with cross-functional teams

What the JD emphasized

  • high-judgment evaluations
  • labeling data
  • high-quality labelled data
  • human insight data
  • sound judgments
  • ambiguous or incomplete information
  • keen eye for detail
  • high bar for quality
  • error patterns
  • labeling tasks

Other signals

  • training data
  • evaluations
  • labeling