Fr Annotations Auditor, Community Feedback Annotation Team

Amazon Amazon · Big Tech · Cape Town, South Africa · Customer Service

This role involves evaluating annotated datasets for natural language processing models, ensuring accuracy and consistency. It focuses on data quality for training generative AI.

What you'd actually do

  1. Review and verify annotations made by fellow annotators for consistency, accuracy, and adherence to guidelines. Provide constructive feedback to maintain annotation quality.
  2. Gain proficiency in understanding and annotating texts across various experiences and organizations, supporting the creation of specialized models.
  3. Ensure accuracy and integrity of annotated data through regular quality checks. Identify and address inconsistencies, maintaining a high standard of data cleanliness.

Skills

Required

  • Experience as a Quality Specialist and/or Quality Analyst
  • Experience with computer skills, including proficiency in MS Office (Word, Excel, PowerPoint)
  • 6 to 9 months in an Annotations role or similar

Nice to have

  • Speak, write, and read fluently in French and English with respect to complex technical instructions and concepts
  • Experience in machine learning, data mining, information retrieval, statistics or natural language processing
  • Prior experience in linguistic annotation, data labeling, or similar roles is a plus.

Other signals

  • evaluate annotated datasets
  • train and improve generative AI models
  • ensure the accuracy and effectiveness of our models