Software Development Engineer Test, Alexa Global Quality

Amazon Amazon · Big Tech · Bellevue, WA · Software Development

The Software Development Engineer Test role on the Alexa Global Quality team focuses on building AI-powered automation tooling for evaluating Alexa's multilingual, conversational, and multimodal experiences across various device surfaces. This involves creating scalable testing frameworks, developing agentic automation for synthetic test generation and LLM-as-a-Judge evaluations, and ensuring cultural and linguistic relevance.

What you'd actually do

  1. This role will lead the quality assurance automation and framework creation/enhancement efforts responsible for the end-to-end quality of Alexa's multi-locale experience.
  2. Establishing a consistent, scalable testing framework that supports multi-locale validation and complements the development processes across all supported locales
  3. Building and evolving agentic tooling for end-to-end quality evaluation — from synthetic test case generation, to multimodal response validation, to automated cultural and linguistic correctness assessment
  4. Creating metrics and reports on quality status, technical operations, and system performance across all locales, driving towards agreed-upon quality bars that are consistent yet culturally appropriate per market
  5. Working effectively with product managers, Country PMs, designers, engineering, locale experts, and business teams to deliver the best overall experience factoring in financial goals, usability goals, and locale-specific customer expectations

Skills

Required

  • 4+ years of non-internship professional software development testing experience
  • 2+ years of test automation frameworks and tools building experience
  • Experience programming with at least one modern language such as Java, C++, or C# including object-oriented design
  • Experience in penetration testing and exploitability-focused vulnerability assessment
  • Experience in platform-level security mitigations and hardening for Linux and Windows

Nice to have

  • Knowledge of overall system architecture, scalability, reliability, and performance in a database environment
  • Experience building test automation frameworks and tools

What the JD emphasized

  • multilingual, conversational CX evaluation across multimodal experiences spanning text, voice, and visual
  • agentic automation tooling
  • AI-powered automation solution
  • multi-locale and linguistic product validation
  • agentic tooling for end-to-end quality evaluation
  • multimodal response validation
  • automated cultural and linguistic correctness assessment

Other signals

  • building agentic automation tooling
  • AI-powered automation solution
  • LLM-as-a-Judge evaluation
  • visual validation using AI
  • cultural relevancy classification powered by machine learning