Software Development Engineer Test, Alexa Global Quality

Amazon Amazon · Big Tech · Bellevue, WA · Software Development

Software Development Engineer in Test focused on quality assurance automation and framework creation for Alexa's global, multilingual, and multimodal experiences. The role involves building agentic automation tooling for end-to-end quality evaluation, including synthetic test generation, LLM-as-a-Judge, and visual/cultural validation using ML.

What you'd actually do

  1. This role will lead the quality assurance automation and framework creation/enhancement efforts responsible for the end-to-end quality of Alexa's multi-locale experience. We are looking for a proven, hands-on, results-oriented quality assurance software engineer to drive the strategy, tool selection, quality bar, and best practices for the future experience of our international customers.
  2. Establishing a consistent, scalable testing framework that supports multi-locale validation and complements the development processes across all supported locales
  3. Working closely with engineers to architect and develop the best technical design and testing approach for internationalization (i18n)
  4. Building and evolving agentic tooling for end-to-end quality evaluation — from synthetic test case generation, to multimodal response validation, to automated cultural and linguistic correctness assessment
  5. Creating metrics and reports on quality status, technical operations, and system performance across all locales, driving towards agreed-upon quality bars that are consistent yet culturally appropriate per market

Skills

Required

  • test automation frameworks and tools building
  • software development testing
  • programming with modern languages (Java, C++, C#)
  • object-oriented design
  • penetration testing
  • exploitability-focused vulnerability assessment
  • platform-level security mitigations and hardening for Linux and Windows

Nice to have

  • overall system architecture
  • scalability
  • reliability
  • performance in a database environment

What the JD emphasized

  • agentic automation tooling
  • LLM-as-a-Judge evaluation
  • multimodal experiences
  • quality assurance automation
  • framework creation/enhancement

Other signals

  • AI-powered automation
  • LLM-as-a-Judge evaluation
  • agentic automation tooling
  • multimodal experiences