Director, Quality Engineering

Redfin Redfin · Seattle · MI · Remote

Redfin is seeking a Director of Quality Engineering to establish and lead the quality engineering practice at Rocket Loans, a fintech company. This player-coach role involves building the quality strategy, culture, and tooling from the ground up, managing a team, and staying hands-on with test automation across UI, API, and integration layers. A key focus will be on designing evaluation frameworks for AI-powered features and agentic workflows, ensuring prompt reliability, and championing autonomous testing approaches. The role requires experience in testing financial or regulated products and building QA practices in early-stage environments.

What you'd actually do

  1. Build Rocket Loans' quality practice from the ground up — strategy, tooling, culture, and execution
  2. Lead structured manual testing efforts for complex, high-stakes flows (loan applications, decisioning, servicing)
  3. Architect and maintain a scalable automation suite across UI, API, and integration layers
  4. Design evaluation frameworks for AI-powered features and agentic workflows — including LLM output quality, tool-use correctness, and multi-step reasoning validation
  5. Collaborate with data engineering to establish quality standards for data pipelines, reporting accuracy, and audit readiness

Skills

Required

  • 7+ years in quality engineering
  • 3+ years in a leadership or staff-level role managing
  • writing test plans
  • reviewing automation code
  • running exploratory tests
  • test automation
  • Jest
  • Playwright
  • Cypress
  • TypeScript
  • NestJS
  • API and service-level integration testing patterns
  • MSW
  • Supertest
  • NestJS Testing module
  • testing financial, compliance-sensitive, or regulated products
  • fintech, lending, or financial services
  • building a QA practice from early-stage or greenfield state
  • FCRA, TILA, or other consumer lending compliance standards
  • platform migration or modernization programs
  • load testing (k6 or equivalent)

Nice to have

  • NX monorepo tooling
  • LLM evaluation tooling (Braintrust, Coval, or custom eval harnesses)
  • test observability tooling (ReportPortal, Datadog)

What the JD emphasized

  • establishing the quality practice
  • build it
  • player-coach role
  • architecting our testing practice
  • building a QA practice from early-stage or greenfield state
  • testing financial, compliance-sensitive, or regulated products

Other signals

  • establishing the quality practice
  • architecting our testing practice
  • design evaluation frameworks for AI-powered features and agentic workflows
  • partner with engineering on prompt reliability, edge case coverage, and production monitoring for AI features
  • champion autonomous test generation, intelligent regression analysis, and self-healing test approaches