WHY WE’RE LOOKING FOR YOU
As Retool’s AI surface area grows, quality becomes the product. In this role, you’ll lead the team responsible for defining, measuring, and continuously improving quality across Retool’s Assist experience and related platform capabilities. Your mission is to build the systems, tools, and culture that help teams answer a deceptively hard question: “Is this actually good and how do we make it better?”
This work sits at the intersection of AI, product, and platform engineering. While some of the problems involve LLMs and AI evaluation, success in this role is less about prior specialization in AI research and more about strong instincts for building scalable quality systems—the kind that make correctness, relevance, and reliability measurable and repeatable as products evolve.
Prior experience with LLMs or AI evaluation tools is helpful, but not required. We’re excited about leaders who bring strong quality instincts and are eager to apply them to an emerging problem space. The systems you build will shape how our customers trust AI-powered software. You’ll influence not just what we ship, but how we ship: faster, more confidently, and with quality baked in from the start.
You’ll lead engineers working on:
- Evaluation & experimentation platforms that let teams compare performance across models, configurations, and releases
- Quality systems that define rubrics, metrics, and feedback loops for both AI and non-AI experiences
- Data curation & feedback pipelines grounded in real-world usage
- Search, retrieval, and relevance quality, ensuring results are accurate, fast, and trustworthy
- Reusable infrastructure that other teams can leverage to ship higher-quality features with confidence
- A culture of continuous improvement, where measurement, iteration, and learning are the default
IN THIS ROLE, YOU WILL
- Lead and grow a team of engineers, supporting their development through coaching, feedback, and clear expectations
- Partner closely with Product, Design, and other Engineering leaders to define quality goals aligned with business outcomes
- Translate ambiguous problem spaces into clear strategies, roadmaps, and execution plans
- Build scalable, repeatable processes that help teams ship faster without sacrificing quality
- Establish standards and tooling that enable rapid iteration with confidence
- Act as a multiplier across the organization by building platforms other teams rely on
- Partner with Recruiting to build a diverse, high-performing team of motivated engineers
THE SKILLSET YOU’LL BRING
- 3+ years of experience leading and managing engineering teams
- Experience designing or operating systems that measure quality, correctness, or performance at scale
- Strong technical curiosity. You enjoy engaging in architecture, reviewing designs, and getting hands-on when it matters
- A track record of leading teams through change and ambiguity
- The ability to set clear strategy while staying grounded in execution and impact
- A product-minded approach: you care deeply about customers, outcomes, and long-term maintainability
- Thoughtfulness around engineering culture, process, and team health
- Clear, structured communication and strong stakeholder management skills
- A collaborative mindset and comfort partnering across functions