Software Engineer, AI Product (canada)

Vanta Vanta · Enterprise · Canada · Remote · Software Engineering

Software Engineer, AI Product role at Vanta, focusing on integrating LLMs into existing products and systems to deliver customer value. The role involves designing, implementing, and scaling AI-powered features, instrumenting evaluations and guardrails, and collaborating with AI Platform engineers. Requires experience shipping LLM-backed products, RAG, agent frameworks, and full-stack development. Emphasis on pragmatic tradeoffs, user experience, and a sustainable technical foundation.

What you'd actually do

  1. Work cross-functionally to design and implement AI-powered features to deliver customer value and integrate LLMs with Vanta’s existing products and systems.
  2. Instrument evaluations, guardrails, and monitoring, and review customer usage to continually improve quality
  3. Collaborate with AI Platform engineers shaping foundational AI systems and tooling that accelerate product teams
  4. Make pragmatic tradeoffs that consider business priorities, user experience, and a sustainable technical foundation
  5. Mentor engineers, champion good technical and product instincts, and model a collaborative, high-ownership engineering culture

Skills

Required

  • Software engineering
  • LLM-backed products
  • prompting
  • RAG
  • agent frameworks
  • designing, building, and scaling full-stack applications
  • backend systems
  • APIs
  • frontend interfaces
  • improving AI systems
  • creating eval sets
  • driving quality hill-climbing
  • mentoring other engineers
  • collaborating with product and design
  • bias for action
  • action-driven
  • engage directly with users
  • product hat

Nice to have

  • TypeScript
  • React
  • Node.js
  • worked at rapidly scaling startups and large companies

What the JD emphasized

  • At least 7 years of industry experience as a software engineer
  • You’ve shipped LLM-backed products
  • You have experience designing, building, and scaling full-stack applications
  • You have experience improving AI systems, creating eval sets, and driving quality hill-climbing

Other signals

  • integrating AI into the Vanta product
  • leverage AI to accelerate their journey towards compliance
  • design and implement AI-powered features
  • integrate LLMs with Vanta’s existing products and systems
  • shipped LLM-backed products