Software Engineer, Insights

Sierra Sierra · AI Frontier · San Francisco, CA · Engineering

Software Engineer, Insights role at Sierra focused on building systems for analyzing agent performance, enabling A/B testing, creating an AI-powered conversational data explorer, and developing agent monitoring systems. This role is key to improving customer experiences with AI.

What you'd actually do

  1. Build a system for analyzing and visualizing millions of data points about agent performance.
  2. Enable agent developers to run A/B test their agents to make data-driven decisions about agent behavior.
  3. Build Explorer, the equivalent of ChatGPT + AI-powered clustering over conversational data.
  4. Build systems for proactively monitoring agents for defects or new patterns.

Skills

Required

  • production products and systems
  • full-stack solutions

Nice to have

  • AI-powered products
  • Go
  • Typescript
  • developer tooling
  • programming languages
  • databases
  • Leadership experience

What the JD emphasized

  • 4+ years hands-on experience building production products and systems.
  • Experience and comfort to build and ship full-stack solutions.

Other signals

  • Build a system for analyzing and visualizing millions of data points about agent performance.
  • Enable agent developers to run A/B test their agents to make data-driven decisions about agent behavior.
  • Build Explorer, the equivalent of ChatGPT + AI-powered clustering over conversational data.
  • Build systems for proactively monitoring agents for defects or new patterns.