Software Engineer, Experimentation

Superhuman Superhuman · Consumer · Hub - San Francisco · Engineering, Product, Design, and Marketing

Software Engineer focused on building and evolving experimentation infrastructure to support next-generation AI products and agentic workflows. The role involves collaborating with Data Scientists and Engineers to measure AI-driven experiences, integrating experimentation with AI-driven evaluations, and supporting production systems at scale. The company is an AI productivity platform.

What you'd actually do

  1. Support and evolve experimentation infrastructure to enable next-generation AI products and agentic workflows, enabling teams to measure complex user interactions and run effective experiments at scale.
  2. Collaborate widely with internal teams to help define and measure quality in AI-driven experiences, partnering closely with Data Scientists and Engineers to deliver impactful product improvements.
  3. Contribute to an engineering culture with a strong emphasis on documentation, testing, and user experience, while leveraging state-of-the-art AI tools and techniques to improve development velocity.
  4. Evaluate existing systems and contribute to architectures that integrate experimentation with AI-driven evaluations, scaling infrastructure to support fast, reliable decision-making
  5. Own changes across back-end and light front-end surfaces, enable product teams to successfully run experiments, and share responsibility for on-call supporting experimentation systems.

Skills

Required

  • Software Development
  • back-end engineering
  • algorithms
  • data structures
  • production systems
  • debugging
  • problem-solving
  • documentation
  • testing
  • user experience
  • collaboration
  • communication

Nice to have

  • experimentation
  • internal tooling
  • front-end surfaces
  • AI tools

What the JD emphasized

  • experimentation infrastructure
  • AI products
  • agentic workflows
  • AI-driven experiences
  • AI-driven evaluations
  • production systems at scale
  • 5+ years of experience in Software Development with an emphasis on back-end engineering skills
  • production systems at scale

Other signals

  • experimentation infrastructure
  • AI products
  • agentic workflows
  • AI-driven experiences
  • AI tools