Software Engineer - Ruby AI

Rubrik Rubrik · Enterprise · Palo Alto, CA · Engineering

Software Engineer to build AI agents for Rubrik's AI-powered assistant, Ruby, which helps enterprise customers manage and protect data through natural language. The role involves designing and building agents, integrating tools, handling evaluation, and ensuring production observability, shipping to thousands of customers.

What you'd actually do

  1. Build AI agents that resolve real customer problems (vSphere troubleshooting, cluster diagnostics, log analysis), reducing resolution time from hours to minutes.
  2. Design tool integrations that let agents safely query data, retrieve logs, and perform operations while honoring RBAC and security boundaries.
  3. Build retrieval pipelines and multi-model orchestration to deliver reliable, cost-effective agent responses across LLM providers.
  4. Develop evaluation frameworks that measure agent quality and catch regressions before changes reach production.
  5. Instrument agents with observability tooling and turn monitoring data into continuous quality improvements.

Skills

Required

  • BS in Computer Science or equivalent field of study
  • 3+ years of professional software engineering experience
  • Strong proficiency in Python with experience building production services
  • Experience in at least one additional programming language (such as Go, Java, or C++)
  • Experience building AI-powered applications or working with AI/ML technologies
  • Experience building and consuming APIs (GraphQL, gRPC, or REST) with solid engineering fundamentals in design, testing, and debugging
  • Clear written and verbal communication skills, comfortable navigating ambiguity in a cross-team environment

Nice to have

  • Experience with agent frameworks (LangChain, LlamaIndex, or similar) or RAG and vector search pipelines
  • Experience with cloud platforms and containerized deployments (Docker, Kubernetes)
  • Familiarity with frontend technologies (React, TypeScript) for contributing to user-facing components

What the JD emphasized

  • ships to thousands of enterprise customers
  • production observability
  • evaluation frameworks
  • agent lifecycle

Other signals

  • AI-powered assistant
  • multi-agent architecture
  • ships to thousands of enterprise customers
  • production observability
  • agent lifecycle