Software Engineer, Nvidia Openshell

NVIDIA NVIDIA · Semiconductors · CA · Remote

Software Engineer role focused on building a distributed systems platform for autonomous AI agents, including secure sandboxed runtimes, inference routing, and policy enforcement. The role involves full-stack development, network security, and operability.

What you'd actually do

  1. Work across the full stack of a distributed systems platform, from crafting gRPC contracts to building secure sandbox runtimes.
  2. Implement and harden network security features, including policy enforcement, L4/L7 proxies, and secure inter-service communication using mTLS.
  3. Develop core platform components such as inference routing, ensuring model provider adapters, credential management, and protocol translation integrate seamlessly with the sandbox and gateway.
  4. Build reliable configuration and control plane systems that handle state divergence, implement reconciliation loops, and support safe merging and hot-reloading policies.
  5. Own the operability experience by creating effective CLI tools, managing release automation, and instrumenting all systems for observability with structured logging and distributed tracing.

Skills

Required

  • Bachelor's degree in Computer Science, Electrical Engineering, or related field, or equivalent experience
  • 8+ years of meaningful experience
  • Systems programming
  • Distributed systems/control planes
  • Container/Sandbox Internals
  • gRPC and Protobuf
  • Kubernetes
  • mTLS
  • Structured logging, health checks, and distributed tracing

Nice to have

  • Virtualization technologies and alternative runtimes (e.g., microVMs)
  • CLI/TUI development
  • Rust, Python, protobuf codegen, and shell scripting

What the JD emphasized

  • secure sandbox runtimes
  • policy enforcement
  • inference routing
  • distributed systems
  • Container/Sandbox Internals
  • Kubernetes
  • observability

Other signals

  • autonomous AI agents
  • sandbox runtimes
  • inference routing
  • policy enforcement