Senior Software Engineer, Agentic AI – Nvidia Blueprints and Nim Integrations

NVIDIA NVIDIA · Semiconductors · Santa Clara, CA +3 · Remote

Senior Software Engineer focused on integrating NVIDIA's NIM microservices and Blueprints into agentic AI frameworks. The role involves building and maintaining agentic workflows, developing test harnesses, and contributing to the open-source agentic AI ecosystem.

What you'd actually do

  1. Design and implement NVIDIA NIM connectors and Blueprint integrations into upstream agentic AI frameworks (e.g., LangGraph, LlamaIndex, AutoGen, CrewAI, Claude Agent SDK, OpenAI Agents SDK)
  2. Build and maintain agentic workflows — including tool use, memory, planning, and multi-agent coordination patterns — powered by NVIDIA inference services
  3. Develop test harnesses and evaluation pipelines to validate agent behavior, tool-call correctness, and end-to-end workflow quality
  4. Evangelize NVIDIA agentic AI capabilities through demos, documentation, and upstream community contributions
  5. Partner with NVIDIA NIM and release teams to ensure Day-0 agentic support for new models and inference APIs

Skills

Required

  • Bachelor's or Master's degree in Computer Science or a related field, or equivalent experience
  • 8+ years of experience in software design, development, and testing
  • Hands-on experience building with LLM-based agent frameworks and patterns (tool use, RAG, multi-agent orchestration, structured outputs)
  • Familiarity with inference APIs and serving frameworks (OpenAI-compatible APIs, NIM, vLLM, TensorRT-LLM)
  • Experience in open-source development — contributing to and maintaining upstream projects
  • Strong understanding of AI application developer workflows and the modern agentic AI stack
  • Strong verbal and written communication skills
  • Action-driven with strong analytical and debugging skills
  • Ability to adapt quickly in a fast-moving, research-driven environment
  • Enthusiasm for working across multiple diverse projects and communities

Nice to have

  • Demonstrated contributions to agentic AI frameworks or LLM orchestration libraries
  • Experience designing and evaluating multi-agent systems, including reliability, latency, and correctness at scale
  • Deep familiarity with the open-source inference and agentic ecosystem (LangChain, LlamaIndex, AutoGen, Haystack, etc.)
  • Published work, blog posts, or conference talks on agentic AI or LLM systems

What the JD emphasized

  • 8+ years of experience in software design, development, and testing
  • Hands-on experience building with LLM-based agent frameworks and patterns (tool use, RAG, multi-agent orchestration, structured outputs)
  • Familiarity with inference APIs and serving frameworks (OpenAI-compatible APIs, NIM, vLLM, TensorRT-LLM)
  • Experience in open-source development — contributing to and maintaining upstream projects
  • Strong understanding of AI application developer workflows and the modern agentic AI stack
  • Demonstrated contributions to agentic AI frameworks or LLM orchestration libraries
  • Experience designing and evaluating multi-agent systems, including reliability, latency, and correctness at scale
  • Deep familiarity with the open-source inference and agentic ecosystem (LangChain, LlamaIndex, AutoGen, Haystack, etc.)

Other signals

  • integrations of NVIDIA NIM microservices and Blueprints into leading agentic AI frameworks
  • enable Day-0 NVIDIA model and inference support in agent orchestration platforms and tooling
  • Build and maintain agentic workflows — including tool use, memory, planning, and multi-agent coordination patterns