Staff, Software Engineer - Genai

Walmart · Retail · Sunnyvale, CA

Staff Software Engineer to integrate GenAI and LLMs into production e-commerce systems, focusing on shipping AI-infused features at scale, building internal AI tooling, and defining technical strategy for GenAI-powered experiences.

What you'd actually do

  1. Define and drive technical strategy for GenAI-powered experiences—architect scalable frontend/backend solutions that integrate LLMs intelligently, ensuring rock-solid code quality, performance, security, and observability.
  2. Lead development of AI-infused features—craft React UIs with intelligent components, manage state in dynamic AI contexts (Redux + React Query), and build efficient GraphQL APIs as the backbone for LLM-powered services.
  3. Ship and optimize GenAI/LLM features at massive scale—design APIs and service architectures that seamlessly blend AI/ML components, manage token costs, latency, and safety, and deliver measurable delight to millions.
  4. Refactor and evolve codebases—making them modular, maintainable, and primed for the next wave of AI innovation.
  5. Collaborate cross-functionally—with product, design, UX, backend, and AI research teams—to craft cohesive, magical customer experiences.

Skills

Required

  • 10+ years of software engineering experience building and shipping large-scale, production systems.
  • Proven track record shipping distributed systems in Java (or equivalent high-scale languages).
  • Hands-on experience shipping GenAI or LLM-powered features/services as part of larger production systems.
  • Strong experience designing APIs and service architectures that integrate with AI/ML components.
  • Deep expertise in modern JavaScript ecosystems (React, Node.js, GraphQL) and performance optimization, testing, CI/CD.
  • Demonstrated ability to influence technical direction without direct authority—through expertise, collaboration, and vision.

Nice to have

  • Expertise with GenAI tools/patterns (e.g., RAG, agents, prompt orchestration, evaluation pipelines).
  • Experience operationalizing LLM evaluation frameworks—including offline benchmarks, automated + human review loops, production monitoring for quality, safety, and business impact (nice to have, but highly valued).
  • Familiarity with cloud platforms (AWS/GCP/Azure), containerization (Docker/Kubernetes), and microfrontends/monorepos (Nx).
  • Track record in Agile environments with excellent communication skills.

What the JD emphasized

  • expertly integrating GenAI and LLMs into production e-commerce systems
  • shipping features that redefine global shopping
  • GenAI
  • AI-powered UX
  • LLMs, agents, RAG, and evaluation frameworks
  • A/B testing AI variants
  • safety/quality guardrails
  • GenAI era
  • AI-driven shopping
  • GenAI-powered experiences
  • LLMs
  • AI/ML components
  • AI innovation
  • AI research teams
  • evaluation frameworks
  • GenAI techniques
  • global e-commerce
  • GenAI or LLM-powered features/services
  • AI/ML components
  • GenAI tools/patterns
  • RAG, agents, prompt orchestration, evaluation pipelines
  • LLM evaluation frameworks
  • quality, safety, and business impact

Other signals

  • Integrate GenAI/LLMs into production e-commerce systems
  • Ship AI-infused features at massive scale
  • Build internal AI best practices and tooling