Principal, Software Engineer - Genai

Walmart · Retail · Sunnyvale, CA

Principal Software Engineer to lead the integration of GenAI and LLMs into production e-commerce systems, focusing on customer-facing features and influencing architecture across teams. The role involves shipping AI-infused features, optimizing GenAI/LLM services at scale, and building internal AI best practices.

What you'd actually do

  1. Define and drive technical strategy for GenAI-powered experiences—architect scalable frontend/backend solutions that integrate LLMs intelligently, with rock-solid code quality, performance, security, and observability.
  2. Lead development of AI-infused features—craft React UIs with intelligent components, manage state in dynamic AI contexts (Redux + React Query), and build efficient GraphQL APIs that serve as the nervous system for LLM-powered services.
  3. Ship and optimize GenAI/LLM features at massive scale—design APIs and service architectures that seamlessly integrate AI/ML components, handle token costs/latency/safety, and deliver measurable delight to millions.
  4. Refactor and evolve codebases—make them modular, maintainable, and ready for the next wave of AI innovation.
  5. Collaborate cross-functionally—with product, design, UX, backend, and AI research teams—to create cohesive, magical customer experiences.

Skills

Required

  • 12+ years of software engineering experience building and shipping large-scale, production systems
  • Proven track record shipping distributed systems in Java (or equivalent high-scale languages)
  • Hands-on experience shipping GenAI or LLM-powered features/services as part of larger production systems
  • Strong experience designing APIs and service architectures that integrate with AI/ML components
  • Deep expertise in modern JavaScript ecosystems (React, Node.js, GraphQL) and performance optimization, testing, CI/CD
  • Demonstrated ability to influence technical direction without direct authority—through expertise, collaboration, and vision

Nice to have

  • Expertise with GenAI tools/patterns (e.g., RAG, agents, prompt orchestration, evaluation frameworks)
  • Experience operationalizing LLM evaluation frameworks—including offline benchmarks, automated + human review loops, production monitoring for quality, safety, and business impact
  • Familiarity with cloud platforms (AWS/GCP/Azure), containerization (Docker/Kubernetes), and micro-frontends/mono-repos (Nx)
  • Track record in Agile environments with excellent communication skills

What the JD emphasized

  • shipping GenAI or LLM-powered features/services
  • designing APIs and service architectures that integrate with AI/ML components
  • shipping GenAI/LLM features at massive scale

Other signals

  • shipping GenAI/LLM features at massive scale
  • integrating LLMs into production e-commerce systems
  • designing APIs and service architectures that integrate with AI/ML components