Staff, Software Engineer

Walmart · Retail · Bentonville, AR

Staff Software Engineer role focused on leading the design, architecture, and productionization of large-scale machine learning and generative AI systems, including LLM-driven platforms, RAG, agent-based architectures, and multimodal models. The role involves defining and implementing advanced NLP solutions, driving the development of multi-agent systems, establishing best practices for model development and deployment, and championing responsible AI practices. Requires extensive experience building and scaling ML systems in production, strong engineering background, and hands-on experience with LLM ecosystems.

What you'd actually do

  1. Lead the design and evolution of large scale machine learning and generative AI systems, setting technical direction across multiple teams and initiatives.
  2. Architect and productionize LLM driven platforms and services, ensuring scalability, reliability, and maintainability in high impact environments.
  3. Define and implement advanced NLP and generative AI solutions, including RAG systems, agent based architectures, and multimodal models.
  4. Drive the development of multi agent systems capable of orchestrating complex, goal directed workflows from natural language inputs.
  5. Establish best practices for model development and deployment, including evaluation frameworks, experimentation standards, and performance optimization techniques (e.g., fine tuning, LoRA, quantization).

Skills

Required

  • Extensive experience building and scaling machine learning systems in production
  • Strong focus on NLP and/or Gen AI applications
  • Proven ability to lead complex, cross functional initiatives
  • Drive technical strategy in ambiguous problem spaces
  • Deep expertise in modern ML and deep learning approaches
  • Large language models and their adaptation techniques
  • Strong engineering background
  • Designing distributed systems, APIs, and data/ML pipelines at scale
  • Hands on experience with LLM ecosystems and tooling (e.g., LangChain, LlamaIndex, DSPy, or similar)
  • Familiarity with agent based or orchestration frameworks
  • Demonstrated experience deploying AI solutions in high stakes environments requiring careful consideration of risk, compliance, and trust
  • Track record of mentoring senior talent
  • Influencing engineering practices beyond immediate team boundaries
  • Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 4 years’ experience in software engineering or related area OR 6 years’ experience in software engineering or related area

Nice to have

  • experience at leading technology companies or AI focused startups
  • equivalent impact in building cutting edge ML systems

What the JD emphasized

  • productionize LLM driven platforms and services
  • agent based architectures
  • multi agent systems
  • fine tuning
  • LoRA
  • quantization
  • deploying AI solutions in high stakes environments

Other signals

  • Lead the design and evolution of large scale machine learning and generative AI systems
  • Architect and productionize LLM driven platforms and services
  • Define and implement advanced NLP and generative AI solutions
  • Drive the development of multi agent systems