Distinguished, Software Engineer

Walmart Walmart · Retail · Bentonville, AR

Distinguished Engineer role focused on shaping the technical vision, architecture, and engineering excellence of enterprise-scale AI/ML systems and platforms, including GenAI integrations, model serving, and intelligent pipelines. The role involves hands-on technical guidance, influencing AI/ML lifecycle practices, and leading prototyping and production strategies. Preferred qualifications include experience with LLM tool-calling or agentic systems.

What you'd actually do

  1. Define and drive the technical vision for AI/ML platforms and ecosystems that operate at enterprise scale.
  2. Lead architecture reviews and design principles across GenAI integrations, model serving, and intelligent pipelines.
  3. Provide hands-on technical guidance and thought leadership to multi-team engineering and data science groups.
  4. Influence AI/ML lifecycle practices, including model evaluation, deployment, monitoring, and observability.
  5. Elevate engineering excellence by mentoring senior ICs, principal engineers, and emerging technical talent.

Skills

Required

  • AI/ML production systems
  • model serving
  • orchestration
  • performance optimization
  • observability practices
  • cloud-native design
  • platform engineering
  • technical leadership
  • system architecture
  • distributed software systems

Nice to have

  • LLM tool-calling
  • agentic systems
  • schema/contract frameworks
  • responsible AI practices
  • GenAI
  • prompt engineering
  • large-scale inference infrastructure
  • mentorship

What the JD emphasized

  • 12+ years of experience building and operating large-scale, distributed software systems.
  • Deep experience with AI/ML production systems, model serving, orchestration, and performance optimization.
  • Experience with observability practices, including structured logging, metrics, traces, and debugging distributed flows across client and gateway environments.
  • Strong expertise in scalable, cloud-native design and platform engineering.
  • Experience with LLM tool-calling or agentic systems (e.g., structured tool invocation, schema validation, prompt/tool design, guardrails).

Other signals

  • architecting for scale
  • enterprise-scale AI/ML systems
  • model serving
  • intelligent pipelines
  • LLM tool-calling or agentic systems