Infrastructure for deploying trained models in production: request batching, autoscaling, KV-cache management, and low-latency inference at scale. Primary AI lifecycle stage: serving infrastructure.
4,890 active AI roles across 249 companies in our index reference Model serving as of today.
The companies with the most active Model serving listings are: Amazon (625 roles), NVIDIA (356 roles), Google (323 roles), Capital One (161 roles), JPMorgan Chase (156 roles).
Model serving primarily belongs to the serving infrastructure stage of the AI lifecycle. In current hiring, Model serving roles concentrate at: agents (40%), serving infrastructure (35%).
The sectors with the most active Model serving hiring are: Big Tech, Enterprise, Semiconductors.
Infrastructure for deploying trained models in production: request batching, autoscaling, KV-cache management, and low-latency inference at scale.
Primary AI lifecycle stage: serving infrastructure.
As of today, 4,890 active AI roles across 249 companies in our index reference Model serving. Hiring concentrates at the agents (40%) and serving infrastructure (35%) stages. Most common sectors: Big Tech, Enterprise, Semiconductors.
227 AI roles tagged model_serving.
| Company | Title | Sector | AI score | Other tags |
|---|---|---|---|---|
| Target | Principal AI Engineer - Advanced AI (Machine Learning, Python, Deep Learning) | Retail | 9 | Agent orchestration · LLM observability · Evals · Inference infra |
| Target | Lead Engineer - GenAI | Retail | 9 | Agent orchestration · Agent research · Tool use · LLM observability · RAG · Fine-tuning · Inference infra · Synthetic data |
| Walmart | Senior Data Scientist: Associate AI Experience | Retail | 9 | Agent orchestration · Tool use · Evals · RAG · Vector DB · Fine-tuning · LLM observability |
| Walmart | Principal Data Scientist: Associate AI experience | Retail | 9 | Agent orchestration · Tool use · Evals · RAG · Vector DB · Fine-tuning · Multi-agent |
| Walmart | Distinguished Data Scientist: Associate AI Experience | Retail | 9 | Agent orchestration · Tool use · Evals · RAG · Vector DB · Fine-tuning · Multi-agent |
| Walmart | Principal, Data Scientist | Retail | 9 | Agent orchestration · Inference infra · RAG · Vector DB · LLM observability · Evals · Guardrails |
| Walmart | (USA) Distinguished, Data Scientist | Retail | 9 | Agent orchestration · Agent research · Tool use · Evals · RAG · Vector DB · Fine-tuning · Multimodal |
| Walmart | Distinguished, Software Engineer -AI/ML Engineer- Walmart Connect | Retail | 9 | Agent orchestration · Tool use · Multimodal · RAG · Vector DB · Fine-tuning · Inference infra · RL post-training · Agent research · LLM observability · Guardrails |
| Walmart | Staff, Data Scientist – Conversational AI | Retail | 9 | Agent orchestration · Tool use · Evals · Guardrails · RAG · Fine-tuning · LLM observability |
| Walmart | Principal, Data Scientist -- Agentic AI | Retail | 9 | Agent orchestration · Tool use · LLM observability · RAG · Fine-tuning · Agent research · Multimodal · Vision · Code gen |
| Walmart | Principal, Data Scientist | Retail | 9 | Agent orchestration · Tool use · RAG · Vector DB · Evals · Inference infra |
| Target | Lead AI Engineer -- Advanced AI (applied ML, LLMs, agentic AI, ML Ops) | Retail | 8 | Agent orchestration · LLM observability · RAG · Fine-tuning · Agent research |
| Target | Lead Engineer- Advanced AI | Retail | 8 | Agent orchestration · Tool use · RAG · Evals · LLM observability · Inference infra |
| Target | Sr Engineering Manager - Advanced AI (Applied ML, LLMs, Deep Learning) | Retail | 8 | Agent orchestration · LLM observability |
| Target | Senior Engineering Manager- Advanced AI | Retail | 8 | Agent orchestration · LLM observability |
| Target | Sr. Data Scientist | Retail | 8 | Search & ranking · Recommender systems · RAG · Agent orchestration · Tool use · Guardrails · Fine-tuning · Inference infra |
| Walmart | (USA) Senior, Software Engineer - MLE- Agentic AI & AIOps | Retail | 8 | Agent orchestration · RAG · LLM observability · Inference infra |
| Walmart | (USA) Senior, Data Scientist - Applied AI | Retail | 8 | Agent orchestration · Evals · Inference infra |
| Walmart | (USA) Principal, Data Scientist - Applied AI | Retail | 8 | Agent orchestration · Evals |
| Walmart | Principal, Data Scientist | Retail | 8 | Agent orchestration · RAG · Vector DB · LLM observability |
| Walmart | Senior, Data Scientist (Machine Learning Engineer) | Retail | 8 | Inference infra · Multimodal · RAG · Fine-tuning · Vector DB |
| Target | Sr Applied Data Scientist - Search and Browse (Applied ML, NLP, LLMs) | Retail | 8 | Recommender systems · Search & ranking · Vector DB · RAG · Inference infra |
| Target | Principal Applied Data Scientist - Search and Browse (NLP, Vector Search, LLMs) | Retail | 8 | LLM observability · RAG · Vector DB · Agent orchestration · Search & ranking · Recommender systems |
| Walmart | (IND) SENIOR, DATA SCIENTIST | Retail | 8 | Vision · Multimodal · Fine-tuning |
| Walmart | Distinguished, Data Scientist | Retail | 8 | Fine-tuning · Guardrails · RAG · Vector DB |
| Walmart | Staff, Data Scientist | Retail | 8 | Agent orchestration · Agent research · Synthetic data · Evals · Guardrails |
| Walmart | Principal, Data Scientist - Personalization | Retail | 8 | Recommender systems · Search & ranking |
| Walmart | Senior, Software Engineer - AI Systems | Retail | 8 | Agent orchestration · Tool use · Evals · Guardrails · RAG · Vector DB · Inference infra |
| Walmart | Software Engineer III– AI Systems | Retail | 8 | Agent orchestration · Tool use · Evals · Guardrails · RAG · Vector DB · Inference infra |
| Walmart | Staff, Data Scientist | Retail | 8 |