Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics. Primary AI lifecycle stage: evaluation and application.
3,121 active AI roles across 225 companies in our index reference LLM observability as of today.
The companies with the most active LLM observability listings are: Amazon (304 roles), JPMorgan Chase (175 roles), Google (151 roles), Capital One (120 roles), Apple (92 roles).
LLM observability primarily belongs to the evaluation and application stages of the AI lifecycle. In current hiring, LLM observability roles concentrate at: agents (70%), serving infrastructure (9%).
The sectors with the most active LLM observability hiring are: Enterprise, Big Tech, Banking.
Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics.
Primary AI lifecycle stage: evaluation and application.
As of today, 3,121 active AI roles across 225 companies in our index reference LLM observability. Hiring concentrates at the agents (70%) and serving infrastructure (9%) stages. Most common sectors: Enterprise, Big Tech, Banking.
156 AI roles tagged llm_observability.
| Company | Title | Sector | AI score | Other tags |
|---|---|---|---|---|
| Target | Lead Data Scientist- Comp Intel | Retail | 9 | Agent orchestration · Tool use · RAG · Vector DB · Fine-tuning · Guardrails · Agent research |
| Target | Principal AI Engineer - Advanced AI (Machine Learning, Python, Deep Learning) | Retail | 9 | Agent orchestration · Evals · Model serving · Inference infra |
| Target | Lead Engineer - GenAI | Retail | 9 | Agent orchestration · Agent research · Tool use · RAG · Fine-tuning · Inference infra · Model serving · Synthetic data |
| Walmart | Senior Data Scientist: Associate AI Experience | Retail | 9 | Agent orchestration · Tool use · Evals · RAG · Vector DB · Fine-tuning · Model serving |
| Walmart | Principal, Data Scientist | Retail | 9 | Agent orchestration · Inference infra · Model serving · RAG · Vector DB · Evals · Guardrails |
| Walmart | (USA) Senior Manager, Data Science | Retail | 9 | Agent orchestration · Tool use · RAG |
| Walmart | Distinguished, Software Engineer -AI/ML Engineer- Walmart Connect | Retail | 9 | Agent orchestration · Tool use · Multimodal · RAG · Vector DB · Fine-tuning · Inference infra · Model serving · RL post-training · Agent research · Guardrails |
| Walmart | Staff, Data Scientist – Conversational AI | Retail | 9 | Agent orchestration · Tool use · Evals · Guardrails · RAG · Fine-tuning · Model serving |
| Walmart | Principal, Data Scientist -- Agentic AI | Retail | 9 | Agent orchestration · Tool use · RAG · Fine-tuning · Model serving · Agent research · Multimodal · Vision · Code gen |
| Walmart | Distinguished, Software Engineer -AI/ML Engineer – Agentic Systems | Retail | 9 | Agent orchestration · Agent research · Multimodal · RL robotics |
| Target | Lead AI Engineer -- Advanced AI (applied ML, LLMs, agentic AI, ML Ops) | Retail | 8 | Agent orchestration · RAG · Fine-tuning · Model serving · Agent research |
| Target | Lead Engineer- Advanced AI | Retail | 8 | Agent orchestration · Tool use · RAG · Evals · Model serving · Inference infra |
| Target | Sr Engineering Manager - Advanced AI (Applied ML, LLMs, Deep Learning) | Retail | 8 | Agent orchestration · Model serving |
| Target | Senior Engineering Manager- Advanced AI | Retail | 8 | Agent orchestration · Model serving |
| Walmart | (USA) Senior, Software Engineer - MLE- Agentic AI & AIOps | Retail | 8 | Agent orchestration · RAG · Inference infra · Model serving |
| Walmart | Principal, Data Scientist | Retail | 8 | Agent orchestration · RAG · Vector DB · Model serving |
| Walmart | Principal, Data Scientist | Retail | 8 | Agent orchestration · RAG · Vector DB |
| Nordstrom | Principal Engineer: AI Agentic Platform (Hybrid - Seattle, WA) | Retail | 8 | Agent orchestration · Tool use · Multi-agent · RAG · Vector DB |
| Walmart | Senior Director, Data Science & Ontology | Retail | 8 | Semantic search · Recommender systems · RAG · Agent orchestration |
| Target | Principal Applied Data Scientist - Search and Browse (NLP, Vector Search, LLMs) | Retail | 8 | RAG · Vector DB · Agent orchestration · Search & ranking · Recommender systems · Model serving |
| Walmart | (USA) Staff, Data Scientist | Retail | 8 | Agent orchestration · Agent research · Evals · Guardrails · Tool use |
| Target | Sr Director Data Sciences | Retail | 8 | Agent orchestration · Search & ranking · Recommender systems · RAG · Evals · Model serving |
| Walmart | (USA) Senior Manager, Data Science (AI Technical Lead) – Next-Gen Customer Engagement & Returns | Retail | 8 | Agent orchestration · Recommender systems · Evals |
| Walmart | (USA) Principal, Software Engineer | Retail | 8 | Agent orchestration · RAG · Guardrails · Evals · Inference infra · Model serving |
| Walmart | (USA) Distinguished, Software Engineer | Retail | 8 | Model serving · Inference infra · Guardrails · Agent orchestration · Tool use |
| Walmart | (USA) Senior Manager, Data Science | Retail | 8 | Agent orchestration · RAG · Fine-tuning · Agent research |
| Walmart | (USA) Staff, Data Scientist | Retail | 8 | Agent orchestration · RAG · Fine-tuning · Model serving · Inference infra |
| Walmart | Staff, Software Engineer | Retail | 8 | Agent orchestration · Agent research · Multimodal · RAG · Fine-tuning · Model serving |
| Walmart | Director, Data Science | Retail | 8 | Recommender systems · Search & ranking · Agent orchestration · RAG · Vector DB · Guardrails · Model serving |
| Walmart | Staff, Data Scientist - Conversational AI | Retail | 8 | Agent orchestration · Tool use · RAG · Guardrails |