Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics. Primary AI lifecycle stage: evaluation and application.
3,121 active AI roles across 225 companies in our index reference LLM observability as of today.
The companies with the most active LLM observability listings are: Amazon (304 roles), JPMorgan Chase (175 roles), Google (151 roles), Capital One (120 roles), Apple (92 roles).
LLM observability primarily belongs to the evaluation and application stages of the AI lifecycle. In current hiring, LLM observability roles concentrate at: agents (70%), serving infrastructure (9%).
The sectors with the most active LLM observability hiring are: Enterprise, Big Tech, Banking.
Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics.
Primary AI lifecycle stage: evaluation and application.
As of today, 3,121 active AI roles across 225 companies in our index reference LLM observability. Hiring concentrates at the agents (70%) and serving infrastructure (9%) stages. Most common sectors: Enterprise, Big Tech, Banking.
54 AI roles tagged llm_observability.
| Company | Title | Sector | AI score | Other tags |
|---|---|---|---|---|
| Expedia | Senior Machine Learning Scientist - Agentic Experience | Hospitality | 9 | Agent orchestration · Tool use · Evals · RAG |
| Expedia | Machine Learning Scientist III - Agentic Experience | Hospitality | 9 | Agent orchestration · Tool use · Evals · RAG |
| Booking | Senior Machine Learning Scientist | Hospitality | 9 | Agent orchestration · Agent research · RAG · Evals · Tool use |
| Expedia | Senior Machine Learning Engineer (Gen AI & Multi-Agentic Systems) | Hospitality | 9 | Agent orchestration · RAG · Vector DB · Fine-tuning · RL post-training · Inference infra · Model serving · Multimodal · Vision · Audio & speech · Code gen · Evals · Guardrails |
| Expedia | Director, Machine Learning Science - Content AI | Hospitality | 9 | Agent orchestration · Fine-tuning · Model serving · Recommender systems · Vision · Multimodal · RAG · Agent research |
| Expedia | Machine Learning Engineer III (Gen AI & Multi-Agentic Systems) | Hospitality | 9 | Agent orchestration · Fine-tuning · RAG · Vector DB · Multimodal · Inference infra · Model serving · Evals · Guardrails · RL post-training · Code gen |
| Expedia | Principal ML Scientist | Hospitality | 8 | Agent orchestration · Fine-tuning · Inference infra · Model serving · Recommender systems · Search & ranking |
| Expedia | Principal Software Development Engineer - Business to Agent | Hospitality | 8 | Agent orchestration · RAG · Tool use · Agent research · Model serving |
| Expedia | Senior Software Development Engineer - Agentic Search | Hospitality | 8 | Agent orchestration · RAG · Tool use · Agent research · Model serving |
| Expedia | Software Development Engineer III - AI Engineer | Hospitality | 8 | Agent orchestration · Agent research · RAG · Vector DB · Fine-tuning · Inference infra · Model serving |
| Expedia | Principal Software Development Engineer - Gen AI | Hospitality | 8 | Agent orchestration · Tool use · Evals · Guardrails · RAG · Vector DB · Fine-tuning · Model serving |
| Expedia | Senior Machine Learning Engineer | Hospitality | 8 | Model serving · Inference infra · RAG · Agent orchestration · Guardrails |
| Expedia | Principal Product Manager – Partner Servicing (Agentic AI) | Hospitality | 8 | Agent orchestration · Guardrails · Model serving |
| Expedia | Senior Software Development Engineer (GenAI, Agentic AI) | Hospitality | 8 | Agent orchestration · Tool use · RAG · Vector DB · Fine-tuning · Inference infra · Model serving · Guardrails |
| Booking | Senior Machine Learning Scientist I | Hospitality | 8 | Agent orchestration · RAG · Evals · Fine-tuning · Model serving |
| Booking | Senior Machine Learning Scientist I - GenAI Applications | Hospitality | 8 | Agent orchestration · Fine-tuning · Multimodal · Recommender systems · Model serving |
| Booking | Senior Machine Learning Engineer I - GenAI Applications | Hospitality | 8 | Agent orchestration · Model serving · Inference infra |
| Expedia | Principal Quantitative User Experience Researcher, AI | Hospitality | 7 | Evals · Agent research · Recommender systems |
| Booking | Senior Solutions Architect - Data & AI | Hospitality | 7 | Agent orchestration · Vector DB · Evals · Model serving |
| Expedia | Senior Software Development Engineer - Agentic AI Experience | Hospitality | 7 | Agent orchestration · Multimodal · Evals · Guardrails · RAG · Model serving |
| Expedia | Data Scientist II - Marketing Automation Performance Analytics | Hospitality | 7 | Agent orchestration · RAG · Recommender systems · Search & ranking |
| Expedia | Senior Manager, Software Development Engineering | Hospitality | 7 | Agent orchestration · Agent research · Model serving · RAG · Guardrails |
| Expedia | Machine Learning Scientist III | Hospitality | 7 | Recommender systems · Search & ranking · Model serving |
| Expedia | Machine Learning Scientist III, Personalization | Hospitality | 7 | Recommender systems · Search & ranking · Fine-tuning · Model serving · RAG |
| Expedia | Software Development Engineer II | Hospitality | 7 | Agent orchestration · Tool use · RAG · Model serving |
| Expedia | Principal Product Manager - Agentic Search | Hospitality | 7 | Agent orchestration · Agent research · RAG · Vector DB |
| Expedia | Principal Product Manager - Answer Engine Optimization (AEO) | Hospitality | 7 | Agent orchestration · RAG · Model serving · Search & ranking |
| Booking | Senior AI Engineer | Hospitality | 7 | Agent orchestration · Tool use |
| Expedia | Data Engineer III, RAG and Gen AI | Hospitality | 7 | RAG · Vector DB · Agent orchestration |
| Expedia | Director of Product, AI Builder Experiences | Hospitality | 7 | Agent orchestration · Tool use · RAG · Evals |