Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics. Primary AI lifecycle stage: evaluation and application.
3,121 active AI roles across 225 companies in our index reference LLM observability as of today.
The companies with the most active LLM observability listings are: Amazon (304 roles), JPMorgan Chase (175 roles), Google (151 roles), Capital One (120 roles), Apple (92 roles).
LLM observability primarily belongs to the evaluation and application stages of the AI lifecycle. In current hiring, LLM observability roles concentrate at: agents (70%), serving infrastructure (9%).
The sectors with the most active LLM observability hiring are: Enterprise, Big Tech, Banking.
Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics.
Primary AI lifecycle stage: evaluation and application.
As of today, 3,121 active AI roles across 225 companies in our index reference LLM observability. Hiring concentrates at the agents (70%) and serving infrastructure (9%) stages. Most common sectors: Enterprise, Big Tech, Banking.
82 AI roles tagged llm_observability.
| Company | Title | Sector | AI score | Other tags |
|---|---|---|---|---|
| Disney | Lead Machine Learning Engineer | Media | 9 | Agent orchestration · Agent research · Multimodal · RAG · Evals · Guardrails · Model serving · Inference infra |
| Disney | Lead Product Manager, AI Platform | Media | 8 | Agent orchestration · RAG · Evals · Model serving |
| Disney | Director, Decision Science AI/ML Engineering & Ops | Media | 8 | Model serving · Inference infra · Guardrails · Evals |
| Comcast | Engineer 4 - Machine Learning | Media | 8 | Agent orchestration · Model serving · Fine-tuning · Evals · Guardrails |
| Disney | Omni-Channel Analytics Mgr | Media | 8 | Agent orchestration · Agent research · Fine-tuning · Evals · Guardrails |
| Disney | Manager - Applied AI | Media | 8 | Agent orchestration · Tool use · Evals · RAG · Model serving |
| Comcast | Senior Manager - Agentic AI | Media | 8 | Agent orchestration · Agent research · RAG · Tool use |
| Disney | Sr Software Engineer | Media | 8 | Agent orchestration · Tool use · RAG · Fine-tuning · Inference infra · Model serving |
| Disney | Staff GenAI/ML Engineer (Emerging Tech & AI Automation) Project Hire | Media | 8 | Agent orchestration · RAG · Fine-tuning · Model serving · Vector DB · Evals |
| Comcast | Engineer 3 - Machine Learning | Media | 8 | Agent orchestration · Model serving · Inference infra · Guardrails |
| Comcast | Engineer 3 - Machine Learning | Media | 8 | Agent orchestration · Model serving · Inference infra · Guardrails |
| The Trade Desk | Staff Product Manager, Agentic AI | Media | 8 | Agent orchestration · Evals · Guardrails |
| Comcast | Engineer 2 - Machine Learning | Media | 8 | Agent orchestration · Tool use · Model serving · Inference infra · Agent research |
| Comcast | Software Engineer - Agentic AI | Media | 8 | Agent orchestration · Tool use · Evals · RAG · Agent research |
| Disney | Software Engineer II | Media | 8 | Agent orchestration · Tool use · Fine-tuning · Model serving |
| Comcast | Principal Engineer - Agentic AI | Media | 8 | Agent orchestration · Agent research · Evals · Tool use |
| Comcast | Software Engineering Manager, AI Agents | Media | 8 | Agent orchestration · Tool use · Evals · Guardrails · Model serving |
| Comcast | Engineer 3, Agentic AI | Media | 8 | Agent orchestration · Tool use · Evals · Agent research · Code gen |
| Disney | Staff GenAI/ML Engineer (Emerging Tech & AI Automation) Project Hire | Media | 8 | Agent orchestration · RAG · Vector DB · Fine-tuning · Model serving · Evals |
| Comcast | Machine Learning Engineer 4 | Media | 8 | Agent orchestration · Evals · Guardrails · Model serving · Inference infra |
| Comcast | Sr. Software Engineer - Agentic AI | Media | 8 | Agent orchestration · Agent research · RAG · Evals |
| Comcast | Agent Evaluation Engineer | Media | 8 | Evals · Agent orchestration · Guardrails |
| Warner Bros Discovery | Sr. Staff, Data Science & Applied AI | Media | 8 | Agent orchestration · RAG · Evals · Guardrails · Model serving |
| Warner Bros Discovery | Sr. Staff, Data Science & Applied AI | Media | 8 | Agent orchestration · Tool use · Guardrails · RAG · Vector DB · Agent research |
| Disney | Sr Machine Learning Engineer | Media | 8 | Model serving · Inference infra · Forecasting |
| Warner Bros Discovery | Sr. Staff, Data Science & Applied AI | Media | 8 | Agent orchestration · RAG · Guardrails · Model serving · Inference infra |
| Disney | Lead Machine Learning Engineer, Ad Platforms | Media | 8 | Recommender systems · Search & ranking · Fine-tuning · RAG · Multimodal · Vision · Evals |
| Disney | Software Engineer II | Media | 7 | Agent orchestration · Tool use · RAG |
| Disney | Sr Software Engineer | Media | 7 | RAG · Vector DB · Fine-tuning · Model serving |
| Disney | VP, Analytics Engineering & DnA Operations | Media | 7 | Agent orchestration · Evals · Guardrails |