Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics.
Primary AI lifecycle stage: evaluation and application.
As of today, 3,121 active AI roles across 225 companies in our index reference LLM observability. Hiring concentrates at the agents (70%) and serving infrastructure (9%) stages. Most common sectors: Enterprise, Big Tech, Banking.
Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics. Primary AI lifecycle stage: evaluation and application.
3,121 active AI roles across 225 companies in our index reference LLM observability as of today.
The companies with the most active LLM observability listings are: Amazon (304 roles), JPMorgan Chase (175 roles), Google (151 roles), Capital One (120 roles), Apple (92 roles).
LLM observability primarily belongs to the evaluation and application stages of the AI lifecycle. In current hiring, LLM observability roles concentrate at: agents (70%), serving infrastructure (9%).
The sectors with the most active LLM observability hiring are: Enterprise, Big Tech, Banking.
57 AI roles tagged llm_observability.
| Company | Title | Sector | AI score | Other tags |
|---|---|---|---|---|
| GEICO | Staff Machine Learning Engineer, AI Agent Platform | Insurance | 9 | Agent orchestration · Tool use · Guardrails · RAG · Agent research · Multi-agent |
| State Farm | REMOTE - AI Engineering Manager (Databricks) | Insurance | 8 | Agent orchestration · Tool use · Evals · Model serving |
| GEICO | Distinguished Machine Learning Engineer | Insurance | 8 | Agent orchestration · RAG · Evals |
| GEICO | Staff Machine Learning Engineer | Insurance | 8 | Agent orchestration · Agent research · RAG · Fine-tuning · Model serving · Inference infra |
| GEICO | Staff Applied Research Scientist | Insurance | 8 | Model serving · Recommender systems · Guardrails · RAG · Fine-tuning |
| GEICO | Distinguished Engineer, Applied AI | Insurance | 8 | Agent orchestration · Model serving · Inference infra |
| Allstate | AI Engineer Lead | Insurance | 8 | Agent orchestration · RAG · Vector DB · Fine-tuning · Model serving · Guardrails · Agent research |
| GEICO | Senior Machine Learning Engineer, AI Agent Platform | Insurance | 8 | Agent orchestration · Guardrails · RAG · Evals · Tool use |
| MetLife | Principal Architect (AI, Cloud & Azure) | Insurance | 8 | Agent orchestration · RAG · Fine-tuning · Model serving · Vector DB |
| GEICO | Staff Machine Learning Engineer | Insurance | 8 | Agent orchestration · Tool use · Inference infra · Model serving |
| GEICO | Sr. Software Engineer - Applied AI | Insurance | 8 | Agent orchestration · Tool use · RAG · Vector DB |
| GEICO | Distinguished Engineer, AI Applications | Insurance | 8 | Agent orchestration · RAG · Evals · Model serving |
| GEICO | Senior Staff Machine Learning Engineer, AI Agent Platform | Insurance | 8 | Agent orchestration · Agent research · Fine-tuning · Inference infra · Model serving · RAG · Guardrails · Evals · Tool use |
| Allstate | Senior Data Scientist - Agentic AI | Insurance | 8 | Agent orchestration · Model serving |
| GEICO | Staff Engineer - Applied AI | Insurance | 8 | Agent orchestration · RAG · Vector DB · Model serving |
| Premera Blue Cross | AI Engineer III | Insurance | 8 | Model serving · Inference infra · RAG · Guardrails |
| GEICO | Sr Staff Engineer - Applied AI | Insurance | 8 | Agent orchestration · Agent research · RAG · Vector DB · Model serving · Inference infra · Guardrails |
| GEICO | Sr Staff Engineer - Applied AI | Insurance | 8 | Agent orchestration · Agent research · RAG · Vector DB · Model serving · Inference infra · Guardrails |
| GEICO | Staff Engineer - Applied AI | Insurance | 8 | Agent orchestration · Tool use · RAG · Vector DB · Model serving · Inference infra |
| GEICO | Distinguished Machine Learning Engineer, Customer Intelligence and Recommendation | Insurance | 7 | Recommender systems |
| GEICO | Sr. Staff Security Engineer – AI, VMR, Offensive Security | Insurance | 7 | Agent orchestration · Evals · Guardrails |
| GEICO | Principal Product Manager - Customer Technologies | Insurance | 7 | Agent orchestration · Agent research · Guardrails |
| Allstate | Data Scientist - Agentic AI (Hybrid) | Insurance | 7 | Agent orchestration |
| GEICO | Director, Machine Learning Engineering | Insurance | 7 | RAG · Agent orchestration · Model serving · Inference infra |
| GEICO | Senior Machine Learning Engineer | Insurance | 7 | Model serving · Inference infra · RAG · Guardrails · Evals |
| GEICO | Senior Staff Software Engineer - Developer Experience | Insurance | 7 | Agent orchestration · Tool use · RAG · Guardrails · Code gen |
| MetLife | Senior AI Scientist | Insurance | 7 | RAG · Fine-tuning · Model serving |
| State Farm | Lead Software Engineer | Insurance | 7 | Agent orchestration · RAG |
| GEICO | Senior Director of Product Management, Enterprise Experience | Insurance | 7 | Agent orchestration · RAG · Vector DB · Model serving · Search & ranking · Copilot |
| Allstate | Data Scientist – Agentic AI (Enterprise Risk Management & AI Governance) | Insurance | 7 | Agent orchestration |