Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics. Primary AI lifecycle stage: evaluation and application.
3,121 active AI roles across 225 companies in our index reference LLM observability as of today.
The companies with the most active LLM observability listings are: Amazon (304 roles), JPMorgan Chase (175 roles), Google (151 roles), Capital One (120 roles), Apple (92 roles).
LLM observability primarily belongs to the evaluation and application stages of the AI lifecycle. In current hiring, LLM observability roles concentrate at: agents (70%), serving infrastructure (9%).
The sectors with the most active LLM observability hiring are: Enterprise, Big Tech, Banking.
Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics.
Primary AI lifecycle stage: evaluation and application.
As of today, 3,121 active AI roles across 225 companies in our index reference LLM observability. Hiring concentrates at the agents (70%) and serving infrastructure (9%) stages. Most common sectors: Enterprise, Big Tech, Banking.
10 AI roles tagged llm_observability.
| Company | Title | Sector | AI score | Other tags |
|---|---|---|---|---|
| Anduril | Generative AI Chief Engineering Lead | Defense | 9 | Agent orchestration · Synthetic data |
| Anduril | Generative AI Integration Engineer | Defense | 8 | Agent orchestration · Tool use · Evals · Multimodal |
| Anduril | Senior Machine Learning/MLOps Engineer | Defense | 8 | Model serving · Inference infra · RAG · Vector DB · Vision |
| Anduril | Software Engineer, Command Control Mission Autonomy | Defense | 7 | Agent orchestration · Agent research · Tool use |
| Anduril | Senior Manager, Software Engineering | Defense | 7 | Model serving · Inference infra · Guardrails · Evals |
| Anduril | Technical Program Manager, AI Platform | Defense | 7 | Agent orchestration · Tool use |
| Anduril | Senior Software Engineer, Agentic Platform | Defense | 7 | Agent orchestration · Tool use · RAG · Vector DB |
| Anduril | IT Systems Engineer | Defense | 5 | Agent orchestration |
| Skydio | GTM Engineer, Post-Sales | Defense | 5 | Agent orchestration · RAG · Vector DB |
| Skydio | Success Systems Specialist | Defense | 5 | Agent orchestration · RAG · Vector DB · Model serving |