Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics.
Primary AI lifecycle stage: evaluation and application.
As of today, 3,121 active AI roles across 225 companies in our index reference LLM observability. Hiring concentrates at the agents (70%) and serving infrastructure (9%) stages. Most common sectors: Enterprise, Big Tech, Banking.
Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics. Primary AI lifecycle stage: evaluation and application.
3,121 active AI roles across 225 companies in our index reference LLM observability as of today.
The companies with the most active LLM observability listings are: Amazon (304 roles), JPMorgan Chase (175 roles), Google (151 roles), Capital One (120 roles), Apple (92 roles).
LLM observability primarily belongs to the evaluation and application stages of the AI lifecycle. In current hiring, LLM observability roles concentrate at: agents (70%), serving infrastructure (9%).
The sectors with the most active LLM observability hiring are: Enterprise, Big Tech, Banking.
13 AI roles tagged llm_observability.
| Company | Title | Sector | AI score | Other tags |
|---|---|---|---|---|
| Agility Robotics | Director of AI | Robotics | 9 | Embodied AI · Model serving · Inference infra · Synthetic data · Frontier research |
| Nuro | Machine Learning Research Scientist: Generative Modeling for Planning | Robotics | 9 | Agent orchestration · Frontier research · Multimodal · Fine-tuning |
| Nuro | Technical Lead, Evaluation Infrastructure | Robotics | 8 | Evals |
| Nuro | Senior Software Engineer – GenAI Infrastructure & Agent Systems for Engineering Efficiency | Robotics | 8 | Agent orchestration · Tool use · Inference infra · Model serving |
| Applied Intuition | Software Engineer - AI Engineering | Robotics | 8 | Agent orchestration · Tool use · Evals · Inference infra · Model serving |
| Agility Robotics | Senior Manager, AI Innovation | Robotics | 8 | Embodied AI · Model serving · Inference infra · Synthetic data |
| Joby Aviation | Senior AI Engineer | Robotics | 8 | Agent orchestration · Model serving · Inference infra · RAG · Vector DB · Guardrails · Evals |
| Waabi | Applied Scientist | Robotics | 7 | Evals · Multimodal |
| Applied Intuition | Software Engineer - Insights Platform | Robotics | 7 | Agent orchestration · Tool use |
| Waabi | Software Engineer, Evaluation Infrastructure | Robotics | 7 | Evals · Model serving |
| Applied Intuition | Engineering Manager - Data Intelligence | Robotics | 7 | Fine-tuning · Multimodal · Evals |
| Wayve | Software Engineer - System Performance, Robot Software | Robotics | 5 | Inference infra · Model serving |
| Waabi | Senior / Staff Software Engineer (Observability / SRE) | Robotics | 5 | Inference infra · Model serving |