Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics. Primary AI lifecycle stage: evaluation and application.
3,121 active AI roles across 225 companies in our index reference LLM observability as of today.
The companies with the most active LLM observability listings are: Amazon (304 roles), JPMorgan Chase (175 roles), Google (151 roles), Capital One (120 roles), Apple (92 roles).
LLM observability primarily belongs to the evaluation and application stages of the AI lifecycle. In current hiring, LLM observability roles concentrate at: agents (70%), serving infrastructure (9%).
The sectors with the most active LLM observability hiring are: Enterprise, Big Tech, Banking.
Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics.
Primary AI lifecycle stage: evaluation and application.
As of today, 3,121 active AI roles across 225 companies in our index reference LLM observability. Hiring concentrates at the agents (70%) and serving infrastructure (9%) stages. Most common sectors: Enterprise, Big Tech, Banking.
47 AI roles tagged llm_observability.
| Company | Title | Sector | AI score | Other tags |
|---|---|---|---|---|
| Honeywell | Lead AI Engr | Industrial | 9 | Agent orchestration · Agent research · Fine-tuning · Inference infra · Model serving · RAG · Vector DB · Multimodal · Guardrails |
| Cognite | Applied AI Engineer | Industrial | 8 | Agent orchestration · Tool use · RAG · Vector DB |
| Caterpillar | Agentic AI / AI Ops Engineer – Platform Engineering | Industrial | 8 | Agent orchestration · Tool use · Inference infra · Model serving |
| Cognite | Senior Machine Learning Engineer | Industrial | 8 | Vision · Multimodal · Model serving · Inference infra · RAG · Vector DB · Fine-tuning · Agent orchestration |
| Honeywell | Sr IT Engineer | Industrial | 8 | Agent orchestration · Agent research · RAG · Model serving |
| Honeywell | Software Engr II | Industrial | 8 | Agent orchestration · RAG · Inference infra · Model serving |
| Honeywell | Sr Advanced AI Platform Engineer | Industrial | 8 | Agent orchestration · RAG · Model serving · Inference infra |
| John Deere | Part-Time Student - Software Engineer - Moline, IL | Industrial | 8 | Agent orchestration · Tool use · RAG · Vector DB · Multimodal |
| Honeywell | Advanced AI Engineer | Industrial | 8 | Agent orchestration · Agent research · RAG · Model serving · Inference infra · Fine-tuning |
| Cognite | Applied AI Engineer (Fullstack), AI Co-Innovation | Industrial | 8 | Agent orchestration · Tool use · RAG · Vector DB |
| Honeywell | Sr Advanced AI Engr | Industrial | 8 | Agent orchestration · Tool use · Multimodal · Fine-tuning · Model serving |
| Honeywell | Software Engr II | Industrial | 8 | Agent orchestration · RAG · Inference infra · Model serving |
| Cognite | Senior AI Platform Engineer, Atlas AI | Industrial | 8 | Agent orchestration · Tool use · Model serving · Inference infra · Evals |
| Caterpillar | Analyst Applications – ServiceNow Conversational & GenAI | Industrial | 7 | Agent orchestration · Guardrails · RAG · Fine-tuning · Model serving · Evals |
| Caterpillar | Senior Manager, Internal Enterprise Analytics & AI Experience Gateway | Industrial | 7 | Model serving · Inference infra · Agent orchestration · Tool use · RAG |
| Caterpillar | Principal Digital Product Manager, Applied AI | Industrial | 7 | Agent orchestration · Model serving |
| Caterpillar | Senior Manager - Connectivity Data Analytics | Industrial | 7 | Agent orchestration · Evals · Guardrails · Fine-tuning · Model serving · Recommender systems · Multimodal |
| Caterpillar | Senior Manager, Software Test Engineering | Industrial | 7 | Evals · Guardrails · Model serving |
| Honeywell | Software Engr II | Industrial | 7 | Agent orchestration · Tool use |
| Caterpillar | Agentic AI / AI Ops Engineer – Platform Engineering | Industrial | 7 | Agent orchestration · Tool use · RAG · Inference infra · Model serving |
| John Deere | Senior AI Engineer - Indaiatuba/SP | Industrial | 7 | Agent orchestration · RAG · Model serving · Fine-tuning |
| Caterpillar | Embedded Software Senior Engineering Specialist - AI | Industrial | 7 | Agent orchestration · RAG |
| Caterpillar | Lead Software Engineer, Gen AI | Industrial | 7 | Agent orchestration · Tool use · RAG · Fine-tuning · Model serving |
| Honeywell | Software Engr II | Industrial | 7 | RAG · Vector DB · Model serving |
| Honeywell | Advanced Software Engr | Industrial | 7 | Model serving · RAG · Vector DB · Agent orchestration |
| Caterpillar | Principal GenAI Product Manager - Dealer and Customer Support | Industrial | 7 | Agent orchestration · Guardrails · Evals · Model serving |
| Caterpillar | Director Software Engineering | Industrial | 7 | Model serving · RAG · Vector DB · Agent orchestration · Guardrails |
| Caterpillar | Lead Software Engineer, Gen AI | Industrial | 7 | Agent orchestration · Tool use · RAG · Fine-tuning · Model serving |
| Caterpillar | 状态监测、数据与 AI 实习生 | Industrial | 7 | Agent orchestration · Fine-tuning |
| Caterpillar | Junior GenAI Engineer | Industrial | 7 | Agent orchestration · RAG · Fine-tuning · Model serving |