Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics.
Primary AI lifecycle stage: evaluation and application.
As of today, 3,121 active AI roles across 225 companies in our index reference LLM observability. Hiring concentrates at the agents (70%) and serving infrastructure (9%) stages. Most common sectors: Enterprise, Big Tech, Banking.
Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics. Primary AI lifecycle stage: evaluation and application.
3,121 active AI roles across 225 companies in our index reference LLM observability as of today.
The companies with the most active LLM observability listings are: Amazon (304 roles), JPMorgan Chase (175 roles), Google (151 roles), Capital One (120 roles), Apple (92 roles).
LLM observability primarily belongs to the evaluation and application stages of the AI lifecycle. In current hiring, LLM observability roles concentrate at: agents (70%), serving infrastructure (9%).
The sectors with the most active LLM observability hiring are: Enterprise, Big Tech, Banking.
105 AI roles tagged llm_observability.
| Company | Title | Sector | AI score | Other tags |
|---|---|---|---|---|
| Johnson & Johnson | Senior Scientist, AI Applications - R&D Immunology Data Science & Digital Health | Pharma | 9 | Agent orchestration · Agent research · Multimodal · Fine-tuning |
| Johnson & Johnson | Senior Scientist – AI Agent Systems for Drug Development | Pharma | 9 | Agent orchestration · Agent research · Multimodal · Interpretability |
| Johnson & Johnson | Sr Director/Scientific Fellow, AI Safety, R&D Data Science and Digital Health | Pharma | 9 | Agent orchestration · Agent research · Evals · Guardrails · Frontier research · Interpretability |
| Johnson & Johnson | Sr Director/Scientific Fellow, AI Safety, R&D Data Science and Digital Health | Pharma | 9 | Agent orchestration · Guardrails · Evals · Frontier research · Agent research · Multimodal |
| Johnson & Johnson | Senior Scientist, AI Applications - R&D Oncology | Pharma | 9 | Agent orchestration · Agent research · Multimodal · Interpretability |
| Merck | Data Strategy Innovation Analyst | Pharma | 8 | Agent orchestration · Tool use · Guardrails |
| Merck | Data Governance Innovation Analyst | Pharma | 8 | Agent orchestration · Tool use · Guardrails |
| Johnson & Johnson | Sr Director Head of Data Science Services | Pharma | 8 | Model serving |
| Johnson & Johnson | Sr. Manager - AI Solutions Lead | Pharma | 8 | Agent orchestration · RAG · Evals · Guardrails · Tool use · Model serving |
| Merck | Associate Scientist, Postdoctoral Fellow - AI in Infectious Disease Modeling | Pharma | 8 | Fine-tuning · Evals · RAG |
| Pfizer | Senior Director, Applied AI - US Commercial | Pharma | 8 | Agent orchestration · Guardrails |
| Pfizer | Director, AI Solutions Expert—Agent Developer, AIA | Pharma | 8 | Agent orchestration · RAG · Vector DB · Model serving |
| Eli Lilly | Agentic AI Sr. Engineer | Pharma | 8 | Agent orchestration · RAG · Tool use |
| Johnson & Johnson | Post Doctoral Researcher, Evaluation & Standards in Clinical Operations | Pharma | 8 | Evals · Agent orchestration |
| Johnson & Johnson | Data Scientist- Clinical Decision Support- LLMs | Pharma | 8 | RAG · Vector DB · Fine-tuning · Model serving · Agent orchestration |
| Johnson & Johnson | Director, MedTech Technology AI Orchestration and Enablement | Pharma | 8 | Agent orchestration · Model serving · Inference infra · Guardrails |
| Johnson & Johnson | Director, MedTech Surgery Data Analytics & AI | Pharma | 8 | Guardrails |
| Johnson & Johnson | Lead, Technology Product Management - AI, Data & Insights | Pharma | 8 | Agent orchestration · RAG · Fine-tuning · Model serving |
| Merck | Senior Scientist, Agentic AI and Machine Learning (PDMB) | Pharma | 8 | Agent orchestration · Tool use · Fine-tuning · RAG · Multimodal · Model serving |
| Pfizer | Director, AI Engineering--Clinical Development and Operations (CD&O) | Pharma | 8 | Agent orchestration · RAG · Fine-tuning · Inference infra · Model serving |
| Merck | Senior Specialist, Data Science | Pharma | 8 | Agent orchestration · Tool use · Fine-tuning · Multimodal |
| Pfizer | Head, AI Delivery & Enablement (AIDE), Director | Pharma | 8 | Agent orchestration · Multimodal · Evals · Guardrails |
| Iambic | Machine Learning Scientist — Agentic data pipelines | Pharma | 8 | Agent orchestration · Tool use |
| Pfizer | Sr. Manager, AI Solutions Expert—Agent Developer | Pharma | 8 | Agent orchestration · Vector DB · RAG · Model serving |
| Pfizer | Senior Director, Applied Intelligence | Pharma | 8 | RAG · Fine-tuning · Model serving · Guardrails |
| Merck | Senior Specialist, Digital Reg Docs Tech Lead | Pharma | 8 | Agent orchestration · RAG · Vector DB · Fine-tuning · Model serving |
| Eli Lilly | Senior Principal Software Engineer - SPE | Pharma | 8 | Agent orchestration · RAG · Vector DB · Guardrails |
| Eli Lilly | Associate Director - AI Engineering | Pharma | 8 | Agent orchestration · Tool use · RAG · Model serving · Inference infra · Guardrails |
| Merck | Senior AI Developer | Pharma | 8 | RAG · Fine-tuning · Vector DB · Model serving |
| Eli Lilly | AI Architect – Lilly Medicine Foundry (R5-6) | Pharma | 8 | Agent orchestration · RAG · Vector DB · Fine-tuning · Model serving · Guardrails |