Which companies are hiring for LLM observability roles?

The companies with the most active LLM observability listings are: Amazon (304 roles), JPMorgan Chase (175 roles), Google (151 roles), Capital One (120 roles), Apple (92 roles).

What AI lifecycle stage does LLM observability belong to?

LLM observability primarily belongs to the evaluation and application stages of the AI lifecycle. In current hiring, LLM observability roles concentrate at: agents (70%), serving infrastructure (9%).

What sectors invest most in LLM observability?

The sectors with the most active LLM observability hiring are: Enterprise, Big Tech, Banking.

← Tag co-occurrence network

LLM observability

Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics.

Primary AI lifecycle stage: evaluation and application.

As of today, 3,121 active AI roles across 225 companies in our index reference LLM observability. Hiring concentrates at the agents (70%) and serving infrastructure (9%) stages. Most common sectors: Enterprise, Big Tech, Banking.

Top hiring:

Function

All Engineering · 4599 Product · 548 Research · 269

Status

All Active only

Sort

AI score Recently posted Company A–Z

FilteredsectorBanking×

455 AI roles tagged llm_observability.

Company	Title	Sector	AI score	Other tags
JPMorgan Chase	Applied Machine Learning Scientist - Vice President	Banking	9	Agent orchestration · Tool use · Evals · Guardrails · RAG · Fine-tuning · Model serving · Recommender systems · Multimodal · Agent research · RL post-training
Capital One	Principal Associate, Data Science - AI Foundations	Banking	9	Fine-tuning · Inference infra · Model serving · Agent orchestration · RAG · Vector DB
Capital One	Sr. Distinguished AI Engineer (Agentic AI Platform)	Banking	9	Agent orchestration · RAG · Guardrails · Tool use · Model serving · Vector DB
JPMorgan Chase	Senior Lead Software Engineer- Java/Python/ AI Solutions	Banking	9	Agent orchestration · Tool use · RAG · Vector DB · Fine-tuning · Model serving · Agent research
JPMorgan Chase	Generative AI - Vice President	Banking	9	Agent orchestration · Model serving · Inference infra · Fine-tuning · Multimodal
JPMorgan Chase	AI Agents Applied Engineer - Senior Associate	Banking	9	Agent orchestration · Tool use · Fine-tuning · Model serving · Inference infra · Guardrails · Recommender systems · Search & ranking · RL post-training
JPMorgan Chase	Vice President — Principal Applied AI Data Scientist	Banking	9	Agent orchestration · RAG · Tool use · Vector DB · Multi-agent
JPMorgan Chase	AI/ML Director	Banking	9	Agent orchestration · RAG · Vector DB · Tool use · Evals · Guardrails
JPMorgan Chase	Machine Learning Scientist - Vice President	Banking	9	Agent orchestration · Tool use · Evals · Guardrails · RAG · Fine-tuning · Model serving · Recommender systems · RL post-training · Multimodal
JPMorgan Chase	Generative AI Director	Banking	9	Agent orchestration · Tool use · Fine-tuning · Model serving · Inference infra · Multimodal · Vision · Audio & speech
JPMorgan Chase	Lead Software Engineer -AI	Banking	8	Agent orchestration · Tool use · Evals · RAG
JPMorgan Chase	Lead Software Engineer -AI	Banking	8	Agent orchestration · Tool use · Evals · RAG
JPMorgan Chase	Applied AI ML Lead [Multiple Positions Available]	Banking	8	Agent orchestration · RAG · Evals · Fine-tuning · Model serving
JPMorgan Chase	Senior AI Application Engineer - Vice President	Banking	8	Evals · Guardrails · Model serving · Inference infra
JPMorgan Chase	Security Engineer III - AIML	Banking	8	Agent orchestration · Evals · Guardrails · RAG
JPMorgan Chase	Lead Software Engineer - Python, AI	Banking	8	Agent orchestration · Agent research · Tool use · Evals
Capital One	Senior Director, Software Engineering - AI	Banking	8	Agent orchestration · Model serving · Inference infra
Capital One	Senior Lead AI Engineer (GenAI Platform Services)	Banking	8	Fine-tuning · Inference infra · Model serving · Guardrails · Vector DB · Evals
JPMorgan Chase	Applied AI/ML Lead	Banking	8	Agent orchestration · Model serving · RAG · Evals
JPMorgan Chase	Software Engineer III - AI/ML, Prompt Engineer	Banking	8	Agent orchestration · RAG · Fine-tuning · Model serving · Vector DB · Evals · Guardrails
Capital One	Senior Lead AI Engineer, Gen AI Platform	Banking	8	Model serving · Inference infra · Fine-tuning · Guardrails · Vector DB
Capital One	Manager, Data Science - GenAI Digital Assistant	Banking	8	Agent orchestration · Fine-tuning · Inference infra · Model serving · RAG · Vector DB
JPMorgan Chase	Applied AI ML Engineer	Banking	8	Agent orchestration · RAG · Model serving
JPMorgan Chase	Applied AI ML Lead [Multiple Positions Available]	Banking	8	Fine-tuning · Model serving · Inference infra · RAG · Evals
Capital One	Senior Manager, Data Science - AI Foundations	Banking	8	Fine-tuning · Inference infra · Model serving · RAG · Vector DB
Capital One	Lead AI Engineer (Vision model customization, VLM)	Banking	8	Vision · Multimodal · Inference infra · Model serving · Fine-tuning · RAG · Vector DB · Guardrails
Capital One	Lead Machine Learning Engineer	Banking	8	Agent orchestration · Model serving · Inference infra · Guardrails · Fine-tuning · Evals
Capital One	Lead Machine Learning Engineer (Manager IC)	Banking	8	Model serving · Inference infra · Guardrails · Agent orchestration · Fine-tuning · RAG
Capital One	Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)	Banking	8	Agent orchestration · Model serving · Inference infra · Guardrails · Vector DB · Fine-tuning · Evals
Capital One	Lead AI Engineer (AI Foundations, LLM Core and Agentic AI)	Banking	8	Agent orchestration · Model serving · Inference infra · Fine-tuning · Guardrails · Vector DB · Evals

Frequently asked questions

What is LLM observability in AI?
Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics. Primary AI lifecycle stage: evaluation and application.
How many AI roles reference LLM observability right now?
3,121 active AI roles across 225 companies in our index reference LLM observability as of today.
Which companies are hiring for LLM observability roles?
The companies with the most active LLM observability listings are: Amazon (304 roles), JPMorgan Chase (175 roles), Google (151 roles), Capital One (120 roles), Apple (92 roles).
What AI lifecycle stage does LLM observability belong to?
LLM observability primarily belongs to the evaluation and application stages of the AI lifecycle. In current hiring, LLM observability roles concentrate at: agents (70%), serving infrastructure (9%).
What sectors invest most in LLM observability?
The sectors with the most active LLM observability hiring are: Enterprise, Big Tech, Banking.