Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics.
Primary AI lifecycle stage: evaluation and application.
As of today, 3,121 active AI roles across 225 companies in our index reference LLM observability. Hiring concentrates at the agents (70%) and serving infrastructure (9%) stages. Most common sectors: Enterprise, Big Tech, Banking.
1264 AI roles tagged llm_observability.
| Company | Title | Sector | AI score | Other tags |
|---|---|---|---|---|
| Elastic | Principal Data Scientist - Agent Builder | Enterprise | 9 | Agent orchestration · RAG · Evals · Search & ranking · Model serving |
| Elastic | Principal Data Scientist - Agent Builder | Enterprise | 9 | Agent orchestration · RAG · Evals · Search & ranking · Model serving |
| Elastic | Principal Data Scientist - Agent Builder | Enterprise | 9 | Agent orchestration · RAG · Evals · Search & ranking · Model serving |
| Elastic | Principal Data Scientist - Agent Builder | Enterprise | 9 | Agent orchestration · RAG · Evals · Search & ranking · Model serving |
| Elastic | Principal Data Scientist - Agent Builder | Enterprise | 9 | Agent orchestration · RAG · Evals · Search & ranking · Model serving |
| Rubrik | Senior Machine Learning Engineer | Enterprise | 9 | Fine-tuning · RL post-training · Model serving · Inference infra · Synthetic data · Evals · Guardrails |
| CrowdStrike | Data Scientist, Agentic Systems (Remote) | Enterprise | 9 | Agent orchestration · Agent research · Tool use · Evals · Guardrails · Fine-tuning · RL post-training · Model serving |
| CrowdStrike | AI Engineer(Remote, IND) | Enterprise | 9 | Agent orchestration · Agent research · RAG · Vector DB · Fine-tuning · Model serving · Evals · Guardrails · Tool use |
| CrowdStrike | Lead AI Engineer, GTM Applications (Remote) | Enterprise | 9 | Agent orchestration · Agent research · RAG · Vector DB · Guardrails · Evals · Model serving · Inference infra |
| Oracle | Senior Principal AI Agent / ML Engineer (OCI) | Enterprise | 9 | Agent orchestration · Tool use · Evals · Guardrails · RAG · Vector DB · Inference infra · Model serving |
| Oracle | Principal AI Agent / ML Software Engineer (OCI) | Enterprise | 9 | Agent orchestration · Tool use · Evals · Guardrails · RAG · Vector DB · Fine-tuning · Inference infra · Model serving |
| CrowdStrike | Director, AI Alignment and Interpretability (Remote) | Enterprise | 9 | Interpretability · Evals · Guardrails |
| CrowdStrike | Sr. Data Scientist (Hybrid) | Enterprise | 9 | Agent orchestration · RAG · Vector DB · Model serving · Recommender systems · Search & ranking |
| Oracle | Applied Scientist 3 | Enterprise | 9 | Synthetic data · Multimodal · Evals · Fine-tuning |
| Salesforce | Senior, Member of Technical Staff | Enterprise | 9 | Agent orchestration · Agent research · RAG · Vector DB · Model serving · Tool use |
| CrowdStrike | Sr. AI/LLM Threat Researcher, Agentic Systems - AI Detection and Response (Hybrid) | Enterprise | 9 | Agent orchestration · Agent research · Evals · Guardrails · RAG · Tool use |
| Salesforce | Principal Architect | Enterprise | 9 | Agent orchestration · Multi-agent · Evals · Guardrails · RAG · Fine-tuning · Model serving · Agent research |
| Elastic | Principal Data Scientist - Agent Builder | Enterprise | 9 | Agent orchestration · RAG · Evals · Model serving · Search & ranking · Vector DB |
| Oracle | Principal AI Agent / ML Software Engineer (OCI) | Enterprise | 9 | Agent orchestration · Tool use · Evals · Guardrails · RAG · Vector DB · Model serving · Inference infra · Agent research |
| Oracle | Senior Principal AI Agent / ML Software Engineer (OCI) | Enterprise | 9 | Agent orchestration · Tool use · Evals · Guardrails · RAG · Vector DB · Model serving · Inference infra · Agent research |
| Oracle | Principal AI Agent / ML Software Engineer (OCI) | Enterprise | 9 | Agent orchestration · Tool use · Evals · Guardrails · RAG · Inference infra · Model serving |
| Oracle | Senior Principal AI Agent / ML Software Engineer (OCI) | Enterprise | 9 | Agent orchestration · Tool use · Evals · Guardrails · RAG · Vector DB · Inference infra · Model serving · Agent research |
| Oracle | Principal AI Agent / ML Software Engineer (OCI) | Enterprise | 9 | Agent orchestration · Tool use · Evals · Guardrails · RAG · Vector DB · Model serving · Inference infra · Agent research |
| Oracle | Principal AI Agent / ML Software Engineer (OCI) | Enterprise | 9 | Agent orchestration · Tool use · Evals · Guardrails · RAG · Vector DB · Inference infra · Model serving |
| Okta | Staff Product Security Engineer | Enterprise | 9 | Agent orchestration · Agent research · Evals · Guardrails · Tool use |
| Box | Machine Learning Engineer III, Core Agents | Enterprise | 9 | Agent orchestration · RAG · Evals · Search & ranking |
| Salesforce | Forward Deployed Engineering Lead | Enterprise | 9 | Agent orchestration · RAG · Vector DB · Fine-tuning · Model serving |
| Oracle | Snr Director, Applied Science | Enterprise | 9 | Multimodal · Agent orchestration · Model serving · Inference infra · RAG · Evals · Guardrails · Vision · Audio & speech |
| Gong | Head of AI Security | Enterprise | 9 | Agent orchestration · Multi-agent · RAG · Guardrails · Evals |
| Handshake | AI Red Teamer, LLM Generalist | Enterprise | 9 | Evals · Guardrails · Agent orchestration · Agent research · Multimodal |
Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics. Primary AI lifecycle stage: evaluation and application.
3,121 active AI roles across 225 companies in our index reference LLM observability as of today.
The companies with the most active LLM observability listings are: Amazon (304 roles), JPMorgan Chase (175 roles), Google (151 roles), Capital One (120 roles), Apple (92 roles).
LLM observability primarily belongs to the evaluation and application stages of the AI lifecycle. In current hiring, LLM observability roles concentrate at: agents (70%), serving infrastructure (9%).
The sectors with the most active LLM observability hiring are: Enterprise, Big Tech, Banking.