Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics. Primary AI lifecycle stage: evaluation and application.
3,121 active AI roles across 225 companies in our index reference LLM observability as of today.
The companies with the most active LLM observability listings are: Amazon (304 roles), JPMorgan Chase (175 roles), Google (151 roles), Capital One (120 roles), Apple (92 roles).
LLM observability primarily belongs to the evaluation and application stages of the AI lifecycle. In current hiring, LLM observability roles concentrate at: agents (70%), serving infrastructure (9%).
The sectors with the most active LLM observability hiring are: Enterprise, Big Tech, Banking.
Monitoring, tracing, and debugging LLM applications in production, including prompt and response logging, latency and cost tracking, and live quality metrics.
Primary AI lifecycle stage: evaluation and application.
As of today, 3,121 active AI roles across 225 companies in our index reference LLM observability. Hiring concentrates at the agents (70%) and serving infrastructure (9%) stages. Most common sectors: Enterprise, Big Tech, Banking.
258 AI roles tagged llm_observability.
| Company | Title | Sector | AI score | Other tags |
|---|---|---|---|---|
| Plaid | Machine Learning Engineer (Research Scientist) - DFAI | Fintech | 9 | Pretraining · Fine-tuning · Model serving · Inference infra |
| Block | Principal Engineer, AI Systems | Fintech | 9 | Agent orchestration · Tool use · Evals · RAG · Fine-tuning · Agent research |
| Plaid | Senior Machine Learning Engineer (Research Scientist) - DFAI | Fintech | 9 | Pretraining · Fine-tuning · Model serving · Inference infra |
| SoFi | Staff AI Engineer | Fintech | 9 | Agent orchestration · Tool use · Evals · RAG |
| Visa | Senior AI Engineer | Fintech | 9 | Agent orchestration · Tool use · Guardrails · RAG · Fine-tuning · Inference infra · Model serving · Frontier research · Interpretability · RL post-training · Agent research · Multimodal |
| Visa | Staff Research Scientist | Fintech | 9 | Frontier research · Pretraining · Fine-tuning |
| Visa | Head of Generative AI Research | Fintech | 9 | Frontier research · Pretraining · Multimodal · Agent research · Agent orchestration · Model serving |
| Upstart | Principal Engineer, LLM | Fintech | 9 | Inference infra · Model serving · RAG · Vector DB · Evals |
| Ramp | Agentic Operator, Growth Marketing | Fintech | 9 | Agent orchestration · Tool use · Evals · Guardrails · RAG · Fine-tuning |
| Gusto | Sr. Staff AI/ML Engineer | Fintech | 9 | Agent orchestration · RAG · Evals · Model serving · Guardrails |
| PitchBook | Manager, Engineering, AI & ML | Fintech | 8 | Fine-tuning · RAG · Vector DB · Model serving |
| Plaid | Engineering Manager, AI Applications | Fintech | 8 | Agent orchestration · Fine-tuning · RAG · Vector DB · Evals · RLHF · Agent research |
| Mastercard | Senior Software Engineer - Backend/Platform Agentic AI | Fintech | 8 | Agent orchestration · Tool use · RAG · Guardrails · Model serving · Inference infra |
| Plaid | Staff Software Engineer - Instant Access | Fintech | 8 | Agent orchestration · Evals · Guardrails · Model serving · Code gen |
| Visa | Manager, Visa Consulting and Analytics (VCA) — Senior AI Engineer, Tech Practice | Fintech | 8 | Agent orchestration · Tool use · RAG · Vector DB · Model serving |
| Stripe | Engineering Manager, AI Conversation Platform | Fintech | 8 | RAG · Fine-tuning · Agent orchestration · Model serving |
| PitchBook | Machine Learning Engineer | Fintech | 8 | RAG · Fine-tuning · Model serving |
| Gusto | Staff Software Engineer, AI Developer Tools | Fintech | 8 | Agent orchestration · RAG · Guardrails · Fine-tuning · Model serving |
| Block | Senior ML/AI Modeler, Risk Automation Machine Learning | Fintech | 8 | Agent orchestration · Guardrails · Fine-tuning · Model serving |
| PayPal | Lead Product Manager | Fintech | 8 | Agent orchestration · RAG · Vector DB · Fine-tuning · Model serving · Guardrails |
| Block | Senior Machine Learning Engineer, Model Risk Management | Fintech | 8 | Evals · Agent orchestration |
| Stripe | Staff Software Engineer, Machine Learning Platform | Fintech | 8 | Model serving · Inference infra · Agent orchestration |
| Ripple | Senior Staff Security Engineer, AI | Fintech | 8 | Agent orchestration · Guardrails · RAG · Agent research |
| Gusto | Head of ML/AI Engineering | Fintech | 8 | Model serving · Guardrails |
| Visa | Manager, Intelligence & Data Solutions (IDS), Data Science | Fintech | 8 | Agent orchestration · Tool use · RAG · Model serving |
| Visa | Software Engineer, Sr. Consultant Level (11-15 years exp, Java-Python-AWS-GenAI) | Fintech | 8 | Agent orchestration · RAG · Vector DB · Guardrails · Model serving · Inference infra |
| Ripple | Staff Software Engineer, GenAI Platform | Fintech | 8 | Agent orchestration · Tool use · Evals · Guardrails · RAG · Inference infra · Model serving |
| Visa | Staff Engineer GenAI Developer | Fintech | 8 | Agent orchestration · RAG · Vector DB · Fine-tuning |
| Robinhood | Senior Engineering Manager, Agentic AI | Fintech | 8 | Agent orchestration · Tool use · Evals · Model serving |
| Gusto | AI Solutions Architect | Fintech | 8 | Agent orchestration · Tool use · Evals · Guardrails |