LLM Evaluation

Frequently asked questions

• What is LLM Evaluation and how common is it in AI job postings?

  LLM Evaluation is a skill in the "ML Ops & Evaluation" category. It currently appears in 89 active AI roles across 33 companies in our index.

• Which companies are hiring for LLM Evaluation?

  The top employers with active AI roles mentioning LLM Evaluation are: Google (15), Apple (9), NVIDIA (8), JPMorgan Chase (7), Salesforce (5).

• Is demand for LLM Evaluation growing?

  Over the last 12 weeks, 70 new AI postings mentioned LLM Evaluation. Demand is rising — up 22% in the last four weeks compared to the earliest four weeks in the window.

• At which stage of AI development is LLM Evaluation used?

  Roles requiring LLM Evaluation are concentrated in: agents (69%), evaluation (15%), serving infrastructure (6%). These stages follow a seven-stage AI lifecycle from data preparation through to shipped product.