LLM Inference

Frequently asked questions

• What is LLM Inference and how common is it in AI job postings?

  LLM Inference is a skill in the "LLM & Foundation Models" category. It currently appears in 355 active AI roles across 66 companies in our index.

• Which companies are hiring for LLM Inference?

  The top employers with active AI roles mentioning LLM Inference are: Capital One (80), NVIDIA (57), Amazon (34), ByteDance (22), Microsoft (12).

• Is demand for LLM Inference growing?

  Over the last 13 weeks, 195 new AI postings mentioned LLM Inference. Demand is rising — up 51% in the last four weeks compared to the earliest four weeks in the window.

• At which stage of AI development is LLM Inference used?

  Roles requiring LLM Inference are concentrated in: serving infrastructure (63%), agents (23%), post-training (6%). These stages follow a seven-stage AI lifecycle from data preparation through to shipped product.

• What skills are commonly paired with LLM Inference?

  Job postings that mention LLM Inference most often also require: Python, Machine Learning, Production ML Systems, PyTorch, Large Language Models (LLMs).