LLM Pre-training

Frequently asked questions

• What is LLM Pre-training and how common is it in AI job postings?

  LLM Pre-training is a skill in the "LLM & Foundation Models" category. It currently appears in 121 active AI roles across 19 companies in our index.

• Which companies are hiring for LLM Pre-training?

  The top employers with active AI roles mentioning LLM Pre-training are: Capital One (82), NVIDIA (8), Amazon (5), Microsoft (4), Google (3).

• Is demand for LLM Pre-training growing?

  Over the last 11 weeks, 57 new AI postings mentioned LLM Pre-training. Demand has been relatively stable over this period.

• At which stage of AI development is LLM Pre-training used?

  Roles requiring LLM Pre-training are concentrated in: serving infrastructure (53%), agents (18%), post-training (17%). These stages follow a seven-stage AI lifecycle from data preparation through to shipped product.

• What skills are commonly paired with LLM Pre-training?

  Job postings that mention LLM Pre-training most often also require: PyTorch, Large Language Models (LLMs), Hugging Face Transformers, LLM Evaluation & Grading, Vector Databases.