What is A/B Testing and how common is it in AI job postings?

A/B Testing is a skill in the "ML Ops & Evaluation" category. It currently appears in 695 active AI roles across 112 companies in our index.

Which companies are hiring for A/B Testing?

The top employers with active AI roles mentioning A/B Testing are: Amazon (147), Capital One (71), Deloitte (32), OpenAI (23), Adobe (23).

Is demand for A/B Testing growing?

Over the last 12 weeks, 446 new AI postings mentioned A/B Testing. Demand is rising — up 153% in the last four weeks compared to the earliest four weeks in the window.

At which stage of AI development is A/B Testing used?

Roles requiring A/B Testing are concentrated in: agents (42%), application (22%), serving infrastructure (17%). These stages follow a seven-stage AI lifecycle from data preparation through to shipped product.

What skills are commonly paired with A/B Testing?

Job postings that mention A/B Testing most often also require: Machine Learning, Large Language Models (LLMs), LLM Evaluation & Grading, Python, Production ML Systems.

← All skills

A/B Testing

695 active AI roles across 112 companies mention A/B Testing. Category: ML Ops & Evaluation.

Demand trend

New AI postings mentioning A/B Testing per week — 446 total over 12 weeks.

Function

All Engineering · 493 Research · 128 Product · 74

Status

All Active only

Sort

AI score Recently posted Company A–Z

FilteredsectorAI Frontier×statusActive only×Clear all

74 AI roles requiring this skill.

Company	Title	Sector	AI score	Stage
Anthropic	Data Scientist, Safeguards	AI Frontier	7	L5
OpenAI	Software Engineer, Monetization ML Infrastructure	AI Frontier	7	L3
Cohere	Forward Deployed Engineer, Infrastructure Specialist (Public Sector)	AI Frontier	7	L6
Mistral AI	Data Scientist	AI Frontier	7	L6
OpenAI	Software Engineer, Kernel Performance & AI Tooling	AI Frontier	7	L3
OpenAI	ChatGPT Performance Engineer	AI Frontier	7	L3
Perplexity	Member of Technical Staff (Software Engineer, Data Flywheel)	AI Frontier	7	L5
OpenAI	Data Science Manager, Integrity	AI Frontier	7	L6
OpenAI	AI Deployment Manager - NYC	AI Frontier	7	L6
Cohere	Forward Deployed Engineer, Infrastructure Specialist (UK/EU/ME)	AI Frontier	7	L4
Cohere	Forward Deployed Engineer, Infrastructure Specialist	AI Frontier	7	L4
Lila Sciences	Director of Product, Life Sciences	AI Frontier	7	L0
OpenAI	Data Scientist, Platform and B2B Products	AI Frontier	7	L6
Cohere	Forward Deployed Engineer, Infrastructure Specialist (North America)	AI Frontier	7	L4

Frequently asked questions

What is A/B Testing and how common is it in AI job postings?
A/B Testing is a skill in the "ML Ops & Evaluation" category. It currently appears in 695 active AI roles across 112 companies in our index.
Which companies are hiring for A/B Testing?
The top employers with active AI roles mentioning A/B Testing are: Amazon (147), Capital One (71), Deloitte (32), OpenAI (23), Adobe (23).
Is demand for A/B Testing growing?
Over the last 12 weeks, 446 new AI postings mentioned A/B Testing. Demand is rising — up 153% in the last four weeks compared to the earliest four weeks in the window.
At which stage of AI development is A/B Testing used?
Roles requiring A/B Testing are concentrated in: agents (42%), application (22%), serving infrastructure (17%). These stages follow a seven-stage AI lifecycle from data preparation through to shipped product.
What skills are commonly paired with A/B Testing?
Job postings that mention A/B Testing most often also require: Machine Learning, Large Language Models (LLMs), LLM Evaluation & Grading, Python, Production ML Systems.

A/B Testing

Top employers

Often paired with

Demand trend

Frequently asked questions

Demand trend

A/B Testing

Top employers

Often paired with

Frequently asked questions