New AI postings mentioning PySpark per week — 210 total over 11 weeks.
268 active AI roles across 48 companies mention PySpark. Category: Frameworks & Tools.
PySpark is a skill in the "Frameworks & Tools" category. It currently appears in 268 active AI roles across 48 companies in our index.
The top employers with active AI roles mentioning PySpark are: Google (132), Amazon (16), Anduril (13), Walmart (11), JPMorgan Chase (10).
Over the last 11 weeks, 210 new AI postings mentioned PySpark. Demand is rising — up 240% in the last four weeks compared to the earliest four weeks in the window.
Roles requiring PySpark are concentrated in: agents (37%), serving infrastructure (24%), application (17%). These stages follow a seven-stage AI lifecycle from data preparation through to shipped product.
Job postings that mention PySpark most often also require: Python, Machine Learning, ML System Deployment, LLM Evaluation & Grading, Distributed Systems.
6 AI roles requiring this skill.
| Company | Title | Sector | AI score | Stage |
|---|---|---|---|---|
| Anthropic | Research Engineer, Pretraining | AI Frontier | 10 | L1 |
| Anthropic | Research Engineer/Research Scientist, Pre-training | AI Frontier | 10 | L1 |
| OpenAI | RE/RS, Data Understanding - Foundations | AI Frontier | 9 | L0 |
| OpenAI | RE/RS, Data Understanding (MM) | AI Frontier | 9 | L0 |
| World Labs | Research Engineer (Scaling Multimodal Data) | AI Frontier | 9 | L0 |
| Character AI | Research Engineer, Post-Training (All Industry Levels) | AI Frontier | 9 | L2 |