Senior Ai/ml Engineer (ai Platform)

Whoop Whoop · Consumer · Boston, MA · Software

Senior AI/ML Engineer to scale the intelligence layer behind WHOOP's AI-powered experiences, focusing on the AI Platform. This role involves owning core components like evaluation pipelines, fine-tuning workflows, LLM observability, and experimentation tooling, partnering with product and data science to translate member needs into reliable AI systems.

What you'd actually do

  1. Design, build, and operate production AI systems and scaffolding around language models that power conversational, predictive, and generative capabilities across WHOOP products.
  2. Lead end-to-end AI system initiatives spanning problem definition, data flows, dataset design, evaluation harnesses, deployment, and iteration in close partnership with data science and product.
  3. Build and maintain pipelines for collecting, curating, and reshaping messy, multi-source data into high-quality, well-structured training and evaluation datasets for language model–based systems.
  4. Operationalize fine-tuning and evaluation workflows for large language models behind member-facing features such as WHOOP Coach and AI Support, including defining datasets, labels, and taxonomies that reflect real member needs.
  5. Develop tooling and frameworks that make experimentation, offline/online evaluation, and model deployment faster, safer, and more repeatable, including robust observability for AI features in production.

Skills

Required

  • applied machine learning
  • AI engineering
  • ML-focused software engineering
  • production environments
  • modern language models
  • prompt design
  • fine-tuning
  • rigorous evaluation
  • ML fundamentals
  • dataset construction
  • feature engineering
  • training workflows
  • evaluation metrics
  • experiment design
  • supervised fine-tuning (SFT)
  • direct preference optimization (DPO)
  • reinforcement learning (RL)
  • data pipelines
  • inference optimization
  • observability
  • lifecycle management
  • data manipulation
  • data analysis
  • secure AI
  • privacy-aware AI
  • sensitive data

Nice to have

  • streaming data
  • AI Studio

What the JD emphasized

  • production AI systems
  • production environments
  • rigorous evaluation
  • production deployments
  • sensitive data

Other signals

  • AI Platform
  • LLM observability
  • fine-tuning workflows
  • evaluation pipelines
  • experimentation tooling