Member of Technical Staff - Pretraining

Black Forest Labs Black Forest Labs · Multimodal · Freiburg · Research

Research role focused on leading large-scale pretraining experiments for multimodal foundation models (image, video, audio), involving architecture, objective functions, and training algorithms. Requires prior experience leading pretraining for production models and strong distributed training skills.

What you'd actually do

  1. Lead large-scale pretraining experiments for our multimodal (image, video, audio) foundation models (architecture, objective functions, scaling strategies)
  2. Develop and evaluate novel ideas across architecture, optimizers, and training algorithms.
  3. Contribute across the full stack: low-level GPU and systems optimizations, research code, and high-level model design
  4. Lead focused research projects independently and drive larger cross-team initiatives

Skills

Required

  • led or co-owned pretraining for a foundation model (image, video, LLM, or multimodal) that shipped to production or a major release
  • architectural calls that move the model: attention patterns, modulation schemes, loss formulations, tokenization strategies
  • large-scale distributed training: FSDP/TP/PP, multi-node runs at 500+ GPUs, debugging loss spikes, NaNs, throughput regressions, and silent correctness issues at scale
  • intuition for architecture and objective design
  • top-venue publications (NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV) paired with production impact, or unambiguous production wins at a frontier lab
  • Deep Python and PyTorch proficiency
  • comfortable reading and modifying low-level training code
  • Familiarity with visual generative models

Nice to have

  • systems optimizations
  • research code
  • high-level model design

What the JD emphasized

  • led pretraining for a foundation model (image, video, LLM, or multimodal) that shipped to production or a major release
  • Track record of shipping: top-venue publications (NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV) paired with production impact, or unambiguous production wins at a frontier lab

Other signals

  • leading large-scale pretraining experiments
  • multimodal foundation models
  • shipping production models
  • frontier research