Scientist/sr. Scientist, AI Safety

Lila Sciences Lila Sciences · AI Frontier · EUROPE · AI

Research role focused on AI safety for scientific superintelligence, involving building evaluations, safeguards, and understanding model capabilities to inform safety strategy. Requires strong Python and ML framework experience, with a focus on building evaluations or red-teaming for frontier models.

What you'd actually do

  1. Evaluations to test for scientific risks (both known but especially novel) from cutting edge scientific models integrated with automated physical labs
  2. Initial proof-of-concept safeguards, such as ML models to detect and block unsafe behavior from scientific AI models, as well as from physical lab outputs.
  3. Understanding of a range of model capabilities, across primarily scientific but also non-scientific domains (e.g. persuasion, deception) to inform Lila's broader safety strategy.
  4. Broader, high-quality research efforts - as and when needed - for scientific capability evaluation and restriction.

Skills

Required

  • Python
  • ML frameworks
  • building evaluations
  • red-teaming
  • AI safety frameworks

Nice to have

  • Masters or PhD
  • Publications in AI safety / evaluations / model behaviour
  • Experience researching risks from novel science
  • working with narrow scientific tools

What the JD emphasized

  • technical safety strategy development
  • risk- and capability-focused evaluations
  • safeguards
  • building evaluations
  • conducting red-teaming exercises
  • AI safety frameworks

Other signals

  • AI safety strategy
  • risk and capability evaluations
  • safeguards
  • model behavior understanding