Senior Research Engineer/scientist - On-device Transformer Models

OpenAI OpenAI · AI Frontier · San Francisco, CA · Consumer Products

Research Engineer/Scientist focused on developing and optimizing on-device transformer models, including multimodal capabilities, for future computing devices. The role involves training and evaluating models, developing novel architectures, and translating research into practical applications, with a focus on performance optimization and rigorous scientific methodology.

What you'd actually do

  1. Train and evaluate multimodal SoTA models along axis that are important to our vision for future devices.
  2. Develop novel architectures that improve model performance when scaling the models themselves is not an option.
  3. Run through the necessary walls to take nascent research capabilities and turn them into capabilities we can build on top of.

Skills

Required

  • research background related to developing on-device transformer models
  • performance optimization
  • rigorous science
  • teaching models to speak and perceive

Nice to have

  • working with GPU kernel engineers

What the JD emphasized

  • on-device transformer models
  • multimodal SoTA models
  • novel architectures
  • performance optimization
  • GPU kernel engineers
  • rigorous science

Other signals

  • on-device transformer models
  • multimodal SoTA models
  • novel architectures
  • nascent research capabilities
  • performance optimization
  • GPU kernel engineers