Staff Machine Learning Engineer, Computer Vision

Pinterest Pinterest · Consumer · San Francisco, CA · ATG

Research Engineer role focused on building and training large-scale computer vision and multimodal models from scratch for Pinterest's visual encoder, powering features like recommender systems and VLM. Involves experimentation with massive datasets, GPU computing, and contributing to visual generative strategy and training data collection. Opportunity to publish work and mentor junior researchers.

What you'd actually do

  1. Prototype state-of-the-art visual encoders that power Pinterest's recommender systems and internal visual language models.
  2. Experiment with billion-scale datasets and gain hands-on experience with large-scale GPU computing.
  3. Build flexible visual reasoning tools such as composed image retrieval, promptable detection/segmentation, and instruction-tuned embedding and generative models.
  4. Read research papers, participate in group discussions, and help brainstorm the company's overall visual generative strategy.
  5. Help collect relevant visual instruction training data that can be shared across multimodal representation, composed image retrieval, text-to-image generation and visual language modeling.

Skills

Required

  • building and training computer vision models
  • large-scale model training
  • modern deep learning frameworks (e.g., PyTorch)
  • collaboration skills
  • work effectively in a small, fast-moving team
  • M.S. or PhD in Machine Learning or related academic areas, or equivalent work experience
  • Publications at top ML conferences

Nice to have

  • multimodal representations
  • visual language modeling
  • Cursor, Copilot, Codex, or similar AI coding assistants

What the JD emphasized

  • train large-scale models from scratch
  • multimodal representations
  • visual language models
  • billion-scale datasets
  • large-scale GPU computing
  • visual generative strategy
  • visual instruction training data
  • multimodal representation
  • text-to-image generation
  • visual language modeling
  • publications at top ML conferences

Other signals

  • train large-scale models from scratch
  • multimodal representations
  • visual encoder
  • large-scale GPU computing
  • research papers
  • visual generative strategy
  • visual instruction training data
  • publications
  • top ML conferences