Technical Program Manager, Human Data

OpenAI OpenAI · AI Frontier · San Francisco, CA · Technical Program Management

This role focuses on designing and executing data collection campaigns to support AI research and model development, particularly for LLMs. The TPM will collaborate with researchers and engineers to define data needs, build and optimize data platforms, and ensure data quality for training and evaluation purposes.

What you'd actually do

  1. Collaborate with Research: Partner with researchers to scope data collection needs, define success metrics, and establish quality measurement frameworks.
  2. Design & Execute Data Collection Campaigns: Translate research needs into actionable plans and accelerate execution by leveraging existing tooling and iterating to reach the desired outcome. In many cases, you will need to implement scrappy new solutions while partnering with engineering to design robust/scalable solutions.
  3. Unblock Yourself: You must be deeply uncomfortable with the idea of sitting around waiting for external dependencies, and have the technical acumen and drive to figure out how to achieve at least partial success in the interim
  4. Optimize Systems & Processes: Build and optimize dashboards to track campaign performance, leveraging SQL and Python for data analysis and actionable insights.
  5. Drive Technical Roadmaps: Collaborate with engineers to enhance data platforms, resolve blockers, and ensure security best practices such as access management

Skills

Required

  • SQL
  • Python
  • data analysis
  • querying databases
  • processing large datasets
  • generating actionable insights
  • interacting with various tools via APIs
  • sending requests
  • processing responses
  • integrating functionalities into workflows
  • creating analytics dashboards
  • writing complex queries
  • optimizing data retrieval
  • visualizing insights for decision-making
  • understanding of how LLMs work
  • prompt engineering
  • understanding the technicalities of cutting edge AI research
  • working alongside researchers
  • working at large scale
  • portfolio of projects
  • action-oriented
  • deeply curious mind
  • frequent context switching
  • working on multiple projects at once
  • expansive ownership
  • navigating ambiguity

Nice to have

  • collaboration with external vendors
  • AI trainers
  • Human Data engineering team
  • Head of Human Data Operations
  • Preparedness and Safety Systems teams

What the JD emphasized

  • implement scrappy new solutions
  • Unblock Yourself
  • get your hands dirty
  • grit and creative problem solving will be required daily
  • Learn technical concepts exceptionally quickly
  • operate with high horsepower
  • ruthless prioritization

Other signals

  • data collection
  • data quality
  • model evaluation
  • AI trainers
  • research roadmap