| Title | Stage | AI score |
|---|---|---|
| Staff Software Engineer, RLE Staff Software Engineer to lead the architecture and evolution of Handshake's Reinforcement Learning Environments (RLE) platform, focusing on scalable systems, data pipelines, and enabling rapid domain creation for frontier AI models. This role involves technical leadership, system design, and cross-team collaboration to ensure reliability, observability, and performance. | DataEval Gate | 8 |
| Strategic Projects Lead, Coding This role involves leading coding data initiatives for AI and platform teams, coordinating SWE Fellows, designing and owning technical evaluation and annotation workflows, and ensuring delivery, margins, quality, and customer relationships. Responsibilities include writing and validating coding assessments, building rubric-driven code review processes, instrumenting quality signals, and adapting workflows. The role requires strong technical and analytical skills, coding proficiency, and stakeholder management. |
| Data |
| 7 |
| Software Engineer II, RLE Software Engineer to build and scale Reinforcement Learning Environments (RLE) platform, which are interactive systems for frontier AI models to learn real-world tasks. The role involves owning components end-to-end, designing backend systems and data pipelines, and improving system reliability and performance, supporting model training and evaluation. | DataEval Gate | 7 |
| Software Engineer I , Coding Pod Software Engineer on the Coding Pod will build data infrastructure and pipelines for frontier AI coding models, focusing on creating large-scale, high-quality benchmark datasets for evaluating model performance on coding tasks. This role involves owning end-to-end data pipelines, integrating with developer ecosystems, and working with evaluation systems and agentic coding tools. | DataEval Gate | 7 |
| Associate Software Engineer, RLE Associate Software Engineer to build Reinforcement Learning Environments (RLE) platform, including supporting infrastructure, backend systems, frontend interfaces, and data pipelines for model training and evaluation. The role involves creating modular workflow domains and working with senior engineers to improve system reliability and performance. | DataPost-train | 7 |
| Software Engineer I, RLE Software Engineer to build and scale the Reinforcement Learning Environments (RLE) platform, which involves designing and implementing backend systems, data pipelines, and modular workflow domains to support frontier AI model training and evaluation. The role requires experience in backend/distributed systems, ML-adjacent infrastructure, and cloud technologies. | DataEval Gate | 7 |
| Senior Software Engineer, RLE Senior Software Engineer to build and scale Reinforcement Learning Environments (RLE) platform, simulating real-world workflows for AI model training and evaluation. This role involves driving architecture for scalable systems and data generation pipelines, partnering with research and product teams, and ensuring system reliability and observability. | DataEval Gate | 7 |
| Manager, Strategic Projects Manager, Strategic Projects leading a team focused on AI data and evaluation work. Responsibilities include managing SPLs, driving project delivery (data pipelines, labeling workflows), translating needs into plans, owning performance metrics, ensuring a good experience for fellows, and partnering with Product/Engineering on tooling. Success involves consistent delivery, improved operational metrics, and strong team leadership. Requires 5+ years in operations, 2+ years managing teams, and experience with complex projects, ideally in AI data operations or ML ops. | DataEval Gate | 7 |
| Electrical Design Engineer - AI Trainer This role involves evaluating AI-generated content related to electronics design (KiCad/LibrePCB) and providing feedback to improve AI understanding of EDA workflows. It's a contract role for experienced hardware/PCB designers. | Data | 5 |
| Music Producer - AI Trainer This role involves evaluating AI-generated audio content and providing feedback to improve AI understanding of audio tasks and production workflows. It requires hands-on experience with audio production software like Ardour, Audacity, or LMMS, and a working knowledge of audio engineering concepts. | Data | 5 |
| Godot Specialist - AI Trainer This role involves evaluating AI-generated content related to Godot game development and providing feedback to improve AI understanding of game development tasks and engine workflows. It requires hands-on experience with Godot, GDScript, or interactive media, and involves annotating, labeling, and reviewing AI outputs for accuracy and relevance. No prior AI experience is necessary. | Data | 5 |
| Game Developer - AI Trainer This role involves evaluating AI-generated game development content and providing feedback to improve AI understanding of game development tasks and engine workflows. It requires hands-on experience with game development engines and tools, but no prior AI experience is necessary. The work is project-based, hourly, and remote. | Data | 5 |
| Spatial Data Analyst - AI Trainer This role involves evaluating AI-generated spatial data content and providing feedback to improve AI understanding of GIS tasks. It requires QGIS experience and knowledge of spatial data analysis, with no prior AI experience needed. | Data | 5 |