| Title | Stage | AI score |
|---|---|---|
| Staff Software Engineer, RLE Staff Software Engineer to lead the architecture and evolution of Handshake's Reinforcement Learning Environments (RLE) platform, focusing on scalable systems, data pipelines, and enabling rapid domain creation for frontier AI models. This role involves technical leadership, system design, and cross-team collaboration to ensure reliability, observability, and performance. | DataEval Gate | 8 |
| Strategic Projects Lead, Coding This role involves leading coding data initiatives for AI and platform teams, coordinating SWE Fellows, designing and owning technical evaluation and annotation workflows, and ensuring delivery, margins, quality, and customer relationships. Responsibilities include writing and validating coding assessments, building rubric-driven code review processes, instrumenting quality signals, and adapting workflows. The role requires strong technical and analytical skills, coding proficiency, and stakeholder management. |
| 7 |
| Software Engineer II, RLE Software Engineer to build and scale Reinforcement Learning Environments (RLE) platform, which are interactive systems for frontier AI models to learn real-world tasks. The role involves owning components end-to-end, designing backend systems and data pipelines, and improving system reliability and performance, supporting model training and evaluation. | DataEval Gate | 7 |
| Software Engineer I , Coding Pod Software Engineer on the Coding Pod will build data infrastructure and pipelines for frontier AI coding models, focusing on creating large-scale, high-quality benchmark datasets for evaluating model performance on coding tasks. This role involves owning end-to-end data pipelines, integrating with developer ecosystems, and working with evaluation systems and agentic coding tools. | DataEval Gate | 7 |
| Associate Software Engineer, RLE Associate Software Engineer to build Reinforcement Learning Environments (RLE) platform, including supporting infrastructure, backend systems, frontend interfaces, and data pipelines for model training and evaluation. The role involves creating modular workflow domains and working with senior engineers to improve system reliability and performance. | DataPost-train | 7 |
| Software Engineer I, RLE Software Engineer to build and scale the Reinforcement Learning Environments (RLE) platform, which involves designing and implementing backend systems, data pipelines, and modular workflow domains to support frontier AI model training and evaluation. The role requires experience in backend/distributed systems, ML-adjacent infrastructure, and cloud technologies. | DataEval Gate | 7 |
| Senior Software Engineer, RLE Senior Software Engineer to build and scale Reinforcement Learning Environments (RLE) platform, simulating real-world workflows for AI model training and evaluation. This role involves driving architecture for scalable systems and data generation pipelines, partnering with research and product teams, and ensuring system reliability and observability. | DataEval Gate | 7 |
| Manager, Strategic Projects Manager, Strategic Projects leading a team focused on AI data and evaluation work. Responsibilities include managing SPLs, driving project delivery (data pipelines, labeling workflows), translating needs into plans, owning performance metrics, ensuring a good experience for fellows, and partnering with Product/Engineering on tooling. Success involves consistent delivery, improved operational metrics, and strong team leadership. Requires 5+ years in operations, 2+ years managing teams, and experience with complex projects, ideally in AI data operations or ML ops. | DataEval Gate | 7 |
| Medical Image Analyst - AI Trainer This role supports AI research by evaluating AI-generated medical image content and providing feedback. It requires experience with 3D Slicer and medical imaging concepts, but no prior AI technical experience is needed. The work involves creating questions and reviewing AI responses for accuracy and relevance. | Data | 5 |
| Cartographer/Digital Cartographer - AI Trainer This role involves evaluating AI-generated GIS content and providing feedback to improve AI understanding of spatial data workflows. It requires QGIS experience and is a flexible, hourly contract position for AI training purposes. | Data | 5 |
| Electrical Design Engineer - AI Trainer This role involves evaluating AI-generated content related to electronics design (KiCad/LibrePCB) and providing feedback to improve AI understanding of EDA workflows. It's a contract role for experienced hardware/PCB designers. | Data | 5 |
| Vectorworks Designer - AI Trainer This role involves evaluating AI-generated content related to Vectorworks and architectural design, providing feedback to improve AI understanding of design tasks and AEC workflows. It requires Vectorworks experience and knowledge of architectural design concepts, BIM standards, and CAD workflows. | Data | 5 |
| Video Editor - AI Trainer This role involves evaluating AI-generated video content and providing feedback to improve AI understanding of video editing tasks. It requires hands-on experience with specific video editing software (OpenShot, Shotcut, Lightworks) and a working knowledge of video editing concepts. No prior AI experience is necessary, as the focus is on leveraging existing video editing skills to train AI models. | Data | 5 |
| Music Producer - AI Trainer This role involves evaluating AI-generated audio content and providing feedback to improve AI understanding of audio tasks and production workflows. It requires hands-on experience with audio production software like Ardour, Audacity, or LMMS, and a working knowledge of audio engineering concepts. | Data | 5 |
| ParaView Specialist - AI Trainer This role involves evaluating AI-generated content related to computational science and HPC workflows, specifically using ParaView for scientific visualization and CFD post-processing. The specialist will provide feedback to improve AI understanding of these tasks. No prior AI experience is required, but strong ParaView and CFD knowledge is essential. | Data | 5 |
| SolveSpace Specialist - AI Trainer This role involves evaluating AI-generated content related to mechanical design and engineering workflows using SolveSpace. The specialist will create questions and review AI responses to improve AI's understanding of these tasks. This is a flexible, hourly contract position for experienced SolveSpace users. | Data | 5 |
| OpenShot Specialist - AI Trainer Contract role for experienced OpenShot users to evaluate AI-generated video content and provide feedback to improve AI understanding of video editing tasks. No prior AI experience required. | Data | 5 |
| BlenderBIM (Bonsai) Specialist - AI Trainer Contract role for BlenderBIM (Bonsai) users to support AI research by evaluating AI-generated content and providing feedback on BIM tasks and AEC data workflows. No prior AI experience required. | Data | 5 |
| FreeCAD BIM/IFC Specialist - AI Trainer Seeking experienced FreeCAD BIM/IFC users to provide feedback on AI-generated content for computational design and AEC workflows. This is a contract role focused on evaluating AI responses and creating tool-related questions. | Data | 5 |
| Qucs-S Specialist - AI Trainer This role involves evaluating AI-generated content related to RF circuit simulation using Qucs-S, providing feedback to improve AI understanding of RF engineering tasks and simulation workflows. It's a contract role for experienced Qucs-S users to support AI research by reviewing and annotating AI outputs. | Data | 5 |
| Krita Specialist - AI Trainer Contract role for experienced Krita users to evaluate AI-generated visual content and provide feedback for AI research. Requires 3+ years of Krita experience and knowledge of digital illustration workflows. No prior AI experience needed. | Data | 5 |
| 3D Slicer Specialist - AI Trainer This role supports AI research by evaluating AI-generated content related to medical imaging segmentation and providing feedback. It requires extensive experience with 3D Slicer and medical imaging concepts, but no prior AI technical experience is necessary. The work is project-based, flexible, and remote. | Data | 5 |
| QGIS Specialist - AI Trainer This role involves evaluating AI-generated content and providing feedback to improve AI understanding of GIS tasks and spatial data workflows. The specialist will use their QGIS expertise to create questions and review AI responses for accuracy and relevance. No prior AI experience is required, but a strong background in GIS and spatial data analysis is essential. | Data | 5 |
| Godot Specialist - AI Trainer This role involves evaluating AI-generated content related to Godot game development and providing feedback to improve AI understanding of game development tasks and engine workflows. It requires hands-on experience with Godot, GDScript, or interactive media, and involves annotating, labeling, and reviewing AI outputs for accuracy and relevance. No prior AI experience is necessary. | Data | 5 |
| Vectorworks Specialist - AI Trainer This role involves evaluating AI-generated content related to architectural design and BIM workflows using Vectorworks expertise. The primary focus is on providing feedback to improve AI understanding of design tasks and AEC workflows, with no prior AI or technical experience required. | Data | 5 |
| GIMP Specialist - AI Trainer This role involves evaluating AI-generated content and providing feedback to improve AI's understanding of visual tasks and 2D art workflows, leveraging experience with GIMP. It is an independent contractor position focused on data annotation and quality assessment for AI research. | Data | 5 |
| Architectural Designer - AI Trainer Contract role for experienced Vectorworks users to evaluate AI-generated architectural design content and provide feedback for AI research. No prior AI experience required. | Data | 5 |
| Game Developer - AI Trainer This role involves evaluating AI-generated game development content and providing feedback to improve AI understanding of game development tasks and engine workflows. It requires hands-on experience with game development engines and tools, but no prior AI experience is necessary. The work is project-based, hourly, and remote. | Data | 5 |
| Indie Game Developer - AI Trainer This role supports AI research by evaluating AI-generated game art assets and providing feedback to improve AI's understanding of visual tasks and game art workflows. It requires experience with pixel art and 2D game asset design tools like LibreSprite, Defold, or Solar2D, and involves annotating and reviewing assets for accuracy and consistency. No prior AI experience is necessary. | Data | 5 |
| Spatial Data Analyst - AI Trainer This role involves evaluating AI-generated spatial data content and providing feedback to improve AI understanding of GIS tasks. It requires QGIS experience and knowledge of spatial data analysis, with no prior AI experience needed. | Data | 5 |
| Medical Imaging Specialist - AI Trainer This role supports AI research by evaluating AI-generated medical imaging content and providing feedback. It requires experience with 3D Slicer, medical image analysis, and DICOM workflows. The work is project-based, flexible, and remote. | Data | 5 |
| RF Engineer - AI Trainer This role involves evaluating AI-generated content related to RF circuit simulation and microwave design, providing feedback to improve AI understanding of these domains. It requires expertise in Qucs-S or similar simulation tools, but no prior AI experience is necessary. The work is project-based, hourly, and remote. | Data | 5 |
| Structural Engineer - AI Trainer This role involves evaluating AI-generated content related to FreeCAD BIM/IFC and providing feedback to improve AI understanding of computational design tasks and AEC workflows. It requires hands-on experience with parametric 3D building modeling, IFC data management, or BIM coordination. | Data | 5 |
| Mechanical Engineer - AI Trainer This role supports AI research by evaluating AI-generated content related to mechanical design and engineering workflows using SolveSpace. The contractor provides feedback to improve AI understanding of these tasks. No prior AI experience is required, but hands-on experience with SolveSpace and mechanical design concepts is essential. | Data | 5 |
| BIM Coordinator - AI Trainer This role supports AI research by evaluating AI-generated BIM content and providing feedback to improve AI understanding of BIM tasks and AEC data workflows. Requires experience with BlenderBIM (Bonsai) and IFC/OpenBIM standards. | Data | 5 |
| Film & Video Editor - AI Trainer This role involves evaluating AI-generated video content and providing feedback to improve AI understanding of video editing tasks. It requires experience with video editing software like OpenShot, Shotcut, or Lightworks, and involves annotating and reviewing video assets for accuracy and consistency. No prior AI or technical experience is necessary. | Data | 5 |
| Content Video Editor - AI Trainer This role supports AI research by evaluating AI-generated video content and providing feedback. It requires experience with video editing software like OpenShot, Shotcut, or Lightworks, and involves creating questions and reviewing AI responses for accuracy and relevance to video editing workflows. No prior AI or technical experience is needed. | Data | 5 |
| Audio Editor - AI Trainer This role involves evaluating AI-generated audio content and providing feedback to improve AI's understanding of audio tasks and post-production workflows. It requires experience with audio editing software like Audacity and a working knowledge of audio editing concepts. | Data | 5 |
| Audio Engineer - AI Trainer This role involves evaluating AI-generated audio content and providing feedback to improve AI understanding of audio tasks and production workflows. It requires hands-on experience with Ardour, audio engineering concepts, and production briefs. The work is project-based, hourly, and remote for individuals in the US. | Data | 5 |
| Game Artist - AI Trainer This role involves evaluating AI-generated game art assets and providing feedback to improve AI's understanding of visual tasks and game art workflows. It requires experience in 2D game asset design (pixel art, sprite creation) and familiarity with game development tools like Defold, Solar2D, MonoGame, etc. No prior AI experience is necessary, and the role is a flexible, hourly contract position. | Data | 5 |