The role focuses on building and maintaining a Spark-based infrastructure for processing large multimodal datasets critical for machine learning research, specifically for state-of-the-art agents within the AGI Autonomy organization. It involves data extraction, transformation, and creating tooling for researchers, with a secondary focus on agent development.

This role focuses on developing diverse datasets for training and evaluating AI models, utilizing methods like synthetic data generation, model-supported generation, and human-in-the-loop collections. The Language Engineer will collaborate with cross-functional teams to innovate and advance the state-of-the-art in AI model evaluation and training.