This role focuses on evaluating, analyzing, and improving state-of-the-art end-to-end speech models for Siri. The engineer will design and implement novel evaluation frameworks, develop tools to measure model performance, analyze model behavior, and explore innovative approaches to advance speech capabilities. The role also involves building automated processes for large-scale model evaluation and analysis, collaborating with cross-functional teams.