Smartsheet

Senior Software Engineer II focused on Applied AI and Evaluations for Smartsheet's AI-powered work management platform (SmartAssist). The role involves owning agent quality end-to-end, including diagnosis, improvement, and validation across orchestrators and subagents. Responsibilities include identifying failure modes, driving quality improvements through prompt/context engineering and RAG tuning, and extending the evaluation framework. This is a deeply technical role at the intersection of LLM evaluation, prompt engineering, and RAG, not a traditional QA role.

This role focuses on developing and enforcing AI and Data Governance frameworks, ensuring compliance with data privacy laws, security regulations, and AI regulations. It involves implementing tools for data lineage, metadata management, quality frameworks, and auditing AI models for bias and transparency. The goal is to manage risks in AI and data pipelines, define data stewardship roles, and embed security and privacy into AI workflows.