Senior Software Engineer II - Applied AI (remote Eligible)

Smartsheet Smartsheet · Seattle · United States · Engineering - Developers

Senior Software Engineer II role focused on building and scaling the AI Platform foundation, standardizing AI development paths, and engineering AI trust and safety systems for an enterprise AI product. The role involves designing core infrastructure, creating high-level APIs, establishing monitoring and evaluation pipelines, and driving technical strategy for AI at Smartsheet.

What you'd actually do

  1. Build the AI Platform Foundation
  2. Standardize the AI Developer Path
  3. Engineer AI Trust & Safety Systems
  4. Drive technical strategy

Skills

Required

  • LLMs in production
  • Prompt engineering
  • Context engineering
  • RAG architectures
  • LLM evaluation frameworks
  • Python
  • Databricks, Delta tables, or equivalent
  • Communication skills
  • Cross-functional judgment
  • Problem-solving in ambiguous situations

Nice to have

  • Applied AI or LLMOps platform experience
  • Terraform
  • Pulumi
  • AWS CDK
  • Pinecone
  • Milvus
  • Weaviate
  • Databricks Vector Search
  • LiteLLM
  • Kong AI Gateway
  • Langfuse
  • LangSmith
  • MLflow
  • RAGAS
  • DeepEval

What the JD emphasized

  • 8+ years of software engineering experience, with at least 2 years working directly with LLMs in production
  • Deep, hands-on experience with prompt engineering and context engineering
  • Strong working knowledge of RAG architectures
  • Experience building or extending LLM evaluation frameworks
  • Ability to communicate complex quality findings (written and verbal) to both technical and non-technical stakeholders
  • A bias for clarity in ambiguous situations

Other signals

  • AI Platform Foundation
  • Standardize AI Developer Path
  • Engineer AI Trust & Safety Systems
  • Drive technical strategy