Software Engineer, Cortex AI Infrastructure

Snowflake Snowflake · Data AI · CA-Menlo Park, United States · Engineering

Software Engineer focused on building the backend infrastructure for agentic AI enterprise products, including orchestration engines, RAG systems, and evaluation infrastructure.

What you'd actually do

  1. Build Agentic Runtimes: Help build and scale the orchestration engines that execute complex agentic workflows, ensuring low-latency tool execution and robust state management.
  2. Scale Context Engineering Infra: Develop and design high-performance systems for RAG (Retrieval-Augmented Generation), including vector database integration, scalable search indexing, query processing, and semantic caching.
  3. Develop the "Evals Engine": Build the automated infrastructure required to run massive-scale golden set simulations, error analysis pipelines, and experiments.
  4. Productionize AI Workflows: Collaborate with the modeling team to take raw LLM capabilities and turn them into hardened, multi-tenant microservices with strict guardrails and observability.
  5. Optimize Performance: Implement system optimizations for model routing, prompt caching, and token optimization to ensure maximum efficiency.

Skills

Required

  • Python
  • Go
  • Java
  • distributed systems
  • high-throughput APIs
  • machine learning platforms
  • data-intensive systems
  • database internals
  • distributed state management
  • cloud-native architecture
  • Kubernetes
  • FoundationDB
  • vector indices
  • agent platforms
  • scalable data pipelines
  • PyTorch
  • TensorFlow
  • XGBoost

Nice to have

  • C++
  • CI/CD pipelines
  • Query optimization
  • SQL engine internals
  • multi-tenant systems
  • search infrastructure

What the JD emphasized

  • 4+ years of industry experience designing, building, and supporting distributed systems, high-throughput APIs, machine learning platforms, or data-intensive systems.

Other signals

  • building high-performance systems that orchestrate AI
  • making agentic AI fast, reliable, scalable, and secure
  • building the future of AI for enterprise data