Senior Software Engineer, Agent Platform

Klaviyo Klaviyo · Enterprise · Boston, MA · Engineering

Senior Software Engineer focused on designing and scaling backend systems for AI products and agent solutions. The role involves contributing to agentic architecture, deploying agents and RAG in production, and evaluating performance using various AI tools. It requires strong backend experience, production ML/AI project launch, and hands-on experience with generative AI and agentic AI applications.

What you'd actually do

  1. Design and build backend systems to scale AI solutions for 167K+ customers.
  2. Contribute to our agentic architecture to support performant AI agents.
  3. Build tools to tune LLM-based features, deploy agents, MCP and RAG in production, and evaluate performance using tools like Arize, OpenAI, Bedrock, LangChain, vLLM and Ray.
  4. Develop reliable, scalable data pipelines and APIs for AI systems.

Skills

Required

  • Python
  • backend software engineer
  • scalable, distributed systems
  • production environments
  • launching ML/AI projects
  • generative AI
  • agentic AI applications in production

Nice to have

  • Apache Spark
  • Ray
  • AWS
  • Terraform
  • Kubernetes
  • Huggingface
  • PyTorch
  • TensorFlow
  • Keras

What the JD emphasized

  • 5+ years of experience as a backend software engineer
  • launching ML/AI projects
  • Hands-on experience with generative AI and agentic AI applications in production

Other signals

  • designing and scaling backend systems for AI products
  • AI agents that can automatically create and execute marketing or customer experiences
  • agentic architecture
  • deploy agents, MCP and RAG in production
  • evaluate performance using tools like Arize, OpenAI, Bedrock, LangChain, vLLM and Ray