Senior AI Engineer

Klaviyo Klaviyo · Enterprise · Boston, MA · Engineering

Senior AI Engineer at Klaviyo, focusing on designing and building scalable backend systems and user experiences for AI products and AI agent solutions. The role involves developing data pipelines, serving AI models, and evolving agentic architecture. Requires strong backend and distributed systems experience, with expertise in generative AI and agentic AI applications.

What you'd actually do

  1. Design and build backend systems that support scaling our AI solutions for 167K+ customers.
  2. Develop robust, reliable and scalable data collection and processing pipelines for machine learning models to train and consume.
  3. Develop robust, reliable and scalable services to serve AI models in production environments.
  4. Contribute to evolving our agentic architecture — making our AI agents more self-sufficient and performant.
  5. Contribute to a culture of ownership, experimentation, and customer-centric product thinking.

Skills

Required

  • 5–7 years of professional experience in software engineering
  • strong focus on backend systems and distributed architectures
  • building and deploying generative AI and agentic AI applications into production
  • prompt engineering
  • few-shot learning
  • fine tuning
  • evaluation
  • scalable, distributed systems
  • Python
  • modern backend frameworks
  • creating human and automated evals
  • big data tools such as Apache Spark and Hadoop
  • asynchronous processing and distributed task queues
  • database technologies and ORMs
  • cloud-native architectures (AWS)
  • container orchestration (Kubernetes)
  • managing infrastructure and CI/CD pipelines
  • designing and building robust APIs
  • operate with a high degree of autonomy
  • handle ambiguity
  • thrive in a fast-moving, startup-like environment

Nice to have

  • FastAPI
  • Django
  • Trained ML models in the past and deployed them in production systems to generate impact to businesses.
  • Experience in reinforcement learning.

What the JD emphasized

  • hands-on experience building and deploying generative AI and agentic AI applications into production
  • strong track record of building scalable, distributed systems, especially in the service of AI agent capabilities
  • creating human and automated evals to ensure high AI model quality

Other signals

  • designing and building scalable backend systems
  • AI agent solutions
  • real-world impact at scale
  • backend-heavy role
  • influence architecture, async processing pipelines, distributed systems