Staff Software Engineer, AI Platform

EvenUp EvenUp · Vertical AI · Toronto, ON · Hybrid · Engineering

Staff Software Engineer, AI Platform role focused on building and scaling backend systems that support production-grade LLM applications. The role involves leading architecture, ensuring quality, and collaborating cross-functionally to deliver reliable and scalable AI platforms. It emphasizes ownership, mentorship, and driving technical direction for LLM-powered products.

What you'd actually do

  1. Build, ship, and iterate on backend systems that support production-grade LLM applications.
  2. Lead the architecture and design of resilient, scalable distributed systems.
  3. Work closely with Product, ML, Data, and Infrastructure teams to scope, design, and deliver impactful solutions.
  4. Own projects end-to-end—from early design through deployment and continuous iteration.
  5. Evaluate and introduce new tools and technologies to continuously improve platform capabilities.

Skills

Required

  • Python
  • Postgres
  • Kubernetes
  • Elasticsearch
  • distributed systems
  • system design
  • technical tradeoff analysis
  • code quality
  • architecture
  • long-term maintainability
  • NodeJS
  • Go
  • Java
  • C++
  • communication
  • stakeholder management
  • ownership
  • accountability
  • technical leadership

Nice to have

  • AI/ML systems
  • LLM-powered applications
  • AI platforms
  • developer enablement tooling
  • ML-heavy environments
  • legal tech
  • mission-driven products
  • social-impact engineering
  • startup or scale-up experience

What the JD emphasized

  • production-grade LLM applications
  • production-grade AI platforms
  • scalable distributed systems
  • production-grade AI applications

Other signals

  • building foundational systems for LLMs
  • making LLMs accessible, reliable, and scalable
  • production-grade AI platforms
  • shared infrastructure and tooling for LLM applications