Engineering Lead, Inference

Mistral AI Mistral AI · AI Frontier · New York, NY · Engineering & Infra

Engineering Lead for Mistral AI's Inference API team, focusing on evolving the inference stack, shipping enterprise features, and improving modalities like audio and OCR. The role involves leading a team, translating product vision to technical reality, and ensuring performance and stability of applications.

What you'd actually do

  1. Remove obstacles and create an environment where your team can focus on building solutions.
  2. Translate product vision into technical reality, collaborating closely with the Product team.
  3. Ensure applications are performant, stable, and responsive.
  4. Uphold high code quality standards through reviews, testing, and automation.
  5. Own the full software development process, from design to deployment.

Skills

Required

  • Experience building and managing engineering teams.
  • Proficiency in Python and at least one web framework (FastAPI, Django, Flask).
  • Proficiency in C#, Golang, TypeScript and at least one web framework.
  • Experience with large-scale distributed systems.
  • Experience working with cross-functional teams, such as Product, Design, and Business.
  • Knowledge of databases, caching mechanisms, and messaging systems.
  • Strong problem-solving abilities and attention to detail.
  • Ownership mindset and ability to ship products end-to-end.
  • Excellent communication skills and a low-ego, team-first attitude.

Nice to have

  • audio
  • OCR

What the JD emphasized

  • Ownership mindset and ability to ship products end-to-end.

Other signals

  • inference stack
  • enterprise-level features
  • API formats
  • modalities (audio, OCR)