Software Engineer, Deployment Infrastructure

Mistral AI Mistral AI · AI Frontier · Paris, France · Engineering & Infra

Software Engineer focused on deploying and integrating AI products (models, APIs) across various infrastructure configurations, including cloud and on-premises. Responsibilities include ensuring fast and reliable product launches, building and extending deployment infrastructure, addressing AI safety on third-party platforms, and enhancing observability and monitoring for high availability and performance.

What you'd actually do

  1. New releases – you will ensure fast and reliable launch of new products (from models to APIs) to customers
  2. Build and test infrastructure – you will work to improve and extend the infrastructure needed to package, deploy and integrate our core technology within first-party systems and third-party platforms
  3. Safety – you will help solve the unique challenges that come with maintaining AI safety on third-party platforms
  4. Observability and Monitoring – you will collaborate closely with both internal and external stakeholders to ensure our services achieve high availability and deliver state-of-the-art performance for our users
  5. Build automation to increase deployment performance (velocity, scalability)

Skills

Required

  • Python
  • Golang
  • Docker
  • CI/CD
  • K8s
  • Helm
  • Terraform
  • cloud ecosystems
  • deploying LLM

Nice to have

  • backend software development
  • infrastructure management

What the JD emphasized

  • deploying LLM in multiple environments (public cloud, private cloud, on-premises)
  • 5+ years of relevant professional work experience

Other signals

  • deploying frontier models
  • serving models to customers
  • infrastructure for packaging and deploying models