Site Reliability Engineer - Nyc

Mistral AI Mistral AI · AI Frontier · New York, NY · Engineering & Infra

Site Reliability Engineer (SRE) to shape the reliability, scalability and performance of Mistral AI's platform and customer facing applications. This role involves designing, building, and maintaining scalable infrastructures for web services and ML workloads, ensuring high availability of platform, inference, and model training environments. The SRE will operate systems, troubleshoot production issues, implement monitoring and alerting, and manage CI/CD, containerization, and orchestration tools. They will also collaborate with AI/ML researchers on solutions for model-training experiments and contribute to cloud-agnostic platform development.

What you'd actually do

  1. Design, build, and maintain scalable, highly available and fault-tolerant infrastructures to support our web services and ML workloads
  2. Make sure our platform, inference and model training environments are always highly available and enable seamless replication of work environments across several HPC clusters
  3. Implement and maintain workflows and tools (CI/CD, containerization, orchestration, monitoring, logging and alerting systems) for both our client-facing APIs and large training runs
  4. Collaborate with AI/ML researchers to develop and implement solutions that enable safe and reproducible model-training experiments
  5. Build a cloud-agnostic platform offering an abstraction layer between science and infrastructure

Skills

Required

  • Master’s degree in Computer Science, Engineering or a related field
  • 7+ years of experience in a DevOps/SRE role
  • Strong experience with cloud computing and highly available distributed systems
  • Exposure to site reliability issues in critical environments (issue root cause analysis, in-production troubleshooting, on-call rotations...)
  • Experience working against reliability KPIs (observability, alerting, SLAs)
  • Hands-on experience with CI/CD, containerization and orchestration tools (Docker, Kubernetes...)
  • Knowledge of monitoring, logging, alerting and observability tools (Prometheus, Grafana, ELK Stack, Datadog...)
  • Familiarity with infrastructure-as-code tools like Terraform or CloudFormation
  • Proficiency in scripting languages (Python, Go, Bash...) and knowledge of software development best practices
  • Strong understanding of networking, security, and system administration concepts
  • Excellent problem-solving and communication skills
  • Self-motivated and able to work well in a fast-paced startup environment

Nice to have

  • experience in an AI/ML environment
  • experience of high-performance computing (HPC) systems and workload managers (Slurm)
  • worked with modern AI-oriented solutions (Fluidstack, Coreweave, Vast...)

What the JD emphasized

  • 7+ years of experience in a DevOps/SRE role
  • strong experience with cloud computing and highly available distributed systems
  • experience working against reliability KPIs (observability, alerting, SLAs)
  • Hands-on experience with CI/CD, containerization and orchestration tools (Docker, Kubernetes...)
  • Proficiency in scripting languages (Python, Go, Bash...)