Cohere

Staff Software Engineer focused on building and scaling ML-optimized HPC infrastructure, including Kubernetes-based GPU/TPU superclusters, optimizing for AI/ML training cost efficiency, reliability, and performance, and enabling researchers with self-service tools.

Cohere is seeking a Site Reliability Engineer to join their Model Serving team. This role focuses on building, deploying, and operating the AI platform that delivers Cohere's large language models through API endpoints. The engineer will work on high-performance, scalable, and reliable machine learning systems, ensuring low latency, high throughput, and high availability for NLP model deployments. Responsibilities include automating service management, environment observability, and resilience, while collaborating with internal developers and influencing the infrastructure roadmap.

Software Engineer focused on building and operating internal infrastructure for training, evaluating, and serving foundational AI models. This includes managing Kubernetes GPU superclusters, optimizing cloud infrastructure for AI workloads, and designing scalable systems for model training, with a strong emphasis on stability, scalability, and observability.

Cohere is seeking Software Engineer Interns to help build and deploy AI systems, focusing on areas like content generation, semantic search, RAG, and agents. Interns will contribute to machine learning datasets, API serving infrastructure, security features, and internal tooling, with opportunities to ship code to production.