Cohere

Cohere is seeking a Staff Research Engineer focused on Model Efficiency to push the limits of LLM inference efficiency. This role involves exploring and shipping breakthroughs in model architecture, routing optimization, decoding algorithms, software/hardware co-design for GPU acceleration, and performance optimization without compromising model quality. The goal is to improve how fast and efficiently their foundation models run in production.

Cohere is seeking an engineer to improve LLM inference efficiency by optimizing model execution, reducing latency and increasing throughput. This role involves deep dives into model execution, identifying bottlenecks, and developing optimizations across the inference stack, including GPU/CUDA and kernel-level improvements.

Lead Member of Technical Staff, Inference Infrastructure at Cohere. Responsible for the design, deployment, and operation of the AI platform delivering large language models through API endpoints. Focuses on optimizing NLP models for low latency, high throughput, and high availability, with a strong emphasis on Kubernetes, GPU workloads, and multi-cloud environments. Requires extensive experience in production infrastructure, distributed systems, and technical leadership, including mentoring engineers and guiding strategic infrastructure decisions.

Staff Software Engineer focused on building and scaling ML-optimized HPC infrastructure, including Kubernetes-based GPU/TPU superclusters, optimizing for AI/ML training cost efficiency, reliability, and performance, and enabling researchers with self-service tools.

Cohere is seeking a Site Reliability Engineer to join their Model Serving team. This role focuses on building, deploying, and operating the AI platform that delivers Cohere's large language models through API endpoints. The engineer will work on high-performance, scalable, and reliable machine learning systems, ensuring low latency, high throughput, and high availability for NLP model deployments. Responsibilities include automating service management, environment observability, and resilience, while collaborating with internal developers and influencing the infrastructure roadmap.

Cohere is seeking a Staff Software Engineer to join their Model Serving team. This role focuses on developing, deploying, and operating the AI platform that delivers Cohere's large language models via API endpoints. The engineer will optimize NLP models for low latency, high throughput, and high availability, working with distributed systems, Kubernetes, and GPU workloads. Experience with cloud platforms and high-performance languages is required.

Cohere is seeking an Audio Inference Engineer to optimize audio inference serving efficiency, focusing on latency, throughput, and quality for real-time and streaming audio workloads. The role involves deep system analysis, bottleneck identification, and developing creative solutions for audio processing and inference.

Software Engineer focused on building and operating internal infrastructure for training, evaluating, and serving foundational AI models. This includes managing Kubernetes GPU superclusters, optimizing cloud infrastructure for AI workloads, and designing scalable systems for model training, with a strong emphasis on stability, scalability, and observability.

Engineering Manager to lead a team of Forward Deployed Engineers responsible for deploying Cohere's AI platform (North) into customer environments, focusing on private cloud and on-premises deployments, technical implementation, performance optimization, and scaling infrastructure.

Cohere is seeking Software Engineer Interns to help build and deploy AI systems, focusing on areas like content generation, semantic search, RAG, and agents. Interns will contribute to machine learning datasets, API serving infrastructure, security features, and internal tooling, with opportunities to ship code to production.

Engineering Manager to lead a Forward Deployed Engineers team in EMEA, responsible for the end-to-end deployment of Cohere's North platform into customer environments (private cloud, on-premises). The role involves mentoring engineers, collaborating with Product/Engineering/Sales, optimizing infrastructure (OpenSearch, K8s services), and defining scaling guidelines for compute resources. Requires strong software engineering and leadership experience, with hands-on deployment of enterprise software at scale, cloud infrastructure, and Kubernetes.

This role focuses on the full-stack engineering of Cohere's inference platform, specifically enhancing customer-facing systems like authentication, billing, payments, and the interactive Playground. The engineer will also work on deployment management features and ensure code runs efficiently in low-resource environments with stringent security and privacy controls.