xAI

Backend Engineer responsible for building and owning the xAI API that serves models to developers worldwide. This includes end-to-end system ownership for high-throughput, low-latency, and highly available inference, covering model serving infrastructure, request routing, SDK development, rate limiting, observability, and scaling. Requires expertise in Rust or C++, distributed systems, and observability, with preferred experience in LLM inference engines, serving frameworks, and agent orchestration.

The role focuses on building and shipping voice features for the Grok product, involving backend engineering for scalable, low-latency voice infrastructure and model integrations. The goal is to drive performance, reliability, and quality of voice interactions at a global scale.

The role involves building and optimizing large-scale GPU clusters and the platform layer for AI training and inference. Responsibilities include low-level CUDA kernel development, Linux kernel internals, custom orchestration, and performance debugging across the full stack to accelerate AI model development.

Seeking a Member of Technical Staff to manage and enhance reliability for a multi-data center AI infrastructure. This role focuses on automating processes, building observability solutions, and ensuring seamless operations for mission-critical AI infrastructure. The ideal candidate will combine strong coding abilities with hands-on data center experience to build scalable reliability services, optimize system performance, and minimize downtime, including partnership with facility operations. The primary objective is to mitigate downtime and minimize impact to end-users through proactive automation, robust observability, and integrated software-physical reliability strategies, ensuring AI infrastructure remains resilient and scalable.