xAI

Backend Engineer responsible for building and owning the xAI API that serves models to developers worldwide. This includes end-to-end system ownership for high-throughput, low-latency, and highly available inference, covering model serving infrastructure, request routing, SDK development, rate limiting, observability, and scaling. Requires expertise in Rust or C++, distributed systems, and observability, with preferred experience in LLM inference engines, serving frameworks, and agent orchestration.

The Sandbox service team at xAI builds and maintains a secure, scalable system that gives AI models safe, controlled access to computational environments. This infrastructure powers critical workloads across training and product, enabling models to run code, build software, interact with tools, and control applications. The role involves provisioning containers and virtual machines on large-scale clusters, granting models interactive control over these remote environments, and spans full-stack development from job orchestration and resource scheduling to filesystem performance tuning. It supports real-time code execution for products like Grok and reinforcement learning in training where models explore various tools.