Abridge

This role focuses on building and optimizing the core inference infrastructure for AI models in a healthcare setting. The engineer will design, deploy, and maintain scalable Kubernetes clusters, develop and optimize ML model serving infrastructure for high performance and low latency, and scale backend infrastructure for AI-driven products. Key responsibilities include optimizing compute-heavy workflows, enhancing GPU utilization, and building a robust model API orchestration system, collaborating with research and product teams.