Abridge

GenAI Engineer role focused on designing and building LLM-driven workflows that leverage agentic capabilities, tool use, and retrieval systems. The role involves scaling and optimizing these workflows, owning architectural decisions, driving rigorous evaluation, and productionizing LLM workflows into low-latency, high-uptime environments with monitoring and guardrails.

Software Engineer, Gen AI Platform at Abridge, focusing on building the runtime, orchestration engine, and evaluation platform for agentic LLM-driven workflows in healthcare.

This role focuses on building and optimizing the core inference infrastructure for AI models in a healthcare setting. The engineer will design, deploy, and maintain scalable Kubernetes clusters, develop and optimize ML model serving infrastructure for high performance and low latency, and scale backend infrastructure for AI-driven products. Key responsibilities include optimizing compute-heavy workflows, enhancing GPU utilization, and building a robust model API orchestration system, collaborating with research and product teams.