Anyscale
Data AI · Ray framework
- HQ
- San Francisco, US
- Website
- anyscale.com
Currently tracking 1 active AI role, up 500% versus the prior 4 weeks. Primary focus: Serve · Engineering. Salary range $170k–$247k (avg $209k).
Data AI · Ray framework
| Title | Stage | AI score |
|---|---|---|
| Distributed LLM Inference Engineer Anyscale is seeking a Distributed LLM Inference Engineer to build and optimize systems for large-scale LLM inference, integrating with Ray and open-source projects like vLLM. The role focuses on achieving high throughput and low latency for batch and online inference, contributing to Anyscale's market-leading AI infrastructure. | Serve | 8 |