Anyscale
Data AI · Ray framework
- HQ
- San Francisco, US
- Website
- anyscale.com
Data AI · Ray framework
No active AI roles currently tracked. Primary focus: Serve · Engineering. Salary range $170k–$247k (avg $209k).
Anyscale currently has 6 active AI-related roles in our index. The most common open titles are: Software Engineer, Platform Infrastructure (Foundations) (2), Distributed LLM Inference Engineer, Senior / Staff Product Manager - Ray Data, Software Engineer, Ray Data, Software Engineer, Ray Serve. Most positions are in Engineering and Product.
Anyscale's active AI hiring is concentrated in: serving infrastructure (67%), data (33%). These categories follow a seven-stage AI lifecycle: data, pre-training, post-training, serving infrastructure, agents, evaluation, and application.
Anyscale is hiring AI talent in: United States (3 roles), India (3 roles).
Job postings at Anyscale most frequently reference: inference infra, model serving, llm observability.
In the past 30 days, Anyscale has posted 1 new AI-related role.
| Title | Stage | AI score |
|---|---|---|
| Distributed LLM Inference Engineer Anyscale is seeking a Distributed LLM Inference Engineer to build and optimize systems for large-scale LLM inference, integrating with Ray and open-source projects like vLLM. The role focuses on achieving high throughput and low latency for batch and online inference, contributing to Anyscale's market-leading AI infrastructure. | Serve | 8 |
| Customer Engineer Customer Engineer role focused on post-sale customer success, onboarding, adoption, and issue resolution for Anyscale's platform (based on Ray) which supports scalable machine learning. Requires a technical background in ML engineering or distributed ML infrastructure, with a focus on LLM training, fine-tuning, inference, and serving. | — | 5 |
| Software Engineer, Platform Infrastructure (Foundations) Software Engineer role focused on building and scaling the platform infrastructure for distributed AI applications using Ray. Responsibilities include control plane and data plane development, Kubernetes, container orchestration, and cloud-native infrastructure. The role involves optimizing performance, reliability, and observability of the platform. | Serve | 5 |
| Senior / Staff Product Manager - Ray Data Product Manager for Ray Data, a scalable data processing library for ML and AI workloads. The role involves balancing open-source adoption with commercial product development, owning the product roadmap, and engaging with customers, engineering, and the open-source community. Requires experience in distributed systems, ML infrastructure, or data processing. | Data | 5 |
| Senior Site Reliability Engineer Senior Site Reliability Engineer to lead architectural strategy and operational excellence for Anyscale's global production systems, focusing on autonomous, self-healing infrastructure and establishing a culture of reliability. The role involves architecting cloud components, ensuring deployment methodologies align with reliability goals, designing observability systems, creating monitoring and alerting, establishing testing infrastructure, defining SLOs and error budgets, implementing best practices for incident management, and coordinating cloud-based service deployment. | — | 0 |
| Software Engineer (Ray Core) | — | — |