Together AI
Data AI · Open-source model infra
- HQ
- San Francisco, US
- Website
- together.ai
Together AI currently has 25 active AI-related job listings. The majority of these roles, 80%, are focused on serving infrastructure. Engineering is the dominant function with 21 listings, and the United States is the primary hiring country with 19 roles. Frequent tech tags include model serving, inference infrastructure, and fine-tuning. Over the last 30 days, Together AI posted 4 new AI roles, representing a 33% decrease compared to the previous 30-day period.
Currently tracking 22 active AI roles, down 17% versus the prior 4 weeks. Primary focus: Serve · Engineering. Salary range $121k–$300k (avg $227k).
Data AI · Open-source model infra
Together AI currently has 26 active AI-related roles in our index. The most common open titles are: Solutions Architect (2), AI Infrastructure Engineer, AI Researcher, Core ML (Turbo), AI infrastructure Engineer (SRE) Bangalore , Customer Support Engineer (Inference), India. Most positions are in Engineering and Research.
Together AI's active AI hiring is concentrated in: serving infrastructure (81%), post-training (12%), application (4%). These categories follow a seven-stage AI lifecycle: data, pre-training, post-training, serving infrastructure, agents, evaluation, and application.
Together AI is hiring AI talent in: United States (20 roles), Netherlands (3 roles), United Kingdom (1 role).
Job postings at Together AI most frequently mention: Production ML Systems, Inference Infrastructure, GPU Computing, LLM Inference, Text-to-Speech.
In the past 30 days, Together AI has posted 5 new AI-related roles.
| Title | Stage | AI score |
|---|---|---|
| Forward Deployed Engineer (Inference & Post-Training) - Mandarin Speaking Forward Deployed Engineer (FDE) focused on Inference & Post-Training for strategic customers. Responsibilities include optimizing inference engines, tuning performance for POCs and deployments, and guiding customers through fine-tuning pipelines (LoRA, SFT, DPO, RLHF, GRPO). Acts as a technical point of contact for strategic accounts, ensuring successful platform adoption and influencing product roadmap. | ServePost-train | 9 |
| Research Engineer, Post-Training Inference Research Engineer focused on customizing open-source foundation models for downstream applications. The role involves building and improving services for fine-tuning, reinforcement learning, and evaluation, with a strong emphasis on integrating post-training processes with production serving and optimizing inference for RL training workloads. Requires experience in building and deploying ML services, modern inference engines, and fine-tuning techniques. |
| Post-trainServe |
| 9 |
| Systems Research Engineer Intern - GPU Programming (Fall 2026) Internship role focused on optimizing GPU-accelerated kernels and algorithms for ML/AI applications, co-designing GPU kernels and model architecture with modeling teams, and contributing to efficient GPU architectures and programming models. | Serve | 9 |
| Staff Machine Learning Engineer, Voice AI Staff ML Engineer focused on optimizing the model serving layer for voice AI applications, including speech-to-text and text-to-speech models, with a focus on latency, throughput, and GPU utilization using inference engines like TRT-LLM and SGLang. The role involves building evaluation frameworks, supporting model partners, and shaping the architecture for next-generation voice models. | Serve | 9 |
| Senior Machine Learning Engineer, Voice AI Senior ML Engineer focused on optimizing the model serving layer for voice AI workloads, including speech-to-text and text-to-speech models. The role involves hands-on work with inference engines, GPU optimization, batching strategies, and ensuring new model architectures can be productionized efficiently. The goal is to achieve best-in-class latency and reliability for real-time voice applications. | Serve | 9 |
| Systems Research Engineer, GPU Programming This role focuses on optimizing and developing GPU-accelerated kernels and algorithms for ML/AI applications, requiring expertise in GPU programming (CUDA, Triton) and performance profiling. The engineer will collaborate with modeling, hardware, and software teams to enhance AI system efficiency and co-design GPU architectures. | Serve | 9 |
| AI Researcher, Core ML (Turbo) AI Researcher focused on the intersection of efficient inference algorithms, architectures, engines, and post-training/RL systems for production-scale API services. The role involves advancing inference efficiency, unifying inference with RL/post-training, and owning critical systems. | ServePost-train | 9 |
| Technical Support Engineer (Inference) - US Weekends Technical Support Engineer role focused on supporting customers using Together AI's inference and fine-tuning services, acting as a customer-facing SRE for inference endpoints on Kubernetes. Responsibilities include resolving technical challenges, ensuring endpoint health, managing incidents, contributing infrastructure changes for model deployment, and collaborating with engineering and product teams. Requires experience with Kubernetes, AI/ML/GPU technologies, infrastructure services, observability tooling, and LLM inference frameworks. | Serve | 8 |
| Staff Engineer, Distributed Storage and HPC & AI Infrastructure Staff Engineer focused on designing and delivering multi-petabyte storage systems optimized for AI training and inference workloads. Responsibilities include architecting high-performance parallel filesystems and object stores, building Kubernetes-native storage operators, optimizing data paths for high throughput, and implementing intelligent caching and data distribution strategies. The role requires deep expertise in distributed storage systems, Kubernetes, and programming in Go and Python. | Serve | 8 |
| Machine Learning Engineer - Inference Machine Learning Engineer focused on optimizing and enhancing the performance of AI inference systems, working with state-of-the-art large language models to ensure efficient and effective operation at scale. Responsibilities include designing and building production systems, optimizing runtime inference services, and creating supporting tools and documentation. | Serve | 8 |
| AI Infrastructure Engineer AI Infrastructure Engineer responsible for keeping user-facing services and production systems running smoothly, specializing in systems, availability, reliability, and scalability, with interests in algorithms and distributed systems. Builds and runs infrastructure using Ansible, Terraform, and Kubernetes, and develops monitoring systems. | Serve | 7 |
| Senior Backend Engineer, Inference Platform Senior Backend Engineer focused on building and optimizing the inference platform for advanced generative AI models, including LLMs and multimodal models, at scale. The role involves optimizing latency, throughput, and resource allocation across tens of thousands of GPUs, collaborating with researchers to productionize frontier models, and contributing to open-source inference projects. | Serve | 7 |
| Platform Engineer, Model Shaping Platform Engineer focused on building and operating the foundational infrastructure for Together AI's model customization and evaluation platform. This includes backend services, scaling production workflows, and a job orchestration platform across datacenters and heterogeneous hardware. The role emphasizes reliability, CI/CD, and cloud/hybrid environment management. | ServeData | 7 |
| Senior Software Engineer - Together Cloud Infrastructure Senior Software Engineer focused on building and operating a high-performance, global AI cloud infrastructure platform. This includes designing and maintaining backend services for hardware management, IaaS software layer for GPU data centers, high-performance object storage for pretraining datasets, and advanced observability stacks for distributed pretraining. The role also involves architecture and research for decentralized AI workloads and contributing to the open-source platform. | ServeData | 7 |
| Solutions Architect Solutions Architect at Together AI to work with customers and prospects to create business value through Generative AI applications. This role involves acting as a technical advisor, running demonstrations and POCs, collaborating with sales, building relationships with customer leadership, delivering feedback to product/engineering/research, and building educational content. Requires 5+ years in a customer-facing technical role with 2+ years in pre-sales, strong technical background in AI/ML/GPU, understanding of LLM training/fine-tuning/inference, Python/JavaScript proficiency, and familiarity with infrastructure services. | Serve | 7 |
| Technical Support Engineer (GPU Clusters) - US Weekends This role is a customer-facing Technical Support Engineer focused on supporting customers using Together AI's GPU clusters for training, fine-tuning, and inference. The engineer will act as a product expert and SRE, troubleshooting complex technical challenges related to Kubernetes, GPU hardware, networking, and storage. They will collaborate with engineering and product teams to drive improvements and transform customer insights into product roadmap actions. The role requires experience with AI/ML infrastructure, Kubernetes, and high-performance computing environments. | — | 5 |
| Software Engineer, Customer Insights Software Engineer for Customer Insights team at Together AI, focusing on building and operating customer-facing visibility layers for AI workloads. This role involves developing features for analytics, activity history, audit logs, and investigation workflows, partnering with Data Platform and Observability teams. The position requires backend engineering skills and experience with large-scale distributed systems, with an emphasis on learning event-driven systems and analytics pipelines. | — | 5 |
| Senior Product Engineer, Fullstack Fullstack engineer to build and improve Together AI's core product surfaces (Playground, Model Garden, Fine-Tuning, etc.), focusing on user experience and shipping features end-to-end. Requires strong JavaScript/TypeScript, React, and full-stack fluency, with a pragmatic approach and curiosity about AI/LLMs. Experience with agentic workflows is a plus. | Ship | 5 |
| Technical Program Manager, Compute Qualification This role is responsible for qualifying new compute capacity for Together AI, ensuring it meets technical standards for training and inference workloads. The Technical Program Manager will manage the end-to-end qualification process, coordinating with engineering partners, reviewing specifications, and making go/no-go recommendations. The role requires strong technical understanding of data center infrastructure and program management skills. | — | 5 |
| Staff Software Engineer, GPU Infrastructure Lifecycle Management Software Engineer to build systems that treat infrastructure as software, owning state machines that provision hardware, bring it into service, and manage its full lifecycle for running inference clusters. The role focuses on creating a self-service API for the inference team to manage clusters, automating self-healing, and ensuring the reliability of the provisioning pipeline. It requires strong software engineering background, experience with workflow orchestration tools, and building control planes or event-driven systems. | — | 5 |
| GTM Engineer This role focuses on building and architecting an AI-native tech stack for Go-To-Market (GTM) operations, including CRM integrations, data centralization, and automation of sales processes using AI agents. The primary goal is to drive revenue outcomes by translating GTM strategy into scalable systems. While the company is an AI research firm, this specific role is not directly involved in AI/ML model development but rather in leveraging AI tools and building systems that support AI-driven business operations. | — | 5 |
| Senior Technical Recruiter, AI/ML Research Senior Technical Recruiter for Together AI, a company building an AI Native Cloud. The role focuses on scaling world-class AI research and engineering teams by partnering with leadership, leading full-cycle recruiting for specialized AI talent, and providing market intelligence. | — | 5 |
| Technical Account Manager (TAM), AI Factory This role is a Technical Account Manager focused on the infrastructure supporting large-scale AI GPU deployments for a strategic enterprise customer. The TAM will be the primary technical point of contact, responsible for the end-to-end technical relationship across compute, networking, storage, and facilities, ensuring smooth delivery and operational health. Responsibilities include issue lifecycle management, hardware lifecycle management, advising on infrastructure stack best practices, owning the observability strategy, coordinating operations, and managing capacity expansions. The role requires deep expertise in GPU infrastructure, large-scale networking, enterprise storage, and DC operations, with experience in customer-facing technical roles and AI/HPC infrastructure. | — | 5 |
| Senior Software Engineer, Observability Senior Software Engineer focused on building and scaling a robust observability platform for AI infrastructure, including metrics, logs, traces, monitoring, alerting, and anomaly detection. The role involves designing and implementing scalable systems using tools like Prometheus, Grafana, ClickHouse, OpenTelemetry, Go, Python, and Terraform, with a focus on distributed systems, containerization, and orchestration. | — | 5 |
| Senior Software Engineer - Together Cloud Platform Senior Backend Engineer role focused on building and scaling the AI Acceleration Cloud platform, which virtualizes ML hardware and provides self-serve AI cloud services for ML practitioners. Responsibilities include developing distributed GPU scheduling systems, global management planes, and customer-facing cloud platform services, ensuring high availability and performance. | — | 5 |
| IT Engineer IT Engineer role focused on providing hands-on support for employees, managing IT infrastructure (identity, devices, SaaS), and supporting IT initiatives. Responsibilities include Help Desk, MDM support, network troubleshooting, Okta administration, asset management, documentation, security hygiene, onboarding/offboarding, and creating automations. Requires experience with Okta, Google Workspace, MDM, various OS, procurement, technical writing, and low-code automation tools. Familiarity with AWS provisioning and security frameworks is a plus. | — | 0 |
| Staff Platform Engineer, Service Infrastructure Staff Platform Engineer focused on service infrastructure strategy, including Kubernetes, AWS, Terraform, networking, and observability. The role involves improving reliability, operability, and production readiness of core platforms, and driving cross-company infrastructure initiatives. | — | 0 |
| Senior Network Engineer Senior Network Engineer responsible for designing, implementing, and maintaining network infrastructure for AI company's user-facing services and production systems. Focus on routing, switching, network security, and protocols, with an emphasis on automation and HPC data center networking. Experience with large-scale hybrid data center networks, TCP/IP, BGP, OSPF, VXLAN, EVPN, QoS, Python/Ansible automation, network troubleshooting tools, multi-tenant networks, and major network device vendors (Cisco, Arista, Juniper, Mellanox). Cloud network experience (AWS, GCP, Azure) and Linux environment proficiency are also required. Preferred knowledge includes RoCE, Infiniband, Docker, Kubernetes, Slurm, and understanding AI training workloads. | — | 0 |
| Data Center Operations Coordinator This role manages and tracks break/fix activities across multiple data center locations, acting as a central point of coordination for hardware incidents, vendor dispatches, ticket management, asset tracking, and operational reporting to ensure maximum uptime and fast issue resolution. Responsibilities include monitoring ticket queues, coordinating with on-site technicians and vendors, maintaining hardware records, escalating outages, scheduling maintenance, providing status reports, and identifying trends in hardware failures. | — | 0 |
| Infrastructure Design Engineer This role focuses on the physical infrastructure design of data centers that house AI GPU clusters. Responsibilities include designing whitespace layouts, power distribution, cooling, and structured cabling to support high-density AI hardware. The role requires expertise in data center design, critical facilities engineering, and collaboration with various engineering and operational teams. | — | 0 |
| Director, Data Center Operations This role is for a Director of Data Center Operations at Together AI, focusing on building and scaling the physical infrastructure for AI workloads. The responsibilities include designing and commissioning data center white space, managing power and cooling systems, and building a break-fix team. It is a ground-floor, builder role with ownership over operational foundations. | — | 0 |
| Senior Developer Productivity Engineer Senior Developer Productivity Engineer at Together AI, a research-driven AI company. Focuses on optimizing engineering workflows, CI/CD pipelines, and building shared tooling to accelerate software delivery. Requires strong experience in DevOps, CI/CD, and Python/Go/TypeScript. | — | 0 |
| Senior Product Engineer Senior Product Engineer to join the central Product Engineering team, focusing on the UI surface for Together AI's revenue-critical commerce flows, including enterprise spend controls, pricing, and payment management. The role requires strong frontend engineering experience with React and TypeScript, a focus on shipping production features efficiently, and translating complex business requirements into user-facing improvements. While the company is AI-focused, this specific role is product engineering for commerce features, not direct AI/ML model development. | — | 0 |