Infrastructure Software Engineer, Enterprise Genai

Scale AI Scale AI · Data AI · San Francisco, CA · Enterprise Engineering

Scale AI is seeking an Infrastructure Software Engineer to build and scale their enterprise GenAI platform, focusing on multi-cloud systems, customer data integrations, and productizing AI technologies like LLMs and vector databases for regulated industries.

What you'd actually do

  1. Architect multi-cloud systems and abstractions to allow the SGP platform to run on top of existing Cloud providers
  2. Implement custom integrations between Scale AI's platform and customer data environments (cloud platforms, data warehouses, internal APIs)
  3. Collaborate with platform, product teams and our customers directly to develop and implement innovative infrastructure that scales to meet evolving needs.
  4. Deliver experiments at a high velocity and level of quality to engage our customers
  5. Work across the entire product lifecycle from conceptualization through production

Skills

Required

  • 4+ years of full-time engineering experience
  • Experience scaling products at hyper growth startups
  • Experience tinkering with or productizing LLMs, vector databases, and the other latest AI technologies
  • Proficient in Python or Javascript/Typescript, and SQL
  • Experience with Kubernetes
  • Experience with major cloud providers (AWS, Azure, GCP)

Nice to have

  • Excellent communication skills with the ability to explain technical concepts to both technical and non-technical audiences

What the JD emphasized

  • highly-regulated industries
  • customer data environments
  • productizing LLMs
  • vector databases

Other signals

  • architect multi-cloud systems
  • integrations with customer data environments
  • scaling core infrastructure
  • productizing LLMs and vector databases