Software Engineer, Frontier AI Infrastructure

Scale AI Scale AI · Data AI · Washington, DC · Public Sector Engineering

Software Engineer focused on the model inference layer for Scale AI's Public Sector customers, involving secure backend systems, re-architecting for compliant environments, integration testing, and customer engagements. The role emphasizes enabling state-of-the-art models, debugging AI tools, managing infrastructure, and ensuring scalability and security within government mandates.

What you'd actually do

  1. Design and implement secure scalable backend systems for Public Sector customers, leveraging Scale's modern and cloud-native AI infrastructure.
  2. Own services or systems and define their long-term health goals, while also improving the health of surrounding components
  3. Re-architect the stack to run in compliant or restrictive environments. This requires designing swappable components (auth, storage, logging) to meet government/security mandates without breaking the product.
  4. You will work with Product to build integration tests that catch issues early, shifting the focus from "infra-only debugging" to preventing failures upstream.
  5. Participate actively in customer engagements, working closely with stakeholders to understand requirements and deliver innovative solutions.

Skills

Required

  • active secret clearance
  • backend systems development
  • cloud-native AI infrastructure
  • customer engagements
  • integration testing
  • security and compliance

Nice to have

  • Full Stack Development
  • modern web development frameworks
  • programming languages
  • databases
  • developing & delivering software to air-gapped & isolated environments
  • containerization (e.g., Docker)
  • container orchestration (e.g., Kubernetes)
  • cloud platforms (e.g., AWS, Azure, GCP)
  • Federal Compliance frameworks
  • analytical and problem-solving skills
  • interpersonal and communication skills
  • Adaptability and Learning Agility

What the JD emphasized

  • At least an active secret clearance and the ability & willingness to up level to TS/SCI with CI Poly. This is a requirement and candidates will not be considered who do not hold at least a secret clearance
  • Experience with Federal Compliance frameworks, and requirements(e.g, Cloud SRG, FedRAMP, STIG Benchmarks, etc). Experience developing software & technical solutions that meet strict security & regulatory compliance requirements.

Other signals

  • enabling state of the art models
  • debugging the latest AI tools
  • managing networking
  • debugging latency
  • tracking pricing/usage metrics for AI models
  • lead technical discussions on the frontlines with cloud vendors and customers
  • deliver on critical contracts
  • re-architect the stack to run in compliant or restrictive environments
  • designing swappable components
  • build integration tests that catch issues early
  • preventing failures upstream