Software Engineer - Hosted Model Infrastructure

Palantir Palantir · Enterprise · Washington, DC · Dev

Software Engineer focused on enabling ML models in production environments, specifically for government and defense clients with strict constraints on hardware, access, and data sovereignty. The role involves owning services end-to-end, including inference engines, GPU scheduling, deployment pipelines, and observability, to deliver new models and capabilities continuously.

What you'd actually do

  1. We deploy AI models to run in variety of environments: air-gapped government networks, forward-deployed defense environments, edge nodes, and enterprises with strict data sovereignty requirements.
  2. You will own services end-to-end, and work across the full stack, from inference engines, GPU scheduling to deployment pipelines, observability, and integration with Palantir's platform.
  3. The goal is to deliver new models and capabilities quickly and continuously.

Skills

Required

  • ML model deployment
  • production environments
  • inference engines
  • GPU scheduling
  • deployment pipelines
  • observability
  • full stack development

Nice to have

  • AI safety
  • AI infrastructure

What the JD emphasized

  • air-gapped government networks
  • forward-deployed defense environments
  • edge nodes
  • strict data sovereignty requirements
  • constrained GPU resources
  • limited direct access

Other signals

  • deploying ML models in production
  • running AI models in air-gapped environments
  • constrained GPU resources
  • limited direct access
  • inference engines
  • GPU scheduling
  • deployment pipelines
  • observability
  • integration with Palantir's platform
  • deliver new models and capabilities quickly and continuously