Software Engineer, AI Infrastructure

Glean Glean · Enterprise · Mountain View, CA +1 · Engineering

Software Engineer focused on building AI infrastructure for an enterprise Work AI platform, including LLM serving, routing, orchestration, and agentic systems. The role involves designing, building, and improving these systems, working with other engineers on modeling and agentic capabilities, and writing robust production code.

What you'd actually do

  1. Design, build, and improve AI/ML systems and data pipelines infrastructure, including platforms that power large language model serving, routing, and orchestration at scale.
  2. Work with and enable other engineers focused on modeling and Agentic capabilities
  3. Build agentic systems that leverage AI to proactively monitor, diagnose, debug and maintain infrastructure health at scale across cloud deployments
  4. Write robust code that's easy to read, maintain, and test
  5. Mentor more junior engineers, or learn from battle-tested ones

Skills

Required

  • Python
  • Go
  • Java
  • design, build, and ship production-ready software
  • AI/ML infrastructure (Batch processing pipelines, Serving infrastructure, LLM orchestration etc.)

Nice to have

  • 2-5 years of experience
  • BA/BS in computer science, math, sciences, or a related degree

What the JD emphasized

  • production-ready software
  • AI/ML infrastructure
  • LLM orchestration
  • customer-focused
  • team player
  • take ownership

Other signals

  • AI/ML systems and data pipelines infrastructure
  • large language model serving, routing, and orchestration
  • agentic systems
  • production-ready software, ideally around AI/ML infrastructure