Software Engineer, AI Infrastructure

Glean Glean · Enterprise · Mountain View, CA +1 · Engineering

Software Engineer focused on building AI Infrastructure for Glean's Work AI platform, specifically focusing on LLM serving, routing, orchestration, and agentic systems for infrastructure health monitoring. The role involves designing, building, and improving AI/ML systems and data pipelines.

What you'd actually do

  1. Design, build, and improve AI/ML systems and data pipelines infrastructure, including platforms that power large language model serving, routing, and orchestration at scale.
  2. Work with and enable other engineers focused on modeling and Agentic capabilities
  3. Build agentic systems that leverage AI to proactively monitor, diagnose, debug and maintain infrastructure health at scale across cloud deployments
  4. Write robust code that's easy to read, maintain, and test
  5. Mentor more junior engineers, or learn from battle-tested ones

Skills

Required

  • 2-5 years of experience
  • BA/BS in computer science, math, sciences, or a related degree
  • Proven ability to design, build, and ship production-ready software, ideally around AI/ML infrastructure (Batch processing pipelines, Serving infrastructure, LLM orchestration etc.)
  • Strong coding skills (Python, Go, Java)

Nice to have

  • customer-focused, tight-knit and cross-functional environment experience
  • proactive and positive attitude to lead, learn, troubleshoot and take ownership

What the JD emphasized

  • ship production-ready software, ideally around AI/ML infrastructure
  • being a team player and willing to take on whatever is most impactful for the company is a must

Other signals

  • AI/ML systems and data pipelines infrastructure
  • large language model serving, routing, and orchestration at scale
  • agentic systems that leverage AI to proactively monitor, diagnose, debug and maintain infrastructure health at scale