Senior Backend Engineer - AI Framework (python)

Gong Gong · Enterprise · Tel Aviv, Israel · Engineering

Senior Backend Engineer to build the foundational platform for AI agents at Gong, focusing on agentic framework architecture, evaluation systems, observability, guardrails, and developer enablement. The role involves designing and implementing systems for orchestration, tool usage, memory management, and production-grade AI agent reliability at scale.

What you'd actually do

  1. Designing and building Gong’s internal agentic framework, leveraging and integrating industry-standard tools such as LangChain, LangSmith, ADK, and similar ecosystems.
  2. Building evaluation frameworks and workflows for AI agents, including offline and online evaluations, quality metrics, regression detection, and experimentation infrastructure.
  3. Providing the organization with robust observability capabilities for AI agents, including tracing, logging, monitoring, cost tracking, and safety guardrails to ensure reliable and responsible usage.
  4. Creating APIs, SDKs, and abstractions that enable product teams to easily build, test, and operate agents while adhering to platform standards.
  5. Building the runtime responsible for orchestrating agent execution, managing tool calls, maintaining state and memory, and ensuring reliable execution across distributed systems.

Skills

Required

  • 7+ years of backend engineering experience
  • strong system design and platform-building expertise
  • designing and building agentic systems or agent frameworks in production
  • extending or building frameworks on top of tools like LangChain, LangGraph, ADK, or similar agent orchestration frameworks
  • designing, implementing, and operating production-grade AI agents
  • strong understanding of AI evaluation methodologies
  • High proficiency in Python
  • experience integrating backend platforms or tooling into Java-based systems
  • Experience building observability, monitoring, or platform tooling for distributed systems
  • Strong analytical skills
  • Experience with cloud platforms and scalable microservices architectures
  • Excellent communication skills
  • strong platform mindset

Nice to have

  • Familiarity with Java

What the JD emphasized

  • production-grade AI agents
  • agentic systems or agent frameworks in production
  • production-grade AI frameworks and services
  • AI evaluation methodologies, including agent evaluations, prompt evaluation, regression testing, and quality monitoring

Other signals

  • building foundational platform for AI agents
  • designing systems for orchestration, evaluation, observability, and safety
  • enabling other teams to build AI agents