Senior Software Engineer, Agents

Harvey Harvey · AI Frontier · New York, NY · Engineering

Senior Software Engineer to build systems for AI agents in legal and professional services, focusing on agent design, model selection, tool creation, and evaluation for faster iteration and new capabilities. The role involves optimizing agent performance, developing infrastructure for low-latency execution, and improving observability.

What you'd actually do

  1. Partner with customers and PMs to understand legal workflows, design practical evaluations that capture what “excellent” means, and ship agents that get the job done.
  2. Optimize agent performance through prompt engineering, model selection, tool design, skill writing, context window management, and eval harness development.
  3. Work with our model infra team to design and implement infrastructure for low-latency agent execution, including caching strategies, parallel tool calls, or subagent patterns.
  4. Improve our observability and instrumentation to profile agent behavior, identify bottlenecks, and drive optimization decisions.
  5. Stay current on new developments in agentic systems and bring those learnings back to the products we build.

Skills

Required

  • Python
  • LLM APIs
  • agent frameworks
  • shipping user-facing products
  • prompt engineering
  • model selection
  • tool design
  • context window management
  • eval harness development
  • caching strategies
  • parallel tool calls
  • subagent patterns
  • observability
  • instrumentation

Nice to have

  • legal workflows
  • domain-specific agents

What the JD emphasized

  • ship agents that get the job done
  • customer delight
  • low-latency agent execution
  • agentic systems

Other signals

  • agentic AI
  • enterprise-grade platform
  • scaling fast
  • customer delight