Software Engineer, Agents

Harvey Harvey · AI Frontier · New York, NY · Engineering

Software Engineer focused on building and optimizing AI agents for legal professionals, involving prompt engineering, tool design, context window management, and performance evaluation. The role emphasizes shipping user-facing products and improving agent execution infrastructure and observability.

What you'd actually do

  1. Partner with customers and PMs to understand legal workflows, design practical evaluations that capture what “excellent” means, and ship agents that get the job done.
  2. Optimize agent performance through prompt engineering, model selection, tool design, skill writing, context window management, and eval harness development.
  3. Work with our model infra team to design and implement infrastructure for low-latency agent execution, including caching strategies, parallel tool calls, or subagent patterns.
  4. Improve our observability and instrumentation to profile agent behavior, identify bottlenecks, and drive optimization decisions.
  5. Stay current on new developments in agentic systems and bring those learnings back to the products we build.

Skills

Required

  • Python
  • LLM APIs
  • agent frameworks
  • shipping user-facing products
  • software engineering experience

Nice to have

  • domain-specific agents
  • iterative mindset
  • evaluations to drive quality
  • adaptable about code and frameworks
  • new best practices

What the JD emphasized

  • ship agents that get the job done
  • shipping user-facing products
  • practical evaluations

Other signals

  • building agentic systems
  • shipping user-facing products
  • customer delight
  • evaluating agent performance