Senior LLM Engineer

Datadog Datadog · Enterprise · Dublin, Ireland +9 · Remote · Dev Eng

Senior LLM Engineer to build AI-assisted tools for Datadog developers, focusing on LLM-based agents, generating tests, fixing bugs, and improving performance. The role involves working with users, designers, and PMs to prototype, iterate, and ship these systems, integrating them with Datadog products and following the latest research in LLM prompting and agents.

What you'd actually do

  1. Work closely with our users, designers, PMs, and data scientists on cutting edge and delightful LLM-based agents.
  2. Work on prompts, evals, and agent tools for working with code, and on the engineering to productionize these systems and integrate them with Datadog products.
  3. Prototype and see what works well in the real world, iterate closely with our users, and then ship.
  4. Follow the latest research on LLM prompting, agents, and code editing.
  5. Work with other Datadog teams to expand capabilities, for example integrating with the Datadog IDE extensions to deliver a CoPilot-like assistant, or Dynamic Instrumentation to collect more runtime data from production and pre-production environments.

Skills

Required

  • backend engineer
  • 5 years of professional experience
  • Go, Java, Python
  • LLMs
  • large-scale systems and data sets
  • machine learning
  • writing developer tools
  • AI coding tools

Nice to have

  • product-minded
  • community ambassador
  • drive hard technical conversations towards a pragmatic solution
  • fast, high-growth startup environment
  • push the boundaries of how AI can improve software engineering best practices
  • building AI-enabled products

What the JD emphasized

  • shipped software that uses LLMs to production
  • experience writing developer tools
  • demonstrated ability to use AI coding tools in day-to-day workflows and validate, critique, and refine AI-generated output

Other signals

  • LLM-based agents
  • productionize systems
  • developer tools