Product Solutions Architect - LLM Observability

Datadog Datadog · Enterprise · Boston, MA +3 · Product Solutions Architecture

This role is a Product Solutions Architect focused on Datadog's LLM Observability product. The primary responsibility is to act as a subject matter expert, providing technical and architectural guidance to enterprise customers adopting the product. This involves creating collateral, building proofs of concept, and feeding customer insights back to the product team. The role requires a strong software engineering foundation with experience building and operating LLM-powered applications in production, and familiarity with observability concepts applied to LLMs.

What you'd actually do

  1. Serve as the in-house subject matter expert for Datadog’s LLM Observability product
  2. Partner with Field teams to provide hands-on technical and architectural guidance to enterprise customers adopting LLM Observability
  3. Create high-impact technical collateral, including reference architectures, technical guides, cookbooks, and documentation to enable Field teams and the broader customer community
  4. Build proofs of concept and small-scale deployments to validate solutions and reproduce real-world customer environments
  5. Act as a trusted advisor to Product Management by delivering actionable feedback informed by real-world field experience

Skills

Required

  • strong software engineering foundation
  • hands-on experience building and operating LLM-powered applications in production environments
  • familiarity with distributed systems
  • core observability concepts, such as tracing, metrics, and logging
  • translate those patterns into the emerging LLM observability domain, including LLM spans, evaluations, and prompt templates
  • experience with languages such as Python and/or JavaScript/TypeScript
  • comfortable operating in rapidly evolving, ambiguous technical domains
  • build deep context across teams and translate it into reusable, scalable solutions
  • take ownership from problem definition through implementation and measurable outcomes
  • highly detail-oriented, particularly when working on architectures and customer-facing technical assets
  • strong listening and consultative skills
  • experienced supporting customers in high-pressure, complex situations

Nice to have

  • Successful track record with 5+ years experience working as an Architect or Consultant
  • Experience using Datadog and/or other observability tools in an SRE or DevOps capacity
  • Experience with LLM application evaluation and testing frameworks

What the JD emphasized

  • building and operating LLM-powered applications in production environments
  • LLM application evaluation and testing frameworks

Other signals

  • LLM Observability product
  • monitor, troubleshoot, and optimize LLM-powered applications
  • drive adoption of LLM observability
  • partner with Field teams
  • technical and architectural guidance to enterprise customers