AI Knowledge Architect

Uber Uber · Consumer · San Francisco, CA +1 · Community Operations

This role focuses on building and maintaining the knowledge base for customer-facing AI agents, ensuring they provide accurate and empathetic responses. It involves authoring prompt-aware content, structuring information for AI reasoning, tuning AI performance, and collaborating with product and engineering teams. The role requires a blend of technical writing, UX design, and prompt engineering skills, with a focus on optimizing retrieval accuracy and AI response patterns.

What you'd actually do

  1. AI Knowledge authoring: Author and structure prompt-aware content for AI agents to ensure the AI provides accurate, empathetic responses without hallucinations. Decide where the AI does not need any additional content, where it needs some context, where it can pull data from upstream systems for context and where it needs a lot of details, and tailor knowledge accordingly. Incorporate tribal knowledge from various parts of Uber into the knowledge base to ensure the AI agents are able to respond to customer queries effectively.
  2. AI Information architecture: Ensure the content provided to the AI agents are relevant, accurate, updated, non-conflicting and succinct. Identify gaps in content leading to AI agents not being able to help customers or providing wrong responses and fix those quickly. Ensure easy knowledge access for AI agents (e..g., clean up metadata where needed, improve vector match probabilities, decide how to chunk knowledge so that retrieval is highly accurate and efficient from a latency and cost perspective).
  3. AI Performance Tuning and standards improvement: Analyze failed AI conversations to identify knowledge gaps, then update documentation or metadata to improve future performance. Use your knowledge of the Tech stack to ensure retrieval accuracy is high and AI responses are crafted according to segmentation requirements and decision logic. Provide feedback to the Global Content team to improve content standards in case they are hindering the delivery of good responses.
  4. Product Thinking: Provide feedback to product and Engineering teams to improve prompts to effectively leverage AI knowledge and on platform enhancements needed for authoring effective AI knowledge. Operate in an agile fashion to adapt knowledge to Technology and product advancements in a rapidly changing AI ecosystem.
  5. Experiment with Knowledge options: Lead the product and use case evolution to better response patterns by experimenting with options to decide what amount of deterministic knowledge inputs is necessary and where to depend on LLM reasoning.

Skills

Required

  • Technical Writing
  • Information Architecture
  • Conversation Design
  • Product Operations
  • AI Knowledge authoring
  • Prompt Engineering
  • LLM reasoning
  • Retrieval accuracy
  • Content structuring

Nice to have

  • Leading LLMs (e.g., GPT-4, Claude, Gemini)
  • Gen AI concepts
  • RAG
  • Agentic AI
  • Chain-of-thought prompting
  • Decision flows
  • AI reasoning
  • Systems thinking
  • Cognitive sciences
  • Analytical mindset
  • Semantic precision
  • SQL
  • Python
  • JSON

What the JD emphasized

  • 8+ years of experience in Technical Writing, Information Architecture, Conversation Design, or Product Operations
  • 1+ year of demonstrated hands-on work with AI Knowledge

Other signals

  • AI agents
  • LLMs
  • knowledge architect
  • prompt engineering
  • RAG
  • vector database