Senior Advanced Analyst - Digital & AI Products

Airbnb Airbnb · Consumer · Bangalore, India · Analytics

Senior Advanced Analyst role at Airbnb focused on Digital & AI Products within the Contact Center space. The role involves driving product analytics, building scalable analytical solutions, and leading measurement for AI systems, including AI Assistants and agent-assisting tools. Key responsibilities include owning the product analytics roadmap, collaborating with engineering on logging and observability for agentic and LLM workflows, designing and evaluating A/B tests for AI features, and translating insights into strategic recommendations. The role also involves mentoring a team in AI analytics and experiment best practices.

What you'd actually do

  1. Owning the product analytics roadmap, prioritization & delivery of solutions in the Contact Center Product space.
  2. Own projects from start to end: building out timelines, key milestones, providing regular updates to product managers, analytics management and delivery against agreed timelines.
  3. Lead end-to-end measurement for AI systems, aligning metrics with business outcomes, user experience, and trustworthiness
  4. Collaborate with engineering to define scalable logging and ensure observability across agentic and LLM workflows.
  5. Lead the design and evaluate A/B and causal tests to quantify impact of AI features and optimizations.

Skills

Required

  • Python
  • SQL
  • A/B testing platforms and best practices
  • EDA
  • hypothesis testing
  • significance testing
  • regression
  • clustering techniques
  • concepts of NLP/Text Mining
  • machine learning and deep learning techniques
  • language model fine-tuning
  • LLM architectures (e.g., prompt chains, retrieval augmentation, orchestration frameworks like LangChain or DSPy)
  • Data engineering foundations
  • Agentic AI systems
  • human-in-the-loop design
  • AI observability best practices
  • designing and building metrics
  • data pipelines

Nice to have

  • Masters or PhD in a quantitative field
  • vector stores
  • embeddings
  • prompt instrumentation
  • structured logging of LLM interactions
  • Contact center domain knowledge
  • marketplace domain knowledge

What the JD emphasized

  • AI Assistant
  • agentic and LLM workflows
  • AI features
  • LLM architectures
  • Agentic AI systems
  • LLM interactions

Other signals

  • AI Assistant
  • agentic and LLM workflows
  • AI features
  • LLM architectures
  • Agentic AI systems
  • LLM interactions