Senior Applied Scientist

Qualtrics Qualtrics · Seattle · Reston, VA · Core AI

Senior Applied Scientist role focused on leveraging ML/AI, particularly generative models and agentic systems, to personalize customer experiences. The role involves research, implementation, evaluation, optimization, and productization of models, with a strong emphasis on evaluation-driven development and production deployment. Experience with NLP, deep learning, and model lifecycle management is required.

What you'd actually do

  1. Work as part of a multidisciplinary team to research, implement, evaluate, optimize, productize and maintain cutting-edge machine learning models to meet the demands of our rapidly growing business.
  2. Stay on top of the latest developments in machine learning and related research, and present research findings with the broader community.
  3. Work closely with, and incorporate feedback from other specialists, engineers, and product managers.
  4. Lead and engage in design reviews, modeling discussions, requirement definitions and other technical activities in diverse capacity.
  5. Mentor and grow junior scientists, drive best practices for experimentation, reproducibility, monitoring and lifecycle management, and ensure models are reliable, scalable and impactful in production.

Skills

Required

  • Python
  • TensorFlow
  • PyTorch
  • machine learning
  • natural language processing
  • reinforcement learning
  • supervised learning
  • unsupervised learning
  • generative models
  • agentic systems
  • evaluation strategies
  • rubric-based success criteria
  • multi-turn conversation simulation
  • LLM-as-a-judge frameworks
  • model selection
  • model training
  • model fine-tuning
  • model customization
  • model explainability
  • model evaluation
  • model life cycle management
  • production quality and large scale deployment
  • observability tools
  • tool-use reliability
  • systematic benchmarking
  • CI/CD pipelines

Nice to have

  • MxNet
  • SageMaker
  • MLFlow
  • publication record in top-tier ML and NLP conferences

What the JD emphasized

  • Proven track record in evaluating complex, multi-turn agentic systems.
  • Deep experience with observability tools, evaluating tool-use reliability, and implementing systematic benchmarking in CI/CD pipelines.
  • Deep understanding of machine learning model life cycle management.

Other signals

  • personalize the Qualtrics experience using ML/AI features
  • deliver algorithms and models that drive efficiency, innovation, and growth
  • tackle challenging problems in creative ways, leveraging generative models
  • design and execute evaluation strategies for agentic systems
  • implement, evaluate, optimize, productize and maintain cutting-edge machine learning models
  • champion Evaluation-Driven Development (EDD) by embedding automated testing, risk-based assessments, and production monitoring into the full agentic lifecycle