Quality Engineering Lead – Agent Evaluation & AI Platforms

Comcast Comcast · Media · Mount Laurel, NJ +1

Seeking a Quality Engineering Lead (SDET 4) to lead the quality strategy for AI initiatives, focusing on Agentic AI validations and evaluation strategies within Google ADK environments. The role involves orchestrating release cycles, managing defect lifecycles, conducting code reviews, and ensuring the quality of AI agent logic, workflows, and production deployments.

What you'd actually do

  1. Run daily Scrums and stand-ups, optimizing team velocity, managing task assignments, and ensuring delivery milestones are met on time.
  2. Lead rigorous defect triaging meetings. You will be the primary driver tracking high-priority issues, coordinating directly with development teams, and pushing defects to rapid closure.
  3. Embed yourself in upstream requirement meetings. You will challenge assumptions, identify missing edge cases, and establish the technical "Definition of Done."
  4. Act as the strategic partner to Business teams, leading User Acceptance Testing (UAT) and translating complex technical deployments into business-ready validation.
  5. Bring at least 2+ years of hands-on experience in Agentic AI validations, navigating the non-deterministic nature of large language models and intelligent workflows.

Skills

Required

  • 10+ years of experience in Software Quality Engineering
  • Managing large-scale delivery
  • Leading functional testing strategies
  • 2+ years of specific experience with Agentic AI validations
  • Prompt Engineering
  • Agent Eval techniques
  • Google ADK or similar models
  • Deep, demonstrable knowledge of all 4 Comcast LOBs and their underlying technical architectures
  • Comprehensive understanding of the functional lifecycle for device provisioning
  • Python or TypeScript test scripts
  • Test automation methodologies
  • Agile Governance
  • Defect Triaging
  • Requirement & Architecture Inception
  • Business & UAT Orchestration
  • Evaluation Frameworks
  • Prompt Engineering Oversight
  • Quality Governance & Code Reviews
  • Automation Oversight & Code Reviews
  • E2E Strategy & Mentorship
  • Technical Troubleshooting
  • Kibana logs
  • Custom JIRA Architecture
  • Executive Reporting

Nice to have

  • complex billing system (ACSR and AMDOCS) handoffs
  • basic knowledge of testing frameworks

What the JD emphasized

  • Agentic AI validations
  • Agent Evaluation strategies
  • Prompt Engineering
  • Agent Eval techniques
  • Google ADK

Other signals

  • AI Agentic Team designs, builds, and runs intelligent agents end to end.
  • Own agent logic, workflows, integrations, production deployment, and ongoing performance.
  • Deliver agentic systems that are reliable, secure, and scalable in real-world use.