Senior Manager, Software Test Engineering

Caterpillar Caterpillar · Industrial · Chicago, IL

Senior Manager for Test Engineering leading a team responsible for system testing of Caterpillar's autonomy programs, defining AI testing strategy, architecting AI test solutions, and establishing AI quality governance.

What you'd actually do

  1. Define and own the end‑to‑end AI testing strategy, including frameworks, tooling, quality gates, and automation approaches for machine‑learning and traditional software systems.
  2. Lead, mentor, and develop a team of software test leads, setting clear expectations, elevating technical depth, and fostering a culture of quality engineering excellence.
  3. Architect scalable AI test solutions, such as model‑validation pipelines, data‑quality checks, bias and drift detection, and performance benchmarking for AI/ML models.
  4. Partner with engineering, product, and data science leaders to align testing practices with roadmap priorities, ensuring AI features meet reliability, safety, and compliance standards.
  5. Drive continuous improvement across test operations, introducing modern automation, observability, and tooling that increase coverage, speed, and defect detection accuracy.

Skills

Required

  • AI Test architecture
  • Software Test Architecture
  • Software Quality Assurance and Testing
  • Organizational Leadership
  • Software Development Life Cycle

Nice to have

  • playwright
  • karate
  • java

What the JD emphasized

  • AI testing strategy
  • AI test solutions
  • AI quality governance
  • regulated or high-impact systems

Other signals

  • AI testing strategy
  • AI test solutions
  • AI quality governance