Machine Learning Test and Automation Engineer, Graphics, Games, and ML

Apple Apple · Big Tech · Cupertino, CA · Software and Services

The Machine Learning Test and Automation Engineer will design and build scalable test solutions for validating on-device and distributed Apple Intelligence inference, focusing on correctness, reliability, and performance of the inference runtime software. This role involves developing functional and performance tests within a CI/CD pipeline, partnering with ML engineering and infrastructure teams.

What you'd actually do

  1. Build scalable test solutions for validating ML-based inferences on Apple's hardware
  2. Design and maintain CI/CD pipelines to accelerate presubmissions and improve integration speed
  3. Help define and enforce best practices for automated testing within a high-velocity ML development lifecycle
  4. Partner closely with cross-functional teams, including ML engineering, infrastructure, and Apple Services Engineering Team to identify gaps in coverage and streamline testing strategies

Skills

Required

  • Swift or Python
  • XCTests/Xcode
  • building scalable automated test frameworks
  • integrating them into CI/CD pipelines
  • Software Quality Assurance

Nice to have

  • PyTorch
  • complete model development lifecycle
  • data preprocessing
  • model training
  • evaluation
  • deployment
  • monitoring

What the JD emphasized

  • validate both on-device and distributed Apple Intelligence inference
  • ensuring the correctness, reliability, and performance of our inference runtime software
  • develop functional and performance tests that push our systems to their limits

Other signals

  • validating on-device and distributed Apple Intelligence inference
  • ensuring correctness, reliability, and performance of inference runtime software
  • develop functional and performance tests for ML-based experiences