ML Software Engineer

Apple Apple · Big Tech · Seattle, WA +2 · Software and Services

ML Software Engineer at Apple to build and improve ML-inference applications and services on Apple Silicon in the datacenter, focusing on generative AI for Private Cloud Compute. The role involves engineering continuous improvements in stability and performance, implementing new functionality, and writing performant, scalable frameworks in Swift and C++ for ML inference tasks. The engineer will integrate inference code into a full service stack, ensuring reliable and performant serving of user traffic, with a focus on developing code that is easy, safe to develop, update, and monitor.

What you'd actually do

  1. engineer continuous improvements in stability and performance for private cloud compute
  2. implement entirely new functionality as it emerges from the research community, in collaboration with product teams throughout Apple
  3. write performant and scalable frameworks (in Swift and C++) to distribute and coordinate ML inference tasks to different hardware acceleration IP blocks on different SoCs
  4. integrate inference code into a full service stack to ensure that user traffic is served reliably and performantly
  5. develop code that is easy and safe to develop, update and monitor

Skills

Required

  • Experience working as a software engineer on large production systems
  • Experience programming in: Swift, C, C++, iOS/macOS or Xcode
  • Practical experience running machine learning models and evaluating them for quality and performance metrics

Nice to have

  • Familiar with Apple ML stack (ANE, CoreML, MPS/Metal)
  • High-level general distributed ML stack (PyTorch-distributed, NCCL) and high throughput inter-chip communication systems
  • On-device iOS development

What the JD emphasized

  • large production systems
  • running machine learning models and evaluating them for quality and performance metrics

Other signals

  • Apple Intelligence
  • Private Cloud Compute
  • generative AI
  • ML inference applications and services
  • Apple Silicon
  • datacenter