Senior Software Engineer, Machine Learning Services

UiPath UiPath · Enterprise · London, United Kingdom · Engineering

Senior Software Engineer to build and operate the core Machine Learning Services (MLS) platform at UiPath, focusing on distributed systems, high-throughput model serving, and asynchronous training workflows. The role involves designing and implementing Rust-based API gateways, Python ML compute workers, and a custom job queue, with a focus on performance, concurrency, and scalability for large-scale AI and Document Understanding products.

What you'd actually do

  1. Design, build, and operate the core MLS platform. This includes our Rust-based API gateway, Python ML compute workers, and the distributed job queue that orchestrates it all.
  2. Solve hard concurrency, performance, and distributed systems problems to ensure our platform is bulletproof for high-volume production workloads.
  3. Work directly with product and ML science teams to understand their needs and build the scalable infrastructure required to bring their models to life—from massive GenAI models to fine-tuned, specialized classifiers.
  4. Develop our custom-built, content-addressable storage abstraction layer over cloud object stores (GCS, S3, Azure Blob), complete with its own garbage collection and sharding logic.
  5. Enhance our asynchronous job-queueing system, built from the ground up on the storage layer using compare-and-swap primitives for atomicity. No off-the-shelf message broker could handle our specific needs.

Skills

Required

  • 5+ years of engineering and architecting large-scale, distributed commercial services
  • Deep proficiency in a systems-level language (Rust, C++, Go)
  • Strong Python skills
  • Real-world experience with cloud ecosystems (Azure, AWS, or GCP)
  • Experience with containerization (Docker, Kubernetes)
  • Firm grasp of concurrency, multithreading, and asynchronous programming
  • Pragmatic understanding of computer science fundamentals

Nice to have

  • Worked with Rust in a production environment
  • Experience with MLOps
  • Familiarity with building ML inference services
  • Model serialization (e.g., ONNX)
  • GPU programming (CUDA)
  • Built or worked on custom storage or job-queueing systems

What the JD emphasized

  • core platform
  • distributed systems
  • high-throughput model serving
  • asynchronous training workflows
  • Rust
  • Python
  • Kubernetes
  • gRPC
  • ONNX
  • GPU-accelerated hardware

Other signals

  • ML platform
  • model serving
  • training workflows
  • distributed systems