Software Engineer

DocuSign DocuSign · Enterprise · San Francisco, CA +2 · Engineering

Software Engineer on the AI Platform team responsible for architecting and building robust distributed systems and backend infrastructure for global AI capabilities, focusing on document processing, model serving, and data orchestration. The role involves developing scalable platforms for autonomous agents, retrieval systems, and model optimization, bridging AI research and production engineering.

What you'd actually do

  1. Build and maintain high-performance distributed systems to support large-scale model inference and data processing
  2. Design and build resilient, horizontally scalable backend services capable of handling high-throughput data processing and model interaction
  3. Develop the core infrastructure for model serving and inference runtimes, focusing on maximizing resource utilization and minimizing latency
  4. Architect resilient data ingestion and processing pipelines that handle massive datasets while ensuring data integrity, multi-tenant isolation, and high availability
  5. Optimize system performance, identify bottlenecks, and implement advanced monitoring (SLOs, SLAs) to ensure high reliability for mission-critical AI services

Skills

Required

  • distributed systems
  • scalable backend architecture
  • Python
  • strongly-typed language (e.g., Java, Go, or C#)
  • container orchestration (e.g., Kubernetes)
  • messaging systems (e.g., Kafka, Service Bus)
  • high-performance database design
  • massive scale production systems
  • strict uptime and latency requirements

Nice to have

  • stateful workflow engines
  • distributed task queues (e.g., Temporal)
  • Ray
  • Spark
  • Azure or GCP infrastructure
  • LLM orchestration
  • RAG architectures
  • specialized prompt configuration layers

What the JD emphasized

  • 5+ years of software engineering experience with a primary focus on distributed systems and scalable backend architecture
  • Experience building, deploying, and maintaining ML models in high-traffic, production environments
  • strict uptime and latency requirements
  • massive scale

Other signals

  • building scalable platforms for autonomous agents
  • developing scalable platforms for advanced retrieval systems
  • automated model optimization
  • model serving and inference runtimes