Backend Engineer- Inference Services

Deepgram Deepgram · AI Frontier · United States · Remote · Engineering

Backend Software Engineer to join the Engine team to lead the design and implementation of Deepgram’s products. You will design and implement secure, robust, and scalable services for speech processing; efficient, distributed compute orchestration; optimized scheduling, and more. Improve Deepgram’s core inference services including areas in networking, speech processing, audio transcoding, and latency and memory optimization.

What you'd actually do

  1. Improve Deepgram’s core inference services including areas in networking, speech processing, audio transcoding, and latency and memory optimization
  2. Develop processes for measuring, building, and optimizing services to maximize system performance
  3. Debug complex system issues that include networking, scheduling, and high performance computing interactions
  4. Rapidly customize backend services to support our customer needs
  5. Partner with Product to design and implement new services, features, and/or products end to end

Skills

Required

  • 3+ years of experience in an industry role
  • Programming experience in Rust (or C, C++)
  • competence in Python
  • Excellent communication and organizational skills, both written and verbal
  • A high level of experience and understanding of version control; preferably git
  • Comprehensive experience with UNIX-style systems

Nice to have

  • Experience with modern machine learning, such as experience with a framework like Torch or implementation knowledge of architectures like CNNs, RNNS, and transformers
  • Experience with audio processing

What the JD emphasized

  • core inference services
  • speech processing
  • latency and memory optimization
  • high performance computing

Other signals

  • real-time APIs for speech-to-text
  • building production-grade voice agents at scale
  • unmatched accuracy, low latency, and cost efficiency
  • processed over 50,000 years of audio and transcribed more than 1 trillion words