Senior Software Engineer, AI Infrastructure - Developer Tooling

ByteDance ByteDance · Big Tech · Seattle, WA · R&D

Senior Software Engineer to build AI-powered developer tools, focusing on retrieval infrastructure (RAG), a coding agent with multi-step capabilities and tool use, and evaluation frameworks for quality measurement. Requires strong Python/TypeScript, systems programming, and practical LLM integration experience.

What you'd actually do

  1. Design and scale retrieval pipelines including vector search, BM25, and hybrid retrieval strategies
  2. Build agent architectures that support multi-step code generation, refactoring, debugging, and diagnostics
  3. Design and maintain evaluation frameworks for retrieval quality and agent task completion

Skills

Required

  • Python
  • TypeScript
  • JavaScript
  • C++
  • Rust
  • Go
  • LLM integration
  • prompt engineering
  • context management
  • output parsing
  • agent patterns
  • tool use
  • multi-turn reasoning
  • error recovery

Nice to have

  • Master's or Ph.D.
  • open-source contributions
  • retrieval systems
  • coding assistants
  • AST parsing
  • code analysis tools
  • language servers
  • rendering pipelines
  • cross-platform framework architecture
  • deploying and optimizing ML models
  • latency
  • cost
  • reliability

What the JD emphasized

  • production scale
  • multi-step code generation
  • multi-turn reasoning
  • error recovery
  • code-specific LLM tasks

Other signals

  • AI-powered backbone of developer tools
  • coding agent that assists users in writing code
  • evaluation frameworks that measure their effectiveness