Senior Software Engineer, AI Infrastructure - Developer Tooling

ByteDance ByteDance · Big Tech · San Jose, CA · R&D

Senior Software Engineer to build AI-powered developer tools, focusing on retrieval infrastructure (RAG), a coding agent with multi-step generation and tool use, and evaluation frameworks for measuring effectiveness. Requires strong Python/TypeScript, systems-level language experience, and practical LLM integration.

What you'd actually do

  1. Design and scale retrieval pipelines including vector search, BM25, and hybrid retrieval strategies
  2. Build agent architectures that support multi-step code generation, refactoring, debugging, and diagnostics
  3. Design and maintain evaluation frameworks for retrieval quality and agent task completion

Skills

Required

  • Python
  • TypeScript/JavaScript
  • C++/Rust/Go
  • integrating LLMs into applications
  • prompt engineering
  • context management
  • output parsing
  • agent patterns
  • tool use
  • multi-turn reasoning
  • error recovery
  • code-specific LLM tasks

Nice to have

  • Contributions to open-source developer tooling, retrieval systems, or coding assistants
  • AST parsing
  • code analysis tools
  • language servers
  • rendering pipelines
  • cross-platform framework architecture
  • deploying and optimizing ML models in production
  • latency
  • cost
  • reliability

What the JD emphasized

  • production scale
  • multi-step code generation
  • multi-turn reasoning
  • error recovery
  • code-specific LLM tasks
  • deploying and optimizing ML models in production

Other signals

  • building agent architectures
  • design and scale retrieval pipelines
  • design and maintain evaluation frameworks