Software Engineer - AI Agent Infra

ByteDance ByteDance · Big Tech · San Jose, CA · R&D

Software Engineer focused on building the AI Agent infrastructure and product platform for the Security organization, enabling rapid development and scaling of AI Agents for real-world security use cases. The role involves working on agent runtime, tool ecosystems, workflow orchestration, RAG, evaluation pipelines, and backend services, with a focus on security, control, auditability, and scalability.

What you'd actually do

  1. Build the foundational AI Agent infrastructure for the Security organization, including agent runtime/frameworks, tool and plugin ecosystems, workflow orchestration, memory and knowledge/RAG systems, evaluation pipelines, observability, and cost governance.
  2. Design and develop the platform capabilities that enable multiple business teams to build and operate AI Agents efficiently, with strong guarantees around access control, auditing, isolation, governance, and reliability.
  3. Drive the implementation and iteration of AI Agent products and solutions for security scenarios, such as security operations assistance, investigation and triage, risk analysis, policy understanding and generation, automated Q&A, and intelligent workflow automation.
  4. Build robust backend services and APIs that support the full lifecycle of AI Agent applications, including integration with internal tools, data systems, and business workflows.
  5. Improve the quality and production readiness of AI applications through systematic work on evaluation, online experimentation, canary release, monitoring, fallback mechanisms, and performance optimization.

Skills

Required

  • Go, Java, Python, C, C++, C#, or JavaScript
  • backend engineering skills
  • computer science fundamentals
  • data structures
  • algorithms
  • operating systems
  • networking
  • databases
  • system design
  • distributed systems
  • service architecture
  • caching
  • messaging
  • high-availability backend services
  • problem-solving
  • execution skills
  • collaboration

Nice to have

  • AI Agent systems
  • LLM applications
  • RAG
  • tool use
  • workflow orchestration
  • AI application infrastructure
  • productionizing AI/ML applications
  • evaluation
  • prompt/system optimization
  • online quality improvement
  • reliability engineering
  • applying advanced AI technologies to high-impact security and enterprise scenarios

What the JD emphasized

  • AI Agent infrastructure
  • AI Agent systems
  • productionizing AI/ML applications

Other signals

  • AI Agent infrastructure
  • LLM applications
  • security use cases
  • production-ready capabilities