Software Engineer- Metadata Storage

ByteDance ByteDance · Big Tech · San Jose, CA · R&D

Software Engineer role focused on designing, developing, and operating ultra-performance metadata services, including distributed coordination, locking, key-value storage, and service discovery. The role also involves developing deployment solutions and providing metadata solutions for various business areas, including AI. Requires strong C/C++ skills and deep understanding of consensus protocols like Raft and Paxos, with experience in large-scale distributed systems.

What you'd actually do

  1. Responsible for designing, developing, and operating ultra-performance metadata services, delivering key features including distributed coordination, distributed locking, metadata key-value storage, service discovery etc.
  2. Responsible for developing automated and disaster-tolerance deployment solutions in both virtualized and bare-metal environments.
  3. Responsible for providing metadata solutions for teams in the technical infrastructure areas (compute, storage, databases, etc.) and upper-layer business areas (advertising, payments, AI, etc.); driving cross-team collaborations for system architecture design and optimization for various business use cases.

Skills

Required

  • C/C++
  • Raft
  • Paxos
  • ZAB
  • large scale distributed systems

Nice to have

  • Go
  • Java
  • Rust
  • ZooKeeper
  • Etcd
  • Kubernetes
  • NVMe
  • SPDK/DPDK
  • TCP/UDP
  • RDMA