Tech Lead - Software Engineer- Metadata Storage

ByteDance ByteDance · Big Tech · San Jose, CA · R&D

Software Engineer role focused on designing, developing, and operating high-performance metadata storage services, distributed coordination, and key-value storage solutions. The role involves building automated deployment solutions and providing metadata services to various business and infrastructure teams, including those in AI.

What you'd actually do

  1. Responsible for designing, developing, and operating ultra-performance metadata services, delivering key features including distributed coordination, distributed locking, metadata key-value storage, service discovery etc.
  2. Responsible for developing automated and disaster-tolerance deployment solutions in both virtualized and bare-metal environments.
  3. Responsible for providing metadata solutions for teams in the technical infrastructure areas (compute, storage, databases, etc.) and upper-layer business areas (advertising, payments, AI, etc.); driving cross-team collaborations for system architecture design and optimization for various business use cases.

Skills

Required

  • Bachelors or above degree in Computer Science or Equivalent
  • Strong coding skills in C/C++
  • Deep understanding of consensus protocols including Raft, Paxos, ZAB etc.
  • Hands-on experience with large scale distributed systems
  • capability of trouble-shooting and performance tuning

Nice to have

  • Proficiency in Go, Java or Rust
  • Experience of maintaining and contributing to open source projects including ZooKeeper, Etcd etc.
  • Experience with compute / storage / network tech stacks, including Kubernetes, NVMe, SPDK/DPDK, TCP/UDP, RDMA

What the JD emphasized

  • ultra-performance metadata services
  • distributed coordination
  • distributed locking
  • metadata key-value storage
  • service discovery
  • automated and disaster-tolerance deployment solutions
  • large scale distributed systems
  • trouble-shooting and performance tuning