Staff Engineer, Data Services

Weights & Biases Weights & Biases · Data AI · Bellevue, WA +1 · Technology

Staff Engineer specializing in database and stream processing to manage and develop CoreWeave's data infrastructure, including managed databases, data ingestion, data flow, and data lakes. The role involves driving technical decisions, championing event-driven architecture, designing and implementing data platforms, developing stream processing architecture, and ensuring scalability, reliability, and security. The engineer will also establish guidelines for data access and storage, ensure compliance with data protection regulations, and contribute to the company's global datastore strategy.

What you'd actually do

  1. Drive technical decision-making to accelerate delivery, mentor engineers, and grow team capability.
  2. Champion event-driven architecture adoption and build consensus across the organization.
  3. Participate in the company's data infra strategy planning and initiatives.
  4. Design and implement the platform to deliver data to teams with a focus on providing managed solutions through APIs.
  5. Develop a stream processing architecture and solve for scalability and reliability.

Skills

Required

  • 12+ years of software engineering experience
  • Understand CAP theorem and concurrency models
  • Define data models
  • Establish guidelines around data management
  • Experience with distributed NewSQL datastores (CockroachDB, TiDB, YDB, Yugabyte)
  • Experience with stream processing tools (NATS, Kafka)
  • Designing and operating systems at scale
  • API designs and microservices
  • Kubernetes
  • Linux internals
  • Production level proficiency in Go

Nice to have

  • Interest or experience with using Kubernetes for event-driven and/or stateful orchestration
  • Excited to have the opportunity to contribute to a Kubernetes operator in order to manage data systems
  • Interest in contributing to open source

What the JD emphasized

  • Ensure compliance with standards for data protection regulation.