Senior Manager, Data Infrastructure Services

Weights & Biases Weights & Biases · Data AI · Bellevue, WA +1 · Technology

This role is for a Senior Manager of Data Infrastructure Services at CoreWeave, a cloud provider focused on AI. The manager will lead a team responsible for data infrastructures including managed databases, data ingestion, data flow, data lakes, and analytics. The role involves building and developing the engineering team, designing and implementing data services, improving performance and reliability, establishing data access guidelines, ensuring compliance with data protection regulations, and analyzing system data for improvements. The ideal candidate has experience managing data service infra teams, expertise in open table formats (Iceberg, DeltaLake, Hudi), and knowledge of production operations, reliability engineering, and data governance.

What you'd actually do

  1. Build a world class engineering team by hiring and developing the best talent in the industry.
  2. Have curiosity and hunger to solve very hard system level problems in order to run the world's most demanding and advanced AI workloads.
  3. Design and implement services to deliver data to teams with a focus on providing managed solutions through APIs
  4. Improve the performance, security, reliability, and scalability of our data services.
  5. Establish guidelines, guard rails for data access and storage for stakeholder teams.

Skills

Required

  • 5+ years of experience managing or leading data service infra teams
  • 5+ years of hands-on software or infrastructure engineering
  • Expert on open table format such as Iceberg, DeltaLake or Hudi
  • Experience with authentication, authorization, key management, data governance and lineage
  • experience operating services in production and at scale
  • versed in reliability engineering concepts
  • understand CAP theorem and concurrency models
  • clearly define data models and establish guidelines around data management
  • familiar with Kubernetes
  • transform problems in elastic solutions, decompose them into achievable tasks, and socialize both to your teammates
  • Proven ability to attract, retain, and grow world-class engineering talent
  • Excellent communication skills

Nice to have

  • interest or comfortable with using Kubernetes for event-driven and/or stateful orchestration
  • excited about new research in data structures

What the JD emphasized

  • Ensure compliance with standards for data protection regulation.
  • Expert on open table format such as Iceberg, DeltaLake or Hudi.
  • operating services in production and at scale
  • reliability engineering concepts