Software Engineer - Data Infrastructure Services

Weights & Biases Weights & Biases · Data AI · Bellevue, WA +1 · Technology

Software Engineer focused on data infrastructure services, including managed databases, data ingestion, data flow, and data lake/retrieval. The role involves designing and implementing data platforms, ensuring performance, security, reliability, and scalability, and establishing guidelines for data access and storage. Experience with Kubernetes, Linux, Go/Python, and reliability engineering concepts is desired.

What you'd actually do

  1. Design and implement the platform to deliver data to teams with a focus on providing managed solutions through APIs
  2. Participate in operations and scaling of relational data platforms.
  3. Improve the performance, security, reliability, and scalability of our data platforms, and related services and participate in the teams on-call rotation.
  4. Establish guidelines, guard rails for data access and storage for stakeholder teams.
  5. Ensure compliance with standards for data protection regulation.

Skills

Required

  • database and stream processing
  • API design
  • relational data platforms
  • performance, security, reliability, and scalability
  • on-call rotation
  • data access and storage guidelines
  • data protection regulation compliance
  • Kubernetes
  • Linux
  • shell scripting
  • Linux storage and networking stacks
  • Go/Python

Nice to have

  • experience operating services in production and at scale
  • reliability engineering concepts
  • CAP theorem
  • concurrency models
  • data models
  • data management guidelines
  • new research in data structures
  • event-driven and/or stateful orchestration
  • Kubernetes operator
  • open source contribution

What the JD emphasized

  • compliance with standards for data protection regulation