Principal Site Reliability Engineer - Observability and Telemetry Platform

NVIDIA NVIDIA · Semiconductors · Santa Clara, CA +1 · Remote

Principal Site Reliability Engineer focused on designing, implementing, and supporting a large-scale Observability & Telemetry platform. The role involves ensuring high availability, performance, and reliability of internal and external GPU cloud services through automation, system design, and incident response. Requires extensive experience in infrastructure automation, distributed systems, and observability tools.

What you'd actually do

  1. Design, implement and support operational and reliability aspects of large scale Observability & Telemetry collection platform with a focus on performance at scale, real time monitoring, logging and alerting
  2. Engage in and improve the whole lifecycle of services—from inception and design through deployment, operation and refinement
  3. Support services before they go live through activities such as system design consulting, developing software tools, platforms and frameworks, capacity management and launch reviews
  4. Maintain services once they are live by measuring and monitoring availability, latency and overall system health
  5. Scale systems sustainably through mechanisms like automation, and evolve systems by pushing for changes that improve reliability and velocity

Skills

Required

  • Infrastructure automation
  • distributed systems design
  • design, develop tools for running large scale private or public cloud system in Production
  • foundational infrastructure and observability platforms
  • Python
  • Go
  • Perl
  • Ruby
  • Linux
  • Networking
  • Containers

Nice to have

  • Kubernetes
  • OpenStack
  • Grafana
  • OpenTelemetry
  • Prometheus
  • debugging
  • performance tuning
  • automation

What the JD emphasized

  • 15+ years of experience with Infrastructure automation, distributed systems design, experience with design, develop tools for running large scale private or public cloud system in Production
  • 8+ years experience delivering foundational infrastructure and observability platforms.