Senior Hpc and Lsf Operations Engineer

NVIDIA NVIDIA · Semiconductors · Santa Clara, CA +3

This role focuses on operating, scaling, and optimizing job scheduling systems (LSF, Slurm) in a large-scale HPC environment to improve design velocity and infrastructure efficiency. It involves analyzing performance, leading problem-solving, implementing automation, defining metrics, and collaborating with customer teams.

What you'd actually do

  1. Manage, scale, and optimize job scheduling systems (LSF, Slurm, etc.) in a large-scale, multi-site environment supporting EDA and other compute-intensive workloads
  2. Analyze scheduler and infrastructure performance data to identify systemic bottlenecks and drive measurable improvements in utilization, throughput, and turnaround time
  3. Lead problem solving across scheduler, OS, and workload layers, ensuring timely resolution of service-impacting issues
  4. Identify recurring operational challenges and implement targeted automation or process improvements to reduce manual effort and prevent repeat incidents
  5. Help define and track reliable metrics and SLOs for service performance and reliability, partnering with customers to ensure expectations are realistic and measurable

Skills

Required

  • Bachelor’s degree in Computer Science or related field, or equivalent experience
  • Minimum 5+ years of experience operating and supporting large-scale Linux-based compute infrastructure
  • Strong hands-on experience supporting and tuning job scheduling systems (LSF, Slurm, etc.) in HPC or silicon design environments
  • Proficiency in Linux systems administration (CentOS/RHEL)
  • Strong problem solving skills and the ability to independently analyze complex system behavior under load
  • Clear and effective communication skills, including the ability to articulate technical tradeoffs and reliability metrics to engineering stakeholders

Nice to have

  • Experience implementing reliability engineering practices within HPC scheduling environments
  • Deep knowledge of job scheduling systems (LSF, Slurm, etc.) configuration tuning, scheduler internals, and advanced troubleshooting techniques
  • Experience building or enhancing observability systems, including metrics collection, monitoring pipelines, alerting strategies, and performance dashboards
  • Background with container technologies such as Docker, Singularity, or Podman in HPC environments
  • Experience influencing adoption of new infrastructure standards across multiple teams or sites

What the JD emphasized

  • Minimum 5+ years of experience operating and supporting large-scale Linux-based compute infrastructure
  • Strong hands-on experience supporting and tuning job scheduling systems (LSF, Slurm, etc.) in HPC or silicon design environments