Technical Product Manager - AI Infra Resilience
Company websitenvidia.com (NVIDIA, opens in new tab)
Base salary $195K – $442K
Employer-published annual base salary, USD. Advertised base range in Santa Clara, CA +2 more
You apply on the employer's own site. Six Figure Work does not handle applications.
- LocationSanta Clara, CA +2 more
- WorkplaceWorkplace not stated
- Status at last checkSource accepting applications when checked
- Last checked (5 h ago) · observed since
All places named
- Santa Clara, CA
- New York, NY
- Seattle, WA
About this job
GPU clusters fail. Workloads crash at 3am, AI teams file tickets pointing at hardware, hardware teams point back at software, and the actual cause stays unknown until someone with deep enough context digs through DCGM metrics, XID history, and NCCL traces. That forensics work shouldn't fall to a human on-call every time. We're building the platform that automates it, and we need a PM who has been that on-call engineer.
We're hiring a Senior Product Manager to own workload failure attribution: how a GPU cluster figures out whether a failed job was caused by hardware, system software, or application code, and how that verdict gets surfaced to operators, schedulers, and the open source developer surface built on top of it. You will own the roadmap and work directly with the engineering and operations communities who deploy and extend this platform. This role is part of NVIDIA's DSX Platform, NVIDIA's open, modular infrastructure software for designing, operating, and optimizing AI factories at scale. No prior product management title required. If you are a deeply technical product manager, architect, SRE, or infra engineer who has lived the GPU cluster failure-triage problem, we want to hear from you.
What You'll Be Doing:
- Drive the product vision, roadmap, and delivery for workload failure attribution, in close collaboration with engineering on architecture and prioritization.
- Identify gaps in how customers and partners triage GPU cluster failures at scale and define new attribution capabilities to close them, including how an NCCL timeout gets attributed to hardware, system software, or application, and which signals belong in a public API vs. an entitled runtime extension.
- Work directly with cloud partners and cluster operators to translate their operational triage requirements into platform capabilities.
- Drive community engagement strategy for the open source attribution project, including contribution models, ecosystem partnerships, and developer adoption.
What We Need To See:
- 12+ years total experience.
- 5+ years in product management, solutions architecture, software engineering, or site reliability engineering on technical infrastructure products. Technical depth on GPU or AI infra is required.
- Familiarity with GPU failure modes: XID codes, ECC correctable and uncorrectable errors, DCGM metrics, NVLink and PCIe health signals.
- Technical understanding of why AI workloads fail: GPU hardware failure modes, distributed training failure patterns (NCCL timeouts, framework errors, hardware vs. system software vs. application fault distinction), and the telemetry systems (DCGM, sysfs, dmesg) that surface these signals.
- Demonstrated ability to work with senior technical customers and translate operational requirements into product decisions.
- Strong written and verbal communication across technical and non-technical audiences.
- Bachelor's degree in Computer Science or equivalent experience.
Ways To Stand Out From The Crowd:
- Former SRE or infra engineer on GPU clusters. You have triaged job failures, parsed XID logs, and understand the cross-team deep dives that happen when a multi-thousand-GPU training run fails.
- Deep familiarity with GPU scheduling, topology-aware placement, or multi-tenant GPU cluster management: Slurm prolog/epilog, Kueue, or Kubernetes-native scheduler environments.
- Experience building products that produce structured diagnostics or attribution output: health verdict schemas, log analysis pipelines, rules-engine systems, or observability APIs at data center scale.
- Practical experience delivering or contributing to an open-source infrastructure project, including managing contributor engagement on GitHub.
NVIDIA is widely considered one of the technology world’s most desirable employers. We have some of the world's most forward-thinking and hardworking people on our team. If you're creative and autonomous, we want to hear from you!
#LI-Hybrid
Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:195,000 USD – 377,000 USD for Level 5; and 232,500 USD – 442,000 USD for Level 6.
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until November 24, 2026.This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.Source: NVIDIA on Workday · View original posting (opens in new tab)
How this pay compares
Base floor $195,000, above 64% of the 907 Product roles in California on this site. The employer's range is $247,000 wide, 127% of the floor. First observed today.
Pay in context
Among 907 Product roles in California listed on this site, the median base floor is $179,000 and the middle half runs from $151,250 to $206,900. This role's floor ($195,000) is above 64% of them; 5 others list the same floor.
Base floors of 907 Product roles in California
Table
| Floor band | Share | Postings |
|---|---|---|
| $100K to $125K | 7.3% | 66 |
| $125K to $150K | 14.1% | 128 |
| $150K to $175K | 23.4% | 212 |
| $175K to $200K | 22.3% | 202 |
| $200K to $225K | 17.0% | 154 |
| $225K to $250K | 8.6% | 78 |
| $250K to $275K | 3.4% | 31 |
| $275K and up | 4.0% | 36 |
How this is calculated
- Statistic
- Base floor distribution of the cohort
- Formula
- count of cohort postings in each $25K band of published base floor / postings in the cohort
- Denominator
- 907 open postings with this job family in California
- Sample size
- 907
- Hidden when
- the cohort has fewer than 30 postings
- Calculation version
- jobpage-analysis-v1
- Data as of
- 2026-11-20
- Employer set
- Open jobs on this site that publish a base salary of $100,000 or more
Only jobs on this site count, and each one publishes a base salary of $100,000 or more, so this compares six-figure jobs with each other, not with the whole market. Computed Nov 20, 2026.
State against nationwide
Median base floor in California vs nationwide
Table
| Value | postings | |
|---|---|---|
| Product, California | $179K | 907 |
| Product, all states | $163K | 3,035 |
| This job's base floor (marked) | $195K |
How this is calculated
- Statistic
- Median floor, state vs nationwide
- Formula
- median published base floor of each cohort
- Denominator
- open postings of this job family
- Sample size
- 907 in California; 3035 nationwide
- Hidden when
- either cohort has fewer than 30 postings
- Calculation version
- jobpage-analysis-v1
- Data as of
- 2026-11-20
- Employer set
- Open jobs on this site that publish a base salary of $100,000 or more
How NVIDIA pays
315 of NVIDIA's 1,160 live roles on this site list a higher base floor and 843 list a lower one. Across them the median floor is $184,000; the middle half runs from $152,000 to $200,000.
Base floors of NVIDIA's 1,160 live roles
Table
| Floor band | Share | Roles |
|---|---|---|
| $100K to $125K | 7.3% | 85 |
| $125K to $150K | 13.6% | 158 |
| $150K to $175K | 26.6% | 309 |
| $175K to $200K | 26.5% | 307 |
| $200K to $225K | 13.6% | 158 |
| $225K to $250K | 3.8% | 44 |
| $250K to $275K | 6.1% | 71 |
| $275K and up | 2.4% | 28 |
How this is calculated
- Statistic
- Employer base floor distribution
- Formula
- count of the employer's open roles in each $25K band of published base floor / its open roles
- Denominator
- 1,160 open public roles at this employer
- Sample size
- 1160
- Hidden when
- this employer has fewer than 5 roles
- Calculation version
- jobpage-analysis-v1
- Data as of
- current
- Employer set
- Open jobs on this site that publish a base salary of $100,000 or more
Similar pay elsewhere
Other employers' Product roles in California with the nearest published base floor to $195,000, one per employer.
- Staff Product Manager, Ads Measurement Snap Inc. (Snapchat) · base floor $195,000
- Product Manager - Integration & Ecosystem Atoms · base floor $195,000
- Product Manager, Activation Anrok · base floor $195,000
- Sr Product Owner Workday · base floor $194,834
- Product Manager Cohesity · base floor $194,400
This listingTechnical Product Manager - AI Infra Resilience$195K – $442K
Manager, System Level Test Engineering$195,000 – $435,500
Senior Mixed Signal Design Engineer$196K – $368K
Senior System Integration Engineer, Memory$196,000 – $310,500
Senior FPGA Prototyping Engineer - Hardware$196K – $368K
Senior ASIC Floorplan Design Engineer$196,000 – $310,500
Senior Manager, PR - AI Software$196,000 – $310,500
Chart as a table
| Role | Published base |
|---|---|
| Technical Product Manager - AI Infra Resilience (this listing) | $195K - $442K |
| Manager, System Level Test Engineering | $195,000 - $435,500 |
| Senior Mixed Signal Design Engineer | $196K - $368K |
| Senior System Integration Engineer, Memory | $196,000 - $310,500 |
| Senior FPGA Prototyping Engineer - Hardware | $196K - $368K |
| Senior ASIC Floorplan Design Engineer | $196,000 - $310,500 |
| Senior Manager, PR - AI Software | $196,000 - $310,500 |
Observed changes
No changes to the pay or listing since we first observed this role on Nov 20, 2026 (today).
- First observed on the employer's board, already publishing a qualifying base salary
- Observed since
- Employer-stated posting date
- 2026-11-20
Where this pay comes from
Location as the employer wrote it: US, CA, Santa Clara • US, NY, New York • US, WA, Seattle (Levels 5-6 combined)
195,000 USD – 377,000 USD for Level 5; and 232,500 USD – 442,000 USD for Level 6.
- Method
- Employer text, read with fixed rules and re-verified
- Checked
- Rule set
- us-base-v2
The pay passage appears in the employer's own job text. Fixed, deterministic rules located it, and the passage below was checked against the stored copy of the posting.
What we verified
- The pay figures come from the employer's own listing, quoted exactly above.
- The pay is an annual base salary in US dollars with a minimum of at least $100,000.
- The role was publicly listed on the employer's job board when last checked.
We do not verify what the employer will actually offer, whether the employer is still recruiting for the role, or anything beyond what the employer published. Full methodology.
