Staff Product Manager, GPU Infrastructure
Company websitenscale.com (Nscale, opens in new tab)
Base salary $220K – $260K
Employer-published annual base salary, USD. Advertised base range in New York, NY
You apply on the employer's own site. Six Figure Work does not handle applications.
- LocationNew York, NY
- WorkplaceWorkplace not stated
- Status at last checkSource accepting applications when checked
- Last checked (5 h ago) · observed since
About this job
About Nscale
Nscale is taking on the hyperscalers by building a vertically integrated GenAI cloud platform. We own the data centres, software, and applications that power today's AI stack using sustainable technology solutions. We thrive on a culture of relentless innovation, ownership, and accountability, where every team member takes pride in their work and drives it with excellence and urgency. As an Nscaler, you'll build trust through openness and transparency, where everyone is inspired to do their best work. Collaboration is key, and we work together swiftly and respectfully, embracing adaptability and resilience in all we do.
About the role
Technical Product Managers at Nscale own the definition, delivery, and ongoing evolution of a slice of the Nscale platform. You partner closely with engineering, design, research, and go-to-market teams to translate customer problems and operational realities into shippable product outcomes. As a Senior Technical Product Manager for Fleet Operations, you own the product strategy for the day 0–2+ operational software that runs our global GPU fleet — the systems that bring capacity online, keep it healthy, and restore it fast when things go wrong. You partner daily with Fleet Software engineering teams, SRE, and Support to turn operational pain into durable product: provisioning and bringup (day 0), testing and deployment (day 1), and the full lifecycle of monitoring, incident response, repair, RMA, firmware, and decommissioning (day 2+). You operate at team scope, owning a major product area and driving multi-quarter initiatives that directly move fleet availability, utilisation, and time-to-recover. Senior Technical Product Manager, Fleet Operations 1
What you'll be doing
- Own the strategy and roadmap for a significant Fleet Operations product area — e.g. provisioning and bring-up, fleet health and telemetry, incident and repair workflows, firmware and lifecycle management, or capacity and inventory.
- Lead multi-sprint, cross-functional initiatives from problem framing through rollout across live GPU clusters, working hand-in-hand with Fleet Software, SRE, data centre operations, and Support.
- Turn operational ambiguity into product: shadow on-call rotations, ride along with support and repair workflows, and translate recurring toil into tooling, automation, and platform capabilities.
- Define the metrics that matter for a GPU fleet — availability, utilisation, MTTR, time-to-bring-up, hardware failure rates, support ticket deflection — and drive the roadmap against them.
- Partner with engineering on architecture and trade-offs for systems that span bare metal, orchestration, observability, and control planes.
- Drive incident reviews and postmortems into product commitments; close the loop so the same class of issue doesn't recur.
- Mentor junior product managers and raise the quality bar for PRDs, reviews, and product decisions across the team.
- Represent Fleet Operations in planning, reviews, and leadership updates.
What you need
- 5–8 years of product management experience in software or technology, with a track record of owning significant product areas in infrastructure, platform, or operations-facing products.
- Strong technical fluency in large-scale systems: you can lead discussions with engineering on architecture, trade-offs, and feasibility across provisioning, orchestration, observability, and control-plane design
- Experience building products for operators — SREs, NOC/support teams, data centre technicians, or similar — and a genuine appetite for understanding their workflows.
- Demonstrated ability to move from an ambiguous operational problem space to shipped product outcomes that measurably improve reliability, efficiency, or time-to-recover.
- Experience mentoring or informally leading peers. Excellent written and verbal communication; you can make complex product decisions legible to engineers, operators, and executives alike.
- Experience with data centre networking technologies, including high-performance GPU interconnects such as InfiniBand and RoCE (RDMA over Converged Ethernet), and an understanding of how backend (east–west/compute) and frontend (north–south/storage and management) network fabrics are designed and operated at scale.
- Familiarity with WAN, edge, and global backbone architectures — including how multi-site connectivity, peering, and traffic engineering support a globally distributed GPU fleet.
- Experience partnering with network engineering teams on fabric health, congestion monitoring, and link-level failure workflows, ideally in environments where network performance directly impacts training or inference workloads.
Nice to haves
- Degree in computer science, engineering, or a related field, or prior experience as an engineer or SRE.
- Hands-on background in cloud infrastructure, bare-metal provisioning, fleet or hardware lifecycle management, observability/monitoring platforms, or incident management tooling.
- Experience with bare-metal provisioning systems such as OpenStack Ironic (or equivalents like MAAS, Tinkerbell, or in-house provisioning stacks).
- Experience with DCIM tools such as NetBox (or equivalents like Device42 or Nautobot) for inventory, cabling, and rack/asset management.
- Experience with ITSM and ticketing platforms such as Jira Service Management (or equivalents like ServiceNow, Zendesk, or Freshservice) for support, incident, and RMA workflows.
- Experience with observability and monitoring platforms such as Grafana, Prometheus, Datadog, or equivalents — ideally including defining SLOs, dashboards, and alerting for large fleets.
- Familiarity with GPU or accelerated compute environments, data centre operations, or hyperscaler-style fleet management.
- Experience operating in high-growth or early-stage environments where the product is being built alongside the fleet itself
Join Nscale as we build a world-class AI cloud platform. If you're excited about owning the software that keeps a global GPU fleet running — and raising the bar for the team around you — we'd love to hear from you!
At Nscale, we are committed to fostering an inclusive, diverse, and equitable workplace. We believe that a variety of perspectives enriches our work environment, and we encourage applications from candidates of all backgrounds, experiences, and abilities. We strongly encourage applications from people of colour, the LGBTQ+ community, people with disabilities, neurodivergent people, parents, carers, and people from lower socio-economic backgrounds.
If there’s anything we can do to accommodate your specific situation, please let us know.
The responsibilities outlined in this job description are not exhaustive and are intended to provide a general overview of the position. The employee may be required to perform additional duties, tasks, and responsibilities as assigned by management, consistent with the skills and qualifications required for the role.
The range below reflects the base salary for the position. Actual compensation may vary based on job-related factors such as skill set, experience, education, and location. In addition to base salary, this role may be eligible for bonus, equity, and/or commission programs. Nscale may offer a competitive benefits package including medical, dental, vision, flexible paid time off, parental leave, and retirement plan participation.
Salary Range
$220,000—$260,000 USD
For information on how Nscale handles candidate personal data, please see our Employee & Candidate Privacy Notice: Here.
Nscale does not accept unsolicited candidate submissions from recruitment agencies.
Source: Nscale on Greenhouse · View original posting (opens in new tab)
How this pay compares
Base floor $220,000, above 86% of the 489 Product roles in New York on this site. The employer's range is $40,000 wide, 18% of the floor. Observed open for 14 days so far (since Nov 6, 2026).
Pay in context
Among 489 Product roles in New York listed on this site, the median base floor is $168,750 and the middle half runs from $140,000 to $200,000. This role's floor ($220,000) is above 86% of them; 7 others list the same floor.
Base floors of 489 Product roles in New York
Table
| Floor band | Share | Postings |
|---|---|---|
| $100K to $125K | 17.2% | 84 |
| $125K to $150K | 14.7% | 72 |
| $150K to $175K | 21.5% | 105 |
| $175K to $200K | 19.8% | 97 |
| $200K to $225K | 15.1% | 74 |
| $225K to $250K | 6.1% | 30 |
| $250K to $275K | 2.2% | 11 |
| $275K and up | 3.3% | 16 |
How this is calculated
- Statistic
- Base floor distribution of the cohort
- Formula
- count of cohort postings in each $25K band of published base floor / postings in the cohort
- Denominator
- 489 open postings with this job family in New York
- Sample size
- 489
- Hidden when
- the cohort has fewer than 30 postings
- Calculation version
- jobpage-analysis-v1
- Data as of
- 2026-11-20
- Employer set
- Open jobs on this site that publish a base salary of $100,000 or more
Only jobs on this site count, and each one publishes a base salary of $100,000 or more, so this compares six-figure jobs with each other, not with the whole market. Computed Nov 20, 2026.
State against nationwide
Median base floor in New York vs nationwide
Table
| Value | postings | |
|---|---|---|
| Product, New York | $168,750 | 489 |
| Product, all states | $163,008 | 3,053 |
| This job's base floor (marked) | $220K |
How this is calculated
- Statistic
- Median floor, state vs nationwide
- Formula
- median published base floor of each cohort
- Denominator
- open postings of this job family
- Sample size
- 489 in New York; 3053 nationwide
- Hidden when
- either cohort has fewer than 30 postings
- Calculation version
- jobpage-analysis-v1
- Data as of
- 2026-11-20
- Employer set
- Open jobs on this site that publish a base salary of $100,000 or more
How Nscale pays
3 of Nscale's 41 live roles on this site list a higher base floor and 35 list a lower one. Across them the median floor is $150,000; the middle half runs from $120,000 to $190,000.
Base floors of Nscale's 41 live roles
Table
| Floor band | Share | Roles |
|---|---|---|
| $100K to $125K | 29.3% | 12 |
| $125K to $150K | 19.5% | 8 |
| $150K to $175K | 19.5% | 8 |
| $175K to $200K | 9.8% | 4 |
| $200K to $225K | 14.6% | 6 |
| $225K to $250K | 2.4% | 1 |
| $250K to $275K | 2.4% | 1 |
| $275K and up | 2.4% | 1 |
How this is calculated
- Statistic
- Employer base floor distribution
- Formula
- count of the employer's open roles in each $25K band of published base floor / its open roles
- Denominator
- 41 open public roles at this employer
- Sample size
- 41
- Hidden when
- this employer has fewer than 5 roles
- Calculation version
- jobpage-analysis-v1
- Data as of
- current
- Employer set
- Open jobs on this site that publish a base salary of $100,000 or more
Similar pay elsewhere
Other employers' Product roles in New York with the nearest published base floor to $220,000, one per employer.
- Staff Product Manager January · base floor $220,000
- Sr. Manager, Product Management, Hack, Fix, Verify Experience Horizon3.ai · base floor $220,000
- Director of Product, Consumer & Support (AI Builder) Veho · base floor $220,000
- Director, Product Management (Instore Selling) Lightspeed · base floor $220,000
- Staff Product Manager, Brand Success Faire · base floor $220,000
This listingStaff Product Manager, GPU Infrastructure$220K – $260K
Principal Front-End Network Engineer$220K – $310K
Staff Software Engineer - Fleet Management$220K – $320K
Director, Securities Counsel$210K – $340K
Director, DC Operations (West Virginia)$200K – $270K
Staff Product Manager, IAAS Platform$200K – $280K
VP, Global Projects Compliance & Executive Risk Assurance$240K – $290K
Chart as a table
| Role | Published base |
|---|---|
| Staff Product Manager, GPU Infrastructure (this listing) | $220K - $260K |
| Principal Front-End Network Engineer | $220K - $310K |
| Staff Software Engineer - Fleet Management | $220K - $320K |
| Director, Securities Counsel | $210K - $340K |
| Director, DC Operations (West Virginia) | $200K - $270K |
| Staff Product Manager, IAAS Platform | $200K - $280K |
| VP, Global Projects Compliance & Executive Risk Assurance | $240K - $290K |
Observed changes
No changes to the pay or listing since we first observed this role on Nov 6, 2026 (14 days ago).
- First observed on the employer's board
- Began meeting the published-salary criteria
- Observed since
- Employer-stated posting date
- 2026-09-14
Where this pay comes from
Location as the employer wrote it: New York
USD 220,000 – 260,000 · interval unstated · pay_input_range · Salary Range
- Method
- Structured pay field published by the employer
- Checked
- Rule set
- us-base-v2
The employer's job board publishes this pay as a dedicated data field. We read the field directly; no interpretation was needed.
What we verified
- The pay figures come from the employer's own listing, quoted exactly above.
- The pay is an annual base salary in US dollars with a minimum of at least $100,000.
- The role was publicly listed on the employer's job board when last checked.
We do not verify what the employer will actually offer, whether the employer is still recruiting for the role, or anything beyond what the employer published. Full methodology.
