Software Engineer, GPU Kernels
Company websiteriver.ai (River AI Inc, opens in new tab)
Base salary $200K – $420K
Employer-published annual base salary, USD. Advertised base range in Palo Alto, CA
You apply on the employer's own site. Six Figure Work does not handle applications.
- LocationPalo Alto, CA
- WorkplaceWorkplace not stated
- Status at last checkSource accepting applications when checked
- Last checked (1 h ago) · observed since
About this job
At River AI, our mission is to create personal AI owned and shaped by each individual. To achieve this, we are rewriting the entire stack from scratch: personal hardware for local inference, bespoke training infrastructure, next-generation UIs, and frontier deep learning research.
Who we are
We are scientists, engineers, and builders from the industry's top tech companies and AI labs. We bring a proven track record of scaling consumer systems for hundreds of millions of users and architecting the pre-training infrastructure behind today's frontier models.
About the Role
We are looking for exceptional GPU kernel engineers to build the compute primitives behind River’s training and inference infrastructure. Your goal is to make large models faster to train and more efficient to serve.
You will own performance-critical operations, including attention, matrix multiplication, mixture-of-experts execution, and low-precision computation. Working closely with researchers and systems engineers, you will identify bottlenecks, implement kernels, validate correctness, and bring improvements into production.
What You’ll Do
- Build fast GPU kernels for attention, matrix multiplication, expert routing, and related operations.
- Optimize memory access, tiling, and synchronization to make efficient use of GPU hardware.
- Develop FP8, FP4, and mixed-precision kernels while preserving numerical correctness.
- Accelerate fine-tuning and RL through optimized adapters, backward passes, and fused operations.
- Profile real workloads and integrate improvements into training and inference runtimes.
- Build reproducible benchmarks that verify correctness, gradients, and performance.
Skills & Qualifications
Minimum Qualifications:
- Bachelor’s degree in Computer Science, Computer Engineering, or equivalent practical experience.
- Experience optimizing GPU kernels with CUDA, Triton, CUTLASS, CuTe, or comparable tools.
- Strong understanding of GPU architecture, memory hierarchies, and parallel execution.
- Proficiency in C++ and Python.
- Strong foundations in linear algebra, floating-point arithmetic, and numerical computing.
- Strong debugging and profiling skills, with a collaborative approach to engineering.
Preferred Qualifications: (We encourage you to apply even if you don't meet all of these)
- Experience optimizing for NVIDIA Blackwell or Hopper GPUs.
- Work on attention, mixture-of-experts kernels, grouped GEMMs, or low-rank adapters.
- Experience implementing backward passes and validating gradients.
- Familiarity with FP8, FP4, and quantized weight layouts.
- Experience integrating custom operators into PyTorch, SGLang, vLLM, or similar frameworks.
- Open-source contributions or a track record of shipping substantial kernel optimizations.
Logistics & Benefits
- Location: Palo Alto, California.
- Compensation: Depending on experience and skills the expected base pay is $200,000 - $420,000 USD per year, plus equity.
- Benefits: Comprehensive health, dental, and vision insurance; unlimited PTO; and relocation assistance as needed.
- Visa Sponsorship: We sponsor visas and are committed to supporting the process for the right candidate.
Source: River AI Inc on Greenhouse · View original posting (opens in new tab)
How this pay compares
Base floor $200,000, above 70% of the 4,901 Software Engineering roles in California on this site. The employer's range is $220,000 wide, 110% of the floor. Observed open for 1 day so far (since Nov 19, 2026).
Pay in context
Among 4,901 Software Engineering roles in California listed on this site, the median base floor is $176,360 and the middle half runs from $149,100 to $202,000. This role's floor ($200,000) is above 70% of them; 193 others list the same floor.
Base floors of 4,901 Software Engineering roles in California
Table
| Floor band | Share | Postings |
|---|---|---|
| $100K to $125K | 7.9% | 386 |
| $125K to $150K | 17.5% | 859 |
| $150K to $175K | 22.7% | 1,111 |
| $175K to $200K | 22.7% | 1,112 |
| $200K to $225K | 12.7% | 624 |
| $225K to $250K | 6.6% | 324 |
| $250K to $275K | 4.6% | 227 |
| $275K and up | 5.3% | 258 |
How this is calculated
- Statistic
- Base floor distribution of the cohort
- Formula
- count of cohort postings in each $25K band of published base floor / postings in the cohort
- Denominator
- 4,901 open postings with this job family in California
- Sample size
- 4901
- Hidden when
- the cohort has fewer than 30 postings
- Calculation version
- jobpage-analysis-v1
- Data as of
- 2026-11-20
- Employer set
- Open jobs on this site that publish a base salary of $100,000 or more
Only jobs on this site count, and each one publishes a base salary of $100,000 or more, so this compares six-figure jobs with each other, not with the whole market. Computed Nov 20, 2026.
State against nationwide
Median base floor in California vs nationwide
Table
| Value | postings | |
|---|---|---|
| Software Engineering, California | $176,360 | 4,901 |
| Software Engineering, all states | $160K | 13,273 |
| This job's base floor (marked) | $200K |
How this is calculated
- Statistic
- Median floor, state vs nationwide
- Formula
- median published base floor of each cohort
- Denominator
- open postings of this job family
- Sample size
- 4901 in California; 13273 nationwide
- Hidden when
- either cohort has fewer than 30 postings
- Calculation version
- jobpage-analysis-v1
- Data as of
- 2026-11-20
- Employer set
- Open jobs on this site that publish a base salary of $100,000 or more
How River AI Inc pays
1 of River AI Inc's 21 live roles on this site list a higher base floor and 1 list a lower one. Across them the median floor is $200,000; the middle half runs from $200,000 to $200,000.
Base floors of River AI Inc's 21 live roles
Table
| Floor band | Share | Roles |
|---|---|---|
| $100K to $125K | 0.0% | 0 |
| $125K to $150K | 0.0% | 0 |
| $150K to $175K | 4.8% | 1 |
| $175K to $200K | 0.0% | 0 |
| $200K to $225K | 90.5% | 19 |
| $225K to $250K | 0.0% | 0 |
| $250K to $275K | 0.0% | 0 |
| $275K and up | 4.8% | 1 |
How this is calculated
- Statistic
- Employer base floor distribution
- Formula
- count of the employer's open roles in each $25K band of published base floor / its open roles
- Denominator
- 21 open public roles at this employer
- Sample size
- 21
- Hidden when
- this employer has fewer than 5 roles
- Calculation version
- jobpage-analysis-v1
- Data as of
- current
- Employer set
- Open jobs on this site that publish a base salary of $100,000 or more
Similar pay elsewhere
Other employers' Software Engineering roles in California with the nearest published base floor to $200,000, one per employer.
- Principal Software Engineer, Continuous Integration (Starship) SpaceX · base floor $200,000
- Senior Software Engineer, Frontend Comfy · base floor $200,000
- Senior Machine Learning Engineer, Trust Airbnb · base floor $200,000
- Senior Software Engineer - Platform Integration, Robot Software Wayve · base floor $200,000
- Software Engineer, Cloud Infrastructure & Automation Glean · base floor $200,000
This listingSoftware Engineer, GPU Kernels$200K – $420K
Product Engineer, Personal AI$200K – $420K
People Lead$200K – $380K
Kernel Engineer (Custom Silicon), Hardware$200K – $420K
Software Engineer, River API$200K – $420K
Performance Engineer, Hardware$200K – $420K
Physical Design Engineer, Hardware$200K – $420K
Chart as a table
| Role | Published base |
|---|---|
| Software Engineer, GPU Kernels (this listing) | $200K - $420K |
| Product Engineer, Personal AI | $200K - $420K |
| People Lead | $200K - $380K |
| Kernel Engineer (Custom Silicon), Hardware | $200K - $420K |
| Software Engineer, River API | $200K - $420K |
| Performance Engineer, Hardware | $200K - $420K |
| Physical Design Engineer, Hardware | $200K - $420K |
Observed changes
No changes to the pay or listing since we first observed this role on Nov 19, 2026 (1 day ago).
- First observed on the employer's board, already publishing a qualifying base salary
- Observed since
- Employer-stated posting date
- 2026-09-12
Where this pay comes from
Location as the employer wrote it: Palo Alto, CA
- Compensation: Depending on experience and skills the expected base pay is $200,000 - $420,000 USD per year, plus equity.
- Method
- Employer text, read with fixed rules and re-verified
- Checked
- Rule set
- us-base-v2
The pay passage appears in the employer's own job text. Fixed, deterministic rules located it, and the passage below was checked against the stored copy of the posting.
What we verified
- The pay figures come from the employer's own listing, quoted exactly above.
- The pay is an annual base salary in US dollars with a minimum of at least $100,000.
- The role was publicly listed on the employer's job board when last checked.
We do not verify what the employer will actually offer, whether the employer is still recruiting for the role, or anything beyond what the employer published. Full methodology.
