Six Figure Work

Member of Technical Staff, ML Platform (Evals)

Runway

Company websiterunway.com (Runway, opens in new tab)

Base salary $240K – $290K

Employer-published annual base salary, USD. Advertised base range in United States

Apply (opens in new tab)

You apply on the employer's own site. Six Figure Work does not handle applications.

  • LocationUnited States
  • WorkplaceRemote
  • Status at last checkSource accepting applications when checked
  • Last checked (7 min ago) · observed since

About this job

We are building AI to simulate the world through merging art and science.

We believe that world models are at the frontier of progress in artificial intelligence. Language models alone won’t solve the world’s hardest problems – robotics, disease, scientific discovery. Real progress requires models that experience the world and learn from their mistakes, the same way that humans do. And this kind of trial and error can be massively accelerated when done in simulation, rather than in the real world.

World models offer the most clear path to general-purpose simulation, changing how stories are told, how scientific progress is made and how the next frontiers of humanity are reached.

Our team consists of creative, open minded, caring and ambitious people who are determined to change the world. We aspire to continuously build impossible things and our ability to do so relies on building an incredible team. If you are driven to do the same, we'd love to hear from you.

*Titles posted to our careers page are updated regularly to best advertise the role and expected seniority, but internally we have a flat titling system with two types of titles: one for individual contributors and one for people managers.

About the role

We're looking for an ML infrastructure engineer to own model evaluation at Runway, end to end. Every decision we make about a model – which checkpoint to keep training, what to ship to millions of users, which datamix and architecture shows the most promise – rests on evals. Today that work is spread across the organization. You'll turn it into one platform.

Your job will be to design and build the systems that generate samples at scale, score them with automated metrics and human annotations, track results across checkpoints and releases, and put the answers in front of researchers in minutes rather than days. You'll define what "better" means operationally – how we measure it, how confident we are, and how a result becomes a ship/no-ship decision.

You'll be embedded within research teams as a member of ML Platform, and you'll set the technical direction for evals across the company. This is an extremely high-leverage role: the quality of our models is bounded by how well we can measure them.

A peek at our technical stack

Our inference and training code is written in Python (PyTorch) and is cloud-native. We leverage multiple clouds and use a combination of Kubernetes native and home-grown tooling for efficient job orchestration.

We’re big users of agentic development and operations. We have a robust internal platform and provide broad access to the latest models and harnesses.

You’ll have access to best-in-class models, agents, GPUs, storage and cloud services you need to drive a world class evaluation pipeline that helps us deliver frontier models.

What you'll do

  • Own the evaluation platform end to end: the tooling and systems required to generate, annotate, review and adapt at frontier scale

  • Define the CLIs, APIs, GUIs and storage layers required to make this process seamless, fast, sophisticated and collaborative

  • Work directly with research teams on video, image, audio, agents, and robotics to understand what they need to measure and build it, then generalize the result into the platform

  • Help set the standards for how we evaluate models at Runway: reproducibility, metric definitions, reporting formats, and when a result is trustworthy enough to act on

  • Support broad adoption of the platform and its integration throughout Runway’s research efforts across training, production model serving and more

  • Contribute broadly as a member of the ML Platform team to tools and systems that help Runway train and serve frontier models

What you'll need

  • 5+ years of experience building ML infrastructure or data platforms in production environments, with at least some of that time spent on evaluation, experimentation, or benchmarking systems

  • Strong Python and PyTorch, and hands-on experience running large batch GPU workloads on Kubernetes

  • Experience designing data pipelines and storage for large volumes of media or model outputs, with attention to versioning and reproducibility

  • Familiarity with experimental statistics: paired comparisons, confidence intervals, multiple-comparison pitfalls, inter-rater agreement

  • Comfort building internal tools end to end, from the command line to the browser

  • Ability to lead a broad technical area: gather requirements from many teams, set direction, make tradeoffs, and drive a roadmap without waiting to be told

  • Familiarity with the full model development lifecycle: data, training, evaluation, serving

  • Self-starter who can work embedded with research teams and move fast

  • Strong systems thinking and pragmatic approach to production reliability

  • Humility and open mindedness; at Runway we love to learn from one another

Nice to have

  • Track record of building evaluation suites for generative models

  • Hands-on work with LLM- or VLM-as-judge pipelines

  • Experience with online experimentation platforms and connecting offline metrics to product outcomes

  • Prior work evaluating agents or robotics policies

Runway strives to recruit and retain exceptional talent from diverse backgrounds while ensuring pay equity for our team. Our salary ranges are based on competitive market rates for our size, stage and industry, and salary is just one part of the overall compensation package we provide.

There are many factors that go into salary determinations, including relevant experience, skill level and qualifications assessed during the interview process, and maintaining internal equity with peers on the team. The range shared below is a general expectation for the function as posted, but we are also open to considering candidates who may be more or less experienced than outlined in the job description. In this case, we will communicate any updates in the expected salary range.

Lastly, the provided range is the expected salary for candidates in the U.S. Outside of those regions, there may be a change in the range, which again, will be communicated to candidates.

Working at Runway

Great things come from great teams. We’d love to hear from you.

We’re committed to creating a space where our employees can bring their full selves to work and have equal opportunity to succeed. So regardless of race, gender identity or expression, sexual orientation, religion, origin, ability, age, veteran status, if joining this mission speaks to you, we encourage you to apply.

More about Runway

  • Universal World Simulator

  • GWM-1

  • Gen-4.5

  • General World Models

  • Robotics SDK

  • Conversational Real-time Agents

  • Runway Studios

We're excited to be recognized as a best place to work:

Crain's | InHerSight | BuiltIn NYC | INC

Source: Runway on Ashby · View original posting (opens in new tab)

How this pay compares

Base floor $240,000. The employer's range is $50,000 wide, 21% of the floor. Observed open for 8 days so far (since Nov 12, 2026).

How Runway pays

8 of Runway's 34 live roles on this site list a higher base floor and 22 list a lower one. Across them the median floor is $220,000; the middle half runs from $160,000 to $240,000.

Base floors of Runway's 34 live roles

Base floors of Runway's 34 live roles$100K to $125K: 8.8% (3); $125K to $150K: 11.8% (4); $150K to $175K: 11.8% (4); $175K to $200K: 2.9% (1); $200K to $225K: 23.5% (8); $225K to $250K: 17.6% (6); $250K to $275K: 11.8% (4); $275K and up: 11.8% (4)0%8%16%24%9%10012%12512%1503%17524%20018%22512%25012%275This job $240K
Each bar counts this employer's live roles by published base floor, in $K. The marker is this job's floor.
Table
Base floors of Runway's 34 live roles
Floor bandShareRoles
$100K to $125K8.8%3
$125K to $150K11.8%4
$150K to $175K11.8%4
$175K to $200K2.9%1
$200K to $225K23.5%8
$225K to $250K17.6%6
$250K to $275K11.8%4
$275K and up11.8%4
How this is calculated
Statistic
Employer base floor distribution
Formula
count of the employer's open roles in each $25K band of published base floor / its open roles
Denominator
34 open public roles at this employer
Sample size
34
Hidden when
this employer has fewer than 5 roles
Calculation version
jobpage-analysis-v1
Data as of
current
Employer set
Open jobs on this site that publish a base salary of $100,000 or more
This range next to 6 other live Runway roles with the nearest advertised base floor
Chart as a table
This range next to 6 other live Runway roles with the nearest advertised base floor
RolePublished base
Member of Technical Staff, ML Platform (Evals) (this listing)$240K - $290K
Infrastructure Security Engineer$240K - $290K
Detection & Response Engineer$240K - $290K
Senior/Staff Product Engineer$240K - $290K
Prototype Researcher$250K - $310K
Sr/Staff Product Manager, ML Research$230K - $280K
Sr/Staff Product Manager, Applied AI Products$230K - $280K

Same $100K to $400K scale as every card. All Runway roles · How to read the bar

Observed changes

No changes to the pay or listing since we first observed this role on Nov 12, 2026 (8 days ago).

  1. First observed on the employer's board, already publishing a qualifying base salary
Observed since
Employer-stated posting date
2026-11-12
Where this pay comes from

Location as the employer wrote it: Remote

USD 240,000 – 290,000 · 1 YEAR · Salary

Method
Structured pay field published by the employer
Checked
Rule set
us-base-v2

The employer's job board publishes this pay as a dedicated data field. We read the field directly; no interpretation was needed.

What we verified

  • The pay figures come from the employer's own listing, quoted exactly above.
  • The pay is an annual base salary in US dollars with a minimum of at least $100,000.
  • The role was publicly listed on the employer's job board when last checked.

We do not verify what the employer will actually offer, whether the employer is still recruiting for the role, or anything beyond what the employer published. Full methodology.

Get Six Figure Work by email

Pick what you want. Nothing is selected for you unless it matches the page you are on, and nothing is sent until you confirm from a link we email you.

What would you like to receive?

A short weekly note on what employer-published pay data shows: who pays what, where, and what is changing. Once a week.

Practical notes for job seekers: interviewing, applying for six-figure roles, and making an upward move. About twice a month.

New jobs that match a search you choose. Every job listed has an employer-published base salary of $100,000 or more. At most one email a day (or weekly, your choice). Nothing is sent on days with no new matches. Alerts cover every new job, because this page has no filters.

We email you only after you confirm from a link we send to this address. We do not sell or share your address. Every email has a one-click unsubscribe link. How we handle your email.