Six Figure Work

ML Engineer

LiteLLM

Company websitelitellm.ai (LiteLLM, opens in new tab)

Base salary $200K – $250K

Employer-published annual base salary, USD. Advertised base range in San Francisco, CA

Apply (opens in new tab)

You apply on the employer's own site. Six Figure Work does not handle applications.

  • LocationSan Francisco, CA
  • WorkplaceOn-site
  • Status at last checkSource accepting applications when checked
  • Last checked (1 h ago) · observed since

About this job

LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product.

What you will be working on

Skills: Python, LLM APIs, FastAPI

As the ML Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec. This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.). You'll work directly with the CEO and CTO on critical projects including:

  • System design for supporting provider level features at the gateway level (skills, compaction, batches, etc.)

  • Thinking about the developer experience - to support millions of users who leverage your work via LiteLLM's Python SDK

  • Building across LLM's, MCP's, and Agents by maintaining an excellent LLM interoperability layer, supporting a wide range of MCP Auth flows and enabling various Agent use-cases

What is our tech stack

The tech stack includes Python, FastAPI, Redis, Postgres.

Who we are looking for

  • 1-2 years of backend/full-stack experience with production systems

  • Passion for open source and user engagement

  • Experience working with the OpenAI api (understand the difference between /chat/completions and /responses, and can speak to API-specific nuances)

  • Strong work ethic and ability to thrive in small teams

  • Eagerness to talk to users and help solve real problems

Why Join LiteLLM?

  • Work directly with the founders every day.

  • Build products used by thousands of engineering teams around the world.

  • Own meaningful product decisions—not just implementation.

  • Move incredibly fast and see your work in production immediately.

  • Help define the future of AI infrastructure and developer tooling.

  • Competitive salary, equity, health, dental, and vision benefits.


About LiteLLM

LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.

If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.

Source: LiteLLM on Ashby · View original posting (opens in new tab)

How this pay compares

Base floor $200,000, above 63% of the 1,552 Data & ML roles in California on this site. The employer's range is $50,000 wide, 25% of the floor. Observed open for 9 days so far (since Nov 11, 2026).

Pay in context

Among 1,552 Data & ML roles in California listed on this site, the median base floor is $180,950 and the middle half runs from $152,000 to $216,250. This role's floor ($200,000) is above 63% of them; 85 others list the same floor.

Base floors of 1,552 Data & ML roles in California

Base floors of 1,552 Data & ML roles in California$100K to $125K: 7.0% (108); $125K to $150K: 12.2% (189); $150K to $175K: 21.2% (329); $175K to $200K: 22.8% (354); $200K to $225K: 16.6% (257); $225K to $250K: 6.4% (99); $250K to $275K: 5.7% (88); $275K and up: 8.2% (128)0%8%16%24%7%10012%12521%15023%17517%2006%2256%2508%275This job $200K
Each bar counts postings on this site by published base floor, in $K. The marker is this job's floor.
Table
Base floors of 1,552 Data & ML roles in California
Floor bandSharePostings
$100K to $125K7.0%108
$125K to $150K12.2%189
$150K to $175K21.2%329
$175K to $200K22.8%354
$200K to $225K16.6%257
$225K to $250K6.4%99
$250K to $275K5.7%88
$275K and up8.2%128
How this is calculated
Statistic
Base floor distribution of the cohort
Formula
count of cohort postings in each $25K band of published base floor / postings in the cohort
Denominator
1,552 open postings with this job family in California
Sample size
1552
Hidden when
the cohort has fewer than 30 postings
Calculation version
jobpage-analysis-v1
Data as of
2026-11-21
Employer set
Open jobs on this site that publish a base salary of $100,000 or more

Only jobs on this site count, and each one publishes a base salary of $100,000 or more, so this compares six-figure jobs with each other, not with the whole market. Computed Nov 21, 2026.

State against nationwide

Median base floor in California vs nationwide

Median published base floor of the same job family, in this state and across all states, next to this job's floor.
Table
Median base floor in California vs nationwide
Valuepostings
Data & ML, California$180,9501,552
Data & ML, all states$165K4,481
This job's base floor (marked)$200K
How this is calculated
Statistic
Median floor, state vs nationwide
Formula
median published base floor of each cohort
Denominator
open postings of this job family
Sample size
1552 in California; 4481 nationwide
Hidden when
either cohort has fewer than 30 postings
Calculation version
jobpage-analysis-v1
Data as of
2026-11-21
Employer set
Open jobs on this site that publish a base salary of $100,000 or more

How LiteLLM pays

6 of LiteLLM's 13 live roles on this site list a higher base floor and 3 list a lower one. Across them the median floor is $200,000; the middle half runs from $200,000 to $220,000.

Base floors of LiteLLM's 13 live roles

Base floors of LiteLLM's 13 live roles$100K to $125K: 0.0% (0); $125K to $150K: 0.0% (0); $150K to $175K: 23.1% (3); $175K to $200K: 0.0% (0); $200K to $225K: 53.8% (7); $225K to $250K: 0.0% (0); $250K to $275K: 23.1% (3)0%15%30%45%60%0%1000%12523%1500%17554%2000%22523%250This job $200K
Each bar counts this employer's live roles by published base floor, in $K. The marker is this job's floor.
Table
Base floors of LiteLLM's 13 live roles
Floor bandShareRoles
$100K to $125K0.0%0
$125K to $150K0.0%0
$150K to $175K23.1%3
$175K to $200K0.0%0
$200K to $225K53.8%7
$225K to $250K0.0%0
$250K to $275K23.1%3
How this is calculated
Statistic
Employer base floor distribution
Formula
count of the employer's open roles in each $25K band of published base floor / its open roles
Denominator
13 open public roles at this employer
Sample size
13
Hidden when
this employer has fewer than 5 roles
Calculation version
jobpage-analysis-v1
Data as of
current
Employer set
Open jobs on this site that publish a base salary of $100,000 or more

Similar pay elsewhere

Other employers' Data & ML roles in California with the nearest published base floor to $200,000, one per employer.

This range next to 6 other live LiteLLM roles with the nearest advertised base floor
Chart as a table
This range next to 6 other live LiteLLM roles with the nearest advertised base floor
RolePublished base
ML Engineer (this listing)$200K - $250K
Senior Backend Engineer$200K - $260K
AI Engineer$200K - $250K
Product Engineer$200K - $260K
Senior Security Engineer$220K - $260K
Senior Security Engineer, Product & Platform$220K - $285K
Senior Security Operations / Detection Engineer$220K - $280K

Same $100K to $400K scale as every card. All LiteLLM roles · How to read the bar

Observed changes

No changes to the pay or listing since we first observed this role on Nov 11, 2026 (9 days ago).

  1. First observed on the employer's board, already publishing a qualifying base salary
Observed since
Employer-stated posting date
2026-11-11
Where this pay comes from

Location as the employer wrote it: San Francisco

USD 200,000 – 250,000 · 1 YEAR · Salary

Method
Structured pay field published by the employer
Checked
Rule set
us-base-v2

The employer's job board publishes this pay as a dedicated data field. We read the field directly; no interpretation was needed.

What we verified

  • The pay figures come from the employer's own listing, quoted exactly above.
  • The pay is an annual base salary in US dollars with a minimum of at least $100,000.
  • The role was publicly listed on the employer's job board when last checked.

We do not verify what the employer will actually offer, whether the employer is still recruiting for the role, or anything beyond what the employer published. Full methodology.

Get Six Figure Work by email

Pick what you want. Nothing is selected for you unless it matches the page you are on, and nothing is sent until you confirm from a link we email you.

What would you like to receive?

A short weekly note on what employer-published pay data shows: who pays what, where, and what is changing. Once a week.

Practical notes for job seekers: interviewing, applying for six-figure roles, and making an upward move. About twice a month.

New jobs that match a search you choose. Every job listed has an employer-published base salary of $100,000 or more. At most one email a day (or weekly, your choice). Nothing is sent on days with no new matches. Alerts cover every new job, because this page has no filters.

We email you only after you confirm from a link we send to this address. We do not sell or share your address. Every email has a one-click unsubscribe link. How we handle your email.