Six Figure Work

Senior Data Scientist (AI Evaluation & Improvement)

Evolent

Company websiteevolent.com (Evolent, opens in new tab)

Base salary From $120K

Employer-published annual base salary, USD. Advertised base range Work at Home

Apply (opens in new tab)

You apply on the employer's own site. Six Figure Work does not handle applications.

  • LocationWork at Home
  • WorkplaceWorkplace not stated
  • Status at last checkSource accepting applications when checked
  • Last checked (22 min ago) · observed since

About this job

Your Future Evolves Here

Evolent partners with health plans and providers to achieve better outcomes for people with most complex and costly health conditions. Working across specialties and primary care, we seek to connect the pieces of fragmented health care system and ensure people get the same level of care and compassion we would want for our loved ones.

Evolent employees enjoy work/life balance, the flexibility to suit their work to their lives, and autonomy they need to get things done. We believe that people do their best work when they're supported to live their best lives, and when they feel welcome to bring their whole selves to work. That's one reason why diversity and inclusion are core to our business.

Join Evolent for the mission. Stay for the culture.

What You’ll Be Doing:

Core Responsibilities

  • Own the diagnostic loop for LLM-based clinical services: take failure modes surfaced by clinical reviewers and product managers, form root-cause hypotheses (prompt design, context assembly, retrieval, guideline encoding, model behavior, upstream data), and design experiments that isolate the cause.
  • Test candidate fixes — prompt and configuration variants, context changes, model alternatives — and verify improvements with structured evaluations, not anecdotes; confirm fixes don't regress other behavior.
  • Own the evaluation roadmap and quality bar for the team's AI services: which metrics gate deployment, how golden sets and regression suites grow, and what "good enough to ship" means in evidence.
  • Use and extend the team's evaluation platform: build golden sets and regression suites, define metrics (accuracy, guideline adherence, grounding/faithfulness), run and interpret eval batteries. Fluency in *using* modern eval tooling matters; the platform exists — extending it thoughtfully is in scope, rebuilding it is not.
  • Partner with clinical reviewers (medical directors) to turn review findings into labeled evidence and executable evaluation criteria; partner with product managers to prioritize which failure modes matter most.
  • Mentor others in evaluation methods and grow the evals function as it scales, including readiness to take direct reports as the team expands.
  • Support the annual clinical-guidelines update cycle with regression evaluation as guidelines, prompts, and models change; ramp with the team's senior data scientists in Q4 2026.
  • Document the diagnostic playbook: failure taxonomies, experiment templates, variant history — a method others can run, not a private intuition. This is a practicing role — the diagnostic loop is the job, at every level of seniority.
  • Handle clinical data (including PHI) according to organizational security, privacy, and compliance requirements.

Minimum Requirements

  • Bachelor's degree in Data Science, Computer Science, Statistics, or a related quantitative field — or equivalent experience.
  • 5+ years of data science or applied machine learning experience, including shipping and maintaining models or AI systems in production.
  • 2+ years of recent, hands-on experience evaluating and improving LLM-based systems: structured error analysis, prompt/configuration iteration, experiment design, metrics interpretation — as a practitioner, not only as a reviewer of others' work.
  • Demonstrated experience with LLM evaluation methods and tools — golden/regression sets, LLM-as-judge with validation, tracing and observability tooling.
  • Strong Python and solid data-analysis skills (SQL a plus); comfort computing and reasoning about metrics such as sensitivity, specificity, and PPV.
  • Hypothesis-driven working style: the instinct to isolate variables and prove a fix, rather than tweak and hope.
  • Strong written communication — findings and go/no-go evidence must be legible to engineers, clinicians, and leadership.

Preferred Requirements

  • Healthcare experience: utilization management, prior authorization, clinical documentation, or clinical/claims data; comfort reading clinical guideline and medical-policy content.
  • Experience mentoring data scientists or leading small technical workstreams; interest in growing into people leadership as a function scales.
  • Experience working with clinical reviewers or other domain experts to convert expert judgment into labeled data and evaluation criteria.
  • Experience with LLM observability/telemetry stacks (OpenTelemetry-based tracing, Logfire, Langfuse, or similar).
  • Statistics or experimentation background (A/B testing, statistical significance, sample-size reasoning).
  • Master's degree in a quantitative field.

#EvolentAi

To ensure a secure hiring process we have implemented several identity verification steps, including submission of a government issued photo ID. We conduct identity verification during interviews, and final interviews may require onsite attendance. All candidates must complete a comprehensive background check, in-person I-9 verification, and may be subject to drug screening prior to employment. The use of artificial intelligence tools during interviews is prohibited and monitored. Misrepresentation will result in immediate disqualification from consideration.

Technical Requirements:

We require that all employees have the following technical capability at their home: High speed internet over 10 Mbps and, specifically for all call center employees, the ability to plug in directly to the home internet router.

Evolent is an equal opportunity employer and considers all qualified applicants equally without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, or disability status. If you need reasonable accommodation to access the information provided on this website, please contact [email protected] for further assistance.

The expected base salary/wage range for this position is $120,000 - 145,000. As part of our total compensation package, Evolent is proud to offer comprehensive benefits (including health insurance benefits) to qualifying employees. All compensation determinations are based on the skills and experience required for the position and commensurate with experience of selected individuals, which may vary above and below the stated amounts.

Source: Evolent on Workday · View original posting (opens in new tab)

How this pay compares

Base floor $120,000, above 13% of the 4,483 Data & ML roles nationwide on this site; the other 87% list the same floor or a higher one. Observed open for 2 days so far (since Nov 18, 2026).

Pay in context

Among 4,483 Data & ML roles nationwide listed on this site, the median base floor is $165,000 and the middle half runs from $135,000 to $197,300. This role's floor ($120,000) is above 13% of them; 86 others list the same floor.

Base floors of 4,483 Data & ML roles nationwide

Base floors of 4,483 Data & ML roles nationwide$100K to $125K: 17.4% (778); $125K to $150K: 20.7% (926); $150K to $175K: 19.9% (890); $175K to $200K: 18.8% (841); $200K to $225K: 11.4% (511); $225K to $250K: 5.1% (230); $250K to $275K: 3.1% (137); $275K and up: 3.8% (170)0%8%16%24%17%10021%12520%15019%17511%2005%2253%2504%275This job $120K
Each bar counts postings on this site by published base floor, in $K. The marker is this job's floor.
Table
Base floors of 4,483 Data & ML roles nationwide
Floor bandSharePostings
$100K to $125K17.4%778
$125K to $150K20.7%926
$150K to $175K19.9%890
$175K to $200K18.8%841
$200K to $225K11.4%511
$225K to $250K5.1%230
$250K to $275K3.1%137
$275K and up3.8%170
How this is calculated
Statistic
Base floor distribution of the cohort
Formula
count of cohort postings in each $25K band of published base floor / postings in the cohort
Denominator
4,483 open postings with this job family nationwide
Sample size
4483
Hidden when
the cohort has fewer than 30 postings
Calculation version
jobpage-analysis-v1
Data as of
2026-11-21
Employer set
Open jobs on this site that publish a base salary of $100,000 or more

Only jobs on this site count, and each one publishes a base salary of $100,000 or more, so this compares six-figure jobs with each other, not with the whole market. Computed Nov 21, 2026.

How Evolent pays

5 of Evolent's 11 live roles on this site list a higher base floor and 4 list a lower one. Across them the median floor is $120,000; the middle half runs from $115,000 to $145,000.

Base floors of Evolent's 11 live roles

Base floors of Evolent's 11 live roles$100K to $125K: 54.5% (6); $125K to $150K: 18.2% (2); $150K to $175K: 18.2% (2); $175K to $200K: 9.1% (1)0%15%30%45%60%55%10018%12518%1509%175This job $120K
Each bar counts this employer's live roles by published base floor, in $K. The marker is this job's floor.
Table
Base floors of Evolent's 11 live roles
Floor bandShareRoles
$100K to $125K54.5%6
$125K to $150K18.2%2
$150K to $175K18.2%2
$175K to $200K9.1%1
How this is calculated
Statistic
Employer base floor distribution
Formula
count of the employer's open roles in each $25K band of published base floor / its open roles
Denominator
11 open public roles at this employer
Sample size
11
Hidden when
this employer has fewer than 5 roles
Calculation version
jobpage-analysis-v1
Data as of
current
Employer set
Open jobs on this site that publish a base salary of $100,000 or more

Similar pay elsewhere

Other employers' Data & ML roles nationwide with the nearest published base floor to $120,000, one per employer.

This range next to 6 other live Evolent roles with the nearest advertised base floor
Chart as a table
This range next to 6 other live Evolent roles with the nearest advertised base floor
RolePublished base
Senior Data Scientist (AI Evaluation & Improvement) (this listing)From $120K
Sr Product Manager (Agentic User Interface)From $120K
Lead Tech Analyst, HR Information SystemsFrom $115K
Sr Tech Analyst, Finance Information SystemsFrom $115K
Senior Product Manager - AI & Healthcare InnovationFrom $125K
Sr Software EngineerFrom $115K
Sr Product Manager (AI Platform)From $115K

Same $100K to $400K scale as every card. All Evolent roles · How to read the bar

Observed changes

No changes to the pay or listing since we first observed this role on Nov 18, 2026 (2 days ago).

  1. First observed on the employer's board, already publishing a qualifying base salary
Observed since
Employer-stated posting date
2026-11-18
Where this pay comes from

Location as the employer wrote it: Work at Home

The expected base salary/wage range for this position is $120,000 - 145,000. As part of our total compensation package, Evole

Method
Employer text, read with fixed rules and re-verified
Checked
Rule set
us-base-v2

The pay passage appears in the employer's own job text. Fixed, deterministic rules located it, and the passage below was checked against the stored copy of the posting.

What we verified

  • The pay figures come from the employer's own listing, quoted exactly above.
  • The pay is an annual base salary in US dollars with a minimum of at least $100,000.
  • The role was publicly listed on the employer's job board when last checked.

We do not verify what the employer will actually offer, whether the employer is still recruiting for the role, or anything beyond what the employer published. Full methodology.

Get Six Figure Work by email

Pick what you want. Nothing is selected for you unless it matches the page you are on, and nothing is sent until you confirm from a link we email you.

What would you like to receive?

A short weekly note on what employer-published pay data shows: who pays what, where, and what is changing. Once a week.

Practical notes for job seekers: interviewing, applying for six-figure roles, and making an upward move. About twice a month.

New jobs that match a search you choose. Every job listed has an employer-published base salary of $100,000 or more. At most one email a day (or weekly, your choice). Nothing is sent on days with no new matches. Alerts cover every new job, because this page has no filters.

We email you only after you confirm from a link we send to this address. We do not sell or share your address. Every email has a one-click unsubscribe link. How we handle your email.