Six Figure Work

Senior Manager, Engineering - AI Validation

Sonatus

Company websitesonatus.com (Sonatus, opens in new tab)

Base salary $240K – $290K

Employer-published annual base salary, USD. Advertised base range in Sunnyvale, CA

Apply (opens in new tab)

You apply on the employer's own site. Six Figure Work does not handle applications.

  • LocationSunnyvale, CA
  • WorkplaceWorkplace not stated
  • Status at last checkSource accepting applications when checked
  • Last checked (5 h ago) · observed since

About this job

At Sonatus, we’re driving the transformation to AI-enabled software-defined vehicles. Traditional automotive software methods can’t keep pace with consumer expectations shaped by the mobile industry—where features evolve rapidly, update seamlessly, and improve continuously. That’s why leading OEMs trust Sonatus to accelerate this shift. Our technology is already in production across more than 9 million vehicles on the road today and rapidly expanding.

Headquartered in Sunnyvale, CA, with 250+ employees worldwide, Sonatus combines the agility of a fast-growing company with the scale and impact of an established partner. Backed by strong funding and proven by global deployment, we’re solving some of the most interesting and complex challenges in the industry. Join us and help redefine what’s possible as we shape the future of mobility.

The Opportunity:

Sonatus is looking for an experienced Senior Engineering Manager to build and lead our AI Validation function — the team responsible for how we test, evaluate, and govern the AI models and agentic capabilities embedded in our software-defined vehicle and cloud platforms, as well as our cloud-only AI and LLM-based products. You will deeply understand how AI is developed and deployed across Sonatus’s embedded, cloud, and LLM/RAG-driven environments, identify gaps and friction in current validation practices, and turn those insights into scalable test strategy, evaluation frameworks, and governance mechanisms that let Sonatus ship trustworthy AI-driven features at automotive scale. You will lead and grow a high-performing AI validation team and partner closely with engineering, product, and safety stakeholders to make AI quality and safety a competitive advantage.

Role and Responsibility:

  • Define and drive Sonatus's AI validation strategy across embedded, in-vehicle, cloud-connected, and cloud-native AI systems, identifying gaps in model development, testing, deployment, and governance.
  • Lead, hire, mentor, and grow a high-performing AI Validation organization, establishing scalable engineering processes, technical direction, and execution excellence.
  • Own the end-to-end validation strategy for AI/ML models, LLMs, RAG pipelines, and agentic AI workflows—from data pipelines and model training through cloud services and in-vehicle deployment.
  • Architect and operationalize scalable evaluation frameworks and benchmarking platforms for AI systems, including multi-step agentic workflows, using deterministic metrics, LLM-as-a-Judge methodologies, automated regression testing, and production feedback loops.
  • Design and maintain evaluation harnesses for RAG and agentic systems that measure retrieval quality, grounding, citation accuracy, factual consistency, context relevance, safety, latency, reliability, and execution correctness.
  • Evaluate, integrate, and optimize open-source and commercial AI validation technologies, driving build-versus-buy decisions for Sonatus's AI quality platform.
  • Establish AI governance, Responsible AI practices, model lineage, safety guardrails, and compliance processes appropriate for automotive safety-critical systems and enterprise AI products.
  • Act as the quality gatekeeper for AI-enabled releases, partnering with engineering, product, safety, and OEM stakeholders to identify risks, define release criteria, and ensure production readiness.
  • Collaborate across engineering teams to define validation strategies for emerging AI capabilities, rapidly prototype new evaluation approaches, and standardize successful practices into reusable frameworks.
  • Drive continuous improvement by tracking industry advances in AI evaluation, agentic AI, LLM validation, and RAG systems, translating them into scalable validation capabilities across Sonatus.

Qualifications:

  • Bachelor's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field required (MS preferred).
  • 10+ years of experience in software or systems engineering—including embedded, cloud, networking, security, or automotive domains—with 3+ years leading high-performing engineering or QA organizations.
  • Hands-on experience developing, deploying, testing, or operating AI/ML systems, with strong expertise in modern ML workflows, neural networks, and MLOps.
  • Deep understanding of LLMs, RAG architectures, vector databases, embeddings, retrieval optimization, and agentic AI frameworks such as LangGraph or equivalent orchestration platforms.
  • Proven experience designing and implementing scalable evaluation frameworks for AI systems, including multi-step agentic workflows, regression testing, benchmarking, and automated quality scoring.
  • Strong expertise with hybrid evaluation methodologies combining deterministic validation (citation grounding, structural validation, exact matching) and probabilistic LLM-as-a-Judge techniques (faithfulness, answer relevance, context precision, task completion).
  • Practical experience with RAG evaluation frameworks such as RAGAS, including evaluation tuning, embedding optimization, retrieval quality improvement, and production-scale LLM evaluation pipelines.
  • Experience validating hallucination, grounding, citation accuracy, bias, fairness, toxicity, and factual consistency in production LLM applications.
  • Experience designing systems that verify external knowledge claims and ensure responses are grounded in traceable citations and trusted data sources.
  • Strong experience testing cloud-native platforms and cloud-managed embedded products, including end-to-end system validation.
  • Experience establishing AI governance, safety, compliance, and Responsible AI practices for enterprise or safety-critical systems.
  • Proficiency in Python, Linux, shell scripting, modern test frameworks (PyTest, Playwright, Behave), and engineering productivity tools such as Jenkins and JIRA.

Ways to Stand Out:

  • Experience validating AI or agentic systems in safety-critical or regulated industries (automotive, aerospace, medical).
  • Track record building and scaling an AI test/evaluation platform or developer experience used by multiple teams (frameworks, reusable components, reference implementations).
  • Demonstrated wins moving AI testing practices from ad hoc to standardized, organization-wide adoption, with measurable impact on cycle time, quality, or reliability.
  • Experience implementing enterprise-grade AI governance (auditability, monitoring, policy enforcement) in production systems.
  • Deep experience evaluating LLM and RAG systems at scale, including agentic workflows, RAGAS-based evaluation, citation verification, hallucination detection, groundedness, faithfulness, answer relevance, tool/task correctness, and automated regression testing across offline and online feedback loops.

Sunnyvale HQ Benefits & Perks Offered:

  • Health care plan (Medical, Dental & Vision)
  • Flexible and Dependent Care Expense program
  • Retirement plan (401k)
  • Life Insurance (Basic, Voluntary & AD&D)
  • Unlimited paid time off per year, 14+ paid holidays
  • Hybrid office work arrangement
  • Complimentary lunches, snacks, and beverages during on-site working days
  • Wellness benefit allowance
  • Phone & Internet reimbursement
  • Computer Accessory Allowance

The posted salary range is a general guideline and represents a good faith estimate of what Sonatus ("Company") could reasonably expect to pay for a base salary for this position. The pay offered to a selected candidate will be determined based on factors such as (but not limited to) the scope and responsibilities of the position, the qualifications of the selected candidate, departmental budget availability, geographic location and external market pay for comparable jobs. The Company reserves the right to modify this range in the future, as needed, as market conditions change.

Base Salary Pay Range

$240,000—$290,000 USD

Source: Sonatus on Greenhouse · View original posting (opens in new tab)

How this pay compares

Base floor $240,000, above 87% of the 4,938 Software Engineering roles in California on this site. The employer's range is $50,000 wide, 21% of the floor. First observed today.

Pay in context

Among 4,938 Software Engineering roles in California listed on this site, the median base floor is $176,100 and the middle half runs from $149,100 to $200,000. This role's floor ($240,000) is above 87% of them; 47 others list the same floor.

Base floors of 4,938 Software Engineering roles in California

Base floors of 4,938 Software Engineering roles in California$100K to $125K: 7.9% (389); $125K to $150K: 17.6% (869); $150K to $175K: 22.6% (1,116); $175K to $200K: 22.9% (1,132); $200K to $225K: 12.7% (629); $225K to $250K: 6.5% (323); $250K to $275K: 4.6% (228); $275K and up: 5.1% (252)0%8%16%24%8%10018%12523%15023%17513%2007%2255%2505%275This job $240K
Each bar counts postings on this site by published base floor, in $K. The marker is this job's floor.
Table
Base floors of 4,938 Software Engineering roles in California
Floor bandSharePostings
$100K to $125K7.9%389
$125K to $150K17.6%869
$150K to $175K22.6%1,116
$175K to $200K22.9%1,132
$200K to $225K12.7%629
$225K to $250K6.5%323
$250K to $275K4.6%228
$275K and up5.1%252
How this is calculated
Statistic
Base floor distribution of the cohort
Formula
count of cohort postings in each $25K band of published base floor / postings in the cohort
Denominator
4,938 open postings with this job family in California
Sample size
4938
Hidden when
the cohort has fewer than 30 postings
Calculation version
jobpage-analysis-v1
Data as of
2026-11-21
Employer set
Open jobs on this site that publish a base salary of $100,000 or more

Only jobs on this site count, and each one publishes a base salary of $100,000 or more, so this compares six-figure jobs with each other, not with the whole market. Computed Nov 21, 2026.

State against nationwide

Median base floor in California vs nationwide

Median published base floor of the same job family, in this state and across all states, next to this job's floor.
Table
Median base floor in California vs nationwide
Valuepostings
Software Engineering, California$176,1004,938
Software Engineering, all states$160K13,319
This job's base floor (marked)$240K
How this is calculated
Statistic
Median floor, state vs nationwide
Formula
median published base floor of each cohort
Denominator
open postings of this job family
Sample size
4938 in California; 13319 nationwide
Hidden when
either cohort has fewer than 30 postings
Calculation version
jobpage-analysis-v1
Data as of
2026-11-21
Employer set
Open jobs on this site that publish a base salary of $100,000 or more

How Sonatus pays

This is the highest base floor among Sonatus's 5 live roles on this site. Across them the median floor is $156,000; the middle half runs from $148,500 to $227,000.

Base floors of Sonatus's 5 live roles

Base floors of Sonatus's 5 live roles$100K to $125K: 0.0% (0); $125K to $150K: 40.0% (2); $150K to $175K: 20.0% (1); $175K to $200K: 0.0% (0); $200K to $225K: 0.0% (0); $225K to $250K: 40.0% (2)0%10%20%30%40%0%10040%12520%1500%1750%20040%225This job $240K
Each bar counts this employer's live roles by published base floor, in $K. The marker is this job's floor.
Table
Base floors of Sonatus's 5 live roles
Floor bandShareRoles
$100K to $125K0.0%0
$125K to $150K40.0%2
$150K to $175K20.0%1
$175K to $200K0.0%0
$200K to $225K0.0%0
$225K to $250K40.0%2
How this is calculated
Statistic
Employer base floor distribution
Formula
count of the employer's open roles in each $25K band of published base floor / its open roles
Denominator
5 open public roles at this employer
Sample size
5
Hidden when
this employer has fewer than 5 roles
Calculation version
jobpage-analysis-v1
Data as of
current
Employer set
Open jobs on this site that publish a base salary of $100,000 or more

Similar pay elsewhere

Other employers' Software Engineering roles in California with the nearest published base floor to $240,000, one per employer.

This range next to 4 other live Sonatus roles with the nearest advertised base floor
Chart as a table
This range next to 4 other live Sonatus roles with the nearest advertised base floor
RolePublished base
Senior Manager, Engineering - AI Validation (this listing)$240K - $290K
Senior Staff AI Engineer - Office of the CTO$227K - $313K
Staff System Test Automation Engineer, AI$156K - $214K
Staff System Test Automation Engineer, AI$148,500 - $204,000
Senior Cloud Platform Engineer$137K - $175K

Same $100K to $400K scale as every card. All Sonatus roles · How to read the bar

Observed changes

No changes to the pay or listing since we first observed this role on Nov 21, 2026 (today).

  1. First observed on the employer's board, already publishing a qualifying base salary
Observed since
Employer-stated posting date
2026-07-17
Where this pay comes from

Location as the employer wrote it: Sunnyvale, CA

USD 240,000 – 290,000 · interval unstated · pay_input_range · Base Salary Pay Range · base-labelled (R1: Base Salary)

Method
Structured pay field published by the employer
Checked
Rule set
us-base-v2

The employer's job board publishes this pay as a dedicated data field. We read the field directly; no interpretation was needed.

What we verified

  • The pay figures come from the employer's own listing, quoted exactly above.
  • The pay is an annual base salary in US dollars with a minimum of at least $100,000.
  • The role was publicly listed on the employer's job board when last checked.

We do not verify what the employer will actually offer, whether the employer is still recruiting for the role, or anything beyond what the employer published. Full methodology.

Get Six Figure Work by email

Pick what you want. Nothing is selected for you unless it matches the page you are on, and nothing is sent until you confirm from a link we email you.

What would you like to receive?

A short weekly note on what employer-published pay data shows: who pays what, where, and what is changing. Once a week.

Practical notes for job seekers: interviewing, applying for six-figure roles, and making an upward move. About twice a month.

New jobs that match a search you choose. Every job listed has an employer-published base salary of $100,000 or more. At most one email a day (or weekly, your choice). Nothing is sent on days with no new matches. Alerts cover every new job, because this page has no filters.

We email you only after you confirm from a link we send to this address. We do not sell or share your address. Every email has a one-click unsubscribe link. How we handle your email.