Six Figure Work

Senior AI Product Manager, Evals & Annotations

Arize AI

Company websitearize.com (Arize AI, opens in new tab)

Base salary $200K – $250K

Employer-published annual base salary, USD. Advertised base range in United States

Apply (opens in new tab)

You apply on the employer's own site. Six Figure Work does not handle applications.

  • LocationUnited States
  • WorkplaceWorkplace not stated
  • Status at last checkSource accepting applications when checked
  • Last checked (just now) · observed since

About this job

About Arize

AI is rapidly transforming the world. As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot, and optimize their AI systems. That’s where we come in. Arize AI is the leading AI & Agent Engineering observability and evaluation platform, empowering AI engineers to ship high-performing, reliable agents and applications. From first prototype to production scale, Arize unifies build, test, and run in a single workspace, so teams can ship faster with confidence.

Arize serves a rapidly growing customer base of 150+ leading enterprises and Fortune 500 companies. Customers like Booking.com, Uber, Siemens, and PepsiCo leverage Arize to deliver AI that works.

The Opportunity

Evaluations are central to how AI developers understand, measure, and improve their applications. As AI systems become increasingly complex and agentic, developers need cohesive workflows to define what good looks like, evaluate behavior, incorporate human feedback, and continuously improve their applications.

We're looking for a highly technical, product-minded PM to own Evals & Annotations at Arize. You'll own the end-to-end evaluation lifecycle—from eval creation and execution to human review, analysis, and iteration. This is an opportunity to bring together powerful capabilities into a cohesive, best-in-class developer experience while helping define the future of evaluations in a world of increasingly autonomous and managed agents, including through our integration with Dynatrace.

This role is ideal for someone with strong product and UX opinions who doesn't just define requirements but actively shapes the experience. You'll independently explore workflows, build prototypes, and collaborate closely with Design and Engineering to turn ideas into polished, technically sound products. You should be as comfortable working through an interaction design as you are discussing technical tradeoffs with engineers.

While Arize has been acquired, we continue to operate with the urgency, resourcefulness, and hands-on mentality of an early-stage startup. Product, Engineering, and Design collaborate closely, and our founders remain actively involved in product thinking and design. You'll have real ownership while working directly with our cofounder/CPO in an environment that values initiative, constructive debate, and a willingness to jump in wherever needed.

What You'll Do

  • Own Arize's Evals & Annotations product area end-to-end, including eval creation and execution, human review, annotation workflows, and the broader evaluation lifecycle.
  • Set the product strategy and roadmap, balancing customer needs, foundational platform investments, UX improvements, and emerging opportunities in AI and agent development.
  • Drive a best-in-class evaluation experience. Develop strong opinions about how workflows should work, independently prototype solutions, and partner with Design to turn those ideas into intuitive, polished experiences.
  • Shape the future of evaluations as AI development evolves toward autonomous and managed agents, including opportunities within the broader Dynatrace ecosystem.
  • Work closely with Engineering on technically complex problems spanning evaluation execution, backend systems, orchestration, and data infrastructure. Contribute to technical discussions, implementation approaches, and tradeoffs.
  • Spend significant time with customers—typically multiple conversations each week—to understand how they evaluate and improve AI systems, uncover underlying problems, and validate product direction.
  • Collaborate directly with our cofounders and cross-functional teams on product direction, design exploration, and prioritization, bringing independent judgment and turning collaborative thinking into execution.
  • Make clear prioritization decisions across competing demands and drive products from problem definition through launch, adoption, and iteration.

What We're Looking For

  • Significant product management experience independently owning technically complex developer-facing products. We're flexible on exact years of experience for candidates with exceptional technical depth, product judgment, and ownership.
  • Strong understanding of LLM evaluations and AI development workflows, including automated evals, human feedback, experimentation, and how developers iterate on AI applications and agents.
  • Experience with developer tools, AI infrastructure, ML platforms, or adjacent technical products, with a solid understanding of backend systems and software architecture.
  • Strong technical depth and hands-on engineering ability. We don't expect you to ship large features as an IC engineer, but we do expect you to:
    • Debug issues independently and navigate code when needed.
    • Put up small fixes or PRs.
    • Build prototypes and technical proofs of concept.
    • Propose technical implementations and reason through tradeoffs.
    • Hold credible technical discussions with engineers.
  • Excellent product and UX instincts.You can independently define and prototype core product experiences, not just write requirements, while partnering effectively with designers and design engineers to refine and ship them.
  • Strong ownership, initiative, and bias toward action. You're comfortable navigating ambiguity, making tradeoffs, and getting hands-on without waiting for a fully defined roadmap or direction.
  • A collaborative, low-ego approach to working with founders, engineers, and designers. You bring strong opinions, engage in constructive debate, and thrive in an environment where responsibilities overlap.
  • Experience working closely with technical customers, with strong communication skills and the ability to move comfortably between strategy and execution.

Bonus Points, But Not Required

  • Direct experience with LLM evaluation platforms, annotation systems, human-in-the-loop workflows, or agent orchestration.
  • Strong backend or platform engineering background, particularly with distributed systems, workflow orchestration, or data infrastructure.
  • Hands-on programming experience and comfort working across backend and frontend technologies.
  • Experience with LLM-as-a-judge, custom evaluators, experiment tracking, datasets, or feedback-driven improvement workflows.
  • Previous engineering experience or substantial hands-on software development experience.
  • Early-stage or high-growth startup experience, particularly in founder-led environments.

The estimated annual salary for this role is between $200,000-$250,000, plus a competitive equity package. Actual compensation is determined based upon a variety of job related factors that may include: transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefit package, including: medical, dental, vision, 401(k) plan, unlimited paid time off, generous parental leave plan, and others for mental and wellness support.

While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.

More About Arize

Arize’s mission is to make the world’s AI work—and work for people.
Our founders came together through a shared frustration: while investments in AI are growing rapidly across every industry, organizations face a critical challenge—understanding whether AI is performing and how to improve it at scale.

Learn more about what we're doing here:

https://techcrunch.com/2025/02/20/arize-ai-hopes-it-has-first-mover-advantage-in-ai-observability/

https://arize.com/blog/arize-ai-raises-70m-series-c-to-build-the-gold-standard-for-ai-evaluation-observability/

Diversity & Inclusion @ Arize

Our company's mission is to make AI work and make AI work for the people, we hope to make an impact in bias industry-wide and that's a big motivator for people who work here. We actively hope that individuals contribute to a good culture

  • Regularly have chats with industry experts, researchers, and ethicists across the ecosystem to advance the use of responsible AI
  • Culturally conscious events such as LGBTQ trivia during pride month
  • We have an active Lady Arizers subgroup

Source: Arize AI on Greenhouse · View original posting (opens in new tab)

How this pay compares

Base floor $200,000, above 78% of the 3,046 Product roles nationwide on this site. The employer's range is $50,000 wide, 25% of the floor. Observed open for 10 days so far (since Nov 10, 2026).

Pay in context

Among 3,046 Product roles nationwide listed on this site, the median base floor is $162,900 and the middle half runs from $136,500 to $191,000. This role's floor ($200,000) is above 78% of them; 112 others list the same floor.

Base floors of 3,046 Product roles nationwide

Base floors of 3,046 Product roles nationwide$100K to $125K: 16.3% (497); $125K to $150K: 18.5% (564); $150K to $175K: 24.5% (746); $175K to $200K: 18.8% (573); $200K to $225K: 11.9% (362); $225K to $250K: 5.7% (174); $250K to $275K: 2.1% (63); $275K and up: 2.2% (67)0%8%16%24%16%10019%12524%15019%17512%2006%2252%2502%275This job $200K
Each bar counts postings on this site by published base floor, in $K. The marker is this job's floor.
Table
Base floors of 3,046 Product roles nationwide
Floor bandSharePostings
$100K to $125K16.3%497
$125K to $150K18.5%564
$150K to $175K24.5%746
$175K to $200K18.8%573
$200K to $225K11.9%362
$225K to $250K5.7%174
$250K to $275K2.1%63
$275K and up2.2%67
How this is calculated
Statistic
Base floor distribution of the cohort
Formula
count of cohort postings in each $25K band of published base floor / postings in the cohort
Denominator
3,046 open postings with this job family nationwide
Sample size
3046
Hidden when
the cohort has fewer than 30 postings
Calculation version
jobpage-analysis-v1
Data as of
2026-11-21
Employer set
Open jobs on this site that publish a base salary of $100,000 or more

Only jobs on this site count, and each one publishes a base salary of $100,000 or more, so this compares six-figure jobs with each other, not with the whole market. Computed Nov 21, 2026.

How Arize AI pays

This is the highest base floor among Arize AI's 8 live roles on this site (shared with 1 other). Across them the median floor is $137,500; the middle half runs from $118,750 to $181,250.

Base floors of Arize AI's 8 live roles

Base floors of Arize AI's 8 live roles$100K to $125K: 25.0% (2); $125K to $150K: 25.0% (2); $150K to $175K: 12.5% (1); $175K to $200K: 12.5% (1); $200K to $225K: 25.0% (2)0%8%16%24%25%10025%12512%15012%17525%200This job $200K
Each bar counts this employer's live roles by published base floor, in $K. The marker is this job's floor.
Table
Base floors of Arize AI's 8 live roles
Floor bandShareRoles
$100K to $125K25.0%2
$125K to $150K25.0%2
$150K to $175K12.5%1
$175K to $200K12.5%1
$200K to $225K25.0%2
How this is calculated
Statistic
Employer base floor distribution
Formula
count of the employer's open roles in each $25K band of published base floor / its open roles
Denominator
8 open public roles at this employer
Sample size
8
Hidden when
this employer has fewer than 5 roles
Calculation version
jobpage-analysis-v1
Data as of
current
Employer set
Open jobs on this site that publish a base salary of $100,000 or more

Similar pay elsewhere

Other employers' Product roles nationwide with the nearest published base floor to $200,000, one per employer.

This range next to 6 other live Arize AI roles with the nearest advertised base floor
Chart as a table
This range next to 6 other live Arize AI roles with the nearest advertised base floor
RolePublished base
Senior AI Product Manager, Evals & Annotations (this listing)$200K - $250K
Senior AI Product Manager, Observability$200K - $250K
Principal of Technical Content & Editorial$175K - $200K
DevOps Engineer$150K - $185K
Senior AI Product Engineer, Fullstack$125K - $225K
Senior AI Product Engineer, Backend$125K - $225K
Applied AI Engineer$100K - $175K

Same $100K to $400K scale as every card. All Arize AI roles · How to read the bar

Observed changes

No changes to the pay or listing since we first observed this role on Nov 10, 2026 (10 days ago).

  1. First observed on the employer's board, already publishing a qualifying base salary
Observed since
Employer-stated posting date
2026-11-10
Where this pay comes from

Location as the employer wrote it: United States (Remote)

The estimated annual salary for this role is between $200,000-$250,000, plus a competitive equity package. Actual compensation is

Method
Employer text, read with fixed rules and re-verified
Checked
Rule set
us-base-v2

The pay passage appears in the employer's own job text. Fixed, deterministic rules located it, and the passage below was checked against the stored copy of the posting.

What we verified

  • The pay figures come from the employer's own listing, quoted exactly above.
  • The pay is an annual base salary in US dollars with a minimum of at least $100,000.
  • The role was publicly listed on the employer's job board when last checked.

We do not verify what the employer will actually offer, whether the employer is still recruiting for the role, or anything beyond what the employer published. Full methodology.

Get Six Figure Work by email

Pick what you want. Nothing is selected for you unless it matches the page you are on, and nothing is sent until you confirm from a link we email you.

What would you like to receive?

A short weekly note on what employer-published pay data shows: who pays what, where, and what is changing. Once a week.

Practical notes for job seekers: interviewing, applying for six-figure roles, and making an upward move. About twice a month.

New jobs that match a search you choose. Every job listed has an employer-published base salary of $100,000 or more. At most one email a day (or weekly, your choice). Nothing is sent on days with no new matches. Alerts cover every new job, because this page has no filters.

We email you only after you confirm from a link we send to this address. We do not sell or share your address. Every email has a one-click unsubscribe link. How we handle your email.