Sr. Software Development Engineer in Test, AI/ML
Sony Interactive Entertainment
Company websitesonyinteractive.com (Sony Interactive Entertainment, opens in new tab)
Base salary $152,500 – $228,700
Employer-published annual base salary, USD. Advertised base range in Madison, WI
You apply on the employer's own site. Six Figure Work does not handle applications.
- LocationMadison, WI
- WorkplaceWorkplace not stated
- Status at last checkSource accepting applications when checked
- Last checked (4 h ago) · observed since
About this job
Why Sony Interactive Entertainment?
Sony Interactive Entertainment isn’t just the Best Place to Play — it’s also the Best Place to Work. Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. As a subsidiary of Sony Group Corporation, we’re part of a proud legacy of innovation and excellence. SIE is a dynamic technology company, delivering cutting-edge hardware and network services to more than 100 million people and an entertainment leader, home to some of the most beloved and recognizable intellectual properties (IP) in the world. Our role at SIE is to create and nurture the experiences under the PlayStation brand, a name synonymous with entertainment excellence and creativity.
Sr. Software Development Engineer In Test, ML/AI
At SIE, we believe in making play safer for everyone. Within our Information Security team, we protect our people, platforms, and products with smart, scalable, and thoughtful solutions. Our mission is to provide clear, actionable risk and security insights that guide the business and enable amazing player experiences.
We’re building a team that thrives on collaboration, curiosity, and delivering real value. Come help us make a difference!
Overview
We are hiring a Sr Software Engineer in Test specializing in ML/AI quality, including automation for model evaluation, LLM-assisted test generation, and validation of AI-powered workflows. The role includes guiding quality strategy and developing automation frameworks. You will also manage implementation for complex, cross-functional, machine learning-powered products and services. This role involves more than test development. You will lead quality initiatives from start to finish, ensuring teams stay synchronized, dependencies are managed, and releases are delivered confidently. You will work closely with ML, engineering, product, and infrastructure teams. You will shape how quality is built, monitored, and expanded while leading embedded QE efforts within projects.
What you’ll do
- Define and complete quality strategies, test plans, and automation coverage for ML-powered services and platform components.
- Use LLMs and other AI-assisted techniques to generate, expand, and maintain high-value test cases for ML-powered workflows.
- Design scenario-based test suites for AI features, including adversarial prompts, edge cases, ambiguous inputs, and underrepresented user scenarios.
- Lead QE efforts for multi-functional projects, driving risk assessment, dependency management, and release readiness.
- Design, develop, and maintain scalable automation frameworks for backend services, APIs, and ML inference systems using Python and/or Java.
- Build automated validation for ML and LLM outputs, including ranking behavior, score distributions, prompt/response quality, hallucination indicators, and probabilistic model evaluation.
- Debug test failures, service anomalies, model inconsistencies, and AI behavior regressions to identify root causes and drive resolution.
- Perform functional, integration, regression, API, end-to-end, performance, and reliability testing for distributed systems.
- Improve automation reliability, reduce flakiness, and optimize execution efficiency.
- Partner with engineering and ML teams to integrate automated testing into CI/CD pipelines and release workflows.
- Collaborate across teams to establish scalable quality standards, tooling, and guidelines.
Required qualifications
- Bachelor’s degree in Computer Science or equivalent
- 5+ years of experience as an SDET or QE engineer focused on backend and distributed systems.
- Experience using LLMs to generate, transform, and prioritize test cases for AI-powered experiences.
- Experience with AI evaluation tooling, prompt evaluation frameworks, model monitoring, or human-in-the-loop review workflows.
- Strong experience testing RESTful APIs, microservices, and distributed architectures.
- Proficiency in Python, Java, JS or similar languages for automation development.
- Hands-on experience with automation frameworks such as pytest, JUnit, Selenium, Playwright, Cypress, or Appium.
- Experience with CI/CD systems and test pipelines (Jenkins, GitHub Actions, etc.).
- Experience with cloud and container technologies (AWS, GCP, Kubernetes, Docker).
- Familiarity with databases, monitoring, and observability tools.
- Strong understanding of SDLC, Agile methodologies, and release processes.
- Excellent problem-solving, debugging, and communication skills.
Preferred qualifications
- Experience validating ML outputs using statistical analysis or scenario-based testing approaches.
- Familiarity with ML infrastructure, data pipelines, or model-serving platforms (Seldon, KServe, Ray Serve, etc.).
- Prior work in content moderation ML, security, fraud detection, or adversarial ML.
- Experience testing high-scale, low-latency online services.
- Experience with Databricks or similar ML platform tooling.
- Familiarity with Node.js, React, or modern frontend technologies.
- Experience testing mobile, console, or other non-PC platforms.
What sets you apart
- Strong combination of automation engineering and delivery ownership.
- Ability to drive quality across complex cross-functional initiatives.
- Practical understanding of how to test non-deterministic AI systems and separate model variance from quality regressions.
- Proven risk management and dependency coordination skills.
- Ability to influence engineering teams and promote quality guidelines.
- Passion for scalable, reliable, and maintainable automation systems.
At SIE, we consider several factors when setting each role’s base pay range, including the competitive benchmarking data for the market and geographic location.
Please note that the base pay range may vary in line with our hybrid working policy and individual base pay will be determined based on job-related factors which may include knowledge, skills, experience, and location.
In addition, this role is eligible for SIE’s top-tier benefits package that includes medical, dental, vision, matching 401(k), paid time off, wellness program and coveted employee discounts for Sony products. This role also may be eligible for a bonus package. Click here to learn more.
The estimated base pay range for this role is listed below.
$152,500—$228,700 USD
Please note, Sony Interactive Entertainment conducts background checks at the offer stage for all new employees (which may include criminal background checks for some roles) and will need to process personal information to support these checks.
Please refer to our Candidate Privacy Notice (where applicable) for more information about what personal information we collect, how we use it, who we share it with, and your data protection rights.
Equal Opportunity Statement:
Sony is an Equal Opportunity Employer. All persons will receive consideration for employment without regard to gender (including gender identity, gender expression and gender reassignment), race (including colour, nationality, ethnic or national origin), religion or belief, marital or civil partnership status, disability, age, sexual orientation, pregnancy, maternity or parental status, trade union membership or membership in any other legally protected category.
We strive to create an inclusive environment, empower employees and embrace diversity. We encourage everyone to respond.
Sony Interactive Entertainment is a Fair Chance employer and qualified applicants with arrest and conviction records will be considered for employment.
Source: Sony Interactive Entertainment on Greenhouse · View original posting (opens in new tab)
How this pay compares
Base floor $152,500, above 45% of the 13,322 Software Engineering roles nationwide on this site; the other 55% list the same floor or a higher one. The employer's range is $76,200 wide, 50% of the floor. First observed today.
Pay in context
Among 13,322 Software Engineering roles nationwide listed on this site, the median base floor is $160,000 and the middle half runs from $136,300 to $190,800. This role's floor ($152,500) is above 45% of them; 5 others list the same floor.
Base floors of 13,322 Software Engineering roles nationwide
Table
| Floor band | Share | Postings |
|---|---|---|
| $100K to $125K | 15.2% | 2,021 |
| $125K to $150K | 25.3% | 3,366 |
| $150K to $175K | 21.3% | 2,835 |
| $175K to $200K | 18.7% | 2,493 |
| $200K to $225K | 9.8% | 1,310 |
| $225K to $250K | 4.6% | 617 |
| $250K to $275K | 2.6% | 344 |
| $275K and up | 2.5% | 336 |
How this is calculated
- Statistic
- Base floor distribution of the cohort
- Formula
- count of cohort postings in each $25K band of published base floor / postings in the cohort
- Denominator
- 13,322 open postings with this job family nationwide
- Sample size
- 13322
- Hidden when
- the cohort has fewer than 30 postings
- Calculation version
- jobpage-analysis-v1
- Data as of
- 2026-11-21
- Employer set
- Open jobs on this site that publish a base salary of $100,000 or more
Only jobs on this site count, and each one publishes a base salary of $100,000 or more, so this compares six-figure jobs with each other, not with the whole market. Computed Nov 21, 2026.
How Sony Interactive Entertainment pays
74 of Sony Interactive Entertainment's 104 live roles on this site list a higher base floor and 29 list a lower one. Across them the median floor is $177,300; the middle half runs from $150,100 to $212,200.
Base floors of Sony Interactive Entertainment's 104 live roles
Table
| Floor band | Share | Roles |
|---|---|---|
| $100K to $125K | 5.8% | 6 |
| $125K to $150K | 15.4% | 16 |
| $150K to $175K | 25.0% | 26 |
| $175K to $200K | 22.1% | 23 |
| $200K to $225K | 11.5% | 12 |
| $225K to $250K | 7.7% | 8 |
| $250K to $275K | 6.7% | 7 |
| $275K and up | 5.8% | 6 |
How this is calculated
- Statistic
- Employer base floor distribution
- Formula
- count of the employer's open roles in each $25K band of published base floor / its open roles
- Denominator
- 104 open public roles at this employer
- Sample size
- 104
- Hidden when
- this employer has fewer than 5 roles
- Calculation version
- jobpage-analysis-v1
- Data as of
- current
- Employer set
- Open jobs on this site that publish a base salary of $100,000 or more
Similar pay elsewhere
Other employers' Software Engineering roles nationwide with the nearest published base floor to $152,500, one per employer.
- Senior Software Engineer, Frontend Circle · base floor $152,500
- Software Validation Engineer, Energy Storage Redwood Materials · base floor $152,500
- Software Engineer - Crypto Data Foundations Coinbase · base floor $152,405
- Mechanical Design - Senior Engineering Manager GE Vernova · base floor $152,400
- Senior Site Reliability Engineer JPMorgan Chase · base floor $152,600
This listingSr. Software Development Engineer in Test, AI/ML$152,500 – $228,700
Data Engineer II, JVM$150,100 – $225,100
Data Engineer II, JVM$150,100 – $225,100
Data Engineer II, JVM$150,100 – $225,100
ML Ops Engineer$150,100 – $225,100
Software Engineer II Platform Data Reliability$150,100 – $225,100
Senior Legal Operations Program Manager$149,800 – $224,600
Chart as a table
| Role | Published base |
|---|---|
| Sr. Software Development Engineer in Test, AI/ML (this listing) | $152,500 - $228,700 |
| Data Engineer II, JVM | $150,100 - $225,100 |
| Data Engineer II, JVM | $150,100 - $225,100 |
| Data Engineer II, JVM | $150,100 - $225,100 |
| ML Ops Engineer | $150,100 - $225,100 |
| Software Engineer II Platform Data Reliability | $150,100 - $225,100 |
| Senior Legal Operations Program Manager | $149,800 - $224,600 |
Observed changes
No changes to the pay or listing since we first observed this role on Nov 21, 2026 (today).
- First observed on the employer's board, already publishing a qualifying base salary
- Observed since
- Employer-stated posting date
- 2026-06-04
Where this pay comes from
Location as the employer wrote it: The estimated base pay range for this role is listed below.
USD 152,500 – 228,700 · interval unstated · pay_input_range · The estimated base pay range for this role is listed below. · base-labelled (R1: estimated base)
- Method
- Structured pay field published by the employer
- Checked
- Rule set
- us-base-v2
The employer's job board publishes this pay as a dedicated data field. We read the field directly; no interpretation was needed.
What we verified
- The pay figures come from the employer's own listing, quoted exactly above.
- The pay is an annual base salary in US dollars with a minimum of at least $100,000.
- The role was publicly listed on the employer's job board when last checked.
We do not verify what the employer will actually offer, whether the employer is still recruiting for the role, or anything beyond what the employer published. Full methodology.