Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr Software Development Engineer in Test, ML

$183k - $274.6k
Full-time

PlayStation Global

Why Sony Interactive Entertainment? Sony Interactive Entertainment isn’t just the Best Place to Play — it’s also the Best Place to Work. Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. As a subsidiary of Sony Group Corporation, we’re part of a proud legacy of innovation and excellence. SIE is a dynamic technology company, delivering cutting-edge hardware and network services to more than 100 million people and an entertainment leader, home to some of the most beloved and recognizable intellectual properties (IP) in the world. Our role at SIE is to create and nurture the experiences under the PlayStation brand, a name synonymous with entertainment excellence and creativity. At PlayStation, we're passionate about both partnership and technology. We care about building performant products and powerful tools, solving practical problems in delightful ways. We love building the systems that millions of people use, and we're always our own first customers and critics. We strive to be at the forefront of development technologies and celebrate our diversity with engineering teams located on four continents from all walks of life. We build our teams to be places where every voice is heard, all input is valued, and our members have the creative freedom to make their ideas real. PlayStation is seeking a Sr Software Development Engineer in Test, ML to join our San Mateo team and lead quality efforts for machine learning-powered products and services. You will partner closely with ML engineers, software engineers, product managers, and data partners to build scalable test automation and validation approaches for systems serving PlayStation at global scale. This role is focused on building confidence in model reliability, production readiness, and behavioral consistency. Unlike traditional software backend testing, success here requires validating probabilistic systems through score distributions, cohort-level behavior, thresholds, and statistical signals, not just deterministic pass/fail assertions.

RESPONSIBILITIES:

* Design, develop, and maintain automated test frameworks, test scripts for ML inference services and related ML platform components using python/Java * Build and automate realistic, representative test account creations and datasets to evaluate model behavior across different scenarios * Validate score distributions, ranking behavior, output quality, and other model signals for incoming ML models prior to release * Perform different types of testing, including functional, integration, regression and API testing working with RESTful APIs, microservices and databases, and non-functional performance and load testing to verify inference service scalability, latency requirements and reliability under production like conditions * Work closely with ML engineers and ops teams to ensure that all features and bug fixes come with automated test coverage, ensuring continuous integration and deployment
  • Debug and analyze test failures, model anomalies and report defects
  • Drive high standards of quality for both engineering decisions and
customer-facing features with optimal test and automation strategy * Develop and implement best practices for test automation that is highly scalable and maintainable
  • Monitor test execution and optimize performance in test environments
  • Come up with innovative solutions to organizational problems

REQUIRED QUALIFICATIONS:

  • Bachelor's degree or equivalent
  • 5+ years of experience as an SDET, with strong experience testing backend
systems.
  • Proficiency in Python/Java/Scala/go for test automation.
  • Hands-on experience with API testing tools (e.g., Postman or similar) for
distributed systems * Familiarity with CI/CD pipelines and test execution in Jenkins or similar environments such as jenkins, GitHub Actions, ArgoCD, etc * Hands-on experience building and maintaining automated test frameworks (e.g., pytest, JUnit, TestNG, etc.)Experience in working with databases for backend validation. * Experience with cloud and container technologies (AWS, GCP, Kubernetes, Docker, etc.) * Familiarity with monitoring and observability tools (e.g., Prometheus, Grafana, Datadog, etc.) for validating service health * Strong understanding of software development lifecycle (SDLC) and agile methodologies. * Excellent problem-solving skills and excellent communication skills.

PREFERRED QUALIFICATIONS:

* Experience testing machine learning systems, such as recommendation systems, search ranking systems, or other probabilistic ML application systems. * Experience creating synthetic or seeded test data to simulate realistic customer/account behaviors. * Experience evaluating model outputs using statistical techniques, distribution analysis, or scenario-based validation, rather than deterministic assertions. * Knowledge of data pipelines, feature stores, inference systems or model-serving infrastructure (Seldon, KServe, Ray Serve, etc.) is a plus.
  • Experience testing online services with high RPS and low latency requirements
  • Experience with performance and load testing tools (Locust, k6, Gatling,
JMeter, etc.) * Experience with Databricks or similar ML platform tooling At SIE, we consider several factors when setting each role’s base pay range, including the competitive benchmarking data for the market and geographic location. Please note that the base pay range may vary in line with our hybrid working policy and individual base pay will be determined based on job-related factors which may include knowledge, skills, experience, and location. In addition, this role is eligible for SIE’s top-tier benefits package that includes medical, dental, vision, matching 401(k), paid time off, wellness program and coveted employee discounts for Sony products. This role also may be eligible for a bonus package. Click here [ to learn more. The estimated base pay range for this role is listed below.

$183,000—$274,600 USD

Please note, Sony Interactive Entertainment conducts background checks at the offer stage for all new employees (which may include criminal background checks for some roles) and will need to process personal information to support these checks. Please refer to our Candidate Privacy Notice [ for more information about what personal information we collect, how we use it, who we share it with, and your data protection rights. Equal Opportunity Statement: Sony is an Equal Opportunity Employer. All persons will receive consideration for employment without regard to gender (including gender identity, gender expression and gender reassignment), race (including colour, nationality, ethnic or national origin), religion or belief, marital or civil partnership status, disability, age, sexual orientation, pregnancy, maternity or parental status, trade union membership or membership in any other legally protected category. We strive to create an inclusive environment, empower employees and embrace diversity. We encourage everyone to respond. Sony Interactive Entertainment is a Fair Chance employer and qualified applicants with arrest and conviction records will be considered for employment.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Sr Software Development Engineer in Test, ML in San Mateo, CA vacancy
  • $183k - $274.6k

     ...with entertainment excellence and creativity. Senior Software Development Engineer In Test, ML/AI At SIE, we believe in making play safer for everyone...  ...us make a difference! Overview We are hiring a Sr Software Engineer in Test specializing in ML/AI quality,... 
    Senior
    Full time

    PlayStation Global

    San Mateo, CA
    4 days ago
  • $183k - $274.6k

     ...Sr. Software Development Engineer in Test United States, San Mateo, CA Why PlayStation? PlayStation isn’t just the Best Place to Play — it’s also the Best Place to Work. Today, we’re recognized as a global leader in entertainment producing The PlayStation family of products... 
    Senior
    Immediate start

    PlayStation Network

    San Mateo, CA
    5 days ago
  •  ...design for our autonomous driving robots before public road deployment.  We are seeking a highly motivated V&V software development engineer in test (SDET) to join this systems-engineering department.  As a V&V SDET, you will be a technical lead, owning the end-to-... 
    Senior
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    a month ago
  • $183k - $274.6k

     ...nurture the experiences under the PlayStation brand, a name synonymous with entertainment excellence and creativity. Sr Software Development Engineer in Test Location: The primary location for this position is San Mateo, CA. However, we are also open to having this... 
    Senior
    Full time
    Shift work

    PlayStation Global

    San Mateo, CA
    3 days ago
  • $500 per month

     ...Your Role As a Senior Software Development Engineer in Test on the Platform Team, you will be responsible for improving the automated and manual testing infrastructure at Alpaca - helping our developers quickly and reliably deliver new features. We are looking for experienced... 
    Senior
    Home office

    Portage Ventures GP Inc.

    San Mateo, CA
    1 day ago
  •  ...Scientist Sit at the intersection of software engineering and data science. Leverage big data tools...  ...statistical analysis Fine tuning test results Train and retrain systems...  ...business needs and Implementing suitable AI/ML algorithms Skill Requirements:... 
    Senior
    Internship

    Veryfi

    San Mateo, CA
    5 days ago
  •  ...Job Description Job Description As a Software Development Engineer in Test on the Product Software Quality Assurance team, your role will focus on building scalable integration automation frameworks and enhancing existing frameworks for automated testing of mobile... 
    Senior
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    12 days ago
  • $30 - $35 per hour

     ...Title: Software Development Engineer in Test Job Type: Contract Contract Length: 6 months Pay Range: $30–$35/hr Start Date: ASAP Location: Onsite in Foster City, CA (5 days in office) About the Opportunity Our client, a leader in autonomous vehicle technology, is looking... 
    Contract work
    For contractors
    Work at office
    Immediate start

    DeWinter Group

    Foster, CA
    1 day ago
  • $193.3k - $289.9k

     ...codecs architecture design and development for PlayStation SDKs and...  ...accountability, leveraging ML-based techniques for video quality...  ..., hardware, and system software teams to investigate and resolve...  ...programming, or performance engineering. #LI-RG1 At SIE, we consider... 
    Senior

    Playstation Global

    San Mateo, CA
    5 days ago
  • $147.8k - $320.2k

    Genentech is looking for a highly motivated Senior/Principal Machine Learning Scientist in South San Francisco. This role is pivotal in developing machine learning models for drug discovery, requiring a deep understanding of perturbation data and collaboration with diverse...
    Senior

    Genentech

    South San Francisco, CA
    2 days ago
  • $147.8k - $320.2k

     ...models to enhance drug discovery processes. The ideal candidate should possess a PhD in a quantitative field and have strong expertise in ML frameworks. Responsibilities include collaborative project leadership and publication of research findings. The expected salary range... 
    Senior

    F. Hoffmann-La Roche AG

    South San Francisco, CA
    2 days ago
  • $170k - $220k

     ...Sr. ML Infrastructure Engineer II, Personalization San Mateo, CA We believe shopping should feel...  ...with data science to design online A/B tests Partner with product and data...  ...industry standard ~ Professional Development Reimbursement Program Work Authorization... 
    Senior
    Work at office
    3 days per week

    Slickdeals

    San Mateo, CA
    1 day ago
  • $193k - $239k

     ...everyone. As a Roblox Studio Platform Engineer, not only will you be one of the...  ...modeling, animation, complete SDLC and testing for teams and individual game developers...  ...looking for a highly motivated Senior Software Development Engineer in Test for  Roblox Studio... 
    Senior
    Full time
    Work experience placement
    Work at office
    Local area
    Monday to Friday

    Roblox

    San Mateo, CA
    more than 2 months ago
  • $312k

     ...excellence and creativity. Sr. Director Data Platform Engineering & Operations San Mateo,...  ...touchpoints. Lead the development of platforms that process...  ...data. Drive AI/ML adoption to enhance gaming...  ...LaunchDarkly , with a focus on A/B testing and feature management... 
    Senior
    Temporary work

    PlayStation Global

    San Mateo, CA
    3 days ago
  • $156.2k - $290.2k

    A leading biotechnology company in South San Francisco seeks a senior AI/ML computational scientist to contribute to the Digital Pathology group. This role focuses on developing computational methods for biomedical imaging and collaborating closely with pathologists and... 
    Senior
    Relocation package

    Genentech

    South San Francisco, CA
    3 days ago
  • $110k - $270k

     ...architecture. Quadric's co-optimized software and hardware is targeted to...  ...and track progress across engineering and cross-functional teams,...  ...technical projects in the AI/ML and embedded processing...  ...Kernels: Knowledge of AI kernel development and familiarity with popular... 
    Senior
    Work at office
    Local area
    Immediate start
    Flexible hours

    quadric.io, Inc

    Burlingame, CA
    22 days ago
  • $363k

     ...liaison between Sensing teams and the core ML system. Drive architectural evolution...  ...compute platforms by influencing Hardware-Software Co-Design . In this role, you will: System...  ...in Computer Science, Robotics, Electrical Engineering, or a related field with a focus on... 
    Temporary work
    Relocation package

    Zoox

    Foster, CA
    5 days ago
  •  ...Description Zoox's Advanced Hardware Engineering team is responsible for the design, development, and innovation of sensor...  ...extensively with cross-functional teams (software, mechanical, vehicle-integration,...  ...hardware to support AI/ML software ~ Track record of successful... 
    Senior
    Temporary work
    Work experience placement
    Relocation package

    Zoox

    Foster, CA
    11 days ago
  •  ...scale and operational excellence of Splunk and Cisco's global engineering capabilities. Our work spans networking, security, observability...  ...drift detection, incremental updates, and production monitoring of ML models. Strong Research Track Record – Publications in top... 
    Flexible hours

    Webex Events (formerly Socio)

    San Mateo, CA
    1 day ago
  • $169.1k - $270.8k

     ...Senior Consultant Data Engineer , you'll join our...  ...platform within an agile development environment. You'll...  ...development of next-generation software, incorporating machine...  ..., emphasizing unit testing, code reviews, and...  ..., and productizing AI/ML models. * Proficient... 
    Senior
    Work experience placement
    Work at office
    Local area
    Immediate start

    Visa

    San Mateo, CA
    4 days ago
  • $214k - $290k

     ...all people and objects that can move. Your role is to work on the ML model team to develop detection and tracking models and to...  ...the world's best sensor data and an incredible infrastructure for testing and validating your algorithms. We are creating new algorithms for... 
    Senior
    Relocation package

    Zoox

    San Mateo, CA
    5 days ago
  • $52 - $78 per hour

     ...nurture the experiences under the PlayStation brand, a name synonymous with entertainment excellence and creativity. Software Development Engineer in Test II (SDET II Contractor) Summary Would you like to help ensure the quality and reliability of PlayStation media... 
    Hourly pay
    Contract work
    For contractors

    PlayStation Global

    San Mateo, CA
    1 day ago
  • $140.5k - $210.7k

     ...technology our developers use to build extraordinary games? Sony Interactive Entertainment (PlayStation) is seeking a Software Development Engineer in Test (SDET) to provide hands-on engineering excellence across our SDK ecosystem. This role focuses on building tools and... 
    Full time

    PlayStation Global

    San Mateo, CA
    4 days ago
  • $277.35k - $330.33k

     ...leader with domain expertise in systems and software used to process and manage Cloud and on-...  ...Domain expertise in system or software engineering Capability of establishing working relationships...  ...systems and experience in AI/ML infrastructure Effective communications... 
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship
    Monday to Friday
    Flexible hours

    Roblox

    San Mateo, CA
    13 days ago
  • $60 - $65 per hour

     ...nurture the experiences under the PlayStation brand, a name synonymous with entertainment excellence and creativity. Software Development Engineer in Test - Contractor San Mateo, CA Do you have a passion for test automation? We are looking for self-motivated, quick... 
    Hourly pay
    Contract work
    For contractors

    PlayStation Global

    San Mateo, CA
    1 day ago
  • $52 - $78 per hour

     ...nurture the experiences under the PlayStation brand, a name synonymous with entertainment excellence and creativity. SOFTWARE DEVELOPMENT ENGINEER IN TEST CONTRACTOR (SDET CONTRACTOR) SUMMARY Would you like to help ensure the quality of PlayStation® peripherals and... 
    Hourly pay
    Contract work
    For contractors

    PlayStation Global

    San Mateo, CA
    1 day ago
  • $229k - $317k

     ...navigation in complex environments. As an engineer in the ODIN team, you will develop...  ...system. In this role, You will... Lead the development of multimodal large language models that...  ...scale data we have at Zoox. Drive end‑to‑end ML solutions from research to production, utilizing... 
    Senior

    Zoox

    Foster, CA
    1 day ago
  • $202.8k - $376.6k

     ...Present: Maintain scientific excellence by publishing in top‑tier ML/genomics venues and representing Genentech at global conferences...  ...Impact: Recognition via influential publications, open‑source software, invited presentations, or patents that have shaped the field. Compensation... 
    Senior
    Local area
    Relocation package

    F. Hoffmann-La Roche AG

    South San Francisco, CA
    3 days ago
  • $144k - $329.1k

     ...technical growth of AI Engineers and Data Scientists, instilling...  ...best practices in software engineering, algorithm...  ...and steer business development activities, forming enduring...  ...teams to design, test, deploy, and refine AI...  ...Science, Data Science or ML Preferred : MS in AI... 
    Senior
    Full time
    Summer holiday
    Flexible hours

    EY

    San Mateo, CA
    1 day ago
  •  ...Data Engineer Ready for a new challenge? Join Guidewire as a Data...  ...preparation and pipeline development for predictive modeling and machine...  ...Feature creation, initial testing, and ongoing management Work...  ...Glue, Redshift, EMR to build ML data pipelines, with a strong... 
    Senior

    Guidewire

    San Mateo, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr Software Development Engineer in Test, ML. Be the first to apply!