Senior Software Engineer in Test

Location: US, Remote; Poland, Ukraine Title: Senior Software Developer in Test (SDET) Department: Technology About Napster Founded on the principle of democratizing access—first to music in 1999, now to creative expertise in 2025— Napster has consistently been at the forefront of transformational technology shifts that expand markets and empower users. The company’s latest platform turns passive consumers into active creators, providing the interface layer between foundation AI models and human creativity. For more information, visit napster.com. About the Role Napster is looking for a Senior Software Developer in Test to own test infrastructure strategy for our real-time AI agent platform. This is not a QA-as-afterthought role. You'll be embedded in the engineering organization, making framework decisions that outlast any single sprint, leading the team toward scalable automation patterns across both deterministic and AI-driven systems, and building load testing tooling that gives us confidence before production sees a spike - with scope that grows beyond this product over time. What You'll Own Test Framework Architecture Evaluate, propose, and drive adoption of test frameworks across the stack - including tooling for real-time, stateful session testing alongside conventional API and UI frameworks - with documented rationale, not just convention Define project structure, configuration standards, and execution model across multiple test layers: unit, contract, real-time/protocol, AI behavioral, and end-to-end Establish patterns for test data management, environment configuration, and cross-service dependency handling Champion a test pyramid strategy suited to a system that combines standard request/response APIs with persistent, real-time sessions Automation Leadership Lead automation design reviews - define what gets automated, at what layer, and why Establish and document automation patterns: service abstractions, fixture strategies, retry logic, test isolation contracts, and behavioral baselines for systems with non-deterministic output Mentor engineers on writing testable code and maintainable specs; conduct test code reviews with the same rigor as production code reviews Drive shift-left practices: bring testing into the design phase, not just the PR stage Load & Performance Testing Tooling Design and build internal load testing tooling and harnesses (extending k6, Locust, or Gatling) tailored to concurrent, real-time session load - not just standard throughput Develop reusable libraries for traffic shaping, scenario composition, and result aggregation Integrate load tests into CI/CD with configurable thresholds and automated regression alerts Build dashboards and reporting pipelines that translate raw load test output into actionable signals for engineering and product AI System Quality & Real-Time Reliability Build evaluation harnesses for systems with non-deterministic, AI-generated output — defining what "passing" means in terms of statistical baselines and acceptable variance, not exact-match assertions Own test coverage for real-time, stateful protocols, including session lifecycle, data stream integrity, and timing-sensitive interaction handling Partner with engineering to identify where AI output quality and system reliability intersect, and design tests that catch regressions in both Platform & Infrastructure Own test infrastructure: parallel execution environments, CI integration, flakiness detection, and test result observability Partner with DevOps/Platform teams to ensure test environments are production-representative Identify and remediate sources of test flakiness systematically What We're Looking For Required 4+ years of software engineering experience, with at least 2 years focused on test infrastructure, tooling, or automation engineering Strong proficiency in TypeScript/JavaScript; additional experience with Python or Go a plus Demonstrated experience proposing and implementing a test framework from scratch or significantly evolving an existing one Hands-on experience with load testing tools (k6, Locust, Gatling, JMeter, or equivalent) and the judgment to extend them Experience testing real-time, streaming, or other stateful/long-lived connection systems (e.g., WebSocket, gRPC streaming, message queues) Solid understanding of distributed systems concepts: request lifecycle, async patterns, eventual consistency, timeouts Experience integrating automated tests into CI/CD pipelines Preferred Experience testing or building systems involving LLMs or other non-deterministic AI components, including eval frameworks Familiarity with telephony, VoIP, or other low-level communication protocols Experience building internal developer tooling (CLIs, test runners, reporting dashboards) Familiarity with observability tooling (Grafana, Datadog, Prometheus) for correlating load test results with system metrics Knowledge of contract testing (Pact or similar) Experience in a platform or infrastructure engineering role Our Culture Impact: Play a crucial role in our growth journey. Culture: Join a vibrant team valuing creativity and collaboration. Growth: Thrive in a fast-paced, dynamic environment. Reward: Enjoy competitive compensation, equity opportunities, and comprehensive benefits. Ready to shape our future? Apply now and be part of something extraordinary! Napster Corp embraces a diversity of backgrounds and experiences and provides equal opportunity for all applicants and employees. We strive to build a company that reflects a global audience. #J-18808-Ljbffr F-Prime Capital