Senior Performance Test Engineer

Job Description

Job Description

About Agadia 

We specialize in healthcare management technology and offer a suite of utilization management software solutions for our clients. Our mission is to improve the quality of care and expedite the delivery of health care services by advancing and automating utilization management processes. We are based in Parsippany, NJ, with clients across the United States. As we grow, we are looking for a detail-oriented, self-motivated, independent Software Engineer to help analyze, design, and refine business requirements.   

Agadia is seeking a Senior Performance Test Engineer to perform performance testing for its healthcare SaaS applications. The role covers requirements analysis, workload modeling, test automation, execution, bottleneck investigation, and reporting. The engineer will work with Development, QA, DevOps, Infrastructure, DBAs, and Production Support to validate performance, investigate regressions, and provide evidence for release and capacity decisions.

Roles and Responsibilities

• Collaborate with business and technical stakeholders to define measurable acceptance criteria for critical workflows, including response-time percentiles, throughput, error rates, and recovery behavior.
• Assess application architecture, dependencies, deployment topology, and production usage to develop performance test strategies, estimates, schedules, and entry and exit criteria.
• Design realistic workload models covering concurrent users, transaction arrival rates, customer mix, think time, pacing, peak periods, ramp-up and sustained load.
• Plan and execute baseline, load, stress, spike, endurance, and scalability tests; coordinate controlled failover and recovery tests with the responsible teams.
• Develop and maintain reusable JMeter or k6 scripts with authentication, session handling, dynamic value correlation, parameterization and assertions that verify successful business transactions.
• Build modular suites for case creation, review, sign-off, queue management and document management, with configurable customer profiles, user credentials and datasets.
• Prepare and manage approved synthetic or masked test data, including extraction, seeding, validation and cleanup; protect credentials and maintain customer data isolation.
• Validate test environment readiness, data volumes, cache state, and load-generator capacity; document differences that affect comparison with production.
• Monitor and correlate test results with Dynatrace or equivalent APM tooling, IIS and Windows metrics, application logs, and SQL Server activity.
• Investigate bottlenecks across application, API, database, and infrastructure layers, including slow queries, blocking, thread or connection pool contention, memory growth, and resource saturation.
• Compare releases against approved baselines, record reproducible performance defects, collaborate with engineering teams on remediation, and verify fixes through retesting.
• Provide measured capacity and scalability findings, with documented assumptions, to support infrastructure planning and growth forecasts.
• Integrate appropriate performance checks into Azure DevOps CI/CD pipelines and scheduled test runs; continuously improve scripts, framework reliability and reporting.
• Deliver technical reports and stakeholder summaries covering workload assumptions, results against targets, bottleneck evidence, business impact, limitations and release readiness recommendations.

Required Qualifications

• At least 5 years of hands-on experience in load and performance testing of web applications and APIs.
• Strong proficiency in JMeter or k6, including independent script development, debugging, maintenance, and command-line test execution.
• Sound understanding of performance testing concepts, workload modeling, and interpretation of latency percentiles, throughput, error rates, and resource utilization.
• Experience testing multi-tier applications, with working knowledge of REST APIs, JSON, authentication, session management, and dynamic data correlation.
• SQL proficiency for test data preparation, validation, and investigation of database-related performance issues.
• Experience using an application performance monitoring tool, server metrics, and logs to investigate bottlenecks and support findings with evidence.
• Ability to develop supporting automation using JavaScript, YAML, Groovy, or a comparable scripting language.
• Experience with Git, repeatable test execution, and performance regression analysis across software releases.
• Strong analytical, documentation, and communication skills, with the ability to manage testing priorities and explain findings to technical and business stakeholders.

Preferred Qualifications

• Experience with Dynatrace Managed and performance analysis of Windows Server, IIS, .NET, and SQL Server environments.
• Hands-on experience with both JMeter and k6, and integration of performance tests into Azure DevOps pipelines.
• Experience testing multi-tenant SaaS or healthcare applications and handling sensitive test data.
• Browser performance analysis using developer tools, Playwright, or k6 browser, alongside API and protocol-level load testing.
• Understanding Azure or AWS architecture, scalability, and migration performance validation; Azure experience is preferred.
• Exposure to background processing, caching, messaging, and failover or recovery validation.

Key Deliverables

• A maintained performance test strategy, workload model, and reusable regression suite.
• Release reports with clear pass or fail results, supporting evidence, test limitations, and unresolved performance risks.
• Verified remediation outcomes and capacity recommendations based on measured results.

Please note:  The Salary range is based on our market pay structure & includes benefits (Medical, Dental, Vision, life Insurance, 401 & PTO, etc.), and will be determined based on the candidate's experience, qualifications, and evaluation.
- Applicants must be legally authorized to work in the United States, and the company does not provide employment visa sponsorship now or in the future

Key Competencies 

Communicates effectively– Attentively listens to others, provides timely and helpful information and is effective in a range of professional settings. Gives and receives feedback in a productive, professional manner. Demonstrates excellent oral and written communication skills. 

Manages Ambiguity -Operating effectively, even when things are not certain, or the way forward is not clear. Is flexible in approach and is able to adapt their approach to meet changing business needs. 

Manages complexity -Makes sense of complex, high quantity, and sometimes contradictory information to effectively solve problems. Has strong organizational skills and is able to manage multiple activities at once. Has high attention to detail. 

Ensures Accountability -Follows through on commitments and makes sure others do the same. Able to work independently as part of a small team.