Performance Tester

Job Title

Management and Technical Skills Performance Testing Management and Problem Solving Responsibilities

Communicate performance test objectives, methods and measures of success to management audiences

Ability to manage and drive results across teams within the Billing program

Capable of explaining the value of the performance test plan and metrics to management audiences

Ability to provide direction and performance manage a small team of test automation specialists and test engineers

Ability to personally determine root cause of key solution performance and resiliency issues, understand trends and lead individual contributors through the process

Uses ingenuity in dealing with ambiguous situations, and guides others to cope effectively

Functional/Technical Skills & Market Knowledge

Possesses required functional and technical knowledge and skills to successfully manage, plan and validate solution performance consistent with the needs of a complex business critical solution The candidate should demonstrate ability to apply the following functional skills:

Benchmarking - Establishes objective performance test criteria for solution functions across the integrated solution. Identifies and manages critical success factors for applications under load

Solution Performance Measurement - Assesses the current state of application and its interactions to determine how the functional areas within the solution are performing with regard to what is acceptable from a business perspective. Illustrates which components are performing below, at and above target performance levels

Solution Resilience Measurement - Assesses the ability of the solution to recover from a failure against established goals for characteristics such as recovery point and recovery time objectives

Performance Test Automation Acumen – Understands and can explain performance, load, and SQL testing scripts. Describes how performance test automation strategies can standardize and scale the application T+2 years to T+5 years. Demonstrates ROI savings and conduct risk analysis performance test methodologies

Day to Day Role Expectations

Performance Test Planning Deliverables

Provide thought leadership in building robust and scalable enterprise scale software systems

Create Master Performance Test Strategy and Plan identifying response time, throughput, and resource utilization goals and constraints

Prepare the test environment, tools, and resources necessary to execute each strategy as features and components become available for test

Create performance test scenarios and test cases

Facilitate and procure the performance test data required to enable performance testing

Set and monitor test execution rate based on business criteria

Build performance test suites for core application functions and interfaces between systems

Review and validate the architecture, design and technology choices against NFRs

Performance Test Validation Deliverables

Establish a performance test baseline to validate that the performance of the overall system has not been impacted

Institute criteria for measuring and optimizing performance test results

Apply performance counters to the application code to set and record load threshold intervals and timings

Recommend remediation steps for address architecture and design issues in the existing system in order to improve performance and scalability

Analyze the testing issues using log files, heap dump, thread dump, resource usage data, profiling snapshots etc.

Work with vendor and client development teams in implementing the solutions proposed and solving the performance issue

Performance test data conversion functionality on partial and full data loads

Assignment and coordinate testing activities across performance test resources

Collaborate with AB QA Testing leadership as needed

Responsible to System/Integration test REST API's, User interface, Database, reporting, ETL/Batch technology components

Perform complex testing in related to data environments as needed to meet business performance objectives (source to target, data mining, data profiling, creation and execution of stored procedures, etc.)

Execute validated tests for analysis while monitoring results within the performance environment

Prepare and communicate management level performance test metrics, trends and hypothesis on root cause on a scheduled and ad hoc basis

Reprioritize tests as needed to drive performance issue identification and resolution

Qualifications

6+ years of experience, including data mining, profiling of application and its module theoretical minimums and maximums

Experience as a performance test lead for a complex business critical solution with multiple applications and interfaces

SPLUNK certification preferred

Language: Same as Automation Test Lead + experience with PHP

Tools: such as LoadRunner, Neoload, JMeter, LoadNet