Load Test And Scenario Statistics
ReadyAPI collects the following statistics for load tests and load test scenarios:
| Statistic | Description | Applicable Metrics | ||
|---|---|---|---|---|
| Arriving VU/s |
The number of arriving virtual users per second. |
Per Second | ||
| Running VUs |
The current number of virtual users simulating requests. The VUs load type only. Some virtual users may finish the test run before data is collected. These users will not be displayed. For example, if it takes less than a second to execute a scenario, this value may be 0. |
|||
|
The number of failed load test assertions.
|
||||
| Failures |
The number of errors that happened during the test run. Includes both simulation issues and failed target ReadyAPI Test test case runs. |
|||
| Request Failures |
The number of failed target functional test case runs. |
|||
| Test case runs |
The number of times target functional test cases were run. |
|||
| Time Taken |
The time taken to complete the load test or scenario in milliseconds. This metric collects test or scenario completion times for one second and calculates a value for that second only. |
Max, 98th percentile, 95th percentile, 90th percentile, COUNT, Min, Last, Sum, 75th percentile, Median, Standard Deviation, 25th percentile, Average |
Test Case Statistics
ReadyAPI collects the following statistics for test cases:
| Statistic | Description | Applicable Metrics |
|---|---|---|
| Completed |
The number of successful target functional test case runs. |
|
| Discarded |
The number of requests that were not sent because the internal queue was full. You can configure the queue size in ReadyAPI Preferences. |
|
| Failures |
The number of errors that happened during the test case run. Includes both simulation issues and failed functional test case runs. |
|
| Max |
The maximum time it takes to run a test case. This metric collects test case completion times during the entire scenario execution and updates its value every second. To get data for the entire test run, use the Time Taken – Max statistics. |
Max, 98th percentile, 95th percentile, 90th percentile, COUNT, Min, Last, Sum, 75th percentile, Median, Standard Deviation, 25th percentile, Average |
| Min |
The minimum time it takes to run a test case. This metric collects test case completion times during the entire scenario execution and updates its value every second. To get data for the entire test run, use the Time Taken – Min statistics. |
Max, 98th percentile, 95th percentile, 90th percentile, COUNT, Min, Last, Sum, 75th percentile, Median, Standard Deviation, 25th percentile, Average |
| Queued |
The number of the requests which are in the internal queue and waiting to be simulated. |
|
|
The size of the received response in bytes. |
Max, 98th percentile, 95th percentile, 90th percentile, COUNT, Min, Last, Sum, 75th percentile, Median, Standard Deviation, 25th percentile, Average |
|
| Running |
The number of currently running virtual users. |
|
| Sent |
The number of sent requests. |
|
| Throughput |
The amount of data or transactions per second handled by the server. |
|
| Time Taken Average |
The average time it takes to run a test case. This metric collects test case completion times during the entire scenario execution and updates its value every second. To get data for the entire test run, use the Time Taken Per Second – Average statistics. |
Max, 98th percentile, 95th percentile, 90th percentile, COUNT, Min, Last, Sum, 75th percentile, Median, Standard Deviation, 25th percentile, Average |
| Time Taken Per Second |
The time taken for requests in milliseconds. This metric collects request completion times for one second and calculates a value for that second only. |
Max, 98th percentile, 95th percentile, 90th percentile, COUNT, Min, Last, Sum, 75th percentile, Median, Standard Deviation, 25th percentile, Average |
Test Step Statistics
ReadyAPI Performance collects the following statistics for test steps:
| Statistic | Description | Applicable Metrics |
|---|---|---|
| Time Taken Average |
The average time it takes to run a test step. This metric collects test step completion times during the entire scenario execution and updates its value every second. To get data for the entire test run, use the Time Taken – Avg statistics. |
Max, 98th percentile, 95th percentile, 90th percentile, COUNT, Min, Last, Sum, 75th percentile, Median, Standard Deviation, 25th percentile, Average |
| Completed |
The number of completed requests. |
|
| Failed |
The number of failed requests (for example, because of socket timeout). |
|
| Max |
The maximum time it takes to run a test step. This metric collects test step completion times during the entire scenario execution and updates its value every second. To get data for the entire test run, use the Time Taken – Max statistics. |
Max, 98th percentile, 95th percentile, 90th percentile, COUNT, Min, Last, Sum, 75th percentile, Median, Standard Deviation, 25th percentile, Average |
| Min |
The minimum time it takes to run a test step. This metric collects test step completion times during the entire scenario execution and updates its value every second. To get data for the entire test run, use the Time Taken – Min statistics. |
Max, 98th percentile, 95th percentile, 90th percentile, COUNT, Min, Last, Sum, 75th percentile, Median, Standard Deviation, 25th percentile, Average |
| Time Taken |
The time taken for requests in milliseconds. This metric collects request completion times for one second and calculates a value for that second only. |
Max, 98th percentile, 95th percentile, 90th percentile, COUNT, Min, Last, Sum, 75th percentile, Median, Standard Deviation, 25th percentile, Average |
| Transactions |
The number of sent requests. |