You use soak testing to find issues that come up during extended work with the server, like server memory leaks.
Ideally, at the end of a test run, the server performance should be the same as it was at the beginning of the test. The decrease in performance can indicate that the server code has some issues.
To create baseline tests, we recommend using the Baseline load test template. By default, it will create a test with the following parameters:
Parameter | Value |
|---|---|
24 hours | |
VUs | |
Fixed, 50 virtual users (25 for trial users) | |
One second (100 ms for trial users) | |
15 seconds | |
Time taken – Average; Time taken – Max; Assertion failures – Per Second; |
As an option, you can configure server monitors.
ReadyAPI will create two statistics charts, one for the load test and another for the server monitors.
Alternatively, you can create a load test with similar parameters manually.
Here is what the first 30 minutes of your test may look like:
 |
To estimate the server performance, you can track various server-side metrics or use assertions.
With ReadyAPI, you can track various server-side metrics like memory and CPU usage, the number of database requests per second, and so on. To do this, you need to configure server monitors in your load tests. For detailed information, see the topics of the Server Monitoring section.
You can check metric data on the Server Monitoring and Statistics pages of the load test inspector.
The exact metrics to be checked depend on your server type and on the type of your server applications. For information on the available metrics, see Monitor Reference.
You can try using the following assertions:
Assertions | Description |
|---|---|
Test Target – Time Taken | Lets you control the request simulation time. (Memory leaks typically lead to slowdowns.) The Time Taken assertion on the Test Steps page will help you check if a certain test step takes too long to be executed. |
Test Steps – <Test Step Name> – Time Taken | |
Load Test – Failures – Total | Lets you check the total number of errors that occur during the test run. |
Test Target – Failures – Total | |
Test Steps – <Test Step Name> – Failed |
Let's suppose that the expected load for your server is 10 users, and the simulated test case lasts for 10 seconds.
If you use the VUs load type, set it up so that 12 users are simulated. If the server starts to slow down, ReadyAPI Performance will keep 10 users working with the server, but the target test case will take longer to run. You will be able to see it on the graph – the Time Taken metric will increase.
If you use the Rate load type, set it up so that a user arrives to the server each second. For the first hour, this test will simulate 10 users on the average. If server responses slow down, you will notice the user build-up on the server. If the server slows down by 50%, there will be about 50% more users working with it. This will create more test cases and the server will slow down much faster than in the situation when you are using the VUs load type.