Tutorials and Samples

• Users – How many users are associated with your account. The main user is the first, and any additional users are added to that.

• Devices/OSs – The number of devices used in your projects. This includes devices used by you and subusers attached to your account. Subusers see only devices used by them.

• Projects – The number of projects created for which test runs have been executed by you and your subusers during the past month. Subusers only see their own projects.

• Test Runs – How many test runs are run by any user attached to your account. Subusers only see runs of their own projects.

• Success Ratio – The cumulative test case pass ratio from all the test runs done by you and your subusers for the past month. Subusers see only pass ratio of their own runs.

• Execution Summary – Shows how the devices selected for test runs have performed. Depending on the test case, some devices may be excluded from the run because, for example, their API level is too old, or a processor is too slow.

• Project Test Case Success Ratio – Shows the overall quality of the test executions per project. Success ratio includes subuser test runs, while subusers only see their own projects’ test runs.

• Last 10 Automated Test Runs – Shows the test and device success execution ratios. Each test run shows its execution start time. This list shows you how well your tests are maturing and performing on the different devices you are using in your testing. When you have a good test execution status but bad device success ratio, it indicates the selected devices do not perform well with your application. For example, the operating system on the devices is not compatible with your app. Similarly, if device execution is good but test success ratio is bad, there can be issues with the quality of your tests and this should be investigated and fixed.

The Usage Statistics - Automation table shows test run performance by device or operating system:

• Device/OSs – The device or OS name.

The Usage Statistics - Automation table shows test run performance by device:

• Device/OSs – The device name.

• Usage (h) – How many hours the device or OS was used.

• Usage (count) – How many times the device or OS was used.

• Success Ratio – The overall device or OS pass ratio from all the test runs that you and your subusers did. Subusers see only pass ratio of their own runs.

• Failures – How many times the device failed.

Click the image to enlarge it.

Filter the table

Download the table

• OS type – The operating system name and version.

• Usage (h) – How many hours the OS were used.

• Usage (count) – How many times the OS were used.

• Success Ratio – The overall OS pass ratio from all the test runs that you and your subusers did. Subusers see only pass ratio of their own runs.

• Failures – How many times the device with the corresponding OS failed.

Click the image to enlarge it.

Filter the table

Download the table