Last modified on November 18, 2020

Quick start

The BitBar Dashboard is where you can quickly create automated, live (or manual), or AI-driven tests, as well as view and analyze usage statistics, test run data, and used device data.

Dashboard UI overview

BitBar Dashboard

Click the image to enlarge it.

Usage statistics summary

  • Users – How many users are associated with your account. The main user is the first, and any additional users are added to that.

  • Used Devices – The number of devices used in your projects. This includes devices used by you and subusers attached to your account. Subusers see only devices used by them.

  • Projects – The number of projects created for which test runs have been executed by you and your subusers during the past month. Subusers only see their own projects.

  • Test Runs – How many test runs are run by any user attached to your account. Subusers only see runs of their own projects.

  • Test Run Success Ratio – The cumulative test case pass ratio from all the test runs done by you and your subusers for the past month. Subusers see only pass ratio of their own runs.

Test run summary

  • Device Execution Summary – Shows how the devices selected for test runs have performed. Depending on the test case, some devices may be excluded from the run because, for example, their API level is too old, or a processor is too slow.

  • Project Test Case Success Ratio – Shows the overall quality of the test executions per project. Success ratio includes subuser test runs, while subusers only see their own projects’ test runs.

  • Last 10 Test Runs – Shows the test and device success execution ratios. Each test run shows its execution start time. This list shows you how well your tests are maturing and performing on the different devices you are using in your testing. When you have a good test execution status but bad device success ratio, it indicates the selected devices do not perform well with your application. For example, the operating system on the devices is not compatible with your app. Similarly, if device execution is good but test success ratio is bad, there can be issues with the quality of your tests and this should be investigated and fixed.

Device usage statistics

The Device Usage Statistics table shows test run performance by device:

  • Device Model – The device name.

  • Usage (h) – How many hours the device has been used.

  • Usage (count) – How many times the device has been used.

  • Success Ratio – The overall device pass ratio from all the test runs done by you and your subusers. Subusers see only pass ratio of their own runs.

  • Device Failures – How many times the device failed.

Device usage statistics

Click the image to enlarge it.

You can filter the data shown in the table:

  1. Click the Filter by dropdown.

  2. Select Projects or Period.

  3. Select a project name or All to show data for a specific project or all projects.

    --or--

    Select the period to filter the table by:

    • All

    • 24 hours

    • Last 30 days

    • This billing period

To download the table data, click Download CSV.

Device OS usage statistic

  • OS type – The operating system name and version.

  • Usage (h) – How many hours the OS has been used.

  • Usage (count) – How many times the OS has been used.

  • Success Ratio – The overall OS pass ratio from all the test runs done by you and your subusers. Subusers see only pass ratio of their own runs.

  • Device Failures – How many times the device with the corresponding OS failed.

Device OS usage statistics

Click the image to enlarge it.

You can filter the data shown in the table:

  1. Click the Filter by dropdown.

  2. Select Projects or Period.

  3. Select a project name or All to show data for a specific project or all projects.

    --or--

    Select the period to filter the table by:

    • All

    • 24 hours

    • Last 30 days

    • This billing period

To download the table data, click Download CSV.

Tutorials

Samples

Highlight search results