Vision AI

Applies to TestComplete 15.82, last modified on June 01, 2026

In this initial release, Vision AI is limited in scope and is not available across all TestComplete features. Support for checkpoints, operations, and Object Spy is planned for future releases.

Overview

Vision AI is a plugin capability that uses artificial intelligence (AI) to identify user interface elements based on their visual appearance on the screen instead of internal application properties.

When Visual Object Detection is enabled, TestComplete can send screenshots and user interface metadata from the tested application to SmartBear-hosted AI services for processing. Restart TestComplete after you enable or disable Visual Object Detection at any time in Install Extensions dialog.

TestComplete displays recognized elements in the Object Browser and uses them during recording and playback.

Vision AI supports both text and images for object recognition, while Optical Character Recognition (OCR) supports text recognition.

Supported Areas

Vision AI captures objects during test creation by using the following visual detection approach:

  • Test recording

TestComplete stores detected objects in the Object Browser.

To locate these detected objects:

  1. In the Object Browser, expand the application under test.

  2. Click the required Keyword Test Window.

Prerequisites

To use Vision AI, verify that the following prerequisites are met.

  • Verify that you have a TestComplete Pro Bundle license or an Intelligent Quality (IQ) add-on license.

  • Allow access to Vision AI service endpoints

    To use Vision AI, make sure that your environment can access the following endpoint:

    If the endpoint is not accessible, work with your IT services team to add them to the allow list.

  • Install and Enable Required Extensions

    1. Open TestComplete.

    2. Click File, and select Install Extensions.

    3. In the Install Extensions dialog, expand Intelligent Quality and verify that the Visual Object Detection checkbox is selected. If other check boxes within Intelligent Quality are also selected, this is an expected behavior.

    4. Click OK.

      Note: TestComplete may take a few moments to apply the extension changes.

    5. Restart TestComplete, if prompted.

Managing Vision AI Priority Order

To configure the priority order for application processes that use Vision AI, do the following:

  1. Open your project in TestComplete.

  2. At the project level, select Properties, and then click Visual Object Detection.

  3. Click Add.

  4. Enter the process name of the application that you want to prioritize for Vision AI, and then select the check box next to the process name to enable it.

  5. To apply the priority setting to all applications, enter * as the process name.

  6. Click OK to save the changes.

Note: You can add multiple application process names and enable or disable each entry individually. Applications that are not included in the Vision AI configuration continue to use the standard recognition priority order.

Creating Your First Vision AI Test

To create your first Vision AI test, perform the following:

  1. Open TestComplete.

  2. On the toolbar, select Record Keyword Test or Record Script.

  3. Select the target application window.

  4. Interact with the application according to your test scenario.

  5. Stop recording when the test scenario is complete.

Note: Upon interaction with the application, Vision AI will send a captured image to the Vision AI service, which will return a catalog of objects to the Object Browser.

Running a Recorded Test

  1. Open the recorded test.

  2. On the toolbar, select Run.

Scripting

When Visual Object Detection records user actions, TestComplete generates script commands that use the VODWindow method to interact with detected objects.

VODWindow is a TestComplete object-accessor method that locates and returns a matching Visual Object Detection (VOD) window object from any accessible process on the machine. You can use the returned object to perform direct user interface actions or access child controls.

The following example shows the script generated for recorded Visual Object Detection actions:

JavaScript, JScript
Copy Code

JavaScript, JScript

function Test1() {
  Sys.Process("xtop").VODWindow("HCS16139P", "*").Click(1058, 215);
  Sys.Process("xtop").VODWindow("HCS16139M").BOTTOM.Click();
  Sys.Process("xtop").VODWindow("HCS16139P", "*").Click(1057, 223);
  Sys.Process("xtop").VODWindow("HCS16139M").TOP.Click();
  Sys.Process("xtop").VODWindow("HCS16139P", "*").Click(1060, 215);
  Sys.Process("xtop").VODWindow("HCS16139M").StandardOrientation.Click();
}

The generated script can include coordinate-based clicks and direct interactions with detected objects exposed in the Object Browser.

TestComplete records detected objects by using the object names identified through Visual Object Detection during the recording session.

Note: For consistent playback results, use the same screen resolution, display scaling, and application layout that were used during recording.

Troubleshooting

If a recorded test does not run as expected:

  1. Review the recorded steps in the test.

  2. Remove or update incorrect or unnecessary actions.

  3. Run the test again.

Verify the following conditions:

  • The application is in the same state as it was during recording.

  • The screen resolution and display scaling are consistent.

  • No other user interface elements interfere with playback.

Limitations

Vision AI identifies elements based on what appears on the screen. Because of this approach, the following limitations apply:

  • The feature captures a screenshot at detection time. Run detection again after UI changes.

  • Some actions may apply to a broader screen area instead of a specific element.

  • Window actions depend on detection accuracy.

  • Playback relies on the position of elements on the screen.

  • Playback requires consistent environment settings.

  • Vision AI does not use Name Mapping.

  • Applications that are not included in the Vision AI configuration use the standard recognition priority order.

See Also

Object Identification
About TestComplete Platform, Modules and Add-Ons

Highlight search results