Stop Project Run on the N-th Error

Errors that occur during the test run can be caused by accidental reasons. Such errors can occur a few times during the project run, and you may want not to stop the test because of them. However, if a number of errors exceeds some limit, it will mean that something goes wrong, and the current project must be stopped.

To configure your project to stop when an error limit is reached:

1. Open the Variables page of your project and create an integer variable. Let’s call this variable ErrorCounter. It will store the number of errors occurred during the project run.

   

2. If your project does not have the Events collection, add it:

   

   Add an event control to the Events collection and create a handler for the OnLogError event:

   

3. Configure the event handler to increase the project variable value and to stop the test run when the limit is reached:

   • If you use scripts

     Insert the following code into the event handling routine:

     Show Code

     Show CodeHide Code

     In the following code snippet, 5 is the maximum number of “allowed” errors.

     JavaScript, JScript

     Python

     VBScript

     DelphiScript

     C++Script, C#Script

     JavaScript, JScript

     function GeneralEvents_OnLogError(Sender, LogParams)
     {
       Project.Variables.ErrorCounter++;
       if (Project.Variables.ErrorCounter >= 5)
        {
            Runner.Stop();
        }
     }

     Python

     def GeneralEvents_OnLogError(Sender, LogParams):
       Project.Variables.ErrorCounter+=1
       if Project.Variables.ErrorCounter >= 5: 
            Runner.Stop(True)

     VBScript

     Sub GeneralEvents_OnLogError(Sender, LogParams)
       Project.Variables.ErrorCounter = Project.Variables.ErrorCounter + 1
       If (Project.Variables.ErrorCounter >= 5) Then
          Runner.Stop()
       End If
     End Sub

     DelphiScript

     procedure GeneralEvents_OnLogError(Sender; LogParams);
     begin
       Project.Variables.ErrorCounter := Project.Variables.ErrorCounter + 1;
       if (Project.Variables.ErrorCounter >= 5) then
       begin
          Runner.Stop();
       end;
     end;

     C++Script, C#Script

     function GeneralEvents_OnLogError(Sender, LogParams)
     {
       Project["Variables"]["ErrorCounter"]++;
       if (Project["Variables"]["ErrorCounter"] >= 5)
        {
            Runner["Stop"]();
        }
     }

   • If you use keyword tests

     Show Instructions

     Show InstructionsHide Instructions

     1. Add the Set Variable Value operation to the event handler. Configure the operation to increase the value of the created ErrorCounter variable:

        

     2. Add the If... Then operation to the event handling keyword test. Specify the created variable for Value1, select Greater than or equal to from the Condition drop-down list and specify the limit of the errors for Value2.

        

     3. Add the Stop Execution operation as a child of the If... Then operation.

        

     4. Make sure the Stop current test only check box is cleared.

        

        To avoid recursive calling, make sure that the Error Message text box is empty.

4. Open the Test Items page of your project and set the On error property of all your test items to Continue running. Otherwise, the test run will be stopped on the first error.

   

See Also

Controlling Test Execution Flow
About Controlling Test Execution Flow
OnLogError Event
Runner.Stop Method
Stop Execution Operation