Skip to content

Run Selected/Failed Tests or combine Tests which doesn't fall under a pattern  #2776

@rjonam

Description

@rjonam

What are you trying to achieve?

Adding new option to run and run-workers to rerun the failed tests or the selected tests. Option added in --rerun-tests.

Working Nature :

  • When the run is initiated and when script(s) fail, the test script will be added in failedCases.json file.
  • When the rerun is initiated with the run --rerun-test or run-workers 2 --rerun-test command, test files will be picked from the json file instead of the config file.
  • Failed Tests will be updated from the last execution regardless of the mode it ran(either run or run --rerun-tests)
  • When all the tests are passed in the last execution, failesCases.json file be deleted from the project folder.
  • We can add files from different folders, files which doesn't falls under a single pattern etc.
  • When a invalid files or files are provided in the json file, message will be thrown with the invalid file.
  • When there is no failedCases.json file or no tests in the failedCases.json file and the run is initiated, appropriate message will be displayed to the user.

Benefits :

  • If the failed scripts need to run against different environments, it could be accomplished with this approach.
  • You can create failedCases.json manually and run the specific scripts you want to execute using the above commands.
  • This would be much useful, if you want to run the scripts which doesn't come under a pattern and from test files from different folders.

Console Outputs :

Failed Scripts when run-workers

1  Worker Failed Scripts

Failed Worker Script In Failed Cases

2 Failed Worker Script In Failed Cases JSON

Rerun Of the Failed Script

3 Rerun Of the Failed Script

Failed Cases JSON removed after the Failed Script succeeded

4 Failed Cases JSON removed after the Failed Script succeeded

Retries Captured In Allure

5 Retries Captured In Allure

Invalid Files Identification

Invalid Files Identification

Running Files From Two Different Folder

Running Files From Two Different Folder

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions