Skip to content

Allure: Skipped tests from before failure don't appear when running with workers #2391

@Georgegriff

Description

@Georgegriff

What are you trying to achieve?

Have skipped tests show when there are setup failures when running with workers

This test does not work with the functionality introduced here
https://github.com/Codeception/CodeceptJS/pull/2369/files

I did a bit of debugging using this unit test in allure_test.js
'should report BeforeSuite errors when executing via run-workers command'
The output of this test does not include 'Skipped due to failure in 'before' hook' where as the test 'should report BeforeSuite errors when executing via run command' does.
From what i could find. the code introduced here:
image
When running in workers there were no tests loaded into the suites object

In addition to thiis the above PR made 'should report BeforeSuite errors when executing via run command' test flakey, this can be fixed though i will fix in an upcoming PR

What do you get instead?

Skipped tests not reported

Provide console output if related. Use --verbose mode for more details.

# paste output here

Provide test source code if related

// paste test

Details

  • CodeceptJS version:
  • NodeJS Version:
  • Operating System:
  • puppeteer || webdriverio || protractor || testcafe version (if related)
  • Configuration file:
# paste config here

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions