dont run SpecialFunctions benchmarks by default#229
dont run SpecialFunctions benchmarks by default#229KristofferC wants to merge 1 commit intomasterfrom
Conversation
|
This definitely seems like a good idea!
This unfortunately is not the case, AFAICT. This PR causes the "specificalfunction" group to not be loaded at all if using It might make more sense to implement this in Nanosoldier.jl (changing the benchmark script here: https://github.com/JuliaCI/Nanosoldier.jl/blob/master/src/jobs/BenchmarkJob.jl#L336) than here. |
|
They're not important for most nanosoldier runs. It's just important to track that they don't regress over some major changes to the language itself. |
Running all the benchmarks for the special functions take a significant time and I am questioning the usefullness of testing this so carefully for every single nanosoldier run.
This PR makes them not be included in the
ALLbenchmarkgroup but IIUC you should still be able to run them explicitly using thespecialfunctiongroup.An alternative is to have a "meta group" called "JuliaLanguage" or something which tries to include stuff that tests the language, but still have everything go into
ALL.cc @jrevels, @pkofod, @ararslan