bench: add test_ls by efiop · Pull Request #344 · treeverse/dvc-bench

efiop · 2022-05-02T13:35:29Z

github-actions · 2022-05-02T14:55:51Z


----------------------------------------------------------------------------------- benchmark 'test_add-add': 5 tests ------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add (test_add/0001_main) 118.7119 (1.0) 118.7119 (1.0) 118.7119 (1.0) 0.0000 (1.0) 118.7119 (1.0) 0.0000 (1.0) 0;0 0.0084 (1.0) 1 1
test_add-add (test_add/0002_2.10.0) 140.3483 (1.18) 140.3483 (1.18) 140.3483 (1.18) 0.0000 (1.0) 140.3483 (1.18) 0.0000 (1.0) 0;0 0.0071 (0.85) 1 1
test_add-add (test_add/0003_2.9.5) 142.4377 (1.20) 142.4377 (1.20) 142.4377 (1.20) 0.0000 (1.0) 142.4377 (1.20) 0.0000 (1.0) 0;0 0.0070 (0.83) 1 1
test_add-add (test_add/0004_2.8.3) 143.4032 (1.21) 143.4032 (1.21) 143.4032 (1.21) 0.0000 (1.0) 143.4032 (1.21) 0.0000 (1.0) 0;0 0.0070 (0.83) 1 1
test_add-add (test_add/0005_2.6.3) 132.9035 (1.12) 132.9035 (1.12) 132.9035 (1.12) 0.0000 (1.0) 132.9035 (1.12) 0.0000 (1.0) 0;0 0.0075 (0.89) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_checkout-checkout': 5 tests ------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout-checkout (test_checkout/0001_main) 33.6785 (1.54) 33.6785 (1.54) 33.6785 (1.54) 0.0000 (1.0) 33.6785 (1.54) 0.0000 (1.0) 0;0 0.0297 (0.65) 1 1
test_checkout-checkout (test_checkout/0002_2.10.0) 36.0030 (1.65) 36.0030 (1.65) 36.0030 (1.65) 0.0000 (1.0) 36.0030 (1.65) 0.0000 (1.0) 0;0 0.0278 (0.61) 1 1
test_checkout-checkout (test_checkout/0003_2.9.5) 35.8150 (1.64) 35.8150 (1.64) 35.8150 (1.64) 0.0000 (1.0) 35.8150 (1.64) 0.0000 (1.0) 0;0 0.0279 (0.61) 1 1
test_checkout-checkout (test_checkout/0004_2.8.3) 30.1270 (1.38) 30.1270 (1.38) 30.1270 (1.38) 0.0000 (1.0) 30.1270 (1.38) 0.0000 (1.0) 0;0 0.0332 (0.72) 1 1
test_checkout-checkout (test_checkout/0005_2.6.3) 21.8253 (1.0) 21.8253 (1.0) 21.8253 (1.0) 0.0000 (1.0) 21.8253 (1.0) 0.0000 (1.0) 0;0 0.0458 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------------- benchmark 'test_checkout-checkout-noop': 5 tests ----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout-checkout-noop (test_checkout/0001_main) 1.9379 (1.84) 1.9379 (1.84) 1.9379 (1.84) 0.0000 (1.0) 1.9379 (1.84) 0.0000 (1.0) 0;0 0.5160 (0.54) 1 1
test_checkout-checkout-noop (test_checkout/0002_2.10.0) 1.9284 (1.83) 1.9284 (1.83) 1.9284 (1.83) 0.0000 (1.0) 1.9284 (1.83) 0.0000 (1.0) 0;0 0.5186 (0.55) 1 1
test_checkout-checkout-noop (test_checkout/0003_2.9.5) 1.9647 (1.86) 1.9647 (1.86) 1.9647 (1.86) 0.0000 (1.0) 1.9647 (1.86) 0.0000 (1.0) 0;0 0.5090 (0.54) 1 1
test_checkout-checkout-noop (test_checkout/0004_2.8.3) 2.2309 (2.12) 2.2309 (2.12) 2.2309 (2.12) 0.0000 (1.0) 2.2309 (2.12) 0.0000 (1.0) 0;0 0.4483 (0.47) 1 1
test_checkout-checkout-noop (test_checkout/0005_2.6.3) 1.0535 (1.0) 1.0535 (1.0) 1.0535 (1.0) 0.0000 (1.0) 1.0535 (1.0) 0.0000 (1.0) 0;0 0.9493 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_checkout-checkout-update': 5 tests ------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout-checkout-update (test_checkout/0001_main) 10.5510 (1.0) 10.5510 (1.0) 10.5510 (1.0) 0.0000 (1.0) 10.5510 (1.0) 0.0000 (1.0) 0;0 0.0948 (1.0) 1 1
test_checkout-checkout-update (test_checkout/0002_2.10.0) 11.3485 (1.08) 11.3485 (1.08) 11.3485 (1.08) 0.0000 (1.0) 11.3485 (1.08) 0.0000 (1.0) 0;0 0.0881 (0.93) 1 1
test_checkout-checkout-update (test_checkout/0003_2.9.5) 11.5511 (1.09) 11.5511 (1.09) 11.5511 (1.09) 0.0000 (1.0) 11.5511 (1.09) 0.0000 (1.0) 0;0 0.0866 (0.91) 1 1
test_checkout-checkout-update (test_checkout/0004_2.8.3) 12.1224 (1.15) 12.1224 (1.15) 12.1224 (1.15) 0.0000 (1.0) 12.1224 (1.15) 0.0000 (1.0) 0;0 0.0825 (0.87) 1 1
test_checkout-checkout-update (test_checkout/0005_2.6.3) 29.5648 (2.80) 29.5648 (2.80) 29.5648 (2.80) 0.0000 (1.0) 29.5648 (2.80) 0.0000 (1.0) 0;0 0.0338 (0.36) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests ----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff (test_diff/0001_main) 18.7400 (1.05) 18.7400 (1.05) 18.7400 (1.05) 0.0000 (1.0) 18.7400 (1.05) 0.0000 (1.0) 0;0 0.0534 (0.95) 1 1
test_diff-diff (test_diff/0002_2.10.0) 18.4465 (1.04) 18.4465 (1.04) 18.4465 (1.04) 0.0000 (1.0) 18.4465 (1.04) 0.0000 (1.0) 0;0 0.0542 (0.97) 1 1
test_diff-diff (test_diff/0003_2.9.5) 17.8049 (1.0) 17.8049 (1.0) 17.8049 (1.0) 0.0000 (1.0) 17.8049 (1.0) 0.0000 (1.0) 0;0 0.0562 (1.0) 1 1
test_diff-diff (test_diff/0004_2.8.3) 19.5671 (1.10) 19.5671 (1.10) 19.5671 (1.10) 0.0000 (1.0) 19.5671 (1.10) 0.0000 (1.0) 0;0 0.0511 (0.91) 1 1
test_diff-diff (test_diff/0005_2.6.3) 31.9263 (1.79) 31.9263 (1.79) 31.9263 (1.79) 0.0000 (1.0) 31.9263 (1.79) 0.0000 (1.0) 0;0 0.0313 (0.56) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 5 tests ----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop (test_diff/0001_main) 1.2764 (1.02) 1.2764 (1.02) 1.2764 (1.02) 0.0000 (1.0) 1.2764 (1.02) 0.0000 (1.0) 0;0 0.7835 (0.98) 1 1
test_diff-diff-noop (test_diff/0002_2.10.0) 1.2825 (1.02) 1.2825 (1.02) 1.2825 (1.02) 0.0000 (1.0) 1.2825 (1.02) 0.0000 (1.0) 0;0 0.7797 (0.98) 1 1
test_diff-diff-noop (test_diff/0003_2.9.5) 1.2548 (1.0) 1.2548 (1.0) 1.2548 (1.0) 0.0000 (1.0) 1.2548 (1.0) 0.0000 (1.0) 0;0 0.7969 (1.0) 1 1
test_diff-diff-noop (test_diff/0004_2.8.3) 2.5902 (2.06) 2.5902 (2.06) 2.5902 (2.06) 0.0000 (1.0) 2.5902 (2.06) 0.0000 (1.0) 0;0 0.3861 (0.48) 1 1
test_diff-diff-noop (test_diff/0005_2.6.3) 15.8703 (12.65) 15.8703 (12.65) 15.8703 (12.65) 0.0000 (1.0) 15.8703 (12.65) 0.0000 (1.0) 0;0 0.0630 (0.08) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_gc-gc': 5 tests -------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc (test_gc/0001_main) 1.7063 (1.02) 1.7063 (1.02) 1.7063 (1.02) 0.0000 (1.0) 1.7063 (1.02) 0.0000 (1.0) 0;0 0.5861 (0.98) 1 1
test_gc-gc (test_gc/0002_2.10.0) 1.7236 (1.03) 1.7236 (1.03) 1.7236 (1.03) 0.0000 (1.0) 1.7236 (1.03) 0.0000 (1.0) 0;0 0.5802 (0.97) 1 1
test_gc-gc (test_gc/0003_2.9.5) 1.6756 (1.0) 1.6756 (1.0) 1.6756 (1.0) 0.0000 (1.0) 1.6756 (1.0) 0.0000 (1.0) 0;0 0.5968 (1.0) 1 1
test_gc-gc (test_gc/0004_2.8.3) 2.0050 (1.20) 2.0050 (1.20) 2.0050 (1.20) 0.0000 (1.0) 2.0050 (1.20) 0.0000 (1.0) 0;0 0.4987 (0.84) 1 1
test_gc-gc (test_gc/0005_2.6.3) 2.6769 (1.60) 2.6769 (1.60) 2.6769 (1.60) 0.0000 (1.0) 2.6769 (1.60) 0.0000 (1.0) 0;0 0.3736 (0.63) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get (test_get/0001_main) 92.2612 (2.06) 92.2612 (2.06) 92.2612 (2.06) 0.0000 (1.0) 92.2612 (2.06) 0.0000 (1.0) 0;0 0.0108 (0.49) 1 1
test_get-get (test_get/0002_2.10.0) 46.2527 (1.03) 46.2527 (1.03) 46.2527 (1.03) 0.0000 (1.0) 46.2527 (1.03) 0.0000 (1.0) 0;0 0.0216 (0.97) 1 1
test_get-get (test_get/0003_2.9.5) 44.8769 (1.0) 44.8769 (1.0) 44.8769 (1.0) 0.0000 (1.0) 44.8769 (1.0) 0.0000 (1.0) 0;0 0.0223 (1.0) 1 1
test_get-get (test_get/0004_2.8.3) 46.4363 (1.03) 46.4363 (1.03) 46.4363 (1.03) 0.0000 (1.0) 46.4363 (1.03) 0.0000 (1.0) 0;0 0.0215 (0.97) 1 1
test_get-get (test_get/0005_2.6.3) 55.5873 (1.24) 55.5873 (1.24) 55.5873 (1.24) 0.0000 (1.0) 55.5873 (1.24) 0.0000 (1.0) 0;0 0.0180 (0.81) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests -------------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help (test_help/0001_main) 193.5472 (1.0) 286.5324 (1.22) 211.0962 (1.01) 11.7310 (1.63) 208.1868 (1.00) 11.0672 (1.30) 15;5 4.7372 (0.99) 100 1
test_help---help (test_help/0002_2.10.0) 197.6561 (1.02) 249.5842 (1.07) 208.8655 (1.0) 7.1975 (1.0) 207.9970 (1.0) 8.5375 (1.0) 23;1 4.7878 (1.0) 100 1
test_help---help (test_help/0003_2.9.5) 196.3966 (1.01) 234.1992 (1.0) 209.9886 (1.01) 7.7759 (1.08) 208.5791 (1.00) 11.4081 (1.34) 32;1 4.7622 (0.99) 100 1
test_help---help (test_help/0004_2.8.3) 228.4284 (1.18) 294.9809 (1.26) 245.2946 (1.17) 10.0861 (1.40) 243.6350 (1.17) 11.1138 (1.30) 22;4 4.0767 (0.85) 100 1
test_help---help (test_help/0005_2.6.3) 246.0929 (1.27) 296.2582 (1.26) 261.4071 (1.25) 9.8904 (1.37) 259.3307 (1.25) 13.6256 (1.60) 33;2 3.8255 (0.80) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------- benchmark 'test_import-import': 5 tests -------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import (test_import/0001_main) 258.6313 (1.43) 258.6313 (1.43) 258.6313 (1.43) 0.0000 (1.0) 258.6313 (1.43) 0.0000 (1.0) 0;0 0.0039 (0.70) 1 1
test_import-import (test_import/0002_2.10.0) 269.4909 (1.49) 269.4909 (1.49) 269.4909 (1.49) 0.0000 (1.0) 269.4909 (1.49) 0.0000 (1.0) 0;0 0.0037 (0.67) 1 1
test_import-import (test_import/0003_2.9.5) 271.3853 (1.50) 271.3853 (1.50) 271.3853 (1.50) 0.0000 (1.0) 271.3853 (1.50) 0.0000 (1.0) 0;0 0.0037 (0.67) 1 1
test_import-import (test_import/0004_2.8.3) 212.8915 (1.18) 212.8915 (1.18) 212.8915 (1.18) 0.0000 (1.0) 212.8915 (1.18) 0.0000 (1.0) 0;0 0.0047 (0.85) 1 1
test_import-import (test_import/0005_2.6.3) 180.9223 (1.0) 180.9223 (1.0) 180.9223 (1.0) 0.0000 (1.0) 180.9223 (1.0) 0.0000 (1.0) 0;0 0.0055 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------- benchmark 'test_init-init': 5 tests -------------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init (test_init/0001_main) 397.2473 (1.0) 829.8732 (1.87) 418.4234 (1.00) 46.9791 (5.49) 411.3108 (1.0) 10.4312 (1.03) 3;4 2.3899 (1.00) 100 1
test_init-init (test_init/0002_2.10.0) 421.1210 (1.06) 466.0753 (1.05) 438.7860 (1.05) 8.6954 (1.02) 436.1181 (1.06) 13.1525 (1.30) 32;1 2.2790 (0.95) 100 1
test_init-init (test_init/0003_2.9.5) 409.4294 (1.03) 463.9501 (1.04) 423.5587 (1.02) 8.5529 (1.0) 421.5873 (1.02) 10.1130 (1.0) 32;2 2.3609 (0.98) 100 1
test_init-init (test_init/0004_2.8.3) 412.6972 (1.04) 560.3789 (1.26) 429.7821 (1.03) 15.7725 (1.84) 427.2338 (1.04) 10.6446 (1.05) 7;2 2.3268 (0.97) 100 1
test_init-init (test_init/0005_2.6.3) 401.6554 (1.01) 444.2074 (1.0) 416.5930 (1.0) 8.5904 (1.00) 415.3797 (1.01) 11.4410 (1.13) 34;2 2.4004 (1.0) 100 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests --------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list (test_list/0001_main) 1.1457 (2.15) 1.1457 (2.15) 1.1457 (2.15) 0.0000 (1.0) 1.1457 (2.15) 0.0000 (1.0) 0;0 0.8728 (0.47) 1 1
test_list-list (test_list/0002_2.10.0) 1.1240 (2.11) 1.1240 (2.11) 1.1240 (2.11) 0.0000 (1.0) 1.1240 (2.11) 0.0000 (1.0) 0;0 0.8897 (0.47) 1 1
test_list-list (test_list/0003_2.9.5) 1.0940 (2.05) 1.0940 (2.05) 1.0940 (2.05) 0.0000 (1.0) 1.0940 (2.05) 0.0000 (1.0) 0;0 0.9140 (0.49) 1 1
test_list-list (test_list/0004_2.8.3) 0.6431 (1.21) 0.6431 (1.21) 0.6431 (1.21) 0.0000 (1.0) 0.6431 (1.21) 0.0000 (1.0) 0;0 1.5549 (0.83) 1 1
test_list-list (test_list/0005_2.6.3) 0.5330 (1.0) 0.5330 (1.0) 0.5330 (1.0) 0.0000 (1.0) 0.5330 (1.0) 0.0000 (1.0) 0;0 1.8762 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests ----------------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only (test_list/0001_main) 966.9206 (2.35) 966.9206 (2.35) 966.9206 (2.35) 0.0000 (1.0) 966.9206 (2.35) 0.0000 (1.0) 0;0 1.0342 (0.43) 1 1
test_list-list-dvc-only (test_list/0002_2.10.0) 1,020.2124 (2.48) 1,020.2124 (2.48) 1,020.2124 (2.48) 0.0000 (1.0) 1,020.2124 (2.48) 0.0000 (1.0) 0;0 0.9802 (0.40) 1 1
test_list-list-dvc-only (test_list/0003_2.9.5) 1,030.2510 (2.50) 1,030.2510 (2.50) 1,030.2510 (2.50) 0.0000 (1.0) 1,030.2510 (2.50) 0.0000 (1.0) 0;0 0.9706 (0.40) 1 1
test_list-list-dvc-only (test_list/0004_2.8.3) 412.9578 (1.00) 412.9578 (1.00) 412.9578 (1.00) 0.0000 (1.0) 412.9578 (1.00) 0.0000 (1.0) 0;0 2.4216 (1.00) 1 1
test_list-list-dvc-only (test_list/0005_2.6.3) 411.3347 (1.0) 411.3347 (1.0) 411.3347 (1.0) 0.0000 (1.0) 411.3347 (1.0) 0.0000 (1.0) 0;0 2.4311 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_list-list-url': 5 tests --------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-url (test_list/0001_main) 1.0840 (2.23) 1.0840 (2.23) 1.0840 (2.23) 0.0000 (1.0) 1.0840 (2.23) 0.0000 (1.0) 0;0 0.9225 (0.45) 1 1
test_list-list-url (test_list/0002_2.10.0) 1.1460 (2.36) 1.1460 (2.36) 1.1460 (2.36) 0.0000 (1.0) 1.1460 (2.36) 0.0000 (1.0) 0;0 0.8726 (0.42) 1 1
test_list-list-url (test_list/0003_2.9.5) 1.1334 (2.33) 1.1334 (2.33) 1.1334 (2.33) 0.0000 (1.0) 1.1334 (2.33) 0.0000 (1.0) 0;0 0.8823 (0.43) 1 1
test_list-list-url (test_list/0004_2.8.3) 0.4865 (1.00) 0.4865 (1.00) 0.4865 (1.00) 0.0000 (1.0) 0.4865 (1.00) 0.0000 (1.0) 0;0 2.0556 (1.00) 1 1
test_list-list-url (test_list/0005_2.6.3) 0.4858 (1.0) 0.4858 (1.0) 0.4858 (1.0) 0.0000 (1.0) 0.4858 (1.0) 0.0000 (1.0) 0;0 2.0585 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_list-list-url-dvc-only': 5 tests --------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-url-dvc-only (test_list/0001_main) 1.0573 (2.17) 1.0573 (2.17) 1.0573 (2.17) 0.0000 (1.0) 1.0573 (2.17) 0.0000 (1.0) 0;0 0.9458 (0.46) 1 1
test_list-list-url-dvc-only (test_list/0002_2.10.0) 1.1335 (2.33) 1.1335 (2.33) 1.1335 (2.33) 0.0000 (1.0) 1.1335 (2.33) 0.0000 (1.0) 0;0 0.8823 (0.43) 1 1
test_list-list-url-dvc-only (test_list/0003_2.9.5) 1.1256 (2.31) 1.1256 (2.31) 1.1256 (2.31) 0.0000 (1.0) 1.1256 (2.31) 0.0000 (1.0) 0;0 0.8884 (0.43) 1 1
test_list-list-url-dvc-only (test_list/0004_2.8.3) 0.4867 (1.0) 0.4867 (1.0) 0.4867 (1.0) 0.0000 (1.0) 0.4867 (1.0) 0.0000 (1.0) 0;0 2.0547 (1.0) 1 1
test_list-list-url-dvc-only (test_list/0005_2.6.3) 0.4882 (1.00) 0.4882 (1.00) 0.4882 (1.00) 0.0000 (1.0) 0.4882 (1.00) 0.0000 (1.0) 0;0 2.0484 (1.00) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------------- benchmark 'test_pull-pull': 5 tests ----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_pull-pull (test_pull/0001_main) 81.7331 (1.27) 81.7331 (1.27) 81.7331 (1.27) 0.0000 (1.0) 81.7331 (1.27) 0.0000 (1.0) 0;0 0.0122 (0.79) 1 1
test_pull-pull (test_pull/0002_2.10.0) 90.8954 (1.41) 90.8954 (1.41) 90.8954 (1.41) 0.0000 (1.0) 90.8954 (1.41) 0.0000 (1.0) 0;0 0.0110 (0.71) 1 1
test_pull-pull (test_pull/0003_2.9.5) 90.7111 (1.41) 90.7111 (1.41) 90.7111 (1.41) 0.0000 (1.0) 90.7111 (1.41) 0.0000 (1.0) 0;0 0.0110 (0.71) 1 1
test_pull-pull (test_pull/0004_2.8.3) 81.6507 (1.27) 81.6507 (1.27) 81.6507 (1.27) 0.0000 (1.0) 81.6507 (1.27) 0.0000 (1.0) 0;0 0.0122 (0.79) 1 1
test_pull-pull (test_pull/0005_2.6.3) 64.5035 (1.0) 64.5035 (1.0) 64.5035 (1.0) 0.0000 (1.0) 64.5035 (1.0) 0.0000 (1.0) 0;0 0.0155 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests ----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push (test_push/0001_main) 70.6601 (1.21) 70.6601 (1.21) 70.6601 (1.21) 0.0000 (1.0) 70.6601 (1.21) 0.0000 (1.0) 0;0 0.0142 (0.83) 1 1
test_push-push (test_push/0002_2.10.0) 79.0436 (1.35) 79.0436 (1.35) 79.0436 (1.35) 0.0000 (1.0) 79.0436 (1.35) 0.0000 (1.0) 0;0 0.0127 (0.74) 1 1
test_push-push (test_push/0003_2.9.5) 79.1654 (1.35) 79.1654 (1.35) 79.1654 (1.35) 0.0000 (1.0) 79.1654 (1.35) 0.0000 (1.0) 0;0 0.0126 (0.74) 1 1
test_push-push (test_push/0004_2.8.3) 73.9448 (1.26) 73.9448 (1.26) 73.9448 (1.26) 0.0000 (1.0) 73.9448 (1.26) 0.0000 (1.0) 0;0 0.0135 (0.79) 1 1
test_push-push (test_push/0005_2.6.3) 58.5291 (1.0) 58.5291 (1.0) 58.5291 (1.0) 0.0000 (1.0) 58.5291 (1.0) 0.0000 (1.0) 0;0 0.0171 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_sharing-add': 5 tests ------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add (test_sharing/0001_main) 82.8339 (1.0) 82.8339 (1.0) 82.8339 (1.0) 0.0000 (1.0) 82.8339 (1.0) 0.0000 (1.0) 0;0 0.0121 (1.0) 1 1
test_sharing-add (test_sharing/0002_2.10.0) 94.9467 (1.15) 94.9467 (1.15) 94.9467 (1.15) 0.0000 (1.0) 94.9467 (1.15) 0.0000 (1.0) 0;0 0.0105 (0.87) 1 1
test_sharing-add (test_sharing/0003_2.9.5) 92.3865 (1.12) 92.3865 (1.12) 92.3865 (1.12) 0.0000 (1.0) 92.3865 (1.12) 0.0000 (1.0) 0;0 0.0108 (0.90) 1 1
test_sharing-add (test_sharing/0004_2.8.3) 95.0604 (1.15) 95.0604 (1.15) 95.0604 (1.15) 0.0000 (1.0) 95.0604 (1.15) 0.0000 (1.0) 0;0 0.0105 (0.87) 1 1
test_sharing-add (test_sharing/0005_2.6.3) 85.9165 (1.04) 85.9165 (1.04) 85.9165 (1.04) 0.0000 (1.0) 85.9165 (1.04) 0.0000 (1.0) 0;0 0.0116 (0.96) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 5 tests -----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop (test_sharing/0001_main) 36.6736 (5.81) 36.6736 (5.81) 36.6736 (5.81) 0.0000 (1.0) 36.6736 (5.81) 0.0000 (1.0) 0;0 0.0273 (0.17) 1 1
test_sharing-add-noop (test_sharing/0002_2.10.0) 39.7788 (6.30) 39.7788 (6.30) 39.7788 (6.30) 0.0000 (1.0) 39.7788 (6.30) 0.0000 (1.0) 0;0 0.0251 (0.16) 1 1
test_sharing-add-noop (test_sharing/0003_2.9.5) 38.7348 (6.13) 38.7348 (6.13) 38.7348 (6.13) 0.0000 (1.0) 38.7348 (6.13) 0.0000 (1.0) 0;0 0.0258 (0.16) 1 1
test_sharing-add-noop (test_sharing/0004_2.8.3) 12.0482 (1.91) 12.0482 (1.91) 12.0482 (1.91) 0.0000 (1.0) 12.0482 (1.91) 0.0000 (1.0) 0;0 0.0830 (0.52) 1 1
test_sharing-add-noop (test_sharing/0005_2.6.3) 6.3161 (1.0) 6.3161 (1.0) 6.3161 (1.0) 0.0000 (1.0) 6.3161 (1.0) 0.0000 (1.0) 0;0 0.1583 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 5 tests ----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop (test_sharing/0001_main) 1.9172 (1.76) 1.9172 (1.76) 1.9172 (1.76) 0.0000 (1.0) 1.9172 (1.76) 0.0000 (1.0) 0;0 0.5216 (0.57) 1 1
test_sharing-checkout-noop (test_sharing/0002_2.10.0) 2.1002 (1.92) 2.1002 (1.92) 2.1002 (1.92) 0.0000 (1.0) 2.1002 (1.92) 0.0000 (1.0) 0;0 0.4761 (0.52) 1 1
test_sharing-checkout-noop (test_sharing/0003_2.9.5) 1.8215 (1.67) 1.8215 (1.67) 1.8215 (1.67) 0.0000 (1.0) 1.8215 (1.67) 0.0000 (1.0) 0;0 0.5490 (0.60) 1 1
test_sharing-checkout-noop (test_sharing/0004_2.8.3) 2.0815 (1.91) 2.0815 (1.91) 2.0815 (1.91) 0.0000 (1.0) 2.0815 (1.91) 0.0000 (1.0) 0;0 0.4804 (0.52) 1 1
test_sharing-checkout-noop (test_sharing/0005_2.6.3) 1.0913 (1.0) 1.0913 (1.0) 1.0913 (1.0) 0.0000 (1.0) 1.0913 (1.0) 0.0000 (1.0) 0;0 0.9163 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------------- benchmark 'test_sharing-pull': 5 tests -------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull (test_sharing/0001_main) 89.5898 (1.25) 89.5898 (1.25) 89.5898 (1.25) 0.0000 (1.0) 89.5898 (1.25) 0.0000 (1.0) 0;0 0.0112 (0.80) 1 1
test_sharing-pull (test_sharing/0002_2.10.0) 101.4402 (1.42) 101.4402 (1.42) 101.4402 (1.42) 0.0000 (1.0) 101.4402 (1.42) 0.0000 (1.0) 0;0 0.0099 (0.70) 1 1
test_sharing-pull (test_sharing/0003_2.9.5) 99.0057 (1.39) 99.0057 (1.39) 99.0057 (1.39) 0.0000 (1.0) 99.0057 (1.39) 0.0000 (1.0) 0;0 0.0101 (0.72) 1 1
test_sharing-pull (test_sharing/0004_2.8.3) 90.0513 (1.26) 90.0513 (1.26) 90.0513 (1.26) 0.0000 (1.0) 90.0513 (1.26) 0.0000 (1.0) 0;0 0.0111 (0.79) 1 1
test_sharing-pull (test_sharing/0005_2.6.3) 71.4505 (1.0) 71.4505 (1.0) 71.4505 (1.0) 0.0000 (1.0) 71.4505 (1.0) 0.0000 (1.0) 0;0 0.0140 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 5 tests ----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull-noop (test_sharing/0001_main) 2.1995 (1.58) 2.1995 (1.58) 2.1995 (1.58) 0.0000 (1.0) 2.1995 (1.58) 0.0000 (1.0) 0;0 0.4547 (0.63) 1 1
test_sharing-pull-noop (test_sharing/0002_2.10.0) 2.1127 (1.52) 2.1127 (1.52) 2.1127 (1.52) 0.0000 (1.0) 2.1127 (1.52) 0.0000 (1.0) 0;0 0.4733 (0.66) 1 1
test_sharing-pull-noop (test_sharing/0003_2.9.5) 2.0603 (1.48) 2.0603 (1.48) 2.0603 (1.48) 0.0000 (1.0) 2.0603 (1.48) 0.0000 (1.0) 0;0 0.4854 (0.67) 1 1
test_sharing-pull-noop (test_sharing/0004_2.8.3) 2.3835 (1.71) 2.3835 (1.71) 2.3835 (1.71) 0.0000 (1.0) 2.3835 (1.71) 0.0000 (1.0) 0;0 0.4196 (0.58) 1 1
test_sharing-pull-noop (test_sharing/0005_2.6.3) 1.3902 (1.0) 1.3902 (1.0) 1.3902 (1.0) 0.0000 (1.0) 1.3902 (1.0) 0.0000 (1.0) 0;0 0.7193 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_sharing-push': 5 tests -----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push (test_sharing/0001_main) 48.3069 (1.17) 48.3069 (1.17) 48.3069 (1.17) 0.0000 (1.0) 48.3069 (1.17) 0.0000 (1.0) 0;0 0.0207 (0.86) 1 1
test_sharing-push (test_sharing/0002_2.10.0) 53.4842 (1.29) 53.4842 (1.29) 53.4842 (1.29) 0.0000 (1.0) 53.4842 (1.29) 0.0000 (1.0) 0;0 0.0187 (0.77) 1 1
test_sharing-push (test_sharing/0003_2.9.5) 49.3514 (1.19) 49.3514 (1.19) 49.3514 (1.19) 0.0000 (1.0) 49.3514 (1.19) 0.0000 (1.0) 0;0 0.0203 (0.84) 1 1
test_sharing-push (test_sharing/0004_2.8.3) 46.3312 (1.12) 46.3312 (1.12) 46.3312 (1.12) 0.0000 (1.0) 46.3312 (1.12) 0.0000 (1.0) 0;0 0.0216 (0.89) 1 1
test_sharing-push (test_sharing/0005_2.6.3) 41.3674 (1.0) 41.3674 (1.0) 41.3674 (1.0) 0.0000 (1.0) 41.3674 (1.0) 0.0000 (1.0) 0;0 0.0242 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 5 tests ----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop (test_sharing/0001_main) 1.0333 (1.0) 1.0333 (1.0) 1.0333 (1.0) 0.0000 (1.0) 1.0333 (1.0) 0.0000 (1.0) 0;0 0.9678 (1.0) 1 1
test_sharing-push-noop (test_sharing/0002_2.10.0) 1.1111 (1.08) 1.1111 (1.08) 1.1111 (1.08) 0.0000 (1.0) 1.1111 (1.08) 0.0000 (1.0) 0;0 0.9000 (0.93) 1 1
test_sharing-push-noop (test_sharing/0003_2.9.5) 1.0508 (1.02) 1.0508 (1.02) 1.0508 (1.02) 0.0000 (1.0) 1.0508 (1.02) 0.0000 (1.0) 0;0 0.9517 (0.98) 1 1
test_sharing-push-noop (test_sharing/0004_2.8.3) 1.0459 (1.01) 1.0459 (1.01) 1.0459 (1.01) 0.0000 (1.0) 1.0459 (1.01) 0.0000 (1.0) 0;0 0.9561 (0.99) 1 1
test_sharing-push-noop (test_sharing/0005_2.6.3) 1.2180 (1.18) 1.2180 (1.18) 1.2180 (1.18) 0.0000 (1.0) 1.2180 (1.18) 0.0000 (1.0) 0;0 0.8210 (0.85) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests -----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status (test_status/0001_main) 31.7522 (1.0) 31.7522 (1.0) 31.7522 (1.0) 0.0000 (1.0) 31.7522 (1.0) 0.0000 (1.0) 0;0 0.0315 (1.0) 1 1
test_status-status (test_status/0002_2.10.0) 48.7814 (1.54) 48.7814 (1.54) 48.7814 (1.54) 0.0000 (1.0) 48.7814 (1.54) 0.0000 (1.0) 0;0 0.0205 (0.65) 1 1
test_status-status (test_status/0003_2.9.5) 48.7741 (1.54) 48.7741 (1.54) 48.7741 (1.54) 0.0000 (1.0) 48.7741 (1.54) 0.0000 (1.0) 0;0 0.0205 (0.65) 1 1
test_status-status (test_status/0004_2.8.3) 52.6667 (1.66) 52.6667 (1.66) 52.6667 (1.66) 0.0000 (1.0) 52.6667 (1.66) 0.0000 (1.0) 0;0 0.0190 (0.60) 1 1
test_status-status (test_status/0005_2.6.3) 50.2676 (1.58) 50.2676 (1.58) 50.2676 (1.58) 0.0000 (1.0) 50.2676 (1.58) 0.0000 (1.0) 0;0 0.0199 (0.63) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_status-status-changed': 5 tests -----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed (test_status/0001_main) 19.4620 (1.0) 19.4620 (1.0) 19.4620 (1.0) 0.0000 (1.0) 19.4620 (1.0) 0.0000 (1.0) 0;0 0.0514 (1.0) 1 1
test_status-status-changed (test_status/0002_2.10.0) 36.3755 (1.87) 36.3755 (1.87) 36.3755 (1.87) 0.0000 (1.0) 36.3755 (1.87) 0.0000 (1.0) 0;0 0.0275 (0.54) 1 1
test_status-status-changed (test_status/0003_2.9.5) 37.0575 (1.90) 37.0575 (1.90) 37.0575 (1.90) 0.0000 (1.0) 37.0575 (1.90) 0.0000 (1.0) 0;0 0.0270 (0.53) 1 1
test_status-status-changed (test_status/0004_2.8.3) 40.2069 (2.07) 40.2069 (2.07) 40.2069 (2.07) 0.0000 (1.0) 40.2069 (2.07) 0.0000 (1.0) 0;0 0.0249 (0.48) 1 1
test_status-status-changed (test_status/0005_2.6.3) 37.7973 (1.94) 37.7973 (1.94) 37.7973 (1.94) 0.0000 (1.0) 37.7973 (1.94) 0.0000 (1.0) 0;0 0.0265 (0.51) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 5 tests -----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop (test_status/0001_main) 19.4493 (1.0) 19.4493 (1.0) 19.4493 (1.0) 0.0000 (1.0) 19.4493 (1.0) 0.0000 (1.0) 0;0 0.0514 (1.0) 1 1
test_status-status-changed-noop (test_status/0002_2.10.0) 36.4222 (1.87) 36.4222 (1.87) 36.4222 (1.87) 0.0000 (1.0) 36.4222 (1.87) 0.0000 (1.0) 0;0 0.0275 (0.53) 1 1
test_status-status-changed-noop (test_status/0003_2.9.5) 36.6831 (1.89) 36.6831 (1.89) 36.6831 (1.89) 0.0000 (1.0) 36.6831 (1.89) 0.0000 (1.0) 0;0 0.0273 (0.53) 1 1
test_status-status-changed-noop (test_status/0004_2.8.3) 39.8467 (2.05) 39.8467 (2.05) 39.8467 (2.05) 0.0000 (1.0) 39.8467 (2.05) 0.0000 (1.0) 0;0 0.0251 (0.49) 1 1
test_status-status-changed-noop (test_status/0005_2.6.3) 37.9248 (1.95) 37.9248 (1.95) 37.9248 (1.95) 0.0000 (1.0) 37.9248 (1.95) 0.0000 (1.0) 0;0 0.0264 (0.51) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean\n```

github-actions · 2022-05-02T15:30:33Z


----------------------------------------------------------------------------------- benchmark 'test_add-add': 5 tests ------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add-add (test_add/0001_main) 117.1827 (1.0) 117.1827 (1.0) 117.1827 (1.0) 0.0000 (1.0) 117.1827 (1.0) 0.0000 (1.0) 0;0 0.0085 (1.0) 1 1
test_add-add (test_add/0002_2.10.0) 140.4782 (1.20) 140.4782 (1.20) 140.4782 (1.20) 0.0000 (1.0) 140.4782 (1.20) 0.0000 (1.0) 0;0 0.0071 (0.83) 1 1
test_add-add (test_add/0003_2.9.5) 139.6094 (1.19) 139.6094 (1.19) 139.6094 (1.19) 0.0000 (1.0) 139.6094 (1.19) 0.0000 (1.0) 0;0 0.0072 (0.84) 1 1
test_add-add (test_add/0004_2.8.3) 137.3263 (1.17) 137.3263 (1.17) 137.3263 (1.17) 0.0000 (1.0) 137.3263 (1.17) 0.0000 (1.0) 0;0 0.0073 (0.85) 1 1
test_add-add (test_add/0005_2.6.3) 130.7514 (1.12) 130.7514 (1.12) 130.7514 (1.12) 0.0000 (1.0) 130.7514 (1.12) 0.0000 (1.0) 0;0 0.0076 (0.90) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_checkout-checkout': 5 tests ------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout-checkout (test_checkout/0001_main) 32.2941 (1.51) 32.2941 (1.51) 32.2941 (1.51) 0.0000 (1.0) 32.2941 (1.51) 0.0000 (1.0) 0;0 0.0310 (0.66) 1 1
test_checkout-checkout (test_checkout/0002_2.10.0) 35.0215 (1.64) 35.0215 (1.64) 35.0215 (1.64) 0.0000 (1.0) 35.0215 (1.64) 0.0000 (1.0) 0;0 0.0286 (0.61) 1 1
test_checkout-checkout (test_checkout/0003_2.9.5) 35.0265 (1.64) 35.0265 (1.64) 35.0265 (1.64) 0.0000 (1.0) 35.0265 (1.64) 0.0000 (1.0) 0;0 0.0285 (0.61) 1 1
test_checkout-checkout (test_checkout/0004_2.8.3) 29.7514 (1.39) 29.7514 (1.39) 29.7514 (1.39) 0.0000 (1.0) 29.7514 (1.39) 0.0000 (1.0) 0;0 0.0336 (0.72) 1 1
test_checkout-checkout (test_checkout/0005_2.6.3) 21.3516 (1.0) 21.3516 (1.0) 21.3516 (1.0) 0.0000 (1.0) 21.3516 (1.0) 0.0000 (1.0) 0;0 0.0468 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------------- benchmark 'test_checkout-checkout-noop': 5 tests ----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout-checkout-noop (test_checkout/0001_main) 1.8083 (1.93) 1.8083 (1.93) 1.8083 (1.93) 0.0000 (1.0) 1.8083 (1.93) 0.0000 (1.0) 0;0 0.5530 (0.52) 1 1
test_checkout-checkout-noop (test_checkout/0002_2.10.0) 1.7789 (1.90) 1.7789 (1.90) 1.7789 (1.90) 0.0000 (1.0) 1.7789 (1.90) 0.0000 (1.0) 0;0 0.5622 (0.53) 1 1
test_checkout-checkout-noop (test_checkout/0003_2.9.5) 1.7883 (1.91) 1.7883 (1.91) 1.7883 (1.91) 0.0000 (1.0) 1.7883 (1.91) 0.0000 (1.0) 0;0 0.5592 (0.52) 1 1
test_checkout-checkout-noop (test_checkout/0004_2.8.3) 2.0206 (2.16) 2.0206 (2.16) 2.0206 (2.16) 0.0000 (1.0) 2.0206 (2.16) 0.0000 (1.0) 0;0 0.4949 (0.46) 1 1
test_checkout-checkout-noop (test_checkout/0005_2.6.3) 0.9349 (1.0) 0.9349 (1.0) 0.9349 (1.0) 0.0000 (1.0) 0.9349 (1.0) 0.0000 (1.0) 0;0 1.0696 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_checkout-checkout-update': 5 tests ------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout-checkout-update (test_checkout/0001_main) 10.8627 (1.00) 10.8627 (1.00) 10.8627 (1.00) 0.0000 (1.0) 10.8627 (1.00) 0.0000 (1.0) 0;0 0.0921 (1.00) 1 1
test_checkout-checkout-update (test_checkout/0002_2.10.0) 10.8210 (1.0) 10.8210 (1.0) 10.8210 (1.0) 0.0000 (1.0) 10.8210 (1.0) 0.0000 (1.0) 0;0 0.0924 (1.0) 1 1
test_checkout-checkout-update (test_checkout/0003_2.9.5) 11.1289 (1.03) 11.1289 (1.03) 11.1289 (1.03) 0.0000 (1.0) 11.1289 (1.03) 0.0000 (1.0) 0;0 0.0899 (0.97) 1 1
test_checkout-checkout-update (test_checkout/0004_2.8.3) 11.7114 (1.08) 11.7114 (1.08) 11.7114 (1.08) 0.0000 (1.0) 11.7114 (1.08) 0.0000 (1.0) 0;0 0.0854 (0.92) 1 1
test_checkout-checkout-update (test_checkout/0005_2.6.3) 30.1265 (2.78) 30.1265 (2.78) 30.1265 (2.78) 0.0000 (1.0) 30.1265 (2.78) 0.0000 (1.0) 0;0 0.0332 (0.36) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------------- benchmark 'test_diff-diff': 5 tests ----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff (test_diff/0001_main) 18.5562 (1.14) 18.5562 (1.14) 18.5562 (1.14) 0.0000 (1.0) 18.5562 (1.14) 0.0000 (1.0) 0;0 0.0539 (0.87) 1 1
test_diff-diff (test_diff/0002_2.10.0) 18.3455 (1.13) 18.3455 (1.13) 18.3455 (1.13) 0.0000 (1.0) 18.3455 (1.13) 0.0000 (1.0) 0;0 0.0545 (0.88) 1 1
test_diff-diff (test_diff/0003_2.9.5) 16.2312 (1.0) 16.2312 (1.0) 16.2312 (1.0) 0.0000 (1.0) 16.2312 (1.0) 0.0000 (1.0) 0;0 0.0616 (1.0) 1 1
test_diff-diff (test_diff/0004_2.8.3) 20.8783 (1.29) 20.8783 (1.29) 20.8783 (1.29) 0.0000 (1.0) 20.8783 (1.29) 0.0000 (1.0) 0;0 0.0479 (0.78) 1 1
test_diff-diff (test_diff/0005_2.6.3) 31.4602 (1.94) 31.4602 (1.94) 31.4602 (1.94) 0.0000 (1.0) 31.4602 (1.94) 0.0000 (1.0) 0;0 0.0318 (0.52) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 5 tests ----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop (test_diff/0001_main) 1.2638 (1.01) 1.2638 (1.01) 1.2638 (1.01) 0.0000 (1.0) 1.2638 (1.01) 0.0000 (1.0) 0;0 0.7913 (0.99) 1 1
test_diff-diff-noop (test_diff/0002_2.10.0) 1.2653 (1.01) 1.2653 (1.01) 1.2653 (1.01) 0.0000 (1.0) 1.2653 (1.01) 0.0000 (1.0) 0;0 0.7903 (0.99) 1 1
test_diff-diff-noop (test_diff/0003_2.9.5) 1.2484 (1.0) 1.2484 (1.0) 1.2484 (1.0) 0.0000 (1.0) 1.2484 (1.0) 0.0000 (1.0) 0;0 0.8011 (1.0) 1 1
test_diff-diff-noop (test_diff/0004_2.8.3) 2.5790 (2.07) 2.5790 (2.07) 2.5790 (2.07) 0.0000 (1.0) 2.5790 (2.07) 0.0000 (1.0) 0;0 0.3877 (0.48) 1 1
test_diff-diff-noop (test_diff/0005_2.6.3) 15.7278 (12.60) 15.7278 (12.60) 15.7278 (12.60) 0.0000 (1.0) 15.7278 (12.60) 0.0000 (1.0) 0;0 0.0636 (0.08) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------- benchmark 'test_gc-gc': 5 tests -------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc (test_gc/0001_main) 1.7092 (1.08) 1.7092 (1.08) 1.7092 (1.08) 0.0000 (1.0) 1.7092 (1.08) 0.0000 (1.0) 0;0 0.5851 (0.92) 1 1
test_gc-gc (test_gc/0002_2.10.0) 1.6278 (1.03) 1.6278 (1.03) 1.6278 (1.03) 0.0000 (1.0) 1.6278 (1.03) 0.0000 (1.0) 0;0 0.6143 (0.97) 1 1
test_gc-gc (test_gc/0003_2.9.5) 1.5769 (1.0) 1.5769 (1.0) 1.5769 (1.0) 0.0000 (1.0) 1.5769 (1.0) 0.0000 (1.0) 0;0 0.6341 (1.0) 1 1
test_gc-gc (test_gc/0004_2.8.3) 1.9586 (1.24) 1.9586 (1.24) 1.9586 (1.24) 0.0000 (1.0) 1.9586 (1.24) 0.0000 (1.0) 0;0 0.5106 (0.81) 1 1
test_gc-gc (test_gc/0005_2.6.3) 1.7226 (1.09) 1.7226 (1.09) 1.7226 (1.09) 0.0000 (1.0) 1.7226 (1.09) 0.0000 (1.0) 0;0 0.5805 (0.92) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_get-get': 5 tests ----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get (test_get/0001_main) 73.1494 (2.03) 73.1494 (2.03) 73.1494 (2.03) 0.0000 (1.0) 73.1494 (2.03) 0.0000 (1.0) 0;0 0.0137 (0.49) 1 1
test_get-get (test_get/0002_2.10.0) 36.8158 (1.02) 36.8158 (1.02) 36.8158 (1.02) 0.0000 (1.0) 36.8158 (1.02) 0.0000 (1.0) 0;0 0.0272 (0.98) 1 1
test_get-get (test_get/0003_2.9.5) 36.0838 (1.0) 36.0838 (1.0) 36.0838 (1.0) 0.0000 (1.0) 36.0838 (1.0) 0.0000 (1.0) 0;0 0.0277 (1.0) 1 1
test_get-get (test_get/0004_2.8.3) 37.9939 (1.05) 37.9939 (1.05) 37.9939 (1.05) 0.0000 (1.0) 37.9939 (1.05) 0.0000 (1.0) 0;0 0.0263 (0.95) 1 1
test_get-get (test_get/0005_2.6.3) 45.3114 (1.26) 45.3114 (1.26) 45.3114 (1.26) 0.0000 (1.0) 45.3114 (1.26) 0.0000 (1.0) 0;0 0.0221 (0.80) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------- benchmark 'test_help---help': 5 tests -------------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help (test_help/0001_main) 203.0787 (1.00) 279.9748 (1.13) 224.9091 (1.01) 10.3941 (1.54) 223.9431 (1.01) 10.2216 (1.23) 19;4 4.4462 (0.99) 100 1
test_help---help (test_help/0002_2.10.0) 202.6787 (1.0) 253.0889 (1.02) 226.6695 (1.01) 10.7822 (1.59) 225.5787 (1.01) 15.6671 (1.89) 33;0 4.4117 (0.99) 100 1
test_help---help (test_help/0003_2.9.5) 208.3974 (1.03) 247.6270 (1.0) 223.5624 (1.0) 6.7603 (1.0) 222.7741 (1.0) 8.2897 (1.0) 32;1 4.4730 (1.0) 100 1
test_help---help (test_help/0004_2.8.3) 250.1574 (1.23) 331.3578 (1.34) 270.5469 (1.21) 10.0752 (1.49) 270.0466 (1.21) 10.9498 (1.32) 18;3 3.6962 (0.83) 100 1
test_help---help (test_help/0005_2.6.3) 246.8791 (1.22) 312.2815 (1.26) 277.7750 (1.24) 12.2464 (1.81) 277.3704 (1.25) 15.2931 (1.84) 28;4 3.6000 (0.80) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------- benchmark 'test_import-import': 5 tests -------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import (test_import/0001_main) 227.3048 (1.36) 227.3048 (1.36) 227.3048 (1.36) 0.0000 (1.0) 227.3048 (1.36) 0.0000 (1.0) 0;0 0.0044 (0.73) 1 1
test_import-import (test_import/0002_2.10.0) 241.5018 (1.45) 241.5018 (1.45) 241.5018 (1.45) 0.0000 (1.0) 241.5018 (1.45) 0.0000 (1.0) 0;0 0.0041 (0.69) 1 1
test_import-import (test_import/0003_2.9.5) 247.1022 (1.48) 247.1022 (1.48) 247.1022 (1.48) 0.0000 (1.0) 247.1022 (1.48) 0.0000 (1.0) 0;0 0.0040 (0.67) 1 1
test_import-import (test_import/0004_2.8.3) 194.8000 (1.17) 194.8000 (1.17) 194.8000 (1.17) 0.0000 (1.0) 194.8000 (1.17) 0.0000 (1.0) 0;0 0.0051 (0.86) 1 1
test_import-import (test_import/0005_2.6.3) 166.6070 (1.0) 166.6070 (1.0) 166.6070 (1.0) 0.0000 (1.0) 166.6070 (1.0) 0.0000 (1.0) 0;0 0.0060 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_init-init': 5 tests -------------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init (test_init/0001_main) 311.6862 (1.0) 336.6892 (1.00) 316.8766 (1.0) 3.3135 (1.0) 316.6535 (1.0) 3.9276 (1.0) 23;1 3.1558 (1.0) 100 1
test_init-init (test_init/0002_2.10.0) 327.3055 (1.05) 391.6041 (1.17) 336.5574 (1.06) 7.3586 (2.22) 334.9929 (1.06) 7.0522 (1.80) 11;3 2.9713 (0.94) 100 1
test_init-init (test_init/0003_2.9.5) 314.1670 (1.01) 335.4841 (1.0) 321.4427 (1.01) 4.7031 (1.42) 320.6090 (1.01) 5.0639 (1.29) 30;4 3.1110 (0.99) 100 1
test_init-init (test_init/0004_2.8.3) 322.9114 (1.04) 533.3816 (1.59) 332.2422 (1.05) 20.7689 (6.27) 329.2634 (1.04) 4.7214 (1.20) 1;8 3.0099 (0.95) 100 1
test_init-init (test_init/0005_2.6.3) 316.9539 (1.02) 337.6307 (1.01) 323.7256 (1.02) 3.7013 (1.12) 323.5787 (1.02) 4.4138 (1.12) 30;2 3.0890 (0.98) 100 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_list-list': 5 tests --------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list (test_list/0001_main) 1.3672 (2.14) 1.3672 (2.14) 1.3672 (2.14) 0.0000 (1.0) 1.3672 (2.14) 0.0000 (1.0) 0;0 0.7314 (0.47) 1 1
test_list-list (test_list/0002_2.10.0) 1.2930 (2.03) 1.2930 (2.03) 1.2930 (2.03) 0.0000 (1.0) 1.2930 (2.03) 0.0000 (1.0) 0;0 0.7734 (0.49) 1 1
test_list-list (test_list/0003_2.9.5) 1.2710 (1.99) 1.2710 (1.99) 1.2710 (1.99) 0.0000 (1.0) 1.2710 (1.99) 0.0000 (1.0) 0;0 0.7868 (0.50) 1 1
test_list-list (test_list/0004_2.8.3) 0.8556 (1.34) 0.8556 (1.34) 0.8556 (1.34) 0.0000 (1.0) 0.8556 (1.34) 0.0000 (1.0) 0;0 1.1687 (0.75) 1 1
test_list-list (test_list/0005_2.6.3) 0.6381 (1.0) 0.6381 (1.0) 0.6381 (1.0) 0.0000 (1.0) 0.6381 (1.0) 0.0000 (1.0) 0;0 1.5671 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 5 tests --------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only (test_list/0001_main) 1.1021 (2.20) 1.1021 (2.20) 1.1021 (2.20) 0.0000 (1.0) 1.1021 (2.20) 0.0000 (1.0) 0;0 0.9074 (0.45) 1 1
test_list-list-dvc-only (test_list/0002_2.10.0) 1.1663 (2.33) 1.1663 (2.33) 1.1663 (2.33) 0.0000 (1.0) 1.1663 (2.33) 0.0000 (1.0) 0;0 0.8574 (0.43) 1 1
test_list-list-dvc-only (test_list/0003_2.9.5) 1.1818 (2.36) 1.1818 (2.36) 1.1818 (2.36) 0.0000 (1.0) 1.1818 (2.36) 0.0000 (1.0) 0;0 0.8461 (0.42) 1 1
test_list-list-dvc-only (test_list/0004_2.8.3) 0.5005 (1.0) 0.5005 (1.0) 0.5005 (1.0) 0.0000 (1.0) 0.5005 (1.0) 0.0000 (1.0) 0;0 1.9981 (1.0) 1 1
test_list-list-dvc-only (test_list/0005_2.6.3) 0.5094 (1.02) 0.5094 (1.02) 0.5094 (1.02) 0.0000 (1.0) 0.5094 (1.02) 0.0000 (1.0) 0;0 1.9632 (0.98) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_pull-pull': 5 tests ------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_pull-pull (test_pull/0001_main) 130.5714 (1.21) 130.5714 (1.21) 130.5714 (1.21) 0.0000 (1.0) 130.5714 (1.21) 0.0000 (1.0) 0;0 0.0077 (0.83) 1 1
test_pull-pull (test_pull/0002_2.10.0) 143.1994 (1.32) 143.1994 (1.32) 143.1994 (1.32) 0.0000 (1.0) 143.1994 (1.32) 0.0000 (1.0) 0;0 0.0070 (0.76) 1 1
test_pull-pull (test_pull/0003_2.9.5) 146.1539 (1.35) 146.1539 (1.35) 146.1539 (1.35) 0.0000 (1.0) 146.1539 (1.35) 0.0000 (1.0) 0;0 0.0068 (0.74) 1 1
test_pull-pull (test_pull/0004_2.8.3) 129.7633 (1.20) 129.7633 (1.20) 129.7633 (1.20) 0.0000 (1.0) 129.7633 (1.20) 0.0000 (1.0) 0;0 0.0077 (0.83) 1 1
test_pull-pull (test_pull/0005_2.6.3) 108.2353 (1.0) 108.2353 (1.0) 108.2353 (1.0) 0.0000 (1.0) 108.2353 (1.0) 0.0000 (1.0) 0;0 0.0092 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

---------------------------------------------------------------------------------- benchmark 'test_push-push': 5 tests ----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push (test_push/0001_main) 71.0401 (1.25) 71.0401 (1.25) 71.0401 (1.25) 0.0000 (1.0) 71.0401 (1.25) 0.0000 (1.0) 0;0 0.0141 (0.80) 1 1
test_push-push (test_push/0002_2.10.0) 79.8677 (1.41) 79.8677 (1.41) 79.8677 (1.41) 0.0000 (1.0) 79.8677 (1.41) 0.0000 (1.0) 0;0 0.0125 (0.71) 1 1
test_push-push (test_push/0003_2.9.5) 77.8615 (1.37) 77.8615 (1.37) 77.8615 (1.37) 0.0000 (1.0) 77.8615 (1.37) 0.0000 (1.0) 0;0 0.0128 (0.73) 1 1
test_push-push (test_push/0004_2.8.3) 70.8293 (1.25) 70.8293 (1.25) 70.8293 (1.25) 0.0000 (1.0) 70.8293 (1.25) 0.0000 (1.0) 0;0 0.0141 (0.80) 1 1
test_push-push (test_push/0005_2.6.3) 56.7013 (1.0) 56.7013 (1.0) 56.7013 (1.0) 0.0000 (1.0) 56.7013 (1.0) 0.0000 (1.0) 0;0 0.0176 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------- benchmark 'test_sharing-add': 5 tests --------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add (test_sharing/0001_main) 81.5591 (1.0) 81.5591 (1.0) 81.5591 (1.0) 0.0000 (1.0) 81.5591 (1.0) 0.0000 (1.0) 0;0 0.0123 (1.0) 1 1
test_sharing-add (test_sharing/0002_2.10.0) 97.4267 (1.19) 97.4267 (1.19) 97.4267 (1.19) 0.0000 (1.0) 97.4267 (1.19) 0.0000 (1.0) 0;0 0.0103 (0.84) 1 1
test_sharing-add (test_sharing/0003_2.9.5) 101.6131 (1.25) 101.6131 (1.25) 101.6131 (1.25) 0.0000 (1.0) 101.6131 (1.25) 0.0000 (1.0) 0;0 0.0098 (0.80) 1 1
test_sharing-add (test_sharing/0004_2.8.3) 101.0804 (1.24) 101.0804 (1.24) 101.0804 (1.24) 0.0000 (1.0) 101.0804 (1.24) 0.0000 (1.0) 0;0 0.0099 (0.81) 1 1
test_sharing-add (test_sharing/0005_2.6.3) 93.2630 (1.14) 93.2630 (1.14) 93.2630 (1.14) 0.0000 (1.0) 93.2630 (1.14) 0.0000 (1.0) 0;0 0.0107 (0.87) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_sharing-add-noop': 5 tests -----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-add-noop (test_sharing/0001_main) 38.3636 (6.32) 38.3636 (6.32) 38.3636 (6.32) 0.0000 (1.0) 38.3636 (6.32) 0.0000 (1.0) 0;0 0.0261 (0.16) 1 1
test_sharing-add-noop (test_sharing/0002_2.10.0) 42.3691 (6.98) 42.3691 (6.98) 42.3691 (6.98) 0.0000 (1.0) 42.3691 (6.98) 0.0000 (1.0) 0;0 0.0236 (0.14) 1 1
test_sharing-add-noop (test_sharing/0003_2.9.5) 42.7294 (7.04) 42.7294 (7.04) 42.7294 (7.04) 0.0000 (1.0) 42.7294 (7.04) 0.0000 (1.0) 0;0 0.0234 (0.14) 1 1
test_sharing-add-noop (test_sharing/0004_2.8.3) 12.0350 (1.98) 12.0350 (1.98) 12.0350 (1.98) 0.0000 (1.0) 12.0350 (1.98) 0.0000 (1.0) 0;0 0.0831 (0.50) 1 1
test_sharing-add-noop (test_sharing/0005_2.6.3) 6.0686 (1.0) 6.0686 (1.0) 6.0686 (1.0) 0.0000 (1.0) 6.0686 (1.0) 0.0000 (1.0) 0;0 0.1648 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_sharing-checkout-noop': 5 tests ----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-checkout-noop (test_sharing/0001_main) 2.0779 (1.89) 2.0779 (1.89) 2.0779 (1.89) 0.0000 (1.0) 2.0779 (1.89) 0.0000 (1.0) 0;0 0.4812 (0.53) 1 1
test_sharing-checkout-noop (test_sharing/0002_2.10.0) 2.0215 (1.84) 2.0215 (1.84) 2.0215 (1.84) 0.0000 (1.0) 2.0215 (1.84) 0.0000 (1.0) 0;0 0.4947 (0.54) 1 1
test_sharing-checkout-noop (test_sharing/0003_2.9.5) 2.0976 (1.91) 2.0976 (1.91) 2.0976 (1.91) 0.0000 (1.0) 2.0976 (1.91) 0.0000 (1.0) 0;0 0.4767 (0.52) 1 1
test_sharing-checkout-noop (test_sharing/0004_2.8.3) 2.2887 (2.09) 2.2887 (2.09) 2.2887 (2.09) 0.0000 (1.0) 2.2887 (2.09) 0.0000 (1.0) 0;0 0.4369 (0.48) 1 1
test_sharing-checkout-noop (test_sharing/0005_2.6.3) 1.0970 (1.0) 1.0970 (1.0) 1.0970 (1.0) 0.0000 (1.0) 1.0970 (1.0) 0.0000 (1.0) 0;0 0.9116 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

-------------------------------------------------------------------------------------- benchmark 'test_sharing-pull': 5 tests -------------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull (test_sharing/0001_main) 92.9031 (1.28) 92.9031 (1.28) 92.9031 (1.28) 0.0000 (1.0) 92.9031 (1.28) 0.0000 (1.0) 0;0 0.0108 (0.78) 1 1
test_sharing-pull (test_sharing/0002_2.10.0) 105.4201 (1.46) 105.4201 (1.46) 105.4201 (1.46) 0.0000 (1.0) 105.4201 (1.46) 0.0000 (1.0) 0;0 0.0095 (0.69) 1 1
test_sharing-pull (test_sharing/0003_2.9.5) 106.6550 (1.47) 106.6550 (1.47) 106.6550 (1.47) 0.0000 (1.0) 106.6550 (1.47) 0.0000 (1.0) 0;0 0.0094 (0.68) 1 1
test_sharing-pull (test_sharing/0004_2.8.3) 93.5684 (1.29) 93.5684 (1.29) 93.5684 (1.29) 0.0000 (1.0) 93.5684 (1.29) 0.0000 (1.0) 0;0 0.0107 (0.77) 1 1
test_sharing-pull (test_sharing/0005_2.6.3) 72.3241 (1.0) 72.3241 (1.0) 72.3241 (1.0) 0.0000 (1.0) 72.3241 (1.0) 0.0000 (1.0) 0;0 0.0138 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_sharing-pull-noop': 5 tests ----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-pull-noop (test_sharing/0001_main) 2.3842 (1.69) 2.3842 (1.69) 2.3842 (1.69) 0.0000 (1.0) 2.3842 (1.69) 0.0000 (1.0) 0;0 0.4194 (0.59) 1 1
test_sharing-pull-noop (test_sharing/0002_2.10.0) 2.3279 (1.65) 2.3279 (1.65) 2.3279 (1.65) 0.0000 (1.0) 2.3279 (1.65) 0.0000 (1.0) 0;0 0.4296 (0.61) 1 1
test_sharing-pull-noop (test_sharing/0003_2.9.5) 2.3352 (1.65) 2.3352 (1.65) 2.3352 (1.65) 0.0000 (1.0) 2.3352 (1.65) 0.0000 (1.0) 0;0 0.4282 (0.61) 1 1
test_sharing-pull-noop (test_sharing/0004_2.8.3) 2.5565 (1.81) 2.5565 (1.81) 2.5565 (1.81) 0.0000 (1.0) 2.5565 (1.81) 0.0000 (1.0) 0;0 0.3912 (0.55) 1 1
test_sharing-pull-noop (test_sharing/0005_2.6.3) 1.4139 (1.0) 1.4139 (1.0) 1.4139 (1.0) 0.0000 (1.0) 1.4139 (1.0) 0.0000 (1.0) 0;0 0.7073 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

------------------------------------------------------------------------------------ benchmark 'test_sharing-push': 5 tests -----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push (test_sharing/0001_main) 48.6013 (1.25) 48.6013 (1.25) 48.6013 (1.25) 0.0000 (1.0) 48.6013 (1.25) 0.0000 (1.0) 0;0 0.0206 (0.80) 1 1
test_sharing-push (test_sharing/0002_2.10.0) 53.9045 (1.38) 53.9045 (1.38) 53.9045 (1.38) 0.0000 (1.0) 53.9045 (1.38) 0.0000 (1.0) 0;0 0.0186 (0.72) 1 1
test_sharing-push (test_sharing/0003_2.9.5) 54.9224 (1.41) 54.9224 (1.41) 54.9224 (1.41) 0.0000 (1.0) 54.9224 (1.41) 0.0000 (1.0) 0;0 0.0182 (0.71) 1 1
test_sharing-push (test_sharing/0004_2.8.3) 48.4832 (1.24) 48.4832 (1.24) 48.4832 (1.24) 0.0000 (1.0) 48.4832 (1.24) 0.0000 (1.0) 0;0 0.0206 (0.80) 1 1
test_sharing-push (test_sharing/0005_2.6.3) 39.0234 (1.0) 39.0234 (1.0) 39.0234 (1.0) 0.0000 (1.0) 39.0234 (1.0) 0.0000 (1.0) 0;0 0.0256 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

--------------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 5 tests ----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop (test_sharing/0001_main) 1.1188 (1.00) 1.1188 (1.00) 1.1188 (1.00) 0.0000 (1.0) 1.1188 (1.00) 0.0000 (1.0) 0;0 0.8938 (1.00) 1 1
test_sharing-push-noop (test_sharing/0002_2.10.0) 1.1308 (1.01) 1.1308 (1.01) 1.1308 (1.01) 0.0000 (1.0) 1.1308 (1.01) 0.0000 (1.0) 0;0 0.8843 (0.99) 1 1
test_sharing-push-noop (test_sharing/0003_2.9.5) 1.1308 (1.01) 1.1308 (1.01) 1.1308 (1.01) 0.0000 (1.0) 1.1308 (1.01) 0.0000 (1.0) 0;0 0.8844 (0.99) 1 1
test_sharing-push-noop (test_sharing/0004_2.8.3) 1.1181 (1.0) 1.1181 (1.0) 1.1181 (1.0) 0.0000 (1.0) 1.1181 (1.0) 0.0000 (1.0) 0;0 0.8944 (1.0) 1 1
test_sharing-push-noop (test_sharing/0005_2.6.3) 1.2410 (1.11) 1.2410 (1.11) 1.2410 (1.11) 0.0000 (1.0) 1.2410 (1.11) 0.0000 (1.0) 0;0 0.8058 (0.90) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_status-status': 5 tests -----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status (test_status/0001_main) 27.5265 (1.0) 27.5265 (1.0) 27.5265 (1.0) 0.0000 (1.0) 27.5265 (1.0) 0.0000 (1.0) 0;0 0.0363 (1.0) 1 1
test_status-status (test_status/0002_2.10.0) 41.9478 (1.52) 41.9478 (1.52) 41.9478 (1.52) 0.0000 (1.0) 41.9478 (1.52) 0.0000 (1.0) 0;0 0.0238 (0.66) 1 1
test_status-status (test_status/0003_2.9.5) 42.4158 (1.54) 42.4158 (1.54) 42.4158 (1.54) 0.0000 (1.0) 42.4158 (1.54) 0.0000 (1.0) 0;0 0.0236 (0.65) 1 1
test_status-status (test_status/0004_2.8.3) 46.2375 (1.68) 46.2375 (1.68) 46.2375 (1.68) 0.0000 (1.0) 46.2375 (1.68) 0.0000 (1.0) 0;0 0.0216 (0.60) 1 1
test_status-status (test_status/0005_2.6.3) 44.2857 (1.61) 44.2857 (1.61) 44.2857 (1.61) 0.0000 (1.0) 44.2857 (1.61) 0.0000 (1.0) 0;0 0.0226 (0.62) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_status-status-changed': 5 tests -----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed (test_status/0001_main) 15.3354 (1.0) 15.3354 (1.0) 15.3354 (1.0) 0.0000 (1.0) 15.3354 (1.0) 0.0000 (1.0) 0;0 0.0652 (1.0) 1 1
test_status-status-changed (test_status/0002_2.10.0) 31.2651 (2.04) 31.2651 (2.04) 31.2651 (2.04) 0.0000 (1.0) 31.2651 (2.04) 0.0000 (1.0) 0;0 0.0320 (0.49) 1 1
test_status-status-changed (test_status/0003_2.9.5) 30.8622 (2.01) 30.8622 (2.01) 30.8622 (2.01) 0.0000 (1.0) 30.8622 (2.01) 0.0000 (1.0) 0;0 0.0324 (0.50) 1 1
test_status-status-changed (test_status/0004_2.8.3) 34.1540 (2.23) 34.1540 (2.23) 34.1540 (2.23) 0.0000 (1.0) 34.1540 (2.23) 0.0000 (1.0) 0;0 0.0293 (0.45) 1 1
test_status-status-changed (test_status/0005_2.6.3) 31.2601 (2.04) 31.2601 (2.04) 31.2601 (2.04) 0.0000 (1.0) 31.2601 (2.04) 0.0000 (1.0) 0;0 0.0320 (0.49) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

----------------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 5 tests -----------------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop (test_status/0001_main) 15.3982 (1.0) 15.3982 (1.0) 15.3982 (1.0) 0.0000 (1.0) 15.3982 (1.0) 0.0000 (1.0) 0;0 0.0649 (1.0) 1 1
test_status-status-changed-noop (test_status/0002_2.10.0) 30.0556 (1.95) 30.0556 (1.95) 30.0556 (1.95) 0.0000 (1.0) 30.0556 (1.95) 0.0000 (1.0) 0;0 0.0333 (0.51) 1 1
test_status-status-changed-noop (test_status/0003_2.9.5) 32.1635 (2.09) 32.1635 (2.09) 32.1635 (2.09) 0.0000 (1.0) 32.1635 (2.09) 0.0000 (1.0) 0;0 0.0311 (0.48) 1 1
test_status-status-changed-noop (test_status/0004_2.8.3) 33.2794 (2.16) 33.2794 (2.16) 33.2794 (2.16) 0.0000 (1.0) 33.2794 (2.16) 0.0000 (1.0) 0;0 0.0300 (0.46) 1 1
test_status-status-changed-noop (test_status/0005_2.6.3) 30.9385 (2.01) 30.9385 (2.01) 30.9385 (2.01) 0.0000 (1.0) 30.9385 (2.01) 0.0000 (1.0) 0;0 0.0323 (0.50) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Legend:
 Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
 OPS: Operations Per Second, computed as 1 / Mean\n```

efiop force-pushed the efiop-patch-5 branch from 6de7e8e to 34cdd17 Compare May 2, 2022 14:13

efiop changed the title ~~bench: add test_ls~~ [WIP] bench: add test_ls May 2, 2022

bench: add test_ls

e4b17b8

efiop force-pushed the efiop-patch-5 branch from 34cdd17 to e4b17b8 Compare May 2, 2022 14:45

efiop changed the title ~~[WIP] bench: add test_ls~~ bench: add test_ls May 2, 2022

efiop merged commit 1907e0c into main May 2, 2022

skshetry deleted the efiop-patch-5 branch May 3, 2022 12:30

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

bench: add test_ls#344

bench: add test_ls#344
efiop merged 1 commit into
mainfrom
efiop-patch-5

efiop commented May 2, 2022 •

edited

Loading

Uh oh!

github-actions Bot commented May 2, 2022

Uh oh!

github-actions Bot commented May 2, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

efiop commented May 2, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented May 2, 2022

Uh oh!

github-actions Bot commented May 2, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

efiop commented May 2, 2022 •

edited

Loading