Skip to content

[SPARK-34950][TESTS] Update benchmark results to the ones created by GitHub Actions machines #32044

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
HyukjinKwon wants to merge 1 commit into from
Closed

[SPARK-34950][TESTS] Update benchmark results to the ones created by GitHub Actions machines #32044

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
68 changes: 34 additions & 34 deletions core/benchmarks/CoalescedRDDBenchmark-jdk11-results.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,39 +2,39 @@
Coalesced RDD , large scale
================================================================================================

OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Coalesced RDD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Coalesce Num Partitions: 100 Num Hosts: 1 344 360 14 0.3 3441.4 1.0X
Coalesce Num Partitions: 100 Num Hosts: 5 283 301 22 0.4 2825.1 1.2X
Coalesce Num Partitions: 100 Num Hosts: 10 270 271 2 0.4 2700.5 1.3X
Coalesce Num Partitions: 100 Num Hosts: 20 272 273 1 0.4 2721.1 1.3X
Coalesce Num Partitions: 100 Num Hosts: 40 271 272 1 0.4 2710.0 1.3X
Coalesce Num Partitions: 100 Num Hosts: 80 266 267 2 0.4 2656.3 1.3X
Coalesce Num Partitions: 500 Num Hosts: 1 609 619 15 0.2 6089.0 0.6X
Coalesce Num Partitions: 500 Num Hosts: 5 338 343 6 0.3 3383.0 1.0X
Coalesce Num Partitions: 500 Num Hosts: 10 303 306 3 0.3 3029.4 1.1X
Coalesce Num Partitions: 500 Num Hosts: 20 286 288 2 0.4 2855.9 1.2X
Coalesce Num Partitions: 500 Num Hosts: 40 279 282 4 0.4 2793.3 1.2X
Coalesce Num Partitions: 500 Num Hosts: 80 273 275 3 0.4 2725.9 1.3X
Coalesce Num Partitions: 1000 Num Hosts: 1 951 955 4 0.1 9514.1 0.4X
Coalesce Num Partitions: 1000 Num Hosts: 5 421 429 8 0.2 4211.3 0.8X
Coalesce Num Partitions: 1000 Num Hosts: 10 347 352 4 0.3 3473.5 1.0X
Coalesce Num Partitions: 1000 Num Hosts: 20 309 312 5 0.3 3087.5 1.1X
Coalesce Num Partitions: 1000 Num Hosts: 40 290 294 6 0.3 2896.4 1.2X
Coalesce Num Partitions: 1000 Num Hosts: 80 281 286 5 0.4 2811.3 1.2X
Coalesce Num Partitions: 5000 Num Hosts: 1 3928 3950 27 0.0 39278.0 0.1X
Coalesce Num Partitions: 5000 Num Hosts: 5 1373 1389 27 0.1 13725.2 0.3X
Coalesce Num Partitions: 5000 Num Hosts: 10 812 827 13 0.1 8123.3 0.4X
Coalesce Num Partitions: 5000 Num Hosts: 20 530 540 9 0.2 5299.1 0.6X
Coalesce Num Partitions: 5000 Num Hosts: 40 421 425 5 0.2 4210.5 0.8X
Coalesce Num Partitions: 5000 Num Hosts: 80 335 344 12 0.3 3353.7 1.0X
Coalesce Num Partitions: 10000 Num Hosts: 1 7116 7120 4 0.0 71159.0 0.0X
Coalesce Num Partitions: 10000 Num Hosts: 5 2539 2598 51 0.0 25390.1 0.1X
Coalesce Num Partitions: 10000 Num Hosts: 10 1393 1432 34 0.1 13928.1 0.2X
Coalesce Num Partitions: 10000 Num Hosts: 20 833 1009 303 0.1 8329.2 0.4X
Coalesce Num Partitions: 10000 Num Hosts: 40 562 563 3 0.2 5615.2 0.6X
Coalesce Num Partitions: 10000 Num Hosts: 80 420 426 7 0.2 4204.0 0.8X
OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Coalesced RDD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Coalesce Num Partitions: 100 Num Hosts: 1 365 454 104 0.3 3652.8 1.0X
Coalesce Num Partitions: 100 Num Hosts: 5 271 374 90 0.4 2708.0 1.3X
Coalesce Num Partitions: 100 Num Hosts: 10 265 337 88 0.4 2651.9 1.4X
Coalesce Num Partitions: 100 Num Hosts: 20 277 338 87 0.4 2772.8 1.3X
Coalesce Num Partitions: 100 Num Hosts: 40 313 320 6 0.3 3127.8 1.2X
Coalesce Num Partitions: 100 Num Hosts: 80 291 330 60 0.3 2909.5 1.3X
Coalesce Num Partitions: 500 Num Hosts: 1 974 1035 59 0.1 9741.6 0.4X
Coalesce Num Partitions: 500 Num Hosts: 5 443 450 6 0.2 4427.7 0.8X
Coalesce Num Partitions: 500 Num Hosts: 10 382 455 64 0.3 3816.6 1.0X
Coalesce Num Partitions: 500 Num Hosts: 20 359 402 39 0.3 3589.9 1.0X
Coalesce Num Partitions: 500 Num Hosts: 40 317 350 54 0.3 3165.5 1.2X
Coalesce Num Partitions: 500 Num Hosts: 80 267 337 81 0.4 2668.5 1.4X
Coalesce Num Partitions: 1000 Num Hosts: 1 1621 1712 84 0.1 16205.9 0.2X
Coalesce Num Partitions: 1000 Num Hosts: 5 582 638 85 0.2 5817.7 0.6X
Coalesce Num Partitions: 1000 Num Hosts: 10 398 446 74 0.3 3980.8 0.9X
Coalesce Num Partitions: 1000 Num Hosts: 20 332 410 108 0.3 3315.1 1.1X
Coalesce Num Partitions: 1000 Num Hosts: 40 345 377 54 0.3 3453.1 1.1X
Coalesce Num Partitions: 1000 Num Hosts: 80 294 353 69 0.3 2940.5 1.2X
Coalesce Num Partitions: 5000 Num Hosts: 1 6818 6906 151 0.0 68183.8 0.1X
Coalesce Num Partitions: 5000 Num Hosts: 5 1606 1719 138 0.1 16061.1 0.2X
Coalesce Num Partitions: 5000 Num Hosts: 10 965 1031 94 0.1 9653.8 0.4X
Coalesce Num Partitions: 5000 Num Hosts: 20 643 722 98 0.2 6427.4 0.6X
Coalesce Num Partitions: 5000 Num Hosts: 40 445 517 97 0.2 4448.8 0.8X
Coalesce Num Partitions: 5000 Num Hosts: 80 369 432 93 0.3 3688.6 1.0X
Coalesce Num Partitions: 10000 Num Hosts: 1 12850 12953 90 0.0 128503.9 0.0X
Coalesce Num Partitions: 10000 Num Hosts: 5 3431 3463 49 0.0 34307.1 0.1X
Coalesce Num Partitions: 10000 Num Hosts: 10 1687 1795 106 0.1 16874.8 0.2X
Coalesce Num Partitions: 10000 Num Hosts: 20 1084 1125 58 0.1 10844.2 0.3X
Coalesce Num Partitions: 10000 Num Hosts: 40 667 722 73 0.1 6674.4 0.5X
Coalesce Num Partitions: 10000 Num Hosts: 80 488 542 82 0.2 4883.9 0.7X


68 changes: 34 additions & 34 deletions core/benchmarks/CoalescedRDDBenchmark-results.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,39 +2,39 @@
Coalesced RDD , large scale
================================================================================================

OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Coalesced RDD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Coalesce Num Partitions: 100 Num Hosts: 1 395 401 9 0.3 3952.3 1.0X
Coalesce Num Partitions: 100 Num Hosts: 5 296 344 42 0.3 2963.2 1.3X
Coalesce Num Partitions: 100 Num Hosts: 10 294 308 15 0.3 2941.7 1.3X
Coalesce Num Partitions: 100 Num Hosts: 20 316 328 13 0.3 3155.2 1.3X
Coalesce Num Partitions: 100 Num Hosts: 40 294 316 36 0.3 2940.3 1.3X
Coalesce Num Partitions: 100 Num Hosts: 80 292 324 30 0.3 2922.2 1.4X
Coalesce Num Partitions: 500 Num Hosts: 1 629 687 61 0.2 6292.4 0.6X
Coalesce Num Partitions: 500 Num Hosts: 5 354 378 42 0.3 3541.7 1.1X
Coalesce Num Partitions: 500 Num Hosts: 10 318 338 29 0.3 3179.8 1.2X
Coalesce Num Partitions: 500 Num Hosts: 20 306 317 11 0.3 3059.2 1.3X
Coalesce Num Partitions: 500 Num Hosts: 40 294 311 28 0.3 2941.6 1.3X
Coalesce Num Partitions: 500 Num Hosts: 80 288 309 34 0.3 2883.9 1.4X
Coalesce Num Partitions: 1000 Num Hosts: 1 956 978 20 0.1 9562.2 0.4X
Coalesce Num Partitions: 1000 Num Hosts: 5 431 452 36 0.2 4306.2 0.9X
Coalesce Num Partitions: 1000 Num Hosts: 10 358 379 23 0.3 3581.1 1.1X
Coalesce Num Partitions: 1000 Num Hosts: 20 324 347 20 0.3 3236.7 1.2X
Coalesce Num Partitions: 1000 Num Hosts: 40 312 333 20 0.3 3116.8 1.3X
Coalesce Num Partitions: 1000 Num Hosts: 80 307 342 32 0.3 3068.4 1.3X
Coalesce Num Partitions: 5000 Num Hosts: 1 3895 3906 12 0.0 38946.8 0.1X
Coalesce Num Partitions: 5000 Num Hosts: 5 1388 1401 19 0.1 13881.7 0.3X
Coalesce Num Partitions: 5000 Num Hosts: 10 806 839 57 0.1 8063.7 0.5X
Coalesce Num Partitions: 5000 Num Hosts: 20 546 573 44 0.2 5462.6 0.7X
Coalesce Num Partitions: 5000 Num Hosts: 40 413 418 5 0.2 4134.7 1.0X
Coalesce Num Partitions: 5000 Num Hosts: 80 345 365 23 0.3 3448.1 1.1X
Coalesce Num Partitions: 10000 Num Hosts: 1 6933 6966 55 0.0 69328.8 0.1X
Coalesce Num Partitions: 10000 Num Hosts: 5 2455 2499 69 0.0 24551.7 0.2X
Coalesce Num Partitions: 10000 Num Hosts: 10 1352 1392 34 0.1 13520.2 0.3X
Coalesce Num Partitions: 10000 Num Hosts: 20 815 853 50 0.1 8147.5 0.5X
Coalesce Num Partitions: 10000 Num Hosts: 40 558 581 28 0.2 5578.0 0.7X
Coalesce Num Partitions: 10000 Num Hosts: 80 416 423 5 0.2 4163.3 0.9X
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Coalesced RDD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Coalesce Num Partitions: 100 Num Hosts: 1 394 423 25 0.3 3942.7 1.0X
Coalesce Num Partitions: 100 Num Hosts: 5 317 339 23 0.3 3171.6 1.2X
Coalesce Num Partitions: 100 Num Hosts: 10 310 324 20 0.3 3095.9 1.3X
Coalesce Num Partitions: 100 Num Hosts: 20 285 292 8 0.4 2849.0 1.4X
Coalesce Num Partitions: 100 Num Hosts: 40 271 292 22 0.4 2712.7 1.5X
Coalesce Num Partitions: 100 Num Hosts: 80 287 300 18 0.3 2874.2 1.4X
Coalesce Num Partitions: 500 Num Hosts: 1 839 872 33 0.1 8388.1 0.5X
Coalesce Num Partitions: 500 Num Hosts: 5 389 395 5 0.3 3892.4 1.0X
Coalesce Num Partitions: 500 Num Hosts: 10 352 356 3 0.3 3522.0 1.1X
Coalesce Num Partitions: 500 Num Hosts: 20 315 322 11 0.3 3145.0 1.3X
Coalesce Num Partitions: 500 Num Hosts: 40 304 324 22 0.3 3036.4 1.3X
Coalesce Num Partitions: 500 Num Hosts: 80 286 301 23 0.4 2855.7 1.4X
Coalesce Num Partitions: 1000 Num Hosts: 1 1390 1422 28 0.1 13898.0 0.3X
Coalesce Num Partitions: 1000 Num Hosts: 5 535 562 26 0.2 5347.4 0.7X
Coalesce Num Partitions: 1000 Num Hosts: 10 419 425 8 0.2 4193.8 0.9X
Coalesce Num Partitions: 1000 Num Hosts: 20 358 364 9 0.3 3575.8 1.1X
Coalesce Num Partitions: 1000 Num Hosts: 40 323 329 5 0.3 3234.8 1.2X
Coalesce Num Partitions: 1000 Num Hosts: 80 306 316 11 0.3 3060.3 1.3X
Coalesce Num Partitions: 5000 Num Hosts: 1 5967 6744 1289 0.0 59666.6 0.1X
Coalesce Num Partitions: 5000 Num Hosts: 5 2010 2032 19 0.0 20104.1 0.2X
Coalesce Num Partitions: 5000 Num Hosts: 10 1132 1161 25 0.1 11324.9 0.3X
Coalesce Num Partitions: 5000 Num Hosts: 20 687 714 39 0.1 6874.2 0.6X
Coalesce Num Partitions: 5000 Num Hosts: 40 507 511 3 0.2 5070.1 0.8X
Coalesce Num Partitions: 5000 Num Hosts: 80 375 383 12 0.3 3749.7 1.1X
Coalesce Num Partitions: 10000 Num Hosts: 1 10782 10833 63 0.0 107816.6 0.0X
Coalesce Num Partitions: 10000 Num Hosts: 5 3819 3901 72 0.0 38185.3 0.1X
Coalesce Num Partitions: 10000 Num Hosts: 10 2021 2030 12 0.0 20212.9 0.2X
Coalesce Num Partitions: 10000 Num Hosts: 20 1138 1168 44 0.1 11378.0 0.3X
Coalesce Num Partitions: 10000 Num Hosts: 40 716 723 9 0.1 7157.2 0.6X
Coalesce Num Partitions: 10000 Num Hosts: 80 504 514 9 0.2 5039.9 0.8X


Loading