diff --git a/core/benchmarks/CoalescedRDDBenchmark-jdk11-results.txt b/core/benchmarks/CoalescedRDDBenchmark-jdk11-results.txt index e944111ff9e93..10ac28b46091c 100644 --- a/core/benchmarks/CoalescedRDDBenchmark-jdk11-results.txt +++ b/core/benchmarks/CoalescedRDDBenchmark-jdk11-results.txt @@ -2,39 +2,39 @@ Coalesced RDD , large scale ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Coalesced RDD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Coalesce Num Partitions: 100 Num Hosts: 1 344 360 14 0.3 3441.4 1.0X -Coalesce Num Partitions: 100 Num Hosts: 5 283 301 22 0.4 2825.1 1.2X -Coalesce Num Partitions: 100 Num Hosts: 10 270 271 2 0.4 2700.5 1.3X -Coalesce Num Partitions: 100 Num Hosts: 20 272 273 1 0.4 2721.1 1.3X -Coalesce Num Partitions: 100 Num Hosts: 40 271 272 1 0.4 2710.0 1.3X -Coalesce Num Partitions: 100 Num Hosts: 80 266 267 2 0.4 2656.3 1.3X -Coalesce Num Partitions: 500 Num Hosts: 1 609 619 15 0.2 6089.0 0.6X -Coalesce Num Partitions: 500 Num Hosts: 5 338 343 6 0.3 3383.0 1.0X -Coalesce Num Partitions: 500 Num Hosts: 10 303 306 3 0.3 3029.4 1.1X -Coalesce Num Partitions: 500 Num Hosts: 20 286 288 2 0.4 2855.9 1.2X -Coalesce Num Partitions: 500 Num Hosts: 40 279 282 4 0.4 2793.3 1.2X -Coalesce Num Partitions: 500 Num Hosts: 80 273 275 3 0.4 2725.9 1.3X -Coalesce Num Partitions: 1000 Num Hosts: 1 951 955 4 0.1 9514.1 0.4X -Coalesce Num Partitions: 1000 Num Hosts: 5 421 429 8 0.2 4211.3 0.8X -Coalesce Num Partitions: 1000 Num Hosts: 10 347 352 4 0.3 3473.5 1.0X -Coalesce Num Partitions: 1000 Num Hosts: 20 309 312 5 0.3 3087.5 1.1X -Coalesce Num Partitions: 1000 Num Hosts: 40 290 294 6 0.3 2896.4 1.2X -Coalesce Num Partitions: 1000 Num Hosts: 80 281 286 5 0.4 2811.3 1.2X -Coalesce Num Partitions: 5000 Num Hosts: 1 3928 3950 27 0.0 39278.0 0.1X -Coalesce Num Partitions: 5000 Num Hosts: 5 1373 1389 27 0.1 13725.2 0.3X -Coalesce Num Partitions: 5000 Num Hosts: 10 812 827 13 0.1 8123.3 0.4X -Coalesce Num Partitions: 5000 Num Hosts: 20 530 540 9 0.2 5299.1 0.6X -Coalesce Num Partitions: 5000 Num Hosts: 40 421 425 5 0.2 4210.5 0.8X -Coalesce Num Partitions: 5000 Num Hosts: 80 335 344 12 0.3 3353.7 1.0X -Coalesce Num Partitions: 10000 Num Hosts: 1 7116 7120 4 0.0 71159.0 0.0X -Coalesce Num Partitions: 10000 Num Hosts: 5 2539 2598 51 0.0 25390.1 0.1X -Coalesce Num Partitions: 10000 Num Hosts: 10 1393 1432 34 0.1 13928.1 0.2X -Coalesce Num Partitions: 10000 Num Hosts: 20 833 1009 303 0.1 8329.2 0.4X -Coalesce Num Partitions: 10000 Num Hosts: 40 562 563 3 0.2 5615.2 0.6X -Coalesce Num Partitions: 10000 Num Hosts: 80 420 426 7 0.2 4204.0 0.8X +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +Coalesced RDD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +---------------------------------------------------------------------------------------------------------------------------- +Coalesce Num Partitions: 100 Num Hosts: 1 365 454 104 0.3 3652.8 1.0X +Coalesce Num Partitions: 100 Num Hosts: 5 271 374 90 0.4 2708.0 1.3X +Coalesce Num Partitions: 100 Num Hosts: 10 265 337 88 0.4 2651.9 1.4X +Coalesce Num Partitions: 100 Num Hosts: 20 277 338 87 0.4 2772.8 1.3X +Coalesce Num Partitions: 100 Num Hosts: 40 313 320 6 0.3 3127.8 1.2X +Coalesce Num Partitions: 100 Num Hosts: 80 291 330 60 0.3 2909.5 1.3X +Coalesce Num Partitions: 500 Num Hosts: 1 974 1035 59 0.1 9741.6 0.4X +Coalesce Num Partitions: 500 Num Hosts: 5 443 450 6 0.2 4427.7 0.8X +Coalesce Num Partitions: 500 Num Hosts: 10 382 455 64 0.3 3816.6 1.0X +Coalesce Num Partitions: 500 Num Hosts: 20 359 402 39 0.3 3589.9 1.0X +Coalesce Num Partitions: 500 Num Hosts: 40 317 350 54 0.3 3165.5 1.2X +Coalesce Num Partitions: 500 Num Hosts: 80 267 337 81 0.4 2668.5 1.4X +Coalesce Num Partitions: 1000 Num Hosts: 1 1621 1712 84 0.1 16205.9 0.2X +Coalesce Num Partitions: 1000 Num Hosts: 5 582 638 85 0.2 5817.7 0.6X +Coalesce Num Partitions: 1000 Num Hosts: 10 398 446 74 0.3 3980.8 0.9X +Coalesce Num Partitions: 1000 Num Hosts: 20 332 410 108 0.3 3315.1 1.1X +Coalesce Num Partitions: 1000 Num Hosts: 40 345 377 54 0.3 3453.1 1.1X +Coalesce Num Partitions: 1000 Num Hosts: 80 294 353 69 0.3 2940.5 1.2X +Coalesce Num Partitions: 5000 Num Hosts: 1 6818 6906 151 0.0 68183.8 0.1X +Coalesce Num Partitions: 5000 Num Hosts: 5 1606 1719 138 0.1 16061.1 0.2X +Coalesce Num Partitions: 5000 Num Hosts: 10 965 1031 94 0.1 9653.8 0.4X +Coalesce Num Partitions: 5000 Num Hosts: 20 643 722 98 0.2 6427.4 0.6X +Coalesce Num Partitions: 5000 Num Hosts: 40 445 517 97 0.2 4448.8 0.8X +Coalesce Num Partitions: 5000 Num Hosts: 80 369 432 93 0.3 3688.6 1.0X +Coalesce Num Partitions: 10000 Num Hosts: 1 12850 12953 90 0.0 128503.9 0.0X +Coalesce Num Partitions: 10000 Num Hosts: 5 3431 3463 49 0.0 34307.1 0.1X +Coalesce Num Partitions: 10000 Num Hosts: 10 1687 1795 106 0.1 16874.8 0.2X +Coalesce Num Partitions: 10000 Num Hosts: 20 1084 1125 58 0.1 10844.2 0.3X +Coalesce Num Partitions: 10000 Num Hosts: 40 667 722 73 0.1 6674.4 0.5X +Coalesce Num Partitions: 10000 Num Hosts: 80 488 542 82 0.2 4883.9 0.7X diff --git a/core/benchmarks/CoalescedRDDBenchmark-results.txt b/core/benchmarks/CoalescedRDDBenchmark-results.txt index f1b867951a074..829e43530dd5f 100644 --- a/core/benchmarks/CoalescedRDDBenchmark-results.txt +++ b/core/benchmarks/CoalescedRDDBenchmark-results.txt @@ -2,39 +2,39 @@ Coalesced RDD , large scale ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Coalesced RDD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Coalesce Num Partitions: 100 Num Hosts: 1 395 401 9 0.3 3952.3 1.0X -Coalesce Num Partitions: 100 Num Hosts: 5 296 344 42 0.3 2963.2 1.3X -Coalesce Num Partitions: 100 Num Hosts: 10 294 308 15 0.3 2941.7 1.3X -Coalesce Num Partitions: 100 Num Hosts: 20 316 328 13 0.3 3155.2 1.3X -Coalesce Num Partitions: 100 Num Hosts: 40 294 316 36 0.3 2940.3 1.3X -Coalesce Num Partitions: 100 Num Hosts: 80 292 324 30 0.3 2922.2 1.4X -Coalesce Num Partitions: 500 Num Hosts: 1 629 687 61 0.2 6292.4 0.6X -Coalesce Num Partitions: 500 Num Hosts: 5 354 378 42 0.3 3541.7 1.1X -Coalesce Num Partitions: 500 Num Hosts: 10 318 338 29 0.3 3179.8 1.2X -Coalesce Num Partitions: 500 Num Hosts: 20 306 317 11 0.3 3059.2 1.3X -Coalesce Num Partitions: 500 Num Hosts: 40 294 311 28 0.3 2941.6 1.3X -Coalesce Num Partitions: 500 Num Hosts: 80 288 309 34 0.3 2883.9 1.4X -Coalesce Num Partitions: 1000 Num Hosts: 1 956 978 20 0.1 9562.2 0.4X -Coalesce Num Partitions: 1000 Num Hosts: 5 431 452 36 0.2 4306.2 0.9X -Coalesce Num Partitions: 1000 Num Hosts: 10 358 379 23 0.3 3581.1 1.1X -Coalesce Num Partitions: 1000 Num Hosts: 20 324 347 20 0.3 3236.7 1.2X -Coalesce Num Partitions: 1000 Num Hosts: 40 312 333 20 0.3 3116.8 1.3X -Coalesce Num Partitions: 1000 Num Hosts: 80 307 342 32 0.3 3068.4 1.3X -Coalesce Num Partitions: 5000 Num Hosts: 1 3895 3906 12 0.0 38946.8 0.1X -Coalesce Num Partitions: 5000 Num Hosts: 5 1388 1401 19 0.1 13881.7 0.3X -Coalesce Num Partitions: 5000 Num Hosts: 10 806 839 57 0.1 8063.7 0.5X -Coalesce Num Partitions: 5000 Num Hosts: 20 546 573 44 0.2 5462.6 0.7X -Coalesce Num Partitions: 5000 Num Hosts: 40 413 418 5 0.2 4134.7 1.0X -Coalesce Num Partitions: 5000 Num Hosts: 80 345 365 23 0.3 3448.1 1.1X -Coalesce Num Partitions: 10000 Num Hosts: 1 6933 6966 55 0.0 69328.8 0.1X -Coalesce Num Partitions: 10000 Num Hosts: 5 2455 2499 69 0.0 24551.7 0.2X -Coalesce Num Partitions: 10000 Num Hosts: 10 1352 1392 34 0.1 13520.2 0.3X -Coalesce Num Partitions: 10000 Num Hosts: 20 815 853 50 0.1 8147.5 0.5X -Coalesce Num Partitions: 10000 Num Hosts: 40 558 581 28 0.2 5578.0 0.7X -Coalesce Num Partitions: 10000 Num Hosts: 80 416 423 5 0.2 4163.3 0.9X +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz +Coalesced RDD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +---------------------------------------------------------------------------------------------------------------------------- +Coalesce Num Partitions: 100 Num Hosts: 1 394 423 25 0.3 3942.7 1.0X +Coalesce Num Partitions: 100 Num Hosts: 5 317 339 23 0.3 3171.6 1.2X +Coalesce Num Partitions: 100 Num Hosts: 10 310 324 20 0.3 3095.9 1.3X +Coalesce Num Partitions: 100 Num Hosts: 20 285 292 8 0.4 2849.0 1.4X +Coalesce Num Partitions: 100 Num Hosts: 40 271 292 22 0.4 2712.7 1.5X +Coalesce Num Partitions: 100 Num Hosts: 80 287 300 18 0.3 2874.2 1.4X +Coalesce Num Partitions: 500 Num Hosts: 1 839 872 33 0.1 8388.1 0.5X +Coalesce Num Partitions: 500 Num Hosts: 5 389 395 5 0.3 3892.4 1.0X +Coalesce Num Partitions: 500 Num Hosts: 10 352 356 3 0.3 3522.0 1.1X +Coalesce Num Partitions: 500 Num Hosts: 20 315 322 11 0.3 3145.0 1.3X +Coalesce Num Partitions: 500 Num Hosts: 40 304 324 22 0.3 3036.4 1.3X +Coalesce Num Partitions: 500 Num Hosts: 80 286 301 23 0.4 2855.7 1.4X +Coalesce Num Partitions: 1000 Num Hosts: 1 1390 1422 28 0.1 13898.0 0.3X +Coalesce Num Partitions: 1000 Num Hosts: 5 535 562 26 0.2 5347.4 0.7X +Coalesce Num Partitions: 1000 Num Hosts: 10 419 425 8 0.2 4193.8 0.9X +Coalesce Num Partitions: 1000 Num Hosts: 20 358 364 9 0.3 3575.8 1.1X +Coalesce Num Partitions: 1000 Num Hosts: 40 323 329 5 0.3 3234.8 1.2X +Coalesce Num Partitions: 1000 Num Hosts: 80 306 316 11 0.3 3060.3 1.3X +Coalesce Num Partitions: 5000 Num Hosts: 1 5967 6744 1289 0.0 59666.6 0.1X +Coalesce Num Partitions: 5000 Num Hosts: 5 2010 2032 19 0.0 20104.1 0.2X +Coalesce Num Partitions: 5000 Num Hosts: 10 1132 1161 25 0.1 11324.9 0.3X +Coalesce Num Partitions: 5000 Num Hosts: 20 687 714 39 0.1 6874.2 0.6X +Coalesce Num Partitions: 5000 Num Hosts: 40 507 511 3 0.2 5070.1 0.8X +Coalesce Num Partitions: 5000 Num Hosts: 80 375 383 12 0.3 3749.7 1.1X +Coalesce Num Partitions: 10000 Num Hosts: 1 10782 10833 63 0.0 107816.6 0.0X +Coalesce Num Partitions: 10000 Num Hosts: 5 3819 3901 72 0.0 38185.3 0.1X +Coalesce Num Partitions: 10000 Num Hosts: 10 2021 2030 12 0.0 20212.9 0.2X +Coalesce Num Partitions: 10000 Num Hosts: 20 1138 1168 44 0.1 11378.0 0.3X +Coalesce Num Partitions: 10000 Num Hosts: 40 716 723 9 0.1 7157.2 0.6X +Coalesce Num Partitions: 10000 Num Hosts: 80 504 514 9 0.2 5039.9 0.8X diff --git a/core/benchmarks/KryoBenchmark-jdk11-results.txt b/core/benchmarks/KryoBenchmark-jdk11-results.txt index 27f0b8f59f47a..22b776c6808c8 100644 --- a/core/benchmarks/KryoBenchmark-jdk11-results.txt +++ b/core/benchmarks/KryoBenchmark-jdk11-results.txt @@ -2,27 +2,27 @@ Benchmark Kryo Unsafe vs safe Serialization ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Benchmark Kryo Unsafe vs safe Serialization: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -basicTypes: Int with unsafe:true 275 288 14 3.6 275.2 1.0X -basicTypes: Long with unsafe:true 331 336 13 3.0 330.9 0.8X -basicTypes: Float with unsafe:true 304 305 1 3.3 304.4 0.9X -basicTypes: Double with unsafe:true 328 332 3 3.0 328.1 0.8X -Array: Int with unsafe:true 4 4 0 252.8 4.0 69.6X -Array: Long with unsafe:true 6 6 0 161.5 6.2 44.5X -Array: Float with unsafe:true 4 4 0 264.6 3.8 72.8X -Array: Double with unsafe:true 6 7 0 160.5 6.2 44.2X -Map of string->Double with unsafe:true 52 52 0 19.3 51.8 5.3X -basicTypes: Int with unsafe:false 344 345 1 2.9 344.3 0.8X -basicTypes: Long with unsafe:false 372 373 1 2.7 372.3 0.7X -basicTypes: Float with unsafe:false 333 334 1 3.0 333.4 0.8X -basicTypes: Double with unsafe:false 344 345 0 2.9 344.3 0.8X -Array: Int with unsafe:false 25 25 0 40.8 24.5 11.2X -Array: Long with unsafe:false 37 37 1 27.3 36.7 7.5X -Array: Float with unsafe:false 11 11 0 92.1 10.9 25.4X -Array: Double with unsafe:false 17 18 0 58.3 17.2 16.0X -Map of string->Double with unsafe:false 51 52 1 19.4 51.5 5.3X +--------------------------------------------------------------------------------------------------------------------------- +basicTypes: Int with unsafe:true 331 346 11 3.0 330.7 1.0X +basicTypes: Long with unsafe:true 392 401 9 2.6 392.0 0.8X +basicTypes: Float with unsafe:true 394 404 9 2.5 394.5 0.8X +basicTypes: Double with unsafe:true 404 414 7 2.5 404.0 0.8X +Array: Int with unsafe:true 5 6 1 195.3 5.1 64.6X +Array: Long with unsafe:true 8 9 1 124.1 8.1 41.0X +Array: Float with unsafe:true 5 6 1 186.1 5.4 61.5X +Array: Double with unsafe:true 8 9 1 126.1 7.9 41.7X +Map of string->Double with unsafe:true 54 59 4 18.4 54.4 6.1X +basicTypes: Int with unsafe:false 417 428 8 2.4 416.6 0.8X +basicTypes: Long with unsafe:false 452 466 9 2.2 451.8 0.7X +basicTypes: Float with unsafe:false 410 421 6 2.4 410.0 0.8X +basicTypes: Double with unsafe:false 429 444 10 2.3 429.2 0.8X +Array: Int with unsafe:false 25 27 2 39.2 25.5 13.0X +Array: Long with unsafe:false 40 43 2 25.0 40.0 8.3X +Array: Float with unsafe:false 11 12 1 90.7 11.0 30.0X +Array: Double with unsafe:false 18 20 1 54.2 18.5 17.9X +Map of string->Double with unsafe:false 55 59 2 18.0 55.5 6.0X diff --git a/core/benchmarks/KryoBenchmark-results.txt b/core/benchmarks/KryoBenchmark-results.txt index 49791e6e87e3a..5c38ff9cabe0e 100644 --- a/core/benchmarks/KryoBenchmark-results.txt +++ b/core/benchmarks/KryoBenchmark-results.txt @@ -2,27 +2,27 @@ Benchmark Kryo Unsafe vs safe Serialization ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Benchmark Kryo Unsafe vs safe Serialization: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -basicTypes: Int with unsafe:true 269 290 23 3.7 269.0 1.0X -basicTypes: Long with unsafe:true 294 295 1 3.4 293.8 0.9X -basicTypes: Float with unsafe:true 300 301 1 3.3 300.4 0.9X -basicTypes: Double with unsafe:true 304 305 1 3.3 304.0 0.9X -Array: Int with unsafe:true 5 6 1 193.5 5.2 52.0X -Array: Long with unsafe:true 8 9 1 131.2 7.6 35.3X -Array: Float with unsafe:true 6 6 0 163.5 6.1 44.0X -Array: Double with unsafe:true 9 10 0 108.8 9.2 29.3X -Map of string->Double with unsafe:true 54 54 1 18.7 53.6 5.0X -basicTypes: Int with unsafe:false 326 327 1 3.1 326.2 0.8X -basicTypes: Long with unsafe:false 353 354 1 2.8 353.3 0.8X -basicTypes: Float with unsafe:false 325 327 1 3.1 325.1 0.8X -basicTypes: Double with unsafe:false 335 336 1 3.0 335.0 0.8X -Array: Int with unsafe:false 27 28 1 36.7 27.2 9.9X -Array: Long with unsafe:false 40 41 1 25.0 40.0 6.7X -Array: Float with unsafe:false 12 13 1 80.8 12.4 21.7X -Array: Double with unsafe:false 21 21 1 48.6 20.6 13.1X -Map of string->Double with unsafe:false 56 57 1 17.8 56.1 4.8X +--------------------------------------------------------------------------------------------------------------------------- +basicTypes: Int with unsafe:true 286 295 6 3.5 285.6 1.0X +basicTypes: Long with unsafe:true 320 327 5 3.1 319.8 0.9X +basicTypes: Float with unsafe:true 314 318 2 3.2 313.5 0.9X +basicTypes: Double with unsafe:true 310 319 6 3.2 309.9 0.9X +Array: Int with unsafe:true 5 6 1 217.9 4.6 62.2X +Array: Long with unsafe:true 8 9 1 121.5 8.2 34.7X +Array: Float with unsafe:true 5 6 0 217.5 4.6 62.1X +Array: Double with unsafe:true 9 9 1 117.3 8.5 33.5X +Map of string->Double with unsafe:true 51 52 1 19.7 50.9 5.6X +basicTypes: Int with unsafe:false 373 384 12 2.7 373.3 0.8X +basicTypes: Long with unsafe:false 373 391 9 2.7 372.6 0.8X +basicTypes: Float with unsafe:false 349 362 11 2.9 349.2 0.8X +basicTypes: Double with unsafe:false 358 372 10 2.8 358.0 0.8X +Array: Int with unsafe:false 25 29 1 40.0 25.0 11.4X +Array: Long with unsafe:false 35 39 1 28.2 35.5 8.1X +Array: Float with unsafe:false 10 12 1 100.2 10.0 28.6X +Array: Double with unsafe:false 17 20 1 58.3 17.1 16.7X +Map of string->Double with unsafe:false 48 53 2 20.6 48.5 5.9X diff --git a/core/benchmarks/KryoSerializerBenchmark-jdk11-results.txt b/core/benchmarks/KryoSerializerBenchmark-jdk11-results.txt index 6b148bde12d36..41ac5386754a4 100644 --- a/core/benchmarks/KryoSerializerBenchmark-jdk11-results.txt +++ b/core/benchmarks/KryoSerializerBenchmark-jdk11-results.txt @@ -2,11 +2,11 @@ Benchmark KryoPool vs old"pool of 1" implementation ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Benchmark KryoPool vs old"pool of 1" implementation: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -KryoPool:true 6208 8374 NaN 0.0 12416876.6 1.0X -KryoPool:false 9084 11577 724 0.0 18168947.4 0.7X +----------------------------------------------------------------------------------------------------------------------------------- +KryoPool:true 10053 13422 983 0.0 20106810.4 1.0X +KryoPool:false 16854 19164 NaN 0.0 33708260.0 0.6X diff --git a/core/benchmarks/KryoSerializerBenchmark-results.txt b/core/benchmarks/KryoSerializerBenchmark-results.txt index 609f3298cbc00..c10f7dc415982 100644 --- a/core/benchmarks/KryoSerializerBenchmark-results.txt +++ b/core/benchmarks/KryoSerializerBenchmark-results.txt @@ -2,11 +2,11 @@ Benchmark KryoPool vs old"pool of 1" implementation ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Benchmark KryoPool vs old"pool of 1" implementation: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -KryoPool:true 6012 7586 NaN 0.0 12023020.2 1.0X -KryoPool:false 9289 11566 909 0.0 18578683.1 0.6X +----------------------------------------------------------------------------------------------------------------------------------- +KryoPool:true 7893 10556 NaN 0.0 15785307.8 1.0X +KryoPool:false 12778 15741 426 0.0 25555753.8 0.6X diff --git a/core/benchmarks/MapStatusesSerDeserBenchmark-jdk11-results.txt b/core/benchmarks/MapStatusesSerDeserBenchmark-jdk11-results.txt index 4b16bd445f39d..29699a2fdcf2a 100644 --- a/core/benchmarks/MapStatusesSerDeserBenchmark-jdk11-results.txt +++ b/core/benchmarks/MapStatusesSerDeserBenchmark-jdk11-results.txt @@ -1,64 +1,64 @@ -OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 200000 MapOutputs, 10 blocks w/ broadcast: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Serialization 175 183 12 1.1 874.1 1.0X -Deserialization 458 462 6 0.4 2288.6 0.4X +Serialization 179 194 9 1.1 897.4 1.0X +Deserialization 254 321 74 0.8 1271.0 0.7X -Compressed Serialized MapStatus sizes: 410 bytes +Compressed Serialized MapStatus sizes: 409 bytes Compressed Serialized Broadcast MapStatus sizes: 2 MB -OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 200000 MapOutputs, 10 blocks w/o broadcast: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative -------------------------------------------------------------------------------------------------------------------------- -Serialization 160 171 8 1.2 801.1 1.0X -Deserialization 453 484 38 0.4 2263.4 0.4X +Serialization 160 166 7 1.2 801.2 1.0X +Deserialization 256 323 69 0.8 1278.9 0.6X Compressed Serialized MapStatus sizes: 2 MB Compressed Serialized Broadcast MapStatus sizes: 0 bytes -OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 200000 MapOutputs, 100 blocks w/ broadcast: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative -------------------------------------------------------------------------------------------------------------------------- -Serialization 343 346 2 0.6 1717.1 1.0X -Deserialization 492 540 59 0.4 2459.6 0.7X +Serialization 341 349 7 0.6 1707.3 1.0X +Deserialization 286 370 84 0.7 1431.4 1.2X Compressed Serialized MapStatus sizes: 426 bytes Compressed Serialized Broadcast MapStatus sizes: 13 MB -OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 200000 MapOutputs, 100 blocks w/o broadcast: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative --------------------------------------------------------------------------------------------------------------------------- -Serialization 297 299 2 0.7 1486.2 1.0X -Deserialization 489 535 87 0.4 2446.5 0.6X +Serialization 309 319 11 0.6 1543.6 1.0X +Deserialization 286 373 117 0.7 1429.5 1.1X Compressed Serialized MapStatus sizes: 13 MB Compressed Serialized Broadcast MapStatus sizes: 0 bytes -OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 200000 MapOutputs, 1000 blocks w/ broadcast: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative --------------------------------------------------------------------------------------------------------------------------- -Serialization 1641 1819 252 0.1 8204.1 1.0X -Deserialization 844 882 37 0.2 4219.7 1.9X +Serialization 1619 1627 12 0.1 8092.6 1.0X +Deserialization 864 883 26 0.2 4319.9 1.9X -Compressed Serialized MapStatus sizes: 553 bytes +Compressed Serialized MapStatus sizes: 557 bytes Compressed Serialized Broadcast MapStatus sizes: 121 MB -OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 200000 MapOutputs, 1000 blocks w/o broadcast: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ---------------------------------------------------------------------------------------------------------------------------- -Serialization 1360 1412 73 0.1 6799.3 1.0X -Deserialization 850 859 13 0.2 4249.9 1.6X +Serialization 1449 1456 9 0.1 7246.8 1.0X +Deserialization 853 888 46 0.2 4263.7 1.7X Compressed Serialized MapStatus sizes: 121 MB Compressed Serialized Broadcast MapStatus sizes: 0 bytes diff --git a/core/benchmarks/MapStatusesSerDeserBenchmark-results.txt b/core/benchmarks/MapStatusesSerDeserBenchmark-results.txt index 996b79b896dba..96fa3a01a8f6d 100644 --- a/core/benchmarks/MapStatusesSerDeserBenchmark-results.txt +++ b/core/benchmarks/MapStatusesSerDeserBenchmark-results.txt @@ -1,64 +1,64 @@ -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 200000 MapOutputs, 10 blocks w/ broadcast: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Serialization 193 202 15 1.0 966.2 1.0X -Deserialization 477 521 44 0.4 2387.5 0.4X +Serialization 135 161 56 1.5 673.9 1.0X +Deserialization 213 235 26 0.9 1065.6 0.6X -Compressed Serialized MapStatus sizes: 410 bytes +Compressed Serialized MapStatus sizes: 409 bytes Compressed Serialized Broadcast MapStatus sizes: 2 MB -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 200000 MapOutputs, 10 blocks w/o broadcast: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative -------------------------------------------------------------------------------------------------------------------------- -Serialization 181 187 11 1.1 907.1 1.0X -Deserialization 477 492 27 0.4 2383.5 0.4X +Serialization 130 137 5 1.5 650.8 1.0X +Deserialization 211 230 20 0.9 1056.5 0.6X Compressed Serialized MapStatus sizes: 2 MB Compressed Serialized Broadcast MapStatus sizes: 0 bytes -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 200000 MapOutputs, 100 blocks w/ broadcast: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative -------------------------------------------------------------------------------------------------------------------------- -Serialization 359 436 162 0.6 1797.5 1.0X -Deserialization 506 514 15 0.4 2530.8 0.7X +Serialization 281 324 86 0.7 1406.7 1.0X +Deserialization 240 267 32 0.8 1200.5 1.2X Compressed Serialized MapStatus sizes: 426 bytes Compressed Serialized Broadcast MapStatus sizes: 13 MB -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 200000 MapOutputs, 100 blocks w/o broadcast: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative --------------------------------------------------------------------------------------------------------------------------- -Serialization 322 323 0 0.6 1610.5 1.0X -Deserialization 508 513 5 0.4 2538.4 0.6X +Serialization 265 273 6 0.8 1324.5 1.0X +Deserialization 247 276 33 0.8 1236.1 1.1X Compressed Serialized MapStatus sizes: 13 MB Compressed Serialized Broadcast MapStatus sizes: 0 bytes -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 200000 MapOutputs, 1000 blocks w/ broadcast: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative --------------------------------------------------------------------------------------------------------------------------- -Serialization 1740 1903 231 0.1 8700.0 1.0X -Deserialization 872 888 24 0.2 4360.9 2.0X +Serialization 1333 1592 366 0.2 6666.0 1.0X +Deserialization 560 585 22 0.4 2799.1 2.4X -Compressed Serialized MapStatus sizes: 553 bytes +Compressed Serialized MapStatus sizes: 558 bytes Compressed Serialized Broadcast MapStatus sizes: 121 MB -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 200000 MapOutputs, 1000 blocks w/o broadcast: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ---------------------------------------------------------------------------------------------------------------------------- -Serialization 1461 1469 11 0.1 7306.1 1.0X -Deserialization 871 889 22 0.2 4353.9 1.7X +Serialization 1222 1260 54 0.2 6111.7 1.0X +Deserialization 539 568 42 0.4 2695.3 2.3X Compressed Serialized MapStatus sizes: 121 MB Compressed Serialized Broadcast MapStatus sizes: 0 bytes diff --git a/core/benchmarks/PropertiesCloneBenchmark-jdk11-results.txt b/core/benchmarks/PropertiesCloneBenchmark-jdk11-results.txt index 605b856d53382..f1d6b1ff372bc 100644 --- a/core/benchmarks/PropertiesCloneBenchmark-jdk11-results.txt +++ b/core/benchmarks/PropertiesCloneBenchmark-jdk11-results.txt @@ -2,39 +2,39 @@ Properties Cloning ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Empty Properties: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SerializationUtils.clone 0 0 0 0.1 11539.0 1.0X -Utils.cloneProperties 0 0 0 1.7 572.0 20.2X +SerializationUtils.clone 0 0 0 0.2 4800.0 1.0X +Utils.cloneProperties 0 0 0 Infinity 0.0 InfinityX -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz System Properties: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SerializationUtils.clone 0 0 0 0.0 217514.0 1.0X -Utils.cloneProperties 0 0 0 0.2 5387.0 40.4X +SerializationUtils.clone 0 0 0 0.0 202203.0 1.0X +Utils.cloneProperties 0 0 0 0.1 6700.0 30.2X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Small Properties: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SerializationUtils.clone 1 1 0 0.0 634574.0 1.0X -Utils.cloneProperties 0 0 0 0.3 3082.0 205.9X +SerializationUtils.clone 1 1 0 0.0 588099.0 1.0X +Utils.cloneProperties 0 0 0 0.2 5699.0 103.2X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Medium Properties: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SerializationUtils.clone 3 3 0 0.0 2576565.0 1.0X -Utils.cloneProperties 0 0 0 0.1 16071.0 160.3X +SerializationUtils.clone 2 3 0 0.0 2357927.0 1.0X +Utils.cloneProperties 0 0 0 0.0 31901.0 73.9X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Large Properties: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SerializationUtils.clone 5 5 0 0.0 5027248.0 1.0X -Utils.cloneProperties 0 0 0 0.0 31842.0 157.9X +SerializationUtils.clone 5 5 0 0.0 4636068.0 1.0X +Utils.cloneProperties 0 0 0 0.0 64701.0 71.7X diff --git a/core/benchmarks/PropertiesCloneBenchmark-results.txt b/core/benchmarks/PropertiesCloneBenchmark-results.txt index 5d332a147c698..81ccff6e638c8 100644 --- a/core/benchmarks/PropertiesCloneBenchmark-results.txt +++ b/core/benchmarks/PropertiesCloneBenchmark-results.txt @@ -2,39 +2,39 @@ Properties Cloning ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Empty Properties: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SerializationUtils.clone 0 0 0 0.1 13640.0 1.0X -Utils.cloneProperties 0 0 0 1.6 608.0 22.4X +SerializationUtils.clone 0 0 0 0.2 5599.0 1.0X +Utils.cloneProperties 0 0 0 Infinity 0.0 InfinityX -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz System Properties: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SerializationUtils.clone 0 0 0 0.0 238968.0 1.0X -Utils.cloneProperties 0 0 0 0.4 2318.0 103.1X +SerializationUtils.clone 0 0 0 0.0 339506.0 1.0X +Utils.cloneProperties 0 0 0 0.5 1900.0 178.7X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Small Properties: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SerializationUtils.clone 1 1 0 0.0 725849.0 1.0X -Utils.cloneProperties 0 0 0 0.3 2900.0 250.3X +SerializationUtils.clone 1 1 0 0.0 604411.0 1.0X +Utils.cloneProperties 0 0 0 0.2 5100.0 118.5X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Medium Properties: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SerializationUtils.clone 3 3 0 0.0 2999676.0 1.0X -Utils.cloneProperties 0 0 0 0.1 11734.0 255.6X +SerializationUtils.clone 2 2 0 0.0 2378345.0 1.0X +Utils.cloneProperties 0 0 0 0.0 25100.0 94.8X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Large Properties: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SerializationUtils.clone 6 6 1 0.0 5846410.0 1.0X -Utils.cloneProperties 0 0 0 0.0 22405.0 260.9X +SerializationUtils.clone 4 4 0 0.0 4035677.0 1.0X +Utils.cloneProperties 0 0 0 0.0 43300.0 93.2X diff --git a/core/benchmarks/XORShiftRandomBenchmark-jdk11-results.txt b/core/benchmarks/XORShiftRandomBenchmark-jdk11-results.txt index 9aa10e4835a2f..0b13462c59b51 100644 --- a/core/benchmarks/XORShiftRandomBenchmark-jdk11-results.txt +++ b/core/benchmarks/XORShiftRandomBenchmark-jdk11-results.txt @@ -2,43 +2,43 @@ Pseudo random ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz nextInt: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -java.util.Random 1362 1362 0 73.4 13.6 1.0X -XORShiftRandom 227 227 0 440.6 2.3 6.0X +java.util.Random 1414 1423 10 70.7 14.1 1.0X +XORShiftRandom 234 238 3 426.9 2.3 6.0X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz nextLong: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -java.util.Random 2725 2726 1 36.7 27.3 1.0X -XORShiftRandom 694 694 1 144.1 6.9 3.9X +java.util.Random 2669 2699 26 37.5 26.7 1.0X +XORShiftRandom 622 633 12 160.7 6.2 4.3X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz nextDouble: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -java.util.Random 2727 2728 0 36.7 27.3 1.0X -XORShiftRandom 693 694 0 144.2 6.9 3.9X +java.util.Random 2613 2712 98 38.3 26.1 1.0X +XORShiftRandom 667 675 7 149.9 6.7 3.9X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz nextGaussian: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -java.util.Random 7012 7016 4 14.3 70.1 1.0X -XORShiftRandom 6065 6067 1 16.5 60.7 1.2X +java.util.Random 6687 6757 61 15.0 66.9 1.0X +XORShiftRandom 4882 4892 9 20.5 48.8 1.4X ================================================================================================ hash seed ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Hash seed: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -XORShiftRandom.hashSeed 36 37 1 276.5 3.6 1.0X +XORShiftRandom.hashSeed 40 42 3 247.4 4.0 1.0X diff --git a/core/benchmarks/XORShiftRandomBenchmark-results.txt b/core/benchmarks/XORShiftRandomBenchmark-results.txt index 4b069878b2e9b..87093eaabd7ea 100644 --- a/core/benchmarks/XORShiftRandomBenchmark-results.txt +++ b/core/benchmarks/XORShiftRandomBenchmark-results.txt @@ -2,43 +2,43 @@ Pseudo random ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz nextInt: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -java.util.Random 1362 1396 59 73.4 13.6 1.0X -XORShiftRandom 227 227 0 440.7 2.3 6.0X +java.util.Random 1192 1217 24 83.9 11.9 1.0X +XORShiftRandom 193 196 4 518.9 1.9 6.2X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz nextLong: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -java.util.Random 2732 2732 1 36.6 27.3 1.0X -XORShiftRandom 630 630 1 158.7 6.3 4.3X +java.util.Random 2391 2402 10 41.8 23.9 1.0X +XORShiftRandom 518 528 11 193.1 5.2 4.6X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz nextDouble: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -java.util.Random 2731 2732 1 36.6 27.3 1.0X -XORShiftRandom 630 630 0 158.8 6.3 4.3X +java.util.Random 2318 2363 39 43.1 23.2 1.0X +XORShiftRandom 488 496 13 205.0 4.9 4.8X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz nextGaussian: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -java.util.Random 8895 8899 4 11.2 88.9 1.0X -XORShiftRandom 5049 5052 5 19.8 50.5 1.8X +java.util.Random 6102 6156 77 16.4 61.0 1.0X +XORShiftRandom 3685 3758 84 27.1 36.9 1.7X ================================================================================================ hash seed ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Hash seed: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -XORShiftRandom.hashSeed 67 68 1 148.8 6.7 1.0X +XORShiftRandom.hashSeed 65 66 2 155.0 6.5 1.0X diff --git a/core/benchmarks/ZStandardBenchmark-jdk11-results.txt b/core/benchmarks/ZStandardBenchmark-jdk11-results.txt index 0f73abd0ffabd..3895e7bb6f27d 100644 --- a/core/benchmarks/ZStandardBenchmark-jdk11-results.txt +++ b/core/benchmarks/ZStandardBenchmark-jdk11-results.txt @@ -2,26 +2,26 @@ Benchmark ZStandardCompressionCodec ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.10+9-Ubuntu-0ubuntu1.18.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Benchmark ZStandardCompressionCodec: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative -------------------------------------------------------------------------------------------------------------------------------------- -Compression 10000 times at level 1 without buffer pool 798 810 11 0.0 79767.6 1.0X -Compression 10000 times at level 2 without buffer pool 706 714 9 0.0 70554.1 1.1X -Compression 10000 times at level 3 without buffer pool 934 934 0 0.0 93385.0 0.9X -Compression 10000 times at level 1 with buffer pool 407 409 1 0.0 40749.3 2.0X -Compression 10000 times at level 2 with buffer pool 478 481 2 0.0 47818.3 1.7X -Compression 10000 times at level 3 with buffer pool 719 719 0 0.0 71861.2 1.1X +Compression 10000 times at level 1 without buffer pool 606 614 6 0.0 60645.3 1.0X +Compression 10000 times at level 2 without buffer pool 686 693 7 0.0 68594.9 0.9X +Compression 10000 times at level 3 without buffer pool 906 920 14 0.0 90642.7 0.7X +Compression 10000 times at level 1 with buffer pool 389 403 20 0.0 38901.4 1.6X +Compression 10000 times at level 2 with buffer pool 450 466 13 0.0 45032.0 1.3X +Compression 10000 times at level 3 with buffer pool 680 682 2 0.0 68004.2 0.9X -OpenJDK 64-Bit Server VM 11.0.10+9-Ubuntu-0ubuntu1.18.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Benchmark ZStandardCompressionCodec: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------------------------ -Decompression 10000 times from level 1 without buffer pool 787 787 0 0.0 78665.3 1.0X -Decompression 10000 times from level 2 without buffer pool 784 785 1 0.0 78381.3 1.0X -Decompression 10000 times from level 3 without buffer pool 785 786 1 0.0 78480.4 1.0X -Decompression 10000 times from level 1 with buffer pool 571 572 0 0.0 57117.5 1.4X -Decompression 10000 times from level 2 with buffer pool 572 573 1 0.0 57221.8 1.4X -Decompression 10000 times from level 3 with buffer pool 572 572 0 0.0 57159.7 1.4X +Decompression 10000 times from level 1 without buffer pool 1209 1226 25 0.0 120862.8 1.0X +Decompression 10000 times from level 2 without buffer pool 1191 1193 3 0.0 119064.9 1.0X +Decompression 10000 times from level 3 without buffer pool 1188 1193 6 0.0 118843.3 1.0X +Decompression 10000 times from level 1 with buffer pool 998 1004 9 0.0 99754.7 1.2X +Decompression 10000 times from level 2 with buffer pool 990 1001 11 0.0 99043.8 1.2X +Decompression 10000 times from level 3 with buffer pool 983 999 20 0.0 98269.5 1.2X diff --git a/core/benchmarks/ZStandardBenchmark-results.txt b/core/benchmarks/ZStandardBenchmark-results.txt index fb867ef4b366a..6990c28690072 100644 --- a/core/benchmarks/ZStandardBenchmark-results.txt +++ b/core/benchmarks/ZStandardBenchmark-results.txt @@ -2,26 +2,26 @@ Benchmark ZStandardCompressionCodec ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_282-8u282-b08-0ubuntu1~18.04-b08 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Benchmark ZStandardCompressionCodec: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative -------------------------------------------------------------------------------------------------------------------------------------- -Compression 10000 times at level 1 without buffer pool 851 865 13 0.0 85083.8 1.0X -Compression 10000 times at level 2 without buffer pool 701 702 1 0.0 70107.3 1.2X -Compression 10000 times at level 3 without buffer pool 946 947 1 0.0 94580.8 0.9X -Compression 10000 times at level 1 with buffer pool 408 417 8 0.0 40774.3 2.1X -Compression 10000 times at level 2 with buffer pool 489 490 1 0.0 48926.5 1.7X -Compression 10000 times at level 3 with buffer pool 726 727 1 0.0 72586.8 1.2X +Compression 10000 times at level 1 without buffer pool 670 681 9 0.0 67011.0 1.0X +Compression 10000 times at level 2 without buffer pool 569 571 2 0.0 56932.0 1.2X +Compression 10000 times at level 3 without buffer pool 748 751 2 0.0 74813.8 0.9X +Compression 10000 times at level 1 with buffer pool 336 337 1 0.0 33630.6 2.0X +Compression 10000 times at level 2 with buffer pool 395 397 2 0.0 39472.6 1.7X +Compression 10000 times at level 3 with buffer pool 563 567 4 0.0 56272.8 1.2X -OpenJDK 64-Bit Server VM 1.8.0_282-8u282-b08-0ubuntu1~18.04-b08 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Benchmark ZStandardCompressionCodec: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------------------------ -Decompression 10000 times from level 1 without buffer pool 793 793 0 0.0 79273.3 1.0X -Decompression 10000 times from level 2 without buffer pool 797 798 0 0.0 79734.3 1.0X -Decompression 10000 times from level 3 without buffer pool 796 797 0 0.0 79612.0 1.0X -Decompression 10000 times from level 1 with buffer pool 577 578 1 0.0 57716.7 1.4X -Decompression 10000 times from level 2 with buffer pool 580 581 1 0.0 57970.1 1.4X -Decompression 10000 times from level 3 with buffer pool 580 581 1 0.0 58001.6 1.4X +Decompression 10000 times from level 1 without buffer pool 1029 1031 3 0.0 102887.4 1.0X +Decompression 10000 times from level 2 without buffer pool 1028 1031 4 0.0 102847.8 1.0X +Decompression 10000 times from level 3 without buffer pool 1029 1029 0 0.0 102941.0 1.0X +Decompression 10000 times from level 1 with buffer pool 798 799 0 0.0 79838.0 1.3X +Decompression 10000 times from level 2 with buffer pool 799 799 0 0.0 79852.9 1.3X +Decompression 10000 times from level 3 with buffer pool 796 798 2 0.0 79630.5 1.3X diff --git a/external/avro/benchmarks/AvroReadBenchmark-jdk11-results.txt b/external/avro/benchmarks/AvroReadBenchmark-jdk11-results.txt index b70b1446f6f64..0a7f6edaba266 100644 --- a/external/avro/benchmarks/AvroReadBenchmark-jdk11-results.txt +++ b/external/avro/benchmarks/AvroReadBenchmark-jdk11-results.txt @@ -2,129 +2,129 @@ SQL Single Numeric Column Scan ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 2872 2936 90 5.5 182.6 1.0X +Sum 3468 3495 39 4.5 220.5 1.0X -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 2810 2838 40 5.6 178.6 1.0X +Sum 3378 3388 13 4.7 214.8 1.0X -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 2901 2922 30 5.4 184.4 1.0X +Sum 3353 3371 26 4.7 213.2 1.0X -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 3387 3391 5 4.6 215.4 1.0X +Sum 3712 3739 38 4.2 236.0 1.0X -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 2890 2960 99 5.4 183.7 1.0X +Sum 3290 3322 45 4.8 209.2 1.0X -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 3067 3088 30 5.1 195.0 1.0X +Sum 3475 3493 25 4.5 220.9 1.0X ================================================================================================ Int and String Scan ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of columns 4736 4818 116 2.2 451.7 1.0X +Sum of columns 5032 5053 29 2.1 479.9 1.0X ================================================================================================ Partitioned Table Scan ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Data column 3383 3400 23 4.6 215.1 1.0X -Partition column 2949 2959 14 5.3 187.5 1.1X -Both columns 3522 3545 33 4.5 223.9 1.0X +Data column 3819 3820 1 4.1 242.8 1.0X +Partition column 3285 3340 77 4.8 208.8 1.2X +Both columns 4051 4066 21 3.9 257.6 0.9X ================================================================================================ Repeated String Scan ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of string length 3332 3355 32 3.1 317.7 1.0X +Sum of string length 3631 3653 32 2.9 346.2 1.0X ================================================================================================ String with Nulls Scan ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of string length 5588 5652 90 1.9 532.9 1.0X +Sum of string length 5786 5801 21 1.8 551.8 1.0X -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of string length 3858 3865 9 2.7 368.0 1.0X +Sum of string length 3767 3791 34 2.8 359.2 1.0X -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of string length 2562 2571 12 4.1 244.3 1.0X +Sum of string length 2472 2498 36 4.2 235.8 1.0X ================================================================================================ Single Column Scan From Wide Columns ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of single column 5241 5243 3 0.2 4998.0 1.0X +Sum of single column 5366 5366 0 0.2 5117.5 1.0X -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Single Column Scan from 200 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of single column 10178 10185 10 0.1 9706.5 1.0X +Sum of single column 10223 10234 15 0.1 9749.7 1.0X -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Single Column Scan from 300 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of single column 15201 15232 44 0.1 14496.4 1.0X +Sum of single column 15283 15328 64 0.1 14575.0 1.0X -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Filters pushdown: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -w/o filters 9614 9669 54 0.1 9614.1 1.0X -pushdown disabled 10077 10141 66 0.1 10077.2 1.0X -w/ filters 4681 4713 29 0.2 4681.5 2.1X +w/o filters 9724 9765 46 0.1 9724.4 1.0X +pushdown disabled 9628 9726 99 0.1 9627.6 1.0X +w/ filters 4833 4879 40 0.2 4833.5 2.0X diff --git a/external/avro/benchmarks/AvroReadBenchmark-results.txt b/external/avro/benchmarks/AvroReadBenchmark-results.txt index 3108a9c8e13fe..f77db2d5e4e67 100644 --- a/external/avro/benchmarks/AvroReadBenchmark-results.txt +++ b/external/avro/benchmarks/AvroReadBenchmark-results.txt @@ -2,129 +2,129 @@ SQL Single Numeric Column Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 2841 2846 7 5.5 180.6 1.0X +Sum 2802 2826 34 5.6 178.1 1.0X -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 2777 2799 30 5.7 176.6 1.0X +Sum 2786 2810 35 5.6 177.1 1.0X -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 2730 2753 33 5.8 173.6 1.0X +Sum 2808 2817 13 5.6 178.5 1.0X -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 3278 3284 9 4.8 208.4 1.0X +Sum 3222 3224 3 4.9 204.9 1.0X -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 2801 2805 6 5.6 178.1 1.0X +Sum 2827 2844 24 5.6 179.7 1.0X -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum 2976 2984 12 5.3 189.2 1.0X +Sum 2910 2924 20 5.4 185.0 1.0X ================================================================================================ Int and String Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of columns 4674 4686 17 2.2 445.8 1.0X +Sum of columns 4575 4580 7 2.3 436.3 1.0X ================================================================================================ Partitioned Table Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Data column 3273 3284 17 4.8 208.1 1.0X -Partition column 2934 2935 2 5.4 186.6 1.1X -Both columns 3395 3405 14 4.6 215.8 1.0X +Data column 3252 3271 27 4.8 206.8 1.0X +Partition column 2905 2907 3 5.4 184.7 1.1X +Both columns 3385 3398 18 4.6 215.2 1.0X ================================================================================================ Repeated String Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of string length 3340 3353 19 3.1 318.5 1.0X +Sum of string length 3275 3278 3 3.2 312.4 1.0X ================================================================================================ String with Nulls Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of string length 5484 5493 12 1.9 523.0 1.0X +Sum of string length 5202 5219 24 2.0 496.1 1.0X -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of string length 3817 3833 22 2.7 364.0 1.0X +Sum of string length 3360 3381 29 3.1 320.5 1.0X -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of string length 2340 2354 20 4.5 223.2 1.0X +Sum of string length 1917 1936 28 5.5 182.8 1.0X ================================================================================================ Single Column Scan From Wide Columns ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of single column 4709 4719 14 0.2 4491.1 1.0X +Sum of single column 4348 4424 107 0.2 4146.5 1.0X -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Single Column Scan from 200 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of single column 9159 9171 18 0.1 8734.3 1.0X +Sum of single column 8799 8806 10 0.1 8391.2 1.0X -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Single Column Scan from 300 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Sum of single column 13645 13751 151 0.1 13012.8 1.0X +Sum of single column 12956 12990 49 0.1 12355.5 1.0X -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Filters pushdown: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -w/o filters 9215 9309 146 0.1 9215.2 1.0X -pushdown disabled 9535 9637 96 0.1 9534.9 1.0X -w/ filters 3969 3994 22 0.3 3969.5 2.3X +w/o filters 9208 9269 63 0.1 9207.5 1.0X +pushdown disabled 9073 9111 59 0.1 9072.7 1.0X +w/ filters 3929 3947 18 0.3 3928.8 2.3X diff --git a/external/avro/benchmarks/AvroWriteBenchmark-jdk11-results.txt b/external/avro/benchmarks/AvroWriteBenchmark-jdk11-results.txt index 2cf1835013821..4cdb05dffcaaa 100644 --- a/external/avro/benchmarks/AvroWriteBenchmark-jdk11-results.txt +++ b/external/avro/benchmarks/AvroWriteBenchmark-jdk11-results.txt @@ -1,10 +1,10 @@ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Avro writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Output Single Int Column 3026 3142 164 5.2 192.4 1.0X -Output Single Double Column 3157 3260 145 5.0 200.7 1.0X -Output Int and String Column 6123 6190 94 2.6 389.3 0.5X -Output Partitions 5197 5733 758 3.0 330.4 0.6X -Output Buckets 7074 7285 298 2.2 449.7 0.4X +Output Single Int Column 3307 3313 8 4.8 210.3 1.0X +Output Single Double Column 3566 3584 26 4.4 226.7 0.9X +Output Int and String Column 6913 6988 106 2.3 439.5 0.5X +Output Partitions 5984 6112 181 2.6 380.5 0.6X +Output Buckets 8403 8505 144 1.9 534.3 0.4X diff --git a/external/avro/benchmarks/AvroWriteBenchmark-results.txt b/external/avro/benchmarks/AvroWriteBenchmark-results.txt index 20f6ae9099a4d..26bb126cf182d 100644 --- a/external/avro/benchmarks/AvroWriteBenchmark-results.txt +++ b/external/avro/benchmarks/AvroWriteBenchmark-results.txt @@ -1,10 +1,10 @@ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Avro writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Output Single Int Column 3080 3137 82 5.1 195.8 1.0X -Output Single Double Column 3595 3595 0 4.4 228.6 0.9X -Output Int and String Column 7491 7504 18 2.1 476.3 0.4X -Output Partitions 5518 5663 205 2.9 350.8 0.6X -Output Buckets 7467 7581 161 2.1 474.7 0.4X +Output Single Int Column 2478 2537 83 6.3 157.6 1.0X +Output Single Double Column 2636 2652 21 6.0 167.6 0.9X +Output Int and String Column 5922 6039 166 2.7 376.5 0.4X +Output Partitions 4158 4305 207 3.8 264.3 0.6X +Output Buckets 5486 5534 68 2.9 348.8 0.5X diff --git a/mllib/benchmarks/UDTSerializationBenchmark-jdk11-results.txt b/mllib/benchmarks/UDTSerializationBenchmark-jdk11-results.txt index 6f671405b8343..8354132d7e5c7 100644 --- a/mllib/benchmarks/UDTSerializationBenchmark-jdk11-results.txt +++ b/mllib/benchmarks/UDTSerializationBenchmark-jdk11-results.txt @@ -2,11 +2,11 @@ VectorUDT de/serialization ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz VectorUDT de/serialization: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -serialize 269 292 13 0.0 269441.1 1.0X -deserialize 164 191 9 0.0 164314.6 1.6X +serialize 482 507 11 0.0 481956.1 1.0X +deserialize 276 291 9 0.0 276403.3 1.7X diff --git a/mllib/benchmarks/UDTSerializationBenchmark-results.txt b/mllib/benchmarks/UDTSerializationBenchmark-results.txt index a0c853e99014b..8a8e904430172 100644 --- a/mllib/benchmarks/UDTSerializationBenchmark-results.txt +++ b/mllib/benchmarks/UDTSerializationBenchmark-results.txt @@ -2,11 +2,11 @@ VectorUDT de/serialization ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz VectorUDT de/serialization: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -serialize 271 294 12 0.0 271054.3 1.0X -deserialize 190 192 2 0.0 189706.1 1.4X +serialize 248 271 16 0.0 248244.3 1.0X +deserialize 135 165 19 0.0 135445.9 1.8X diff --git a/sql/catalyst/benchmarks/GenericArrayDataBenchmark-jdk11-results.txt b/sql/catalyst/benchmarks/GenericArrayDataBenchmark-jdk11-results.txt index 6a5a9b781e894..a3ef8452bb03c 100644 --- a/sql/catalyst/benchmarks/GenericArrayDataBenchmark-jdk11-results.txt +++ b/sql/catalyst/benchmarks/GenericArrayDataBenchmark-jdk11-results.txt @@ -1,10 +1,10 @@ -OpenJDK 64-Bit Server VM 11.0.5+10 on Mac OS X 10.14.6 -Intel(R) Core(TM) i5-8210Y CPU @ 1.60GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz constructor: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -arrayOfAny 6 7 1 1770.9 0.6 1.0X -arrayOfAnyAsObject 6 7 2 1709.3 0.6 1.0X -arrayOfAnyAsSeq 5 6 2 2195.5 0.5 1.2X -arrayOfInt 452 469 13 22.1 45.2 0.0X -arrayOfIntAsObject 678 690 11 14.7 67.8 0.0X +arrayOfAny 5 6 1 1957.6 0.5 1.0X +arrayOfAnyAsObject 5 6 1 2001.6 0.5 1.0X +arrayOfAnyAsSeq 5 6 1 2040.4 0.5 1.0X +arrayOfInt 578 595 20 17.3 57.8 0.0X +arrayOfIntAsObject 830 847 18 12.0 83.0 0.0X diff --git a/sql/catalyst/benchmarks/GenericArrayDataBenchmark-results.txt b/sql/catalyst/benchmarks/GenericArrayDataBenchmark-results.txt index 02971749662f5..88de9c13130d0 100644 --- a/sql/catalyst/benchmarks/GenericArrayDataBenchmark-results.txt +++ b/sql/catalyst/benchmarks/GenericArrayDataBenchmark-results.txt @@ -1,10 +1,10 @@ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_191-b12 on Mac OS X 10.14.6 -Intel(R) Core(TM) i5-8210Y CPU @ 1.60GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz constructor: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -arrayOfAny 7 8 2 1471.6 0.7 1.0X -arrayOfAnyAsObject 197 207 9 50.7 19.7 0.0X -arrayOfAnyAsSeq 25 27 2 398.0 2.5 0.3X -arrayOfInt 613 630 15 16.3 61.3 0.0X -arrayOfIntAsObject 866 872 8 11.5 86.6 0.0X +arrayOfAny 3 4 0 2907.2 0.3 1.0X +arrayOfAnyAsObject 274 276 2 36.5 27.4 0.0X +arrayOfAnyAsSeq 21 23 1 470.1 2.1 0.2X +arrayOfInt 727 735 8 13.8 72.7 0.0X +arrayOfIntAsObject 998 1002 6 10.0 99.8 0.0X diff --git a/sql/catalyst/benchmarks/HashBenchmark-jdk11-results.txt b/sql/catalyst/benchmarks/HashBenchmark-jdk11-results.txt index d6452891a3ddd..6454809cd6218 100644 --- a/sql/catalyst/benchmarks/HashBenchmark-jdk11-results.txt +++ b/sql/catalyst/benchmarks/HashBenchmark-jdk11-results.txt @@ -2,69 +2,69 @@ single ints ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Hash For single ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -interpreted version 3285 3286 1 163.4 6.1 1.0X -codegen version 6838 6838 0 78.5 12.7 0.5X -codegen version 64-bit 6247 6247 0 85.9 11.6 0.5X -codegen HiveHash version 4927 4927 0 109.0 9.2 0.7X +interpreted version 4452 4453 1 120.6 8.3 1.0X +codegen version 5888 5942 77 91.2 11.0 0.8X +codegen version 64-bit 5760 5782 30 93.2 10.7 0.8X +codegen HiveHash version 4697 4744 67 114.3 8.7 0.9X ================================================================================================ single longs ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Hash For single longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -interpreted version 3615 3615 0 148.5 6.7 1.0X -codegen version 9630 9633 5 55.8 17.9 0.4X -codegen version 64-bit 6763 6764 2 79.4 12.6 0.5X -codegen HiveHash version 5709 5711 2 94.0 10.6 0.6X +interpreted version 5628 5654 36 95.4 10.5 1.0X +codegen version 8911 8913 4 60.3 16.6 0.6X +codegen version 64-bit 6828 6830 3 78.6 12.7 0.8X +codegen HiveHash version 5731 5734 4 93.7 10.7 1.0X ================================================================================================ normal ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Hash For normal: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -interpreted version 2946 2965 27 0.7 1404.7 1.0X -codegen version 2386 2386 1 0.9 1137.7 1.2X -codegen version 64-bit 895 895 0 2.3 426.8 3.3X -codegen HiveHash version 4454 4463 14 0.5 2123.6 0.7X +interpreted version 3207 3212 7 0.7 1529.4 1.0X +codegen version 2518 2522 6 0.8 1200.9 1.3X +codegen version 64-bit 1004 1009 7 2.1 478.7 3.2X +codegen HiveHash version 5074 5076 3 0.4 2419.5 0.6X ================================================================================================ array ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Hash For array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -interpreted version 2325 2374 68 0.1 17740.6 1.0X -codegen version 4928 4977 69 0.0 37597.1 0.5X -codegen version 64-bit 3404 3408 5 0.0 25973.0 0.7X -codegen HiveHash version 1491 1512 30 0.1 11376.3 1.6X +interpreted version 2309 2314 7 0.1 17619.7 1.0X +codegen version 4207 4214 9 0.0 32098.7 0.5X +codegen version 64-bit 3518 3522 6 0.0 26842.6 0.7X +codegen HiveHash version 1681 1698 24 0.1 12823.2 1.4X ================================================================================================ map ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Hash For map: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -interpreted version 0 0 0 45.1 22.2 1.0X -codegen version 271 278 8 0.0 66062.7 0.0X -codegen version 64-bit 208 210 2 0.0 50775.0 0.0X -codegen HiveHash version 52 53 0 0.1 12794.9 0.0X +interpreted version 0 0 0 42.7 23.4 1.0X +codegen version 207 209 1 0.0 50608.9 0.0X +codegen version 64-bit 203 204 1 0.0 49444.7 0.0X +codegen HiveHash version 56 57 0 0.1 13725.9 0.0X diff --git a/sql/catalyst/benchmarks/HashBenchmark-results.txt b/sql/catalyst/benchmarks/HashBenchmark-results.txt index 8075df73399b9..a8596bc917cf1 100644 --- a/sql/catalyst/benchmarks/HashBenchmark-results.txt +++ b/sql/catalyst/benchmarks/HashBenchmark-results.txt @@ -2,69 +2,69 @@ single ints ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Hash For single ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -interpreted version 3364 3364 0 159.6 6.3 1.0X -codegen version 6921 6924 4 77.6 12.9 0.5X -codegen version 64-bit 6139 6140 2 87.5 11.4 0.5X -codegen HiveHash version 5097 5099 2 105.3 9.5 0.7X +interpreted version 3181 3184 4 168.8 5.9 1.0X +codegen version 4371 4372 1 122.8 8.1 0.7X +codegen version 64-bit 3869 3870 1 138.7 7.2 0.8X +codegen HiveHash version 3633 3636 4 147.8 6.8 0.9X ================================================================================================ single longs ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Hash For single longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -interpreted version 3838 3838 0 139.9 7.1 1.0X -codegen version 9690 9703 19 55.4 18.0 0.4X -codegen version 64-bit 6876 6877 1 78.1 12.8 0.6X -codegen HiveHash version 5717 5718 1 93.9 10.6 0.7X +interpreted version 3747 3747 0 143.3 7.0 1.0X +codegen version 7617 7626 12 70.5 14.2 0.5X +codegen version 64-bit 4622 4623 0 116.1 8.6 0.8X +codegen HiveHash version 4423 4424 1 121.4 8.2 0.8X ================================================================================================ normal ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Hash For normal: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -interpreted version 2914 2918 6 0.7 1389.6 1.0X -codegen version 2337 2341 6 0.9 1114.5 1.2X -codegen version 64-bit 910 911 3 2.3 433.9 3.2X -codegen HiveHash version 4479 4480 1 0.5 2135.9 0.7X +interpreted version 2760 2808 67 0.8 1316.1 1.0X +codegen version 1901 1901 0 1.1 906.7 1.5X +codegen version 64-bit 769 771 3 2.7 366.5 3.6X +codegen HiveHash version 3713 3723 13 0.6 1770.6 0.7X ================================================================================================ array ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Hash For array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -interpreted version 2081 2133 74 0.1 15878.7 1.0X -codegen version 4385 4506 172 0.0 33452.2 0.5X -codegen version 64-bit 3518 3552 48 0.0 26842.8 0.6X -codegen HiveHash version 1715 1752 52 0.1 13085.4 1.2X +interpreted version 1677 1692 21 0.1 12797.1 1.0X +codegen version 2609 2697 124 0.1 19907.4 0.6X +codegen version 64-bit 2673 2692 27 0.0 20392.7 0.6X +codegen HiveHash version 1363 1382 28 0.1 10396.1 1.2X ================================================================================================ map ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Hash For map: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -interpreted version 0 0 0 50.4 19.8 1.0X -codegen version 195 204 8 0.0 47681.7 0.0X -codegen version 64-bit 186 190 3 0.0 45296.8 0.0X -codegen HiveHash version 48 48 0 0.1 11610.3 0.0X +interpreted version 0 0 0 46.7 21.4 1.0X +codegen version 159 160 1 0.0 38910.2 0.0X +codegen version 64-bit 155 156 1 0.0 37908.4 0.0X +codegen HiveHash version 42 43 0 0.1 10321.6 0.0X diff --git a/sql/catalyst/benchmarks/HashByteArrayBenchmark-jdk11-results.txt b/sql/catalyst/benchmarks/HashByteArrayBenchmark-jdk11-results.txt index d8d43068929ed..5f3d0a657eb4e 100644 --- a/sql/catalyst/benchmarks/HashByteArrayBenchmark-jdk11-results.txt +++ b/sql/catalyst/benchmarks/HashByteArrayBenchmark-jdk11-results.txt @@ -2,76 +2,76 @@ Benchmark for MurMurHash 3 and xxHash64 ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Hash byte arrays with length 8: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Murmur3_x86_32 14 14 0 147.0 6.8 1.0X -xxHash 64-bit 18 18 0 119.7 8.4 0.8X -HiveHasher 16 16 0 129.9 7.7 0.9X +Murmur3_x86_32 15 16 1 140.1 7.1 1.0X +xxHash 64-bit 18 19 1 118.8 8.4 0.8X +HiveHasher 17 18 1 122.4 8.2 0.9X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Hash byte arrays with length 16: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Murmur3_x86_32 23 23 0 89.8 11.1 1.0X -xxHash 64-bit 22 23 0 93.3 10.7 1.0X -HiveHasher 26 26 0 79.4 12.6 0.9X +Murmur3_x86_32 23 24 1 90.1 11.1 1.0X +xxHash 64-bit 21 22 2 98.5 10.2 1.1X +HiveHasher 29 31 2 71.3 14.0 0.8X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Hash byte arrays with length 24: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Murmur3_x86_32 32 32 0 65.5 15.3 1.0X -xxHash 64-bit 26 26 0 80.8 12.4 1.2X -HiveHasher 41 41 0 50.8 19.7 0.8X +Murmur3_x86_32 31 32 2 68.5 14.6 1.0X +xxHash 64-bit 24 25 1 87.4 11.4 1.3X +HiveHasher 45 48 3 46.8 21.4 0.7X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Hash byte arrays with length 31: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Murmur3_x86_32 49 49 0 43.2 23.2 1.0X -xxHash 64-bit 44 44 0 48.0 20.8 1.1X -HiveHasher 55 56 0 37.8 26.4 0.9X +Murmur3_x86_32 48 50 2 44.0 22.7 1.0X +xxHash 64-bit 42 45 2 50.2 19.9 1.1X +HiveHasher 62 65 2 34.1 29.3 0.8X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Hash byte arrays with length 95: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Murmur3_x86_32 127 127 0 16.5 60.5 1.0X -xxHash 64-bit 83 83 0 25.3 39.5 1.5X -HiveHasher 196 196 0 10.7 93.3 0.6X +Murmur3_x86_32 113 118 3 18.6 53.8 1.0X +xxHash 64-bit 86 89 2 24.3 41.1 1.3X +HiveHasher 218 226 7 9.6 103.9 0.5X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Hash byte arrays with length 287: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Murmur3_x86_32 327 327 0 6.4 155.9 1.0X -xxHash 64-bit 138 138 0 15.2 65.9 2.4X -HiveHasher 628 628 0 3.3 299.6 0.5X +Murmur3_x86_32 346 352 6 6.1 165.2 1.0X +xxHash 64-bit 155 158 2 13.5 73.8 2.2X +HiveHasher 722 728 7 2.9 344.5 0.5X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Hash byte arrays with length 1055: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Murmur3_x86_32 1145 1145 0 1.8 545.9 1.0X -xxHash 64-bit 370 371 0 5.7 176.6 3.1X -HiveHasher 2325 2325 0 0.9 1108.6 0.5X +Murmur3_x86_32 1217 1224 9 1.7 580.3 1.0X +xxHash 64-bit 412 417 3 5.1 196.5 3.0X +HiveHasher 2593 2630 52 0.8 1236.6 0.5X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Hash byte arrays with length 2079: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Murmur3_x86_32 2209 2211 3 0.9 1053.4 1.0X -xxHash 64-bit 615 615 0 3.4 293.0 3.6X -HiveHasher 4590 4590 0 0.5 2188.7 0.5X +Murmur3_x86_32 2451 2454 4 0.9 1168.8 1.0X +xxHash 64-bit 621 631 7 3.4 296.0 3.9X +HiveHasher 5243 5295 73 0.4 2500.1 0.5X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Hash byte arrays with length 8223: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Murmur3_x86_32 8687 8702 22 0.2 4142.2 1.0X -xxHash 64-bit 2033 2034 1 1.0 969.5 4.3X -HiveHasher 18216 18218 2 0.1 8686.1 0.5X +Murmur3_x86_32 9280 9405 177 0.2 4425.1 1.0X +xxHash 64-bit 1943 1945 3 1.1 926.5 4.8X +HiveHasher 20457 20458 1 0.1 9754.6 0.5X diff --git a/sql/catalyst/benchmarks/HashByteArrayBenchmark-results.txt b/sql/catalyst/benchmarks/HashByteArrayBenchmark-results.txt index 83bd970e14392..35582ff03b5be 100644 --- a/sql/catalyst/benchmarks/HashByteArrayBenchmark-results.txt +++ b/sql/catalyst/benchmarks/HashByteArrayBenchmark-results.txt @@ -2,76 +2,76 @@ Benchmark for MurMurHash 3 and xxHash64 ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Hash byte arrays with length 8: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Murmur3_x86_32 15 15 0 138.0 7.2 1.0X -xxHash 64-bit 17 17 0 125.7 8.0 0.9X -HiveHasher 16 16 0 134.4 7.4 1.0X +Murmur3_x86_32 11 12 1 195.8 5.1 1.0X +xxHash 64-bit 11 13 1 190.4 5.3 1.0X +HiveHasher 12 13 1 181.4 5.5 0.9X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Hash byte arrays with length 16: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Murmur3_x86_32 24 24 0 86.8 11.5 1.0X -xxHash 64-bit 22 22 0 96.5 10.4 1.1X -HiveHasher 31 31 0 66.8 15.0 0.8X +Murmur3_x86_32 16 19 1 128.5 7.8 1.0X +xxHash 64-bit 14 16 1 145.7 6.9 1.1X +HiveHasher 22 25 1 93.6 10.7 0.7X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Hash byte arrays with length 24: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Murmur3_x86_32 34 34 0 61.9 16.2 1.0X -xxHash 64-bit 26 26 0 79.6 12.6 1.3X -HiveHasher 48 48 0 44.0 22.7 0.7X +Murmur3_x86_32 23 26 2 90.3 11.1 1.0X +xxHash 64-bit 18 20 1 119.6 8.4 1.3X +HiveHasher 35 38 2 60.7 16.5 0.7X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Hash byte arrays with length 31: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Murmur3_x86_32 50 50 0 41.9 23.9 1.0X -xxHash 64-bit 40 40 0 52.4 19.1 1.3X -HiveHasher 61 61 0 34.4 29.1 0.8X +Murmur3_x86_32 38 41 2 55.6 18.0 1.0X +xxHash 64-bit 30 33 2 69.9 14.3 1.3X +HiveHasher 48 53 2 43.7 22.9 0.8X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Hash byte arrays with length 95: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Murmur3_x86_32 132 133 0 15.9 63.1 1.0X -xxHash 64-bit 77 78 0 27.4 36.5 1.7X -HiveHasher 209 209 0 10.0 99.6 0.6X +Murmur3_x86_32 92 101 6 22.8 43.8 1.0X +xxHash 64-bit 56 63 3 37.4 26.7 1.6X +HiveHasher 165 175 5 12.7 78.7 0.6X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Hash byte arrays with length 287: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Murmur3_x86_32 333 334 0 6.3 158.9 1.0X -xxHash 64-bit 123 123 0 17.1 58.6 2.7X -HiveHasher 630 630 0 3.3 300.3 0.5X +Murmur3_x86_32 276 294 13 7.6 131.7 1.0X +xxHash 64-bit 94 103 5 22.2 45.0 2.9X +HiveHasher 549 574 19 3.8 261.6 0.5X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Hash byte arrays with length 1055: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Murmur3_x86_32 1151 1151 0 1.8 548.9 1.0X -xxHash 64-bit 321 321 0 6.5 153.2 3.6X -HiveHasher 2332 2332 1 0.9 1111.8 0.5X +Murmur3_x86_32 1009 1016 10 2.1 481.3 1.0X +xxHash 64-bit 246 260 7 8.5 117.4 4.1X +HiveHasher 2243 2257 19 0.9 1069.6 0.4X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Hash byte arrays with length 2079: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Murmur3_x86_32 2213 2213 0 0.9 1055.2 1.0X -xxHash 64-bit 550 550 0 3.8 262.3 4.0X -HiveHasher 4599 4599 1 0.5 2192.8 0.5X +Murmur3_x86_32 2021 2036 22 1.0 963.7 1.0X +xxHash 64-bit 458 466 7 4.6 218.2 4.4X +HiveHasher 4473 4525 73 0.5 2132.9 0.5X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Hash byte arrays with length 8223: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Murmur3_x86_32 8660 8664 6 0.2 4129.3 1.0X -xxHash 64-bit 1889 1893 6 1.1 900.6 4.6X -HiveHasher 18269 18272 5 0.1 8711.3 0.5X +Murmur3_x86_32 7706 7771 92 0.3 3674.5 1.0X +xxHash 64-bit 1512 1533 29 1.4 721.1 5.1X +HiveHasher 17151 17155 5 0.1 8178.4 0.4X diff --git a/sql/catalyst/benchmarks/UnsafeProjectionBenchmark-jdk11-results.txt b/sql/catalyst/benchmarks/UnsafeProjectionBenchmark-jdk11-results.txt index 8b56fcbebc79c..8f18280c59c88 100644 --- a/sql/catalyst/benchmarks/UnsafeProjectionBenchmark-jdk11-results.txt +++ b/sql/catalyst/benchmarks/UnsafeProjectionBenchmark-jdk11-results.txt @@ -2,13 +2,13 @@ unsafe projection ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz unsafe projection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -single long 2218 2219 1 121.0 8.3 1.0X -single nullable long 3200 3201 1 83.9 11.9 0.7X -7 primitive types 7809 7813 5 34.4 29.1 0.3X -7 nullable primitive types 11906 11908 3 22.5 44.4 0.2X +single long 2009 2009 0 133.6 7.5 1.0X +single nullable long 3300 3301 0 81.3 12.3 0.6X +7 primitive types 6499 6508 13 41.3 24.2 0.3X +7 nullable primitive types 11725 11741 22 22.9 43.7 0.2X diff --git a/sql/catalyst/benchmarks/UnsafeProjectionBenchmark-results.txt b/sql/catalyst/benchmarks/UnsafeProjectionBenchmark-results.txt index 7b30e2075f010..4d484090e29b3 100644 --- a/sql/catalyst/benchmarks/UnsafeProjectionBenchmark-results.txt +++ b/sql/catalyst/benchmarks/UnsafeProjectionBenchmark-results.txt @@ -2,13 +2,13 @@ unsafe projection ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz unsafe projection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -single long 2173 2173 0 123.5 8.1 1.0X -single nullable long 3156 3157 2 85.0 11.8 0.7X -7 primitive types 6725 6726 2 39.9 25.1 0.3X -7 nullable primitive types 11399 11400 2 23.5 42.5 0.2X +single long 1610 1629 27 166.7 6.0 1.0X +single nullable long 2349 2397 68 114.3 8.8 0.7X +7 primitive types 5446 5508 88 49.3 20.3 0.3X +7 nullable primitive types 8743 8843 142 30.7 32.6 0.2X diff --git a/sql/core/benchmarks/AggregateBenchmark-jdk11-results.txt b/sql/core/benchmarks/AggregateBenchmark-jdk11-results.txt index baa237d3142d8..546face681b4c 100644 --- a/sql/core/benchmarks/AggregateBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/AggregateBenchmark-jdk11-results.txt @@ -2,142 +2,142 @@ aggregate without grouping ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz agg w/o group: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -agg w/o group wholestage off 59499 62969 2375 35.2 28.4 1.0X -agg w/o group wholestage on 890 902 10 2357.2 0.4 66.9X +agg w/o group wholestage off 63666 64021 502 32.9 30.4 1.0X +agg w/o group wholestage on 882 912 37 2376.9 0.4 72.2X ================================================================================================ stat functions ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz stddev: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -stddev wholestage off 8702 8870 237 12.0 83.0 1.0X -stddev wholestage on 1307 1314 9 80.2 12.5 6.7X +stddev wholestage off 7370 7688 450 14.2 70.3 1.0X +stddev wholestage on 931 997 50 112.6 8.9 7.9X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz kurtosis: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -kurtosis wholestage off 42656 42797 198 2.5 406.8 1.0X -kurtosis wholestage on 1440 1466 32 72.8 13.7 29.6X +kurtosis wholestage off 30901 31209 436 3.4 294.7 1.0X +kurtosis wholestage on 950 996 33 110.4 9.1 32.5X ================================================================================================ aggregate with linear keys ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 10963 11035 101 7.7 130.7 1.0X -codegen = T hashmap = F 6852 7080 207 12.2 81.7 1.6X -codegen = T hashmap = T 1377 1421 43 60.9 16.4 8.0X +codegen = F 8845 8874 41 9.5 105.4 1.0X +codegen = T hashmap = F 5804 5854 47 14.5 69.2 1.5X +codegen = T hashmap = T 954 1001 35 87.9 11.4 9.3X ================================================================================================ aggregate with randomized keys ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 12240 12296 80 6.9 145.9 1.0X -codegen = T hashmap = F 8318 8376 87 10.1 99.2 1.5X -codegen = T hashmap = T 2551 2617 80 32.9 30.4 4.8X +codegen = F 10398 10788 552 8.1 124.0 1.0X +codegen = T hashmap = F 7426 7520 84 11.3 88.5 1.4X +codegen = T hashmap = T 1883 1917 31 44.5 22.4 5.5X ================================================================================================ aggregate with string key ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Aggregate w string key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 4442 4504 88 4.7 211.8 1.0X -codegen = T hashmap = F 2685 2778 95 7.8 128.0 1.7X -codegen = T hashmap = T 1181 1203 15 17.8 56.3 3.8X +codegen = F 3615 3888 386 5.8 172.4 1.0X +codegen = T hashmap = F 2253 2381 168 9.3 107.4 1.6X +codegen = T hashmap = T 1242 1316 59 16.9 59.2 2.9X ================================================================================================ aggregate with decimal key ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Aggregate w decimal key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 3487 3534 66 6.0 166.3 1.0X -codegen = T hashmap = F 2239 2353 161 9.4 106.8 1.6X -codegen = T hashmap = T 664 693 26 31.6 31.7 5.3X +codegen = F 3437 3534 137 6.1 163.9 1.0X +codegen = T hashmap = F 2122 2226 147 9.9 101.2 1.6X +codegen = T hashmap = T 638 678 36 32.9 30.4 5.4X ================================================================================================ aggregate with multiple key types ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Aggregate w multiple keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 6414 6475 86 3.3 305.9 1.0X -codegen = T hashmap = F 3776 3800 34 5.6 180.1 1.7X -codegen = T hashmap = T 2824 2852 40 7.4 134.7 2.3X +codegen = F 6549 6648 140 3.2 312.3 1.0X +codegen = T hashmap = F 3591 3693 144 5.8 171.2 1.8X +codegen = T hashmap = T 2822 2922 141 7.4 134.6 2.3X ================================================================================================ max function bytecode size of wholestagecodegen ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz max function bytecode size: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 654 696 36 1.0 998.6 1.0X -codegen = T hugeMethodLimit = 10000 378 405 24 1.7 577.1 1.7X -codegen = T hugeMethodLimit = 1500 383 403 22 1.7 584.3 1.7X +codegen = F 531 571 36 1.2 810.7 1.0X +codegen = T hugeMethodLimit = 10000 223 282 36 2.9 340.1 2.4X +codegen = T hugeMethodLimit = 1500 264 308 27 2.5 402.2 2.0X ================================================================================================ cube ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz cube: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cube wholestage off 3443 3444 1 1.5 656.7 1.0X -cube wholestage on 1797 1815 20 2.9 342.7 1.9X +cube wholestage off 2963 3099 193 1.8 565.1 1.0X +cube wholestage on 1624 1767 98 3.2 309.8 1.8X ================================================================================================ hash and BytesToBytesMap ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz BytesToBytesMap: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -UnsafeRowhash 313 314 2 67.1 14.9 1.0X -murmur3 hash 144 145 2 145.9 6.9 2.2X -fast hash 70 72 5 301.5 3.3 4.5X -arrayEqual 189 190 0 111.0 9.0 1.7X -Java HashMap (Long) 129 132 4 162.4 6.2 2.4X -Java HashMap (two ints) 148 154 7 142.0 7.0 2.1X -Java HashMap (UnsafeRow) 839 840 1 25.0 40.0 0.4X -LongToUnsafeRowMap (opt=false) 462 464 1 45.4 22.0 0.7X -LongToUnsafeRowMap (opt=true) 108 108 1 194.2 5.2 2.9X -BytesToBytesMap (off Heap) 1027 1029 2 20.4 49.0 0.3X -BytesToBytesMap (on Heap) 999 1001 3 21.0 47.6 0.3X -Aggregate HashMap 44 44 0 477.8 2.1 7.1X +UnsafeRowhash 247 268 19 84.8 11.8 1.0X +murmur3 hash 99 123 40 211.3 4.7 2.5X +fast hash 56 66 5 374.0 2.7 4.4X +arrayEqual 186 200 8 113.0 8.8 1.3X +Java HashMap (Long) 121 207 65 173.5 5.8 2.0X +Java HashMap (two ints) 147 233 61 142.8 7.0 1.7X +Java HashMap (UnsafeRow) 733 778 45 28.6 34.9 0.3X +LongToUnsafeRowMap (opt=false) 489 504 15 42.8 23.3 0.5X +LongToUnsafeRowMap (opt=true) 125 154 29 168.2 5.9 2.0X +BytesToBytesMap (off Heap) 840 895 48 25.0 40.1 0.3X +BytesToBytesMap (on Heap) 853 904 60 24.6 40.7 0.3X +Aggregate HashMap 38 46 8 546.3 1.8 6.4X diff --git a/sql/core/benchmarks/AggregateBenchmark-results.txt b/sql/core/benchmarks/AggregateBenchmark-results.txt index b1c2e9d6ae9fe..f18c470831c67 100644 --- a/sql/core/benchmarks/AggregateBenchmark-results.txt +++ b/sql/core/benchmarks/AggregateBenchmark-results.txt @@ -2,142 +2,142 @@ aggregate without grouping ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz agg w/o group: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -agg w/o group wholestage off 49902 52257 NaN 42.0 23.8 1.0X -agg w/o group wholestage on 1162 1171 10 1805.2 0.6 43.0X +agg w/o group wholestage off 47798 50190 NaN 43.9 22.8 1.0X +agg w/o group wholestage on 1091 1128 28 1922.6 0.5 43.8X ================================================================================================ stat functions ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz stddev: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -stddev wholestage off 8203 8243 56 12.8 78.2 1.0X -stddev wholestage on 1287 1303 10 81.5 12.3 6.4X +stddev wholestage off 7884 7959 106 13.3 75.2 1.0X +stddev wholestage on 1012 1072 34 103.6 9.6 7.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz kurtosis: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -kurtosis wholestage off 39557 39919 511 2.7 377.2 1.0X -kurtosis wholestage on 1398 1476 138 75.0 13.3 28.3X +kurtosis wholestage off 34023 34576 783 3.1 324.5 1.0X +kurtosis wholestage on 1092 1121 30 96.1 10.4 31.2X ================================================================================================ aggregate with linear keys ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 11236 12182 1337 7.5 133.9 1.0X -codegen = T hashmap = F 7079 7337 250 11.9 84.4 1.6X -codegen = T hashmap = T 1278 1419 186 65.6 15.2 8.8X +codegen = F 9309 9379 99 9.0 111.0 1.0X +codegen = T hashmap = F 5453 5643 223 15.4 65.0 1.7X +codegen = T hashmap = T 1084 1110 16 77.4 12.9 8.6X ================================================================================================ aggregate with randomized keys ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 11629 11650 30 7.2 138.6 1.0X -codegen = T hashmap = F 7552 7747 169 11.1 90.0 1.5X -codegen = T hashmap = T 2414 2662 167 34.7 28.8 4.8X +codegen = F 10707 10950 344 7.8 127.6 1.0X +codegen = T hashmap = F 7295 7423 145 11.5 87.0 1.5X +codegen = T hashmap = T 2057 2199 199 40.8 24.5 5.2X ================================================================================================ aggregate with string key ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Aggregate w string key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 4790 4904 162 4.4 228.4 1.0X -codegen = T hashmap = F 3439 3504 105 6.1 164.0 1.4X -codegen = T hashmap = T 2327 2365 39 9.0 111.0 2.1X +codegen = F 4570 4573 4 4.6 217.9 1.0X +codegen = T hashmap = F 3600 3686 74 5.8 171.7 1.3X +codegen = T hashmap = T 2384 2432 45 8.8 113.7 1.9X ================================================================================================ aggregate with decimal key ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Aggregate w decimal key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 3260 3418 223 6.4 155.5 1.0X -codegen = T hashmap = F 2316 2325 14 9.1 110.4 1.4X -codegen = T hashmap = T 605 607 2 34.7 28.8 5.4X +codegen = F 2966 3011 64 7.1 141.4 1.0X +codegen = T hashmap = F 1857 1908 73 11.3 88.5 1.6X +codegen = T hashmap = T 695 702 8 30.2 33.2 4.3X ================================================================================================ aggregate with multiple key types ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Aggregate w multiple keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 7426 7473 67 2.8 354.1 1.0X -codegen = T hashmap = F 4685 4723 54 4.5 223.4 1.6X -codegen = T hashmap = T 3946 4005 83 5.3 188.2 1.9X +codegen = F 7361 7385 35 2.8 351.0 1.0X +codegen = T hashmap = F 4525 4688 231 4.6 215.8 1.6X +codegen = T hashmap = T 3865 3977 159 5.4 184.3 1.9X ================================================================================================ max function bytecode size of wholestagecodegen ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz max function bytecode size: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -codegen = F 628 672 49 1.0 958.4 1.0X -codegen = T hugeMethodLimit = 10000 357 373 12 1.8 545.3 1.8X -codegen = T hugeMethodLimit = 1500 344 356 7 1.9 525.6 1.8X +codegen = F 451 489 23 1.5 688.5 1.0X +codegen = T hugeMethodLimit = 10000 211 229 19 3.1 322.4 2.1X +codegen = T hugeMethodLimit = 1500 203 226 20 3.2 309.5 2.2X ================================================================================================ cube ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz cube: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cube wholestage off 3167 3266 140 1.7 604.1 1.0X -cube wholestage on 1549 1576 29 3.4 295.4 2.0X +cube wholestage off 2479 2548 97 2.1 472.9 1.0X +cube wholestage on 1487 1567 62 3.5 283.7 1.7X ================================================================================================ hash and BytesToBytesMap ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz BytesToBytesMap: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -UnsafeRowhash 326 328 2 64.3 15.5 1.0X -murmur3 hash 147 147 0 142.7 7.0 2.2X -fast hash 74 75 1 282.3 3.5 4.4X -arrayEqual 175 175 0 119.8 8.3 1.9X -Java HashMap (Long) 138 140 4 152.1 6.6 2.4X -Java HashMap (two ints) 148 154 7 141.7 7.1 2.2X -Java HashMap (UnsafeRow) 1043 1090 66 20.1 49.8 0.3X -LongToUnsafeRowMap (opt=false) 464 466 2 45.2 22.1 0.7X -LongToUnsafeRowMap (opt=true) 104 106 8 202.3 4.9 3.1X -BytesToBytesMap (off Heap) 1140 1149 12 18.4 54.4 0.3X -BytesToBytesMap (on Heap) 1002 1132 183 20.9 47.8 0.3X -Aggregate HashMap 74 74 0 281.9 3.5 4.4X +UnsafeRowhash 826 837 16 25.4 39.4 1.0X +murmur3 hash 537 553 11 39.1 25.6 1.5X +fast hash 559 572 14 37.5 26.6 1.5X +arrayEqual 1665 1728 90 12.6 79.4 0.5X +Java HashMap (Long) 732 739 7 28.7 34.9 1.1X +Java HashMap (two ints) 682 694 15 30.7 32.5 1.2X +Java HashMap (UnsafeRow) 1486 1499 19 14.1 70.9 0.6X +LongToUnsafeRowMap (opt=false) 1235 1240 8 17.0 58.9 0.7X +LongToUnsafeRowMap (opt=true) 718 736 17 29.2 34.2 1.2X +BytesToBytesMap (off Heap) 945 965 20 22.2 45.1 0.9X +BytesToBytesMap (on Heap) 870 895 28 24.1 41.5 0.9X +Aggregate HashMap 64 71 5 325.6 3.1 12.8X diff --git a/sql/core/benchmarks/BloomFilterBenchmark-jdk11-results.txt b/sql/core/benchmarks/BloomFilterBenchmark-jdk11-results.txt index cb1e96a3df236..1e3abebef021f 100644 --- a/sql/core/benchmarks/BloomFilterBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/BloomFilterBenchmark-jdk11-results.txt @@ -2,23 +2,23 @@ ORC Write ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Write 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Without bloom filter 19554 20736 1672 5.1 195.5 1.0X -With bloom filter 22112 22203 129 4.5 221.1 0.9X +Without bloom filter 19503 19621 166 5.1 195.0 1.0X +With bloom filter 22472 22710 335 4.4 224.7 0.9X ================================================================================================ ORC Read ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Without bloom filter 1866 1879 19 53.6 18.7 1.0X -With bloom filter 1523 1544 29 65.6 15.2 1.2X +Without bloom filter 1981 2040 82 50.5 19.8 1.0X +With bloom filter 1428 1467 54 70.0 14.3 1.4X diff --git a/sql/core/benchmarks/BloomFilterBenchmark-results.txt b/sql/core/benchmarks/BloomFilterBenchmark-results.txt index ec629129559f4..149d3bf76f770 100644 --- a/sql/core/benchmarks/BloomFilterBenchmark-results.txt +++ b/sql/core/benchmarks/BloomFilterBenchmark-results.txt @@ -2,23 +2,23 @@ ORC Write ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Write 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Without bloom filter 19110 19145 50 5.2 191.1 1.0X -With bloom filter 21890 21908 25 4.6 218.9 0.9X +Without bloom filter 14922 15194 384 6.7 149.2 1.0X +With bloom filter 17270 17665 559 5.8 172.7 0.9X ================================================================================================ ORC Read ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Read a row from 100M rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Without bloom filter 1724 1746 30 58.0 17.2 1.0X -With bloom filter 1364 1376 17 73.3 13.6 1.3X +Without bloom filter 1463 1486 32 68.4 14.6 1.0X +With bloom filter 1232 1239 9 81.2 12.3 1.2X diff --git a/sql/core/benchmarks/BuiltInDataSourceWriteBenchmark-jdk11-results.txt b/sql/core/benchmarks/BuiltInDataSourceWriteBenchmark-jdk11-results.txt index bc13f6e9b9424..12153bddb5852 100644 --- a/sql/core/benchmarks/BuiltInDataSourceWriteBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/BuiltInDataSourceWriteBenchmark-jdk11-results.txt @@ -2,59 +2,59 @@ Parquet writer benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Parquet writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Output Single Int Column 2552 2690 195 6.2 162.2 1.0X -Output Single Double Column 2865 2892 38 5.5 182.2 0.9X -Output Int and String Column 7876 7885 12 2.0 500.7 0.3X -Output Partitions 5079 5871 1120 3.1 322.9 0.5X -Output Buckets 6980 6994 20 2.3 443.8 0.4X +Output Single Int Column 2636 2676 56 6.0 167.6 1.0X +Output Single Double Column 2743 2859 164 5.7 174.4 1.0X +Output Int and String Column 8811 8822 15 1.8 560.2 0.3X +Output Partitions 5489 5519 43 2.9 349.0 0.5X +Output Buckets 7426 7436 14 2.1 472.1 0.4X ================================================================================================ ORC writer benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz ORC writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Output Single Int Column 1799 1902 146 8.7 114.4 1.0X -Output Single Double Column 2268 2276 11 6.9 144.2 0.8X -Output Int and String Column 6650 6670 28 2.4 422.8 0.3X -Output Partitions 4697 4719 31 3.3 298.6 0.4X -Output Buckets 6394 6436 60 2.5 406.5 0.3X +Output Single Int Column 1931 1944 19 8.1 122.8 1.0X +Output Single Double Column 2241 2304 90 7.0 142.5 0.9X +Output Int and String Column 7255 7318 89 2.2 461.3 0.3X +Output Partitions 4733 4832 140 3.3 300.9 0.4X +Output Buckets 6496 6547 73 2.4 413.0 0.3X ================================================================================================ JSON writer benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz JSON writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Output Single Int Column 2778 3522 1052 5.7 176.6 1.0X -Output Single Double Column 4222 4269 67 3.7 268.4 0.7X -Output Int and String Column 10822 10845 33 1.5 688.0 0.3X -Output Partitions 5450 5523 104 2.9 346.5 0.5X -Output Buckets 10827 11622 1123 1.5 688.4 0.3X +Output Single Int Column 2521 2552 44 6.2 160.3 1.0X +Output Single Double Column 4164 4181 24 3.8 264.7 0.6X +Output Int and String Column 6972 7002 43 2.3 443.3 0.4X +Output Partitions 5246 5345 140 3.0 333.5 0.5X +Output Buckets 6860 6935 107 2.3 436.1 0.4X ================================================================================================ CSV writer benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz CSV writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Output Single Int Column 3649 3698 68 4.3 232.0 1.0X -Output Single Double Column 4612 4696 120 3.4 293.2 0.8X -Output Int and String Column 7334 7517 258 2.1 466.3 0.5X -Output Partitions 6386 6541 220 2.5 406.0 0.6X -Output Buckets 8692 9439 1057 1.8 552.6 0.4X +Output Single Int Column 3650 3672 31 4.3 232.1 1.0X +Output Single Double Column 4719 4726 10 3.3 300.0 0.8X +Output Int and String Column 7842 7863 30 2.0 498.6 0.5X +Output Partitions 6895 6911 23 2.3 438.4 0.5X +Output Buckets 8880 8928 67 1.8 564.6 0.4X diff --git a/sql/core/benchmarks/BuiltInDataSourceWriteBenchmark-results.txt b/sql/core/benchmarks/BuiltInDataSourceWriteBenchmark-results.txt index 1380a6158954a..43674e52a72b7 100644 --- a/sql/core/benchmarks/BuiltInDataSourceWriteBenchmark-results.txt +++ b/sql/core/benchmarks/BuiltInDataSourceWriteBenchmark-results.txt @@ -2,59 +2,59 @@ Parquet writer benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Parquet writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Output Single Int Column 2537 2594 81 6.2 161.3 1.0X -Output Single Double Column 2615 2645 42 6.0 166.3 1.0X -Output Int and String Column 8931 8933 4 1.8 567.8 0.3X -Output Partitions 5011 5321 438 3.1 318.6 0.5X -Output Buckets 6789 6793 6 2.3 431.6 0.4X +Output Single Int Column 2067 2087 29 7.6 131.4 1.0X +Output Single Double Column 1977 2013 52 8.0 125.7 1.0X +Output Int and String Column 7387 7410 33 2.1 469.7 0.3X +Output Partitions 3720 3831 156 4.2 236.5 0.6X +Output Buckets 4987 5028 57 3.2 317.1 0.4X ================================================================================================ ORC writer benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz ORC writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Output Single Int Column 1780 1937 222 8.8 113.2 1.0X -Output Single Double Column 2248 2265 23 7.0 142.9 0.8X -Output Int and String Column 7996 8031 49 2.0 508.4 0.2X -Output Partitions 4827 4939 159 3.3 306.9 0.4X -Output Buckets 6521 6595 104 2.4 414.6 0.3X +Output Single Int Column 1264 1284 29 12.4 80.3 1.0X +Output Single Double Column 1708 1711 4 9.2 108.6 0.7X +Output Int and String Column 5988 6019 43 2.6 380.7 0.2X +Output Partitions 3192 3269 108 4.9 203.0 0.4X +Output Buckets 4439 4472 47 3.5 282.2 0.3X ================================================================================================ JSON writer benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz JSON writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Output Single Int Column 2791 2823 45 5.6 177.5 1.0X -Output Single Double Column 4078 5089 1431 3.9 259.3 0.7X -Output Int and String Column 10249 10296 66 1.5 651.6 0.3X -Output Partitions 5247 5296 69 3.0 333.6 0.5X -Output Buckets 8168 9714 2187 1.9 519.3 0.3X +Output Single Int Column 2187 2194 10 7.2 139.0 1.0X +Output Single Double Column 2808 2833 35 5.6 178.5 0.8X +Output Int and String Column 6190 6224 49 2.5 393.5 0.4X +Output Partitions 3646 3705 83 4.3 231.8 0.6X +Output Buckets 4891 5325 614 3.2 311.0 0.4X ================================================================================================ CSV writer benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz CSV writer benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Output Single Int Column 4055 4200 205 3.9 257.8 1.0X -Output Single Double Column 4978 5010 45 3.2 316.5 0.8X -Output Int and String Column 9285 9294 13 1.7 590.3 0.4X -Output Partitions 6681 6738 80 2.4 424.8 0.6X -Output Buckets 9495 10052 787 1.7 603.7 0.4X +Output Single Int Column 3162 3168 9 5.0 201.0 1.0X +Output Single Double Column 3647 3660 19 4.3 231.9 0.9X +Output Int and String Column 7266 7271 6 2.2 462.0 0.4X +Output Partitions 4857 4930 103 3.2 308.8 0.7X +Output Buckets 6809 6897 124 2.3 432.9 0.5X diff --git a/sql/core/benchmarks/CSVBenchmark-jdk11-results.txt b/sql/core/benchmarks/CSVBenchmark-jdk11-results.txt index c8db7859d203e..b9dc68c988f63 100644 --- a/sql/core/benchmarks/CSVBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/CSVBenchmark-jdk11-results.txt @@ -2,66 +2,66 @@ Benchmark to measure CSV read/write performance ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 11.0.3+12-LTS on Mac OS X 10.15.7 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Parsing quoted values: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -One quoted string 21212 21537 327 0.0 424244.5 1.0X +One quoted string 35546 35913 327 0.0 710924.3 1.0X -Java HotSpot(TM) 64-Bit Server VM 11.0.3+12-LTS on Mac OS X 10.15.7 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Wide rows with 1000 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Select 1000 columns 73744 74898 1930 0.0 73743.8 1.0X -Select 100 columns 22704 22860 236 0.0 22704.4 3.2X -Select one column 17837 17977 121 0.1 17837.2 4.1X -count() 4304 4320 27 0.2 4304.0 17.1X -Select 100 columns, one bad input field 42060 42280 378 0.0 42059.8 1.8X -Select 100 columns, corrupt record field 46633 47520 773 0.0 46632.5 1.6X +Select 1000 columns 97613 98458 1123 0.0 97613.1 1.0X +Select 100 columns 42208 42598 374 0.0 42208.4 2.3X +Select one column 37602 38233 547 0.0 37601.6 2.6X +count() 6343 6432 153 0.2 6343.4 15.4X +Select 100 columns, one bad input field 65577 66403 829 0.0 65577.2 1.5X +Select 100 columns, corrupt record field 79049 79718 608 0.0 79048.6 1.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.3+12-LTS on Mac OS X 10.15.7 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Count a dataset with 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Select 10 columns + count() 9906 10132 246 1.0 990.6 1.0X -Select 1 column + count() 6497 6616 104 1.5 649.7 1.5X -count() 2285 2322 32 4.4 228.5 4.3X +Select 10 columns + count() 17730 18004 321 0.6 1773.0 1.0X +Select 1 column + count() 12627 12858 292 0.8 1262.7 1.4X +count() 4329 4425 130 2.3 432.9 4.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.3+12-LTS on Mac OS X 10.15.7 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Write dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Create a dataset of timestamps 902 932 30 11.1 90.2 1.0X -to_csv(timestamp) 8537 8851 274 1.2 853.7 0.1X -write timestamps to files 7810 8000 238 1.3 781.0 0.1X -Create a dataset of dates 929 931 2 10.8 92.9 1.0X -to_csv(date) 5170 5237 62 1.9 517.0 0.2X -write dates to files 4163 4220 49 2.4 416.3 0.2X +Create a dataset of timestamps 1539 1582 47 6.5 153.9 1.0X +to_csv(timestamp) 12782 12980 192 0.8 1278.2 0.1X +write timestamps to files 10122 10253 170 1.0 1012.2 0.2X +Create a dataset of dates 1646 1765 111 6.1 164.6 0.9X +to_csv(date) 9004 9216 200 1.1 900.4 0.2X +write dates to files 6519 6615 148 1.5 651.9 0.2X -Java HotSpot(TM) 64-Bit Server VM 11.0.3+12-LTS on Mac OS X 10.15.7 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Read dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -read timestamp text from files 1475 1497 33 6.8 147.5 1.0X -read timestamps from files 18596 18811 343 0.5 1859.6 0.1X -infer timestamps from files 37182 37511 342 0.3 3718.2 0.0X -read date text from files 1183 1210 31 8.5 118.3 1.2X -read date from files 8797 9099 283 1.1 879.7 0.2X -infer date from files 11296 11427 218 0.9 1129.6 0.1X -timestamp strings 1379 1382 4 7.3 137.9 1.1X -parse timestamps from Dataset[String] 18243 19000 721 0.5 1824.3 0.1X -infer timestamps from Dataset[String] 38253 39096 731 0.3 3825.3 0.0X -date strings 1686 1721 35 5.9 168.6 0.9X -parse dates from Dataset[String] 10474 10680 184 1.0 1047.4 0.1X -from_csv(timestamp) 18643 18965 350 0.5 1864.3 0.1X -from_csv(date) 9814 10018 188 1.0 981.4 0.2X +read timestamp text from files 2364 2428 90 4.2 236.4 1.0X +read timestamps from files 39799 39885 96 0.3 3979.9 0.1X +infer timestamps from files 79083 79866 818 0.1 7908.3 0.0X +read date text from files 2174 2202 37 4.6 217.4 1.1X +read date from files 17997 18249 218 0.6 1799.7 0.1X +infer date from files 21635 21893 223 0.5 2163.5 0.1X +timestamp strings 2686 2719 28 3.7 268.6 0.9X +parse timestamps from Dataset[String] 40089 41277 1071 0.2 4008.9 0.1X +infer timestamps from Dataset[String] 78144 78581 524 0.1 7814.4 0.0X +date strings 2899 2974 74 3.4 289.9 0.8X +parse dates from Dataset[String] 19762 19875 99 0.5 1976.2 0.1X +from_csv(timestamp) 39890 40339 725 0.3 3989.0 0.1X +from_csv(date) 18501 18740 214 0.5 1850.1 0.1X -Java HotSpot(TM) 64-Bit Server VM 11.0.3+12-LTS on Mac OS X 10.15.7 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Filters pushdown: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -w/o filters 11243 11535 287 0.0 112433.9 1.0X -pushdown disabled 11093 11117 34 0.0 110931.9 1.0X -w/ filters 794 800 5 0.1 7942.1 14.2X +w/o filters 25642 25863 202 0.0 256422.1 1.0X +pushdown disabled 24703 25195 476 0.0 247029.0 1.0X +w/ filters 1184 1209 27 0.1 11842.4 21.7X diff --git a/sql/core/benchmarks/CSVBenchmark-results.txt b/sql/core/benchmarks/CSVBenchmark-results.txt index 15f901e8a7a2d..caa215762fa9a 100644 --- a/sql/core/benchmarks/CSVBenchmark-results.txt +++ b/sql/core/benchmarks/CSVBenchmark-results.txt @@ -2,66 +2,66 @@ Benchmark to measure CSV read/write performance ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.15.7 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Parsing quoted values: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -One quoted string 24185 24195 10 0.0 483694.2 1.0X +One quoted string 43757 44446 765 0.0 875148.4 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.15.7 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Wide rows with 1000 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Select 1000 columns 61793 62388 532 0.0 61793.4 1.0X -Select 100 columns 21958 21993 34 0.0 21957.9 2.8X -Select one column 18215 18515 505 0.1 18215.0 3.4X -count() 5865 6168 296 0.2 5865.1 10.5X -Select 100 columns, one bad input field 39638 39739 124 0.0 39637.5 1.6X -Select 100 columns, corrupt record field 47290 48133 741 0.0 47290.0 1.3X +Select 1000 columns 96330 99161 NaN 0.0 96329.7 1.0X +Select 100 columns 41414 42672 1556 0.0 41414.1 2.3X +Select one column 35365 36113 662 0.0 35365.4 2.7X +count() 18845 18867 26 0.1 18845.0 5.1X +Select 100 columns, one bad input field 68271 68305 51 0.0 68270.7 1.4X +Select 100 columns, corrupt record field 77700 78165 803 0.0 77699.7 1.2X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.15.7 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Count a dataset with 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Select 10 columns + count() 9935 10460 461 1.0 993.5 1.0X -Select 1 column + count() 6786 7179 342 1.5 678.6 1.5X -count() 2281 2458 165 4.4 228.1 4.4X +Select 10 columns + count() 18462 18651 175 0.5 1846.2 1.0X +Select 1 column + count() 11897 12075 199 0.8 1189.7 1.6X +count() 4218 4229 10 2.4 421.8 4.4X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.15.7 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Write dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Create a dataset of timestamps 812 826 14 12.3 81.2 1.0X -to_csv(timestamp) 7548 7764 192 1.3 754.8 0.1X -write timestamps to files 7052 7193 141 1.4 705.2 0.1X -Create a dataset of dates 897 909 13 11.1 89.7 0.9X -to_csv(date) 4778 4787 10 2.1 477.8 0.2X -write dates to files 3853 3891 33 2.6 385.3 0.2X +Create a dataset of timestamps 1680 1699 17 6.0 168.0 1.0X +to_csv(timestamp) 13269 13787 456 0.8 1326.9 0.1X +write timestamps to files 10747 10785 48 0.9 1074.7 0.2X +Create a dataset of dates 1900 1919 24 5.3 190.0 0.9X +to_csv(date) 9207 9223 23 1.1 920.7 0.2X +write dates to files 6331 6339 7 1.6 633.1 0.3X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.15.7 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Read dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -read timestamp text from files 1259 1262 4 7.9 125.9 1.0X -read timestamps from files 20030 20105 80 0.5 2003.0 0.1X -infer timestamps from files 39621 39674 61 0.3 3962.1 0.0X -read date text from files 1039 1068 40 9.6 103.9 1.2X -read date from files 9352 9363 10 1.1 935.2 0.1X -infer date from files 11465 11485 23 0.9 1146.5 0.1X -timestamp strings 1759 1812 59 5.7 175.9 0.7X -parse timestamps from Dataset[String] 20806 20858 75 0.5 2080.6 0.1X -infer timestamps from Dataset[String] 40537 40821 258 0.2 4053.7 0.0X -date strings 1808 1816 12 5.5 180.8 0.7X -parse dates from Dataset[String] 12080 12311 245 0.8 1208.0 0.1X -from_csv(timestamp) 20120 21503 1224 0.5 2012.0 0.1X -from_csv(date) 10607 10768 246 0.9 1060.7 0.1X +read timestamp text from files 2355 2382 24 4.2 235.5 1.0X +read timestamps from files 31297 31331 35 0.3 3129.7 0.1X +infer timestamps from files 63255 66511 NaN 0.2 6325.5 0.0X +read date text from files 2139 2160 18 4.7 213.9 1.1X +read date from files 17027 17090 89 0.6 1702.7 0.1X +infer date from files 21307 21337 31 0.5 2130.7 0.1X +timestamp strings 3661 3699 35 2.7 366.1 0.6X +parse timestamps from Dataset[String] 36355 37714 1180 0.3 3635.5 0.1X +infer timestamps from Dataset[String] 74494 74851 542 0.1 7449.4 0.0X +date strings 3753 3756 5 2.7 375.3 0.6X +parse dates from Dataset[String] 21590 21714 126 0.5 2159.0 0.1X +from_csv(timestamp) 35419 35459 59 0.3 3541.9 0.1X +from_csv(date) 19081 19124 39 0.5 1908.1 0.1X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_202-b08 on Mac OS X 10.15.7 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Filters pushdown: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -w/o filters 13109 13249 151 0.0 131086.4 1.0X -pushdown disabled 12951 12994 63 0.0 129509.7 1.0X -w/ filters 1095 1113 15 0.1 10953.7 12.0X +w/o filters 22203 22425 192 0.0 222033.1 1.0X +pushdown disabled 22123 22220 89 0.0 221227.6 1.0X +w/ filters 1332 1338 9 0.1 13317.7 16.7X diff --git a/sql/core/benchmarks/CharVarcharBenchmark-results.txt b/sql/core/benchmarks/CharVarcharBenchmark-results.txt index 3e4048a205fef..d9d8a307a3469 100644 --- a/sql/core/benchmarks/CharVarcharBenchmark-results.txt +++ b/sql/core/benchmarks/CharVarcharBenchmark-results.txt @@ -2,121 +2,121 @@ Char Varchar Write Side Perf w/o Tailing Spaces ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS X 10.16 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Write with length 5: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -write string with length 5 9415 9961 487 4.2 235.4 1.0X -write char with length 5 12593 12972 590 3.2 314.8 0.7X -write varchar with length 5 9556 9753 317 4.2 238.9 1.0X +write string with length 5 10387 10439 85 3.9 259.7 1.0X +write char with length 5 14181 14200 22 2.8 354.5 0.7X +write varchar with length 5 10658 10713 83 3.8 266.5 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS X 10.16 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Write with length 10: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -write string with length 10 4901 5072 172 4.1 245.0 1.0X -write char with length 10 7205 7344 122 2.8 360.2 0.7X -write varchar with length 10 4871 4967 152 4.1 243.6 1.0X +write string with length 10 5292 5305 12 3.8 264.6 1.0X +write char with length 10 8539 8549 11 2.3 427.0 0.6X +write varchar with length 10 5404 5417 21 3.7 270.2 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS X 10.16 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Write with length 20: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -write string with length 20 2558 2575 17 3.9 255.8 1.0X -write char with length 20 4594 4807 185 2.2 459.4 0.6X -write varchar with length 20 2444 2523 94 4.1 244.4 1.0X +write string with length 20 2680 2701 21 3.7 268.0 1.0X +write char with length 20 5768 5793 22 1.7 576.8 0.5X +write varchar with length 20 2744 2760 22 3.6 274.4 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS X 10.16 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Write with length 40: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -write string with length 40 1333 1335 2 3.8 266.6 1.0X -write char with length 40 3588 3654 67 1.4 717.7 0.4X -write varchar with length 40 1379 1397 20 3.6 275.8 1.0X +write string with length 40 1401 1409 12 3.6 280.1 1.0X +write char with length 40 4306 4316 11 1.2 861.2 0.3X +write varchar with length 40 1433 1438 4 3.5 286.5 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS X 10.16 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Write with length 60: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -write string with length 60 932 948 15 3.6 279.6 1.0X -write char with length 60 3067 3118 61 1.1 920.2 0.3X -write varchar with length 60 928 938 9 3.6 278.3 1.0X +write string with length 60 1123 1127 6 3.0 336.8 1.0X +write char with length 60 3807 3811 8 0.9 1142.0 0.3X +write varchar with length 60 987 991 3 3.4 296.2 1.1X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS X 10.16 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Write with length 80: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -write string with length 80 731 740 13 3.4 292.6 1.0X -write char with length 80 2829 2838 8 0.9 1131.7 0.3X -write varchar with length 80 670 676 5 3.7 268.1 1.1X +write string with length 80 741 753 11 3.4 296.4 1.0X +write char with length 80 3563 3568 6 0.7 1425.1 0.2X +write varchar with length 80 751 767 15 3.3 300.3 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS X 10.16 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Write with length 100: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -write string with length 100 547 576 32 3.7 273.3 1.0X -write char with length 100 2744 2750 11 0.7 1371.9 0.2X -write varchar with length 100 601 604 5 3.3 300.5 0.9X +write string with length 100 635 637 2 3.1 317.6 1.0X +write char with length 100 3454 3455 1 0.6 1727.0 0.2X +write varchar with length 100 634 638 4 3.2 316.9 1.0X ================================================================================================ Char Varchar Write Side Perf w/ Tailing Spaces ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS X 10.16 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Write with length 5: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -write string with length 5 16122 16432 294 2.5 403.0 1.0X -write char with length 5 16988 17124 196 2.4 424.7 0.9X -write varchar with length 5 16773 17067 300 2.4 419.3 1.0X +write string with length 5 20381 20394 22 2.0 509.5 1.0X +write char with length 5 20172 20180 7 2.0 504.3 1.0X +write varchar with length 5 20153 20168 22 2.0 503.8 1.0X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS X 10.16 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Write with length 10: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -write string with length 10 9006 9242 205 2.2 450.3 1.0X -write char with length 10 10495 10564 62 1.9 524.7 0.9X -write varchar with length 10 10313 10515 177 1.9 515.7 0.9X +write string with length 10 10697 10714 20 1.9 534.8 1.0X +write char with length 10 12411 12426 14 1.6 620.5 0.9X +write varchar with length 10 12416 12421 5 1.6 620.8 0.9X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS X 10.16 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Write with length 20: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -write string with length 20 6265 6301 32 1.6 626.5 1.0X -write char with length 20 7494 7586 89 1.3 749.4 0.8X -write varchar with length 20 7374 7565 167 1.4 737.4 0.8X +write string with length 20 7370 7381 12 1.4 737.0 1.0X +write char with length 20 9090 9099 9 1.1 909.0 0.8X +write varchar with length 20 9082 9091 8 1.1 908.2 0.8X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS X 10.16 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Write with length 40: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -write string with length 40 4619 4638 20 1.1 923.7 1.0X -write char with length 40 5826 5964 125 0.9 1165.2 0.8X -write varchar with length 40 5937 6013 67 0.8 1187.5 0.8X +write string with length 40 5606 5608 3 0.9 1121.2 1.0X +write char with length 40 7290 7292 3 0.7 1458.0 0.8X +write varchar with length 40 7304 7311 8 0.7 1460.8 0.8X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS X 10.16 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Write with length 60: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -write string with length 60 4028 4052 28 0.8 1208.5 1.0X -write char with length 60 5172 5299 145 0.6 1551.7 0.8X -write varchar with length 60 5277 5399 191 0.6 1583.2 0.8X +write string with length 60 4898 4906 9 0.7 1469.3 1.0X +write char with length 60 6640 6654 12 0.5 1992.1 0.7X +write varchar with length 60 6750 6756 7 0.5 2025.0 0.7X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS X 10.16 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Write with length 80: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -write string with length 80 3875 3882 8 0.6 1549.9 1.0X -write char with length 80 5060 5169 96 0.5 2023.9 0.8X -write varchar with length 80 5322 5334 17 0.5 2128.7 0.7X +write string with length 80 4720 4726 9 0.5 1887.8 1.0X +write char with length 80 6446 6448 1 0.4 2578.6 0.7X +write varchar with length 80 6469 6509 35 0.4 2587.7 0.7X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS X 10.16 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Write with length 100: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -write string with length 100 3410 3541 115 0.6 1705.2 1.0X -write char with length 100 4760 4990 200 0.4 2380.0 0.7X -write varchar with length 100 5166 5185 17 0.4 2583.1 0.7X +write string with length 100 4436 4450 14 0.5 2217.8 1.0X +write char with length 100 6317 6325 12 0.3 3158.4 0.7X +write varchar with length 100 6316 6322 7 0.3 3158.1 0.7X diff --git a/sql/core/benchmarks/ColumnarBatchBenchmark-jdk11-results.txt b/sql/core/benchmarks/ColumnarBatchBenchmark-jdk11-results.txt index d5dcdab6b942a..eb13d5b86f218 100644 --- a/sql/core/benchmarks/ColumnarBatchBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/ColumnarBatchBenchmark-jdk11-results.txt @@ -2,58 +2,58 @@ Int Read/Write ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Int Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Java Array 233 234 0 1406.0 0.7 1.0X -ByteBuffer Unsafe 396 397 0 826.5 1.2 0.6X -ByteBuffer API 603 605 3 543.0 1.8 0.4X -DirectByteBuffer 1189 1196 9 275.6 3.6 0.2X -Unsafe Buffer 321 324 3 1022.0 1.0 0.7X -Column(on heap) 235 236 2 1393.1 0.7 1.0X -Column(off heap) 524 526 1 624.8 1.6 0.4X -Column(off heap direct) 317 318 1 1034.1 1.0 0.7X -UnsafeRow (on heap) 690 693 3 474.8 2.1 0.3X -UnsafeRow (off heap) 642 646 3 510.1 2.0 0.4X -Column On Heap Append 522 527 4 628.0 1.6 0.4X +Java Array 263 266 3 1247.5 0.8 1.0X +ByteBuffer Unsafe 1039 1050 15 315.3 3.2 0.3X +ByteBuffer API 923 928 8 355.0 2.8 0.3X +DirectByteBuffer 1370 1371 1 239.1 4.2 0.2X +Unsafe Buffer 350 357 6 937.5 1.1 0.8X +Column(on heap) 265 269 3 1235.8 0.8 1.0X +Column(off heap) 514 519 3 637.2 1.6 0.5X +Column(off heap direct) 348 354 5 940.8 1.1 0.8X +UnsafeRow (on heap) 800 819 23 409.6 2.4 0.3X +UnsafeRow (off heap) 755 760 5 433.9 2.3 0.3X +Column On Heap Append 520 529 9 629.8 1.6 0.5X ================================================================================================ Boolean Read/Write ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Boolean Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Bitset 778 780 3 431.1 2.3 1.0X -Byte Array 355 356 1 944.9 1.1 2.2X +Bitset 846 848 1 396.4 2.5 1.0X +Byte Array 386 391 4 869.5 1.2 2.2X ================================================================================================ String Read/Write ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz String Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -On Heap 447 453 5 36.6 27.3 1.0X -Off Heap 652 658 4 25.1 39.8 0.7X +On Heap 536 538 1 30.5 32.7 1.0X +Off Heap 751 759 7 21.8 45.8 0.7X ================================================================================================ Array Vector Read ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Array Vector Read: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -On Heap Read Size Only 101 102 0 1616.4 0.6 1.0X -Off Heap Read Size Only 305 307 2 536.8 1.9 0.3X -On Heap Read Elements 4255 4256 1 38.5 26.0 0.0X -Off Heap Read Elements 6097 6104 10 26.9 37.2 0.0X +On Heap Read Size Only 96 100 2 1698.7 0.6 1.0X +Off Heap Read Size Only 356 364 9 459.6 2.2 0.3X +On Heap Read Elements 4971 4972 2 33.0 30.3 0.0X +Off Heap Read Elements 6833 6880 67 24.0 41.7 0.0X diff --git a/sql/core/benchmarks/ColumnarBatchBenchmark-results.txt b/sql/core/benchmarks/ColumnarBatchBenchmark-results.txt index 8ae21d7a7e653..2559b2c363220 100644 --- a/sql/core/benchmarks/ColumnarBatchBenchmark-results.txt +++ b/sql/core/benchmarks/ColumnarBatchBenchmark-results.txt @@ -2,58 +2,58 @@ Int Read/Write ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Int Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Java Array 246 246 0 1333.2 0.8 1.0X -ByteBuffer Unsafe 446 447 1 734.6 1.4 0.6X -ByteBuffer API 2141 2144 4 153.0 6.5 0.1X -DirectByteBuffer 745 745 0 439.9 2.3 0.3X -Unsafe Buffer 237 240 1 1379.7 0.7 1.0X -Column(on heap) 247 247 0 1327.3 0.8 1.0X -Column(off heap) 487 488 1 673.1 1.5 0.5X -Column(off heap direct) 242 243 1 1354.1 0.7 1.0X -UnsafeRow (on heap) 541 543 1 605.4 1.7 0.5X -UnsafeRow (off heap) 581 583 2 563.7 1.8 0.4X -Column On Heap Append 520 521 1 629.8 1.6 0.5X +Java Array 274 279 5 1196.8 0.8 1.0X +ByteBuffer Unsafe 476 487 6 687.7 1.5 0.6X +ByteBuffer API 2024 2030 8 161.9 6.2 0.1X +DirectByteBuffer 702 755 47 466.8 2.1 0.4X +Unsafe Buffer 250 266 13 1311.9 0.8 1.1X +Column(on heap) 260 272 7 1258.0 0.8 1.1X +Column(off heap) 528 540 13 620.1 1.6 0.5X +Column(off heap direct) 265 272 6 1236.9 0.8 1.0X +UnsafeRow (on heap) 551 556 4 594.8 1.7 0.5X +UnsafeRow (off heap) 565 586 19 579.9 1.7 0.5X +Column On Heap Append 544 552 10 602.1 1.7 0.5X ================================================================================================ Boolean Read/Write ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Boolean Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Bitset 883 883 1 380.1 2.6 1.0X -Byte Array 775 777 2 432.9 2.3 1.1X +Bitset 1009 1026 25 332.6 3.0 1.0X +Byte Array 756 768 11 443.7 2.3 1.3X ================================================================================================ String Read/Write ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz String Read/Write: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -On Heap 463 470 10 35.4 28.3 1.0X -Off Heap 676 677 2 24.2 41.2 0.7X +On Heap 396 408 9 41.3 24.2 1.0X +Off Heap 673 696 20 24.3 41.1 0.6X ================================================================================================ Array Vector Read ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Array Vector Read: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -On Heap Read Size Only 422 422 0 388.7 2.6 1.0X -Off Heap Read Size Only 259 259 0 633.2 1.6 1.6X -On Heap Read Elements 3932 3960 39 41.7 24.0 0.1X -Off Heap Read Elements 5143 5173 43 31.9 31.4 0.1X +On Heap Read Size Only 458 486 16 357.6 2.8 1.0X +Off Heap Read Size Only 260 275 9 630.6 1.6 1.8X +On Heap Read Elements 3315 3349 48 49.4 20.2 0.1X +Off Heap Read Elements 5265 5304 55 31.1 32.1 0.1X diff --git a/sql/core/benchmarks/CompressionSchemeBenchmark-jdk11-results.txt b/sql/core/benchmarks/CompressionSchemeBenchmark-jdk11-results.txt index d6a5a7d11c23b..74b59ef725170 100644 --- a/sql/core/benchmarks/CompressionSchemeBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/CompressionSchemeBenchmark-jdk11-results.txt @@ -2,136 +2,136 @@ Compression Scheme Benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.8+10-LTS on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz BOOLEAN Encode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough(1.000) 1 1 0 53450.1 0.0 1.0X -RunLengthEncoding(2.496) 533 545 10 125.8 7.9 0.0X -BooleanBitSet(0.125) 287 293 6 234.2 4.3 0.0X +PassThrough(1.000) 5 6 0 13175.1 0.1 1.0X +RunLengthEncoding(2.498) 907 920 11 74.0 13.5 0.0X +BooleanBitSet(0.125) 594 609 11 113.1 8.8 0.0X -OpenJDK 64-Bit Server VM 11.0.8+10-LTS on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz BOOLEAN Decode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough 105 108 2 638.6 1.6 1.0X -RunLengthEncoding 490 497 6 136.8 7.3 0.2X -BooleanBitSet 911 914 4 73.7 13.6 0.1X +PassThrough 326 341 20 205.8 4.9 1.0X +RunLengthEncoding 1060 1061 2 63.3 15.8 0.3X +BooleanBitSet 1696 1717 29 39.6 25.3 0.2X -OpenJDK 64-Bit Server VM 11.0.8+10-LTS on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SHORT Encode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough(1.000) 3 3 0 20673.0 0.0 1.0X -RunLengthEncoding(1.495) 750 757 9 89.5 11.2 0.0X +PassThrough(1.000) 9 10 1 7396.4 0.1 1.0X +RunLengthEncoding(1.495) 1412 1412 0 47.5 21.0 0.0X -OpenJDK 64-Bit Server VM 11.0.8+10-LTS on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SHORT Decode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough 637 647 7 105.3 9.5 1.0X -RunLengthEncoding 1056 1069 17 63.5 15.7 0.6X +PassThrough 1565 1588 32 42.9 23.3 1.0X +RunLengthEncoding 1841 1861 28 36.5 27.4 0.9X -OpenJDK 64-Bit Server VM 11.0.8+10-LTS on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SHORT Encode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough(1.000) 3 3 0 21332.2 0.0 1.0X -RunLengthEncoding(2.004) 768 783 15 87.4 11.4 0.0X +PassThrough(1.000) 8 9 1 8316.3 0.1 1.0X +RunLengthEncoding(2.014) 1481 1489 10 45.3 22.1 0.0X -OpenJDK 64-Bit Server VM 11.0.8+10-LTS on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SHORT Decode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough 640 643 4 104.9 9.5 1.0X -RunLengthEncoding 1073 1078 6 62.5 16.0 0.6X +PassThrough 1537 1538 1 43.7 22.9 1.0X +RunLengthEncoding 1864 1870 9 36.0 27.8 0.8X -OpenJDK 64-Bit Server VM 11.0.8+10-LTS on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz INT Encode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough(1.000) 9 9 1 7640.9 0.1 1.0X -RunLengthEncoding(1.003) 882 883 2 76.1 13.1 0.0X -DictionaryEncoding(0.500) 587 624 33 114.3 8.7 0.0X -IntDelta(0.250) 122 127 5 549.8 1.8 0.1X +PassThrough(1.000) 17 19 1 3926.8 0.3 1.0X +RunLengthEncoding(1.002) 1483 1487 5 45.3 22.1 0.0X +DictionaryEncoding(0.500) 1158 1165 10 58.0 17.2 0.0X +IntDelta(0.250) 299 305 6 224.3 4.5 0.1X -OpenJDK 64-Bit Server VM 11.0.8+10-LTS on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz INT Decode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough 684 709 27 98.1 10.2 1.0X -RunLengthEncoding 1068 1075 10 62.8 15.9 0.6X -DictionaryEncoding 517 526 6 129.8 7.7 1.3X -IntDelta 541 545 4 124.0 8.1 1.3X +PassThrough 1333 1343 14 50.3 19.9 1.0X +RunLengthEncoding 1944 1945 2 34.5 29.0 0.7X +DictionaryEncoding 925 945 18 72.6 13.8 1.4X +IntDelta 784 794 10 85.6 11.7 1.7X -OpenJDK 64-Bit Server VM 11.0.8+10-LTS on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz INT Encode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough(1.000) 9 10 1 7475.0 0.1 1.0X -RunLengthEncoding(1.339) 908 922 12 73.9 13.5 0.0X -DictionaryEncoding(0.501) 629 652 16 106.6 9.4 0.0X -IntDelta(0.250) 124 128 3 542.5 1.8 0.1X +PassThrough(1.000) 17 18 1 4021.0 0.2 1.0X +RunLengthEncoding(1.338) 1554 1576 32 43.2 23.1 0.0X +DictionaryEncoding(0.501) 1432 1438 8 46.9 21.3 0.0X +IntDelta(0.250) 303 314 10 221.7 4.5 0.1X -OpenJDK 64-Bit Server VM 11.0.8+10-LTS on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz INT Decode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough 778 783 8 86.3 11.6 1.0X -RunLengthEncoding 1217 1217 1 55.2 18.1 0.6X -DictionaryEncoding 690 704 12 97.2 10.3 1.1X -IntDelta 691 699 13 97.1 10.3 1.1X +PassThrough 1414 1434 28 47.5 21.1 1.0X +RunLengthEncoding 2067 2077 14 32.5 30.8 0.7X +DictionaryEncoding 1187 1190 3 56.5 17.7 1.2X +IntDelta 1036 1072 51 64.8 15.4 1.4X -OpenJDK 64-Bit Server VM 11.0.8+10-LTS on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz LONG Encode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough(1.000) 18 19 1 3772.0 0.3 1.0X -RunLengthEncoding(0.750) 985 987 2 68.1 14.7 0.0X -DictionaryEncoding(0.250) 665 668 4 100.9 9.9 0.0X -LongDelta(0.125) 124 128 2 539.4 1.9 0.1X +PassThrough(1.000) 379 383 6 177.3 5.6 1.0X +RunLengthEncoding(0.754) 1618 1623 7 41.5 24.1 0.2X +DictionaryEncoding(0.250) 1246 1283 53 53.9 18.6 0.3X +LongDelta(0.125) 197 200 3 340.2 2.9 1.9X -OpenJDK 64-Bit Server VM 11.0.8+10-LTS on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz LONG Decode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough 837 841 7 80.2 12.5 1.0X -RunLengthEncoding 1177 1180 4 57.0 17.5 0.7X -DictionaryEncoding 741 747 7 90.6 11.0 1.1X -LongDelta 509 520 13 131.8 7.6 1.6X +PassThrough 1567 1577 13 42.8 23.4 1.0X +RunLengthEncoding 2064 2080 22 32.5 30.8 0.8X +DictionaryEncoding 1252 1259 10 53.6 18.6 1.3X +LongDelta 922 930 8 72.8 13.7 1.7X -OpenJDK 64-Bit Server VM 11.0.8+10-LTS on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz LONG Encode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough(1.000) 18 20 1 3769.4 0.3 1.0X -RunLengthEncoding(1.005) 1016 1054 54 66.1 15.1 0.0X -DictionaryEncoding(0.251) 923 928 4 72.7 13.8 0.0X -LongDelta(0.125) 125 127 2 538.8 1.9 0.1X +PassThrough(1.000) 385 397 8 174.4 5.7 1.0X +RunLengthEncoding(0.998) 1687 1689 3 39.8 25.1 0.2X +DictionaryEncoding(0.251) 1453 1462 13 46.2 21.7 0.3X +LongDelta(0.125) 190 200 7 353.5 2.8 2.0X -OpenJDK 64-Bit Server VM 11.0.8+10-LTS on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz LONG Decode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough 842 846 5 79.7 12.5 1.0X -RunLengthEncoding 1222 1264 59 54.9 18.2 0.7X -DictionaryEncoding 757 776 20 88.7 11.3 1.1X -LongDelta 681 686 4 98.5 10.2 1.2X +PassThrough 1561 1564 3 43.0 23.3 1.0X +RunLengthEncoding 2066 2075 12 32.5 30.8 0.8X +DictionaryEncoding 1244 1252 11 53.9 18.5 1.3X +LongDelta 1114 1117 4 60.3 16.6 1.4X -OpenJDK 64-Bit Server VM 11.0.8+10-LTS on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz STRING Encode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough(1.000) 27 29 2 2510.4 0.4 1.0X -RunLengthEncoding(0.888) 1651 1663 18 40.7 24.6 0.0X -DictionaryEncoding(0.167) 1851 1863 17 36.3 27.6 0.0X +PassThrough(1.000) 584 592 8 114.9 8.7 1.0X +RunLengthEncoding(0.889) 2862 2872 14 23.4 42.7 0.2X +DictionaryEncoding(0.167) 3034 3053 26 22.1 45.2 0.2X -OpenJDK 64-Bit Server VM 11.0.8+10-LTS on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz STRING Decode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough 1485 1495 15 45.2 22.1 1.0X -RunLengthEncoding 2010 2066 80 33.4 30.0 0.7X -DictionaryEncoding 1788 1790 4 37.5 26.6 0.8X +PassThrough 2937 2939 3 22.8 43.8 1.0X +RunLengthEncoding 3557 3574 24 18.9 53.0 0.8X +DictionaryEncoding 2858 2890 46 23.5 42.6 1.0X diff --git a/sql/core/benchmarks/CompressionSchemeBenchmark-results.txt b/sql/core/benchmarks/CompressionSchemeBenchmark-results.txt index d4670070505aa..8bb988a302d1b 100644 --- a/sql/core/benchmarks/CompressionSchemeBenchmark-results.txt +++ b/sql/core/benchmarks/CompressionSchemeBenchmark-results.txt @@ -2,136 +2,136 @@ Compression Scheme Benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_265-b01 on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz BOOLEAN Encode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough(1.000) 1 2 0 49671.6 0.0 1.0X -RunLengthEncoding(2.501) 470 487 25 142.7 7.0 0.0X -BooleanBitSet(0.125) 358 362 4 187.6 5.3 0.0X +PassThrough(1.000) 4 4 0 16463.0 0.1 1.0X +RunLengthEncoding(2.493) 732 733 0 91.6 10.9 0.0X +BooleanBitSet(0.125) 484 484 0 138.7 7.2 0.0X -OpenJDK 64-Bit Server VM 1.8.0_265-b01 on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz BOOLEAN Decode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough 90 95 5 746.2 1.3 1.0X -RunLengthEncoding 550 559 8 122.0 8.2 0.2X -BooleanBitSet 1082 1087 7 62.0 16.1 0.1X +PassThrough 135 135 0 497.4 2.0 1.0X +RunLengthEncoding 812 812 0 82.7 12.1 0.2X +BooleanBitSet 1398 1398 0 48.0 20.8 0.1X -OpenJDK 64-Bit Server VM 1.8.0_265-b01 on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz SHORT Encode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough(1.000) 3 4 0 20595.0 0.0 1.0X -RunLengthEncoding(1.495) 1074 1087 19 62.5 16.0 0.0X +PassThrough(1.000) 10 10 0 6540.8 0.2 1.0X +RunLengthEncoding(1.501) 1497 1497 0 44.8 22.3 0.0X -OpenJDK 64-Bit Server VM 1.8.0_265-b01 on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz SHORT Decode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough 807 844 33 83.1 12.0 1.0X -RunLengthEncoding 1077 1078 1 62.3 16.0 0.7X +PassThrough 1225 1227 3 54.8 18.3 1.0X +RunLengthEncoding 1516 1517 0 44.3 22.6 0.8X -OpenJDK 64-Bit Server VM 1.8.0_265-b01 on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz SHORT Encode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough(1.000) 3 3 0 23144.6 0.0 1.0X -RunLengthEncoding(2.001) 1067 1073 8 62.9 15.9 0.0X +PassThrough(1.000) 8 8 0 8250.5 0.1 1.0X +RunLengthEncoding(2.000) 1568 1568 0 42.8 23.4 0.0X -OpenJDK 64-Bit Server VM 1.8.0_265-b01 on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz SHORT Decode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough 793 811 16 84.7 11.8 1.0X -RunLengthEncoding 1099 1123 33 61.1 16.4 0.7X +PassThrough 1226 1227 1 54.7 18.3 1.0X +RunLengthEncoding 1505 1505 0 44.6 22.4 0.8X -OpenJDK 64-Bit Server VM 1.8.0_265-b01 on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz INT Encode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough(1.000) 10 11 1 6979.9 0.1 1.0X -RunLengthEncoding(1.000) 985 994 9 68.1 14.7 0.0X -DictionaryEncoding(0.500) 896 903 10 74.9 13.4 0.0X -IntDelta(0.250) 237 244 6 283.5 3.5 0.0X +PassThrough(1.000) 16 16 0 4116.8 0.2 1.0X +RunLengthEncoding(1.003) 1375 1375 0 48.8 20.5 0.0X +DictionaryEncoding(0.500) 1221 1222 2 55.0 18.2 0.0X +IntDelta(0.250) 337 337 0 199.0 5.0 0.0X -OpenJDK 64-Bit Server VM 1.8.0_265-b01 on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz INT Decode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough 791 795 3 84.8 11.8 1.0X -RunLengthEncoding 1111 1114 5 60.4 16.6 0.7X -DictionaryEncoding 641 650 17 104.7 9.6 1.2X -IntDelta 560 575 24 119.8 8.4 1.4X +PassThrough 925 926 1 72.5 13.8 1.0X +RunLengthEncoding 1575 1576 1 42.6 23.5 0.6X +DictionaryEncoding 834 834 0 80.5 12.4 1.1X +IntDelta 731 731 0 91.8 10.9 1.3X -OpenJDK 64-Bit Server VM 1.8.0_265-b01 on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz INT Encode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough(1.000) 9 10 1 7181.9 0.1 1.0X -RunLengthEncoding(1.336) 1006 1006 1 66.7 15.0 0.0X -DictionaryEncoding(0.501) 1034 1045 15 64.9 15.4 0.0X -IntDelta(0.250) 235 238 2 285.7 3.5 0.0X +PassThrough(1.000) 16 16 0 4162.0 0.2 1.0X +RunLengthEncoding(1.340) 1398 1399 1 48.0 20.8 0.0X +DictionaryEncoding(0.501) 1731 1731 0 38.8 25.8 0.0X +IntDelta(0.250) 337 337 0 199.1 5.0 0.0X -OpenJDK 64-Bit Server VM 1.8.0_265-b01 on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz INT Decode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough 829 832 3 81.0 12.3 1.0X -RunLengthEncoding 1199 1207 11 56.0 17.9 0.7X -DictionaryEncoding 725 726 1 92.6 10.8 1.1X -IntDelta 680 683 5 98.6 10.1 1.2X +PassThrough 978 979 0 68.6 14.6 1.0X +RunLengthEncoding 1551 1551 1 43.3 23.1 0.6X +DictionaryEncoding 1000 1001 1 67.1 14.9 1.0X +IntDelta 794 796 2 84.5 11.8 1.2X -OpenJDK 64-Bit Server VM 1.8.0_265-b01 on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz LONG Encode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough(1.000) 20 22 1 3405.6 0.3 1.0X -RunLengthEncoding(0.747) 1097 1102 7 61.2 16.3 0.0X -DictionaryEncoding(0.250) 854 933 74 78.6 12.7 0.0X -LongDelta(0.125) 322 328 11 208.5 4.8 0.1X +PassThrough(1.000) 32 32 0 2075.1 0.5 1.0X +RunLengthEncoding(0.748) 1477 1477 0 45.4 22.0 0.0X +DictionaryEncoding(0.250) 1470 1472 3 45.7 21.9 0.0X +LongDelta(0.125) 496 496 0 135.2 7.4 0.1X -OpenJDK 64-Bit Server VM 1.8.0_265-b01 on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz LONG Decode (Lower Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough 839 843 4 80.0 12.5 1.0X -RunLengthEncoding 1234 1234 1 54.4 18.4 0.7X -DictionaryEncoding 806 809 3 83.3 12.0 1.0X -LongDelta 550 558 6 122.0 8.2 1.5X +PassThrough 1014 1015 1 66.2 15.1 1.0X +RunLengthEncoding 1657 1658 1 40.5 24.7 0.6X +DictionaryEncoding 1017 1020 4 66.0 15.2 1.0X +LongDelta 697 697 0 96.3 10.4 1.5X -OpenJDK 64-Bit Server VM 1.8.0_265-b01 on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz LONG Encode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough(1.000) 20 22 1 3319.5 0.3 1.0X -RunLengthEncoding(1.005) 1153 1169 24 58.2 17.2 0.0X -DictionaryEncoding(0.251) 923 930 9 72.7 13.7 0.0X -LongDelta(0.125) 327 332 4 205.0 4.9 0.1X +PassThrough(1.000) 32 32 0 2073.3 0.5 1.0X +RunLengthEncoding(1.004) 1559 1560 1 43.0 23.2 0.0X +DictionaryEncoding(0.251) 1656 1656 0 40.5 24.7 0.0X +LongDelta(0.125) 496 496 0 135.3 7.4 0.1X -OpenJDK 64-Bit Server VM 1.8.0_265-b01 on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz LONG Decode (Higher Skew): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough 854 864 16 78.6 12.7 1.0X -RunLengthEncoding 1242 1244 3 54.0 18.5 0.7X -DictionaryEncoding 823 823 1 81.6 12.3 1.0X -LongDelta 640 651 8 104.8 9.5 1.3X +PassThrough 1015 1016 1 66.1 15.1 1.0X +RunLengthEncoding 1650 1653 4 40.7 24.6 0.6X +DictionaryEncoding 1024 1025 1 65.5 15.3 1.0X +LongDelta 832 837 5 80.7 12.4 1.2X -OpenJDK 64-Bit Server VM 1.8.0_265-b01 on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz STRING Encode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough(1.000) 29 32 1 2279.8 0.4 1.0X -RunLengthEncoding(0.886) 1723 1734 15 38.9 25.7 0.0X -DictionaryEncoding(0.167) 2667 2690 33 25.2 39.7 0.0X +PassThrough(1.000) 63 63 0 1067.3 0.9 1.0X +RunLengthEncoding(0.893) 2337 2338 1 28.7 34.8 0.0X +DictionaryEncoding(0.167) 3541 3543 3 19.0 52.8 0.0X -OpenJDK 64-Bit Server VM 1.8.0_265-b01 on Mac OS X 10.15.5 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz STRING Decode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -PassThrough 1847 1892 64 36.3 27.5 1.0X -RunLengthEncoding 2305 2332 38 29.1 34.3 0.8X -DictionaryEncoding 2134 2150 22 31.5 31.8 0.9X +PassThrough 2628 2635 9 25.5 39.2 1.0X +RunLengthEncoding 3126 3128 2 21.5 46.6 0.8X +DictionaryEncoding 2977 2979 3 22.5 44.4 0.9X diff --git a/sql/core/benchmarks/DataSourceReadBenchmark-jdk11-results.txt b/sql/core/benchmarks/DataSourceReadBenchmark-jdk11-results.txt index 595f69c8e1407..6578d5664cd30 100644 --- a/sql/core/benchmarks/DataSourceReadBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/DataSourceReadBenchmark-jdk11-results.txt @@ -2,251 +2,251 @@ SQL Single Numeric Column Scan ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 28338 28589 356 0.6 1801.7 1.0X -SQL Json 9273 9332 83 1.7 589.6 3.1X -SQL Parquet Vectorized 186 217 22 84.3 11.9 152.0X -SQL Parquet MR 1951 1972 29 8.1 124.1 14.5X -SQL ORC Vectorized 256 277 22 61.4 16.3 110.6X -SQL ORC MR 1627 1717 127 9.7 103.4 17.4X +SQL CSV 13405 13422 24 1.2 852.3 1.0X +SQL Json 10723 10788 92 1.5 681.7 1.3X +SQL Parquet Vectorized 164 217 50 95.9 10.4 81.8X +SQL Parquet MR 2349 2440 129 6.7 149.3 5.7X +SQL ORC Vectorized 312 346 23 50.4 19.8 43.0X +SQL ORC MR 1610 1659 69 9.8 102.4 8.3X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Parquet Reader Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -ParquetReader Vectorized 208 223 13 75.8 13.2 1.0X -ParquetReader Vectorized -> Row 96 97 1 164.1 6.1 2.2X +------------------------------------------------------------------------------------------------------------------------- +ParquetReader Vectorized 187 209 20 84.3 11.9 1.0X +ParquetReader Vectorized -> Row 89 95 5 177.6 5.6 2.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 28493 28516 33 0.6 1811.5 1.0X -SQL Json 10257 10291 47 1.5 652.1 2.8X -SQL Parquet Vectorized 215 233 14 73.2 13.7 132.5X -SQL Parquet MR 2384 2388 7 6.6 151.5 12.0X -SQL ORC Vectorized 298 307 7 52.8 18.9 95.6X -SQL ORC MR 1798 1814 22 8.7 114.3 15.8X +SQL CSV 14214 14549 474 1.1 903.7 1.0X +SQL Json 11866 11934 95 1.3 754.4 1.2X +SQL Parquet Vectorized 294 342 53 53.6 18.7 48.4X +SQL Parquet MR 2929 3004 107 5.4 186.2 4.9X +SQL ORC Vectorized 312 328 15 50.4 19.8 45.5X +SQL ORC MR 2037 2097 84 7.7 129.5 7.0X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Parquet Reader Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -ParquetReader Vectorized 286 293 6 54.9 18.2 1.0X -ParquetReader Vectorized -> Row 154 179 57 102.3 9.8 1.9X +-------------------------------------------------------------------------------------------------------------------------- +ParquetReader Vectorized 249 266 18 63.1 15.8 1.0X +ParquetReader Vectorized -> Row 192 247 36 82.1 12.2 1.3X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 30821 30902 114 0.5 1959.5 1.0X -SQL Json 10935 10944 13 1.4 695.3 2.8X -SQL Parquet Vectorized 203 213 12 77.6 12.9 152.1X -SQL Parquet MR 2334 2351 24 6.7 148.4 13.2X -SQL ORC Vectorized 281 286 4 56.0 17.9 109.6X -SQL ORC MR 1943 2022 112 8.1 123.5 15.9X +SQL CSV 15502 15817 446 1.0 985.6 1.0X +SQL Json 12638 12646 11 1.2 803.5 1.2X +SQL Parquet Vectorized 193 256 44 81.7 12.2 80.5X +SQL Parquet MR 2943 2953 14 5.3 187.1 5.3X +SQL ORC Vectorized 324 370 34 48.5 20.6 47.8X +SQL ORC MR 2110 2163 75 7.5 134.1 7.3X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Parquet Reader Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 284 291 9 55.5 18.0 1.0X -ParquetReader Vectorized -> Row 277 281 6 56.8 17.6 1.0X +ParquetReader Vectorized 276 287 14 57.0 17.6 1.0X +ParquetReader Vectorized -> Row 309 320 9 50.9 19.6 0.9X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 38264 38306 60 0.4 2432.7 1.0X -SQL Json 14369 14371 3 1.1 913.6 2.7X -SQL Parquet Vectorized 313 319 6 50.3 19.9 122.3X -SQL Parquet MR 2581 2602 30 6.1 164.1 14.8X -SQL ORC Vectorized 423 432 9 37.2 26.9 90.4X -SQL ORC MR 2108 2142 49 7.5 134.0 18.2X +SQL CSV 20156 20694 761 0.8 1281.5 1.0X +SQL Json 15228 15380 214 1.0 968.2 1.3X +SQL Parquet Vectorized 325 346 20 48.4 20.7 62.0X +SQL Parquet MR 3144 3228 118 5.0 199.9 6.4X +SQL ORC Vectorized 516 526 7 30.5 32.8 39.0X +SQL ORC MR 2353 2367 19 6.7 149.6 8.6X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Parquet Reader Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 401 409 8 39.2 25.5 1.0X -ParquetReader Vectorized -> Row 392 400 15 40.2 24.9 1.0X +ParquetReader Vectorized 372 396 24 42.3 23.6 1.0X +ParquetReader Vectorized -> Row 437 462 25 36.0 27.8 0.9X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 36276 36300 34 0.4 2306.4 1.0X -SQL Json 13691 14374 967 1.1 870.4 2.6X -SQL Parquet Vectorized 193 198 5 81.6 12.3 188.2X -SQL Parquet MR 2361 2389 40 6.7 150.1 15.4X -SQL ORC Vectorized 430 434 4 36.6 27.3 84.4X -SQL ORC MR 2037 2072 50 7.7 129.5 17.8X +SQL CSV 17413 17599 263 0.9 1107.1 1.0X +SQL Json 14416 14453 53 1.1 916.5 1.2X +SQL Parquet Vectorized 181 225 35 86.8 11.5 96.1X +SQL Parquet MR 2940 2996 78 5.3 186.9 5.9X +SQL ORC Vectorized 470 494 29 33.5 29.9 37.1X +SQL ORC MR 2351 2379 39 6.7 149.5 7.4X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Parquet Reader Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 277 284 10 56.8 17.6 1.0X -ParquetReader Vectorized -> Row 274 276 4 57.5 17.4 1.0X +ParquetReader Vectorized 268 282 14 58.7 17.0 1.0X +ParquetReader Vectorized -> Row 298 321 18 52.8 18.9 0.9X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 39757 39761 5 0.4 2527.7 1.0X -SQL Json 20049 20052 5 0.8 1274.7 2.0X -SQL Parquet Vectorized 310 318 10 50.7 19.7 128.3X -SQL Parquet MR 2535 2571 52 6.2 161.2 15.7X -SQL ORC Vectorized 537 543 8 29.3 34.1 74.1X -SQL ORC MR 2132 2161 41 7.4 135.6 18.6X +SQL CSV 21666 21697 43 0.7 1377.5 1.0X +SQL Json 18307 18363 79 0.9 1163.9 1.2X +SQL Parquet Vectorized 310 337 22 50.7 19.7 69.9X +SQL Parquet MR 3089 3103 19 5.1 196.4 7.0X +SQL ORC Vectorized 589 617 31 26.7 37.5 36.8X +SQL ORC MR 2307 2377 98 6.8 146.7 9.4X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Parquet Reader Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 390 394 5 40.3 24.8 1.0X -ParquetReader Vectorized -> Row 389 391 5 40.5 24.7 1.0X +ParquetReader Vectorized 400 415 18 39.3 25.4 1.0X +ParquetReader Vectorized -> Row 393 406 11 40.1 25.0 1.0X ================================================================================================ Int and String Scan ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 27215 27240 34 0.4 2595.5 1.0X -SQL Json 12713 12783 100 0.8 1212.4 2.1X -SQL Parquet Vectorized 2265 2269 5 4.6 216.0 12.0X -SQL Parquet MR 4477 4544 95 2.3 426.9 6.1X -SQL ORC Vectorized 2388 2404 23 4.4 227.7 11.4X -SQL ORC MR 4295 4305 15 2.4 409.6 6.3X +SQL CSV 17703 17719 22 0.6 1688.3 1.0X +SQL Json 13095 13168 103 0.8 1248.9 1.4X +SQL Parquet Vectorized 2253 2266 19 4.7 214.8 7.9X +SQL Parquet MR 4913 4977 91 2.1 468.5 3.6X +SQL ORC Vectorized 2457 2467 14 4.3 234.3 7.2X +SQL ORC MR 4433 4464 44 2.4 422.8 4.0X ================================================================================================ Repeated String Scan ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 17544 17580 51 0.6 1673.1 1.0X -SQL Json 8277 8328 71 1.3 789.4 2.1X -SQL Parquet Vectorized 674 682 7 15.6 64.3 26.0X -SQL Parquet MR 1960 1972 17 5.3 187.0 8.9X -SQL ORC Vectorized 551 558 11 19.0 52.6 31.8X -SQL ORC MR 2047 2052 6 5.1 195.2 8.6X +SQL CSV 9741 9804 89 1.1 929.0 1.0X +SQL Json 8230 8401 241 1.3 784.9 1.2X +SQL Parquet Vectorized 618 650 31 17.0 58.9 15.8X +SQL Parquet MR 2258 2311 75 4.6 215.4 4.3X +SQL ORC Vectorized 608 629 15 17.3 58.0 16.0X +SQL ORC MR 2466 2479 18 4.3 235.2 4.0X ================================================================================================ Partitioned Table Scan ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Data column - CSV 40273 40290 24 0.4 2560.5 1.0X -Data column - Json 14420 14440 28 1.1 916.8 2.8X -Data column - Parquet Vectorized 336 342 6 46.8 21.4 119.8X -Data column - Parquet MR 2651 2652 2 5.9 168.5 15.2X -Data column - ORC Vectorized 444 451 9 35.4 28.2 90.7X -Data column - ORC MR 2342 2356 20 6.7 148.9 17.2X -Partition column - CSV 11307 11310 4 1.4 718.9 3.6X -Partition column - Json 12105 12115 14 1.3 769.6 3.3X -Partition column - Parquet Vectorized 87 97 13 181.2 5.5 464.0X -Partition column - Parquet MR 1364 1368 7 11.5 86.7 29.5X -Partition column - ORC Vectorized 83 97 13 189.0 5.3 484.1X -Partition column - ORC MR 1424 1437 19 11.0 90.5 28.3X -Both columns - CSV 41896 42166 381 0.4 2663.7 1.0X -Both columns - Json 15852 15871 27 1.0 1007.8 2.5X -Both columns - Parquet Vectorized 379 383 5 41.5 24.1 106.2X -Both columns - Parquet MR 2889 2916 38 5.4 183.7 13.9X -Both columns - ORC Vectorized 581 582 2 27.1 36.9 69.3X -Both columns - ORC MR 2626 2641 22 6.0 166.9 15.3X +Data column - CSV 24195 24573 534 0.7 1538.3 1.0X +Data column - Json 14746 14883 194 1.1 937.5 1.6X +Data column - Parquet Vectorized 352 385 34 44.7 22.4 68.7X +Data column - Parquet MR 3674 3694 27 4.3 233.6 6.6X +Data column - ORC Vectorized 480 505 26 32.8 30.5 50.4X +Data column - ORC MR 2913 3004 128 5.4 185.2 8.3X +Partition column - CSV 7527 7544 23 2.1 478.6 3.2X +Partition column - Json 11955 12051 135 1.3 760.1 2.0X +Partition column - Parquet Vectorized 65 92 29 242.5 4.1 373.0X +Partition column - Parquet MR 1614 1628 21 9.7 102.6 15.0X +Partition column - ORC Vectorized 71 99 29 220.1 4.5 338.5X +Partition column - ORC MR 1761 1769 11 8.9 112.0 13.7X +Both columns - CSV 24077 24127 70 0.7 1530.8 1.0X +Both columns - Json 15286 15479 273 1.0 971.9 1.6X +Both columns - Parquet Vectorized 376 412 40 41.9 23.9 64.4X +Both columns - Parquet MR 3808 3826 26 4.1 242.1 6.4X +Both columns - ORC Vectorized 560 604 42 28.1 35.6 43.2X +Both columns - ORC MR 3046 3080 49 5.2 193.7 7.9X ================================================================================================ String with Nulls Scan ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 20831 21141 439 0.5 1986.6 1.0X -SQL Json 11720 11721 1 0.9 1117.7 1.8X -SQL Parquet Vectorized 1470 1475 7 7.1 140.2 14.2X -SQL Parquet MR 3902 3902 0 2.7 372.1 5.3X -ParquetReader Vectorized 1074 1077 4 9.8 102.5 19.4X -SQL ORC Vectorized 1289 1334 64 8.1 122.9 16.2X -SQL ORC MR 3603 3612 13 2.9 343.6 5.8X +SQL CSV 11805 12021 306 0.9 1125.8 1.0X +SQL Json 12051 12105 77 0.9 1149.3 1.0X +SQL Parquet Vectorized 1474 1545 100 7.1 140.6 8.0X +SQL Parquet MR 4488 4492 4 2.3 428.1 2.6X +ParquetReader Vectorized 1140 1140 1 9.2 108.7 10.4X +SQL ORC Vectorized 1164 1178 20 9.0 111.0 10.1X +SQL ORC MR 3745 3817 102 2.8 357.1 3.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 21850 21910 85 0.5 2083.8 1.0X -SQL Json 8651 8668 24 1.2 825.0 2.5X -SQL Parquet Vectorized 1079 1090 16 9.7 102.9 20.3X -SQL Parquet MR 2906 2925 27 3.6 277.1 7.5X -ParquetReader Vectorized 951 954 4 11.0 90.7 23.0X -SQL ORC Vectorized 1246 1250 5 8.4 118.8 17.5X -SQL ORC MR 3146 3162 22 3.3 300.1 6.9X +SQL CSV 9814 9837 33 1.1 936.0 1.0X +SQL Json 9317 9445 182 1.1 888.5 1.1X +SQL Parquet Vectorized 1117 1155 52 9.4 106.6 8.8X +SQL Parquet MR 3463 3538 106 3.0 330.3 2.8X +ParquetReader Vectorized 1033 1039 8 10.1 98.6 9.5X +SQL ORC Vectorized 1307 1353 65 8.0 124.7 7.5X +SQL ORC MR 3644 3690 65 2.9 347.5 2.7X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 18993 19140 209 0.6 1811.3 1.0X -SQL Json 5467 5469 2 1.9 521.4 3.5X -SQL Parquet Vectorized 240 248 10 43.8 22.8 79.3X -SQL Parquet MR 1745 1753 12 6.0 166.4 10.9X -ParquetReader Vectorized 240 244 5 43.7 22.9 79.1X -SQL ORC Vectorized 496 500 4 21.1 47.3 38.3X -SQL ORC MR 1822 1827 8 5.8 173.7 10.4X +SQL CSV 8145 8270 176 1.3 776.8 1.0X +SQL Json 5714 5764 71 1.8 544.9 1.4X +SQL Parquet Vectorized 235 264 15 44.6 22.4 34.7X +SQL Parquet MR 2398 2412 19 4.4 228.7 3.4X +ParquetReader Vectorized 248 262 11 42.3 23.6 32.9X +SQL ORC Vectorized 430 462 37 24.4 41.0 18.9X +SQL ORC MR 1983 1993 14 5.3 189.1 4.1X ================================================================================================ Single Column Scan From Wide Columns ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Single Column Scan from 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 3907 3911 6 0.3 3726.3 1.0X -SQL Json 3755 3763 12 0.3 3581.2 1.0X -SQL Parquet Vectorized 68 71 6 15.4 64.8 57.5X -SQL Parquet MR 234 239 5 4.5 223.0 16.7X -SQL ORC Vectorized 74 77 5 14.2 70.4 52.9X -SQL ORC MR 203 204 2 5.2 193.3 19.3X +SQL CSV 2448 2461 18 0.4 2334.3 1.0X +SQL Json 3332 3370 53 0.3 3177.6 0.7X +SQL Parquet Vectorized 51 87 25 20.7 48.2 48.4X +SQL Parquet MR 239 278 35 4.4 227.5 10.3X +SQL ORC Vectorized 60 82 19 17.5 57.3 40.8X +SQL ORC MR 197 219 26 5.3 188.3 12.4X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Single Column Scan from 50 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 7909 7927 25 0.1 7542.9 1.0X -SQL Json 15014 15101 123 0.1 14318.8 0.5X -SQL Parquet Vectorized 105 128 22 10.0 100.0 75.4X -SQL Parquet MR 275 283 9 3.8 261.9 28.8X -SQL ORC Vectorized 104 116 9 10.1 98.9 76.3X -SQL ORC MR 234 245 12 4.5 223.0 33.8X +SQL CSV 6034 6061 39 0.2 5754.0 1.0X +SQL Json 12232 12315 118 0.1 11665.4 0.5X +SQL Parquet Vectorized 73 120 30 14.4 69.6 82.6X +SQL Parquet MR 316 368 44 3.3 301.1 19.1X +SQL ORC Vectorized 76 122 36 13.7 72.9 79.0X +SQL ORC MR 206 261 47 5.1 196.5 29.3X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 13033 13129 136 0.1 12429.1 1.0X -SQL Json 28298 29130 1176 0.0 26987.3 0.5X -SQL Parquet Vectorized 139 151 9 7.5 132.7 93.7X -SQL Parquet MR 314 322 7 3.3 299.5 41.5X -SQL ORC Vectorized 123 143 17 8.5 117.3 106.0X -SQL ORC MR 260 272 9 4.0 248.1 50.1X +SQL CSV 10307 10309 4 0.1 9829.0 1.0X +SQL Json 23412 23539 180 0.0 22327.7 0.4X +SQL Parquet Vectorized 105 151 23 10.0 99.9 98.4X +SQL Parquet MR 295 325 29 3.6 281.5 34.9X +SQL ORC Vectorized 85 112 31 12.4 81.0 121.4X +SQL ORC MR 212 255 66 4.9 202.3 48.6X diff --git a/sql/core/benchmarks/DataSourceReadBenchmark-results.txt b/sql/core/benchmarks/DataSourceReadBenchmark-results.txt index 40e8dfc77c712..fe083703ae0ea 100644 --- a/sql/core/benchmarks/DataSourceReadBenchmark-results.txt +++ b/sql/core/benchmarks/DataSourceReadBenchmark-results.txt @@ -2,251 +2,251 @@ SQL Single Numeric Column Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 24716 24743 38 0.6 1571.4 1.0X -SQL Json 9669 9686 25 1.6 614.7 2.6X -SQL Parquet Vectorized 172 193 21 91.2 11.0 143.4X -SQL Parquet MR 1929 1942 18 8.2 122.7 12.8X -SQL ORC Vectorized 247 266 19 63.6 15.7 99.9X -SQL ORC MR 1640 1660 29 9.6 104.3 15.1X +SQL CSV 15943 15956 18 1.0 1013.6 1.0X +SQL Json 9109 9158 70 1.7 579.1 1.8X +SQL Parquet Vectorized 168 191 16 93.8 10.7 95.1X +SQL Parquet MR 1938 1950 17 8.1 123.2 8.2X +SQL ORC Vectorized 191 199 6 82.2 12.2 83.3X +SQL ORC MR 1523 1537 20 10.3 96.8 10.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Parquet Reader Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -ParquetReader Vectorized 197 200 4 79.9 12.5 1.0X -ParquetReader Vectorized -> Row 96 98 3 164.1 6.1 2.1X +------------------------------------------------------------------------------------------------------------------------- +ParquetReader Vectorized 203 206 3 77.5 12.9 1.0X +ParquetReader Vectorized -> Row 97 100 2 161.6 6.2 2.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 25320 25343 32 0.6 1609.8 1.0X -SQL Json 10460 10465 8 1.5 665.0 2.4X -SQL Parquet Vectorized 206 218 13 76.5 13.1 123.2X -SQL Parquet MR 2032 2036 6 7.7 129.2 12.5X -SQL ORC Vectorized 295 301 4 53.4 18.7 85.9X -SQL ORC MR 1867 1885 25 8.4 118.7 13.6X +SQL CSV 17062 17089 38 0.9 1084.8 1.0X +SQL Json 9718 9720 3 1.6 617.9 1.8X +SQL Parquet Vectorized 326 333 7 48.2 20.7 52.3X +SQL Parquet MR 2305 2329 34 6.8 146.6 7.4X +SQL ORC Vectorized 201 205 3 78.2 12.8 84.8X +SQL ORC MR 1795 1796 0 8.8 114.1 9.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Parquet Reader Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -ParquetReader Vectorized 288 294 6 54.6 18.3 1.0X -ParquetReader Vectorized -> Row 252 254 4 62.3 16.0 1.1X +-------------------------------------------------------------------------------------------------------------------------- +ParquetReader Vectorized 333 339 7 47.2 21.2 1.0X +ParquetReader Vectorized -> Row 283 285 3 55.7 18.0 1.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 27385 27423 54 0.6 1741.1 1.0X -SQL Json 10118 10133 20 1.6 643.3 2.7X -SQL Parquet Vectorized 180 189 10 87.4 11.4 152.1X -SQL Parquet MR 2548 2552 6 6.2 162.0 10.7X -SQL ORC Vectorized 306 312 8 51.4 19.4 89.5X -SQL ORC MR 1882 1927 64 8.4 119.6 14.6X +SQL CSV 18722 18809 123 0.8 1190.3 1.0X +SQL Json 10192 10249 80 1.5 648.0 1.8X +SQL Parquet Vectorized 155 162 8 101.6 9.8 120.9X +SQL Parquet MR 2348 2360 16 6.7 149.3 8.0X +SQL ORC Vectorized 265 275 7 59.3 16.9 70.5X +SQL ORC MR 1892 1938 65 8.3 120.3 9.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Parquet Reader Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 255 260 7 61.7 16.2 1.0X -ParquetReader Vectorized -> Row 252 257 6 62.4 16.0 1.0X +ParquetReader Vectorized 243 251 7 64.8 15.4 1.0X +ParquetReader Vectorized -> Row 222 229 5 70.9 14.1 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 36971 37037 94 0.4 2350.5 1.0X -SQL Json 13285 13300 22 1.2 844.6 2.8X -SQL Parquet Vectorized 275 285 5 57.1 17.5 134.3X -SQL Parquet MR 2599 2603 6 6.1 165.3 14.2X -SQL ORC Vectorized 386 395 5 40.7 24.6 95.7X -SQL ORC MR 2059 2075 22 7.6 130.9 18.0X +SQL CSV 24299 24358 84 0.6 1544.9 1.0X +SQL Json 13349 13429 114 1.2 848.7 1.8X +SQL Parquet Vectorized 215 241 59 73.3 13.6 113.2X +SQL Parquet MR 2508 2508 0 6.3 159.4 9.7X +SQL ORC Vectorized 323 330 6 48.7 20.5 75.2X +SQL ORC MR 1993 2009 22 7.9 126.7 12.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Parquet Reader Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 352 361 14 44.7 22.4 1.0X -ParquetReader Vectorized -> Row 386 392 8 40.7 24.6 0.9X +ParquetReader Vectorized 310 351 74 50.8 19.7 1.0X +ParquetReader Vectorized -> Row 281 297 8 55.9 17.9 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 29272 29322 71 0.5 1861.1 1.0X -SQL Json 15022 15099 108 1.0 955.1 1.9X -SQL Parquet Vectorized 172 178 6 91.5 10.9 170.2X -SQL Parquet MR 2184 2206 31 7.2 138.9 13.4X -SQL ORC Vectorized 477 485 6 32.9 30.4 61.3X -SQL ORC MR 2036 2054 26 7.7 129.4 14.4X +SQL CSV 19745 19811 93 0.8 1255.4 1.0X +SQL Json 12523 12760 335 1.3 796.2 1.6X +SQL Parquet Vectorized 153 160 6 102.9 9.7 129.2X +SQL Parquet MR 2325 2338 18 6.8 147.8 8.5X +SQL ORC Vectorized 389 401 8 40.5 24.7 50.8X +SQL ORC MR 2009 2009 1 7.8 127.7 9.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Parquet Reader Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 251 255 5 62.6 16.0 1.0X -ParquetReader Vectorized -> Row 248 254 7 63.5 15.7 1.0X +ParquetReader Vectorized 240 244 4 65.5 15.3 1.0X +ParquetReader Vectorized -> Row 223 230 6 70.5 14.2 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 38020 38024 6 0.4 2417.2 1.0X -SQL Json 20449 20463 19 0.8 1300.1 1.9X -SQL Parquet Vectorized 268 274 8 58.7 17.0 141.8X -SQL Parquet MR 2484 2493 12 6.3 157.9 15.3X -SQL ORC Vectorized 580 582 2 27.1 36.9 65.6X -SQL ORC MR 2179 2199 29 7.2 138.5 17.5X +SQL CSV 27223 27293 99 0.6 1730.8 1.0X +SQL Json 18601 18646 63 0.8 1182.6 1.5X +SQL Parquet Vectorized 247 251 3 63.8 15.7 110.4X +SQL Parquet MR 2724 2773 69 5.8 173.2 10.0X +SQL ORC Vectorized 474 484 10 33.2 30.1 57.4X +SQL ORC MR 2342 2368 37 6.7 148.9 11.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Parquet Reader Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ParquetReader Vectorized 344 350 7 45.7 21.9 1.0X -ParquetReader Vectorized -> Row 346 352 12 45.5 22.0 1.0X +ParquetReader Vectorized 326 335 13 48.3 20.7 1.0X +ParquetReader Vectorized -> Row 358 365 7 44.0 22.7 0.9X ================================================================================================ Int and String Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 27652 28221 804 0.4 2637.1 1.0X -SQL Json 12827 12842 21 0.8 1223.3 2.2X -SQL Parquet Vectorized 2297 2311 19 4.6 219.1 12.0X -SQL Parquet MR 4207 4217 15 2.5 401.2 6.6X -SQL ORC Vectorized 2316 2342 36 4.5 220.9 11.9X -SQL ORC MR 4158 4236 110 2.5 396.5 6.7X +SQL CSV 18706 18716 15 0.6 1783.9 1.0X +SQL Json 12665 12762 138 0.8 1207.8 1.5X +SQL Parquet Vectorized 2408 2419 15 4.4 229.6 7.8X +SQL Parquet MR 4599 4620 30 2.3 438.6 4.1X +SQL ORC Vectorized 2397 2400 3 4.4 228.6 7.8X +SQL ORC MR 4267 4288 30 2.5 406.9 4.4X ================================================================================================ Repeated String Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 19185 19343 224 0.5 1829.6 1.0X -SQL Json 7682 7692 14 1.4 732.6 2.5X -SQL Parquet Vectorized 796 805 9 13.2 75.9 24.1X -SQL Parquet MR 1880 1891 17 5.6 179.2 10.2X -SQL ORC Vectorized 553 558 5 19.0 52.7 34.7X -SQL ORC MR 2105 2128 32 5.0 200.8 9.1X +SQL CSV 10822 10838 23 1.0 1032.0 1.0X +SQL Json 7459 7488 41 1.4 711.4 1.5X +SQL Parquet Vectorized 875 895 26 12.0 83.5 12.4X +SQL Parquet MR 1976 2002 37 5.3 188.4 5.5X +SQL ORC Vectorized 533 539 8 19.7 50.9 20.3X +SQL ORC MR 2191 2194 5 4.8 208.9 4.9X ================================================================================================ Partitioned Table Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Data column - CSV 43759 43811 73 0.4 2782.1 1.0X -Data column - Json 13866 13874 11 1.1 881.6 3.2X -Data column - Parquet Vectorized 292 302 10 53.9 18.5 150.1X -Data column - Parquet MR 2681 2697 23 5.9 170.5 16.3X -Data column - ORC Vectorized 416 422 12 37.8 26.4 105.2X -Data column - ORC MR 2256 2275 27 7.0 143.4 19.4X -Partition column - CSV 13909 13949 56 1.1 884.3 3.1X -Partition column - Json 11248 11252 7 1.4 715.1 3.9X -Partition column - Parquet Vectorized 83 95 13 189.4 5.3 526.9X -Partition column - Parquet MR 1531 1532 2 10.3 97.3 28.6X -Partition column - ORC Vectorized 81 97 17 193.1 5.2 537.3X -Partition column - ORC MR 1557 1570 19 10.1 99.0 28.1X -Both columns - CSV 48341 48524 259 0.3 3073.4 0.9X -Both columns - Json 13636 13652 23 1.2 866.9 3.2X -Both columns - Parquet Vectorized 341 354 16 46.1 21.7 128.2X -Both columns - Parquet MR 2806 2825 26 5.6 178.4 15.6X -Both columns - ORC Vectorized 548 554 8 28.7 34.8 79.8X -Both columns - ORC MR 2602 2632 43 6.0 165.4 16.8X +Data column - CSV 31196 31449 359 0.5 1983.4 1.0X +Data column - Json 16118 16855 1041 1.0 1024.8 1.9X +Data column - Parquet Vectorized 243 251 9 64.8 15.4 128.4X +Data column - Parquet MR 4213 4288 106 3.7 267.8 7.4X +Data column - ORC Vectorized 335 341 4 46.9 21.3 93.1X +Data column - ORC MR 3119 3146 38 5.0 198.3 10.0X +Partition column - CSV 9616 9915 423 1.6 611.3 3.2X +Partition column - Json 14136 14164 39 1.1 898.8 2.2X +Partition column - Parquet Vectorized 64 70 6 243.9 4.1 483.8X +Partition column - Parquet MR 1954 1980 38 8.1 124.2 16.0X +Partition column - ORC Vectorized 67 74 8 233.4 4.3 462.9X +Partition column - ORC MR 2461 2479 26 6.4 156.4 12.7X +Both columns - CSV 30327 30666 479 0.5 1928.2 1.0X +Both columns - Json 18656 18789 188 0.8 1186.1 1.7X +Both columns - Parquet Vectorized 291 297 7 54.0 18.5 107.2X +Both columns - Parquet MR 4430 4443 19 3.6 281.6 7.0X +Both columns - ORC Vectorized 403 411 11 39.0 25.6 77.4X +Both columns - ORC MR 3580 3584 5 4.4 227.6 8.7X ================================================================================================ String with Nulls Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 22570 22687 166 0.5 2152.4 1.0X -SQL Json 11103 11129 38 0.9 1058.8 2.0X -SQL Parquet Vectorized 1508 1516 12 7.0 143.8 15.0X -SQL Parquet MR 3686 3692 9 2.8 351.5 6.1X -ParquetReader Vectorized 1117 1133 22 9.4 106.6 20.2X -SQL ORC Vectorized 1195 1212 24 8.8 114.0 18.9X -SQL ORC MR 3617 3618 3 2.9 344.9 6.2X +SQL CSV 15606 15614 11 0.7 1488.3 1.0X +SQL Json 15406 15451 63 0.7 1469.3 1.0X +SQL Parquet Vectorized 1555 1573 25 6.7 148.3 10.0X +SQL Parquet MR 5369 5377 11 2.0 512.0 2.9X +ParquetReader Vectorized 1145 1150 7 9.2 109.2 13.6X +SQL ORC Vectorized 1023 1027 6 10.2 97.6 15.3X +SQL ORC MR 4421 4542 172 2.4 421.6 3.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 19569 19819 354 0.5 1866.2 1.0X -SQL Json 8292 8308 22 1.3 790.8 2.4X -SQL Parquet Vectorized 1107 1136 41 9.5 105.6 17.7X -SQL Parquet MR 2784 2812 39 3.8 265.5 7.0X -ParquetReader Vectorized 990 994 5 10.6 94.4 19.8X -SQL ORC Vectorized 1198 1199 2 8.8 114.2 16.3X -SQL ORC MR 3164 3195 44 3.3 301.7 6.2X +SQL CSV 11096 11159 90 0.9 1058.2 1.0X +SQL Json 10797 11304 717 1.0 1029.7 1.0X +SQL Parquet Vectorized 1218 1230 16 8.6 116.2 9.1X +SQL Parquet MR 3778 3806 40 2.8 360.3 2.9X +ParquetReader Vectorized 1108 1118 14 9.5 105.7 10.0X +SQL ORC Vectorized 1361 1371 13 7.7 129.8 8.2X +SQL ORC MR 4186 4196 14 2.5 399.2 2.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 15940 15969 41 0.7 1520.1 1.0X -SQL Json 4845 4845 0 2.2 462.0 3.3X -SQL Parquet Vectorized 243 249 6 43.1 23.2 65.5X -SQL Parquet MR 1732 1751 26 6.1 165.2 9.2X -ParquetReader Vectorized 241 243 3 43.4 23.0 66.0X -SQL ORC Vectorized 425 431 7 24.7 40.5 37.5X -SQL ORC MR 1713 1728 20 6.1 163.4 9.3X +SQL CSV 8803 8866 90 1.2 839.5 1.0X +SQL Json 7220 7249 42 1.5 688.5 1.2X +SQL Parquet Vectorized 258 265 7 40.6 24.6 34.1X +SQL Parquet MR 2760 2761 0 3.8 263.2 3.2X +ParquetReader Vectorized 277 283 5 37.8 26.4 31.7X +SQL ORC Vectorized 514 522 6 20.4 49.1 17.1X +SQL ORC MR 2523 2591 96 4.2 240.6 3.5X ================================================================================================ Single Column Scan From Wide Columns ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Single Column Scan from 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 3838 3885 66 0.3 3660.4 1.0X -SQL Json 3615 3615 0 0.3 3447.8 1.1X -SQL Parquet Vectorized 66 74 8 15.8 63.2 57.9X -SQL Parquet MR 230 237 6 4.6 219.3 16.7X -SQL ORC Vectorized 72 77 9 14.5 68.9 53.1X -SQL ORC MR 194 201 5 5.4 185.3 19.7X +SQL CSV 3022 3032 14 0.3 2881.9 1.0X +SQL Json 4047 4051 5 0.3 3859.5 0.7X +SQL Parquet Vectorized 50 54 6 20.8 48.1 59.9X +SQL Parquet MR 299 301 2 3.5 285.0 10.1X +SQL ORC Vectorized 59 63 11 17.9 55.9 51.6X +SQL ORC MR 255 259 5 4.1 243.4 11.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Single Column Scan from 50 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 8711 8754 60 0.1 8307.9 1.0X -SQL Json 14414 14423 12 0.1 13746.5 0.6X -SQL Parquet Vectorized 97 106 12 10.8 92.7 89.6X -SQL Parquet MR 267 274 7 3.9 254.2 32.7X -SQL ORC Vectorized 100 104 7 10.5 95.1 87.4X -SQL ORC MR 226 230 6 4.6 215.2 38.6X +SQL CSV 7250 7252 3 0.1 6914.4 1.0X +SQL Json 15641 15718 109 0.1 14916.8 0.5X +SQL Parquet Vectorized 66 72 8 15.9 62.9 110.0X +SQL Parquet MR 320 323 3 3.3 305.0 22.7X +SQL ORC Vectorized 72 77 11 14.6 68.6 100.9X +SQL ORC MR 269 273 5 3.9 256.8 26.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -SQL CSV 14509 14596 123 0.1 13836.8 1.0X -SQL Json 27545 27909 515 0.0 26269.1 0.5X -SQL Parquet Vectorized 141 151 13 7.4 134.8 102.7X -SQL Parquet MR 313 341 23 3.4 298.4 46.4X -SQL ORC Vectorized 121 129 15 8.7 115.4 119.9X -SQL ORC MR 252 269 33 4.2 240.3 57.6X +SQL CSV 10962 11340 535 0.1 10454.1 1.0X +SQL Json 24951 25755 1137 0.0 23795.0 0.4X +SQL Parquet Vectorized 84 93 6 12.4 80.5 129.9X +SQL Parquet MR 280 296 14 3.7 266.8 39.2X +SQL ORC Vectorized 70 76 6 15.0 66.6 156.9X +SQL ORC MR 231 242 13 4.5 220.1 47.5X diff --git a/sql/core/benchmarks/DatasetBenchmark-jdk11-results.txt b/sql/core/benchmarks/DatasetBenchmark-jdk11-results.txt index f07fae9121df1..8af16f90c40c2 100644 --- a/sql/core/benchmarks/DatasetBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/DatasetBenchmark-jdk11-results.txt @@ -2,45 +2,45 @@ Dataset Benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz back-to-back map long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -RDD 14574 14759 261 6.9 145.7 1.0X -DataFrame 2468 2655 264 40.5 24.7 5.9X -Dataset 3498 3533 50 28.6 35.0 4.2X +RDD 13660 13836 249 7.3 136.6 1.0X +DataFrame 2103 2125 30 47.5 21.0 6.5X +Dataset 2899 2910 16 34.5 29.0 4.7X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz back-to-back map: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -RDD 17877 18133 361 5.6 178.8 1.0X -DataFrame 5968 5991 33 16.8 59.7 3.0X -Dataset 12638 12859 313 7.9 126.4 1.4X +RDD 14939 14940 2 6.7 149.4 1.0X +DataFrame 5377 5529 216 18.6 53.8 2.8X +Dataset 15861 15923 88 6.3 158.6 0.9X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz back-to-back filter Long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -RDD 3399 3464 92 29.4 34.0 1.0X -DataFrame 1609 1628 28 62.2 16.1 2.1X -Dataset 3637 3648 16 27.5 36.4 0.9X +RDD 3803 3842 56 26.3 38.0 1.0X +DataFrame 1359 1369 14 73.6 13.6 2.8X +Dataset 3667 3668 1 27.3 36.7 1.0X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz back-to-back filter: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -RDD 4850 4859 13 20.6 48.5 1.0X -DataFrame 211 244 21 472.9 2.1 22.9X -Dataset 5864 6126 372 17.1 58.6 0.8X +RDD 4572 4595 33 21.9 45.7 1.0X +DataFrame 212 261 45 471.6 2.1 21.6X +Dataset 5629 5776 208 17.8 56.3 0.8X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz aggregate: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -RDD sum 4821 4914 131 20.7 48.2 1.0X -DataFrame sum 71 83 8 1412.4 0.7 68.1X -Dataset sum using Aggregator 6001 6012 16 16.7 60.0 0.8X -Dataset complex Aggregator 10247 10455 294 9.8 102.5 0.5X +RDD sum 3528 3563 50 28.3 35.3 1.0X +DataFrame sum 81 111 23 1240.3 0.8 43.8X +Dataset sum using Aggregator 5140 5164 34 19.5 51.4 0.7X +Dataset complex Aggregator 9815 9921 150 10.2 98.1 0.4X diff --git a/sql/core/benchmarks/DatasetBenchmark-results.txt b/sql/core/benchmarks/DatasetBenchmark-results.txt index 2774f14664230..965335f07cb8f 100644 --- a/sql/core/benchmarks/DatasetBenchmark-results.txt +++ b/sql/core/benchmarks/DatasetBenchmark-results.txt @@ -2,45 +2,45 @@ Dataset Benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz back-to-back map long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -RDD 12720 12777 80 7.9 127.2 1.0X -DataFrame 2242 2501 366 44.6 22.4 5.7X -Dataset 3040 3174 189 32.9 30.4 4.2X +RDD 12276 12399 175 8.1 122.8 1.0X +DataFrame 2017 2094 110 49.6 20.2 6.1X +Dataset 3034 3044 15 33.0 30.3 4.0X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz back-to-back map: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -RDD 15865 15922 82 6.3 158.6 1.0X -DataFrame 8423 8476 75 11.9 84.2 1.9X -Dataset 17180 18142 1361 5.8 171.8 0.9X +RDD 16325 16361 50 6.1 163.2 1.0X +DataFrame 8463 8468 6 11.8 84.6 1.9X +Dataset 22525 23091 801 4.4 225.2 0.7X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz back-to-back filter Long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -RDD 2928 3009 114 34.1 29.3 1.0X -DataFrame 1386 1427 59 72.2 13.9 2.1X -Dataset 3448 3451 5 29.0 34.5 0.8X +RDD 3133 3136 3 31.9 31.3 1.0X +DataFrame 1194 1535 482 83.8 11.9 2.6X +Dataset 3146 3156 13 31.8 31.5 1.0X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz back-to-back filter: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -RDD 5476 5483 10 18.3 54.8 1.0X -DataFrame 209 235 23 479.1 2.1 26.2X -Dataset 9433 9549 163 10.6 94.3 0.6X +RDD 5334 5352 25 18.7 53.3 1.0X +DataFrame 190 221 21 527.1 1.9 28.1X +Dataset 10536 10630 133 9.5 105.4 0.5X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz aggregate: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -RDD sum 5146 5239 132 19.4 51.5 1.0X -DataFrame sum 84 99 15 1196.9 0.8 61.6X -Dataset sum using Aggregator 8944 9021 109 11.2 89.4 0.6X -Dataset complex Aggregator 12832 13141 436 7.8 128.3 0.4X +RDD sum 4970 5099 181 20.1 49.7 1.0X +DataFrame sum 67 81 9 1483.8 0.7 73.8X +Dataset sum using Aggregator 9474 9771 420 10.6 94.7 0.5X +Dataset complex Aggregator 13975 14701 1028 7.2 139.7 0.4X diff --git a/sql/core/benchmarks/DateTimeBenchmark-jdk11-results.txt b/sql/core/benchmarks/DateTimeBenchmark-jdk11-results.txt index b787eff7029e6..1267cee7e9736 100644 --- a/sql/core/benchmarks/DateTimeBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/DateTimeBenchmark-jdk11-results.txt @@ -2,460 +2,460 @@ datetime +/- interval ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz datetime +/- interval: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date + interval(m) 1556 1667 157 6.4 155.6 1.0X -date + interval(m, d) 1582 1593 16 6.3 158.2 1.0X -date + interval(m, d, ms) 6619 6625 9 1.5 661.9 0.2X -date - interval(m) 1463 1475 16 6.8 146.3 1.1X -date - interval(m, d) 1569 1589 29 6.4 156.9 1.0X -date - interval(m, d, ms) 6638 6641 5 1.5 663.8 0.2X -timestamp + interval(m) 3153 3159 7 3.2 315.3 0.5X -timestamp + interval(m, d) 3230 3234 7 3.1 323.0 0.5X -timestamp + interval(m, d, ms) 3309 3313 5 3.0 330.9 0.5X -timestamp - interval(m) 2897 2900 4 3.5 289.7 0.5X -timestamp - interval(m, d) 3018 3019 1 3.3 301.8 0.5X -timestamp - interval(m, d, ms) 3313 3317 5 3.0 331.3 0.5X +date + interval(m) 1644 1661 24 6.1 164.4 1.0X +date + interval(m, d) 1571 1577 9 6.4 157.1 1.0X +date + interval(m, d, ms) 6292 6343 72 1.6 629.2 0.3X +date - interval(m) 1490 1493 5 6.7 149.0 1.1X +date - interval(m, d) 1551 1563 16 6.4 155.1 1.1X +date - interval(m, d, ms) 6432 6458 36 1.6 643.2 0.3X +timestamp + interval(m) 3198 3252 76 3.1 319.8 0.5X +timestamp + interval(m, d) 3421 3435 20 2.9 342.1 0.5X +timestamp + interval(m, d, ms) 3685 3715 43 2.7 368.5 0.4X +timestamp - interval(m) 3249 3269 28 3.1 324.9 0.5X +timestamp - interval(m, d) 3375 3383 12 3.0 337.5 0.5X +timestamp - interval(m, d, ms) 3696 3706 15 2.7 369.6 0.4X ================================================================================================ Extract components ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz cast to timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to timestamp wholestage off 314 319 7 31.8 31.4 1.0X -cast to timestamp wholestage on 289 305 12 34.6 28.9 1.1X +cast to timestamp wholestage off 279 293 20 35.8 27.9 1.0X +cast to timestamp wholestage on 274 286 9 36.4 27.4 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz year of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -year of timestamp wholestage off 1237 1247 14 8.1 123.7 1.0X -year of timestamp wholestage on 1242 1251 11 8.0 124.2 1.0X +year of timestamp wholestage off 1182 1184 3 8.5 118.2 1.0X +year of timestamp wholestage on 1239 1251 10 8.1 123.9 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz quarter of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -quarter of timestamp wholestage off 1589 1590 2 6.3 158.9 1.0X -quarter of timestamp wholestage on 1541 1556 11 6.5 154.1 1.0X +quarter of timestamp wholestage off 1238 1243 8 8.1 123.8 1.0X +quarter of timestamp wholestage on 1269 1291 14 7.9 126.9 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz month of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -month of timestamp wholestage off 1236 1252 23 8.1 123.6 1.0X -month of timestamp wholestage on 1226 1232 5 8.2 122.6 1.0X +month of timestamp wholestage off 1178 1185 10 8.5 117.8 1.0X +month of timestamp wholestage on 1211 1230 12 8.3 121.1 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz weekofyear of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -weekofyear of timestamp wholestage off 1877 1879 3 5.3 187.7 1.0X -weekofyear of timestamp wholestage on 1852 1872 28 5.4 185.2 1.0X +weekofyear of timestamp wholestage off 1734 1740 10 5.8 173.4 1.0X +weekofyear of timestamp wholestage on 1810 1826 16 5.5 181.0 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz day of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -day of timestamp wholestage off 1260 1262 3 7.9 126.0 1.0X -day of timestamp wholestage on 1230 1238 9 8.1 123.0 1.0X +day of timestamp wholestage off 1195 1199 4 8.4 119.5 1.0X +day of timestamp wholestage on 1214 1231 16 8.2 121.4 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz dayofyear of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -dayofyear of timestamp wholestage off 1281 1285 7 7.8 128.1 1.0X -dayofyear of timestamp wholestage on 1268 1272 6 7.9 126.8 1.0X +dayofyear of timestamp wholestage off 1283 1286 5 7.8 128.3 1.0X +dayofyear of timestamp wholestage on 1269 1286 11 7.9 126.9 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz dayofmonth of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -dayofmonth of timestamp wholestage off 1280 1287 9 7.8 128.0 1.0X -dayofmonth of timestamp wholestage on 1232 1237 5 8.1 123.2 1.0X +dayofmonth of timestamp wholestage off 1216 1239 32 8.2 121.6 1.0X +dayofmonth of timestamp wholestage on 1201 1262 73 8.3 120.1 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz dayofweek of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -dayofweek of timestamp wholestage off 1417 1419 4 7.1 141.7 1.0X -dayofweek of timestamp wholestage on 1419 1435 19 7.0 141.9 1.0X +dayofweek of timestamp wholestage off 1333 1343 14 7.5 133.3 1.0X +dayofweek of timestamp wholestage on 1380 1399 18 7.2 138.0 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz weekday of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -weekday of timestamp wholestage off 1353 1359 8 7.4 135.3 1.0X -weekday of timestamp wholestage on 1338 1345 7 7.5 133.8 1.0X +weekday of timestamp wholestage off 1294 1314 28 7.7 129.4 1.0X +weekday of timestamp wholestage on 1361 1379 12 7.3 136.1 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz hour of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -hour of timestamp wholestage off 985 998 17 10.1 98.5 1.0X -hour of timestamp wholestage on 935 938 3 10.7 93.5 1.1X +hour of timestamp wholestage off 946 1039 132 10.6 94.6 1.0X +hour of timestamp wholestage on 995 1026 18 10.1 99.5 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz minute of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -minute of timestamp wholestage off 1053 1053 0 9.5 105.3 1.0X -minute of timestamp wholestage on 934 940 9 10.7 93.4 1.1X +minute of timestamp wholestage off 958 979 28 10.4 95.8 1.0X +minute of timestamp wholestage on 952 964 12 10.5 95.2 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz second of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -second of timestamp wholestage off 978 983 7 10.2 97.8 1.0X -second of timestamp wholestage on 935 944 9 10.7 93.5 1.0X +second of timestamp wholestage off 947 977 42 10.6 94.7 1.0X +second of timestamp wholestage on 987 1029 62 10.1 98.7 1.0X ================================================================================================ Current date and time ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz current_date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -current_date wholestage off 297 299 2 33.6 29.7 1.0X -current_date wholestage on 273 283 11 36.6 27.3 1.1X +current_date wholestage off 254 254 1 39.4 25.4 1.0X +current_date wholestage on 268 275 7 37.3 26.8 0.9X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz current_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -current_timestamp wholestage off 300 365 92 33.4 30.0 1.0X -current_timestamp wholestage on 276 381 91 36.3 27.6 1.1X +current_timestamp wholestage off 263 296 47 38.1 26.3 1.0X +current_timestamp wholestage on 274 338 99 36.5 27.4 1.0X ================================================================================================ Date arithmetic ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz cast to date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to date wholestage off 1073 1087 20 9.3 107.3 1.0X -cast to date wholestage on 1009 1016 7 9.9 100.9 1.1X +cast to date wholestage off 1053 1068 20 9.5 105.3 1.0X +cast to date wholestage on 1133 1151 19 8.8 113.3 0.9X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz last_day: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -last_day wholestage off 1253 1254 2 8.0 125.3 1.0X -last_day wholestage on 1247 1257 10 8.0 124.7 1.0X +last_day wholestage off 1178 1179 1 8.5 117.8 1.0X +last_day wholestage on 1372 1390 19 7.3 137.2 0.9X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz next_day: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -next_day wholestage off 1150 1150 1 8.7 115.0 1.0X -next_day wholestage on 1061 1066 5 9.4 106.1 1.1X +next_day wholestage off 1114 1131 24 9.0 111.4 1.0X +next_day wholestage on 1129 1147 13 8.9 112.9 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz date_add: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_add wholestage off 1062 1068 9 9.4 106.2 1.0X -date_add wholestage on 1049 1056 8 9.5 104.9 1.0X +date_add wholestage off 1039 1041 3 9.6 103.9 1.0X +date_add wholestage on 1036 1055 12 9.7 103.6 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz date_sub: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_sub wholestage off 1063 1067 6 9.4 106.3 1.0X -date_sub wholestage on 1043 1061 26 9.6 104.3 1.0X +date_sub wholestage off 989 1010 29 10.1 98.9 1.0X +date_sub wholestage on 1033 1045 14 9.7 103.3 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz add_months: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -add_months wholestage off 1427 1434 10 7.0 142.7 1.0X -add_months wholestage on 1436 1449 11 7.0 143.6 1.0X +add_months wholestage off 1328 1410 116 7.5 132.8 1.0X +add_months wholestage on 1439 1478 39 7.0 143.9 0.9X ================================================================================================ Formatting dates ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz format date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -format date wholestage off 5200 5214 19 1.9 520.0 1.0X -format date wholestage on 5404 5424 14 1.9 540.4 1.0X +format date wholestage off 5802 5830 40 1.7 580.2 1.0X +format date wholestage on 5802 5837 40 1.7 580.2 1.0X ================================================================================================ Formatting timestamps ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz from_unixtime: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -from_unixtime wholestage off 7493 7494 2 1.3 749.3 1.0X -from_unixtime wholestage on 7506 7514 7 1.3 750.6 1.0X +from_unixtime wholestage off 6634 6669 49 1.5 663.4 1.0X +from_unixtime wholestage on 6724 6806 51 1.5 672.4 1.0X ================================================================================================ Convert timestamps ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz from_utc_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -from_utc_timestamp wholestage off 1314 1317 4 7.6 131.4 1.0X -from_utc_timestamp wholestage on 1273 1279 6 7.9 127.3 1.0X +from_utc_timestamp wholestage off 1389 1405 23 7.2 138.9 1.0X +from_utc_timestamp wholestage on 1363 1381 16 7.3 136.3 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz to_utc_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to_utc_timestamp wholestage off 1751 1752 1 5.7 175.1 1.0X -to_utc_timestamp wholestage on 1711 1716 6 5.8 171.1 1.0X +to_utc_timestamp wholestage off 1828 1837 12 5.5 182.8 1.0X +to_utc_timestamp wholestage on 1818 1838 23 5.5 181.8 1.0X ================================================================================================ Intervals ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz cast interval: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast interval wholestage off 332 337 7 30.1 33.2 1.0X -cast interval wholestage on 288 289 1 34.7 28.8 1.2X +cast interval wholestage off 288 289 1 34.7 28.8 1.0X +cast interval wholestage on 269 281 10 37.2 26.9 1.1X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz datediff: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -datediff wholestage off 1850 1852 3 5.4 185.0 1.0X -datediff wholestage on 1783 1791 5 5.6 178.3 1.0X +datediff wholestage off 2024 2028 5 4.9 202.4 1.0X +datediff wholestage on 2002 2044 32 5.0 200.2 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz months_between: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -months_between wholestage off 5540 5545 8 1.8 554.0 1.0X -months_between wholestage on 5474 5482 8 1.8 547.4 1.0X +months_between wholestage off 6378 6398 28 1.6 637.8 1.0X +months_between wholestage on 6400 6467 65 1.6 640.0 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz window: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -window wholestage off 2200 2309 154 0.5 2200.0 1.0X -window wholestage on 47429 47483 35 0.0 47428.8 0.0X +window wholestage off 1834 1837 5 0.5 1833.7 1.0X +window wholestage on 20763 21129 229 0.0 20763.3 0.1X ================================================================================================ Truncation ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz date_trunc YEAR: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc YEAR wholestage off 2587 2591 5 3.9 258.7 1.0X -date_trunc YEAR wholestage on 2531 2548 11 4.0 253.1 1.0X +date_trunc YEAR wholestage off 2786 2817 43 3.6 278.6 1.0X +date_trunc YEAR wholestage on 2805 2852 31 3.6 280.5 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz date_trunc YYYY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc YYYY wholestage off 2595 2596 1 3.9 259.5 1.0X -date_trunc YYYY wholestage on 2532 2537 9 3.9 253.2 1.0X +date_trunc YYYY wholestage off 2772 2813 58 3.6 277.2 1.0X +date_trunc YYYY wholestage on 2860 2894 39 3.5 286.0 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz date_trunc YY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc YY wholestage off 2604 2604 1 3.8 260.4 1.0X -date_trunc YY wholestage on 2529 2539 7 4.0 252.9 1.0X +date_trunc YY wholestage off 2902 2907 6 3.4 290.2 1.0X +date_trunc YY wholestage on 2801 2842 37 3.6 280.1 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz date_trunc MON: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc MON wholestage off 2601 2606 7 3.8 260.1 1.0X -date_trunc MON wholestage on 2544 2551 5 3.9 254.4 1.0X +date_trunc MON wholestage off 2863 2876 18 3.5 286.3 1.0X +date_trunc MON wholestage on 2870 2905 22 3.5 287.0 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz date_trunc MONTH: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc MONTH wholestage off 2596 2597 1 3.9 259.6 1.0X -date_trunc MONTH wholestage on 2547 2552 8 3.9 254.7 1.0X +date_trunc MONTH wholestage off 2847 2866 27 3.5 284.7 1.0X +date_trunc MONTH wholestage on 2799 2851 40 3.6 279.9 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz date_trunc MM: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc MM wholestage off 2598 2598 1 3.8 259.8 1.0X -date_trunc MM wholestage on 2545 2550 5 3.9 254.5 1.0X +date_trunc MM wholestage off 2833 2857 33 3.5 283.3 1.0X +date_trunc MM wholestage on 2890 2907 20 3.5 289.0 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz date_trunc DAY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc DAY wholestage off 2248 2249 2 4.4 224.8 1.0X -date_trunc DAY wholestage on 2215 2222 6 4.5 221.5 1.0X +date_trunc DAY wholestage off 2331 2387 79 4.3 233.1 1.0X +date_trunc DAY wholestage on 2324 2371 51 4.3 232.4 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz date_trunc DD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc DD wholestage off 2244 2251 9 4.5 224.4 1.0X -date_trunc DD wholestage on 2214 2220 6 4.5 221.4 1.0X +date_trunc DD wholestage off 2314 2352 53 4.3 231.4 1.0X +date_trunc DD wholestage on 2351 2392 28 4.3 235.1 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz date_trunc HOUR: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc HOUR wholestage off 2208 2211 3 4.5 220.8 1.0X -date_trunc HOUR wholestage on 2228 2233 3 4.5 222.8 1.0X +date_trunc HOUR wholestage off 2278 2319 58 4.4 227.8 1.0X +date_trunc HOUR wholestage on 2346 2373 32 4.3 234.6 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz date_trunc MINUTE: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc MINUTE wholestage off 2230 2238 11 4.5 223.0 1.0X -date_trunc MINUTE wholestage on 2217 2225 11 4.5 221.7 1.0X +date_trunc MINUTE wholestage off 2326 2346 28 4.3 232.6 1.0X +date_trunc MINUTE wholestage on 2310 2348 33 4.3 231.0 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz date_trunc SECOND: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc SECOND wholestage off 353 362 12 28.3 35.3 1.0X -date_trunc SECOND wholestage on 333 336 3 30.0 33.3 1.1X +date_trunc SECOND wholestage off 368 373 8 27.2 36.8 1.0X +date_trunc SECOND wholestage on 370 380 9 27.0 37.0 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz date_trunc WEEK: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc WEEK wholestage off 2473 2478 7 4.0 247.3 1.0X -date_trunc WEEK wholestage on 2439 2462 33 4.1 243.9 1.0X +date_trunc WEEK wholestage off 2749 2773 35 3.6 274.9 1.0X +date_trunc WEEK wholestage on 2761 2835 49 3.6 276.1 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz date_trunc QUARTER: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc QUARTER wholestage off 3163 3165 3 3.2 316.3 1.0X -date_trunc QUARTER wholestage on 3129 3142 13 3.2 312.9 1.0X +date_trunc QUARTER wholestage off 3513 3574 86 2.8 351.3 1.0X +date_trunc QUARTER wholestage on 3492 3544 38 2.9 349.2 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz trunc year: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc year wholestage off 309 311 3 32.4 30.9 1.0X -trunc year wholestage on 325 332 4 30.8 32.5 1.0X +trunc year wholestage off 272 273 2 36.8 27.2 1.0X +trunc year wholestage on 314 323 6 31.9 31.4 0.9X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz trunc yyyy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc yyyy wholestage off 319 320 2 31.4 31.9 1.0X -trunc yyyy wholestage on 324 328 4 30.9 32.4 1.0X +trunc yyyy wholestage off 270 272 4 37.1 27.0 1.0X +trunc yyyy wholestage on 315 325 8 31.8 31.5 0.9X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz trunc yy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc yy wholestage off 311 313 3 32.2 31.1 1.0X -trunc yy wholestage on 324 330 4 30.8 32.4 1.0X +trunc yy wholestage off 273 275 3 36.7 27.3 1.0X +trunc yy wholestage on 324 327 4 30.9 32.4 0.8X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz trunc mon: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc mon wholestage off 310 313 4 32.2 31.0 1.0X -trunc mon wholestage on 326 329 4 30.7 32.6 1.0X +trunc mon wholestage off 284 285 2 35.2 28.4 1.0X +trunc mon wholestage on 318 327 7 31.4 31.8 0.9X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz trunc month: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc month wholestage off 308 318 13 32.4 30.8 1.0X -trunc month wholestage on 324 326 3 30.9 32.4 1.0X +trunc month wholestage off 272 274 3 36.8 27.2 1.0X +trunc month wholestage on 313 321 5 31.9 31.3 0.9X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz trunc mm: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc mm wholestage off 309 314 7 32.4 30.9 1.0X -trunc mm wholestage on 323 329 5 31.0 32.3 1.0X +trunc mm wholestage off 270 276 8 37.0 27.0 1.0X +trunc mm wholestage on 313 320 7 31.9 31.3 0.9X ================================================================================================ Parsing ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz to timestamp str: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to timestamp str wholestage off 172 174 2 5.8 172.4 1.0X -to timestamp str wholestage on 171 174 4 5.9 170.6 1.0X +to timestamp str wholestage off 145 151 8 6.9 145.2 1.0X +to timestamp str wholestage on 147 158 19 6.8 146.5 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz to_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to_timestamp wholestage off 1410 1411 2 0.7 1410.4 1.0X -to_timestamp wholestage on 1364 1375 10 0.7 1364.4 1.0X +to_timestamp wholestage off 1205 1209 6 0.8 1205.2 1.0X +to_timestamp wholestage on 1217 1261 64 0.8 1217.1 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz to_unix_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to_unix_timestamp wholestage off 1449 1453 6 0.7 1449.2 1.0X -to_unix_timestamp wholestage on 1379 1389 9 0.7 1379.5 1.1X +to_unix_timestamp wholestage off 1438 1440 2 0.7 1438.0 1.0X +to_unix_timestamp wholestage on 1194 1207 12 0.8 1193.6 1.2X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz to date str: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to date str wholestage off 228 231 4 4.4 228.1 1.0X -to date str wholestage on 211 213 1 4.7 210.6 1.1X +to date str wholestage off 192 199 10 5.2 191.6 1.0X +to date str wholestage on 192 202 16 5.2 191.9 1.0X -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz to_date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to_date wholestage off 3147 3173 37 0.3 3147.0 1.0X -to_date wholestage on 3123 3137 13 0.3 3123.0 1.0X +to_date wholestage off 2021 2034 18 0.5 2021.5 1.0X +to_date wholestage on 1965 1976 15 0.5 1965.1 1.0X ================================================================================================ Conversion from/to external types ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.9+11-Ubuntu-0ubuntu1.18.04.1 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz To/from Java's date-time: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -From java.sql.Date 403 414 13 12.4 80.6 1.0X -From java.time.LocalDate 342 346 4 14.6 68.4 1.2X -Collect java.sql.Date 2122 2549 639 2.4 424.4 0.2X -Collect java.time.LocalDate 1833 2034 175 2.7 366.5 0.2X -From java.sql.Timestamp 244 250 6 20.5 48.8 1.7X -From java.time.Instant 315 316 1 15.9 63.0 1.3X -Collect longs 1436 1452 19 3.5 287.2 0.3X -Collect java.sql.Timestamp 1685 1698 14 3.0 337.0 0.2X -Collect java.time.Instant 1722 2022 278 2.9 344.4 0.2X -java.sql.Date to Hive string 14996 16316 1670 0.3 2999.2 0.0X -java.time.LocalDate to Hive string 13774 13942 160 0.4 2754.8 0.0X -java.sql.Timestamp to Hive string 15346 15775 435 0.3 3069.3 0.0X -java.time.Instant to Hive string 17731 18153 444 0.3 3546.1 0.0X +From java.sql.Date 496 516 22 10.1 99.3 1.0X +From java.time.LocalDate 380 384 4 13.2 76.0 1.3X +Collect java.sql.Date 2476 2837 357 2.0 495.3 0.2X +Collect java.time.LocalDate 2281 2314 28 2.2 456.3 0.2X +From java.sql.Timestamp 268 289 30 18.7 53.6 1.9X +From java.time.Instant 335 351 24 14.9 67.1 1.5X +Collect longs 1981 2184 188 2.5 396.2 0.3X +Collect java.sql.Timestamp 2137 2320 171 2.3 427.4 0.2X +Collect java.time.Instant 2291 2412 155 2.2 458.1 0.2X +java.sql.Date to Hive string 9522 9998 674 0.5 1904.3 0.1X +java.time.LocalDate to Hive string 8841 9082 407 0.6 1768.2 0.1X +java.sql.Timestamp to Hive string 9385 9733 521 0.5 1876.9 0.1X +java.time.Instant to Hive string 11756 11927 252 0.4 2351.2 0.0X diff --git a/sql/core/benchmarks/DateTimeBenchmark-results.txt b/sql/core/benchmarks/DateTimeBenchmark-results.txt index 8e22dbbd8b8b3..21940b6ca6918 100644 --- a/sql/core/benchmarks/DateTimeBenchmark-results.txt +++ b/sql/core/benchmarks/DateTimeBenchmark-results.txt @@ -2,460 +2,460 @@ datetime +/- interval ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz datetime +/- interval: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date + interval(m) 1651 1690 56 6.1 165.1 1.0X -date + interval(m, d) 1826 1833 10 5.5 182.6 0.9X -date + interval(m, d, ms) 6522 6534 17 1.5 652.2 0.3X -date - interval(m) 1465 1473 12 6.8 146.5 1.1X -date - interval(m, d) 1728 1734 9 5.8 172.8 1.0X -date - interval(m, d, ms) 6757 6765 12 1.5 675.7 0.2X -timestamp + interval(m) 2686 2696 14 3.7 268.6 0.6X -timestamp + interval(m, d) 2979 2982 4 3.4 297.9 0.6X -timestamp + interval(m, d, ms) 3483 3507 33 2.9 348.3 0.5X -timestamp - interval(m) 2856 2858 3 3.5 285.6 0.6X -timestamp - interval(m, d) 3167 3169 3 3.2 316.7 0.5X -timestamp - interval(m, d, ms) 3475 3477 2 2.9 347.5 0.5X +date + interval(m) 1640 1688 68 6.1 164.0 1.0X +date + interval(m, d) 1840 1845 8 5.4 184.0 0.9X +date + interval(m, d, ms) 6767 6819 74 1.5 676.7 0.2X +date - interval(m) 1436 1446 15 7.0 143.6 1.1X +date - interval(m, d) 1755 1766 17 5.7 175.5 0.9X +date - interval(m, d, ms) 7090 7100 13 1.4 709.0 0.2X +timestamp + interval(m) 2791 2793 2 3.6 279.1 0.6X +timestamp + interval(m, d) 3058 3068 14 3.3 305.8 0.5X +timestamp + interval(m, d, ms) 3414 3425 16 2.9 341.4 0.5X +timestamp - interval(m) 2827 2878 72 3.5 282.7 0.6X +timestamp - interval(m, d) 3112 3144 45 3.2 311.2 0.5X +timestamp - interval(m, d, ms) 3360 3433 103 3.0 336.0 0.5X ================================================================================================ Extract components ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz cast to timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to timestamp wholestage off 309 312 5 32.4 30.9 1.0X -cast to timestamp wholestage on 292 302 8 34.2 29.2 1.1X +cast to timestamp wholestage off 263 272 13 38.1 26.3 1.0X +cast to timestamp wholestage on 256 281 22 39.0 25.6 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz year of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -year of timestamp wholestage off 1228 1228 0 8.1 122.8 1.0X -year of timestamp wholestage on 1213 1227 18 8.2 121.3 1.0X +year of timestamp wholestage off 1236 1243 10 8.1 123.6 1.0X +year of timestamp wholestage on 1206 1221 14 8.3 120.6 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz quarter of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -quarter of timestamp wholestage off 1433 1440 9 7.0 143.3 1.0X -quarter of timestamp wholestage on 1344 1349 4 7.4 134.4 1.1X +quarter of timestamp wholestage off 1406 1408 3 7.1 140.6 1.0X +quarter of timestamp wholestage on 1322 1352 37 7.6 132.2 1.1X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz month of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -month of timestamp wholestage off 1229 1232 5 8.1 122.9 1.0X -month of timestamp wholestage on 1201 1207 6 8.3 120.1 1.0X +month of timestamp wholestage off 1201 1220 27 8.3 120.1 1.0X +month of timestamp wholestage on 1192 1212 17 8.4 119.2 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz weekofyear of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -weekofyear of timestamp wholestage off 1921 1931 14 5.2 192.1 1.0X -weekofyear of timestamp wholestage on 1864 1881 16 5.4 186.4 1.0X +weekofyear of timestamp wholestage off 1931 1936 8 5.2 193.1 1.0X +weekofyear of timestamp wholestage on 1923 1959 31 5.2 192.3 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz day of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -day of timestamp wholestage off 1223 1225 2 8.2 122.3 1.0X -day of timestamp wholestage on 1204 1215 7 8.3 120.4 1.0X +day of timestamp wholestage off 1251 1252 2 8.0 125.1 1.0X +day of timestamp wholestage on 1209 1224 17 8.3 120.9 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz dayofyear of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -dayofyear of timestamp wholestage off 1261 1266 8 7.9 126.1 1.0X -dayofyear of timestamp wholestage on 1236 1260 15 8.1 123.6 1.0X +dayofyear of timestamp wholestage off 1290 1310 29 7.8 129.0 1.0X +dayofyear of timestamp wholestage on 1228 1273 51 8.1 122.8 1.1X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz dayofmonth of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -dayofmonth of timestamp wholestage off 1243 1250 10 8.0 124.3 1.0X -dayofmonth of timestamp wholestage on 1203 1214 11 8.3 120.3 1.0X +dayofmonth of timestamp wholestage off 1224 1283 83 8.2 122.4 1.0X +dayofmonth of timestamp wholestage on 1211 1228 15 8.3 121.1 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz dayofweek of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -dayofweek of timestamp wholestage off 1400 1409 13 7.1 140.0 1.0X -dayofweek of timestamp wholestage on 1374 1385 10 7.3 137.4 1.0X +dayofweek of timestamp wholestage off 1374 1374 0 7.3 137.4 1.0X +dayofweek of timestamp wholestage on 1380 1396 10 7.2 138.0 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz weekday of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -weekday of timestamp wholestage off 1355 1358 4 7.4 135.5 1.0X -weekday of timestamp wholestage on 1319 1328 8 7.6 131.9 1.0X +weekday of timestamp wholestage off 1352 1359 11 7.4 135.2 1.0X +weekday of timestamp wholestage on 1318 1336 16 7.6 131.8 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz hour of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -hour of timestamp wholestage off 970 973 4 10.3 97.0 1.0X -hour of timestamp wholestage on 950 957 9 10.5 95.0 1.0X +hour of timestamp wholestage off 986 999 18 10.1 98.6 1.0X +hour of timestamp wholestage on 887 921 31 11.3 88.7 1.1X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz minute of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -minute of timestamp wholestage off 1017 1019 3 9.8 101.7 1.0X -minute of timestamp wholestage on 948 951 2 10.5 94.8 1.1X +minute of timestamp wholestage off 936 956 28 10.7 93.6 1.0X +minute of timestamp wholestage on 867 899 22 11.5 86.7 1.1X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz second of timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -second of timestamp wholestage off 965 966 2 10.4 96.5 1.0X -second of timestamp wholestage on 943 946 2 10.6 94.3 1.0X +second of timestamp wholestage off 915 935 28 10.9 91.5 1.0X +second of timestamp wholestage on 917 948 27 10.9 91.7 1.0X ================================================================================================ Current date and time ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz current_date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -current_date wholestage off 296 296 0 33.8 29.6 1.0X -current_date wholestage on 271 277 7 36.9 27.1 1.1X +current_date wholestage off 253 261 10 39.5 25.3 1.0X +current_date wholestage on 255 277 24 39.3 25.5 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz current_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -current_timestamp wholestage off 307 329 32 32.6 30.7 1.0X -current_timestamp wholestage on 259 314 96 38.7 25.9 1.2X +current_timestamp wholestage off 292 364 102 34.3 29.2 1.0X +current_timestamp wholestage on 265 314 69 37.8 26.5 1.1X ================================================================================================ Date arithmetic ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz cast to date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to date wholestage off 1075 1077 3 9.3 107.5 1.0X -cast to date wholestage on 997 1002 5 10.0 99.7 1.1X +cast to date wholestage off 1053 1054 2 9.5 105.3 1.0X +cast to date wholestage on 971 981 8 10.3 97.1 1.1X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz last_day: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -last_day wholestage off 1259 1261 3 7.9 125.9 1.0X -last_day wholestage on 1231 1242 11 8.1 123.1 1.0X +last_day wholestage off 1268 1280 18 7.9 126.8 1.0X +last_day wholestage on 1215 1255 25 8.2 121.5 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz next_day: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -next_day wholestage off 1121 1123 3 8.9 112.1 1.0X -next_day wholestage on 1043 1049 6 9.6 104.3 1.1X +next_day wholestage off 1064 1070 8 9.4 106.4 1.0X +next_day wholestage on 1026 1047 21 9.7 102.6 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz date_add: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_add wholestage off 1043 1044 2 9.6 104.3 1.0X -date_add wholestage on 1026 1030 5 9.7 102.6 1.0X +date_add wholestage off 1033 1040 10 9.7 103.3 1.0X +date_add wholestage on 1030 1034 4 9.7 103.0 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz date_sub: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_sub wholestage off 1058 1062 6 9.5 105.8 1.0X -date_sub wholestage on 1024 1027 3 9.8 102.4 1.0X +date_sub wholestage off 1027 1033 8 9.7 102.7 1.0X +date_sub wholestage on 1008 1020 9 9.9 100.8 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz add_months: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -add_months wholestage off 1403 1404 2 7.1 140.3 1.0X -add_months wholestage on 1394 1399 5 7.2 139.4 1.0X +add_months wholestage off 1393 1419 37 7.2 139.3 1.0X +add_months wholestage on 1390 1433 45 7.2 139.0 1.0X ================================================================================================ Formatting dates ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz format date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -format date wholestage off 5730 5736 8 1.7 573.0 1.0X -format date wholestage on 6159 6184 26 1.6 615.9 0.9X +format date wholestage off 6010 6012 3 1.7 601.0 1.0X +format date wholestage on 5942 6007 39 1.7 594.2 1.0X ================================================================================================ Formatting timestamps ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz from_unixtime: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -from_unixtime wholestage off 8718 8725 10 1.1 871.8 1.0X -from_unixtime wholestage on 8648 8668 17 1.2 864.8 1.0X +from_unixtime wholestage off 7645 7703 82 1.3 764.5 1.0X +from_unixtime wholestage on 7748 7800 58 1.3 774.8 1.0X ================================================================================================ Convert timestamps ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz from_utc_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -from_utc_timestamp wholestage off 1174 1180 8 8.5 117.4 1.0X -from_utc_timestamp wholestage on 1084 1093 6 9.2 108.4 1.1X +from_utc_timestamp wholestage off 1215 1225 15 8.2 121.5 1.0X +from_utc_timestamp wholestage on 1073 1098 22 9.3 107.3 1.1X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz to_utc_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to_utc_timestamp wholestage off 1567 1567 0 6.4 156.7 1.0X -to_utc_timestamp wholestage on 1509 1528 13 6.6 150.9 1.0X +to_utc_timestamp wholestage off 1538 1547 12 6.5 153.8 1.0X +to_utc_timestamp wholestage on 1538 1586 39 6.5 153.8 1.0X ================================================================================================ Intervals ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz cast interval: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast interval wholestage off 328 332 5 30.4 32.8 1.0X -cast interval wholestage on 286 290 5 35.0 28.6 1.1X +cast interval wholestage off 300 311 15 33.3 30.0 1.0X +cast interval wholestage on 262 274 12 38.2 26.2 1.1X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz datediff: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -datediff wholestage off 1832 1833 2 5.5 183.2 1.0X -datediff wholestage on 1757 1761 3 5.7 175.7 1.0X +datediff wholestage off 1806 1815 12 5.5 180.6 1.0X +datediff wholestage on 1750 1789 44 5.7 175.0 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz months_between: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -months_between wholestage off 5040 5049 13 2.0 504.0 1.0X -months_between wholestage on 4943 4950 5 2.0 494.3 1.0X +months_between wholestage off 5164 5208 62 1.9 516.4 1.0X +months_between wholestage on 5052 5099 43 2.0 505.2 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz window: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -window wholestage off 1779 1855 107 0.6 1778.6 1.0X -window wholestage on 46705 46754 43 0.0 46705.1 0.0X +window wholestage off 1798 1814 23 0.6 1798.3 1.0X +window wholestage on 26389 26548 117 0.0 26388.6 0.1X ================================================================================================ Truncation ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz date_trunc YEAR: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc YEAR wholestage off 2485 2497 17 4.0 248.5 1.0X -date_trunc YEAR wholestage on 2403 2420 20 4.2 240.3 1.0X +date_trunc YEAR wholestage off 2497 2521 34 4.0 249.7 1.0X +date_trunc YEAR wholestage on 2427 2479 39 4.1 242.7 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz date_trunc YYYY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc YYYY wholestage off 2498 2502 5 4.0 249.8 1.0X -date_trunc YYYY wholestage on 2399 2401 2 4.2 239.9 1.0X +date_trunc YYYY wholestage off 2531 2545 20 4.0 253.1 1.0X +date_trunc YYYY wholestage on 2409 2452 25 4.2 240.9 1.1X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz date_trunc YY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc YY wholestage off 2492 2493 3 4.0 249.2 1.0X -date_trunc YY wholestage on 2399 2404 6 4.2 239.9 1.0X +date_trunc YY wholestage off 2531 2552 30 4.0 253.1 1.0X +date_trunc YY wholestage on 2419 2480 51 4.1 241.9 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz date_trunc MON: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc MON wholestage off 2454 2455 1 4.1 245.4 1.0X -date_trunc MON wholestage on 2412 2417 5 4.1 241.2 1.0X +date_trunc MON wholestage off 2498 2510 17 4.0 249.8 1.0X +date_trunc MON wholestage on 2436 2464 20 4.1 243.6 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz date_trunc MONTH: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc MONTH wholestage off 2449 2450 1 4.1 244.9 1.0X -date_trunc MONTH wholestage on 2409 2414 7 4.2 240.9 1.0X +date_trunc MONTH wholestage off 2505 2533 40 4.0 250.5 1.0X +date_trunc MONTH wholestage on 2477 2514 29 4.0 247.7 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz date_trunc MM: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc MM wholestage off 2445 2450 7 4.1 244.5 1.0X -date_trunc MM wholestage on 2409 2412 4 4.2 240.9 1.0X +date_trunc MM wholestage off 2522 2525 4 4.0 252.2 1.0X +date_trunc MM wholestage on 2472 2499 30 4.0 247.2 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz date_trunc DAY: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc DAY wholestage off 2158 2165 10 4.6 215.8 1.0X -date_trunc DAY wholestage on 2039 2045 6 4.9 203.9 1.1X +date_trunc DAY wholestage off 2111 2122 15 4.7 211.1 1.0X +date_trunc DAY wholestage on 2055 2092 33 4.9 205.5 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz date_trunc DD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc DD wholestage off 2156 2162 8 4.6 215.6 1.0X -date_trunc DD wholestage on 2038 2043 3 4.9 203.8 1.1X +date_trunc DD wholestage off 2097 2126 42 4.8 209.7 1.0X +date_trunc DD wholestage on 2072 2109 31 4.8 207.2 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz date_trunc HOUR: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc HOUR wholestage off 2080 2081 2 4.8 208.0 1.0X -date_trunc HOUR wholestage on 2042 2048 6 4.9 204.2 1.0X +date_trunc HOUR wholestage off 2227 2248 30 4.5 222.7 1.0X +date_trunc HOUR wholestage on 2119 2146 24 4.7 211.9 1.1X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz date_trunc MINUTE: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc MINUTE wholestage off 2116 2122 9 4.7 211.6 1.0X -date_trunc MINUTE wholestage on 2041 2048 11 4.9 204.1 1.0X +date_trunc MINUTE wholestage off 2196 2197 2 4.6 219.6 1.0X +date_trunc MINUTE wholestage on 2076 2127 30 4.8 207.6 1.1X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz date_trunc SECOND: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc SECOND wholestage off 349 352 4 28.6 34.9 1.0X -date_trunc SECOND wholestage on 309 314 6 32.3 30.9 1.1X +date_trunc SECOND wholestage off 310 313 4 32.3 31.0 1.0X +date_trunc SECOND wholestage on 295 308 10 33.9 29.5 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz date_trunc WEEK: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc WEEK wholestage off 2324 2330 8 4.3 232.4 1.0X -date_trunc WEEK wholestage on 2297 2305 13 4.4 229.7 1.0X +date_trunc WEEK wholestage off 2422 2455 48 4.1 242.2 1.0X +date_trunc WEEK wholestage on 2373 2422 33 4.2 237.3 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz date_trunc QUARTER: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -date_trunc QUARTER wholestage off 3652 3654 3 2.7 365.2 1.0X -date_trunc QUARTER wholestage on 3211 3218 9 3.1 321.1 1.1X +date_trunc QUARTER wholestage off 3545 3556 15 2.8 354.5 1.0X +date_trunc QUARTER wholestage on 3294 3340 39 3.0 329.4 1.1X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz trunc year: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc year wholestage off 308 311 4 32.5 30.8 1.0X -trunc year wholestage on 286 291 4 35.0 28.6 1.1X +trunc year wholestage off 268 271 4 37.3 26.8 1.0X +trunc year wholestage on 279 287 6 35.8 27.9 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz trunc yyyy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc yyyy wholestage off 304 305 1 32.9 30.4 1.0X -trunc yyyy wholestage on 286 290 5 35.0 28.6 1.1X +trunc yyyy wholestage off 289 291 2 34.5 28.9 1.0X +trunc yyyy wholestage on 279 291 11 35.9 27.9 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz trunc yy: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc yy wholestage off 319 322 5 31.4 31.9 1.0X -trunc yy wholestage on 285 288 3 35.0 28.5 1.1X +trunc yy wholestage off 276 280 5 36.2 27.6 1.0X +trunc yy wholestage on 277 299 20 36.1 27.7 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz trunc mon: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc mon wholestage off 304 309 7 32.9 30.4 1.0X -trunc mon wholestage on 284 289 4 35.2 28.4 1.1X +trunc mon wholestage off 266 268 3 37.6 26.6 1.0X +trunc mon wholestage on 285 298 9 35.1 28.5 0.9X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz trunc month: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc month wholestage off 302 305 4 33.1 30.2 1.0X -trunc month wholestage on 285 294 10 35.1 28.5 1.1X +trunc month wholestage off 264 271 9 37.8 26.4 1.0X +trunc month wholestage on 275 286 13 36.4 27.5 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz trunc mm: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -trunc mm wholestage off 301 317 23 33.2 30.1 1.0X -trunc mm wholestage on 284 290 4 35.2 28.4 1.1X +trunc mm wholestage off 266 279 18 37.6 26.6 1.0X +trunc mm wholestage on 288 291 4 34.7 28.8 0.9X ================================================================================================ Parsing ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz to timestamp str: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to timestamp str wholestage off 217 219 2 4.6 217.5 1.0X -to timestamp str wholestage on 216 219 4 4.6 215.7 1.0X +to timestamp str wholestage off 214 221 9 4.7 214.3 1.0X +to timestamp str wholestage on 207 212 5 4.8 207.1 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz to_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to_timestamp wholestage off 1853 1855 3 0.5 1852.9 1.0X -to_timestamp wholestage on 2138 2159 26 0.5 2137.6 0.9X +to_timestamp wholestage off 1253 1272 27 0.8 1253.2 1.0X +to_timestamp wholestage on 1240 1257 13 0.8 1239.5 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz to_unix_timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to_unix_timestamp wholestage off 2115 2116 1 0.5 2115.2 1.0X -to_unix_timestamp wholestage on 2131 2144 16 0.5 2130.8 1.0X +to_unix_timestamp wholestage off 1281 1288 11 0.8 1280.5 1.0X +to_unix_timestamp wholestage on 1270 1314 26 0.8 1270.0 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz to date str: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to date str wholestage off 280 281 1 3.6 279.7 1.0X -to date str wholestage on 265 271 9 3.8 265.2 1.1X +to date str wholestage off 247 249 2 4.0 247.5 1.0X +to date str wholestage on 245 254 7 4.1 244.9 1.0X -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz to_date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -to_date wholestage off 3434 3458 34 0.3 3433.7 1.0X -to_date wholestage on 3517 3539 18 0.3 3517.4 1.0X +to_date wholestage off 2314 2350 51 0.4 2314.1 1.0X +to_date wholestage on 2368 2393 43 0.4 2367.7 1.0X ================================================================================================ Conversion from/to external types ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_272-8u272-b10-0ubuntu1~18.04-b10 on Linux 5.4.0-1029-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz To/from Java's date-time: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -From java.sql.Date 399 405 6 12.5 79.7 1.0X -From java.time.LocalDate 341 347 6 14.6 68.3 1.2X -Collect java.sql.Date 1732 1943 183 2.9 346.3 0.2X -Collect java.time.LocalDate 1686 1719 29 3.0 337.2 0.2X -From java.sql.Timestamp 249 261 19 20.1 49.8 1.6X -From java.time.Instant 240 242 3 20.9 47.9 1.7X -Collect longs 1546 1582 60 3.2 309.3 0.3X -Collect java.sql.Timestamp 1714 1720 6 2.9 342.9 0.2X -Collect java.time.Instant 2063 2119 65 2.4 412.6 0.2X -java.sql.Date to Hive string 13888 14401 490 0.4 2777.6 0.0X -java.time.LocalDate to Hive string 13804 14231 661 0.4 2760.8 0.0X -java.sql.Timestamp to Hive string 14231 14550 393 0.4 2846.1 0.0X -java.time.Instant to Hive string 16732 17801 953 0.3 3346.3 0.0X +From java.sql.Date 403 409 7 12.4 80.6 1.0X +From java.time.LocalDate 326 327 2 15.4 65.1 1.2X +Collect java.sql.Date 1474 3120 NaN 3.4 294.8 0.3X +Collect java.time.LocalDate 1296 1338 39 3.9 259.2 0.3X +From java.sql.Timestamp 243 246 3 20.6 48.6 1.7X +From java.time.Instant 208 225 15 24.0 41.6 1.9X +Collect longs 1200 1274 79 4.2 240.1 0.3X +Collect java.sql.Timestamp 1368 1462 94 3.7 273.6 0.3X +Collect java.time.Instant 1312 1432 170 3.8 262.5 0.3X +java.sql.Date to Hive string 16614 21580 1798 0.3 3322.8 0.0X +java.time.LocalDate to Hive string 16907 18295 NaN 0.3 3381.3 0.0X +java.sql.Timestamp to Hive string 16926 17914 1288 0.3 3385.3 0.0X +java.time.Instant to Hive string 21324 22244 1592 0.2 4264.8 0.0X diff --git a/sql/core/benchmarks/DateTimeRebaseBenchmark-jdk11-results.txt b/sql/core/benchmarks/DateTimeRebaseBenchmark-jdk11-results.txt index 74b19f2eef6a8..3a93f70758aec 100644 --- a/sql/core/benchmarks/DateTimeRebaseBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/DateTimeRebaseBenchmark-jdk11-results.txt @@ -2,153 +2,153 @@ Rebasing dates/timestamps in Parquet datasource ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Save DATE to parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1582, noop 21041 21041 0 4.8 210.4 1.0X -before 1582, noop 11202 11202 0 8.9 112.0 1.9X -after 1582, rebase EXCEPTION 32810 32810 0 3.0 328.1 0.6X -after 1582, rebase LEGACY 32530 32530 0 3.1 325.3 0.6X -after 1582, rebase CORRECTED 32849 32849 0 3.0 328.5 0.6X -before 1582, rebase LEGACY 23537 23537 0 4.2 235.4 0.9X -before 1582, rebase CORRECTED 22870 22870 0 4.4 228.7 0.9X - -OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +after 1582, noop 24957 24957 0 4.0 249.6 1.0X +before 1582, noop 13309 13309 0 7.5 133.1 1.9X +after 1582, rebase EXCEPTION 38895 38895 0 2.6 388.9 0.6X +after 1582, rebase LEGACY 38477 38477 0 2.6 384.8 0.6X +after 1582, rebase CORRECTED 39442 39442 0 2.5 394.4 0.6X +before 1582, rebase LEGACY 31573 31573 0 3.2 315.7 0.8X +before 1582, rebase CORRECTED 28340 28340 0 3.5 283.4 0.9X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Load DATE from parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1582, vec off, rebase EXCEPTION 13114 13225 104 7.6 131.1 1.0X -after 1582, vec off, rebase LEGACY 13175 13189 15 7.6 131.8 1.0X -after 1582, vec off, rebase CORRECTED 13080 13115 34 7.6 130.8 1.0X -after 1582, vec on, rebase EXCEPTION 3698 3726 29 27.0 37.0 3.5X -after 1582, vec on, rebase LEGACY 3730 3745 17 26.8 37.3 3.5X -after 1582, vec on, rebase CORRECTED 3714 3758 75 26.9 37.1 3.5X -before 1582, vec off, rebase LEGACY 13519 13575 63 7.4 135.2 1.0X -before 1582, vec off, rebase CORRECTED 13210 13309 108 7.6 132.1 1.0X -before 1582, vec on, rebase LEGACY 4459 4488 44 22.4 44.6 2.9X -before 1582, vec on, rebase CORRECTED 3661 3718 88 27.3 36.6 3.6X - -OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +after 1582, vec off, rebase EXCEPTION 18452 18602 146 5.4 184.5 1.0X +after 1582, vec off, rebase LEGACY 18570 18609 36 5.4 185.7 1.0X +after 1582, vec off, rebase CORRECTED 18432 18646 191 5.4 184.3 1.0X +after 1582, vec on, rebase EXCEPTION 4473 4581 120 22.4 44.7 4.1X +after 1582, vec on, rebase LEGACY 4449 4548 87 22.5 44.5 4.1X +after 1582, vec on, rebase CORRECTED 4409 4435 32 22.7 44.1 4.2X +before 1582, vec off, rebase LEGACY 19835 19969 116 5.0 198.4 0.9X +before 1582, vec off, rebase CORRECTED 19035 19054 29 5.3 190.4 1.0X +before 1582, vec on, rebase LEGACY 5843 5929 91 17.1 58.4 3.2X +before 1582, vec on, rebase CORRECTED 4274 4347 74 23.4 42.7 4.3X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Save TIMESTAMP_INT96 to parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1900, noop 2900 2900 0 34.5 29.0 1.0X -before 1900, noop 2848 2848 0 35.1 28.5 1.0X -after 1900, rebase EXCEPTION 27623 27623 0 3.6 276.2 0.1X -after 1900, rebase LEGACY 27305 27305 0 3.7 273.0 0.1X -after 1900, rebase CORRECTED 27715 27715 0 3.6 277.2 0.1X -before 1900, rebase LEGACY 30911 30911 0 3.2 309.1 0.1X -before 1900, rebase CORRECTED 27944 27944 0 3.6 279.4 0.1X - -OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +after 1900, noop 3409 3409 0 29.3 34.1 1.0X +before 1900, noop 3664 3664 0 27.3 36.6 0.9X +after 1900, rebase EXCEPTION 33008 33008 0 3.0 330.1 0.1X +after 1900, rebase LEGACY 32753 32753 0 3.1 327.5 0.1X +after 1900, rebase CORRECTED 34472 34472 0 2.9 344.7 0.1X +before 1900, rebase LEGACY 38110 38110 0 2.6 381.1 0.1X +before 1900, rebase CORRECTED 35285 35285 0 2.8 352.9 0.1X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Load TIMESTAMP_INT96 from parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1900, vec off, rebase EXCEPTION 16853 16885 41 5.9 168.5 1.0X -after 1900, vec off, rebase LEGACY 16804 16816 21 6.0 168.0 1.0X -after 1900, vec off, rebase CORRECTED 16985 17020 58 5.9 169.9 1.0X -after 1900, vec on, rebase EXCEPTION 7044 7063 19 14.2 70.4 2.4X -after 1900, vec on, rebase LEGACY 7183 7255 94 13.9 71.8 2.3X -after 1900, vec on, rebase CORRECTED 7047 7137 86 14.2 70.5 2.4X -before 1900, vec off, rebase LEGACY 20371 20458 81 4.9 203.7 0.8X -before 1900, vec off, rebase CORRECTED 17484 17541 54 5.7 174.8 1.0X -before 1900, vec on, rebase LEGACY 10284 10327 45 9.7 102.8 1.6X -before 1900, vec on, rebase CORRECTED 7044 7073 37 14.2 70.4 2.4X - -OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +after 1900, vec off, rebase EXCEPTION 27084 27321 216 3.7 270.8 1.0X +after 1900, vec off, rebase LEGACY 26556 27280 630 3.8 265.6 1.0X +after 1900, vec off, rebase CORRECTED 26710 27071 319 3.7 267.1 1.0X +after 1900, vec on, rebase EXCEPTION 8552 8693 168 11.7 85.5 3.2X +after 1900, vec on, rebase LEGACY 8853 8866 12 11.3 88.5 3.1X +after 1900, vec on, rebase CORRECTED 8161 8327 221 12.3 81.6 3.3X +before 1900, vec off, rebase LEGACY 30156 30951 702 3.3 301.6 0.9X +before 1900, vec off, rebase CORRECTED 27258 27418 139 3.7 272.6 1.0X +before 1900, vec on, rebase LEGACY 12023 12086 89 8.3 120.2 2.3X +before 1900, vec on, rebase CORRECTED 8546 8554 6 11.7 85.5 3.2X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Save TIMESTAMP_MICROS to parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1900, noop 2848 2848 0 35.1 28.5 1.0X -before 1900, noop 2855 2855 0 35.0 28.6 1.0X -after 1900, rebase EXCEPTION 15622 15622 0 6.4 156.2 0.2X -after 1900, rebase LEGACY 16148 16148 0 6.2 161.5 0.2X -after 1900, rebase CORRECTED 16946 16946 0 5.9 169.5 0.2X -before 1900, rebase LEGACY 19486 19486 0 5.1 194.9 0.1X -before 1900, rebase CORRECTED 17029 17029 0 5.9 170.3 0.2X - -OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +after 1900, noop 3765 3765 0 26.6 37.7 1.0X +before 1900, noop 3563 3563 0 28.1 35.6 1.1X +after 1900, rebase EXCEPTION 21884 21884 0 4.6 218.8 0.2X +after 1900, rebase LEGACY 23126 23126 0 4.3 231.3 0.2X +after 1900, rebase CORRECTED 24592 24592 0 4.1 245.9 0.2X +before 1900, rebase LEGACY 27854 27854 0 3.6 278.5 0.1X +before 1900, rebase CORRECTED 24708 24708 0 4.0 247.1 0.2X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Load TIMESTAMP_MICROS from parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1900, vec off, rebase EXCEPTION 15785 15848 56 6.3 157.9 1.0X -after 1900, vec off, rebase LEGACY 15935 15954 17 6.3 159.3 1.0X -after 1900, vec off, rebase CORRECTED 15976 16046 62 6.3 159.8 1.0X -after 1900, vec on, rebase EXCEPTION 4925 4941 20 20.3 49.3 3.2X -after 1900, vec on, rebase LEGACY 5033 5041 11 19.9 50.3 3.1X -after 1900, vec on, rebase CORRECTED 4946 4972 29 20.2 49.5 3.2X -before 1900, vec off, rebase LEGACY 18619 18782 176 5.4 186.2 0.8X -before 1900, vec off, rebase CORRECTED 15956 16018 56 6.3 159.6 1.0X -before 1900, vec on, rebase LEGACY 8461 8472 14 11.8 84.6 1.9X -before 1900, vec on, rebase CORRECTED 4953 4962 12 20.2 49.5 3.2X - -OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +after 1900, vec off, rebase EXCEPTION 21394 21679 253 4.7 213.9 1.0X +after 1900, vec off, rebase LEGACY 21749 21763 12 4.6 217.5 1.0X +after 1900, vec off, rebase CORRECTED 22065 22265 188 4.5 220.7 1.0X +after 1900, vec on, rebase EXCEPTION 6613 6766 218 15.1 66.1 3.2X +after 1900, vec on, rebase LEGACY 6134 6243 143 16.3 61.3 3.5X +after 1900, vec on, rebase CORRECTED 6332 6368 54 15.8 63.3 3.4X +before 1900, vec off, rebase LEGACY 24196 24829 579 4.1 242.0 0.9X +before 1900, vec off, rebase CORRECTED 21725 22006 286 4.6 217.3 1.0X +before 1900, vec on, rebase LEGACY 9491 9774 250 10.5 94.9 2.3X +before 1900, vec on, rebase CORRECTED 6136 6229 93 16.3 61.4 3.5X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Save TIMESTAMP_MILLIS to parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1900, noop 3019 3019 0 33.1 30.2 1.0X -before 1900, noop 2896 2896 0 34.5 29.0 1.0X -after 1900, rebase EXCEPTION 15525 15525 0 6.4 155.2 0.2X -after 1900, rebase LEGACY 15903 15903 0 6.3 159.0 0.2X -after 1900, rebase CORRECTED 16468 16468 0 6.1 164.7 0.2X -before 1900, rebase LEGACY 19620 19620 0 5.1 196.2 0.2X -before 1900, rebase CORRECTED 16470 16470 0 6.1 164.7 0.2X - -OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +after 1900, noop 3755 3755 0 26.6 37.5 1.0X +before 1900, noop 3619 3619 0 27.6 36.2 1.0X +after 1900, rebase EXCEPTION 21243 21243 0 4.7 212.4 0.2X +after 1900, rebase LEGACY 21808 21808 0 4.6 218.1 0.2X +after 1900, rebase CORRECTED 22194 22194 0 4.5 221.9 0.2X +before 1900, rebase LEGACY 26637 26637 0 3.8 266.4 0.1X +before 1900, rebase CORRECTED 22130 22130 0 4.5 221.3 0.2X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Load TIMESTAMP_MILLIS from parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1900, vec off, rebase EXCEPTION 16329 16357 26 6.1 163.3 1.0X -after 1900, vec off, rebase LEGACY 16609 16659 51 6.0 166.1 1.0X -after 1900, vec off, rebase CORRECTED 16659 16765 91 6.0 166.6 1.0X -after 1900, vec on, rebase EXCEPTION 6132 6162 28 16.3 61.3 2.7X -after 1900, vec on, rebase LEGACY 6344 6397 61 15.8 63.4 2.6X -after 1900, vec on, rebase CORRECTED 6023 6024 2 16.6 60.2 2.7X -before 1900, vec off, rebase LEGACY 19611 19626 13 5.1 196.1 0.8X -before 1900, vec off, rebase CORRECTED 16765 16784 19 6.0 167.7 1.0X -before 1900, vec on, rebase LEGACY 9136 9158 19 10.9 91.4 1.8X -before 1900, vec on, rebase CORRECTED 6023 6042 30 16.6 60.2 2.7X +after 1900, vec off, rebase EXCEPTION 21977 22216 207 4.6 219.8 1.0X +after 1900, vec off, rebase LEGACY 21929 22352 370 4.6 219.3 1.0X +after 1900, vec off, rebase CORRECTED 22644 22788 171 4.4 226.4 1.0X +after 1900, vec on, rebase EXCEPTION 7719 7818 101 13.0 77.2 2.8X +after 1900, vec on, rebase LEGACY 7736 7800 88 12.9 77.4 2.8X +after 1900, vec on, rebase CORRECTED 7896 8002 107 12.7 79.0 2.8X +before 1900, vec off, rebase LEGACY 25595 25846 218 3.9 255.9 0.9X +before 1900, vec off, rebase CORRECTED 22795 23167 550 4.4 227.9 1.0X +before 1900, vec on, rebase LEGACY 10800 10859 60 9.3 108.0 2.0X +before 1900, vec on, rebase CORRECTED 7546 7635 82 13.3 75.5 2.9X ================================================================================================ Rebasing dates/timestamps in ORC datasource ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Save DATE to ORC: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1582, noop 20934 20934 0 4.8 209.3 1.0X -before 1582, noop 11098 11098 0 9.0 111.0 1.9X -after 1582 29249 29249 0 3.4 292.5 0.7X -before 1582 20059 20059 0 5.0 200.6 1.0X +after 1582, noop 25059 25059 0 4.0 250.6 1.0X +before 1582, noop 12893 12893 0 7.8 128.9 1.9X +after 1582 32469 32469 0 3.1 324.7 0.8X +before 1582 25104 25104 0 4.0 251.0 1.0X -OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Load DATE from ORC: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1582, vec off 10751 10802 56 9.3 107.5 1.0X -after 1582, vec on 3815 3870 62 26.2 38.1 2.8X -before 1582, vec off 11144 11174 37 9.0 111.4 1.0X -before 1582, vec on 4120 4126 8 24.3 41.2 2.6X +after 1582, vec off 11382 11543 194 8.8 113.8 1.0X +after 1582, vec on 4964 5042 99 20.1 49.6 2.3X +before 1582, vec off 12443 12478 31 8.0 124.4 0.9X +before 1582, vec on 5685 5724 34 17.6 56.9 2.0X -OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Save TIMESTAMP to ORC: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1900, noop 2858 2858 0 35.0 28.6 1.0X -before 1900, noop 2859 2859 0 35.0 28.6 1.0X -after 1900 17098 17098 0 5.8 171.0 0.2X -before 1900 20639 20639 0 4.8 206.4 0.1X +after 1900, noop 3528 3528 0 28.3 35.3 1.0X +before 1900, noop 3536 3536 0 28.3 35.4 1.0X +after 1900 19807 19807 0 5.0 198.1 0.2X +before 1900 28731 28731 0 3.5 287.3 0.1X -OpenJDK 64-Bit Server VM 11.0.8+10-post-Ubuntu-0ubuntu118.04.1 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Load TIMESTAMP from ORC: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1900, vec off 12292 12318 23 8.1 122.9 1.0X -after 1900, vec on 5198 5271 95 19.2 52.0 2.4X -before 1900, vec off 15108 15145 53 6.6 151.1 0.8X -before 1900, vec on 8085 8277 245 12.4 80.8 1.5X +after 1900, vec off 12936 13032 85 7.7 129.4 1.0X +after 1900, vec on 5957 6006 50 16.8 59.6 2.2X +before 1900, vec off 16065 16193 115 6.2 160.7 0.8X +before 1900, vec on 8611 8836 196 11.6 86.1 1.5X diff --git a/sql/core/benchmarks/DateTimeRebaseBenchmark-results.txt b/sql/core/benchmarks/DateTimeRebaseBenchmark-results.txt index 07b156a62e2ec..fe3efcabd7eb6 100644 --- a/sql/core/benchmarks/DateTimeRebaseBenchmark-results.txt +++ b/sql/core/benchmarks/DateTimeRebaseBenchmark-results.txt @@ -2,153 +2,153 @@ Rebasing dates/timestamps in Parquet datasource ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Save DATE to parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1582, noop 22736 22736 0 4.4 227.4 1.0X -before 1582, noop 10512 10512 0 9.5 105.1 2.2X -after 1582, rebase EXCEPTION 35759 35759 0 2.8 357.6 0.6X -after 1582, rebase LEGACY 36229 36229 0 2.8 362.3 0.6X -after 1582, rebase CORRECTED 35489 35489 0 2.8 354.9 0.6X -before 1582, rebase LEGACY 23514 23514 0 4.3 235.1 1.0X -before 1582, rebase CORRECTED 23234 23234 0 4.3 232.3 1.0X - -OpenJDK 64-Bit Server VM 1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +after 1582, noop 24145 24145 0 4.1 241.4 1.0X +before 1582, noop 9863 9863 0 10.1 98.6 2.4X +after 1582, rebase EXCEPTION 36123 36123 0 2.8 361.2 0.7X +after 1582, rebase LEGACY 36800 36800 0 2.7 368.0 0.7X +after 1582, rebase CORRECTED 37083 37083 0 2.7 370.8 0.7X +before 1582, rebase LEGACY 27894 27894 0 3.6 278.9 0.9X +before 1582, rebase CORRECTED 22720 22720 0 4.4 227.2 1.1X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Load DATE from parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1582, vec off, rebase EXCEPTION 13036 13121 85 7.7 130.4 1.0X -after 1582, vec off, rebase LEGACY 13567 13631 55 7.4 135.7 1.0X -after 1582, vec off, rebase CORRECTED 13476 13498 28 7.4 134.8 1.0X -after 1582, vec on, rebase EXCEPTION 3676 3679 3 27.2 36.8 3.5X -after 1582, vec on, rebase LEGACY 3842 3863 19 26.0 38.4 3.4X -after 1582, vec on, rebase CORRECTED 3706 3756 69 27.0 37.1 3.5X -before 1582, vec off, rebase LEGACY 13781 13832 68 7.3 137.8 0.9X -before 1582, vec off, rebase CORRECTED 13414 13445 28 7.5 134.1 1.0X -before 1582, vec on, rebase LEGACY 4774 4788 14 20.9 47.7 2.7X -before 1582, vec on, rebase CORRECTED 3650 3691 38 27.4 36.5 3.6X - -OpenJDK 64-Bit Server VM 1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +after 1582, vec off, rebase EXCEPTION 13975 14142 207 7.2 139.7 1.0X +after 1582, vec off, rebase LEGACY 14288 14464 165 7.0 142.9 1.0X +after 1582, vec off, rebase CORRECTED 14192 14398 332 7.0 141.9 1.0X +after 1582, vec on, rebase EXCEPTION 3418 3473 56 29.3 34.2 4.1X +after 1582, vec on, rebase LEGACY 3708 3794 91 27.0 37.1 3.8X +after 1582, vec on, rebase CORRECTED 3474 3542 67 28.8 34.7 4.0X +before 1582, vec off, rebase LEGACY 14162 14333 198 7.1 141.6 1.0X +before 1582, vec off, rebase CORRECTED 14201 14254 48 7.0 142.0 1.0X +before 1582, vec on, rebase LEGACY 4497 4538 70 22.2 45.0 3.1X +before 1582, vec on, rebase CORRECTED 3371 3420 46 29.7 33.7 4.1X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Save TIMESTAMP_INT96 to parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1900, noop 2696 2696 0 37.1 27.0 1.0X -before 1900, noop 2687 2687 0 37.2 26.9 1.0X -after 1900, rebase EXCEPTION 29085 29085 0 3.4 290.9 0.1X -after 1900, rebase LEGACY 29789 29789 0 3.4 297.9 0.1X -after 1900, rebase CORRECTED 29563 29563 0 3.4 295.6 0.1X -before 1900, rebase LEGACY 34033 34033 0 2.9 340.3 0.1X -before 1900, rebase CORRECTED 29687 29687 0 3.4 296.9 0.1X - -OpenJDK 64-Bit Server VM 1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +after 1900, noop 2359 2359 0 42.4 23.6 1.0X +before 1900, noop 2500 2500 0 40.0 25.0 0.9X +after 1900, rebase EXCEPTION 21442 21442 0 4.7 214.4 0.1X +after 1900, rebase LEGACY 21791 21791 0 4.6 217.9 0.1X +after 1900, rebase CORRECTED 22458 22458 0 4.5 224.6 0.1X +before 1900, rebase LEGACY 26749 26749 0 3.7 267.5 0.1X +before 1900, rebase CORRECTED 22908 22908 0 4.4 229.1 0.1X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Load TIMESTAMP_INT96 from parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1900, vec off, rebase EXCEPTION 16623 16711 78 6.0 166.2 1.0X -after 1900, vec off, rebase LEGACY 16525 16641 103 6.1 165.3 1.0X -after 1900, vec off, rebase CORRECTED 16698 16847 133 6.0 167.0 1.0X -after 1900, vec on, rebase EXCEPTION 8614 8723 97 11.6 86.1 1.9X -after 1900, vec on, rebase LEGACY 9790 9812 20 10.2 97.9 1.7X -after 1900, vec on, rebase CORRECTED 8607 8671 73 11.6 86.1 1.9X -before 1900, vec off, rebase LEGACY 21389 21553 142 4.7 213.9 0.8X -before 1900, vec off, rebase CORRECTED 17539 17545 6 5.7 175.4 0.9X -before 1900, vec on, rebase LEGACY 13594 13627 40 7.4 135.9 1.2X -before 1900, vec on, rebase CORRECTED 8620 8666 73 11.6 86.2 1.9X - -OpenJDK 64-Bit Server VM 1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +after 1900, vec off, rebase EXCEPTION 18065 18166 91 5.5 180.7 1.0X +after 1900, vec off, rebase LEGACY 17358 17602 217 5.8 173.6 1.0X +after 1900, vec off, rebase CORRECTED 17900 18615 1194 5.6 179.0 1.0X +after 1900, vec on, rebase EXCEPTION 8235 8301 100 12.1 82.3 2.2X +after 1900, vec on, rebase LEGACY 8295 8476 225 12.1 83.0 2.2X +after 1900, vec on, rebase CORRECTED 8128 8224 98 12.3 81.3 2.2X +before 1900, vec off, rebase LEGACY 21413 21906 507 4.7 214.1 0.8X +before 1900, vec off, rebase CORRECTED 18217 18288 103 5.5 182.2 1.0X +before 1900, vec on, rebase LEGACY 12115 12260 138 8.3 121.2 1.5X +before 1900, vec on, rebase CORRECTED 8742 8772 42 11.4 87.4 2.1X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Save TIMESTAMP_MICROS to parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1900, noop 2755 2755 0 36.3 27.5 1.0X -before 1900, noop 2819 2819 0 35.5 28.2 1.0X -after 1900, rebase EXCEPTION 16742 16742 0 6.0 167.4 0.2X -after 1900, rebase LEGACY 16978 16978 0 5.9 169.8 0.2X -after 1900, rebase CORRECTED 17508 17508 0 5.7 175.1 0.2X -before 1900, rebase LEGACY 21961 21961 0 4.6 219.6 0.1X -before 1900, rebase CORRECTED 17770 17770 0 5.6 177.7 0.2X - -OpenJDK 64-Bit Server VM 1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +after 1900, noop 2556 2556 0 39.1 25.6 1.0X +before 1900, noop 2619 2619 0 38.2 26.2 1.0X +after 1900, rebase EXCEPTION 18377 18377 0 5.4 183.8 0.1X +after 1900, rebase LEGACY 18986 18986 0 5.3 189.9 0.1X +after 1900, rebase CORRECTED 20329 20329 0 4.9 203.3 0.1X +before 1900, rebase LEGACY 24590 24590 0 4.1 245.9 0.1X +before 1900, rebase CORRECTED 19737 19737 0 5.1 197.4 0.1X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Load TIMESTAMP_MICROS from parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1900, vec off, rebase EXCEPTION 15311 15405 82 6.5 153.1 1.0X -after 1900, vec off, rebase LEGACY 15501 15578 73 6.5 155.0 1.0X -after 1900, vec off, rebase CORRECTED 15331 15472 123 6.5 153.3 1.0X -after 1900, vec on, rebase EXCEPTION 4976 5008 38 20.1 49.8 3.1X -after 1900, vec on, rebase LEGACY 5366 5443 67 18.6 53.7 2.9X -after 1900, vec on, rebase CORRECTED 4977 4982 9 20.1 49.8 3.1X -before 1900, vec off, rebase LEGACY 19205 19281 65 5.2 192.1 0.8X -before 1900, vec off, rebase CORRECTED 15458 15490 28 6.5 154.6 1.0X -before 1900, vec on, rebase LEGACY 9878 9933 79 10.1 98.8 1.5X -before 1900, vec on, rebase CORRECTED 4886 4961 66 20.5 48.9 3.1X - -OpenJDK 64-Bit Server VM 1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +after 1900, vec off, rebase EXCEPTION 16350 16622 272 6.1 163.5 1.0X +after 1900, vec off, rebase LEGACY 15887 16060 209 6.3 158.9 1.0X +after 1900, vec off, rebase CORRECTED 16156 16349 175 6.2 161.6 1.0X +after 1900, vec on, rebase EXCEPTION 4902 4922 32 20.4 49.0 3.3X +after 1900, vec on, rebase LEGACY 5245 5354 135 19.1 52.5 3.1X +after 1900, vec on, rebase CORRECTED 4905 5019 99 20.4 49.1 3.3X +before 1900, vec off, rebase LEGACY 19924 20162 240 5.0 199.2 0.8X +before 1900, vec off, rebase CORRECTED 16070 16180 162 6.2 160.7 1.0X +before 1900, vec on, rebase LEGACY 9381 9522 127 10.7 93.8 1.7X +before 1900, vec on, rebase CORRECTED 4942 4990 49 20.2 49.4 3.3X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Save TIMESTAMP_MILLIS to parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1900, noop 2836 2836 0 35.3 28.4 1.0X -before 1900, noop 2813 2813 0 35.6 28.1 1.0X -after 1900, rebase EXCEPTION 16549 16549 0 6.0 165.5 0.2X -after 1900, rebase LEGACY 16296 16296 0 6.1 163.0 0.2X -after 1900, rebase CORRECTED 16913 16913 0 5.9 169.1 0.2X -before 1900, rebase LEGACY 21150 21150 0 4.7 211.5 0.1X -before 1900, rebase CORRECTED 17090 17090 0 5.9 170.9 0.2X - -OpenJDK 64-Bit Server VM 1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +after 1900, noop 2583 2583 0 38.7 25.8 1.0X +before 1900, noop 2514 2514 0 39.8 25.1 1.0X +after 1900, rebase EXCEPTION 16857 16857 0 5.9 168.6 0.2X +after 1900, rebase LEGACY 17211 17211 0 5.8 172.1 0.2X +after 1900, rebase CORRECTED 18908 18908 0 5.3 189.1 0.1X +before 1900, rebase LEGACY 22901 22901 0 4.4 229.0 0.1X +before 1900, rebase CORRECTED 19047 19047 0 5.3 190.5 0.1X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Load TIMESTAMP_MILLIS from parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1900, vec off, rebase EXCEPTION 15706 15823 132 6.4 157.1 1.0X -after 1900, vec off, rebase LEGACY 16100 16194 88 6.2 161.0 1.0X -after 1900, vec off, rebase CORRECTED 16227 16282 81 6.2 162.3 1.0X -after 1900, vec on, rebase EXCEPTION 6383 6404 26 15.7 63.8 2.5X -after 1900, vec on, rebase LEGACY 6994 7006 15 14.3 69.9 2.2X -after 1900, vec on, rebase CORRECTED 6580 6597 15 15.2 65.8 2.4X -before 1900, vec off, rebase LEGACY 19601 19674 82 5.1 196.0 0.8X -before 1900, vec off, rebase CORRECTED 16188 16215 25 6.2 161.9 1.0X -before 1900, vec on, rebase LEGACY 10305 10360 51 9.7 103.1 1.5X -before 1900, vec on, rebase CORRECTED 6573 6600 28 15.2 65.7 2.4X +after 1900, vec off, rebase EXCEPTION 16820 16922 116 5.9 168.2 1.0X +after 1900, vec off, rebase LEGACY 17201 17547 406 5.8 172.0 1.0X +after 1900, vec off, rebase CORRECTED 17087 17321 220 5.9 170.9 1.0X +after 1900, vec on, rebase EXCEPTION 6204 6237 55 16.1 62.0 2.7X +after 1900, vec on, rebase LEGACY 6853 6887 51 14.6 68.5 2.5X +after 1900, vec on, rebase CORRECTED 6388 6509 193 15.7 63.9 2.6X +before 1900, vec off, rebase LEGACY 20223 20522 454 4.9 202.2 0.8X +before 1900, vec off, rebase CORRECTED 16680 17002 330 6.0 166.8 1.0X +before 1900, vec on, rebase LEGACY 9893 10044 162 10.1 98.9 1.7X +before 1900, vec on, rebase CORRECTED 6381 6486 140 15.7 63.8 2.6X ================================================================================================ Rebasing dates/timestamps in ORC datasource ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Save DATE to ORC: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1582, noop 22766 22766 0 4.4 227.7 1.0X -before 1582, noop 10535 10535 0 9.5 105.3 2.2X -after 1582 31037 31037 0 3.2 310.4 0.7X -before 1582 19755 19755 0 5.1 197.6 1.2X +after 1582, noop 24733 24733 0 4.0 247.3 1.0X +before 1582, noop 10658 10658 0 9.4 106.6 2.3X +after 1582 34442 34442 0 2.9 344.4 0.7X +before 1582 20847 20847 0 4.8 208.5 1.2X -OpenJDK 64-Bit Server VM 1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Load DATE from ORC: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1582, vec off 11137 11165 37 9.0 111.4 1.0X -after 1582, vec on 3701 3734 51 27.0 37.0 3.0X -before 1582, vec off 11379 11409 50 8.8 113.8 1.0X -before 1582, vec on 4110 4160 57 24.3 41.1 2.7X +after 1582, vec off 10339 10498 180 9.7 103.4 1.0X +after 1582, vec on 3812 3825 18 26.2 38.1 2.7X +before 1582, vec off 11374 11531 150 8.8 113.7 0.9X +before 1582, vec on 4387 4641 424 22.8 43.9 2.4X -OpenJDK 64-Bit Server VM 1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Save TIMESTAMP to ORC: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1900, noop 2830 2830 0 35.3 28.3 1.0X -before 1900, noop 2867 2867 0 34.9 28.7 1.0X -after 1900 17867 17867 0 5.6 178.7 0.2X -before 1900 21555 21555 0 4.6 215.6 0.1X +after 1900, noop 2709 2709 0 36.9 27.1 1.0X +before 1900, noop 2563 2563 0 39.0 25.6 1.1X +after 1900 18967 18967 0 5.3 189.7 0.1X +before 1900 21109 21109 0 4.7 211.1 0.1X -OpenJDK 64-Bit Server VM 1.8.0_265-8u265-b01-0ubuntu2~18.04-b01 on Linux 5.3.0-1034-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Load TIMESTAMP from ORC: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -after 1900, vec off 12245 12269 24 8.2 122.5 1.0X -after 1900, vec on 5258 5303 63 19.0 52.6 2.3X -before 1900, vec off 15698 15777 119 6.4 157.0 0.8X -before 1900, vec on 8568 8674 138 11.7 85.7 1.4X +after 1900, vec off 11339 11393 86 8.8 113.4 1.0X +after 1900, vec on 5269 5298 47 19.0 52.7 2.2X +before 1900, vec off 14399 14551 241 6.9 144.0 0.8X +before 1900, vec on 8171 8266 97 12.2 81.7 1.4X diff --git a/sql/core/benchmarks/ExternalAppendOnlyUnsafeRowArrayBenchmark-jdk11-results.txt b/sql/core/benchmarks/ExternalAppendOnlyUnsafeRowArrayBenchmark-jdk11-results.txt index 4f50a894e5c07..373bf2db133c6 100644 --- a/sql/core/benchmarks/ExternalAppendOnlyUnsafeRowArrayBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/ExternalAppendOnlyUnsafeRowArrayBenchmark-jdk11-results.txt @@ -2,44 +2,44 @@ WITHOUT SPILL ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Array with 100000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ArrayBuffer 5371 5392 30 19.1 52.5 1.0X -ExternalAppendOnlyUnsafeRowArray 6724 6778 77 15.2 65.7 0.8X +ArrayBuffer 5039 5085 65 20.3 49.2 1.0X +ExternalAppendOnlyUnsafeRowArray 7524 7584 85 13.6 73.5 0.7X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Array with 1000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ArrayBuffer 9120 9121 1 28.7 34.8 1.0X -ExternalAppendOnlyUnsafeRowArray 37713 37739 38 7.0 143.9 0.2X +ArrayBuffer 10509 10609 141 24.9 40.1 1.0X +ExternalAppendOnlyUnsafeRowArray 29307 29477 239 8.9 111.8 0.4X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Array with 30000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ArrayBuffer 18037 18052 21 27.3 36.7 1.0X -ExternalAppendOnlyUnsafeRowArray 34726 34771 63 14.2 70.7 0.5X +ArrayBuffer 21699 21794 134 22.7 44.1 1.0X +ExternalAppendOnlyUnsafeRowArray 38614 38681 94 12.7 78.6 0.6X ================================================================================================ WITH SPILL ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Spilling with 1000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -UnsafeExternalSorter 29668 29676 11 8.8 113.2 1.0X -ExternalAppendOnlyUnsafeRowArray 12658 12663 6 20.7 48.3 2.3X +UnsafeExternalSorter 26214 26230 22 10.0 100.0 1.0X +ExternalAppendOnlyUnsafeRowArray 12670 12678 12 20.7 48.3 2.1X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Spilling with 10000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -UnsafeExternalSorter 12 12 0 13.8 72.7 1.0X -ExternalAppendOnlyUnsafeRowArray 8 8 0 19.8 50.6 1.4X +UnsafeExternalSorter 10 11 1 15.9 62.9 1.0X +ExternalAppendOnlyUnsafeRowArray 8 8 1 21.3 47.0 1.3X diff --git a/sql/core/benchmarks/ExternalAppendOnlyUnsafeRowArrayBenchmark-results.txt b/sql/core/benchmarks/ExternalAppendOnlyUnsafeRowArrayBenchmark-results.txt index c4be80af1334b..88702951f3353 100644 --- a/sql/core/benchmarks/ExternalAppendOnlyUnsafeRowArrayBenchmark-results.txt +++ b/sql/core/benchmarks/ExternalAppendOnlyUnsafeRowArrayBenchmark-results.txt @@ -2,44 +2,44 @@ WITHOUT SPILL ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Array with 100000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ArrayBuffer 7626 7776 212 13.4 74.5 1.0X -ExternalAppendOnlyUnsafeRowArray 8432 8498 93 12.1 82.3 0.9X +ArrayBuffer 5579 5669 128 18.4 54.5 1.0X +ExternalAppendOnlyUnsafeRowArray 5589 5591 2 18.3 54.6 1.0X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Array with 1000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ArrayBuffer 11753 11763 15 22.3 44.8 1.0X -ExternalAppendOnlyUnsafeRowArray 38921 39236 446 6.7 148.5 0.3X +ArrayBuffer 12989 13075 122 20.2 49.5 1.0X +ExternalAppendOnlyUnsafeRowArray 29432 29595 231 8.9 112.3 0.4X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Array with 30000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -ArrayBuffer 23820 23829 12 20.6 48.5 1.0X -ExternalAppendOnlyUnsafeRowArray 33449 33466 25 14.7 68.1 0.7X +ArrayBuffer 25378 25500 171 19.4 51.6 1.0X +ExternalAppendOnlyUnsafeRowArray 29897 30232 474 16.4 60.8 0.8X ================================================================================================ WITH SPILL ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Spilling with 1000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -UnsafeExternalSorter 31384 31479 135 8.4 119.7 1.0X -ExternalAppendOnlyUnsafeRowArray 15278 15303 35 17.2 58.3 2.1X +UnsafeExternalSorter 26731 27063 469 9.8 102.0 1.0X +ExternalAppendOnlyUnsafeRowArray 14471 14653 258 18.1 55.2 1.8X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Spilling with 10000 rows: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -UnsafeExternalSorter 11 11 1 14.7 68.0 1.0X -ExternalAppendOnlyUnsafeRowArray 9 10 1 17.1 58.5 1.2X +UnsafeExternalSorter 9 11 2 18.1 55.1 1.0X +ExternalAppendOnlyUnsafeRowArray 9 9 1 18.7 53.5 1.0X diff --git a/sql/core/benchmarks/ExtractBenchmark-jdk11-results.txt b/sql/core/benchmarks/ExtractBenchmark-jdk11-results.txt index 77f1bdb5eaee0..3466d35680352 100644 --- a/sql/core/benchmarks/ExtractBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/ExtractBenchmark-jdk11-results.txt @@ -1,104 +1,104 @@ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Mac OS X 10.15.4 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Invoke extract for timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to timestamp 333 345 13 30.0 33.3 1.0X -YEAR of timestamp 826 840 16 12.1 82.6 0.4X -YEAROFWEEK of timestamp 1161 1168 7 8.6 116.1 0.3X -QUARTER of timestamp 961 966 6 10.4 96.1 0.3X -MONTH of timestamp 831 838 6 12.0 83.1 0.4X -WEEK of timestamp 1155 1159 4 8.7 115.5 0.3X -DAY of timestamp 822 828 6 12.2 82.2 0.4X -DAYOFWEEK of timestamp 968 972 6 10.3 96.8 0.3X -DOW of timestamp 960 966 9 10.4 96.0 0.3X -DOW_ISO of timestamp 961 967 9 10.4 96.1 0.3X -DAYOFWEEK_ISO of timestamp 965 968 5 10.4 96.5 0.3X -DOY of timestamp 864 873 9 11.6 86.4 0.4X -HOUR of timestamp 631 647 14 15.9 63.1 0.5X -MINUTE of timestamp 638 651 12 15.7 63.8 0.5X -SECOND of timestamp 758 760 2 13.2 75.8 0.4X +cast to timestamp 301 311 8 33.2 30.1 1.0X +YEAR of timestamp 930 1003 68 10.8 93.0 0.3X +YEAROFWEEK of timestamp 1019 1091 63 9.8 101.9 0.3X +QUARTER of timestamp 1151 1228 67 8.7 115.1 0.3X +MONTH of timestamp 987 1033 42 10.1 98.7 0.3X +WEEK of timestamp 1372 1449 67 7.3 137.2 0.2X +DAY of timestamp 1015 1040 22 9.8 101.5 0.3X +DAYOFWEEK of timestamp 1155 1223 59 8.7 115.5 0.3X +DOW of timestamp 1090 1170 82 9.2 109.0 0.3X +DOW_ISO of timestamp 1059 1143 93 9.4 105.9 0.3X +DAYOFWEEK_ISO of timestamp 1060 1118 51 9.4 106.0 0.3X +DOY of timestamp 958 1050 81 10.4 95.8 0.3X +HOUR of timestamp 803 817 25 12.5 80.3 0.4X +MINUTE of timestamp 707 742 30 14.1 70.7 0.4X +SECOND of timestamp 901 934 44 11.1 90.1 0.3X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Mac OS X 10.15.4 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Invoke date_part for timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to timestamp 301 307 8 33.2 30.1 1.0X -YEAR of timestamp 797 805 7 12.6 79.7 0.4X -YEAROFWEEK of timestamp 1147 1156 8 8.7 114.7 0.3X -QUARTER of timestamp 965 974 9 10.4 96.5 0.3X -MONTH of timestamp 801 815 17 12.5 80.1 0.4X -WEEK of timestamp 1133 1157 21 8.8 113.3 0.3X -DAY of timestamp 825 828 4 12.1 82.5 0.4X -DAYOFWEEK of timestamp 929 937 8 10.8 92.9 0.3X -DOW of timestamp 933 940 11 10.7 93.3 0.3X -DOW_ISO of timestamp 944 954 11 10.6 94.4 0.3X -DAYOFWEEK_ISO of timestamp 948 965 21 10.5 94.8 0.3X -DOY of timestamp 894 898 6 11.2 89.4 0.3X -HOUR of timestamp 678 683 6 14.7 67.8 0.4X -MINUTE of timestamp 669 670 2 15.0 66.9 0.5X -SECOND of timestamp 762 771 12 13.1 76.2 0.4X +cast to timestamp 345 349 5 29.0 34.5 1.0X +YEAR of timestamp 1050 1083 39 9.5 105.0 0.3X +YEAROFWEEK of timestamp 1125 1141 14 8.9 112.5 0.3X +QUARTER of timestamp 1103 1218 132 9.1 110.3 0.3X +MONTH of timestamp 992 1008 28 10.1 99.2 0.3X +WEEK of timestamp 1334 1403 101 7.5 133.4 0.3X +DAY of timestamp 1001 1059 52 10.0 100.1 0.3X +DAYOFWEEK of timestamp 1094 1177 77 9.1 109.4 0.3X +DOW of timestamp 1052 1128 67 9.5 105.2 0.3X +DOW_ISO of timestamp 1124 1165 39 8.9 112.4 0.3X +DAYOFWEEK_ISO of timestamp 1015 1125 101 9.9 101.5 0.3X +DOY of timestamp 1027 1080 49 9.7 102.7 0.3X +HOUR of timestamp 779 818 34 12.8 77.9 0.4X +MINUTE of timestamp 757 770 19 13.2 75.7 0.5X +SECOND of timestamp 862 898 33 11.6 86.2 0.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Mac OS X 10.15.4 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Invoke extract for date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to date 737 751 23 13.6 73.7 1.0X -YEAR of date 804 811 11 12.4 80.4 0.9X -YEAROFWEEK of date 1151 1155 4 8.7 115.1 0.6X -QUARTER of date 964 987 26 10.4 96.4 0.8X -MONTH of date 831 835 6 12.0 83.1 0.9X -WEEK of date 1162 1163 2 8.6 116.2 0.6X -DAY of date 826 833 7 12.1 82.6 0.9X -DAYOFWEEK of date 984 1003 26 10.2 98.4 0.7X -DOW of date 995 997 2 10.0 99.5 0.7X -DOW_ISO of date 985 992 8 10.2 98.5 0.7X -DAYOFWEEK_ISO of date 985 1001 19 10.1 98.5 0.7X -DOY of date 884 890 8 11.3 88.4 0.8X -HOUR of date 1630 1640 13 6.1 163.0 0.5X -MINUTE of date 1631 1636 6 6.1 163.1 0.5X -SECOND of date 1737 1739 2 5.8 173.7 0.4X +cast to date 885 922 35 11.3 88.5 1.0X +YEAR of date 1100 1103 3 9.1 110.0 0.8X +YEAROFWEEK of date 1030 1076 56 9.7 103.0 0.9X +QUARTER of date 1065 1160 82 9.4 106.5 0.8X +MONTH of date 937 989 78 10.7 93.7 0.9X +WEEK of date 1389 1479 79 7.2 138.9 0.6X +DAY of date 927 997 82 10.8 92.7 1.0X +DAYOFWEEK of date 1111 1199 76 9.0 111.1 0.8X +DOW of date 1041 1149 94 9.6 104.1 0.8X +DOW_ISO of date 1049 1076 34 9.5 104.9 0.8X +DAYOFWEEK_ISO of date 1084 1134 62 9.2 108.4 0.8X +DOY of date 1042 1079 43 9.6 104.2 0.8X +HOUR of date 1792 1829 32 5.6 179.2 0.5X +MINUTE of date 1773 1827 60 5.6 177.3 0.5X +SECOND of date 2066 2085 18 4.8 206.6 0.4X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Mac OS X 10.15.4 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Invoke date_part for date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to date 746 753 8 13.4 74.6 1.0X -YEAR of date 841 843 1 11.9 84.1 0.9X -YEAROFWEEK of date 1169 1191 20 8.6 116.9 0.6X -QUARTER of date 1008 1012 4 9.9 100.8 0.7X -MONTH of date 838 844 6 11.9 83.8 0.9X -WEEK of date 1179 1182 3 8.5 117.9 0.6X -DAY of date 849 850 1 11.8 84.9 0.9X -DAYOFWEEK of date 984 988 4 10.2 98.4 0.8X -DOW of date 986 994 7 10.1 98.6 0.8X -DOW_ISO of date 974 992 17 10.3 97.4 0.8X -DAYOFWEEK_ISO of date 979 994 14 10.2 97.9 0.8X -DOY of date 874 878 3 11.4 87.4 0.9X -HOUR of date 1644 1649 6 6.1 164.4 0.5X -MINUTE of date 1610 1626 15 6.2 161.0 0.5X -SECOND of date 1768 1789 30 5.7 176.8 0.4X +cast to date 907 932 23 11.0 90.7 1.0X +YEAR of date 996 1041 55 10.0 99.6 0.9X +YEAROFWEEK of date 1032 1087 81 9.7 103.2 0.9X +QUARTER of date 1143 1193 82 8.7 114.3 0.8X +MONTH of date 953 1014 58 10.5 95.3 1.0X +WEEK of date 1260 1328 102 7.9 126.0 0.7X +DAY of date 907 927 18 11.0 90.7 1.0X +DAYOFWEEK of date 1071 1094 22 9.3 107.1 0.8X +DOW of date 1048 1077 40 9.5 104.8 0.9X +DOW_ISO of date 1024 1049 26 9.8 102.4 0.9X +DAYOFWEEK_ISO of date 1072 1082 16 9.3 107.2 0.8X +DOY of date 968 973 5 10.3 96.8 0.9X +HOUR of date 1628 1663 42 6.1 162.8 0.6X +MINUTE of date 1542 1620 69 6.5 154.2 0.6X +SECOND of date 1740 1769 33 5.7 174.0 0.5X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Mac OS X 10.15.4 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Invoke extract for interval: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to interval 989 1003 13 10.1 98.9 1.0X -YEAR of interval 980 999 16 10.2 98.0 1.0X -MONTH of interval 988 1000 15 10.1 98.8 1.0X -DAY of interval 970 983 11 10.3 97.0 1.0X -HOUR of interval 989 1000 13 10.1 98.9 1.0X -MINUTE of interval 1019 1034 13 9.8 101.9 1.0X -SECOND of interval 1084 1095 10 9.2 108.4 0.9X +cast to interval 1413 1431 21 7.1 141.3 1.0X +YEAR of interval 1386 1424 34 7.2 138.6 1.0X +MONTH of interval 1419 1434 17 7.0 141.9 1.0X +DAY of interval 1411 1428 15 7.1 141.1 1.0X +HOUR of interval 1444 1461 24 6.9 144.4 1.0X +MINUTE of interval 1435 1463 27 7.0 143.5 1.0X +SECOND of interval 1537 1565 30 6.5 153.7 0.9X -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Mac OS X 10.15.4 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Invoke date_part for interval: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to interval 955 969 15 10.5 95.5 1.0X -YEAR of interval 1004 1007 3 10.0 100.4 1.0X -MONTH of interval 989 990 2 10.1 98.9 1.0X -DAY of interval 1006 1011 6 9.9 100.6 0.9X -HOUR of interval 986 997 10 10.1 98.6 1.0X -MINUTE of interval 1004 1014 15 10.0 100.4 1.0X -SECOND of interval 1083 1088 6 9.2 108.3 0.9X +cast to interval 1434 1450 15 7.0 143.4 1.0X +YEAR of interval 1423 1443 18 7.0 142.3 1.0X +MONTH of interval 1432 1452 22 7.0 143.2 1.0X +DAY of interval 1451 1467 14 6.9 145.1 1.0X +HOUR of interval 1415 1431 23 7.1 141.5 1.0X +MINUTE of interval 1433 1458 36 7.0 143.3 1.0X +SECOND of interval 1543 1556 13 6.5 154.3 0.9X diff --git a/sql/core/benchmarks/ExtractBenchmark-results.txt b/sql/core/benchmarks/ExtractBenchmark-results.txt index 11144a0547e43..8587ee04564dd 100644 --- a/sql/core/benchmarks/ExtractBenchmark-results.txt +++ b/sql/core/benchmarks/ExtractBenchmark-results.txt @@ -1,104 +1,104 @@ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS X 10.15.4 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Invoke extract for timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to timestamp 292 310 16 34.3 29.2 1.0X -YEAR of timestamp 847 875 26 11.8 84.7 0.3X -YEAROFWEEK of timestamp 964 981 24 10.4 96.4 0.3X -QUARTER of timestamp 1217 1219 2 8.2 121.7 0.2X -MONTH of timestamp 835 844 10 12.0 83.5 0.3X -WEEK of timestamp 1173 1183 15 8.5 117.3 0.2X -DAY of timestamp 851 878 25 11.7 85.1 0.3X -DAYOFWEEK of timestamp 946 970 22 10.6 94.6 0.3X -DOW of timestamp 935 959 21 10.7 93.5 0.3X -DOW_ISO of timestamp 947 961 13 10.6 94.7 0.3X -DAYOFWEEK_ISO of timestamp 965 992 26 10.4 96.5 0.3X -DOY of timestamp 886 904 26 11.3 88.6 0.3X -HOUR of timestamp 697 700 4 14.3 69.7 0.4X -MINUTE of timestamp 654 665 10 15.3 65.4 0.4X -SECOND of timestamp 770 778 8 13.0 77.0 0.4X +cast to timestamp 400 407 7 25.0 40.0 1.0X +YEAR of timestamp 1031 1099 59 9.7 103.1 0.4X +YEAROFWEEK of timestamp 1134 1178 39 8.8 113.4 0.4X +QUARTER of timestamp 1179 1225 44 8.5 117.9 0.3X +MONTH of timestamp 1064 1092 33 9.4 106.4 0.4X +WEEK of timestamp 2260 2304 42 4.4 226.0 0.2X +DAY of timestamp 1124 1162 35 8.9 112.4 0.4X +DAYOFWEEK of timestamp 1225 1250 30 8.2 122.5 0.3X +DOW of timestamp 1231 1247 27 8.1 123.1 0.3X +DOW_ISO of timestamp 1196 1209 15 8.4 119.6 0.3X +DAYOFWEEK_ISO of timestamp 1222 1236 12 8.2 122.2 0.3X +DOY of timestamp 1091 1105 16 9.2 109.1 0.4X +HOUR of timestamp 836 854 31 12.0 83.6 0.5X +MINUTE of timestamp 803 837 34 12.5 80.3 0.5X +SECOND of timestamp 990 1025 46 10.1 99.0 0.4X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS X 10.15.4 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Invoke date_part for timestamp: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to timestamp 233 243 9 43.0 23.3 1.0X -YEAR of timestamp 810 826 15 12.3 81.0 0.3X -YEAROFWEEK of timestamp 996 1019 21 10.0 99.6 0.2X -QUARTER of timestamp 1037 1049 11 9.6 103.7 0.2X -MONTH of timestamp 822 852 30 12.2 82.2 0.3X -WEEK of timestamp 1179 1220 35 8.5 117.9 0.2X -DAY of timestamp 822 825 3 12.2 82.2 0.3X -DAYOFWEEK of timestamp 937 941 3 10.7 93.7 0.2X -DOW of timestamp 931 970 34 10.7 93.1 0.2X -DOW_ISO of timestamp 927 948 22 10.8 92.7 0.3X -DAYOFWEEK_ISO of timestamp 896 918 20 11.2 89.6 0.3X -DOY of timestamp 863 891 25 11.6 86.3 0.3X -HOUR of timestamp 639 645 6 15.7 63.9 0.4X -MINUTE of timestamp 639 647 12 15.7 63.9 0.4X -SECOND of timestamp 785 796 11 12.7 78.5 0.3X +cast to timestamp 378 387 10 26.5 37.8 1.0X +YEAR of timestamp 1089 1110 25 9.2 108.9 0.3X +YEAROFWEEK of timestamp 1223 1277 70 8.2 122.3 0.3X +QUARTER of timestamp 1322 1365 45 7.6 132.2 0.3X +MONTH of timestamp 1185 1195 10 8.4 118.5 0.3X +WEEK of timestamp 2187 2239 48 4.6 218.7 0.2X +DAY of timestamp 1087 1105 32 9.2 108.7 0.3X +DAYOFWEEK of timestamp 1223 1252 28 8.2 122.3 0.3X +DOW of timestamp 1294 1336 37 7.7 129.4 0.3X +DOW_ISO of timestamp 1259 1286 25 7.9 125.9 0.3X +DAYOFWEEK_ISO of timestamp 1200 1229 25 8.3 120.0 0.3X +DOY of timestamp 1084 1111 30 9.2 108.4 0.3X +HOUR of timestamp 829 878 43 12.1 82.9 0.5X +MINUTE of timestamp 809 839 26 12.4 80.9 0.5X +SECOND of timestamp 1069 1102 44 9.4 106.9 0.4X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS X 10.15.4 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Invoke extract for date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to date 690 693 3 14.5 69.0 1.0X -YEAR of date 822 841 17 12.2 82.2 0.8X -YEAROFWEEK of date 967 974 7 10.3 96.7 0.7X -QUARTER of date 1034 1044 11 9.7 103.4 0.7X -MONTH of date 831 836 5 12.0 83.1 0.8X -WEEK of date 1152 1177 34 8.7 115.2 0.6X -DAY of date 836 873 34 12.0 83.6 0.8X -DAYOFWEEK of date 960 992 30 10.4 96.0 0.7X -DOW of date 1011 1016 4 9.9 101.1 0.7X -DOW_ISO of date 969 984 16 10.3 96.9 0.7X -DAYOFWEEK_ISO of date 967 986 19 10.3 96.7 0.7X -DOY of date 901 953 47 11.1 90.1 0.8X -HOUR of date 1581 1586 5 6.3 158.1 0.4X -MINUTE of date 1570 1584 13 6.4 157.0 0.4X -SECOND of date 1713 1740 27 5.8 171.3 0.4X +cast to date 900 912 12 11.1 90.0 1.0X +YEAR of date 1112 1126 12 9.0 111.2 0.8X +YEAROFWEEK of date 1257 1271 17 8.0 125.7 0.7X +QUARTER of date 1177 1202 22 8.5 117.7 0.8X +MONTH of date 1053 1115 59 9.5 105.3 0.9X +WEEK of date 2232 2290 59 4.5 223.2 0.4X +DAY of date 1124 1136 11 8.9 112.4 0.8X +DAYOFWEEK of date 1247 1255 11 8.0 124.7 0.7X +DOW of date 1229 1275 40 8.1 122.9 0.7X +DOW_ISO of date 1175 1192 21 8.5 117.5 0.8X +DAYOFWEEK_ISO of date 1147 1172 24 8.7 114.7 0.8X +DOY of date 1087 1123 32 9.2 108.7 0.8X +HOUR of date 1603 1707 90 6.2 160.3 0.6X +MINUTE of date 1647 1704 49 6.1 164.7 0.5X +SECOND of date 1846 1879 39 5.4 184.6 0.5X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS X 10.15.4 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Invoke date_part for date: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to date 756 762 6 13.2 75.6 1.0X -YEAR of date 843 857 13 11.9 84.3 0.9X -YEAROFWEEK of date 1055 1065 16 9.5 105.5 0.7X -QUARTER of date 1066 1073 6 9.4 106.6 0.7X -MONTH of date 856 890 44 11.7 85.6 0.9X -WEEK of date 1155 1204 59 8.7 115.5 0.7X -DAY of date 749 762 12 13.3 74.9 1.0X -DAYOFWEEK of date 850 865 15 11.8 85.0 0.9X -DOW of date 878 893 16 11.4 87.8 0.9X -DOW_ISO of date 865 869 5 11.6 86.5 0.9X -DAYOFWEEK_ISO of date 914 967 76 10.9 91.4 0.8X -DOY of date 789 792 4 12.7 78.9 1.0X -HOUR of date 1558 1659 168 6.4 155.8 0.5X -MINUTE of date 1581 1673 80 6.3 158.1 0.5X -SECOND of date 1646 1881 319 6.1 164.6 0.5X +cast to date 846 889 37 11.8 84.6 1.0X +YEAR of date 1020 1071 46 9.8 102.0 0.8X +YEAROFWEEK of date 1288 1303 18 7.8 128.8 0.7X +QUARTER of date 1181 1201 22 8.5 118.1 0.7X +MONTH of date 1021 1076 48 9.8 102.1 0.8X +WEEK of date 2145 2186 42 4.7 214.5 0.4X +DAY of date 1084 1103 26 9.2 108.4 0.8X +DAYOFWEEK of date 1201 1233 41 8.3 120.1 0.7X +DOW of date 1246 1281 34 8.0 124.6 0.7X +DOW_ISO of date 1136 1141 4 8.8 113.6 0.7X +DAYOFWEEK_ISO of date 1209 1234 30 8.3 120.9 0.7X +DOY of date 1083 1144 57 9.2 108.3 0.8X +HOUR of date 1632 1654 24 6.1 163.2 0.5X +MINUTE of date 1681 1716 31 6.0 168.1 0.5X +SECOND of date 1838 1902 60 5.4 183.8 0.5X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS X 10.15.4 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Invoke extract for interval: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to interval 925 941 20 10.8 92.5 1.0X -YEAR of interval 903 919 14 11.1 90.3 1.0X -MONTH of interval 944 958 17 10.6 94.4 1.0X -DAY of interval 917 925 7 10.9 91.7 1.0X -HOUR of interval 925 940 17 10.8 92.5 1.0X -MINUTE of interval 951 962 12 10.5 95.1 1.0X -SECOND of interval 1017 1036 19 9.8 101.7 0.9X +cast to interval 1285 1304 16 7.8 128.5 1.0X +YEAR of interval 1356 1384 24 7.4 135.6 0.9X +MONTH of interval 1349 1370 19 7.4 134.9 1.0X +DAY of interval 1306 1345 51 7.7 130.6 1.0X +HOUR of interval 1351 1400 44 7.4 135.1 1.0X +MINUTE of interval 1339 1410 74 7.5 133.9 1.0X +SECOND of interval 1365 1402 32 7.3 136.5 0.9X -Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS X 10.15.4 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Invoke date_part for interval: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -cast to interval 913 920 8 11.0 91.3 1.0X -YEAR of interval 930 935 4 10.8 93.0 1.0X -MONTH of interval 930 943 14 10.7 93.0 1.0X -DAY of interval 933 946 12 10.7 93.3 1.0X -HOUR of interval 951 953 3 10.5 95.1 1.0X -MINUTE of interval 923 958 30 10.8 92.3 1.0X -SECOND of interval 993 995 1 10.1 99.3 0.9X +cast to interval 1274 1334 58 7.9 127.4 1.0X +YEAR of interval 1329 1359 27 7.5 132.9 1.0X +MONTH of interval 1310 1362 45 7.6 131.0 1.0X +DAY of interval 1473 1500 26 6.8 147.3 0.9X +HOUR of interval 1308 1369 57 7.6 130.8 1.0X +MINUTE of interval 1333 1379 76 7.5 133.3 1.0X +SECOND of interval 1423 1448 36 7.0 142.3 0.9X diff --git a/sql/core/benchmarks/FilterPushdownBenchmark-jdk11-results.txt b/sql/core/benchmarks/FilterPushdownBenchmark-jdk11-results.txt index d292607e2cbcb..9a8422ea88b73 100644 --- a/sql/core/benchmarks/FilterPushdownBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/FilterPushdownBenchmark-jdk11-results.txt @@ -2,669 +2,669 @@ Pushdown for many distinct value case ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 0 string row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 11943 12023 69 1.3 759.3 1.0X -Parquet Vectorized (Pushdown) 880 934 44 17.9 55.9 13.6X -Native ORC Vectorized 7847 7896 41 2.0 498.9 1.5X -Native ORC Vectorized (Pushdown) 507 525 22 31.0 32.3 23.5X +Parquet Vectorized 10512 10572 58 1.5 668.4 1.0X +Parquet Vectorized (Pushdown) 596 621 19 26.4 37.9 17.6X +Native ORC Vectorized 8555 8723 97 1.8 543.9 1.2X +Native ORC Vectorized (Pushdown) 592 609 11 26.6 37.7 17.8X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 0 string row ('7864320' < value < '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 12020 12040 13 1.3 764.2 1.0X -Parquet Vectorized (Pushdown) 819 840 24 19.2 52.0 14.7X -Native ORC Vectorized 8045 8062 14 2.0 511.5 1.5X -Native ORC Vectorized (Pushdown) 498 535 55 31.6 31.7 24.1X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +----------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 10406 10461 50 1.5 661.6 1.0X +Parquet Vectorized (Pushdown) 619 641 22 25.4 39.4 16.8X +Native ORC Vectorized 8787 8834 57 1.8 558.6 1.2X +Native ORC Vectorized (Pushdown) 592 608 11 26.6 37.6 17.6X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 1 string row (value = '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 12006 12028 21 1.3 763.3 1.0X -Parquet Vectorized (Pushdown) 772 800 25 20.4 49.1 15.6X -Native ORC Vectorized 8074 8091 15 1.9 513.3 1.5X -Native ORC Vectorized (Pushdown) 467 481 10 33.7 29.7 25.7X +Parquet Vectorized 10632 10694 60 1.5 676.0 1.0X +Parquet Vectorized (Pushdown) 608 635 22 25.9 38.6 17.5X +Native ORC Vectorized 8790 8838 37 1.8 558.9 1.2X +Native ORC Vectorized (Pushdown) 559 584 22 28.1 35.5 19.0X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 1 string row (value <=> '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 11995 12021 30 1.3 762.6 1.0X -Parquet Vectorized (Pushdown) 780 792 10 20.2 49.6 15.4X -Native ORC Vectorized 8046 8066 12 2.0 511.6 1.5X -Native ORC Vectorized (Pushdown) 476 489 13 33.0 30.3 25.2X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 10529 10624 74 1.5 669.4 1.0X +Parquet Vectorized (Pushdown) 613 631 16 25.7 39.0 17.2X +Native ORC Vectorized 8746 8816 63 1.8 556.1 1.2X +Native ORC Vectorized (Pushdown) 589 600 11 26.7 37.5 17.9X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 1 string row ('7864320' <= value <= '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 11967 11989 12 1.3 760.9 1.0X -Parquet Vectorized (Pushdown) 775 788 11 20.3 49.3 15.4X -Native ORC Vectorized 8028 8046 25 2.0 510.4 1.5X -Native ORC Vectorized (Pushdown) 461 493 29 34.1 29.3 26.0X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 10612 10696 110 1.5 674.7 1.0X +Parquet Vectorized (Pushdown) 621 635 13 25.3 39.5 17.1X +Native ORC Vectorized 8856 8901 59 1.8 563.0 1.2X +Native ORC Vectorized (Pushdown) 576 590 14 27.3 36.6 18.4X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select all string rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 21435 21513 46 0.7 1362.8 1.0X -Parquet Vectorized (Pushdown) 21710 21742 33 0.7 1380.3 1.0X -Native ORC Vectorized 19324 19373 35 0.8 1228.6 1.1X -Native ORC Vectorized (Pushdown) 19535 19572 40 0.8 1242.0 1.1X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +-------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 19970 20121 95 0.8 1269.7 1.0X +Parquet Vectorized (Pushdown) 20052 20137 73 0.8 1274.9 1.0X +Native ORC Vectorized 18242 18405 147 0.9 1159.8 1.1X +Native ORC Vectorized (Pushdown) 18595 18840 167 0.8 1182.2 1.1X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 0 int row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 11008 11034 21 1.4 699.9 1.0X -Parquet Vectorized (Pushdown) 762 767 6 20.6 48.4 14.4X -Native ORC Vectorized 7156 7186 58 2.2 454.9 1.5X -Native ORC Vectorized (Pushdown) 436 447 9 36.1 27.7 25.3X +Parquet Vectorized 9942 9996 56 1.6 632.1 1.0X +Parquet Vectorized (Pushdown) 594 613 23 26.5 37.7 16.7X +Native ORC Vectorized 7954 8180 173 2.0 505.7 1.2X +Native ORC Vectorized (Pushdown) 554 580 17 28.4 35.2 17.9X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 0 int row (7864320 < value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 10987 11033 38 1.4 698.5 1.0X -Parquet Vectorized (Pushdown) 766 776 11 20.5 48.7 14.4X -Native ORC Vectorized 7160 7192 35 2.2 455.2 1.5X -Native ORC Vectorized (Pushdown) 440 454 26 35.8 27.9 25.0X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +---------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 9987 10077 66 1.6 635.0 1.0X +Parquet Vectorized (Pushdown) 617 637 14 25.5 39.2 16.2X +Native ORC Vectorized 7995 8106 100 2.0 508.3 1.2X +Native ORC Vectorized (Pushdown) 565 587 18 27.8 36.0 17.7X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 1 int row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 11066 11082 19 1.4 703.6 1.0X -Parquet Vectorized (Pushdown) 749 770 15 21.0 47.6 14.8X -Native ORC Vectorized 7248 7294 57 2.2 460.8 1.5X -Native ORC Vectorized (Pushdown) 437 450 16 36.0 27.8 25.3X +Parquet Vectorized 10017 10097 92 1.6 636.9 1.0X +Parquet Vectorized (Pushdown) 598 615 13 26.3 38.0 16.8X +Native ORC Vectorized 8032 8102 62 2.0 510.7 1.2X +Native ORC Vectorized (Pushdown) 562 572 11 28.0 35.7 17.8X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 1 int row (value <=> 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 11066 11091 32 1.4 703.5 1.0X -Parquet Vectorized (Pushdown) 754 776 28 20.9 47.9 14.7X -Native ORC Vectorized 7257 7265 6 2.2 461.4 1.5X -Native ORC Vectorized (Pushdown) 449 457 7 35.0 28.6 24.6X +Parquet Vectorized 10076 10247 321 1.6 640.6 1.0X +Parquet Vectorized (Pushdown) 590 606 15 26.7 37.5 17.1X +Native ORC Vectorized 8101 8167 38 1.9 515.0 1.2X +Native ORC Vectorized (Pushdown) 566 580 15 27.8 36.0 17.8X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 1 int row (7864320 <= value <= 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 11067 11079 14 1.4 703.6 1.0X -Parquet Vectorized (Pushdown) 753 762 8 20.9 47.9 14.7X -Native ORC Vectorized 7251 7267 22 2.2 461.0 1.5X -Native ORC Vectorized (Pushdown) 427 435 6 36.8 27.2 25.9X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +------------------------------------------------------------------------------------------------------------------------------ +Parquet Vectorized 10031 10081 58 1.6 637.8 1.0X +Parquet Vectorized (Pushdown) 614 629 19 25.6 39.0 16.3X +Native ORC Vectorized 7980 8095 101 2.0 507.4 1.3X +Native ORC Vectorized (Pushdown) 551 561 10 28.5 35.0 18.2X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 1 int row (7864319 < value < 7864321): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 11055 11086 18 1.4 702.8 1.0X -Parquet Vectorized (Pushdown) 748 753 6 21.0 47.5 14.8X -Native ORC Vectorized 7227 7253 27 2.2 459.5 1.5X -Native ORC Vectorized (Pushdown) 429 435 5 36.7 27.3 25.8X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +---------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 10140 10183 39 1.6 644.7 1.0X +Parquet Vectorized (Pushdown) 606 618 13 25.9 38.6 16.7X +Native ORC Vectorized 8013 8104 90 2.0 509.5 1.3X +Native ORC Vectorized (Pushdown) 554 572 16 28.4 35.2 18.3X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 10% int rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 12060 12091 21 1.3 766.7 1.0X -Parquet Vectorized (Pushdown) 2799 2821 17 5.6 178.0 4.3X -Native ORC Vectorized 8334 8391 55 1.9 529.9 1.4X -Native ORC Vectorized (Pushdown) 2197 2209 12 7.2 139.7 5.5X +Parquet Vectorized 10876 10962 92 1.4 691.5 1.0X +Parquet Vectorized (Pushdown) 2507 2538 29 6.3 159.4 4.3X +Native ORC Vectorized 9090 9177 83 1.7 577.9 1.2X +Native ORC Vectorized (Pushdown) 2228 2289 65 7.1 141.7 4.9X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 50% int rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 15593 15619 22 1.0 991.3 1.0X -Parquet Vectorized (Pushdown) 10573 10584 10 1.5 672.2 1.5X -Native ORC Vectorized 12276 12290 16 1.3 780.5 1.3X -Native ORC Vectorized (Pushdown) 8931 8958 31 1.8 567.8 1.7X +Parquet Vectorized 14221 14357 129 1.1 904.2 1.0X +Parquet Vectorized (Pushdown) 9631 9713 62 1.6 612.4 1.5X +Native ORC Vectorized 12437 12586 92 1.3 790.7 1.1X +Native ORC Vectorized (Pushdown) 8802 8891 89 1.8 559.6 1.6X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 90% int rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 19094 19120 23 0.8 1214.0 1.0X -Parquet Vectorized (Pushdown) 18327 18342 14 0.9 1165.2 1.0X -Native ORC Vectorized 15890 15943 44 1.0 1010.2 1.2X -Native ORC Vectorized (Pushdown) 15414 15442 24 1.0 980.0 1.2X +Parquet Vectorized 17521 17720 209 0.9 1114.0 1.0X +Parquet Vectorized (Pushdown) 16711 16780 66 0.9 1062.5 1.0X +Native ORC Vectorized 15743 15909 108 1.0 1000.9 1.1X +Native ORC Vectorized (Pushdown) 15332 15452 100 1.0 974.8 1.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select all int rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 20010 20037 21 0.8 1272.2 1.0X -Parquet Vectorized (Pushdown) 20297 20318 21 0.8 1290.4 1.0X -Native ORC Vectorized 16994 17029 39 0.9 1080.5 1.2X -Native ORC Vectorized (Pushdown) 17180 17224 53 0.9 1092.3 1.2X +Parquet Vectorized 18527 18615 69 0.8 1177.9 1.0X +Parquet Vectorized (Pushdown) 18761 18898 132 0.8 1192.8 1.0X +Native ORC Vectorized 16582 16724 134 0.9 1054.3 1.1X +Native ORC Vectorized (Pushdown) 16720 16860 81 0.9 1063.0 1.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select all int rows (value > -1): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 19988 20061 96 0.8 1270.8 1.0X -Parquet Vectorized (Pushdown) 20343 20389 42 0.8 1293.4 1.0X -Native ORC Vectorized 16932 16958 22 0.9 1076.5 1.2X -Native ORC Vectorized (Pushdown) 17308 17351 31 0.9 1100.4 1.2X +Parquet Vectorized 18667 18837 155 0.8 1186.8 1.0X +Parquet Vectorized (Pushdown) 18590 18851 262 0.8 1181.9 1.0X +Native ORC Vectorized 16641 16720 48 0.9 1058.0 1.1X +Native ORC Vectorized (Pushdown) 16811 16944 96 0.9 1068.8 1.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select all int rows (value != -1): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 20167 20210 36 0.8 1282.2 1.0X -Parquet Vectorized (Pushdown) 20508 20543 44 0.8 1303.9 1.0X -Native ORC Vectorized 17038 17070 32 0.9 1083.3 1.2X -Native ORC Vectorized (Pushdown) 17250 17663 538 0.9 1096.7 1.2X +Parquet Vectorized 18680 18772 68 0.8 1187.6 1.0X +Parquet Vectorized (Pushdown) 18633 18804 152 0.8 1184.7 1.0X +Native ORC Vectorized 16587 16714 96 0.9 1054.6 1.1X +Native ORC Vectorized (Pushdown) 16810 16983 113 0.9 1068.8 1.1X ================================================================================================ Pushdown for few distinct value case (use dictionary encoding) ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 0 distinct string row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 10641 10674 57 1.5 676.6 1.0X -Parquet Vectorized (Pushdown) 661 665 7 23.8 42.0 16.1X -Native ORC Vectorized 9194 9227 33 1.7 584.5 1.2X -Native ORC Vectorized (Pushdown) 798 808 18 19.7 50.7 13.3X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +---------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 8687 8807 91 1.8 552.3 1.0X +Parquet Vectorized (Pushdown) 516 533 15 30.5 32.8 16.8X +Native ORC Vectorized 9679 9770 76 1.6 615.4 0.9X +Native ORC Vectorized (Pushdown) 1011 1023 10 15.6 64.3 8.6X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 0 distinct string row ('100' < value < '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 10785 10810 20 1.5 685.7 1.0X -Parquet Vectorized (Pushdown) 656 666 10 24.0 41.7 16.5X -Native ORC Vectorized 9435 9457 16 1.7 599.9 1.1X -Native ORC Vectorized (Pushdown) 796 822 34 19.8 50.6 13.6X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +------------------------------------------------------------------------------------------------------------------------------------ +Parquet Vectorized 9038 9082 39 1.7 574.6 1.0X +Parquet Vectorized (Pushdown) 510 538 20 30.9 32.4 17.7X +Native ORC Vectorized 10082 10135 80 1.6 641.0 0.9X +Native ORC Vectorized (Pushdown) 1005 1033 16 15.6 63.9 9.0X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 1 distinct string row (value = '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 10639 10664 26 1.5 676.4 1.0X -Parquet Vectorized (Pushdown) 734 742 5 21.4 46.7 14.5X -Native ORC Vectorized 9346 9362 17 1.7 594.2 1.1X -Native ORC Vectorized (Pushdown) 863 869 5 18.2 54.9 12.3X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +---------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 8882 8947 55 1.8 564.7 1.0X +Parquet Vectorized (Pushdown) 585 617 30 26.9 37.2 15.2X +Native ORC Vectorized 9998 10016 22 1.6 635.7 0.9X +Native ORC Vectorized (Pushdown) 1101 1122 17 14.3 70.0 8.1X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 1 distinct string row (value <=> '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 10617 10672 59 1.5 675.0 1.0X -Parquet Vectorized (Pushdown) 736 747 8 21.4 46.8 14.4X -Native ORC Vectorized 9345 9445 125 1.7 594.1 1.1X -Native ORC Vectorized (Pushdown) 868 877 7 18.1 55.2 12.2X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +------------------------------------------------------------------------------------------------------------------------------ +Parquet Vectorized 8836 8913 51 1.8 561.8 1.0X +Parquet Vectorized (Pushdown) 589 615 22 26.7 37.4 15.0X +Native ORC Vectorized 10005 10088 64 1.6 636.1 0.9X +Native ORC Vectorized (Pushdown) 1082 1109 19 14.5 68.8 8.2X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 1 distinct string row ('100' <= value <= '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 10750 10790 35 1.5 683.5 1.0X -Parquet Vectorized (Pushdown) 745 748 6 21.1 47.4 14.4X -Native ORC Vectorized 9471 9488 16 1.7 602.1 1.1X -Native ORC Vectorized (Pushdown) 857 866 6 18.3 54.5 12.5X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +-------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 9009 9058 37 1.7 572.8 1.0X +Parquet Vectorized (Pushdown) 603 621 17 26.1 38.4 14.9X +Native ORC Vectorized 10175 10251 60 1.5 646.9 0.9X +Native ORC Vectorized (Pushdown) 1102 1111 13 14.3 70.0 8.2X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select all distinct string rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 21173 21253 91 0.7 1346.1 1.0X -Parquet Vectorized (Pushdown) 21369 21456 75 0.7 1358.6 1.0X -Native ORC Vectorized 20282 20397 83 0.8 1289.5 1.0X -Native ORC Vectorized (Pushdown) 20704 20768 48 0.8 1316.3 1.0X +----------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 20070 20183 84 0.8 1276.0 1.0X +Parquet Vectorized (Pushdown) 20144 20391 163 0.8 1280.7 1.0X +Native ORC Vectorized 20849 20927 97 0.8 1325.5 1.0X +Native ORC Vectorized (Pushdown) 21132 21279 102 0.7 1343.6 0.9X ================================================================================================ Pushdown benchmark for StringStartsWith ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz StringStartsWith filter: (value like '10%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 12426 12474 59 1.3 790.0 1.0X -Parquet Vectorized (Pushdown) 1847 1855 8 8.5 117.4 6.7X -Native ORC Vectorized 8336 8391 68 1.9 530.0 1.5X -Native ORC Vectorized (Pushdown) 8514 8536 14 1.8 541.3 1.5X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +--------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 11414 11506 79 1.4 725.7 1.0X +Parquet Vectorized (Pushdown) 1577 1614 31 10.0 100.3 7.2X +Native ORC Vectorized 8983 9104 148 1.8 571.1 1.3X +Native ORC Vectorized (Pushdown) 9175 9273 63 1.7 583.3 1.2X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz StringStartsWith filter: (value like '1000%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 12143 12167 23 1.3 772.1 1.0X -Parquet Vectorized (Pushdown) 751 758 9 21.0 47.7 16.2X -Native ORC Vectorized 8064 8069 8 2.0 512.7 1.5X -Native ORC Vectorized (Pushdown) 8226 8254 35 1.9 523.0 1.5X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +----------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 11258 11293 31 1.4 715.7 1.0X +Parquet Vectorized (Pushdown) 601 613 9 26.2 38.2 18.7X +Native ORC Vectorized 8782 8829 54 1.8 558.3 1.3X +Native ORC Vectorized (Pushdown) 8989 9038 56 1.7 571.5 1.3X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz StringStartsWith filter: (value like '786432%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 12123 12142 13 1.3 770.8 1.0X -Parquet Vectorized (Pushdown) 739 743 4 21.3 47.0 16.4X -Native ORC Vectorized 8038 8052 10 2.0 511.0 1.5X -Native ORC Vectorized (Pushdown) 8211 8227 12 1.9 522.0 1.5X +------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 11348 11438 75 1.4 721.5 1.0X +Parquet Vectorized (Pushdown) 621 635 10 25.3 39.5 18.3X +Native ORC Vectorized 8710 8815 62 1.8 553.8 1.3X +Native ORC Vectorized (Pushdown) 8885 9012 86 1.8 564.9 1.3X ================================================================================================ Pushdown benchmark for decimal ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 1 decimal(9, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 5889 5912 23 2.7 374.4 1.0X -Parquet Vectorized (Pushdown) 186 193 7 84.6 11.8 31.7X -Native ORC Vectorized 5272 5291 18 3.0 335.2 1.1X -Native ORC Vectorized (Pushdown) 156 183 36 100.9 9.9 37.8X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +---------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 3711 3735 37 4.2 235.9 1.0X +Parquet Vectorized (Pushdown) 141 152 8 111.2 9.0 26.2X +Native ORC Vectorized 6095 6143 37 2.6 387.5 0.6X +Native ORC Vectorized (Pushdown) 184 193 7 85.5 11.7 20.2X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 10% decimal(9, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 7738 7804 111 2.0 492.0 1.0X -Parquet Vectorized (Pushdown) 3172 3188 27 5.0 201.6 2.4X -Native ORC Vectorized 7522 7528 4 2.1 478.2 1.0X -Native ORC Vectorized (Pushdown) 3390 3433 35 4.6 215.5 2.3X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 5978 6030 36 2.6 380.1 1.0X +Parquet Vectorized (Pushdown) 3086 3162 46 5.1 196.2 1.9X +Native ORC Vectorized 8289 8307 13 1.9 527.0 0.7X +Native ORC Vectorized (Pushdown) 3608 3618 9 4.4 229.4 1.7X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 50% decimal(9, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 13990 14000 9 1.1 889.4 1.0X -Parquet Vectorized (Pushdown) 13251 13266 21 1.2 842.5 1.1X -Native ORC Vectorized 14799 14817 14 1.1 940.9 0.9X -Native ORC Vectorized (Pushdown) 14149 14195 64 1.1 899.6 1.0X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 13279 13366 80 1.2 844.2 1.0X +Parquet Vectorized (Pushdown) 12650 12758 147 1.2 804.3 1.0X +Native ORC Vectorized 15137 15272 113 1.0 962.4 0.9X +Native ORC Vectorized (Pushdown) 14389 14472 75 1.1 914.8 0.9X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 90% decimal(9, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 15114 15165 44 1.0 960.9 1.0X -Parquet Vectorized (Pushdown) 15182 15222 23 1.0 965.2 1.0X -Native ORC Vectorized 16653 16683 19 0.9 1058.8 0.9X -Native ORC Vectorized (Pushdown) 16730 16743 9 0.9 1063.7 0.9X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +-------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 14918 14969 50 1.1 948.5 1.0X +Parquet Vectorized (Pushdown) 15070 15210 115 1.0 958.1 1.0X +Native ORC Vectorized 17081 17453 275 0.9 1086.0 0.9X +Native ORC Vectorized (Pushdown) 17298 17452 110 0.9 1099.8 0.9X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 1 decimal(18, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 6112 6127 17 2.6 388.6 1.0X -Parquet Vectorized (Pushdown) 186 190 3 84.7 11.8 32.9X -Native ORC Vectorized 5292 5359 74 3.0 336.4 1.2X -Native ORC Vectorized (Pushdown) 152 159 14 103.3 9.7 40.1X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +----------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 3968 4006 31 4.0 252.3 1.0X +Parquet Vectorized (Pushdown) 143 153 8 109.9 9.1 27.7X +Native ORC Vectorized 6074 6111 33 2.6 386.2 0.7X +Native ORC Vectorized (Pushdown) 178 192 9 88.5 11.3 22.3X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 10% decimal(18, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 7119 7158 57 2.2 452.6 1.0X -Parquet Vectorized (Pushdown) 1765 1784 13 8.9 112.2 4.0X -Native ORC Vectorized 6389 6398 11 2.5 406.2 1.1X -Native ORC Vectorized (Pushdown) 1732 1743 13 9.1 110.1 4.1X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +-------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 4949 5032 75 3.2 314.6 1.0X +Parquet Vectorized (Pushdown) 1587 1625 27 9.9 100.9 3.1X +Native ORC Vectorized 7049 7143 74 2.2 448.2 0.7X +Native ORC Vectorized (Pushdown) 1783 1834 51 8.8 113.3 2.8X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 50% decimal(18, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 10996 11025 19 1.4 699.1 1.0X -Parquet Vectorized (Pushdown) 8047 8074 16 2.0 511.6 1.4X -Native ORC Vectorized 10620 10642 23 1.5 675.2 1.0X -Native ORC Vectorized (Pushdown) 8086 8102 14 1.9 514.1 1.4X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +-------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 9178 9253 51 1.7 583.5 1.0X +Parquet Vectorized (Pushdown) 7386 7454 58 2.1 469.6 1.2X +Native ORC Vectorized 11201 11271 70 1.4 712.1 0.8X +Native ORC Vectorized (Pushdown) 8282 8355 54 1.9 526.6 1.1X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 90% decimal(18, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 14800 14834 28 1.1 941.0 1.0X -Parquet Vectorized (Pushdown) 14261 14268 7 1.1 906.7 1.0X -Native ORC Vectorized 14832 14880 44 1.1 943.0 1.0X -Native ORC Vectorized (Pushdown) 14402 14428 28 1.1 915.7 1.0X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +--------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 13453 13543 61 1.2 855.3 1.0X +Parquet Vectorized (Pushdown) 13147 13232 65 1.2 835.9 1.0X +Native ORC Vectorized 15464 15648 153 1.0 983.2 0.9X +Native ORC Vectorized (Pushdown) 14666 14892 146 1.1 932.4 0.9X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 1 decimal(38, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 8132 8178 36 1.9 517.0 1.0X -Parquet Vectorized (Pushdown) 201 209 10 78.3 12.8 40.5X -Native ORC Vectorized 5270 5290 16 3.0 335.0 1.5X -Native ORC Vectorized (Pushdown) 149 153 2 105.2 9.5 54.4X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +----------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 6499 6536 28 2.4 413.2 1.0X +Parquet Vectorized (Pushdown) 154 167 10 101.8 9.8 42.1X +Native ORC Vectorized 6092 6134 32 2.6 387.3 1.1X +Native ORC Vectorized (Pushdown) 175 189 8 90.0 11.1 37.2X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 10% decimal(38, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 9422 9465 50 1.7 599.1 1.0X -Parquet Vectorized (Pushdown) 2271 2283 13 6.9 144.4 4.1X -Native ORC Vectorized 6651 6662 10 2.4 422.9 1.4X -Native ORC Vectorized (Pushdown) 2002 2016 17 7.9 127.3 4.7X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +-------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 7674 7724 36 2.0 487.9 1.0X +Parquet Vectorized (Pushdown) 2067 2134 52 7.6 131.4 3.7X +Native ORC Vectorized 7176 7249 52 2.2 456.3 1.1X +Native ORC Vectorized (Pushdown) 1880 1948 46 8.4 119.5 4.1X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 50% decimal(38, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 14781 14814 37 1.1 939.7 1.0X -Parquet Vectorized (Pushdown) 10675 10696 24 1.5 678.7 1.4X -Native ORC Vectorized 11887 11983 101 1.3 755.8 1.2X -Native ORC Vectorized (Pushdown) 9383 9396 11 1.7 596.5 1.6X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +-------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 13010 13089 89 1.2 827.2 1.0X +Parquet Vectorized (Pushdown) 9935 10013 64 1.6 631.6 1.3X +Native ORC Vectorized 12398 12503 65 1.3 788.2 1.0X +Native ORC Vectorized (Pushdown) 9483 9594 82 1.7 602.9 1.4X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 90% decimal(38, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 19753 19777 28 0.8 1255.9 1.0X -Parquet Vectorized (Pushdown) 19049 19089 49 0.8 1211.1 1.0X -Native ORC Vectorized 17238 17247 7 0.9 1096.0 1.1X -Native ORC Vectorized (Pushdown) 16780 16804 21 0.9 1066.9 1.2X +--------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 18271 18374 64 0.9 1161.7 1.0X +Parquet Vectorized (Pushdown) 17692 17759 79 0.9 1124.8 1.0X +Native ORC Vectorized 17374 17657 324 0.9 1104.6 1.1X +Native ORC Vectorized (Pushdown) 16902 16933 23 0.9 1074.6 1.1X ================================================================================================ Pushdown benchmark for InSet -> InFilters ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz InSet -> InFilters (values count: 5, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 11101 11144 74 1.4 705.8 1.0X -Parquet Vectorized (Pushdown) 773 776 3 20.3 49.1 14.4X -Native ORC Vectorized 6973 7001 28 2.3 443.3 1.6X -Native ORC Vectorized (Pushdown) 445 451 5 35.4 28.3 25.0X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +-------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 9945 10030 71 1.6 632.3 1.0X +Parquet Vectorized (Pushdown) 612 628 13 25.7 38.9 16.3X +Native ORC Vectorized 8240 8295 55 1.9 523.9 1.2X +Native ORC Vectorized (Pushdown) 564 593 21 27.9 35.8 17.6X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz InSet -> InFilters (values count: 5, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 11098 11111 13 1.4 705.6 1.0X -Parquet Vectorized (Pushdown) 775 778 4 20.3 49.2 14.3X -Native ORC Vectorized 6980 6996 9 2.3 443.8 1.6X -Native ORC Vectorized (Pushdown) 441 448 8 35.7 28.0 25.2X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +-------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 10131 10207 77 1.6 644.1 1.0X +Parquet Vectorized (Pushdown) 608 627 30 25.9 38.7 16.7X +Native ORC Vectorized 8216 8287 49 1.9 522.3 1.2X +Native ORC Vectorized (Pushdown) 561 578 23 28.0 35.7 18.0X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz InSet -> InFilters (values count: 5, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 11089 11118 26 1.4 705.0 1.0X -Parquet Vectorized (Pushdown) 772 777 3 20.4 49.1 14.4X -Native ORC Vectorized 6973 6985 9 2.3 443.3 1.6X -Native ORC Vectorized (Pushdown) 446 448 3 35.3 28.3 24.9X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +-------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 10163 10239 64 1.5 646.2 1.0X +Parquet Vectorized (Pushdown) 608 632 17 25.9 38.7 16.7X +Native ORC Vectorized 8122 8166 49 1.9 516.4 1.3X +Native ORC Vectorized (Pushdown) 558 572 9 28.2 35.5 18.2X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz InSet -> InFilters (values count: 10, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 11113 11137 19 1.4 706.5 1.0X -Parquet Vectorized (Pushdown) 802 807 5 19.6 51.0 13.9X -Native ORC Vectorized 7034 7080 63 2.2 447.2 1.6X -Native ORC Vectorized (Pushdown) 461 469 5 34.1 29.3 24.1X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +--------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 10098 10246 108 1.6 642.0 1.0X +Parquet Vectorized (Pushdown) 623 654 30 25.3 39.6 16.2X +Native ORC Vectorized 8322 8351 34 1.9 529.1 1.2X +Native ORC Vectorized (Pushdown) 601 615 16 26.2 38.2 16.8X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz InSet -> InFilters (values count: 10, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 11122 11134 16 1.4 707.1 1.0X -Parquet Vectorized (Pushdown) 804 817 16 19.6 51.1 13.8X -Native ORC Vectorized 7027 7037 10 2.2 446.8 1.6X -Native ORC Vectorized (Pushdown) 463 470 5 34.0 29.4 24.0X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +--------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 10123 10195 42 1.6 643.6 1.0X +Parquet Vectorized (Pushdown) 651 667 13 24.2 41.4 15.5X +Native ORC Vectorized 8187 8286 83 1.9 520.5 1.2X +Native ORC Vectorized (Pushdown) 565 595 18 27.8 35.9 17.9X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz InSet -> InFilters (values count: 10, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 11097 11115 13 1.4 705.5 1.0X -Parquet Vectorized (Pushdown) 804 810 6 19.6 51.1 13.8X -Native ORC Vectorized 7010 7022 15 2.2 445.7 1.6X -Native ORC Vectorized (Pushdown) 465 468 4 33.8 29.6 23.9X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +--------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 10220 10263 38 1.5 649.8 1.0X +Parquet Vectorized (Pushdown) 634 650 17 24.8 40.3 16.1X +Native ORC Vectorized 8290 8335 50 1.9 527.0 1.2X +Native ORC Vectorized (Pushdown) 599 612 10 26.3 38.1 17.1X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz InSet -> InFilters (values count: 50, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 11378 11387 7 1.4 723.4 1.0X -Parquet Vectorized (Pushdown) 11640 11675 37 1.4 740.1 1.0X -Native ORC Vectorized 7266 7284 24 2.2 462.0 1.6X -Native ORC Vectorized (Pushdown) 612 624 12 25.7 38.9 18.6X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +--------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 10551 10635 75 1.5 670.8 1.0X +Parquet Vectorized (Pushdown) 10515 10593 59 1.5 668.5 1.0X +Native ORC Vectorized 8460 8547 117 1.9 537.9 1.2X +Native ORC Vectorized (Pushdown) 764 789 22 20.6 48.6 13.8X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz InSet -> InFilters (values count: 50, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 11411 11448 49 1.4 725.5 1.0X -Parquet Vectorized (Pushdown) 11670 11692 20 1.3 741.9 1.0X -Native ORC Vectorized 7284 7292 10 2.2 463.1 1.6X -Native ORC Vectorized (Pushdown) 652 659 8 24.1 41.4 17.5X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +--------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 10528 10595 69 1.5 669.4 1.0X +Parquet Vectorized (Pushdown) 10519 10570 65 1.5 668.8 1.0X +Native ORC Vectorized 8550 8688 139 1.8 543.6 1.2X +Native ORC Vectorized (Pushdown) 800 809 7 19.7 50.8 13.2X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz InSet -> InFilters (values count: 50, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 11399 11447 71 1.4 724.7 1.0X -Parquet Vectorized (Pushdown) 11659 11684 15 1.3 741.3 1.0X -Native ORC Vectorized 7290 7301 10 2.2 463.5 1.6X -Native ORC Vectorized (Pushdown) 655 700 77 24.0 41.7 17.4X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +--------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 10452 10605 131 1.5 664.5 1.0X +Parquet Vectorized (Pushdown) 10467 10574 94 1.5 665.5 1.0X +Native ORC Vectorized 8575 8646 58 1.8 545.2 1.2X +Native ORC Vectorized (Pushdown) 806 822 13 19.5 51.2 13.0X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz InSet -> InFilters (values count: 100, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 11398 11424 23 1.4 724.7 1.0X -Parquet Vectorized (Pushdown) 11660 11775 100 1.3 741.3 1.0X -Native ORC Vectorized 7292 7312 24 2.2 463.6 1.6X -Native ORC Vectorized (Pushdown) 789 796 5 19.9 50.2 14.4X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +---------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 10400 10540 117 1.5 661.2 1.0X +Parquet Vectorized (Pushdown) 10487 10535 32 1.5 666.7 1.0X +Native ORC Vectorized 8646 8751 135 1.8 549.7 1.2X +Native ORC Vectorized (Pushdown) 923 942 16 17.0 58.7 11.3X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz InSet -> InFilters (values count: 100, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 11399 11462 55 1.4 724.7 1.0X -Parquet Vectorized (Pushdown) 11648 11670 24 1.4 740.6 1.0X -Native ORC Vectorized 7254 7265 8 2.2 461.2 1.6X -Native ORC Vectorized (Pushdown) 851 857 5 18.5 54.1 13.4X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +---------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 10514 10592 100 1.5 668.5 1.0X +Parquet Vectorized (Pushdown) 10391 10491 119 1.5 660.6 1.0X +Native ORC Vectorized 8492 8616 94 1.9 539.9 1.2X +Native ORC Vectorized (Pushdown) 999 1031 39 15.7 63.5 10.5X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz InSet -> InFilters (values count: 100, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 11383 11499 97 1.4 723.7 1.0X -Parquet Vectorized (Pushdown) 11694 11731 22 1.3 743.5 1.0X -Native ORC Vectorized 7244 7272 22 2.2 460.6 1.6X -Native ORC Vectorized (Pushdown) 887 896 12 17.7 56.4 12.8X +---------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 10396 10447 33 1.5 661.0 1.0X +Parquet Vectorized (Pushdown) 10483 10532 89 1.5 666.5 1.0X +Native ORC Vectorized 8596 8642 35 1.8 546.5 1.2X +Native ORC Vectorized (Pushdown) 1027 1044 13 15.3 65.3 10.1X ================================================================================================ Pushdown benchmark for tinyint ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 1 tinyint row (value = CAST(63 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 6301 6337 24 2.5 400.6 1.0X -Parquet Vectorized (Pushdown) 254 260 4 61.9 16.2 24.8X -Native ORC Vectorized 3257 3273 12 4.8 207.1 1.9X -Native ORC Vectorized (Pushdown) 211 217 4 74.4 13.4 29.8X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +---------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 4181 4231 44 3.8 265.9 1.0X +Parquet Vectorized (Pushdown) 202 209 10 77.9 12.8 20.7X +Native ORC Vectorized 3879 3969 79 4.1 246.6 1.1X +Native ORC Vectorized (Pushdown) 253 261 9 62.2 16.1 16.5X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 10% tinyint rows (value < CAST(12 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 7169 7219 46 2.2 455.8 1.0X -Parquet Vectorized (Pushdown) 1665 1672 12 9.4 105.9 4.3X -Native ORC Vectorized 4199 4208 12 3.7 267.0 1.7X -Native ORC Vectorized (Pushdown) 1376 1394 30 11.4 87.5 5.2X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 5054 5147 82 3.1 321.3 1.0X +Parquet Vectorized (Pushdown) 1437 1479 29 10.9 91.3 3.5X +Native ORC Vectorized 4585 4656 54 3.4 291.5 1.1X +Native ORC Vectorized (Pushdown) 1356 1400 41 11.6 86.2 3.7X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 50% tinyint rows (value < CAST(63 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 10703 10739 29 1.5 680.5 1.0X -Parquet Vectorized (Pushdown) 7648 7671 20 2.1 486.3 1.4X -Native ORC Vectorized 7815 7836 14 2.0 496.9 1.4X -Native ORC Vectorized (Pushdown) 6289 6295 9 2.5 399.8 1.7X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 8744 8866 117 1.8 555.9 1.0X +Parquet Vectorized (Pushdown) 6744 6844 71 2.3 428.8 1.3X +Native ORC Vectorized 7921 7993 44 2.0 503.6 1.1X +Native ORC Vectorized (Pushdown) 6123 6255 101 2.6 389.3 1.4X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 90% tinyint rows (value < CAST(114 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 14239 14284 35 1.1 905.3 1.0X -Parquet Vectorized (Pushdown) 13733 13769 28 1.1 873.1 1.0X -Native ORC Vectorized 11432 11481 32 1.4 726.8 1.2X -Native ORC Vectorized (Pushdown) 11241 11254 11 1.4 714.7 1.3X +-------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12765 12796 36 1.2 811.6 1.0X +Parquet Vectorized (Pushdown) 12422 12519 88 1.3 789.7 1.0X +Native ORC Vectorized 11353 11452 81 1.4 721.8 1.1X +Native ORC Vectorized (Pushdown) 11027 11161 143 1.4 701.1 1.2X ================================================================================================ Pushdown benchmark for Timestamp ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 1 timestamp stored as INT96 row (value = CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 6805 6823 17 2.3 432.7 1.0X -Parquet Vectorized (Pushdown) 6876 6892 11 2.3 437.2 1.0X -Native ORC Vectorized 3186 3208 33 4.9 202.5 2.1X -Native ORC Vectorized (Pushdown) 131 140 9 120.4 8.3 52.1X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 10% timestamp stored as INT96 rows (value < CAST(1572864 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 7742 7765 21 2.0 492.2 1.0X -Parquet Vectorized (Pushdown) 7798 7853 70 2.0 495.8 1.0X -Native ORC Vectorized 4128 4138 8 3.8 262.4 1.9X -Native ORC Vectorized (Pushdown) 1392 1402 17 11.3 88.5 5.6X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 50% timestamp stored as INT96 rows (value < CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 11354 11380 33 1.4 721.9 1.0X -Parquet Vectorized (Pushdown) 11408 11449 36 1.4 725.3 1.0X -Native ORC Vectorized 7752 7780 26 2.0 492.8 1.5X -Native ORC Vectorized (Pushdown) 6233 6246 12 2.5 396.3 1.8X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 90% timestamp stored as INT96 rows (value < CAST(14155776 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 14944 14997 49 1.1 950.1 1.0X -Parquet Vectorized (Pushdown) 15066 15120 95 1.0 957.9 1.0X -Native ORC Vectorized 11422 11487 45 1.4 726.2 1.3X -Native ORC Vectorized (Pushdown) 11169 11211 30 1.4 710.1 1.3X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 1 timestamp stored as TIMESTAMP_MICROS row (value = CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 6047 6083 28 2.6 384.5 1.0X -Parquet Vectorized (Pushdown) 188 192 3 83.5 12.0 32.1X -Native ORC Vectorized 3169 3180 11 5.0 201.5 1.9X -Native ORC Vectorized (Pushdown) 127 138 15 124.0 8.1 47.7X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 10% timestamp stored as TIMESTAMP_MICROS rows (value < CAST(1572864 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 6967 7009 26 2.3 443.0 1.0X -Parquet Vectorized (Pushdown) 1705 1711 7 9.2 108.4 4.1X -Native ORC Vectorized 4092 4115 18 3.8 260.2 1.7X -Native ORC Vectorized (Pushdown) 1389 1394 9 11.3 88.3 5.0X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 50% timestamp stored as TIMESTAMP_MICROS rows (value < CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 10658 10695 23 1.5 677.6 1.0X -Parquet Vectorized (Pushdown) 7760 7792 35 2.0 493.4 1.4X -Native ORC Vectorized 7780 7802 24 2.0 494.6 1.4X -Native ORC Vectorized (Pushdown) 6241 6279 24 2.5 396.8 1.7X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 90% timestamp stored as TIMESTAMP_MICROS rows (value < CAST(14155776 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 14209 14253 53 1.1 903.4 1.0X -Parquet Vectorized (Pushdown) 13742 13764 15 1.1 873.7 1.0X -Native ORC Vectorized 11437 11463 18 1.4 727.1 1.2X -Native ORC Vectorized (Pushdown) 11172 11218 43 1.4 710.3 1.3X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 1 timestamp stored as TIMESTAMP_MILLIS row (value = CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 6124 6173 46 2.6 389.4 1.0X -Parquet Vectorized (Pushdown) 187 189 3 84.2 11.9 32.8X -Native ORC Vectorized 3161 3174 13 5.0 200.9 1.9X -Native ORC Vectorized (Pushdown) 129 144 24 122.4 8.2 47.6X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 10% timestamp stored as TIMESTAMP_MILLIS rows (value < CAST(1572864 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 7068 7094 23 2.2 449.4 1.0X -Parquet Vectorized (Pushdown) 1724 1740 19 9.1 109.6 4.1X -Native ORC Vectorized 4127 4137 12 3.8 262.4 1.7X -Native ORC Vectorized (Pushdown) 1385 1393 10 11.4 88.1 5.1X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 50% timestamp stored as TIMESTAMP_MILLIS rows (value < CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 10767 10786 21 1.5 684.5 1.0X -Parquet Vectorized (Pushdown) 7805 7820 13 2.0 496.2 1.4X -Native ORC Vectorized 7714 7775 64 2.0 490.4 1.4X -Native ORC Vectorized (Pushdown) 6247 6266 17 2.5 397.2 1.7X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 90% timestamp stored as TIMESTAMP_MILLIS rows (value < CAST(14155776 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 14337 14392 34 1.1 911.5 1.0X -Parquet Vectorized (Pushdown) 13774 13791 13 1.1 875.7 1.0X -Native ORC Vectorized 11426 11448 16 1.4 726.4 1.3X -Native ORC Vectorized (Pushdown) 11149 11181 27 1.4 708.8 1.3X +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +Select 1 timestamp stored as INT96 row (value = timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +----------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 4418 4479 39 3.6 280.9 1.0X +Parquet Vectorized (Pushdown) 4461 4515 57 3.5 283.6 1.0X +Native ORC Vectorized 3837 3923 93 4.1 243.9 1.2X +Native ORC Vectorized (Pushdown) 150 159 6 104.9 9.5 29.5X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +Select 10% timestamp stored as INT96 rows (value < timestamp_seconds(1572864)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +-------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 5516 5557 40 2.9 350.7 1.0X +Parquet Vectorized (Pushdown) 5394 5511 81 2.9 342.9 1.0X +Native ORC Vectorized 4725 4797 57 3.3 300.4 1.2X +Native ORC Vectorized (Pushdown) 1428 1482 37 11.0 90.8 3.9X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +Select 50% timestamp stored as INT96 rows (value < timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +-------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 9602 9660 46 1.6 610.5 1.0X +Parquet Vectorized (Pushdown) 9652 9750 74 1.6 613.7 1.0X +Native ORC Vectorized 8351 8435 103 1.9 530.9 1.1X +Native ORC Vectorized (Pushdown) 6625 6711 92 2.4 421.2 1.4X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +Select 90% timestamp stored as INT96 rows (value < timestamp_seconds(14155776)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +--------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 13573 13738 100 1.2 862.9 1.0X +Parquet Vectorized (Pushdown) 13553 13737 168 1.2 861.7 1.0X +Native ORC Vectorized 12094 12204 85 1.3 768.9 1.1X +Native ORC Vectorized (Pushdown) 11801 11961 102 1.3 750.3 1.2X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +Select 1 timestamp stored as TIMESTAMP_MICROS row (value = timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +---------------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 3810 3885 44 4.1 242.3 1.0X +Parquet Vectorized (Pushdown) 137 146 10 114.5 8.7 27.7X +Native ORC Vectorized 3879 3936 33 4.1 246.6 1.0X +Native ORC Vectorized (Pushdown) 145 156 9 108.1 9.2 26.2X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +Select 10% timestamp stored as TIMESTAMP_MICROS rows (value < timestamp_seconds(1572864)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 4811 4899 70 3.3 305.9 1.0X +Parquet Vectorized (Pushdown) 1508 1533 18 10.4 95.9 3.2X +Native ORC Vectorized 4738 4815 68 3.3 301.2 1.0X +Native ORC Vectorized (Pushdown) 1462 1484 19 10.8 93.0 3.3X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +Select 50% timestamp stored as TIMESTAMP_MICROS rows (value < timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 8971 9010 61 1.8 570.4 1.0X +Parquet Vectorized (Pushdown) 7104 7168 74 2.2 451.6 1.3X +Native ORC Vectorized 8245 8325 57 1.9 524.2 1.1X +Native ORC Vectorized (Pushdown) 6465 6621 101 2.4 411.1 1.4X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +Select 90% timestamp stored as TIMESTAMP_MICROS rows (value < timestamp_seconds(14155776)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +-------------------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12934 13023 86 1.2 822.3 1.0X +Parquet Vectorized (Pushdown) 12688 12766 79 1.2 806.7 1.0X +Native ORC Vectorized 12007 12056 62 1.3 763.4 1.1X +Native ORC Vectorized (Pushdown) 11717 11865 135 1.3 744.9 1.1X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +Select 1 timestamp stored as TIMESTAMP_MILLIS row (value = timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +---------------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 3832 3911 61 4.1 243.6 1.0X +Parquet Vectorized (Pushdown) 137 147 8 114.9 8.7 28.0X +Native ORC Vectorized 3861 3894 34 4.1 245.5 1.0X +Native ORC Vectorized (Pushdown) 151 162 7 104.4 9.6 25.4X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +Select 10% timestamp stored as TIMESTAMP_MILLIS rows (value < timestamp_seconds(1572864)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 4830 4916 68 3.3 307.1 1.0X +Parquet Vectorized (Pushdown) 1538 1567 18 10.2 97.8 3.1X +Native ORC Vectorized 4707 4869 99 3.3 299.2 1.0X +Native ORC Vectorized (Pushdown) 1437 1476 34 10.9 91.4 3.4X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +Select 50% timestamp stored as TIMESTAMP_MILLIS rows (value < timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 8933 9014 65 1.8 567.9 1.0X +Parquet Vectorized (Pushdown) 7178 7269 111 2.2 456.4 1.2X +Native ORC Vectorized 8253 8329 65 1.9 524.7 1.1X +Native ORC Vectorized (Pushdown) 6499 6575 63 2.4 413.2 1.4X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +Select 90% timestamp stored as TIMESTAMP_MILLIS rows (value < timestamp_seconds(14155776)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +-------------------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12848 12984 84 1.2 816.8 1.0X +Parquet Vectorized (Pushdown) 12504 12702 174 1.3 795.0 1.0X +Native ORC Vectorized 11950 12124 113 1.3 759.8 1.1X +Native ORC Vectorized (Pushdown) 11713 11794 77 1.3 744.7 1.1X ================================================================================================ Pushdown benchmark with many filters ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 1 row with 1 filters: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 509 514 6 0.0 509244147.0 1.0X -Parquet Vectorized (Pushdown) 512 519 6 0.0 511810881.0 1.0X -Native ORC Vectorized 488 495 8 0.0 488404846.0 1.0X -Native ORC Vectorized (Pushdown) 489 500 16 0.0 489064429.0 1.0X +Parquet Vectorized 195 211 10 0.0 195007208.0 1.0X +Parquet Vectorized (Pushdown) 189 201 12 0.0 188853012.0 1.0X +Native ORC Vectorized 172 185 8 0.0 171902507.0 1.1X +Native ORC Vectorized (Pushdown) 178 188 10 0.0 177535267.0 1.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 1 row with 250 filters: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 1704 1712 7 0.0 1703741457.0 1.0X -Parquet Vectorized (Pushdown) 1782 1794 7 0.0 1781727704.0 1.0X -Native ORC Vectorized 1668 1674 5 0.0 1668306343.0 1.0X -Native ORC Vectorized (Pushdown) 1670 1679 7 0.0 1669592413.0 1.0X +Parquet Vectorized 2024 2103 64 0.0 2024084302.0 1.0X +Parquet Vectorized (Pushdown) 2041 2141 82 0.0 2041237030.0 1.0X +Native ORC Vectorized 1946 2052 79 0.0 1945760183.0 1.0X +Native ORC Vectorized (Pushdown) 1975 2073 61 0.0 1975176024.0 1.0X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select 1 row with 500 filters: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 5011 5044 25 0.0 5011180244.0 1.0X -Parquet Vectorized (Pushdown) 5375 5397 17 0.0 5375351637.0 0.9X -Native ORC Vectorized 4979 4992 12 0.0 4979326800.0 1.0X -Native ORC Vectorized (Pushdown) 4979 5008 26 0.0 4978952429.0 1.0X +Parquet Vectorized 11078 11226 162 0.0 11077796980.0 1.0X +Parquet Vectorized (Pushdown) 11266 11386 118 0.0 11266306946.0 1.0X +Native ORC Vectorized 11183 11310 171 0.0 11183362739.0 1.0X +Native ORC Vectorized (Pushdown) 11092 11181 71 0.0 11092193039.0 1.0X diff --git a/sql/core/benchmarks/FilterPushdownBenchmark-results.txt b/sql/core/benchmarks/FilterPushdownBenchmark-results.txt index 1fda7bffc8e82..c4e938716448c 100644 --- a/sql/core/benchmarks/FilterPushdownBenchmark-results.txt +++ b/sql/core/benchmarks/FilterPushdownBenchmark-results.txt @@ -2,669 +2,669 @@ Pushdown for many distinct value case ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 0 string row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 9582 9636 49 1.6 609.2 1.0X -Parquet Vectorized (Pushdown) 759 785 40 20.7 48.3 12.6X -Native ORC Vectorized 7141 7183 60 2.2 454.0 1.3X -Native ORC Vectorized (Pushdown) 513 556 49 30.7 32.6 18.7X +Parquet Vectorized 9604 9646 56 1.6 610.6 1.0X +Parquet Vectorized (Pushdown) 615 626 8 25.6 39.1 15.6X +Native ORC Vectorized 7129 8305 1477 2.2 453.3 1.3X +Native ORC Vectorized (Pushdown) 592 615 27 26.6 37.7 16.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 0 string row ('7864320' < value < '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 9657 9675 22 1.6 614.0 1.0X -Parquet Vectorized (Pushdown) 707 724 26 22.2 44.9 13.7X -Native ORC Vectorized 7250 7296 49 2.2 460.9 1.3X -Native ORC Vectorized (Pushdown) 503 537 51 31.3 32.0 19.2X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +----------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 9809 10636 1264 1.6 623.7 1.0X +Parquet Vectorized (Pushdown) 599 611 10 26.2 38.1 16.4X +Native ORC Vectorized 7343 7479 267 2.1 466.9 1.3X +Native ORC Vectorized (Pushdown) 597 662 85 26.3 38.0 16.4X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 1 string row (value = '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 9636 9657 20 1.6 612.7 1.0X -Parquet Vectorized (Pushdown) 679 693 13 23.2 43.2 14.2X -Native ORC Vectorized 7327 7359 25 2.1 465.8 1.3X -Native ORC Vectorized (Pushdown) 483 512 30 32.6 30.7 20.0X +Parquet Vectorized 9816 10707 1227 1.6 624.1 1.0X +Parquet Vectorized (Pushdown) 599 610 18 26.2 38.1 16.4X +Native ORC Vectorized 7356 8080 1365 2.1 467.7 1.3X +Native ORC Vectorized (Pushdown) 583 609 39 27.0 37.0 16.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 1 string row (value <=> '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 9688 9710 29 1.6 615.9 1.0X -Parquet Vectorized (Pushdown) 674 692 14 23.3 42.8 14.4X -Native ORC Vectorized 7315 7343 22 2.2 465.1 1.3X -Native ORC Vectorized (Pushdown) 483 498 24 32.6 30.7 20.1X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 9800 10170 789 1.6 623.1 1.0X +Parquet Vectorized (Pushdown) 597 607 14 26.4 37.9 16.4X +Native ORC Vectorized 7373 7493 256 2.1 468.8 1.3X +Native ORC Vectorized (Pushdown) 587 625 76 26.8 37.3 16.7X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 1 string row ('7864320' <= value <= '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 9611 9638 21 1.6 611.1 1.0X -Parquet Vectorized (Pushdown) 670 676 4 23.5 42.6 14.3X -Native ORC Vectorized 7261 7313 31 2.2 461.6 1.3X -Native ORC Vectorized (Pushdown) 480 518 51 32.8 30.5 20.0X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 9817 9865 79 1.6 624.1 1.0X +Parquet Vectorized (Pushdown) 595 608 11 26.4 37.8 16.5X +Native ORC Vectorized 7319 7347 22 2.1 465.3 1.3X +Native ORC Vectorized (Pushdown) 584 614 44 26.9 37.1 16.8X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select all string rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 18597 18738 91 0.8 1182.4 1.0X -Parquet Vectorized (Pushdown) 18864 18915 30 0.8 1199.4 1.0X -Native ORC Vectorized 16865 16968 67 0.9 1072.3 1.1X -Native ORC Vectorized (Pushdown) 17056 17168 120 0.9 1084.4 1.1X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +-------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 19560 19607 56 0.8 1243.6 1.0X +Parquet Vectorized (Pushdown) 19579 19657 54 0.8 1244.8 1.0X +Native ORC Vectorized 17091 17112 19 0.9 1086.6 1.1X +Native ORC Vectorized (Pushdown) 17297 17333 27 0.9 1099.7 1.1X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 0 int row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 8923 8981 48 1.8 567.3 1.0X -Parquet Vectorized (Pushdown) 651 670 25 24.1 41.4 13.7X -Native ORC Vectorized 6477 6507 46 2.4 411.8 1.4X -Native ORC Vectorized (Pushdown) 453 470 26 34.7 28.8 19.7X +Parquet Vectorized 9173 9193 24 1.7 583.2 1.0X +Parquet Vectorized (Pushdown) 585 591 7 26.9 37.2 15.7X +Native ORC Vectorized 6644 7830 1272 2.4 422.4 1.4X +Native ORC Vectorized (Pushdown) 550 570 38 28.6 34.9 16.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 0 int row (7864320 < value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 8979 8989 12 1.8 570.9 1.0X -Parquet Vectorized (Pushdown) 659 674 15 23.9 41.9 13.6X -Native ORC Vectorized 6502 6522 13 2.4 413.4 1.4X -Native ORC Vectorized (Pushdown) 460 479 22 34.2 29.2 19.5X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +---------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 9648 10861 1284 1.6 613.4 1.0X +Parquet Vectorized (Pushdown) 586 601 16 26.8 37.2 16.5X +Native ORC Vectorized 6635 7205 965 2.4 421.8 1.5X +Native ORC Vectorized (Pushdown) 560 581 36 28.1 35.6 17.2X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 1 int row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 9046 9065 23 1.7 575.1 1.0X -Parquet Vectorized (Pushdown) 654 662 9 24.1 41.6 13.8X -Native ORC Vectorized 6592 6617 24 2.4 419.1 1.4X -Native ORC Vectorized (Pushdown) 450 468 20 34.9 28.6 20.1X +Parquet Vectorized 9213 9728 1060 1.7 585.7 1.0X +Parquet Vectorized (Pushdown) 588 597 9 26.8 37.4 15.7X +Native ORC Vectorized 6735 7233 890 2.3 428.2 1.4X +Native ORC Vectorized (Pushdown) 559 589 39 28.1 35.6 16.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 1 int row (value <=> 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 9036 9052 16 1.7 574.5 1.0X -Parquet Vectorized (Pushdown) 652 661 9 24.1 41.5 13.9X -Native ORC Vectorized 6566 6616 36 2.4 417.4 1.4X -Native ORC Vectorized (Pushdown) 456 493 47 34.5 29.0 19.8X +Parquet Vectorized 9202 9441 440 1.7 585.0 1.0X +Parquet Vectorized (Pushdown) 584 592 12 26.9 37.2 15.7X +Native ORC Vectorized 6760 7297 856 2.3 429.8 1.4X +Native ORC Vectorized (Pushdown) 547 572 36 28.7 34.8 16.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 1 int row (7864320 <= value <= 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 9024 9062 52 1.7 573.7 1.0X -Parquet Vectorized (Pushdown) 657 662 4 23.9 41.8 13.7X -Native ORC Vectorized 6575 6606 19 2.4 418.1 1.4X -Native ORC Vectorized (Pushdown) 454 464 15 34.6 28.9 19.9X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +------------------------------------------------------------------------------------------------------------------------------ +Parquet Vectorized 9248 9934 1130 1.7 588.0 1.0X +Parquet Vectorized (Pushdown) 590 596 6 26.7 37.5 15.7X +Native ORC Vectorized 6711 6863 285 2.3 426.6 1.4X +Native ORC Vectorized (Pushdown) 558 584 39 28.2 35.5 16.6X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 1 int row (7864319 < value < 7864321): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 8992 9012 18 1.7 571.7 1.0X -Parquet Vectorized (Pushdown) 651 656 4 24.2 41.4 13.8X -Native ORC Vectorized 6615 6622 5 2.4 420.6 1.4X -Native ORC Vectorized (Pushdown) 455 467 22 34.5 29.0 19.7X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +---------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 9233 9821 891 1.7 587.0 1.0X +Parquet Vectorized (Pushdown) 585 596 8 26.9 37.2 15.8X +Native ORC Vectorized 6721 7310 887 2.3 427.3 1.4X +Native ORC Vectorized (Pushdown) 556 579 38 28.3 35.3 16.6X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 10% int rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 9928 9972 49 1.6 631.2 1.0X -Parquet Vectorized (Pushdown) 2416 2427 11 6.5 153.6 4.1X -Native ORC Vectorized 7620 7650 21 2.1 484.5 1.3X -Native ORC Vectorized (Pushdown) 2094 2161 119 7.5 133.1 4.7X +Parquet Vectorized 10192 10390 401 1.5 648.0 1.0X +Parquet Vectorized (Pushdown) 2422 2434 10 6.5 154.0 4.2X +Native ORC Vectorized 7708 8361 964 2.0 490.1 1.3X +Native ORC Vectorized (Pushdown) 2185 2209 18 7.2 138.9 4.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 50% int rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 13110 13154 46 1.2 833.5 1.0X -Parquet Vectorized (Pushdown) 9096 9130 34 1.7 578.3 1.4X -Native ORC Vectorized 11109 11139 21 1.4 706.3 1.2X -Native ORC Vectorized (Pushdown) 8100 8158 40 1.9 515.0 1.6X +Parquet Vectorized 13724 14226 944 1.1 872.5 1.0X +Parquet Vectorized (Pushdown) 9487 9519 27 1.7 603.2 1.4X +Native ORC Vectorized 11327 11352 22 1.4 720.1 1.2X +Native ORC Vectorized (Pushdown) 8359 8372 17 1.9 531.4 1.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 90% int rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 16372 16424 53 1.0 1040.9 1.0X -Parquet Vectorized (Pushdown) 15745 15794 51 1.0 1001.0 1.0X -Native ORC Vectorized 14642 14681 31 1.1 930.9 1.1X -Native ORC Vectorized (Pushdown) 14209 14239 19 1.1 903.4 1.2X +Parquet Vectorized 17332 17598 515 0.9 1102.0 1.0X +Parquet Vectorized (Pushdown) 16520 16564 28 1.0 1050.3 1.0X +Native ORC Vectorized 14885 15133 477 1.1 946.4 1.2X +Native ORC Vectorized (Pushdown) 14434 14499 56 1.1 917.7 1.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select all int rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 17032 17078 45 0.9 1082.9 1.0X -Parquet Vectorized (Pushdown) 17495 17509 18 0.9 1112.3 1.0X -Native ORC Vectorized 15626 15720 61 1.0 993.5 1.1X -Native ORC Vectorized (Pushdown) 15871 15950 71 1.0 1009.1 1.1X +Parquet Vectorized 18152 18276 183 0.9 1154.1 1.0X +Parquet Vectorized (Pushdown) 18251 18299 35 0.9 1160.4 1.0X +Native ORC Vectorized 15640 15675 45 1.0 994.3 1.2X +Native ORC Vectorized (Pushdown) 15840 15871 30 1.0 1007.1 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select all int rows (value > -1): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 17169 17200 20 0.9 1091.6 1.0X -Parquet Vectorized (Pushdown) 17450 17490 33 0.9 1109.4 1.0X -Native ORC Vectorized 16062 16134 81 1.0 1021.2 1.1X -Native ORC Vectorized (Pushdown) 16225 16281 48 1.0 1031.5 1.1X +Parquet Vectorized 18139 18190 39 0.9 1153.2 1.0X +Parquet Vectorized (Pushdown) 18216 18250 35 0.9 1158.1 1.0X +Native ORC Vectorized 15753 15793 29 1.0 1001.6 1.2X +Native ORC Vectorized (Pushdown) 15947 15997 38 1.0 1013.9 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select all int rows (value != -1): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 17091 17199 102 0.9 1086.6 1.0X -Parquet Vectorized (Pushdown) 17394 17480 60 0.9 1105.9 1.0X -Native ORC Vectorized 16322 16366 35 1.0 1037.7 1.0X -Native ORC Vectorized (Pushdown) 16459 16543 52 1.0 1046.4 1.0X +Parquet Vectorized 18169 18205 31 0.9 1155.2 1.0X +Parquet Vectorized (Pushdown) 18220 18262 45 0.9 1158.4 1.0X +Native ORC Vectorized 15797 15840 27 1.0 1004.3 1.2X +Native ORC Vectorized (Pushdown) 15980 16030 43 1.0 1015.9 1.1X ================================================================================================ Pushdown for few distinct value case (use dictionary encoding) ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 0 distinct string row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 8671 8722 42 1.8 551.3 1.0X -Parquet Vectorized (Pushdown) 567 576 9 27.7 36.1 15.3X -Native ORC Vectorized 8567 8600 48 1.8 544.7 1.0X -Native ORC Vectorized (Pushdown) 846 870 30 18.6 53.8 10.2X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +---------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 11129 11136 6 1.4 707.6 1.0X +Parquet Vectorized (Pushdown) 507 515 13 31.0 32.2 21.9X +Native ORC Vectorized 11193 11271 130 1.4 711.7 1.0X +Native ORC Vectorized (Pushdown) 1043 1078 38 15.1 66.3 10.7X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 0 distinct string row ('100' < value < '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 8852 8890 30 1.8 562.8 1.0X -Parquet Vectorized (Pushdown) 563 567 5 27.9 35.8 15.7X -Native ORC Vectorized 8816 8847 25 1.8 560.5 1.0X -Native ORC Vectorized (Pushdown) 838 869 41 18.8 53.3 10.6X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +------------------------------------------------------------------------------------------------------------------------------------ +Parquet Vectorized 11313 11357 57 1.4 719.3 1.0X +Parquet Vectorized (Pushdown) 515 522 10 30.6 32.7 22.0X +Native ORC Vectorized 11489 11532 27 1.4 730.4 1.0X +Native ORC Vectorized (Pushdown) 1043 1082 42 15.1 66.3 10.8X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 1 distinct string row (value = '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 8764 8799 24 1.8 557.2 1.0X -Parquet Vectorized (Pushdown) 632 637 6 24.9 40.2 13.9X -Native ORC Vectorized 8688 8707 24 1.8 552.4 1.0X -Native ORC Vectorized (Pushdown) 907 1073 259 17.3 57.7 9.7X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +---------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 11181 11222 40 1.4 710.9 1.0X +Parquet Vectorized (Pushdown) 578 587 12 27.2 36.7 19.4X +Native ORC Vectorized 11451 11522 45 1.4 728.0 1.0X +Native ORC Vectorized (Pushdown) 1093 1133 51 14.4 69.5 10.2X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 1 distinct string row (value <=> '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 8789 8802 11 1.8 558.8 1.0X -Parquet Vectorized (Pushdown) 638 646 13 24.6 40.6 13.8X -Native ORC Vectorized 8707 8728 16 1.8 553.6 1.0X -Native ORC Vectorized (Pushdown) 909 931 26 17.3 57.8 9.7X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +------------------------------------------------------------------------------------------------------------------------------ +Parquet Vectorized 11156 11216 57 1.4 709.3 1.0X +Parquet Vectorized (Pushdown) 579 590 11 27.2 36.8 19.3X +Native ORC Vectorized 11399 11427 24 1.4 724.7 1.0X +Native ORC Vectorized (Pushdown) 1089 1126 45 14.4 69.3 10.2X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 1 distinct string row ('100' <= value <= '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 8888 8901 11 1.8 565.1 1.0X -Parquet Vectorized (Pushdown) 632 639 5 24.9 40.2 14.1X -Native ORC Vectorized 8835 9125 424 1.8 561.7 1.0X -Native ORC Vectorized (Pushdown) 909 951 53 17.3 57.8 9.8X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +-------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 11347 11388 39 1.4 721.4 1.0X +Parquet Vectorized (Pushdown) 582 590 6 27.0 37.0 19.5X +Native ORC Vectorized 11536 11605 98 1.4 733.4 1.0X +Native ORC Vectorized (Pushdown) 1100 1135 43 14.3 69.9 10.3X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select all distinct string rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 18995 19038 52 0.8 1207.7 1.0X -Parquet Vectorized (Pushdown) 19265 19339 56 0.8 1224.9 1.0X -Native ORC Vectorized 19356 19526 130 0.8 1230.6 1.0X -Native ORC Vectorized (Pushdown) 19683 19762 105 0.8 1251.4 1.0X +----------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 22154 22191 23 0.7 1408.5 1.0X +Parquet Vectorized (Pushdown) 22123 22263 136 0.7 1406.5 1.0X +Native ORC Vectorized 22058 22098 26 0.7 1402.4 1.0X +Native ORC Vectorized (Pushdown) 22367 22441 47 0.7 1422.1 1.0X ================================================================================================ Pushdown benchmark for StringStartsWith ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz StringStartsWith filter: (value like '10%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 9986 10034 42 1.6 634.9 1.0X -Parquet Vectorized (Pushdown) 1539 1553 20 10.2 97.8 6.5X -Native ORC Vectorized 7520 7560 30 2.1 478.1 1.3X -Native ORC Vectorized (Pushdown) 7717 7764 37 2.0 490.6 1.3X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +--------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12880 12936 45 1.2 818.9 1.0X +Parquet Vectorized (Pushdown) 1490 1498 8 10.6 94.7 8.6X +Native ORC Vectorized 10279 10294 20 1.5 653.5 1.3X +Native ORC Vectorized (Pushdown) 10468 10507 32 1.5 665.5 1.2X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz StringStartsWith filter: (value like '1000%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 9711 9754 31 1.6 617.4 1.0X -Parquet Vectorized (Pushdown) 647 657 12 24.3 41.1 15.0X -Native ORC Vectorized 7257 7309 42 2.2 461.4 1.3X -Native ORC Vectorized (Pushdown) 7424 7497 56 2.1 472.0 1.3X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +----------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12489 12506 21 1.3 794.0 1.0X +Parquet Vectorized (Pushdown) 596 607 12 26.4 37.9 21.0X +Native ORC Vectorized 10072 10110 32 1.6 640.4 1.2X +Native ORC Vectorized (Pushdown) 10345 10393 61 1.5 657.7 1.2X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz StringStartsWith filter: (value like '786432%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 9747 9835 94 1.6 619.7 1.0X -Parquet Vectorized (Pushdown) 648 656 8 24.3 41.2 15.0X -Native ORC Vectorized 7233 7262 50 2.2 459.8 1.3X -Native ORC Vectorized (Pushdown) 7463 7539 115 2.1 474.5 1.3X +------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12450 12486 24 1.3 791.6 1.0X +Parquet Vectorized (Pushdown) 583 594 9 27.0 37.1 21.4X +Native ORC Vectorized 10104 10178 133 1.6 642.4 1.2X +Native ORC Vectorized (Pushdown) 10312 10332 19 1.5 655.6 1.2X ================================================================================================ Pushdown benchmark for decimal ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 1 decimal(9, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 4018 4049 32 3.9 255.4 1.0X -Parquet Vectorized (Pushdown) 163 178 19 96.6 10.4 24.7X -Native ORC Vectorized 4918 4969 39 3.2 312.7 0.8X -Native ORC Vectorized (Pushdown) 160 167 11 98.1 10.2 25.1X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +---------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 3993 4013 12 3.9 253.9 1.0X +Parquet Vectorized (Pushdown) 139 143 7 113.3 8.8 28.8X +Native ORC Vectorized 5123 5176 93 3.1 325.7 0.8X +Native ORC Vectorized (Pushdown) 191 201 25 82.4 12.1 20.9X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 10% decimal(9, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 5800 5837 36 2.7 368.8 1.0X -Parquet Vectorized (Pushdown) 2764 2787 19 5.7 175.7 2.1X -Native ORC Vectorized 7034 7050 13 2.2 447.2 0.8X -Native ORC Vectorized (Pushdown) 3179 3191 9 4.9 202.1 1.8X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 5942 5956 13 2.6 377.8 1.0X +Parquet Vectorized (Pushdown) 2842 2853 15 5.5 180.7 2.1X +Native ORC Vectorized 7100 7124 22 2.2 451.4 0.8X +Native ORC Vectorized (Pushdown) 3141 3154 10 5.0 199.7 1.9X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 50% decimal(9, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 12173 12215 33 1.3 773.9 1.0X -Parquet Vectorized (Pushdown) 11669 11723 31 1.3 741.9 1.0X -Native ORC Vectorized 13874 13893 19 1.1 882.1 0.9X -Native ORC Vectorized (Pushdown) 13241 13285 33 1.2 841.8 0.9X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12214 12254 30 1.3 776.5 1.0X +Parquet Vectorized (Pushdown) 11711 11745 34 1.3 744.6 1.0X +Native ORC Vectorized 13522 13547 19 1.2 859.7 0.9X +Native ORC Vectorized (Pushdown) 12929 12946 18 1.2 822.0 0.9X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 90% decimal(9, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 13290 13316 23 1.2 845.0 1.0X -Parquet Vectorized (Pushdown) 13335 13367 23 1.2 847.8 1.0X -Native ORC Vectorized 15485 15504 18 1.0 984.5 0.9X -Native ORC Vectorized (Pushdown) 15576 15605 18 1.0 990.3 0.9X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +-------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 13714 13740 24 1.1 871.9 1.0X +Parquet Vectorized (Pushdown) 13738 13832 100 1.1 873.4 1.0X +Native ORC Vectorized 15109 15152 37 1.0 960.6 0.9X +Native ORC Vectorized (Pushdown) 15140 15159 22 1.0 962.6 0.9X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 1 decimal(18, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 4154 4175 32 3.8 264.1 1.0X -Parquet Vectorized (Pushdown) 159 162 7 98.9 10.1 26.1X -Native ORC Vectorized 4902 4926 25 3.2 311.7 0.8X -Native ORC Vectorized (Pushdown) 153 162 23 102.6 9.7 27.1X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +----------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 4207 4232 28 3.7 267.5 1.0X +Parquet Vectorized (Pushdown) 140 143 5 112.7 8.9 30.1X +Native ORC Vectorized 5146 5175 47 3.1 327.2 0.8X +Native ORC Vectorized (Pushdown) 185 195 21 85.1 11.8 22.8X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 10% decimal(18, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 5090 5114 46 3.1 323.6 1.0X -Parquet Vectorized (Pushdown) 1509 1533 45 10.4 95.9 3.4X -Native ORC Vectorized 5943 5952 11 2.6 377.9 0.9X -Native ORC Vectorized (Pushdown) 1649 1686 61 9.5 104.8 3.1X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +-------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 5170 5195 20 3.0 328.7 1.0X +Parquet Vectorized (Pushdown) 1524 1537 12 10.3 96.9 3.4X +Native ORC Vectorized 6127 6140 13 2.6 389.5 0.8X +Native ORC Vectorized (Pushdown) 1669 1679 7 9.4 106.1 3.1X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 50% decimal(18, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 8887 8938 79 1.8 565.0 1.0X -Parquet Vectorized (Pushdown) 6901 6917 13 2.3 438.8 1.3X -Native ORC Vectorized 10030 10047 15 1.6 637.7 0.9X -Native ORC Vectorized (Pushdown) 7672 7689 12 2.1 487.8 1.2X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +-------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 9075 9104 43 1.7 577.0 1.0X +Parquet Vectorized (Pushdown) 7081 7107 27 2.2 450.2 1.3X +Native ORC Vectorized 10127 10154 32 1.6 643.9 0.9X +Native ORC Vectorized (Pushdown) 7679 7707 26 2.0 488.2 1.2X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 90% decimal(18, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 12618 12633 19 1.2 802.2 1.0X -Parquet Vectorized (Pushdown) 12296 12315 13 1.3 781.7 1.0X -Native ORC Vectorized 14260 14318 43 1.1 906.6 0.9X -Native ORC Vectorized (Pushdown) 13661 13678 12 1.2 868.5 0.9X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +--------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12918 12944 20 1.2 821.3 1.0X +Parquet Vectorized (Pushdown) 12553 12590 37 1.3 798.1 1.0X +Native ORC Vectorized 14060 14076 16 1.1 893.9 0.9X +Native ORC Vectorized (Pushdown) 13590 13655 40 1.2 864.1 1.0X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 1 decimal(38, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 6470 6492 29 2.4 411.4 1.0X -Parquet Vectorized (Pushdown) 175 178 3 89.8 11.1 36.9X -Native ORC Vectorized 4928 4949 17 3.2 313.3 1.3X -Native ORC Vectorized (Pushdown) 153 166 23 103.0 9.7 42.4X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +----------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 6428 6450 20 2.4 408.7 1.0X +Parquet Vectorized (Pushdown) 154 160 6 101.9 9.8 41.6X +Native ORC Vectorized 5146 5156 9 3.1 327.2 1.2X +Native ORC Vectorized (Pushdown) 187 195 19 84.2 11.9 34.4X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 10% decimal(38, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 7674 7709 60 2.0 487.9 1.0X -Parquet Vectorized (Pushdown) 1984 1994 10 7.9 126.1 3.9X -Native ORC Vectorized 6245 6259 15 2.5 397.1 1.2X -Native ORC Vectorized (Pushdown) 1926 1935 11 8.2 122.5 4.0X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +-------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 7654 7698 26 2.1 486.6 1.0X +Parquet Vectorized (Pushdown) 1986 2004 12 7.9 126.3 3.9X +Native ORC Vectorized 6287 6300 14 2.5 399.7 1.2X +Native ORC Vectorized (Pushdown) 1835 1849 12 8.6 116.7 4.2X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 50% decimal(38, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 12485 12497 10 1.3 793.7 1.0X -Parquet Vectorized (Pushdown) 9348 9376 26 1.7 594.3 1.3X -Native ORC Vectorized 11573 11583 12 1.4 735.8 1.1X -Native ORC Vectorized (Pushdown) 9211 9228 10 1.7 585.6 1.4X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +-------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12475 12543 55 1.3 793.2 1.0X +Parquet Vectorized (Pushdown) 9386 9406 26 1.7 596.7 1.3X +Native ORC Vectorized 10935 10962 19 1.4 695.3 1.1X +Native ORC Vectorized (Pushdown) 8498 8560 46 1.9 540.3 1.5X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 90% decimal(38, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 17198 17206 7 0.9 1093.4 1.0X -Parquet Vectorized (Pushdown) 16613 16629 12 0.9 1056.2 1.0X -Native ORC Vectorized 17081 17103 31 0.9 1086.0 1.0X -Native ORC Vectorized (Pushdown) 16659 16693 28 0.9 1059.2 1.0X +--------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 17270 17291 29 0.9 1098.0 1.0X +Parquet Vectorized (Pushdown) 16666 16708 43 0.9 1059.6 1.0X +Native ORC Vectorized 15653 15723 69 1.0 995.2 1.1X +Native ORC Vectorized (Pushdown) 15229 15258 19 1.0 968.3 1.1X ================================================================================================ Pushdown benchmark for InSet -> InFilters ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz InSet -> InFilters (values count: 5, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 8986 9024 59 1.8 571.3 1.0X -Parquet Vectorized (Pushdown) 662 676 14 23.7 42.1 13.6X -Native ORC Vectorized 6568 6589 27 2.4 417.6 1.4X -Native ORC Vectorized (Pushdown) 462 475 18 34.0 29.4 19.4X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +-------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12028 12062 37 1.3 764.7 1.0X +Parquet Vectorized (Pushdown) 607 614 12 25.9 38.6 19.8X +Native ORC Vectorized 9373 9399 26 1.7 595.9 1.3X +Native ORC Vectorized (Pushdown) 571 595 39 27.6 36.3 21.1X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz InSet -> InFilters (values count: 5, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 8973 8986 21 1.8 570.5 1.0X -Parquet Vectorized (Pushdown) 663 666 5 23.7 42.1 13.5X -Native ORC Vectorized 6569 6574 6 2.4 417.6 1.4X -Native ORC Vectorized (Pushdown) 462 507 57 34.0 29.4 19.4X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +-------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12084 12207 222 1.3 768.3 1.0X +Parquet Vectorized (Pushdown) 606 611 7 26.0 38.5 20.0X +Native ORC Vectorized 9413 9452 31 1.7 598.5 1.3X +Native ORC Vectorized (Pushdown) 565 588 36 27.8 35.9 21.4X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz InSet -> InFilters (values count: 5, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 9003 9037 37 1.7 572.4 1.0X -Parquet Vectorized (Pushdown) 666 671 6 23.6 42.4 13.5X -Native ORC Vectorized 6571 6581 8 2.4 417.8 1.4X -Native ORC Vectorized (Pushdown) 463 473 18 34.0 29.4 19.5X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +-------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12085 12129 36 1.3 768.3 1.0X +Parquet Vectorized (Pushdown) 606 612 5 25.9 38.6 19.9X +Native ORC Vectorized 9440 9474 29 1.7 600.2 1.3X +Native ORC Vectorized (Pushdown) 571 594 33 27.5 36.3 21.2X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz InSet -> InFilters (values count: 10, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 9015 9022 8 1.7 573.2 1.0X -Parquet Vectorized (Pushdown) 687 698 13 22.9 43.7 13.1X -Native ORC Vectorized 6592 6611 13 2.4 419.1 1.4X -Native ORC Vectorized (Pushdown) 485 497 16 32.5 30.8 18.6X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +--------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12105 12120 16 1.3 769.6 1.0X +Parquet Vectorized (Pushdown) 627 635 9 25.1 39.8 19.3X +Native ORC Vectorized 9456 9568 99 1.7 601.2 1.3X +Native ORC Vectorized (Pushdown) 590 615 30 26.6 37.5 20.5X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz InSet -> InFilters (values count: 10, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 9001 9008 14 1.7 572.3 1.0X -Parquet Vectorized (Pushdown) 686 692 5 22.9 43.6 13.1X -Native ORC Vectorized 6599 6619 32 2.4 419.6 1.4X -Native ORC Vectorized (Pushdown) 473 483 17 33.2 30.1 19.0X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +--------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12041 12062 23 1.3 765.5 1.0X +Parquet Vectorized (Pushdown) 630 638 10 25.0 40.1 19.1X +Native ORC Vectorized 9371 9417 33 1.7 595.8 1.3X +Native ORC Vectorized (Pushdown) 592 607 31 26.6 37.6 20.3X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz InSet -> InFilters (values count: 10, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 8996 9002 8 1.7 571.9 1.0X -Parquet Vectorized (Pushdown) 690 697 6 22.8 43.9 13.0X -Native ORC Vectorized 6579 6587 8 2.4 418.3 1.4X -Native ORC Vectorized (Pushdown) 481 490 15 32.7 30.6 18.7X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +--------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12063 12262 164 1.3 767.0 1.0X +Parquet Vectorized (Pushdown) 632 640 5 24.9 40.2 19.1X +Native ORC Vectorized 9416 9475 49 1.7 598.6 1.3X +Native ORC Vectorized (Pushdown) 580 602 32 27.1 36.9 20.8X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz InSet -> InFilters (values count: 50, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 9292 9304 9 1.7 590.8 1.0X -Parquet Vectorized (Pushdown) 9558 9567 9 1.6 607.7 1.0X -Native ORC Vectorized 6898 6911 10 2.3 438.6 1.3X -Native ORC Vectorized (Pushdown) 625 641 15 25.2 39.8 14.9X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +--------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12450 12477 22 1.3 791.6 1.0X +Parquet Vectorized (Pushdown) 12456 12510 43 1.3 791.9 1.0X +Native ORC Vectorized 9846 9884 29 1.6 626.0 1.3X +Native ORC Vectorized (Pushdown) 750 764 23 21.0 47.7 16.6X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz InSet -> InFilters (values count: 50, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 9281 9298 12 1.7 590.1 1.0X -Parquet Vectorized (Pushdown) 9546 9561 17 1.6 606.9 1.0X -Native ORC Vectorized 6877 6897 18 2.3 437.2 1.3X -Native ORC Vectorized (Pushdown) 661 668 15 23.8 42.0 14.0X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +--------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12440 12477 44 1.3 790.9 1.0X +Parquet Vectorized (Pushdown) 12473 12522 38 1.3 793.0 1.0X +Native ORC Vectorized 9702 9769 40 1.6 616.8 1.3X +Native ORC Vectorized (Pushdown) 760 781 30 20.7 48.3 16.4X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz InSet -> InFilters (values count: 50, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 9322 9335 22 1.7 592.7 1.0X -Parquet Vectorized (Pushdown) 9551 9573 18 1.6 607.2 1.0X -Native ORC Vectorized 6902 6915 13 2.3 438.8 1.4X -Native ORC Vectorized (Pushdown) 659 680 25 23.9 41.9 14.1X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +--------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12384 12456 52 1.3 787.3 1.0X +Parquet Vectorized (Pushdown) 12448 12480 24 1.3 791.4 1.0X +Native ORC Vectorized 9680 9704 14 1.6 615.4 1.3X +Native ORC Vectorized (Pushdown) 773 805 32 20.3 49.1 16.0X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz InSet -> InFilters (values count: 100, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 9278 9294 18 1.7 589.9 1.0X -Parquet Vectorized (Pushdown) 9520 9560 27 1.7 605.3 1.0X -Native ORC Vectorized 6855 6870 16 2.3 435.9 1.4X -Native ORC Vectorized (Pushdown) 795 808 16 19.8 50.5 11.7X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +---------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12410 12697 228 1.3 789.0 1.0X +Parquet Vectorized (Pushdown) 12391 12418 23 1.3 787.8 1.0X +Native ORC Vectorized 9716 9766 37 1.6 617.7 1.3X +Native ORC Vectorized (Pushdown) 883 912 37 17.8 56.1 14.1X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz InSet -> InFilters (values count: 100, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 9306 9311 4 1.7 591.6 1.0X -Parquet Vectorized (Pushdown) 9529 9551 16 1.7 605.8 1.0X -Native ORC Vectorized 6875 6882 7 2.3 437.1 1.4X -Native ORC Vectorized (Pushdown) 853 865 15 18.4 54.2 10.9X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +---------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12334 12353 18 1.3 784.2 1.0X +Parquet Vectorized (Pushdown) 12328 12375 33 1.3 783.8 1.0X +Native ORC Vectorized 9554 9612 39 1.6 607.4 1.3X +Native ORC Vectorized (Pushdown) 974 996 19 16.1 62.0 12.7X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz InSet -> InFilters (values count: 100, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 9256 9271 9 1.7 588.5 1.0X -Parquet Vectorized (Pushdown) 9500 9520 13 1.7 604.0 1.0X -Native ORC Vectorized 6843 6857 9 2.3 435.1 1.4X -Native ORC Vectorized (Pushdown) 858 870 14 18.3 54.6 10.8X +---------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12355 12378 15 1.3 785.5 1.0X +Parquet Vectorized (Pushdown) 12335 12362 42 1.3 784.2 1.0X +Native ORC Vectorized 9644 9701 51 1.6 613.2 1.3X +Native ORC Vectorized (Pushdown) 989 1016 25 15.9 62.9 12.5X ================================================================================================ Pushdown benchmark for tinyint ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 1 tinyint row (value = CAST(63 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 4303 4312 8 3.7 273.6 1.0X -Parquet Vectorized (Pushdown) 208 213 6 75.5 13.2 20.7X -Native ORC Vectorized 2950 2958 9 5.3 187.6 1.5X -Native ORC Vectorized (Pushdown) 207 212 10 76.1 13.1 20.8X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +---------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 5244 5282 30 3.0 333.4 1.0X +Parquet Vectorized (Pushdown) 190 193 4 82.9 12.1 27.6X +Native ORC Vectorized 4019 4040 17 3.9 255.6 1.3X +Native ORC Vectorized (Pushdown) 248 260 23 63.5 15.8 21.2X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 10% tinyint rows (value < CAST(12 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 5125 5162 57 3.1 325.9 1.0X -Parquet Vectorized (Pushdown) 1402 1419 16 11.2 89.2 3.7X -Native ORC Vectorized 3840 3849 8 4.1 244.1 1.3X -Native ORC Vectorized (Pushdown) 1302 1306 3 12.1 82.8 3.9X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 6104 6125 16 2.6 388.1 1.0X +Parquet Vectorized (Pushdown) 1416 1432 14 11.1 90.0 4.3X +Native ORC Vectorized 4862 4872 11 3.2 309.1 1.3X +Native ORC Vectorized (Pushdown) 1329 1347 12 11.8 84.5 4.6X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 50% tinyint rows (value < CAST(63 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 8562 8577 12 1.8 544.4 1.0X -Parquet Vectorized (Pushdown) 6539 6564 22 2.4 415.8 1.3X -Native ORC Vectorized 7300 7320 13 2.2 464.1 1.2X -Native ORC Vectorized (Pushdown) 5944 5954 15 2.6 377.9 1.4X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 9645 9685 35 1.6 613.2 1.0X +Parquet Vectorized (Pushdown) 6720 6741 20 2.3 427.2 1.4X +Native ORC Vectorized 8318 8339 17 1.9 528.8 1.2X +Native ORC Vectorized (Pushdown) 6005 6116 131 2.6 381.8 1.6X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 90% tinyint rows (value < CAST(114 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 11989 12005 13 1.3 762.2 1.0X -Parquet Vectorized (Pushdown) 11637 11686 54 1.4 739.8 1.0X -Native ORC Vectorized 10795 10816 18 1.5 686.3 1.1X -Native ORC Vectorized (Pushdown) 10592 10599 5 1.5 673.4 1.1X +-------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 13318 13363 36 1.2 846.8 1.0X +Parquet Vectorized (Pushdown) 12852 12919 54 1.2 817.1 1.0X +Native ORC Vectorized 11759 11792 21 1.3 747.6 1.1X +Native ORC Vectorized (Pushdown) 11404 11457 35 1.4 725.1 1.2X ================================================================================================ Pushdown benchmark for Timestamp ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 1 timestamp stored as INT96 row (value = CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 4700 4716 19 3.3 298.8 1.0X -Parquet Vectorized (Pushdown) 4745 4758 11 3.3 301.7 1.0X -Native ORC Vectorized 2848 2865 22 5.5 181.1 1.7X -Native ORC Vectorized (Pushdown) 129 135 12 122.2 8.2 36.5X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 10% timestamp stored as INT96 rows (value < CAST(1572864 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 5575 5590 9 2.8 354.5 1.0X -Parquet Vectorized (Pushdown) 5610 5623 10 2.8 356.7 1.0X -Native ORC Vectorized 3706 3723 11 4.2 235.6 1.5X -Native ORC Vectorized (Pushdown) 1286 1287 2 12.2 81.7 4.3X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 50% timestamp stored as INT96 rows (value < CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 9872 9887 13 1.6 627.7 1.0X -Parquet Vectorized (Pushdown) 9932 9942 8 1.6 631.4 1.0X -Native ORC Vectorized 7238 7273 25 2.2 460.2 1.4X -Native ORC Vectorized (Pushdown) 5933 5937 6 2.7 377.2 1.7X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 90% timestamp stored as INT96 rows (value < CAST(14155776 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 12660 12677 12 1.2 804.9 1.0X -Parquet Vectorized (Pushdown) 12652 12704 31 1.2 804.4 1.0X -Native ORC Vectorized 10842 10870 19 1.5 689.3 1.2X -Native ORC Vectorized (Pushdown) 10630 10639 6 1.5 675.9 1.2X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 1 timestamp stored as TIMESTAMP_MICROS row (value = CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 4057 4065 7 3.9 257.9 1.0X -Parquet Vectorized (Pushdown) 155 159 7 101.2 9.9 26.1X -Native ORC Vectorized 2828 2840 8 5.6 179.8 1.4X -Native ORC Vectorized (Pushdown) 126 130 9 124.8 8.0 32.2X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 10% timestamp stored as TIMESTAMP_MICROS rows (value < CAST(1572864 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 4926 4938 9 3.2 313.2 1.0X -Parquet Vectorized (Pushdown) 1415 1422 6 11.1 90.0 3.5X -Native ORC Vectorized 3705 3714 7 4.2 235.6 1.3X -Native ORC Vectorized (Pushdown) 1279 1285 9 12.3 81.3 3.9X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 50% timestamp stored as TIMESTAMP_MICROS rows (value < CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 8409 8413 4 1.9 534.6 1.0X -Parquet Vectorized (Pushdown) 6489 6497 6 2.4 412.5 1.3X -Native ORC Vectorized 7248 7255 10 2.2 460.8 1.2X -Native ORC Vectorized (Pushdown) 5922 5932 7 2.7 376.5 1.4X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 90% timestamp stored as TIMESTAMP_MICROS rows (value < CAST(14155776 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 11821 11830 8 1.3 751.5 1.0X -Parquet Vectorized (Pushdown) 11478 11490 11 1.4 729.8 1.0X -Native ORC Vectorized 10851 10856 4 1.4 689.9 1.1X -Native ORC Vectorized (Pushdown) 10620 10628 10 1.5 675.2 1.1X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 1 timestamp stored as TIMESTAMP_MILLIS row (value = CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 4307 4341 75 3.7 273.8 1.0X -Parquet Vectorized (Pushdown) 156 161 6 101.1 9.9 27.7X -Native ORC Vectorized 2825 2836 8 5.6 179.6 1.5X -Native ORC Vectorized (Pushdown) 125 128 9 125.4 8.0 34.3X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 10% timestamp stored as TIMESTAMP_MILLIS rows (value < CAST(1572864 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 5173 5178 3 3.0 328.9 1.0X -Parquet Vectorized (Pushdown) 1444 1451 9 10.9 91.8 3.6X -Native ORC Vectorized 3707 3715 5 4.2 235.7 1.4X -Native ORC Vectorized (Pushdown) 1275 1276 2 12.3 81.0 4.1X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 50% timestamp stored as TIMESTAMP_MILLIS rows (value < CAST(7864320 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 8645 8655 9 1.8 549.6 1.0X -Parquet Vectorized (Pushdown) 6588 6603 11 2.4 418.9 1.3X -Native ORC Vectorized 7233 7246 13 2.2 459.9 1.2X -Native ORC Vectorized (Pushdown) 5904 5912 8 2.7 375.3 1.5X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -Select 90% timestamp stored as TIMESTAMP_MILLIS rows (value < CAST(14155776 AS timestamp)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Parquet Vectorized 12057 12069 12 1.3 766.5 1.0X -Parquet Vectorized (Pushdown) 11694 11699 5 1.3 743.5 1.0X -Native ORC Vectorized 10817 10843 28 1.5 687.7 1.1X -Native ORC Vectorized (Pushdown) 10615 10634 11 1.5 674.9 1.1X +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz +Select 1 timestamp stored as INT96 row (value = timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +----------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 5563 5590 26 2.8 353.7 1.0X +Parquet Vectorized (Pushdown) 5584 5606 24 2.8 355.0 1.0X +Native ORC Vectorized 3268 3704 384 4.8 207.8 1.7X +Native ORC Vectorized (Pushdown) 152 159 16 103.4 9.7 36.6X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz +Select 10% timestamp stored as INT96 rows (value < timestamp_seconds(1572864)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +-------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 6532 6549 21 2.4 415.3 1.0X +Parquet Vectorized (Pushdown) 6545 6576 19 2.4 416.1 1.0X +Native ORC Vectorized 4192 4200 7 3.8 266.5 1.6X +Native ORC Vectorized (Pushdown) 1368 1394 21 11.5 87.0 4.8X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz +Select 50% timestamp stored as INT96 rows (value < timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +-------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 10385 10421 25 1.5 660.2 1.0X +Parquet Vectorized (Pushdown) 10348 10386 23 1.5 657.9 1.0X +Native ORC Vectorized 7724 7768 29 2.0 491.1 1.3X +Native ORC Vectorized (Pushdown) 6222 6246 17 2.5 395.6 1.7X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz +Select 90% timestamp stored as INT96 rows (value < timestamp_seconds(14155776)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +--------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 14117 14146 31 1.1 897.6 1.0X +Parquet Vectorized (Pushdown) 14106 14128 25 1.1 896.8 1.0X +Native ORC Vectorized 11373 11425 59 1.4 723.1 1.2X +Native ORC Vectorized (Pushdown) 11084 11122 25 1.4 704.7 1.3X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz +Select 1 timestamp stored as TIMESTAMP_MICROS row (value = timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +---------------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 4097 4449 441 3.8 260.5 1.0X +Parquet Vectorized (Pushdown) 139 143 6 113.4 8.8 29.5X +Native ORC Vectorized 3272 3362 179 4.8 208.0 1.3X +Native ORC Vectorized (Pushdown) 152 160 17 103.3 9.7 26.9X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz +Select 10% timestamp stored as TIMESTAMP_MICROS rows (value < timestamp_seconds(1572864)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 5046 5085 38 3.1 320.8 1.0X +Parquet Vectorized (Pushdown) 1469 1487 12 10.7 93.4 3.4X +Native ORC Vectorized 4175 4201 25 3.8 265.5 1.2X +Native ORC Vectorized (Pushdown) 1359 1382 14 11.6 86.4 3.7X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz +Select 50% timestamp stored as TIMESTAMP_MICROS rows (value < timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 8862 8876 11 1.8 563.4 1.0X +Parquet Vectorized (Pushdown) 6887 6915 31 2.3 437.9 1.3X +Native ORC Vectorized 7759 7781 18 2.0 493.3 1.1X +Native ORC Vectorized (Pushdown) 6213 6239 22 2.5 395.0 1.4X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz +Select 90% timestamp stored as TIMESTAMP_MICROS rows (value < timestamp_seconds(14155776)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +-------------------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12582 12603 40 1.3 799.9 1.0X +Parquet Vectorized (Pushdown) 12203 12235 24 1.3 775.8 1.0X +Native ORC Vectorized 11364 11386 24 1.4 722.5 1.1X +Native ORC Vectorized (Pushdown) 11116 11161 50 1.4 706.7 1.1X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz +Select 1 timestamp stored as TIMESTAMP_MILLIS row (value = timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +---------------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 4287 4306 13 3.7 272.6 1.0X +Parquet Vectorized (Pushdown) 138 142 7 113.9 8.8 31.0X +Native ORC Vectorized 3266 3280 17 4.8 207.7 1.3X +Native ORC Vectorized (Pushdown) 151 158 17 104.0 9.6 28.3X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz +Select 10% timestamp stored as TIMESTAMP_MILLIS rows (value < timestamp_seconds(1572864)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 5247 5279 24 3.0 333.6 1.0X +Parquet Vectorized (Pushdown) 1497 1509 12 10.5 95.2 3.5X +Native ORC Vectorized 4185 4197 9 3.8 266.1 1.3X +Native ORC Vectorized (Pushdown) 1364 1388 14 11.5 86.8 3.8X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz +Select 50% timestamp stored as TIMESTAMP_MILLIS rows (value < timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 9055 9099 47 1.7 575.7 1.0X +Parquet Vectorized (Pushdown) 6993 7023 27 2.2 444.6 1.3X +Native ORC Vectorized 7740 7787 34 2.0 492.1 1.2X +Native ORC Vectorized (Pushdown) 6222 6249 20 2.5 395.6 1.5X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz +Select 90% timestamp stored as TIMESTAMP_MILLIS rows (value < timestamp_seconds(14155776)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +-------------------------------------------------------------------------------------------------------------------------------------------------------------------------- +Parquet Vectorized 12755 12794 44 1.2 810.9 1.0X +Parquet Vectorized (Pushdown) 12408 12441 34 1.3 788.9 1.0X +Native ORC Vectorized 11357 11410 52 1.4 722.1 1.1X +Native ORC Vectorized (Pushdown) 11089 11144 43 1.4 705.0 1.2X ================================================================================================ Pushdown benchmark with many filters ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 1 row with 1 filters: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 463 468 6 0.0 462711905.0 1.0X -Parquet Vectorized (Pushdown) 468 470 3 0.0 468018831.0 1.0X -Native ORC Vectorized 447 450 5 0.0 446698170.0 1.0X -Native ORC Vectorized (Pushdown) 449 458 11 0.0 448997785.0 1.0X +Parquet Vectorized 165 171 5 0.0 164509375.0 1.0X +Parquet Vectorized (Pushdown) 167 170 4 0.0 167250773.0 1.0X +Native ORC Vectorized 148 152 5 0.0 148320765.0 1.1X +Native ORC Vectorized (Pushdown) 154 158 7 0.0 153612969.0 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 1 row with 250 filters: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 1538 1549 9 0.0 1538463215.0 1.0X -Parquet Vectorized (Pushdown) 1659 1668 6 0.0 1659315980.0 0.9X -Native ORC Vectorized 1513 1517 5 0.0 1512577059.0 1.0X -Native ORC Vectorized (Pushdown) 1517 1538 12 0.0 1516938695.0 1.0X +Parquet Vectorized 1973 2021 36 0.0 1972618013.0 1.0X +Parquet Vectorized (Pushdown) 2045 2069 21 0.0 2045423860.0 1.0X +Native ORC Vectorized 1959 1992 20 0.0 1959045908.0 1.0X +Native ORC Vectorized (Pushdown) 1967 2002 26 0.0 1966983577.0 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Select 1 row with 500 filters: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Parquet Vectorized 4497 4525 29 0.0 4497410600.0 1.0X -Parquet Vectorized (Pushdown) 4945 4955 8 0.0 4945493883.0 0.9X -Native ORC Vectorized 4466 4485 23 0.0 4466103057.0 1.0X -Native ORC Vectorized (Pushdown) 4477 4496 18 0.0 4476752574.0 1.0X +Parquet Vectorized 12096 12477 293 0.0 12096441094.0 1.0X +Parquet Vectorized (Pushdown) 12241 12311 54 0.0 12241257148.0 1.0X +Native ORC Vectorized 11948 12002 51 0.0 11948392776.0 1.0X +Native ORC Vectorized (Pushdown) 11916 12008 61 0.0 11915517617.0 1.0X diff --git a/sql/core/benchmarks/GenerateExecBenchmark-jdk11-results.txt b/sql/core/benchmarks/GenerateExecBenchmark-jdk11-results.txt index ee25ce153dc6b..52ba08ba5e0f1 100644 --- a/sql/core/benchmarks/GenerateExecBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/GenerateExecBenchmark-jdk11-results.txt @@ -2,11 +2,11 @@ GenerateExec benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Mac OS X 10.16 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz GenerateExec Benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -GenerateExec Benchmark wholestage off 72694 72900 292 1.4 726.9 1.0X -GenerateExec Benchmark wholestage on 29207 30182 562 3.4 292.1 2.5X +GenerateExec Benchmark wholestage off 130659 131394 1040 0.8 1306.6 1.0X +GenerateExec Benchmark wholestage on 64031 64151 90 1.6 640.3 2.0X diff --git a/sql/core/benchmarks/GenerateExecBenchmark-results.txt b/sql/core/benchmarks/GenerateExecBenchmark-results.txt index 50c18724d17f8..4dcba78820eaa 100644 --- a/sql/core/benchmarks/GenerateExecBenchmark-results.txt +++ b/sql/core/benchmarks/GenerateExecBenchmark-results.txt @@ -2,11 +2,11 @@ GenerateExec benchmark ================================================================================================ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_271-b09 on Mac OS X 10.16 -Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz GenerateExec Benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -GenerateExec Benchmark wholestage off 88194 88334 199 1.1 881.9 1.0X -GenerateExec Benchmark wholestage on 43805 44271 326 2.3 438.0 2.0X +GenerateExec Benchmark wholestage off 102348 105601 1650 1.0 1023.5 1.0X +GenerateExec Benchmark wholestage on 56423 58047 1028 1.8 564.2 1.8X diff --git a/sql/core/benchmarks/HashedRelationMetricsBenchmark-jdk11-results.txt b/sql/core/benchmarks/HashedRelationMetricsBenchmark-jdk11-results.txt index e01561364b989..fd40ab7799278 100644 --- a/sql/core/benchmarks/HashedRelationMetricsBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/HashedRelationMetricsBenchmark-jdk11-results.txt @@ -2,10 +2,10 @@ LongToUnsafeRowMap metrics ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz LongToUnsafeRowMap metrics: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -LongToUnsafeRowMap 568 575 5 0.9 1136.4 1.0X +LongToUnsafeRowMap 709 759 51 0.7 1417.4 1.0X diff --git a/sql/core/benchmarks/HashedRelationMetricsBenchmark-results.txt b/sql/core/benchmarks/HashedRelationMetricsBenchmark-results.txt index 7483f517a62e8..5ba6600aad885 100644 --- a/sql/core/benchmarks/HashedRelationMetricsBenchmark-results.txt +++ b/sql/core/benchmarks/HashedRelationMetricsBenchmark-results.txt @@ -2,10 +2,10 @@ LongToUnsafeRowMap metrics ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz LongToUnsafeRowMap metrics: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -LongToUnsafeRowMap 513 629 106 1.0 1026.6 1.0X +LongToUnsafeRowMap 613 622 13 0.8 1225.3 1.0X diff --git a/sql/core/benchmarks/InExpressionBenchmark-jdk11-results.txt b/sql/core/benchmarks/InExpressionBenchmark-jdk11-results.txt index 04474566ef43d..b462065fde6b6 100644 --- a/sql/core/benchmarks/InExpressionBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/InExpressionBenchmark-jdk11-results.txt @@ -2,739 +2,739 @@ In Expression Benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 5 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 163 213 53 61.4 16.3 1.0X -InSet expression 105 130 16 95.5 10.5 1.6X +In expression 56 78 27 179.9 5.6 1.0X +InSet expression 47 63 21 210.5 4.7 1.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 10 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 112 126 9 89.4 11.2 1.0X -InSet expression 78 92 11 128.4 7.8 1.4X +In expression 68 73 6 146.7 6.8 1.0X +InSet expression 51 66 19 196.8 5.1 1.3X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 25 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 170 181 8 58.9 17.0 1.0X -InSet expression 109 118 9 91.8 10.9 1.6X +In expression 113 117 4 88.3 11.3 1.0X +InSet expression 69 73 4 145.7 6.9 1.7X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 50 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 279 283 3 35.8 27.9 1.0X -InSet expression 140 148 8 71.6 14.0 2.0X +In expression 189 194 6 52.9 18.9 1.0X +InSet expression 101 106 4 99.4 10.1 1.9X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 100 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 461 486 28 21.7 46.1 1.0X -InSet expression 184 187 3 54.5 18.4 2.5X +In expression 343 348 4 29.1 34.3 1.0X +InSet expression 171 179 9 58.5 17.1 2.0X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 200 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 735 754 16 13.6 73.5 1.0X -InSet expression 317 323 5 31.6 31.7 2.3X +In expression 556 561 8 18.0 55.6 1.0X +InSet expression 302 311 7 33.1 30.2 1.8X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 5 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 63 68 5 157.8 6.3 1.0X -InSet expression 56 61 4 177.7 5.6 1.1X +In expression 43 52 16 234.0 4.3 1.0X +InSet expression 36 46 14 274.3 3.6 1.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 10 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 84 87 2 118.8 8.4 1.0X -InSet expression 58 62 4 171.6 5.8 1.4X +In expression 49 56 11 203.7 4.9 1.0X +InSet expression 35 46 15 281.8 3.5 1.4X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 25 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 139 146 10 72.0 13.9 1.0X -InSet expression 58 63 7 173.5 5.8 2.4X +In expression 81 90 12 123.3 8.1 1.0X +InSet expression 36 44 10 275.0 3.6 2.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 50 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 231 236 7 43.3 23.1 1.0X -InSet expression 59 64 8 170.5 5.9 3.9X +In expression 130 138 16 76.9 13.0 1.0X +InSet expression 37 44 13 269.9 3.7 3.5X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 100 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 411 414 3 24.3 41.1 1.0X -InSet expression 64 72 8 155.4 6.4 6.4X +In expression 228 238 13 43.8 22.8 1.0X +InSet expression 41 50 12 243.9 4.1 5.6X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 200 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 775 779 6 12.9 77.5 1.0X -InSet expression 70 74 4 142.7 7.0 11.1X +In expression 428 436 7 23.3 42.8 1.0X +InSet expression 48 57 11 206.2 4.8 8.8X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 300 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1129 1133 3 8.9 112.9 1.0X -InSet expression 86 91 6 116.9 8.6 13.2X +In expression 630 634 4 15.9 63.0 1.0X +InSet expression 57 60 5 176.4 5.7 11.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 400 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1574 1577 3 6.4 157.4 1.0X -InSet expression 89 92 4 112.9 8.9 17.8X +In expression 1129 1136 5 8.9 112.9 1.0X +InSet expression 65 68 3 153.1 6.5 17.3X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 500 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1865 1914 100 5.4 186.5 1.0X -InSet expression 275 279 4 36.3 27.5 6.8X +In expression 1598 1641 72 6.3 159.8 1.0X +InSet expression 314 324 11 31.8 31.4 5.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 5 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 63 66 4 158.5 6.3 1.0X -InSet expression 62 68 14 160.7 6.2 1.0X +In expression 36 43 15 276.7 3.6 1.0X +InSet expression 38 47 14 261.5 3.8 0.9X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 10 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 81 87 10 124.0 8.1 1.0X -InSet expression 70 82 15 142.4 7.0 1.1X +In expression 48 55 13 209.1 4.8 1.0X +InSet expression 44 51 12 227.8 4.4 1.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 25 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 142 145 5 70.4 14.2 1.0X -InSet expression 78 80 3 128.4 7.8 1.8X +In expression 80 89 13 124.4 8.0 1.0X +InSet expression 50 65 23 200.6 5.0 1.6X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 50 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 229 235 14 43.8 22.9 1.0X -InSet expression 91 94 4 109.5 9.1 2.5X +In expression 132 140 13 75.5 13.2 1.0X +InSet expression 58 65 11 173.6 5.8 2.3X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 100 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 409 411 2 24.4 40.9 1.0X -InSet expression 108 112 5 92.9 10.8 3.8X +In expression 227 241 23 44.0 22.7 1.0X +InSet expression 65 78 24 153.0 6.5 3.5X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 200 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 772 779 8 12.9 77.2 1.0X -InSet expression 126 131 4 79.6 12.6 6.1X +In expression 427 430 3 23.4 42.7 1.0X +InSet expression 77 84 11 130.0 7.7 5.6X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 300 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1138 1144 6 8.8 113.8 1.0X -InSet expression 136 140 6 73.5 13.6 8.4X +In expression 633 636 4 15.8 63.3 1.0X +InSet expression 88 96 12 113.1 8.8 7.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 400 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1500 1504 3 6.7 150.0 1.0X -InSet expression 148 154 6 67.7 14.8 10.2X +In expression 1260 1264 5 7.9 126.0 1.0X +InSet expression 98 100 2 102.2 9.8 12.9X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 500 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1932 1969 72 5.2 193.2 1.0X -InSet expression 275 278 3 36.3 27.5 7.0X +In expression 1646 1648 2 6.1 164.6 1.0X +InSet expression 316 322 7 31.7 31.6 5.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 5 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 57 59 2 174.1 5.7 1.0X -InSet expression 53 57 5 187.1 5.3 1.1X +In expression 33 39 11 302.2 3.3 1.0X +InSet expression 29 35 10 343.6 2.9 1.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 10 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 76 79 7 131.9 7.6 1.0X -InSet expression 54 57 8 186.1 5.4 1.4X +In expression 43 48 9 231.6 4.3 1.0X +InSet expression 29 36 10 339.2 2.9 1.5X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 25 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 128 132 3 77.9 12.8 1.0X -InSet expression 55 58 4 183.2 5.5 2.4X +In expression 75 85 13 132.7 7.5 1.0X +InSet expression 32 39 12 314.4 3.2 2.4X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 50 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 227 237 11 44.1 22.7 1.0X -InSet expression 56 58 2 178.0 5.6 4.0X +In expression 128 134 12 78.0 12.8 1.0X +InSet expression 34 44 15 295.4 3.4 3.8X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 100 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 407 413 9 24.5 40.7 1.0X -InSet expression 59 64 7 169.0 5.9 6.9X +In expression 225 231 14 44.5 22.5 1.0X +InSet expression 37 45 15 269.1 3.7 6.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 200 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 772 775 4 13.0 77.2 1.0X -InSet expression 67 70 5 148.7 6.7 11.5X +In expression 420 422 2 23.8 42.0 1.0X +InSet expression 44 51 10 226.7 4.4 9.5X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 300 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1128 1132 3 8.9 112.8 1.0X -InSet expression 75 77 2 133.6 7.5 15.1X +In expression 618 619 1 16.2 61.8 1.0X +InSet expression 53 61 12 188.0 5.3 11.6X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 400 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1502 1507 6 6.7 150.2 1.0X -InSet expression 82 84 2 121.6 8.2 18.3X +In expression 1154 1158 4 8.7 115.4 1.0X +InSet expression 58 60 2 172.1 5.8 19.9X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 500 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1860 1897 75 5.4 186.0 1.0X -InSet expression 246 249 2 40.7 24.6 7.6X +In expression 1598 1635 73 6.3 159.8 1.0X +InSet expression 307 314 6 32.6 30.7 5.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 5 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 46 48 3 219.3 4.6 1.0X -InSet expression 40 41 2 251.6 4.0 1.1X +In expression 24 30 9 410.7 2.4 1.0X +InSet expression 19 24 9 526.3 1.9 1.3X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 10 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 65 67 2 154.5 6.5 1.0X -InSet expression 45 47 2 221.2 4.5 1.4X +In expression 34 39 9 294.8 3.4 1.0X +InSet expression 21 27 9 470.2 2.1 1.6X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 25 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 121 124 3 82.5 12.1 1.0X -InSet expression 46 49 4 217.2 4.6 2.6X +In expression 69 77 22 145.9 6.9 1.0X +InSet expression 26 34 12 384.8 2.6 2.6X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 50 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 214 216 2 46.7 21.4 1.0X -InSet expression 57 59 3 175.3 5.7 3.8X +In expression 205 209 2 48.7 20.5 1.0X +InSet expression 30 37 10 330.7 3.0 6.8X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 100 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 400 406 6 25.0 40.0 1.0X -InSet expression 58 61 3 173.9 5.8 7.0X +In expression 401 411 18 24.9 40.1 1.0X +InSet expression 37 44 10 271.5 3.7 10.9X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 200 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 762 765 2 13.1 76.2 1.0X -InSet expression 69 71 3 145.5 6.9 11.1X +In expression 792 794 2 12.6 79.2 1.0X +InSet expression 43 51 11 230.5 4.3 18.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 300 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1116 1122 4 9.0 111.6 1.0X -InSet expression 84 87 2 118.5 8.4 13.2X +In expression 1174 1179 3 8.5 117.4 1.0X +InSet expression 51 58 11 195.1 5.1 22.9X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 400 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1491 1498 5 6.7 149.1 1.0X -InSet expression 88 91 2 113.4 8.8 16.9X +In expression 1572 1579 6 6.4 157.2 1.0X +InSet expression 58 61 6 171.4 5.8 27.0X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 500 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1858 1909 109 5.4 185.8 1.0X -InSet expression 247 249 2 40.5 24.7 7.5X +In expression 1965 2000 70 5.1 196.5 1.0X +InSet expression 312 317 4 32.0 31.2 6.3X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 5 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 53 54 2 190.2 5.3 1.0X -InSet expression 156 162 13 64.3 15.6 0.3X +In expression 31 37 8 318.6 3.1 1.0X +InSet expression 165 175 11 60.7 16.5 0.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 10 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 67 69 3 149.9 6.7 1.0X -InSet expression 171 174 2 58.5 17.1 0.4X +In expression 42 48 11 240.6 4.2 1.0X +InSet expression 183 192 12 54.7 18.3 0.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 25 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 120 122 4 83.0 12.0 1.0X -InSet expression 178 181 1 56.2 17.8 0.7X +In expression 73 79 11 136.3 7.3 1.0X +InSet expression 190 197 8 52.5 19.0 0.4X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 50 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 212 213 2 47.2 21.2 1.0X -InSet expression 222 224 3 45.0 22.2 1.0X +In expression 124 132 14 80.5 12.4 1.0X +InSet expression 237 241 3 42.2 23.7 0.5X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 100 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 393 398 4 25.5 39.3 1.0X -InSet expression 193 197 2 51.8 19.3 2.0X +In expression 223 225 2 44.8 22.3 1.0X +InSet expression 209 216 9 47.9 20.9 1.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 200 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 756 763 7 13.2 75.6 1.0X -InSet expression 186 188 2 53.8 18.6 4.1X +In expression 419 433 25 23.9 41.9 1.0X +InSet expression 197 206 10 50.8 19.7 2.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 5 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 92 94 4 109.1 9.2 1.0X -InSet expression 205 208 2 48.8 20.5 0.4X +In expression 50 56 10 200.0 5.0 1.0X +InSet expression 200 208 7 49.9 20.0 0.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 10 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 140 141 2 71.6 14.0 1.0X -InSet expression 232 235 2 43.0 23.2 0.6X +In expression 70 76 10 142.5 7.0 1.0X +InSet expression 228 231 3 43.8 22.8 0.3X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 25 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 247 250 5 40.5 24.7 1.0X -InSet expression 240 242 3 41.6 24.0 1.0X +In expression 135 145 14 74.1 13.5 1.0X +InSet expression 229 233 2 43.7 22.9 0.6X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 50 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 426 429 5 23.5 42.6 1.0X -InSet expression 290 293 4 34.5 29.0 1.5X +In expression 239 253 23 41.8 23.9 1.0X +InSet expression 288 291 3 34.7 28.8 0.8X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 100 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 785 787 2 12.7 78.5 1.0X -InSet expression 250 252 2 40.0 25.0 3.1X +In expression 437 441 3 22.9 43.7 1.0X +InSet expression 248 257 10 40.3 24.8 1.8X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 200 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 3101 3190 192 3.2 310.1 1.0X -InSet expression 251 252 1 39.8 25.1 12.3X +In expression 3017 3058 77 3.3 301.7 1.0X +InSet expression 245 252 6 40.8 24.5 12.3X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 5 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 89 92 4 112.1 8.9 1.0X -InSet expression 171 175 2 58.4 17.1 0.5X +In expression 50 56 9 199.1 5.0 1.0X +InSet expression 203 214 9 49.2 20.3 0.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 10 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 135 136 2 73.9 13.5 1.0X -InSet expression 191 194 1 52.4 19.1 0.7X +In expression 70 79 14 143.6 7.0 1.0X +InSet expression 229 237 11 43.7 22.9 0.3X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 25 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 243 245 2 41.2 24.3 1.0X -InSet expression 199 201 1 50.4 19.9 1.2X +In expression 136 144 14 73.8 13.6 1.0X +InSet expression 234 241 8 42.8 23.4 0.6X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 50 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 420 423 2 23.8 42.0 1.0X -InSet expression 242 244 2 41.3 24.2 1.7X +In expression 234 251 23 42.8 23.4 1.0X +InSet expression 289 298 11 34.6 28.9 0.8X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 100 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 774 776 2 12.9 77.4 1.0X -InSet expression 210 216 5 47.7 21.0 3.7X +In expression 430 444 26 23.3 43.0 1.0X +InSet expression 255 263 10 39.2 25.5 1.7X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 200 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 3627 3744 248 2.8 362.7 1.0X -InSet expression 202 206 2 49.4 20.2 17.9X +In expression 3397 3469 129 2.9 339.7 1.0X +InSet expression 241 249 9 41.4 24.1 14.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 5 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 52 55 4 19.2 52.1 1.0X -InSet expression 158 172 24 6.3 158.0 0.3X +In expression 36 40 5 27.5 36.4 1.0X +InSet expression 150 156 10 6.7 149.8 0.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 10 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 63 64 2 16.0 62.6 1.0X -InSet expression 160 164 4 6.2 160.1 0.4X +In expression 44 47 4 22.7 44.0 1.0X +InSet expression 150 161 13 6.7 150.2 0.3X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 25 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 97 99 2 10.3 97.2 1.0X -InSet expression 163 166 2 6.1 163.2 0.6X +In expression 68 71 5 14.7 67.8 1.0X +InSet expression 155 170 25 6.4 155.1 0.4X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 50 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 184 186 2 5.4 184.4 1.0X -InSet expression 173 176 2 5.8 173.0 1.1X +In expression 167 169 2 6.0 166.6 1.0X +InSet expression 165 176 15 6.1 164.7 1.0X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 100 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 472 478 9 2.1 472.4 1.0X -InSet expression 178 181 4 5.6 177.6 2.7X +In expression 465 470 4 2.1 465.5 1.0X +InSet expression 168 173 3 6.0 167.7 2.8X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 200 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1054 1184 282 0.9 1053.8 1.0X -InSet expression 188 191 1 5.3 187.9 5.6X +In expression 1042 1131 173 1.0 1042.1 1.0X +InSet expression 176 190 22 5.7 176.1 5.9X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 5 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 275 282 8 3.6 274.7 1.0X -InSet expression 195 199 8 5.1 194.7 1.4X +In expression 233 243 22 4.3 233.0 1.0X +InSet expression 174 185 9 5.7 174.1 1.3X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 10 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 458 470 8 2.2 458.4 1.0X -InSet expression 195 200 5 5.1 195.5 2.3X +In expression 401 425 25 2.5 401.5 1.0X +InSet expression 177 189 15 5.6 177.3 2.3X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 25 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1093 1099 6 0.9 1093.3 1.0X -InSet expression 202 204 1 4.9 202.2 5.4X +In expression 963 978 19 1.0 963.4 1.0X +InSet expression 185 195 11 5.4 184.7 5.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 50 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 2091 2101 12 0.5 2090.6 1.0X -InSet expression 207 210 2 4.8 206.7 10.1X +In expression 1876 1905 43 0.5 1875.8 1.0X +InSet expression 196 207 15 5.1 196.0 9.6X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 100 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 4164 4187 16 0.2 4164.1 1.0X -InSet expression 239 244 4 4.2 239.1 17.4X +In expression 3784 3805 23 0.3 3783.5 1.0X +InSet expression 220 234 21 4.5 220.1 17.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 200 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 8331 8353 21 0.1 8330.7 1.0X -InSet expression 251 252 1 4.0 250.7 33.2X +In expression 7528 7548 31 0.1 7527.8 1.0X +InSet expression 231 243 14 4.3 231.0 32.6X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 5 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 66 67 2 15.2 65.8 1.0X -InSet expression 81 84 6 12.3 81.0 0.8X +In expression 50 54 5 19.9 50.2 1.0X +InSet expression 71 75 6 14.1 71.0 0.7X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 10 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 70 72 2 14.3 70.1 1.0X -InSet expression 84 86 2 12.0 83.6 0.8X +In expression 55 58 5 18.0 55.4 1.0X +InSet expression 75 79 6 13.4 74.6 0.7X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 25 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 89 92 3 11.2 89.3 1.0X -InSet expression 92 94 2 10.9 92.2 1.0X +In expression 88 91 4 11.4 87.6 1.0X +InSet expression 83 88 7 12.0 83.2 1.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 50 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 123 125 2 8.1 123.0 1.0X -InSet expression 95 97 2 10.6 94.7 1.3X +In expression 195 200 5 5.1 195.1 1.0X +InSet expression 86 92 7 11.7 85.8 2.3X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 100 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 221 223 2 4.5 220.7 1.0X -InSet expression 92 94 3 10.9 91.7 2.4X +In expression 452 454 2 2.2 451.6 1.0X +InSet expression 85 91 6 11.8 85.0 5.3X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 200 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 753 903 327 1.3 752.9 1.0X -InSet expression 97 100 3 10.3 97.2 7.7X +In expression 950 1050 196 1.1 950.4 1.0X +InSet expression 92 98 6 10.8 92.2 10.3X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 5 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 48 49 2 209.3 4.8 1.0X -InSet expression 178 181 2 56.1 17.8 0.3X +In expression 25 31 9 402.5 2.5 1.0X +InSet expression 174 183 10 57.5 17.4 0.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 10 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 65 67 4 154.9 6.5 1.0X -InSet expression 196 198 1 50.9 19.6 0.3X +In expression 33 38 9 303.9 3.3 1.0X +InSet expression 193 204 12 51.8 19.3 0.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 25 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 118 121 6 84.5 11.8 1.0X -InSet expression 259 261 1 38.6 25.9 0.5X +In expression 68 75 12 147.6 6.8 1.0X +InSet expression 243 249 11 41.2 24.3 0.3X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 50 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 199 201 1 50.2 19.9 1.0X -InSet expression 280 282 3 35.7 28.0 0.7X +In expression 120 130 14 83.5 12.0 1.0X +InSet expression 262 267 4 38.2 26.2 0.5X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 100 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 368 370 2 27.1 36.8 1.0X -InSet expression 252 254 2 39.7 25.2 1.5X +In expression 220 232 27 45.4 22.0 1.0X +InSet expression 240 247 7 41.7 24.0 0.9X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 200 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 710 715 3 14.1 71.0 1.0X -InSet expression 251 255 6 39.8 25.1 2.8X +In expression 428 432 4 23.4 42.8 1.0X +InSet expression 237 247 11 42.2 23.7 1.8X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 5 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 699 701 2 14.3 69.9 1.0X -InSet expression 695 695 1 14.4 69.5 1.0X +In expression 681 695 18 14.7 68.1 1.0X +InSet expression 684 694 13 14.6 68.4 1.0X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 10 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 700 703 2 14.3 70.0 1.0X -InSet expression 700 701 1 14.3 70.0 1.0X +In expression 712 725 19 14.0 71.2 1.0X +InSet expression 671 680 17 14.9 67.1 1.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 25 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 742 746 3 13.5 74.2 1.0X -InSet expression 704 706 1 14.2 70.4 1.1X +In expression 753 771 21 13.3 75.3 1.0X +InSet expression 669 688 17 15.0 66.9 1.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 50 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 839 840 2 11.9 83.9 1.0X -InSet expression 710 713 2 14.1 71.0 1.2X +In expression 835 849 15 12.0 83.5 1.0X +InSet expression 692 713 17 14.4 69.2 1.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 100 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1027 1030 2 9.7 102.7 1.0X -InSet expression 712 714 1 14.0 71.2 1.4X +In expression 977 996 19 10.2 97.7 1.0X +InSet expression 693 705 19 14.4 69.3 1.4X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 200 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1390 1411 43 7.2 139.0 1.0X -InSet expression 727 730 3 13.8 72.7 1.9X +In expression 1306 1312 8 7.7 130.6 1.0X +InSet expression 705 729 23 14.2 70.5 1.9X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 300 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1767 1774 8 5.7 176.7 1.0X -InSet expression 739 741 3 13.5 73.9 2.4X +In expression 1682 1725 72 5.9 168.2 1.0X +InSet expression 716 732 20 14.0 71.6 2.3X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 400 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 2144 2155 12 4.7 214.4 1.0X -InSet expression 758 766 7 13.2 75.8 2.8X +In expression 2094 2109 17 4.8 209.4 1.0X +InSet expression 702 706 3 14.2 70.2 3.0X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 500 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 2528 2552 22 4.0 252.8 1.0X -InSet expression 865 868 2 11.6 86.5 2.9X +In expression 2465 2476 11 4.1 246.5 1.0X +InSet expression 881 903 18 11.4 88.1 2.8X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 5 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 58 61 3 17.2 58.3 1.0X -InSet expression 113 115 2 8.9 112.7 0.5X +In expression 46 50 6 21.9 45.7 1.0X +InSet expression 101 109 11 9.9 100.9 0.5X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 10 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 86 89 3 11.7 85.8 1.0X -InSet expression 113 116 2 8.8 113.3 0.8X +In expression 70 74 5 14.2 70.3 1.0X +InSet expression 101 108 8 9.9 101.4 0.7X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 25 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 278 280 2 3.6 278.4 1.0X -InSet expression 141 145 5 7.1 140.6 2.0X +In expression 255 261 4 3.9 255.5 1.0X +InSet expression 132 141 10 7.6 132.1 1.9X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 50 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 577 704 75 1.7 576.9 1.0X -InSet expression 193 196 3 5.2 193.5 3.0X +In expression 549 573 36 1.8 549.2 1.0X +InSet expression 187 197 11 5.3 187.1 2.9X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 100 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 2462 2643 375 0.4 2461.6 1.0X -InSet expression 234 238 6 4.3 234.1 10.5X +In expression 1109 1113 3 0.9 1109.4 1.0X +InSet expression 229 238 12 4.4 228.9 4.8X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 200 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 8526 9225 487 0.1 8526.5 1.0X -InSet expression 306 312 5 3.3 306.0 27.9X +In expression 2601 3125 698 0.4 2600.8 1.0X +InSet expression 310 319 10 3.2 310.3 8.4X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 5 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 51 55 7 19.5 51.3 1.0X -InSet expression 169 172 2 5.9 168.8 0.3X +In expression 37 41 6 26.9 37.1 1.0X +InSet expression 159 165 8 6.3 159.1 0.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 10 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 62 66 6 16.2 61.6 1.0X -InSet expression 170 175 7 5.9 169.9 0.4X +In expression 52 57 5 19.2 52.2 1.0X +InSet expression 162 169 4 6.2 162.4 0.3X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 25 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 141 145 3 7.1 141.4 1.0X -InSet expression 213 220 8 4.7 212.7 0.7X +In expression 125 130 4 8.0 124.8 1.0X +InSet expression 212 221 9 4.7 211.6 0.6X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 50 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 335 365 67 3.0 334.9 1.0X -InSet expression 303 309 7 3.3 303.4 1.1X +In expression 317 323 3 3.2 317.2 1.0X +InSet expression 304 312 9 3.3 304.0 1.0X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 100 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 976 1114 286 1.0 976.4 1.0X -InSet expression 358 365 10 2.8 357.5 2.7X +In expression 731 735 3 1.4 730.6 1.0X +InSet expression 372 381 8 2.7 371.6 2.0X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz 200 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 4162 4703 859 0.2 4162.5 1.0X -InSet expression 473 476 3 2.1 473.2 8.8X +In expression 1774 2026 487 0.6 1774.4 1.0X +InSet expression 506 516 12 2.0 505.5 3.5X diff --git a/sql/core/benchmarks/InExpressionBenchmark-results.txt b/sql/core/benchmarks/InExpressionBenchmark-results.txt index 36d38ea9b162b..86c975c2dd5c4 100644 --- a/sql/core/benchmarks/InExpressionBenchmark-results.txt +++ b/sql/core/benchmarks/InExpressionBenchmark-results.txt @@ -2,739 +2,739 @@ In Expression Benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 5 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 132 172 32 75.7 13.2 1.0X -InSet expression 79 98 13 125.8 7.9 1.7X +In expression 45 51 5 222.2 4.5 1.0X +InSet expression 42 47 4 239.6 4.2 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 10 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 100 111 7 99.7 10.0 1.0X -InSet expression 70 78 9 143.0 7.0 1.4X +In expression 56 63 4 177.5 5.6 1.0X +InSet expression 42 49 4 236.3 4.2 1.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 25 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 161 170 7 62.0 16.1 1.0X -InSet expression 88 93 7 113.9 8.8 1.8X +In expression 94 102 6 106.7 9.4 1.0X +InSet expression 56 64 7 178.5 5.6 1.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 50 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 270 277 6 37.0 27.0 1.0X -InSet expression 116 123 9 86.0 11.6 2.3X +In expression 150 156 7 66.9 15.0 1.0X +InSet expression 79 88 8 126.3 7.9 1.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 100 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 450 463 13 22.2 45.0 1.0X -InSet expression 182 189 7 54.9 18.2 2.5X +In expression 263 270 8 38.1 26.3 1.0X +InSet expression 127 137 6 78.9 12.7 2.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 200 bytes: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 706 714 7 14.2 70.6 1.0X -InSet expression 302 311 7 33.1 30.2 2.3X +In expression 443 449 5 22.6 44.3 1.0X +InSet expression 223 236 16 44.8 22.3 2.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 5 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 62 64 5 162.2 6.2 1.0X -InSet expression 57 59 5 176.7 5.7 1.1X +In expression 34 38 3 293.9 3.4 1.0X +InSet expression 33 38 3 299.4 3.3 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 10 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 79 82 5 126.7 7.9 1.0X -InSet expression 53 54 3 188.7 5.3 1.5X +In expression 44 47 2 229.4 4.4 1.0X +InSet expression 30 33 2 331.7 3.0 1.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 25 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 132 135 5 75.8 13.2 1.0X -InSet expression 50 53 6 200.7 5.0 2.6X +In expression 68 73 4 148.1 6.8 1.0X +InSet expression 30 34 3 328.3 3.0 2.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 50 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 228 231 4 43.8 22.8 1.0X -InSet expression 51 53 3 195.5 5.1 4.5X +In expression 106 114 5 94.3 10.6 1.0X +InSet expression 33 37 4 303.6 3.3 3.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 100 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 404 404 0 24.8 40.4 1.0X -InSet expression 58 61 4 171.0 5.8 6.9X +In expression 185 194 10 54.1 18.5 1.0X +InSet expression 35 39 4 288.5 3.5 5.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 200 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 766 767 1 13.1 76.6 1.0X -InSet expression 66 68 3 151.0 6.6 11.6X +In expression 346 355 7 28.9 34.6 1.0X +InSet expression 40 46 4 247.9 4.0 8.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 300 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1124 1124 0 8.9 112.4 1.0X -InSet expression 74 77 4 135.3 7.4 15.2X +In expression 508 522 11 19.7 50.8 1.0X +InSet expression 47 51 4 212.8 4.7 10.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 400 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1566 1567 2 6.4 156.6 1.0X -InSet expression 82 84 4 121.9 8.2 19.1X +In expression 1017 1036 20 9.8 101.7 1.0X +InSet expression 53 59 5 188.2 5.3 19.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 500 shorts: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1841 1871 37 5.4 184.1 1.0X -InSet expression 314 318 5 31.8 31.4 5.9X +In expression 1334 1360 19 7.5 133.4 1.0X +InSet expression 256 267 9 39.1 25.6 5.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 5 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 58 62 5 171.0 5.8 1.0X -InSet expression 53 55 4 187.5 5.3 1.1X +In expression 32 35 2 307.8 3.2 1.0X +InSet expression 32 36 2 312.2 3.2 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 10 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 76 77 2 131.3 7.6 1.0X -InSet expression 65 66 3 154.3 6.5 1.2X +In expression 41 44 2 241.6 4.1 1.0X +InSet expression 36 39 3 279.9 3.6 1.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 25 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 138 140 5 72.7 13.8 1.0X -InSet expression 74 78 8 135.2 7.4 1.9X +In expression 67 71 4 149.9 6.7 1.0X +InSet expression 41 44 3 246.3 4.1 1.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 50 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 226 227 1 44.2 22.6 1.0X -InSet expression 83 86 7 120.8 8.3 2.7X +In expression 106 111 4 94.1 10.6 1.0X +InSet expression 46 49 3 216.1 4.6 2.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 100 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 402 403 0 24.9 40.2 1.0X -InSet expression 93 94 3 108.0 9.3 4.3X +In expression 186 195 7 53.8 18.6 1.0X +InSet expression 54 61 5 183.8 5.4 3.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 200 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 761 762 0 13.1 76.1 1.0X -InSet expression 113 116 7 88.4 11.3 6.7X +In expression 346 363 16 28.9 34.6 1.0X +InSet expression 64 69 4 156.0 6.4 5.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 300 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1125 1125 0 8.9 112.5 1.0X -InSet expression 136 142 11 73.5 13.6 8.3X +In expression 523 541 19 19.1 52.3 1.0X +InSet expression 72 77 4 138.7 7.2 7.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 400 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1486 1487 1 6.7 148.6 1.0X -InSet expression 141 142 2 70.8 14.1 10.5X +In expression 1042 1053 10 9.6 104.2 1.0X +InSet expression 86 92 5 116.3 8.6 12.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 500 shorts (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1842 1873 67 5.4 184.2 1.0X -InSet expression 315 318 3 31.7 31.5 5.8X +In expression 1350 1369 11 7.4 135.0 1.0X +InSet expression 259 270 10 38.6 25.9 5.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 5 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 54 55 4 186.6 5.4 1.0X -InSet expression 49 51 3 203.0 4.9 1.1X +In expression 32 36 3 311.2 3.2 1.0X +InSet expression 28 31 2 357.8 2.8 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 10 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 72 74 5 139.7 7.2 1.0X -InSet expression 46 48 5 218.2 4.6 1.6X +In expression 41 44 3 245.1 4.1 1.0X +InSet expression 29 32 3 349.0 2.9 1.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 25 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 125 127 5 79.9 12.5 1.0X -InSet expression 47 48 4 212.5 4.7 2.7X +In expression 66 71 4 150.9 6.6 1.0X +InSet expression 29 32 3 339.6 2.9 2.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 50 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 221 224 4 45.2 22.1 1.0X -InSet expression 48 49 3 206.3 4.8 4.6X +In expression 103 109 5 96.7 10.3 1.0X +InSet expression 30 34 3 329.8 3.0 3.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 100 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 401 404 6 25.0 40.1 1.0X -InSet expression 55 56 2 180.5 5.5 7.2X +In expression 184 194 7 54.3 18.4 1.0X +InSet expression 33 37 3 306.6 3.3 5.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 200 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 762 763 1 13.1 76.2 1.0X -InSet expression 63 69 14 159.8 6.3 12.2X +In expression 339 350 10 29.5 33.9 1.0X +InSet expression 38 42 3 261.2 3.8 8.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 300 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1117 1117 0 9.0 111.7 1.0X -InSet expression 70 71 2 143.3 7.0 16.0X +In expression 506 512 6 19.8 50.6 1.0X +InSet expression 43 47 4 232.6 4.3 11.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 400 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1557 1558 1 6.4 155.7 1.0X -InSet expression 77 78 2 129.6 7.7 20.2X +In expression 989 1008 21 10.1 98.9 1.0X +InSet expression 51 57 4 195.1 5.1 19.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 500 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1841 1877 79 5.4 184.1 1.0X -InSet expression 320 322 2 31.2 32.0 5.8X +In expression 1398 1422 19 7.2 139.8 1.0X +InSet expression 262 274 8 38.1 26.2 5.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 5 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 43 44 3 231.6 4.3 1.0X -InSet expression 40 42 4 252.4 4.0 1.1X +In expression 22 25 2 448.9 2.2 1.0X +InSet expression 20 23 2 510.5 2.0 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 10 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 62 64 4 162.0 6.2 1.0X -InSet expression 45 47 4 222.2 4.5 1.4X +In expression 31 34 2 323.6 3.1 1.0X +InSet expression 22 24 2 454.8 2.2 1.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 25 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 117 119 4 85.4 11.7 1.0X -InSet expression 57 59 5 176.9 5.7 2.1X +In expression 55 61 3 180.5 5.5 1.0X +InSet expression 27 30 2 368.8 2.7 2.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 50 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 207 207 0 48.3 20.7 1.0X -InSet expression 65 66 3 153.3 6.5 3.2X +In expression 172 186 13 58.0 17.2 1.0X +InSet expression 31 34 3 326.2 3.1 5.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 100 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 390 394 4 25.7 39.0 1.0X -InSet expression 76 77 3 132.0 7.6 5.1X +In expression 339 358 18 29.5 33.9 1.0X +InSet expression 36 40 4 277.1 3.6 9.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 200 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 752 755 2 13.3 75.2 1.0X -InSet expression 111 112 3 90.2 11.1 6.8X +In expression 653 662 7 15.3 65.3 1.0X +InSet expression 63 67 3 159.6 6.3 10.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 300 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1106 1115 6 9.0 110.6 1.0X -InSet expression 129 130 3 77.7 12.9 8.6X +In expression 967 990 17 10.3 96.7 1.0X +InSet expression 74 81 5 135.1 7.4 13.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 400 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1476 1484 6 6.8 147.6 1.0X -InSet expression 129 130 3 77.3 12.9 11.4X +In expression 1288 1299 9 7.8 128.8 1.0X +InSet expression 80 85 5 125.6 8.0 16.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 500 ints (non-compact): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1844 1900 124 5.4 184.4 1.0X -InSet expression 321 322 2 31.2 32.1 5.7X +In expression 1600 1647 83 6.3 160.0 1.0X +InSet expression 252 258 4 39.7 25.2 6.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 5 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 50 53 5 199.5 5.0 1.0X -InSet expression 166 169 5 60.2 16.6 0.3X +In expression 23 26 2 436.1 2.3 1.0X +InSet expression 133 140 4 75.1 13.3 0.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 10 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 64 68 8 155.5 6.4 1.0X -InSet expression 186 188 4 53.9 18.6 0.3X +In expression 29 33 2 341.4 2.9 1.0X +InSet expression 148 156 6 67.5 14.8 0.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 25 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 118 119 2 84.7 11.8 1.0X -InSet expression 194 208 26 51.4 19.4 0.6X +In expression 56 61 4 179.0 5.6 1.0X +InSet expression 153 160 7 65.3 15.3 0.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 50 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 208 208 0 48.1 20.8 1.0X -InSet expression 240 244 5 41.7 24.0 0.9X +In expression 95 101 4 105.6 9.5 1.0X +InSet expression 189 206 13 52.9 18.9 0.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 100 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 390 397 10 25.6 39.0 1.0X -InSet expression 205 207 5 48.8 20.5 1.9X +In expression 179 186 6 55.8 17.9 1.0X +InSet expression 160 176 12 62.7 16.0 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 200 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 745 745 1 13.4 74.5 1.0X -InSet expression 194 197 5 51.5 19.4 3.8X +In expression 339 348 8 29.5 33.9 1.0X +InSet expression 155 163 6 64.6 15.5 2.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 5 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 90 91 1 111.2 9.0 1.0X -InSet expression 199 202 4 50.2 19.9 0.5X +In expression 46 50 3 216.0 4.6 1.0X +InSet expression 156 165 6 64.1 15.6 0.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 10 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 131 132 0 76.4 13.1 1.0X -InSet expression 221 223 2 45.2 22.1 0.6X +In expression 62 65 2 160.5 6.2 1.0X +InSet expression 177 185 6 56.6 17.7 0.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 25 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 244 245 0 40.9 24.4 1.0X -InSet expression 235 236 1 42.6 23.5 1.0X +In expression 108 118 8 93.0 10.8 1.0X +InSet expression 182 195 8 54.8 18.2 0.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 50 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 423 424 2 23.7 42.3 1.0X -InSet expression 284 285 2 35.3 28.4 1.5X +In expression 190 203 10 52.7 19.0 1.0X +InSet expression 231 239 6 43.3 23.1 0.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 100 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 777 778 1 12.9 77.7 1.0X -InSet expression 248 249 2 40.4 24.8 3.1X +In expression 353 358 5 28.4 35.3 1.0X +InSet expression 190 203 7 52.7 19.0 1.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 200 floats: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 3032 3125 203 3.3 303.2 1.0X -InSet expression 239 241 2 41.8 23.9 12.7X +In expression 2398 2491 128 4.2 239.8 1.0X +InSet expression 194 203 9 51.4 19.4 12.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 5 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 84 86 3 118.8 8.4 1.0X -InSet expression 167 168 2 59.9 16.7 0.5X +In expression 47 50 3 214.1 4.7 1.0X +InSet expression 142 153 13 70.2 14.2 0.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 10 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 126 127 1 79.1 12.6 1.0X -InSet expression 183 185 2 54.6 18.3 0.7X +In expression 58 62 3 172.9 5.8 1.0X +InSet expression 163 174 11 61.4 16.3 0.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 25 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 239 240 0 41.8 23.9 1.0X -InSet expression 189 192 4 52.9 18.9 1.3X +In expression 108 126 9 92.5 10.8 1.0X +InSet expression 173 184 9 57.8 17.3 0.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 50 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 417 417 0 24.0 41.7 1.0X -InSet expression 231 234 4 43.3 23.1 1.8X +In expression 188 196 7 53.3 18.8 1.0X +InSet expression 212 218 4 47.1 21.2 0.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 100 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 770 772 3 13.0 77.0 1.0X -InSet expression 201 204 5 49.7 20.1 3.8X +In expression 350 359 7 28.6 35.0 1.0X +InSet expression 178 188 10 56.3 17.8 2.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 200 doubles: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 3587 3686 212 2.8 358.7 1.0X -InSet expression 196 198 3 50.9 19.6 18.3X +In expression 2957 3035 91 3.4 295.7 1.0X +InSet expression 170 180 10 58.8 17.0 17.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 5 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 50 51 2 20.1 49.7 1.0X -InSet expression 151 153 3 6.6 150.7 0.3X +In expression 30 33 3 33.4 30.0 1.0X +InSet expression 110 118 10 9.1 109.6 0.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 10 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 62 62 2 16.2 61.6 1.0X -InSet expression 153 155 2 6.5 153.3 0.4X +In expression 36 40 4 28.1 35.6 1.0X +InSet expression 112 119 5 8.9 112.0 0.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 25 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 95 96 2 10.5 95.0 1.0X -InSet expression 156 158 2 6.4 156.4 0.6X +In expression 56 61 3 17.9 55.9 1.0X +InSet expression 115 122 6 8.7 114.8 0.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 50 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 175 177 5 5.7 175.2 1.0X -InSet expression 165 167 3 6.1 164.9 1.1X +In expression 126 132 6 7.9 126.3 1.0X +InSet expression 119 127 5 8.4 119.0 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 100 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 440 440 0 2.3 439.7 1.0X -InSet expression 167 169 2 6.0 167.0 2.6X +In expression 323 331 7 3.1 323.4 1.0X +InSet expression 123 131 7 8.1 123.4 2.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 200 small decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1005 1154 330 1.0 1004.8 1.0X -InSet expression 180 182 2 5.5 180.2 5.6X +In expression 790 811 16 1.3 790.1 1.0X +InSet expression 132 146 9 7.6 132.1 6.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 5 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 251 258 7 4.0 251.1 1.0X -InSet expression 193 197 3 5.2 193.2 1.3X +In expression 183 193 6 5.5 182.7 1.0X +InSet expression 132 139 5 7.6 131.8 1.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 10 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 424 437 8 2.4 424.2 1.0X -InSet expression 196 198 2 5.1 195.5 2.2X +In expression 320 340 23 3.1 319.5 1.0X +InSet expression 133 142 5 7.5 133.4 2.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 25 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1018 1023 5 1.0 1017.8 1.0X -InSet expression 203 206 3 4.9 202.9 5.0X +In expression 798 816 16 1.3 798.3 1.0X +InSet expression 137 147 7 7.3 137.1 5.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 50 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1947 1955 7 0.5 1947.5 1.0X -InSet expression 208 211 3 4.8 208.4 9.3X +In expression 1556 1592 35 0.6 1556.1 1.0X +InSet expression 141 157 14 7.1 140.6 11.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 100 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 3886 3899 10 0.3 3885.9 1.0X -InSet expression 233 235 4 4.3 232.6 16.7X +In expression 3156 3195 57 0.3 3156.2 1.0X +InSet expression 162 169 5 6.2 161.5 19.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 200 large decimals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 7702 7793 60 0.1 7701.8 1.0X -InSet expression 243 248 6 4.1 243.4 31.6X +In expression 6347 6391 49 0.2 6346.6 1.0X +InSet expression 178 186 5 5.6 178.0 35.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 5 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 132 135 4 7.6 132.1 1.0X -InSet expression 147 149 2 6.8 147.1 0.9X +In expression 96 106 8 10.4 96.1 1.0X +InSet expression 110 120 8 9.1 109.9 0.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 10 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 139 141 5 7.2 139.0 1.0X -InSet expression 150 151 2 6.7 149.6 0.9X +In expression 99 105 5 10.1 98.6 1.0X +InSet expression 112 118 5 8.9 111.8 0.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 25 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 160 161 2 6.3 159.6 1.0X -InSet expression 157 158 2 6.4 157.3 1.0X +In expression 117 123 5 8.6 116.7 1.0X +InSet expression 119 128 9 8.4 118.7 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 50 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 190 192 2 5.3 189.8 1.0X -InSet expression 160 161 2 6.2 160.5 1.2X +In expression 194 202 6 5.1 194.5 1.0X +InSet expression 122 130 6 8.2 121.8 1.6X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 100 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 264 265 2 3.8 263.8 1.0X -InSet expression 159 160 2 6.3 158.5 1.7X +In expression 373 387 12 2.7 372.5 1.0X +InSet expression 124 132 6 8.1 123.9 3.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 200 strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 735 884 327 1.4 735.4 1.0X -InSet expression 164 166 3 6.1 163.9 4.5X +In expression 751 764 11 1.3 751.0 1.0X +InSet expression 128 138 9 7.8 127.9 5.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 5 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 45 46 3 223.6 4.5 1.0X -InSet expression 162 164 3 61.6 16.2 0.3X +In expression 22 25 2 451.1 2.2 1.0X +InSet expression 138 149 12 72.6 13.8 0.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 10 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 62 65 7 161.9 6.2 1.0X -InSet expression 179 181 2 56.0 17.9 0.3X +In expression 30 33 3 332.6 3.0 1.0X +InSet expression 148 156 6 67.4 14.8 0.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 25 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 115 116 1 86.8 11.5 1.0X -InSet expression 222 225 6 45.1 22.2 0.5X +In expression 53 58 4 187.2 5.3 1.0X +InSet expression 196 204 13 51.1 19.6 0.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 50 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 198 199 1 50.6 19.8 1.0X -InSet expression 238 239 2 42.0 23.8 0.8X +In expression 94 101 5 106.9 9.4 1.0X +InSet expression 203 214 8 49.3 20.3 0.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 100 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 363 368 5 27.6 36.3 1.0X -InSet expression 222 224 2 45.0 22.2 1.6X +In expression 168 175 5 59.6 16.8 1.0X +InSet expression 185 197 9 54.0 18.5 0.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 200 timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 701 706 4 14.3 70.1 1.0X -InSet expression 226 228 3 44.2 22.6 3.1X +In expression 328 358 22 30.5 32.8 1.0X +InSet expression 175 182 6 57.0 17.5 1.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 5 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 659 665 5 15.2 65.9 1.0X -InSet expression 660 664 3 15.1 66.0 1.0X +In expression 516 527 12 19.4 51.6 1.0X +InSet expression 509 535 20 19.6 50.9 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 10 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 663 667 2 15.1 66.3 1.0X -InSet expression 659 661 2 15.2 65.9 1.0X +In expression 519 535 10 19.3 51.9 1.0X +InSet expression 506 525 14 19.8 50.6 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 25 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 700 705 4 14.3 70.0 1.0X -InSet expression 667 669 2 15.0 66.7 1.0X +In expression 547 572 19 18.3 54.7 1.0X +InSet expression 524 542 17 19.1 52.4 1.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 50 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 801 805 3 12.5 80.1 1.0X -InSet expression 675 677 1 14.8 67.5 1.2X +In expression 627 664 22 16.0 62.7 1.0X +InSet expression 550 574 20 18.2 55.0 1.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 100 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 984 987 5 10.2 98.4 1.0X -InSet expression 685 690 4 14.6 68.5 1.4X +In expression 797 812 20 12.5 79.7 1.0X +InSet expression 555 563 6 18.0 55.5 1.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 200 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1350 1356 4 7.4 135.0 1.0X -InSet expression 710 712 3 14.1 71.0 1.9X +In expression 1039 1065 24 9.6 103.9 1.0X +InSet expression 570 599 35 17.5 57.0 1.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 300 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1716 1722 6 5.8 171.6 1.0X -InSet expression 716 719 2 14.0 71.6 2.4X +In expression 1375 1392 16 7.3 137.5 1.0X +InSet expression 571 583 11 17.5 57.1 2.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 400 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 2083 2100 13 4.8 208.3 1.0X -InSet expression 742 744 1 13.5 74.2 2.8X +In expression 1650 1713 54 6.1 165.0 1.0X +InSet expression 566 580 11 17.7 56.6 2.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 500 dates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 2469 2486 11 4.1 246.9 1.0X -InSet expression 829 831 2 12.1 82.9 3.0X +In expression 2009 2052 43 5.0 200.9 1.0X +InSet expression 642 683 35 15.6 64.2 3.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 5 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 56 58 4 17.9 55.9 1.0X -InSet expression 123 124 2 8.1 123.1 0.5X +In expression 36 39 3 27.9 35.9 1.0X +InSet expression 83 88 4 12.0 83.2 0.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 10 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 83 84 2 12.1 82.7 1.0X -InSet expression 124 127 7 8.1 123.8 0.7X +In expression 59 63 3 16.9 59.2 1.0X +InSet expression 85 90 5 11.8 84.8 0.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 25 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 275 281 9 3.6 275.5 1.0X -InSet expression 155 158 4 6.4 155.2 1.8X +In expression 215 231 11 4.6 215.4 1.0X +InSet expression 108 113 4 9.3 107.6 2.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 50 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 659 718 109 1.5 659.4 1.0X -InSet expression 217 218 2 4.6 217.0 3.0X +In expression 462 473 10 2.2 462.5 1.0X +InSet expression 158 167 6 6.3 157.7 2.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 100 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 2488 2684 434 0.4 2488.4 1.0X -InSet expression 267 270 3 3.7 266.7 9.3X +In expression 965 1001 24 1.0 964.8 1.0X +InSet expression 184 200 11 5.4 183.9 5.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 200 arrays: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 9462 10091 897 0.1 9462.2 1.0X -InSet expression 347 349 2 2.9 347.4 27.2X +In expression 2142 2516 760 0.5 2142.5 1.0X +InSet expression 251 262 9 4.0 250.7 8.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 5 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 51 55 7 19.7 50.8 1.0X -InSet expression 166 168 4 6.0 166.3 0.3X +In expression 33 36 4 30.7 32.6 1.0X +InSet expression 125 132 4 8.0 125.2 0.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 10 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 66 70 5 15.1 66.4 1.0X -InSet expression 167 170 3 6.0 167.3 0.4X +In expression 43 48 5 23.2 43.1 1.0X +InSet expression 122 133 8 8.2 122.0 0.4X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 25 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 142 144 3 7.0 142.1 1.0X -InSet expression 211 215 6 4.7 211.2 0.7X +In expression 106 113 5 9.5 105.6 1.0X +InSet expression 160 172 9 6.3 160.0 0.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 50 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 375 378 5 2.7 375.5 1.0X -InSet expression 297 298 2 3.4 297.5 1.3X +In expression 294 304 9 3.4 293.6 1.0X +InSet expression 234 258 18 4.3 234.1 1.3X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 100 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 1122 1260 304 0.9 1122.2 1.0X -InSet expression 354 357 4 2.8 353.9 3.2X +In expression 687 700 8 1.5 686.7 1.0X +InSet expression 277 288 9 3.6 277.0 2.5X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz 200 structs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -In expression 5651 5989 644 0.2 5651.4 1.0X -InSet expression 471 473 2 2.1 471.0 12.0X +In expression 2864 3173 467 0.3 2864.4 1.0X +InSet expression 362 379 10 2.8 362.1 7.9X diff --git a/sql/core/benchmarks/InsertTableWithDynamicPartitionsBenchmark-jdk11-results.txt b/sql/core/benchmarks/InsertTableWithDynamicPartitionsBenchmark-jdk11-results.txt index 12fe0e1f5a7ce..33b57463daf76 100644 --- a/sql/core/benchmarks/InsertTableWithDynamicPartitionsBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/InsertTableWithDynamicPartitionsBenchmark-jdk11-results.txt @@ -1,8 +1,8 @@ -OpenJDK 64-Bit Server VM 11.0.8+10-LTS on Mac OS X 10.15.7 -Intel(R) Core(TM) i5-7360U CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz dynamic insert table benchmark, totalRows = 200000: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ---------------------------------------------------------------------------------------------------------------------------------- -one partition column, 100 partitions 16396 16688 413 0.0 81978.3 1.0X -two partition columns, 500 partitions 50356 50924 804 0.0 251777.9 0.3X -three partition columns, 2000 partitions 144342 144850 718 0.0 721710.9 0.1X +one partition column, 100 partitions 6789 6843 76 0.0 33944.4 1.0X +two partition columns, 500 partitions 17469 18429 1358 0.0 87345.0 0.4X +three partition columns, 2000 partitions 48564 49213 918 0.0 242817.5 0.1X diff --git a/sql/core/benchmarks/InsertTableWithDynamicPartitionsBenchmark-results.txt b/sql/core/benchmarks/InsertTableWithDynamicPartitionsBenchmark-results.txt index c042d74091a3b..f8f7e2a446903 100644 --- a/sql/core/benchmarks/InsertTableWithDynamicPartitionsBenchmark-results.txt +++ b/sql/core/benchmarks/InsertTableWithDynamicPartitionsBenchmark-results.txt @@ -1,8 +1,8 @@ -OpenJDK 64-Bit Server VM 1.8.0_232-b18 on Mac OS X 10.15.7 -Intel(R) Core(TM) i5-7360U CPU @ 2.30GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz dynamic insert table benchmark, totalRows = 200000: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ---------------------------------------------------------------------------------------------------------------------------------- -one partition column, 100 partitions 23370 23588 309 0.0 116848.3 1.0X -two partition columns, 500 partitions 37686 38079 555 0.0 188432.2 0.6X -three partition columns, 2000 partitions 112489 113049 792 0.0 562446.1 0.2X +one partition column, 100 partitions 5195 5197 3 0.0 25976.7 1.0X +two partition columns, 500 partitions 13231 13395 232 0.0 66154.1 0.4X +three partition columns, 2000 partitions 36808 37118 437 0.0 184041.2 0.1X diff --git a/sql/core/benchmarks/IntervalBenchmark-jdk11-results.txt b/sql/core/benchmarks/IntervalBenchmark-jdk11-results.txt index 70a64931049c0..9343c3dee5145 100644 --- a/sql/core/benchmarks/IntervalBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/IntervalBenchmark-jdk11-results.txt @@ -1,40 +1,40 @@ -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz cast strings to intervals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -prepare string w/ interval 708 829 110 1.4 708.0 1.0X -prepare string w/o interval 660 672 14 1.5 660.3 1.1X -1 units w/ interval 514 543 33 1.9 514.2 1.4X -1 units w/o interval 476 492 20 2.1 475.9 1.5X -2 units w/ interval 751 767 14 1.3 751.0 0.9X -2 units w/o interval 709 716 11 1.4 709.0 1.0X -3 units w/ interval 1541 1551 15 0.6 1540.9 0.5X -3 units w/o interval 1531 1532 1 0.7 1531.5 0.5X -4 units w/ interval 1764 1768 5 0.6 1763.5 0.4X -4 units w/o interval 1737 1745 8 0.6 1736.6 0.4X -5 units w/ interval 1920 1930 10 0.5 1919.7 0.4X -5 units w/o interval 1928 1936 11 0.5 1927.9 0.4X -6 units w/ interval 2124 2127 4 0.5 2124.2 0.3X -6 units w/o interval 2124 2125 1 0.5 2123.7 0.3X -7 units w/ interval 2525 2541 15 0.4 2525.5 0.3X -7 units w/o interval 2512 2518 11 0.4 2511.5 0.3X -8 units w/ interval 2578 2597 19 0.4 2578.1 0.3X -8 units w/o interval 2558 2562 6 0.4 2558.1 0.3X -9 units w/ interval 2742 2750 9 0.4 2741.8 0.3X -9 units w/o interval 2752 2762 11 0.4 2751.8 0.3X -10 units w/ interval 3112 3123 10 0.3 3111.9 0.2X -10 units w/o interval 3116 3130 14 0.3 3115.7 0.2X -11 units w/ interval 3255 3273 20 0.3 3255.3 0.2X -11 units w/o interval 3294 3305 14 0.3 3293.6 0.2X +prepare string w/ interval 643 653 11 1.6 643.0 1.0X +prepare string w/o interval 625 654 44 1.6 624.7 1.0X +1 units w/ interval 542 559 15 1.8 541.6 1.2X +1 units w/o interval 474 491 15 2.1 474.0 1.4X +2 units w/ interval 779 788 9 1.3 778.9 0.8X +2 units w/o interval 714 733 17 1.4 713.7 0.9X +3 units w/ interval 1689 1718 44 0.6 1688.9 0.4X +3 units w/o interval 1717 1741 23 0.6 1716.9 0.4X +4 units w/ interval 2130 2166 45 0.5 2130.3 0.3X +4 units w/o interval 2047 2061 23 0.5 2046.7 0.3X +5 units w/ interval 2296 2310 18 0.4 2295.8 0.3X +5 units w/o interval 2250 2288 33 0.4 2250.0 0.3X +6 units w/ interval 2573 2588 24 0.4 2572.6 0.2X +6 units w/o interval 2491 2517 33 0.4 2491.3 0.3X +7 units w/ interval 3087 3127 67 0.3 3086.9 0.2X +7 units w/o interval 3104 3150 46 0.3 3103.6 0.2X +8 units w/ interval 3281 3319 46 0.3 3281.1 0.2X +8 units w/o interval 3369 3442 71 0.3 3368.7 0.2X +9 units w/ interval 3436 3472 31 0.3 3436.3 0.2X +9 units w/o interval 3471 3511 39 0.3 3471.3 0.2X +10 units w/ interval 4040 4084 69 0.2 4040.1 0.2X +10 units w/o interval 4145 4170 22 0.2 4145.2 0.2X +11 units w/ interval 4345 4432 78 0.2 4345.0 0.1X +11 units w/o interval 4425 4465 68 0.2 4424.5 0.1X -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz make_interval(): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative -------------------------------------------------------------------------------------------------------------------------- -prepare make_interval() 3395 3410 16 0.3 3395.0 1.0X -make_interval(0, 1, 2, 3, 4, 5, 50.123456) 94 102 9 10.7 93.8 36.2X -make_interval(*, *, 2, 3, 4, 5, 50.123456) 136 139 4 7.3 136.5 24.9X -make_interval(0, 1, *, *, 4, 5, 50.123456) 115 119 4 8.7 114.8 29.6X -make_interval(0, 1, 2, 3, *, *, *) 3359 3382 37 0.3 3358.7 1.0X -make_interval(*, *, *, *, *, *, *) 3382 3388 9 0.3 3382.3 1.0X +prepare make_interval() 3911 3961 44 0.3 3910.6 1.0X +make_interval(0, 1, 2, 3, 4, 5, 50.123456) 66 66 0 15.2 65.8 59.4X +make_interval(*, *, 2, 3, 4, 5, 50.123456) 95 99 5 10.5 95.2 41.1X +make_interval(0, 1, *, *, 4, 5, 50.123456) 110 112 2 9.1 110.2 35.5X +make_interval(0, 1, 2, 3, *, *, *) 4004 4050 42 0.2 4003.6 1.0X +make_interval(*, *, *, *, *, *, *) 3942 3957 13 0.3 3942.4 1.0X diff --git a/sql/core/benchmarks/IntervalBenchmark-results.txt b/sql/core/benchmarks/IntervalBenchmark-results.txt index 98b9f55c2e15e..d05429b4dcf75 100644 --- a/sql/core/benchmarks/IntervalBenchmark-results.txt +++ b/sql/core/benchmarks/IntervalBenchmark-results.txt @@ -1,40 +1,40 @@ -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz cast strings to intervals: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -prepare string w/ interval 677 718 40 1.5 677.2 1.0X -prepare string w/o interval 602 624 19 1.7 602.2 1.1X -1 units w/ interval 582 598 20 1.7 581.8 1.2X -1 units w/o interval 549 591 64 1.8 549.1 1.2X -2 units w/ interval 758 773 14 1.3 758.2 0.9X -2 units w/o interval 723 738 14 1.4 722.6 0.9X -3 units w/ interval 1442 1450 11 0.7 1441.8 0.5X -3 units w/o interval 1426 1429 3 0.7 1426.4 0.5X -4 units w/ interval 1645 1652 11 0.6 1645.1 0.4X -4 units w/o interval 1618 1626 10 0.6 1617.6 0.4X -5 units w/ interval 1794 1803 13 0.6 1794.4 0.4X -5 units w/o interval 1783 1793 9 0.6 1783.2 0.4X -6 units w/ interval 1976 1984 11 0.5 1976.2 0.3X -6 units w/o interval 1948 1959 10 0.5 1947.9 0.3X -7 units w/ interval 2394 2408 18 0.4 2393.7 0.3X -7 units w/o interval 2387 2392 8 0.4 2386.8 0.3X -8 units w/ interval 2578 2588 15 0.4 2577.5 0.3X -8 units w/o interval 2572 2578 5 0.4 2571.8 0.3X -9 units w/ interval 2812 2829 19 0.4 2811.7 0.2X -9 units w/o interval 2811 2816 4 0.4 2810.7 0.2X -10 units w/ interval 3108 3116 10 0.3 3107.8 0.2X -10 units w/o interval 3107 3109 3 0.3 3106.8 0.2X -11 units w/ interval 3386 3392 8 0.3 3386.3 0.2X -11 units w/o interval 3374 3377 4 0.3 3374.0 0.2X +prepare string w/ interval 638 642 4 1.6 637.6 1.0X +prepare string w/o interval 637 640 5 1.6 636.6 1.0X +1 units w/ interval 652 673 18 1.5 652.4 1.0X +1 units w/o interval 610 624 12 1.6 610.4 1.0X +2 units w/ interval 795 800 7 1.3 794.9 0.8X +2 units w/o interval 773 812 35 1.3 773.3 0.8X +3 units w/ interval 1713 1756 38 0.6 1713.3 0.4X +3 units w/o interval 1714 1747 37 0.6 1714.3 0.4X +4 units w/ interval 1945 1980 50 0.5 1944.9 0.3X +4 units w/o interval 1923 1986 55 0.5 1922.8 0.3X +5 units w/ interval 2138 2184 42 0.5 2138.4 0.3X +5 units w/o interval 2149 2174 35 0.5 2148.5 0.3X +6 units w/ interval 2383 2418 33 0.4 2383.0 0.3X +6 units w/o interval 2413 2432 23 0.4 2412.9 0.3X +7 units w/ interval 2976 3005 25 0.3 2976.1 0.2X +7 units w/o interval 2955 2995 56 0.3 2954.9 0.2X +8 units w/ interval 3256 3303 42 0.3 3256.1 0.2X +8 units w/o interval 3264 3320 49 0.3 3263.9 0.2X +9 units w/ interval 3587 3616 27 0.3 3587.0 0.2X +9 units w/o interval 3613 3681 82 0.3 3613.5 0.2X +10 units w/ interval 3972 3994 19 0.3 3972.4 0.2X +10 units w/o interval 3934 3984 48 0.3 3933.7 0.2X +11 units w/ interval 4226 4233 6 0.2 4226.1 0.2X +11 units w/o interval 4172 4222 64 0.2 4171.9 0.2X -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz make_interval(): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative -------------------------------------------------------------------------------------------------------------------------- -prepare make_interval() 3634 3684 47 0.3 3634.1 1.0X -make_interval(0, 1, 2, 3, 4, 5, 50.123456) 90 100 12 11.1 90.0 40.4X -make_interval(*, *, 2, 3, 4, 5, 50.123456) 114 119 5 8.8 114.3 31.8X -make_interval(0, 1, *, *, 4, 5, 50.123456) 121 138 21 8.3 120.7 30.1X -make_interval(0, 1, 2, 3, *, *, *) 3615 3621 9 0.3 3614.7 1.0X -make_interval(*, *, *, *, *, *, *) 3638 3657 21 0.3 3637.7 1.0X +prepare make_interval() 4533 4626 91 0.2 4532.8 1.0X +make_interval(0, 1, 2, 3, 4, 5, 50.123456) 68 68 0 14.7 67.9 66.7X +make_interval(*, *, 2, 3, 4, 5, 50.123456) 92 98 6 10.8 92.3 49.1X +make_interval(0, 1, *, *, 4, 5, 50.123456) 103 107 6 9.7 102.8 44.1X +make_interval(0, 1, 2, 3, *, *, *) 4521 4576 47 0.2 4521.4 1.0X +make_interval(*, *, *, *, *, *, *) 4580 4591 11 0.2 4579.9 1.0X diff --git a/sql/core/benchmarks/JoinBenchmark-jdk11-results.txt b/sql/core/benchmarks/JoinBenchmark-jdk11-results.txt index 529fc1364c9ad..7c90d77acf9e1 100644 --- a/sql/core/benchmarks/JoinBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/JoinBenchmark-jdk11-results.txt @@ -2,81 +2,81 @@ Join Benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Join w long wholestage off 3931 3998 95 5.3 187.4 1.0X -Join w long wholestage on 1507 1769 178 13.9 71.9 2.6X +Join w long wholestage off 5102 5104 2 4.1 243.3 1.0X +Join w long wholestage on 1557 1602 43 13.5 74.2 3.3X -OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Join w long duplicated: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Join w long duplicated wholestage off 5582 5617 50 3.8 266.2 1.0X -Join w long duplicated wholestage on 1435 1451 19 14.6 68.4 3.9X +Join w long duplicated wholestage off 5824 5825 1 3.6 277.7 1.0X +Join w long duplicated wholestage on 1558 1650 91 13.5 74.3 3.7X -OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Join w 2 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Join w 2 ints wholestage off 171470 171478 11 0.1 8176.3 1.0X -Join w 2 ints wholestage on 166612 166762 123 0.1 7944.7 1.0X +Join w 2 ints wholestage off 253807 254193 546 0.1 12102.4 1.0X +Join w 2 ints wholestage on 340317 342234 NaN 0.1 16227.6 0.7X -OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Join w 2 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Join w 2 longs wholestage off 6065 6093 40 3.5 289.2 1.0X -Join w 2 longs wholestage on 3285 3375 97 6.4 156.7 1.8X +Join w 2 longs wholestage off 8169 8222 76 2.6 389.5 1.0X +Join w 2 longs wholestage on 4078 4176 80 5.1 194.4 2.0X -OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Join w 2 longs duplicated: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Join w 2 longs duplicated wholestage off 14969 15027 82 1.4 713.8 1.0X -Join w 2 longs duplicated wholestage on 7902 8151 406 2.7 376.8 1.9X +Join w 2 longs duplicated wholestage off 17448 17625 251 1.2 832.0 1.0X +Join w 2 longs duplicated wholestage on 10282 10407 106 2.0 490.3 1.7X -OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz outer join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -outer join w long wholestage off 2822 2823 1 7.4 134.6 1.0X -outer join w long wholestage on 1419 1436 19 14.8 67.7 2.0X +outer join w long wholestage off 3053 3102 70 6.9 145.6 1.0X +outer join w long wholestage on 1628 1683 71 12.9 77.6 1.9X -OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz semi join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -semi join w long wholestage off 1821 1832 15 11.5 86.8 1.0X -semi join w long wholestage on 828 853 36 25.3 39.5 2.2X +semi join w long wholestage off 1912 1917 6 11.0 91.2 1.0X +semi join w long wholestage on 960 1057 88 21.8 45.8 2.0X -OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz sort merge join: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -sort merge join wholestage off 1371 1380 13 1.5 653.7 1.0X -sort merge join wholestage on 1197 1244 37 1.8 570.9 1.1X +sort merge join wholestage off 1587 1617 43 1.3 756.6 1.0X +sort merge join wholestage on 1358 1413 98 1.5 647.7 1.2X -OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz sort merge join with duplicates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------------ -sort merge join with duplicates wholestage off 1920 1933 20 1.1 915.3 1.0X -sort merge join with duplicates wholestage on 1871 1912 27 1.1 892.0 1.0X +sort merge join with duplicates wholestage off 2232 2259 39 0.9 1064.1 1.0X +sort merge join with duplicates wholestage on 1921 2030 99 1.1 916.1 1.2X -OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz shuffle hash join: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -shuffle hash join wholestage off 1102 1122 28 3.8 262.8 1.0X -shuffle hash join wholestage on 657 674 13 6.4 156.6 1.7X +shuffle hash join wholestage off 1289 1333 62 3.3 307.4 1.0X +shuffle hash join wholestage on 813 879 54 5.2 193.9 1.6X -OpenJDK 64-Bit Server VM 11.0.9+11-LTS on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz broadcast nested loop join: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -broadcast nested loop join wholestage off 62922 63052 184 0.3 3000.3 1.0X -broadcast nested loop join wholestage on 30946 30972 26 0.7 1475.6 2.0X +broadcast nested loop join wholestage off 63164 63592 606 0.3 3011.9 1.0X +broadcast nested loop join wholestage on 39833 40527 660 0.5 1899.4 1.6X diff --git a/sql/core/benchmarks/JoinBenchmark-results.txt b/sql/core/benchmarks/JoinBenchmark-results.txt index 76b6a94684269..3a11fa8fde8e4 100644 --- a/sql/core/benchmarks/JoinBenchmark-results.txt +++ b/sql/core/benchmarks/JoinBenchmark-results.txt @@ -2,81 +2,81 @@ Join Benchmark ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_272-b10 on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Join w long wholestage off 3717 3779 88 5.6 177.2 1.0X -Join w long wholestage on 1283 1458 109 16.3 61.2 2.9X +Join w long wholestage off 5228 5257 42 4.0 249.3 1.0X +Join w long wholestage on 1136 1177 38 18.5 54.1 4.6X -OpenJDK 64-Bit Server VM 1.8.0_272-b10 on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Join w long duplicated: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Join w long duplicated wholestage off 5342 5378 50 3.9 254.7 1.0X -Join w long duplicated wholestage on 1559 1594 24 13.5 74.3 3.4X +Join w long duplicated wholestage off 7318 7322 5 2.9 348.9 1.0X +Join w long duplicated wholestage on 1421 1465 43 14.8 67.8 5.2X -OpenJDK 64-Bit Server VM 1.8.0_272-b10 on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Join w 2 ints: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Join w 2 ints wholestage off 169393 169454 86 0.1 8077.3 1.0X -Join w 2 ints wholestage on 165629 165648 19 0.1 7897.8 1.0X +Join w 2 ints wholestage off 155491 155901 580 0.1 7414.4 1.0X +Join w 2 ints wholestage on 146448 147523 646 0.1 6983.2 1.1X -OpenJDK 64-Bit Server VM 1.8.0_272-b10 on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Join w 2 longs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Join w 2 longs wholestage off 6194 6240 66 3.4 295.3 1.0X -Join w 2 longs wholestage on 3389 3447 55 6.2 161.6 1.8X +Join w 2 longs wholestage off 7755 7755 0 2.7 369.8 1.0X +Join w 2 longs wholestage on 2668 2697 23 7.9 127.2 2.9X -OpenJDK 64-Bit Server VM 1.8.0_272-b10 on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Join w 2 longs duplicated: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Join w 2 longs duplicated wholestage off 14445 14511 93 1.5 688.8 1.0X -Join w 2 longs duplicated wholestage on 8465 8554 120 2.5 403.6 1.7X +Join w 2 longs duplicated wholestage off 20840 20879 56 1.0 993.7 1.0X +Join w 2 longs duplicated wholestage on 8235 8376 163 2.5 392.7 2.5X -OpenJDK 64-Bit Server VM 1.8.0_272-b10 on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz outer join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -outer join w long wholestage off 2565 2582 23 8.2 122.3 1.0X -outer join w long wholestage on 1323 1339 19 15.8 63.1 1.9X +outer join w long wholestage off 2492 2529 52 8.4 118.8 1.0X +outer join w long wholestage on 1231 1275 27 17.0 58.7 2.0X -OpenJDK 64-Bit Server VM 1.8.0_272-b10 on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz semi join w long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -semi join w long wholestage off 1754 1761 11 12.0 83.6 1.0X -semi join w long wholestage on 846 859 21 24.8 40.3 2.1X +semi join w long wholestage off 1614 1636 30 13.0 77.0 1.0X +semi join w long wholestage on 712 735 35 29.5 33.9 2.3X -OpenJDK 64-Bit Server VM 1.8.0_272-b10 on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz sort merge join: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -sort merge join wholestage off 1283 1294 16 1.6 611.8 1.0X -sort merge join wholestage on 1185 1210 26 1.8 565.0 1.1X +sort merge join wholestage off 1313 1313 1 1.6 625.9 1.0X +sort merge join wholestage on 1228 1254 21 1.7 585.5 1.1X -OpenJDK 64-Bit Server VM 1.8.0_272-b10 on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz sort merge join with duplicates: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------------ -sort merge join with duplicates wholestage off 1915 1934 27 1.1 913.1 1.0X -sort merge join with duplicates wholestage on 1742 1778 36 1.2 830.7 1.1X +sort merge join with duplicates wholestage off 1837 1840 4 1.1 876.2 1.0X +sort merge join with duplicates wholestage on 1657 1686 32 1.3 790.1 1.1X -OpenJDK 64-Bit Server VM 1.8.0_272-b10 on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz shuffle hash join: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -shuffle hash join wholestage off 1037 1047 14 4.0 247.3 1.0X -shuffle hash join wholestage on 652 668 15 6.4 155.4 1.6X +shuffle hash join wholestage off 1430 1438 12 2.9 340.8 1.0X +shuffle hash join wholestage on 612 628 13 6.9 146.0 2.3X -OpenJDK 64-Bit Server VM 1.8.0_272-b10 on Linux 4.14.219-161.340.amzn2.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz broadcast nested loop join: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -broadcast nested loop join wholestage off 65666 66140 671 0.3 3131.2 1.0X -broadcast nested loop join wholestage on 29429 29523 64 0.7 1403.3 2.2X +broadcast nested loop join wholestage off 79031 79073 59 0.3 3768.5 1.0X +broadcast nested loop join wholestage on 30409 30902 383 0.7 1450.0 2.6X diff --git a/sql/core/benchmarks/JsonBenchmark-jdk11-results.txt b/sql/core/benchmarks/JsonBenchmark-jdk11-results.txt index 6f68d60ce619a..e373d38237202 100644 --- a/sql/core/benchmarks/JsonBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/JsonBenchmark-jdk11-results.txt @@ -3,118 +3,118 @@ Benchmark for performance of JSON parsing ================================================================================================ Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz JSON schema inferring: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -No encoding 70753 71127 471 1.4 707.5 1.0X -UTF-8 is set 128105 129183 1165 0.8 1281.1 0.6X +No encoding 4180 4300 122 1.2 836.1 1.0X +UTF-8 is set 5506 5566 70 0.9 1101.3 0.8X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz count a short column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -No encoding 59588 59643 73 1.7 595.9 1.0X -UTF-8 is set 97081 97122 62 1.0 970.8 0.6X +No encoding 2878 2926 58 1.7 575.6 1.0X +UTF-8 is set 4189 4239 43 1.2 837.8 0.7X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz count a wide column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -No encoding 58835 59259 659 0.2 5883.5 1.0X -UTF-8 is set 103117 103218 88 0.1 10311.7 0.6X +No encoding 6729 6876 128 0.1 6728.7 1.0X +UTF-8 is set 10313 10402 126 0.1 10312.6 0.7X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz select wide row: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -No encoding 142993 143485 436 0.0 285985.3 1.0X -UTF-8 is set 165446 165496 60 0.0 330892.4 0.9X +No encoding 15375 15551 201 0.0 307498.9 1.0X +UTF-8 is set 18257 18476 190 0.0 365135.8 0.8X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Select a subset of 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Select 10 columns 21557 21593 61 0.5 2155.7 1.0X -Select 1 column 24197 24236 35 0.4 2419.7 0.9X +Select 10 columns 2664 2673 11 0.4 2664.2 1.0X +Select 1 column 2335 2353 16 0.4 2335.3 1.1X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz creation of JSON parser per line: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Short column without encoding 9795 9820 29 1.0 979.5 1.0X -Short column with UTF-8 16442 16536 146 0.6 1644.2 0.6X -Wide column without encoding 99134 99475 300 0.1 9913.4 0.1X -Wide column with UTF-8 155913 156369 692 0.1 15591.3 0.1X +Short column without encoding 845 852 7 1.2 845.0 1.0X +Short column with UTF-8 1149 1161 12 0.9 1148.8 0.7X +Wide column without encoding 9971 9991 29 0.1 9971.1 0.1X +Wide column with UTF-8 14047 14059 14 0.1 14047.3 0.1X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz JSON functions: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Text read 671 679 7 14.9 67.1 1.0X -from_json 25356 25432 79 0.4 2535.6 0.0X -json_tuple 29464 29927 672 0.3 2946.4 0.0X -get_json_object 21841 21877 32 0.5 2184.1 0.0X +Text read 90 91 1 11.1 90.4 1.0X +from_json 2265 2291 25 0.4 2265.3 0.0X +json_tuple 2585 2607 36 0.4 2584.7 0.0X +get_json_object 2381 2388 10 0.4 2381.0 0.0X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Dataset of json strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Text read 3109 3116 12 16.1 62.2 1.0X -schema inferring 28751 28765 15 1.7 575.0 0.1X -parsing 34923 35030 151 1.4 698.5 0.1X +Text read 397 399 2 12.6 79.4 1.0X +schema inferring 3722 3770 43 1.3 744.4 0.1X +parsing 3265 3282 21 1.5 653.0 0.1X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Json files in the per-line mode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Text read 10787 10818 32 4.6 215.7 1.0X -Schema inferring 49577 49775 184 1.0 991.5 0.2X -Parsing without charset 35343 35433 87 1.4 706.9 0.3X -Parsing with UTF-8 60253 60290 35 0.8 1205.1 0.2X +Text read 1030 1037 9 4.9 206.0 1.0X +Schema inferring 4515 4560 78 1.1 902.9 0.2X +Parsing without charset 3714 3772 64 1.3 742.7 0.3X +Parsing with UTF-8 5370 5476 97 0.9 1074.1 0.2X -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Write dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Create a dataset of timestamps 2200 2209 8 4.5 220.0 1.0X -to_json(timestamp) 18410 18602 264 0.5 1841.0 0.1X -write timestamps to files 11841 12032 305 0.8 1184.1 0.2X -Create a dataset of dates 2353 2363 9 4.3 235.3 0.9X -to_json(date) 12135 12182 72 0.8 1213.5 0.2X -write dates to files 6776 6801 33 1.5 677.6 0.3X +Create a dataset of timestamps 174 178 5 5.7 174.4 1.0X +to_json(timestamp) 1354 1368 12 0.7 1353.8 0.1X +write timestamps to files 1215 1226 16 0.8 1214.5 0.1X +Create a dataset of dates 184 188 5 5.4 184.0 0.9X +to_json(date) 898 922 24 1.1 898.5 0.2X +write dates to files 708 716 10 1.4 708.1 0.2X -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Read dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -read timestamp text from files 2563 2580 20 3.9 256.3 1.0X -read timestamps from files 41261 41360 97 0.2 4126.1 0.1X -infer timestamps from files 92292 92517 243 0.1 9229.2 0.0X -read date text from files 2332 2340 11 4.3 233.2 1.1X -read date from files 18753 18768 13 0.5 1875.3 0.1X -timestamp strings 3108 3123 13 3.2 310.8 0.8X -parse timestamps from Dataset[String] 51078 51448 323 0.2 5107.8 0.1X -infer timestamps from Dataset[String] 101373 101429 65 0.1 10137.3 0.0X -date strings 4126 4138 15 2.4 412.6 0.6X -parse dates from Dataset[String] 29365 29398 30 0.3 2936.5 0.1X -from_json(timestamp) 67033 67098 63 0.1 6703.3 0.0X -from_json(date) 44495 44581 125 0.2 4449.5 0.1X +read timestamp text from files 265 285 23 3.8 265.0 1.0X +read timestamps from files 3107 3132 23 0.3 3107.1 0.1X +infer timestamps from files 6316 6365 43 0.2 6315.5 0.0X +read date text from files 241 259 19 4.2 240.6 1.1X +read date from files 1259 1278 20 0.8 1259.4 0.2X +timestamp strings 290 293 4 3.4 290.3 0.9X +parse timestamps from Dataset[String] 3324 3359 34 0.3 3324.4 0.1X +infer timestamps from Dataset[String] 6868 6979 113 0.1 6867.7 0.0X +date strings 380 384 7 2.6 379.6 0.7X +parse dates from Dataset[String] 1650 1672 20 0.6 1649.8 0.2X +from_json(timestamp) 4944 4969 33 0.2 4943.7 0.1X +from_json(date) 3188 3251 57 0.3 3188.0 0.1X -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Filters pushdown: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -w/o filters 30167 30223 48 0.0 301674.9 1.0X -pushdown disabled 30291 30311 30 0.0 302914.8 1.0X -w/ filters 901 915 14 0.1 9012.4 33.5X +w/o filters 24601 24817 219 0.0 246012.5 1.0X +pushdown disabled 24029 24183 137 0.0 240289.2 1.0X +w/ filters 782 794 12 0.1 7822.7 31.4X diff --git a/sql/core/benchmarks/JsonBenchmark-results.txt b/sql/core/benchmarks/JsonBenchmark-results.txt index 38ad9d0077f9a..0877f71ca7c62 100644 --- a/sql/core/benchmarks/JsonBenchmark-results.txt +++ b/sql/core/benchmarks/JsonBenchmark-results.txt @@ -3,118 +3,118 @@ Benchmark for performance of JSON parsing ================================================================================================ Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz JSON schema inferring: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -No encoding 78058 78116 76 1.3 780.6 1.0X -UTF-8 is set 125709 126521 1367 0.8 1257.1 0.6X +No encoding 4500 4634 132 1.1 900.1 1.0X +UTF-8 is set 6666 6700 53 0.8 1333.3 0.7X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz count a short column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -No encoding 60424 60567 188 1.7 604.2 1.0X -UTF-8 is set 92714 92864 140 1.1 927.1 0.7X +No encoding 3231 3303 88 1.5 646.2 1.0X +UTF-8 is set 5442 5513 72 0.9 1088.4 0.6X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz count a wide column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -No encoding 65047 65761 662 0.2 6504.7 1.0X -UTF-8 is set 101823 101918 113 0.1 10182.3 0.6X +No encoding 11257 11271 14 0.1 11257.4 1.0X +UTF-8 is set 13220 13469 296 0.1 13219.5 0.9X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz select wide row: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -No encoding 145471 146067 601 0.0 290941.4 1.0X -UTF-8 is set 158504 159237 635 0.0 317008.4 0.9X +No encoding 16207 16359 168 0.0 324141.3 1.0X +UTF-8 is set 17577 17811 214 0.0 351539.6 0.9X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Select a subset of 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Select 10 columns 21386 21451 112 0.5 2138.6 1.0X -Select 1 column 27172 27214 58 0.4 2717.2 0.8X +Select 10 columns 2596 2633 34 0.4 2596.3 1.0X +Select 1 column 2730 2742 12 0.4 2729.6 1.0X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz creation of JSON parser per line: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Short column without encoding 9283 9363 69 1.1 928.3 1.0X -Short column with UTF-8 15330 15369 61 0.7 1533.0 0.6X -Wide column without encoding 138885 139153 239 0.1 13888.5 0.1X -Wide column with UTF-8 177201 177650 501 0.1 17720.1 0.1X +Short column without encoding 1089 1092 4 0.9 1088.9 1.0X +Short column with UTF-8 1410 1436 22 0.7 1410.3 0.8X +Wide column without encoding 16404 16572 184 0.1 16403.5 0.1X +Wide column with UTF-8 19200 19238 57 0.1 19200.0 0.1X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz JSON functions: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Text read 1224 1243 17 8.2 122.4 1.0X -from_json 25191 25327 214 0.4 2519.1 0.0X -json_tuple 30333 30380 42 0.3 3033.3 0.0X -get_json_object 21611 21739 112 0.5 2161.1 0.1X +Text read 130 134 4 7.7 130.1 1.0X +from_json 2863 2884 19 0.3 2862.7 0.0X +json_tuple 3325 3374 44 0.3 3324.5 0.0X +get_json_object 2892 2919 25 0.3 2892.2 0.0X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Dataset of json strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Text read 5923 5941 32 8.4 118.5 1.0X -schema inferring 34089 34238 135 1.5 681.8 0.2X -parsing 44699 45952 1108 1.1 894.0 0.1X +Text read 564 584 18 8.9 112.7 1.0X +schema inferring 4592 4601 12 1.1 918.3 0.1X +parsing 4032 4109 113 1.2 806.3 0.1X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Json files in the per-line mode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Text read 9727 9776 50 5.1 194.5 1.0X -Schema inferring 52529 52643 98 1.0 1050.6 0.2X -Parsing without charset 44563 44692 132 1.1 891.3 0.2X -Parsing with UTF-8 55558 55755 218 0.9 1111.2 0.2X +Text read 1267 1282 18 3.9 253.4 1.0X +Schema inferring 5201 5277 73 1.0 1040.2 0.2X +Parsing without charset 5081 5140 64 1.0 1016.3 0.2X +Parsing with UTF-8 6554 6632 116 0.8 1310.8 0.2X -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Write dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Create a dataset of timestamps 1945 1964 22 5.1 194.5 1.0X -to_json(timestamp) 17990 18135 249 0.6 1799.0 0.1X -write timestamps to files 13198 13234 45 0.8 1319.8 0.1X -Create a dataset of dates 2202 2213 11 4.5 220.2 0.9X -to_json(date) 11219 11240 29 0.9 1121.9 0.2X -write dates to files 6932 6966 32 1.4 693.2 0.3X +Create a dataset of timestamps 218 223 6 4.6 218.0 1.0X +to_json(timestamp) 1722 1734 12 0.6 1722.5 0.1X +write timestamps to files 1490 1503 14 0.7 1489.6 0.1X +Create a dataset of dates 241 245 6 4.2 240.6 0.9X +to_json(date) 1102 1128 24 0.9 1102.2 0.2X +write dates to files 900 927 24 1.1 899.6 0.2X -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Read dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -read timestamp text from files 2354 2368 12 4.2 235.4 1.0X -read timestamps from files 43681 43771 100 0.2 4368.1 0.1X -infer timestamps from files 90608 90771 161 0.1 9060.8 0.0X -read date text from files 2121 2129 9 4.7 212.1 1.1X -read date from files 19069 19103 32 0.5 1906.9 0.1X -timestamp strings 3943 3967 24 2.5 394.3 0.6X -parse timestamps from Dataset[String] 55239 55324 74 0.2 5523.9 0.0X -infer timestamps from Dataset[String] 106155 106258 99 0.1 10615.5 0.0X -date strings 4567 4572 5 2.2 456.7 0.5X -parse dates from Dataset[String] 31258 31461 321 0.3 3125.8 0.1X -from_json(timestamp) 76499 77031 504 0.1 7649.9 0.0X -from_json(date) 44188 44199 9 0.2 4418.8 0.1X +read timestamp text from files 323 331 9 3.1 323.2 1.0X +read timestamps from files 3456 3465 9 0.3 3456.0 0.1X +infer timestamps from files 7237 7264 27 0.1 7237.2 0.0X +read date text from files 282 291 8 3.5 282.4 1.1X +read date from files 1762 1789 44 0.6 1761.6 0.2X +timestamp strings 455 466 18 2.2 454.5 0.7X +parse timestamps from Dataset[String] 3870 3937 99 0.3 3869.9 0.1X +infer timestamps from Dataset[String] 7701 7739 36 0.1 7701.5 0.0X +date strings 513 538 21 1.9 513.3 0.6X +parse dates from Dataset[String] 2102 2123 23 0.5 2102.3 0.2X +from_json(timestamp) 5846 5950 91 0.2 5846.0 0.1X +from_json(date) 3988 4010 21 0.3 3988.1 0.1X -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Filters pushdown: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -w/o filters 30314 30334 28 0.0 303139.1 1.0X -pushdown disabled 30394 30429 54 0.0 303944.7 1.0X -w/ filters 906 913 8 0.1 9059.1 33.5X +w/o filters 25621 25700 113 0.0 256214.3 1.0X +pushdown disabled 24732 24764 36 0.0 247315.8 1.0X +w/ filters 827 842 13 0.1 8274.2 31.0X diff --git a/sql/core/benchmarks/MakeDateTimeBenchmark-jdk11-results.txt b/sql/core/benchmarks/MakeDateTimeBenchmark-jdk11-results.txt index bd2dff0271c8e..c9288a260a751 100644 --- a/sql/core/benchmarks/MakeDateTimeBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/MakeDateTimeBenchmark-jdk11-results.txt @@ -1,22 +1,22 @@ -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz make_date(): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -prepare make_date() 3214 3344 209 31.1 32.1 1.0X -make_date(2019, 9, 16) 2342 2348 6 42.7 23.4 1.4X -make_date(*, *, *) 4485 4533 56 22.3 44.8 0.7X +prepare make_date() 4106 4124 28 24.4 41.1 1.0X +make_date(2019, 9, 16) 3151 3190 40 31.7 31.5 1.3X +make_date(*, *, *) 4929 4967 44 20.3 49.3 0.8X -OpenJDK 64-Bit Server VM 11.0.7+10-post-Ubuntu-2ubuntu218.04 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz make_timestamp(): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative --------------------------------------------------------------------------------------------------------------------------- -prepare make_timestamp() 3744 3775 35 0.3 3744.1 1.0X -make_timestamp(2019, 1, 2, 3, 4, 50.123456) 82 91 9 12.2 82.3 45.5X -make_timestamp(2019, 1, 2, 3, 4, 60.000000) 81 89 7 12.4 81.0 46.2X -make_timestamp(2019, 12, 31, 23, 59, 60.00) 70 80 9 14.3 69.9 53.5X -make_timestamp(*, *, *, 3, 4, 50.123456) 308 314 7 3.2 308.1 12.2X -make_timestamp(*, *, *, *, *, 0) 302 316 14 3.3 301.9 12.4X -make_timestamp(*, *, *, *, *, 60.0) 290 296 6 3.4 290.4 12.9X -make_timestamp(2019, 1, 2, *, *, *) 3888 3902 15 0.3 3888.1 1.0X -make_timestamp(*, *, *, *, *, *) 3902 3908 8 0.3 3901.6 1.0X +prepare make_timestamp() 4039 4077 46 0.2 4038.9 1.0X +make_timestamp(2019, 1, 2, 3, 4, 50.123456) 54 58 6 18.7 53.5 75.5X +make_timestamp(2019, 1, 2, 3, 4, 60.000000) 51 57 6 19.8 50.6 79.9X +make_timestamp(2019, 12, 31, 23, 59, 60.00) 50 51 1 19.9 50.4 80.2X +make_timestamp(*, *, *, 3, 4, 50.123456) 294 309 17 3.4 294.4 13.7X +make_timestamp(*, *, *, *, *, 0) 264 291 28 3.8 264.0 15.3X +make_timestamp(*, *, *, *, *, 60.0) 272 293 26 3.7 272.1 14.8X +make_timestamp(2019, 1, 2, *, *, *) 4472 4498 24 0.2 4471.6 0.9X +make_timestamp(*, *, *, *, *, *) 4306 4324 29 0.2 4305.9 0.9X diff --git a/sql/core/benchmarks/MakeDateTimeBenchmark-results.txt b/sql/core/benchmarks/MakeDateTimeBenchmark-results.txt index 2191be264a51c..e68c316246771 100644 --- a/sql/core/benchmarks/MakeDateTimeBenchmark-results.txt +++ b/sql/core/benchmarks/MakeDateTimeBenchmark-results.txt @@ -1,22 +1,22 @@ -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz make_date(): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -prepare make_date() 3309 3429 110 30.2 33.1 1.0X -make_date(2019, 9, 16) 2336 2359 23 42.8 23.4 1.4X -make_date(*, *, *) 4588 4618 27 21.8 45.9 0.7X +prepare make_date() 2468 2609 192 40.5 24.7 1.0X +make_date(2019, 9, 16) 2260 2298 44 44.2 22.6 1.1X +make_date(*, *, *) 4163 4247 74 24.0 41.6 0.6X -OpenJDK 64-Bit Server VM 1.8.0_252-8u252-b09-1~18.04-b09 on Linux 4.15.0-1063-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz make_timestamp(): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative --------------------------------------------------------------------------------------------------------------------------- -prepare make_timestamp() 3651 3697 58 0.3 3651.4 1.0X -make_timestamp(2019, 1, 2, 3, 4, 50.123456) 89 99 10 11.3 88.6 41.2X -make_timestamp(2019, 1, 2, 3, 4, 60.000000) 72 73 1 13.9 72.1 50.6X -make_timestamp(2019, 12, 31, 23, 59, 60.00) 66 68 3 15.2 65.8 55.5X -make_timestamp(*, *, *, 3, 4, 50.123456) 265 272 6 3.8 265.1 13.8X -make_timestamp(*, *, *, *, *, 0) 259 266 6 3.9 259.1 14.1X -make_timestamp(*, *, *, *, *, 60.0) 271 278 9 3.7 271.2 13.5X -make_timestamp(2019, 1, 2, *, *, *) 3838 3850 12 0.3 3837.7 1.0X -make_timestamp(*, *, *, *, *, *) 3854 3877 20 0.3 3853.8 0.9X +prepare make_timestamp() 3667 3722 54 0.3 3667.0 1.0X +make_timestamp(2019, 1, 2, 3, 4, 50.123456) 44 44 0 22.9 43.6 84.0X +make_timestamp(2019, 1, 2, 3, 4, 60.000000) 41 42 1 24.3 41.1 89.1X +make_timestamp(2019, 12, 31, 23, 59, 60.00) 41 43 3 24.6 40.7 90.0X +make_timestamp(*, *, *, 3, 4, 50.123456) 244 247 2 4.1 244.4 15.0X +make_timestamp(*, *, *, *, *, 0) 241 248 7 4.2 240.6 15.2X +make_timestamp(*, *, *, *, *, 60.0) 239 245 6 4.2 239.5 15.3X +make_timestamp(2019, 1, 2, *, *, *) 3894 3944 58 0.3 3893.6 0.9X +make_timestamp(*, *, *, *, *, *) 3952 3976 38 0.3 3951.8 0.9X diff --git a/sql/core/benchmarks/MetricsAggregationBenchmark-jdk11-results.txt b/sql/core/benchmarks/MetricsAggregationBenchmark-jdk11-results.txt index e33ed30eaa559..70451fe2e1fed 100644 --- a/sql/core/benchmarks/MetricsAggregationBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/MetricsAggregationBenchmark-jdk11-results.txt @@ -1,12 +1,12 @@ -OpenJDK 64-Bit Server VM 11.0.4+11 on Linux 4.15.0-66-generic -Intel(R) Core(TM) i7-6820HQ CPU @ 2.70GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz metrics aggregation (50 metrics, 100000 tasks per stage): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -1 stage(s) 672 841 179 0.0 671888474.0 1.0X -2 stage(s) 1700 1842 201 0.0 1699591662.0 0.4X -3 stage(s) 2601 2776 247 0.0 2601465786.0 0.3X +---------------------------------------------------------------------------------------------------------------------------------------- +1 stage(s) 3172 3298 179 0.0 3171630175.0 1.0X +2 stage(s) 6668 6766 140 0.0 6667562027.0 0.5X +3 stage(s) 10079 10517 619 0.0 10078844686.0 0.3X Stage Count Stage Proc. Time Aggreg. Time - 1 436 164 - 2 537 354 - 3 480 602 + 1 1710 331 + 2 1832 871 + 3 1775 1472 diff --git a/sql/core/benchmarks/MetricsAggregationBenchmark-results.txt b/sql/core/benchmarks/MetricsAggregationBenchmark-results.txt index 4fae928258d32..9c5b8b4027bf2 100644 --- a/sql/core/benchmarks/MetricsAggregationBenchmark-results.txt +++ b/sql/core/benchmarks/MetricsAggregationBenchmark-results.txt @@ -1,12 +1,12 @@ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_181-b13 on Linux 4.15.0-66-generic -Intel(R) Core(TM) i7-6820HQ CPU @ 2.70GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz metrics aggregation (50 metrics, 100000 tasks per stage): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -1 stage(s) 740 883 147 0.0 740089816.0 1.0X -2 stage(s) 1661 1943 399 0.0 1660649192.0 0.4X -3 stage(s) 2711 2967 362 0.0 2711110178.0 0.3X +---------------------------------------------------------------------------------------------------------------------------------------- +1 stage(s) 3137 3280 203 0.0 3136824845.0 1.0X +2 stage(s) 6420 6826 574 0.0 6419861899.0 0.5X +3 stage(s) 11018 11209 271 0.0 11017607749.0 0.3X Stage Count Stage Proc. Time Aggreg. Time - 1 405 179 - 2 375 414 - 3 364 644 + 1 2513 326 + 2 2150 1048 + 3 2136 1583 diff --git a/sql/core/benchmarks/MiscBenchmark-jdk11-results.txt b/sql/core/benchmarks/MiscBenchmark-jdk11-results.txt index 281b0fe28171b..edfbb7ff363a9 100644 --- a/sql/core/benchmarks/MiscBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/MiscBenchmark-jdk11-results.txt @@ -2,126 +2,126 @@ filter & aggregate without group ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz range/filter/sum: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -range/filter/sum wholestage off 54616 54834 309 38.4 26.0 1.0X -range/filter/sum wholestage on 3263 3369 129 642.6 1.6 16.7X +range/filter/sum wholestage off 116300 116850 778 18.0 55.5 1.0X +range/filter/sum wholestage on 4137 4321 381 507.0 2.0 28.1X ================================================================================================ range/limit/sum ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz range/limit/sum: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -range/limit/sum wholestage off 239 265 36 2190.0 0.5 1.0X -range/limit/sum wholestage on 137 162 15 3814.6 0.3 1.7X +range/limit/sum wholestage off 198 200 3 2642.7 0.4 1.0X +range/limit/sum wholestage on 46 66 36 11475.6 0.1 4.3X ================================================================================================ sample ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz sample with replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -sample with replacement wholestage off 13093 13417 458 10.0 99.9 1.0X -sample with replacement wholestage on 7606 7624 13 17.2 58.0 1.7X +sample with replacement wholestage off 17080 17302 314 7.7 130.3 1.0X +sample with replacement wholestage on 8033 8188 101 16.3 61.3 2.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -sample without replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -sample without replacement wholestage off 3031 3038 9 43.2 23.1 1.0X -sample without replacement wholestage on 1156 1177 16 113.4 8.8 2.6X +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +sample without replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------- +sample without replacement wholestage off 5087 5115 38 25.8 38.8 1.0X +sample without replacement wholestage on 1064 1084 25 123.2 8.1 4.8X ================================================================================================ collect ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz collect: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -collect 1 million 335 360 20 3.1 319.0 1.0X -collect 2 millions 579 633 42 1.8 552.2 0.6X -collect 4 millions 1192 1331 196 0.9 1137.1 0.3X +collect 1 million 391 462 85 2.7 372.8 1.0X +collect 2 millions 789 910 130 1.3 752.1 0.5X +collect 4 millions 1677 1729 75 0.6 1599.0 0.2X ================================================================================================ collect limit ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz collect limit: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -collect limit 1 million 378 386 12 2.8 360.8 1.0X -collect limit 2 millions 724 733 12 1.4 690.3 0.5X +collect limit 1 million 507 545 28 2.1 483.4 1.0X +collect limit 2 millions 854 1003 212 1.2 814.1 0.6X ================================================================================================ generate explode ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz generate explode array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate explode array wholestage off 15880 16159 395 1.1 946.5 1.0X -generate explode array wholestage on 15690 15783 73 1.1 935.2 1.0X +generate explode array wholestage off 20533 20699 235 0.8 1223.9 1.0X +generate explode array wholestage on 5886 6012 109 2.9 350.8 3.5X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz generate explode map: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate explode map wholestage off 51293 51311 26 0.3 3057.3 1.0X -generate explode map wholestage on 50409 50795 388 0.3 3004.6 1.0X +generate explode map wholestage off 62142 63593 2052 0.3 3703.9 1.0X +generate explode map wholestage on 38943 39253 439 0.4 2321.2 1.6X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz generate posexplode array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate posexplode array wholestage off 17246 17860 869 1.0 1027.9 1.0X -generate posexplode array wholestage on 17344 17472 88 1.0 1033.8 1.0X +generate posexplode array wholestage off 26931 27169 335 0.6 1605.2 1.0X +generate posexplode array wholestage on 6003 6107 64 2.8 357.8 4.5X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz generate inline array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate inline array wholestage off 13698 13790 130 1.2 816.5 1.0X -generate inline array wholestage on 12995 13033 38 1.3 774.6 1.1X +generate inline array wholestage off 19043 19081 55 0.9 1135.0 1.0X +generate inline array wholestage on 4648 4778 158 3.6 277.0 4.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz generate big struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate big struct array wholestage off 476 489 18 0.1 7938.6 1.0X -generate big struct array wholestage on 424 440 14 0.1 7074.9 1.1X +generate big struct array wholestage off 486 496 15 0.1 8094.8 1.0X +generate big struct array wholestage on 396 420 22 0.2 6603.2 1.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -generate big nested struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -generate big nested struct array wholestage off 413 433 28 0.1 6886.8 1.0X -generate big nested struct array wholestage on 394 420 39 0.2 6560.9 1.0X +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +generate big nested struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------------- +generate big nested struct array wholestage off 327380 353982 NaN 0.0 5456328.8 1.0X +generate big nested struct array wholestage on 391 427 66 0.2 6524.4 836.3X ================================================================================================ generate regular generator ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz generate stack: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate stack wholestage off 26494 26510 23 0.6 1579.2 1.0X -generate stack wholestage on 24205 24339 80 0.7 1442.8 1.1X +generate stack wholestage off 31236 31274 54 0.5 1861.8 1.0X +generate stack wholestage on 6420 6496 113 2.6 382.7 4.9X diff --git a/sql/core/benchmarks/MiscBenchmark-results.txt b/sql/core/benchmarks/MiscBenchmark-results.txt index 8b1e728ed9cf9..85993a5ba6829 100644 --- a/sql/core/benchmarks/MiscBenchmark-results.txt +++ b/sql/core/benchmarks/MiscBenchmark-results.txt @@ -2,126 +2,126 @@ filter & aggregate without group ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz range/filter/sum: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -range/filter/sum wholestage off 46812 48110 1836 44.8 22.3 1.0X -range/filter/sum wholestage on 3116 3656 309 673.1 1.5 15.0X +range/filter/sum wholestage off 98011 99011 1415 21.4 46.7 1.0X +range/filter/sum wholestage on 3287 3614 183 638.1 1.6 29.8X ================================================================================================ range/limit/sum ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz range/limit/sum: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -range/limit/sum wholestage off 200 219 27 2621.6 0.4 1.0X -range/limit/sum wholestage on 117 125 7 4477.8 0.2 1.7X +range/limit/sum wholestage off 93 96 4 5625.2 0.2 1.0X +range/limit/sum wholestage on 42 49 9 12366.6 0.1 2.2X ================================================================================================ sample ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz sample with replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -sample with replacement wholestage off 12963 13506 768 10.1 98.9 1.0X -sample with replacement wholestage on 7397 7742 300 17.7 56.4 1.8X +sample with replacement wholestage off 13712 13721 13 9.6 104.6 1.0X +sample with replacement wholestage on 7532 7561 47 17.4 57.5 1.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -sample without replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -sample without replacement wholestage off 2977 2977 0 44.0 22.7 1.0X -sample without replacement wholestage on 1087 1099 13 120.6 8.3 2.7X +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz +sample without replacement: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------- +sample without replacement wholestage off 4652 4652 1 28.2 35.5 1.0X +sample without replacement wholestage on 1065 1096 56 123.1 8.1 4.4X ================================================================================================ collect ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz collect: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -collect 1 million 281 315 34 3.7 268.2 1.0X -collect 2 millions 531 564 28 2.0 506.6 0.5X -collect 4 millions 1179 1970 1118 0.9 1124.5 0.2X +collect 1 million 249 253 3 4.2 237.8 1.0X +collect 2 millions 482 500 28 2.2 459.2 0.5X +collect 4 millions 989 1016 38 1.1 943.5 0.3X ================================================================================================ collect limit ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz collect limit: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -collect limit 1 million 344 352 5 3.0 328.0 1.0X -collect limit 2 millions 656 660 6 1.6 625.2 0.5X +collect limit 1 million 297 303 4 3.5 283.5 1.0X +collect limit 2 millions 582 593 14 1.8 554.6 0.5X ================================================================================================ generate explode ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz generate explode array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate explode array wholestage off 14664 14780 164 1.1 874.0 1.0X -generate explode array wholestage on 14789 14886 87 1.1 881.5 1.0X +generate explode array wholestage off 17458 17507 70 1.0 1040.6 1.0X +generate explode array wholestage on 6094 6178 93 2.8 363.2 2.9X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz generate explode map: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate explode map wholestage off 50441 51014 811 0.3 3006.5 1.0X -generate explode map wholestage on 49164 49915 892 0.3 2930.4 1.0X +generate explode map wholestage off 51077 53221 3032 0.3 3044.4 1.0X +generate explode map wholestage on 30130 30343 200 0.6 1795.9 1.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz generate posexplode array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate posexplode array wholestage off 17101 17130 40 1.0 1019.3 1.0X -generate posexplode array wholestage on 15625 15675 46 1.1 931.3 1.1X +generate posexplode array wholestage off 18582 18702 170 0.9 1107.6 1.0X +generate posexplode array wholestage on 6164 6208 32 2.7 367.4 3.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz generate inline array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate inline array wholestage off 13923 14720 1127 1.2 829.9 1.0X -generate inline array wholestage on 12246 12591 695 1.4 729.9 1.1X +generate inline array wholestage off 13275 14431 1635 1.3 791.2 1.0X +generate inline array wholestage on 4668 4752 118 3.6 278.3 2.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz generate big struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate big struct array wholestage off 442 456 20 0.1 7368.2 1.0X -generate big struct array wholestage on 409 429 22 0.1 6823.9 1.1X +generate big struct array wholestage off 382 385 4 0.2 6367.5 1.0X +generate big struct array wholestage on 327 349 42 0.2 5446.1 1.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -generate big nested struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -generate big nested struct array wholestage off 409 415 8 0.1 6822.4 1.0X -generate big nested struct array wholestage on 401 414 23 0.1 6687.0 1.0X +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz +generate big nested struct array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------------- +generate big nested struct array wholestage off 45694 45856 229 0.0 761565.1 1.0X +generate big nested struct array wholestage on 338 356 35 0.2 5631.4 135.2X ================================================================================================ generate regular generator ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz generate stack: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -generate stack wholestage off 27043 27118 106 0.6 1611.9 1.0X -generate stack wholestage on 24002 24036 34 0.7 1430.6 1.1X +generate stack wholestage off 26624 26685 87 0.6 1586.9 1.0X +generate stack wholestage on 5948 5971 25 2.8 354.5 4.5X diff --git a/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-jdk11-results.txt b/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-jdk11-results.txt index c286dc2da8076..c736d5e0d5089 100644 --- a/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-jdk11-results.txt @@ -2,52 +2,52 @@ Nested Schema Pruning Benchmark For ORC v1 ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 155 197 23 6.5 155.0 1.0X -Nested column 1290 1338 43 0.8 1289.9 0.1X -Nested column in array 5914 5989 57 0.2 5914.1 0.0X +Top-level column 82 129 39 12.2 82.2 1.0X +Nested column 462 490 23 2.2 461.7 0.2X +Nested column in array 2051 2140 74 0.5 2051.2 0.0X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 463 537 53 2.2 463.2 1.0X -Nested column 1807 1874 62 0.6 1807.3 0.3X -Nested column in array 6729 6906 116 0.1 6729.4 0.1X +Top-level column 387 418 36 2.6 387.2 1.0X +Nested column 702 754 41 1.4 702.3 0.6X +Nested column in array 2320 2511 108 0.4 2320.4 0.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 378 402 18 2.6 377.7 1.0X -Nested column 1765 1794 46 0.6 1765.4 0.2X -Nested column in array 6675 6718 42 0.1 6674.6 0.1X +Top-level column 314 363 46 3.2 313.6 1.0X +Nested column 663 712 25 1.5 663.2 0.5X +Nested column in array 2174 2278 65 0.5 2174.3 0.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 384 399 8 2.6 383.7 1.0X -Nested column 4724 4820 72 0.2 4724.3 0.1X -Nested column in array 9256 9405 133 0.1 9255.7 0.0X +Top-level column 271 312 45 3.7 270.7 1.0X +Nested column 664 695 30 1.5 663.6 0.4X +Nested column in array 2228 2331 88 0.4 2227.8 0.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 121 137 13 8.3 120.7 1.0X -Nested column 1303 1361 45 0.8 1303.2 0.1X -Nested column in array 5901 5978 49 0.2 5901.0 0.0X +Top-level column 99 138 57 10.1 99.5 1.0X +Nested column 395 424 28 2.5 395.4 0.3X +Nested column in array 1734 1779 36 0.6 1733.6 0.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 651 675 30 1.5 650.8 1.0X -Nested column 5398 5527 179 0.2 5397.9 0.1X -Nested column in array 10413 10685 310 0.1 10413.1 0.1X +Top-level column 458 521 55 2.2 458.0 1.0X +Nested column 818 879 43 1.2 817.5 0.6X +Nested column in array 2388 2528 95 0.4 2388.0 0.2X diff --git a/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-results.txt b/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-results.txt index 0cbd855ec5e3a..3aae82770da72 100644 --- a/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-results.txt +++ b/sql/core/benchmarks/OrcNestedSchemaPruningBenchmark-results.txt @@ -2,52 +2,52 @@ Nested Schema Pruning Benchmark For ORC v1 ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 116 148 22 8.6 115.9 1.0X -Nested column 1200 1221 23 0.8 1200.3 0.1X -Nested column in array 4786 4898 202 0.2 4785.6 0.0X +Top-level column 65 76 10 15.4 64.9 1.0X +Nested column 353 368 11 2.8 353.0 0.2X +Nested column in array 1630 1665 28 0.6 1629.8 0.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 428 452 18 2.3 427.7 1.0X -Nested column 1681 1725 53 0.6 1680.7 0.3X -Nested column in array 5652 5699 47 0.2 5651.9 0.1X +Top-level column 306 332 11 3.3 306.3 1.0X +Nested column 588 629 33 1.7 587.9 0.5X +Nested column in array 2064 2110 36 0.5 2064.4 0.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 341 351 15 2.9 340.9 1.0X -Nested column 1529 1559 31 0.7 1528.6 0.2X -Nested column in array 5468 5517 97 0.2 5468.2 0.1X +Top-level column 247 261 7 4.0 247.0 1.0X +Nested column 550 577 16 1.8 549.9 0.4X +Nested column in array 1987 2012 23 0.5 1987.4 0.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 353 365 12 2.8 352.5 1.0X -Nested column 4135 4171 23 0.2 4135.2 0.1X -Nested column in array 8766 8816 56 0.1 8766.0 0.0X +Top-level column 260 269 8 3.8 259.7 1.0X +Nested column 664 682 17 1.5 663.6 0.4X +Nested column in array 2177 2287 71 0.5 2176.6 0.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 115 133 25 8.7 115.3 1.0X -Nested column 1200 1216 13 0.8 1199.7 0.1X -Nested column in array 5296 5345 39 0.2 5296.3 0.0X +Top-level column 80 101 26 12.5 80.3 1.0X +Nested column 356 374 21 2.8 356.5 0.2X +Nested column in array 1611 1679 39 0.6 1611.0 0.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 545 560 14 1.8 544.7 1.0X -Nested column 4704 4813 184 0.2 4703.8 0.1X -Nested column in array 9785 9824 42 0.1 9784.8 0.1X +Top-level column 375 396 12 2.7 375.2 1.0X +Nested column 738 763 12 1.4 738.1 0.5X +Nested column in array 2302 2444 129 0.4 2302.2 0.2X diff --git a/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-jdk11-results.txt b/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-jdk11-results.txt index 31970672aacd4..753674ea9ded8 100644 --- a/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-jdk11-results.txt @@ -2,52 +2,52 @@ Nested Schema Pruning Benchmark For ORC v2 ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 176 207 20 5.7 176.2 1.0X -Nested column 1173 1212 61 0.9 1173.2 0.2X -Nested column in array 5557 5628 58 0.2 5557.5 0.0X +Top-level column 69 74 6 14.4 69.3 1.0X +Nested column 653 665 11 1.5 652.5 0.1X +Nested column in array 3065 3085 22 0.3 3064.7 0.0X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 143 178 21 7.0 143.5 1.0X -Nested column 1233 1272 31 0.8 1233.0 0.1X -Nested column in array 5585 5691 66 0.2 5585.4 0.0X +Top-level column 382 435 53 2.6 382.4 1.0X +Nested column 970 1006 41 1.0 970.3 0.4X +Nested column in array 3452 3551 85 0.3 3452.3 0.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 395 416 23 2.5 395.4 1.0X -Nested column 1665 1691 16 0.6 1664.7 0.2X -Nested column in array 6194 6307 183 0.2 6194.5 0.1X +Top-level column 324 360 40 3.1 323.7 1.0X +Nested column 896 910 8 1.1 896.4 0.4X +Nested column in array 3395 3407 11 0.3 3395.5 0.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 394 407 14 2.5 393.7 1.0X -Nested column 4381 4536 97 0.2 4380.6 0.1X -Nested column in array 8797 8833 34 0.1 8796.7 0.0X +Top-level column 318 355 42 3.1 318.1 1.0X +Nested column 993 1006 10 1.0 993.3 0.3X +Nested column in array 3607 3624 16 0.3 3607.0 0.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 136 170 24 7.4 135.6 1.0X -Nested column 1135 1171 30 0.9 1135.0 0.1X -Nested column in array 4833 4911 92 0.2 4833.3 0.0X +Top-level column 98 114 27 10.2 97.8 1.0X +Nested column 689 702 12 1.5 688.9 0.1X +Nested column in array 3004 3090 55 0.3 3004.5 0.0X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 327 336 8 3.1 327.0 1.0X -Nested column 3321 3377 56 0.3 3321.0 0.1X -Nested column in array 8080 8161 97 0.1 8080.4 0.0X +Top-level column 582 669 59 1.7 582.2 1.0X +Nested column 1265 1300 51 0.8 1264.9 0.5X +Nested column in array 4249 4308 129 0.2 4248.7 0.1X diff --git a/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt b/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt index c7d8c8a541b59..ae9ac2a89705b 100644 --- a/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt +++ b/sql/core/benchmarks/OrcV2NestedSchemaPruningBenchmark-results.txt @@ -2,52 +2,52 @@ Nested Schema Pruning Benchmark For ORC v2 ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 121 156 27 8.3 121.1 1.0X -Nested column 1373 1406 37 0.7 1373.4 0.1X -Nested column in array 5545 5579 54 0.2 5544.8 0.0X +Top-level column 51 59 9 19.5 51.2 1.0X +Nested column 472 492 15 2.1 471.7 0.1X +Nested column in array 2371 2418 44 0.4 2370.9 0.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 127 147 20 7.9 127.0 1.0X -Nested column 1280 1328 32 0.8 1280.2 0.1X -Nested column in array 5617 5696 70 0.2 5617.0 0.0X +Top-level column 303 346 47 3.3 302.8 1.0X +Nested column 1015 1163 136 1.0 1014.8 0.3X +Nested column in array 2867 2940 114 0.3 2866.9 0.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 343 356 17 2.9 342.6 1.0X -Nested column 1692 1710 14 0.6 1692.3 0.2X -Nested column in array 6128 6168 30 0.2 6128.0 0.1X +Top-level column 255 265 5 3.9 255.4 1.0X +Nested column 1026 1047 17 1.0 1026.1 0.2X +Nested column in array 2760 2813 37 0.4 2760.2 0.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 348 355 11 2.9 348.1 1.0X -Nested column 4350 4392 35 0.2 4349.8 0.1X -Nested column in array 8864 8901 29 0.1 8864.1 0.0X +Top-level column 245 258 8 4.1 245.2 1.0X +Nested column 1085 1124 35 0.9 1084.8 0.2X +Nested column in array 2945 2993 36 0.3 2944.9 0.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 123 143 27 8.2 122.5 1.0X -Nested column 1233 1295 29 0.8 1233.2 0.1X -Nested column in array 5534 5597 53 0.2 5533.7 0.0X +Top-level column 76 86 13 13.1 76.2 1.0X +Nested column 780 824 40 1.3 779.5 0.1X +Nested column in array 2450 2530 68 0.4 2449.9 0.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 265 280 20 3.8 264.8 1.0X -Nested column 3211 3263 96 0.3 3211.2 0.1X -Nested column in array 8324 8357 42 0.1 8323.6 0.0X +Top-level column 396 425 26 2.5 395.6 1.0X +Nested column 1203 1255 51 0.8 1202.7 0.3X +Nested column in array 3077 3159 44 0.3 3076.7 0.1X diff --git a/sql/core/benchmarks/ParquetNestedPredicatePushDownBenchmark-jdk11-results.txt b/sql/core/benchmarks/ParquetNestedPredicatePushDownBenchmark-jdk11-results.txt index c33f8a372d82b..e2e9681fd96b2 100644 --- a/sql/core/benchmarks/ParquetNestedPredicatePushDownBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/ParquetNestedPredicatePushDownBenchmark-jdk11-results.txt @@ -1,21 +1,21 @@ -OpenJDK 64-Bit Server VM 11.0.2+9 on Mac OS X 10.14.6 -Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Can skip all row groups: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Without nested predicate Pushdown 34214 35752 NaN 3.1 326.3 1.0X -With nested predicate Pushdown 86 102 11 1216.2 0.8 396.8X +Without nested predicate Pushdown 51192 53164 953 2.0 488.2 1.0X +With nested predicate Pushdown 73 117 48 1443.5 0.7 704.7X -OpenJDK 64-Bit Server VM 11.0.2+9 on Mac OS X 10.14.6 -Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Can skip some row groups: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Without nested predicate Pushdown 34211 35162 843 3.1 326.3 1.0X -With nested predicate Pushdown 3470 3514 36 30.2 33.1 9.9X +Without nested predicate Pushdown 53589 55125 932 2.0 511.1 1.0X +With nested predicate Pushdown 87 138 36 1201.9 0.8 614.2X -OpenJDK 64-Bit Server VM 11.0.2+9 on Mac OS X 10.14.6 -Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Can skip no row groups: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Without nested predicate Pushdown 37533 37919 329 2.8 357.9 1.0X -With nested predicate Pushdown 37876 39132 536 2.8 361.2 1.0X +Without nested predicate Pushdown 63303 65061 NaN 1.7 603.7 1.0X +With nested predicate Pushdown 63738 64255 427 1.6 607.8 1.0X diff --git a/sql/core/benchmarks/ParquetNestedPredicatePushDownBenchmark-results.txt b/sql/core/benchmarks/ParquetNestedPredicatePushDownBenchmark-results.txt index 35dd4f0a5e9cb..1150bc0040f3b 100644 --- a/sql/core/benchmarks/ParquetNestedPredicatePushDownBenchmark-results.txt +++ b/sql/core/benchmarks/ParquetNestedPredicatePushDownBenchmark-results.txt @@ -1,21 +1,21 @@ -OpenJDK 64-Bit Server VM 1.8.0_252-b09 on Mac OS X 10.14.6 -Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Can skip all row groups: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Without nested predicate Pushdown 30687 31552 NaN 3.4 292.7 1.0X -With nested predicate Pushdown 105 150 61 999.3 1.0 292.5X +Without nested predicate Pushdown 41268 41398 78 2.5 393.6 1.0X +With nested predicate Pushdown 68 81 10 1532.2 0.7 603.0X -OpenJDK 64-Bit Server VM 1.8.0_252-b09 on Mac OS X 10.14.6 -Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Can skip some row groups: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Without nested predicate Pushdown 30505 31828 NaN 3.4 290.9 1.0X -With nested predicate Pushdown 3156 3215 77 33.2 30.1 9.7X +Without nested predicate Pushdown 41173 41299 80 2.5 392.7 1.0X +With nested predicate Pushdown 75 82 9 1404.3 0.7 551.4X -OpenJDK 64-Bit Server VM 1.8.0_252-b09 on Mac OS X 10.14.6 -Intel(R) Core(TM) i7-7920HQ CPU @ 3.10GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Can skip no row groups: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Without nested predicate Pushdown 34475 35302 NaN 3.0 328.8 1.0X -With nested predicate Pushdown 34003 34596 567 3.1 324.3 1.0X +Without nested predicate Pushdown 46265 46390 91 2.3 441.2 1.0X +With nested predicate Pushdown 46263 46383 111 2.3 441.2 1.0X diff --git a/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-jdk11-results.txt b/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-jdk11-results.txt index f6135968bb97b..79e249a806c96 100644 --- a/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-jdk11-results.txt @@ -2,52 +2,52 @@ Nested Schema Pruning Benchmark For Parquet ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 150 218 36 6.6 150.5 1.0X -Nested column 294 334 39 3.4 293.8 0.5X -Nested column in array 994 1024 34 1.0 994.3 0.2X +Top-level column 72 103 23 13.9 71.8 1.0X +Nested column 351 372 22 2.8 351.2 0.2X +Nested column in array 1563 1664 57 0.6 1563.3 0.0X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 161 183 13 6.2 160.9 1.0X -Nested column 296 332 43 3.4 295.6 0.5X -Nested column in array 1048 1089 48 1.0 1047.9 0.2X +Top-level column 380 453 68 2.6 379.8 1.0X +Nested column 729 818 70 1.4 728.8 0.5X +Nested column in array 2161 2404 173 0.5 2160.9 0.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 393 411 16 2.5 393.1 1.0X -Nested column 550 563 9 1.8 549.9 0.7X -Nested column in array 1468 1494 20 0.7 1467.5 0.3X +Top-level column 315 358 50 3.2 315.2 1.0X +Nested column 617 678 40 1.6 616.9 0.5X +Nested column in array 2032 2149 112 0.5 2031.8 0.2X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 404 419 15 2.5 404.2 1.0X -Nested column 2833 2875 24 0.4 2832.8 0.1X -Nested column in array 3340 3396 53 0.3 3340.3 0.1X +Top-level column 306 348 39 3.3 305.6 1.0X +Nested column 713 762 40 1.4 713.1 0.4X +Nested column in array 2364 2452 58 0.4 2364.3 0.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 142 159 12 7.0 142.3 1.0X -Nested column 308 318 8 3.2 307.8 0.5X -Nested column in array 1119 1154 32 0.9 1118.5 0.1X +Top-level column 106 143 45 9.4 106.2 1.0X +Nested column 427 460 42 2.3 427.3 0.2X +Nested column in array 1739 1864 91 0.6 1738.8 0.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 338 342 2 3.0 338.0 1.0X -Nested column 1873 1971 129 0.5 1873.1 0.2X -Nested column in array 2708 2760 50 0.4 2707.9 0.1X +Top-level column 520 581 39 1.9 519.6 1.0X +Nested column 983 1063 71 1.0 983.3 0.5X +Nested column in array 2538 2687 146 0.4 2538.0 0.2X diff --git a/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-results.txt b/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-results.txt index 9f64e0425df8d..1dd30ef901f6f 100644 --- a/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-results.txt +++ b/sql/core/benchmarks/ParquetNestedSchemaPruningBenchmark-results.txt @@ -2,52 +2,52 @@ Nested Schema Pruning Benchmark For Parquet ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 136 157 19 7.3 136.3 1.0X -Nested column 254 267 8 3.9 254.3 0.5X -Nested column in array 1071 1089 18 0.9 1071.1 0.1X +Top-level column 56 62 5 17.8 56.1 1.0X +Nested column 291 306 9 3.4 291.0 0.2X +Nested column in array 1126 1166 24 0.9 1126.1 0.0X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 134 147 12 7.5 134.1 1.0X -Nested column 288 295 5 3.5 287.7 0.5X -Nested column in array 1104 1135 35 0.9 1104.1 0.1X +Top-level column 372 399 28 2.7 371.9 1.0X +Nested column 686 724 27 1.5 686.0 0.5X +Nested column in array 1892 1973 72 0.5 1892.0 0.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 361 372 14 2.8 361.1 1.0X -Nested column 522 535 16 1.9 521.8 0.7X -Nested column in array 1540 1553 11 0.6 1539.6 0.2X +Top-level column 351 361 6 2.9 350.6 1.0X +Nested column 661 677 8 1.5 660.6 0.5X +Nested column in array 1886 1935 41 0.5 1886.3 0.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 375 384 11 2.7 374.6 1.0X -Nested column 2686 2715 24 0.4 2686.2 0.1X -Nested column in array 3067 3080 13 0.3 3067.2 0.1X +Top-level column 322 343 15 3.1 322.2 1.0X +Nested column 686 712 23 1.5 686.4 0.5X +Nested column in array 1813 1918 67 0.6 1813.1 0.2X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 120 135 8 8.3 120.3 1.0X -Nested column 280 290 13 3.6 279.9 0.4X -Nested column in array 1114 1143 29 0.9 1114.2 0.1X +Top-level column 81 92 8 12.3 81.2 1.0X +Nested column 331 393 42 3.0 330.6 0.2X +Nested column in array 1209 1324 70 0.8 1209.5 0.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Top-level column 263 277 18 3.8 263.0 1.0X -Nested column 1724 1763 38 0.6 1724.1 0.2X -Nested column in array 2530 2605 65 0.4 2529.9 0.1X +Top-level column 475 482 4 2.1 475.1 1.0X +Nested column 843 883 17 1.2 843.2 0.6X +Nested column in array 1895 1936 33 0.5 1895.1 0.3X diff --git a/sql/core/benchmarks/PrimitiveArrayBenchmark-jdk11-results.txt b/sql/core/benchmarks/PrimitiveArrayBenchmark-jdk11-results.txt index 0e5a051d92c90..01b8509a325c1 100644 --- a/sql/core/benchmarks/PrimitiveArrayBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/PrimitiveArrayBenchmark-jdk11-results.txt @@ -2,11 +2,11 @@ Write primitive arrays in dataset ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Write an array in Dataset: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Int 636 681 50 13.2 75.8 1.0X -Double 727 809 71 11.5 86.7 0.9X +Int 461 490 30 18.2 55.0 1.0X +Double 679 729 52 12.4 80.9 0.7X diff --git a/sql/core/benchmarks/PrimitiveArrayBenchmark-results.txt b/sql/core/benchmarks/PrimitiveArrayBenchmark-results.txt index 837145e7c93a5..2ddce974b986c 100644 --- a/sql/core/benchmarks/PrimitiveArrayBenchmark-results.txt +++ b/sql/core/benchmarks/PrimitiveArrayBenchmark-results.txt @@ -2,11 +2,11 @@ Write primitive arrays in dataset ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz Write an array in Dataset: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Int 631 684 65 13.3 75.2 1.0X -Double 792 854 61 10.6 94.4 0.8X +Int 324 341 15 25.9 38.6 1.0X +Double 583 599 11 14.4 69.5 0.6X diff --git a/sql/core/benchmarks/RangeBenchmark-jdk11-results.txt b/sql/core/benchmarks/RangeBenchmark-jdk11-results.txt index 44109e406ebb6..358bd76b7100a 100644 --- a/sql/core/benchmarks/RangeBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/RangeBenchmark-jdk11-results.txt @@ -2,14 +2,14 @@ range ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz range: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -full scan 11004 11558 944 47.6 21.0 1.0X -limit after range 121 135 19 4320.4 0.2 90.7X -filter after range 1529 1544 23 342.9 2.9 7.2X -count after range 123 143 21 4268.5 0.2 89.6X -count after limit after range 115 123 6 4547.6 0.2 95.4X +full scan 28020 28353 518 18.7 53.4 1.0X +limit after range 34 58 44 15423.8 0.1 824.3X +filter after range 1848 1863 12 283.7 3.5 15.2X +count after range 34 44 15 15406.4 0.1 823.4X +count after limit after range 50 79 36 10485.2 0.1 560.4X diff --git a/sql/core/benchmarks/RangeBenchmark-results.txt b/sql/core/benchmarks/RangeBenchmark-results.txt index e006785e7a2ca..273968f781f89 100644 --- a/sql/core/benchmarks/RangeBenchmark-results.txt +++ b/sql/core/benchmarks/RangeBenchmark-results.txt @@ -2,14 +2,14 @@ range ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz range: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -full scan 11565 11703 217 45.3 22.1 1.0X -limit after range 96 100 4 5455.9 0.2 120.3X -filter after range 1426 1432 10 367.7 2.7 8.1X -count after range 82 84 2 6412.8 0.2 141.5X -count after limit after range 72 76 3 7264.9 0.1 160.2X +full scan 18617 18864 257 28.2 35.5 1.0X +limit after range 23 25 2 23167.0 0.0 822.7X +filter after range 1288 1331 47 407.1 2.5 14.5X +count after range 56 62 4 9281.9 0.1 329.6X +count after limit after range 34 35 3 15645.0 0.1 555.6X diff --git a/sql/core/benchmarks/SortBenchmark-jdk11-results.txt b/sql/core/benchmarks/SortBenchmark-jdk11-results.txt index a61989b174bf5..7fdc446a792d3 100644 --- a/sql/core/benchmarks/SortBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/SortBenchmark-jdk11-results.txt @@ -2,15 +2,15 @@ radix sort ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz radix sort 25000000: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -reference TimSort key prefix array 15588 15592 6 1.6 623.5 1.0X -reference Arrays.sort 3367 3377 14 7.4 134.7 4.6X -radix sort one byte 436 447 10 57.3 17.5 35.7X -radix sort two bytes 875 885 9 28.6 35.0 17.8X -radix sort eight bytes 3409 3429 27 7.3 136.4 4.6X -radix sort key prefix array 5985 6058 104 4.2 239.4 2.6X +reference TimSort key prefix array 13491 13527 52 1.9 539.6 1.0X +reference Arrays.sort 3526 3541 21 7.1 141.0 3.8X +radix sort one byte 550 561 9 45.5 22.0 24.5X +radix sort two bytes 1038 1058 28 24.1 41.5 13.0X +radix sort eight bytes 4205 4214 13 5.9 168.2 3.2X +radix sort key prefix array 7674 7713 55 3.3 307.0 1.8X diff --git a/sql/core/benchmarks/SortBenchmark-results.txt b/sql/core/benchmarks/SortBenchmark-results.txt index b321d1115b727..8866158fe727c 100644 --- a/sql/core/benchmarks/SortBenchmark-results.txt +++ b/sql/core/benchmarks/SortBenchmark-results.txt @@ -2,15 +2,15 @@ radix sort ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz radix sort 25000000: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -reference TimSort key prefix array 15736 15778 59 1.6 629.4 1.0X -reference Arrays.sort 3051 3057 10 8.2 122.0 5.2X -radix sort one byte 442 453 10 56.6 17.7 35.6X -radix sort two bytes 883 885 1 28.3 35.3 17.8X -radix sort eight bytes 3422 3440 26 7.3 136.9 4.6X -radix sort key prefix array 6025 6138 159 4.1 241.0 2.6X +reference TimSort key prefix array 13590 13887 420 1.8 543.6 1.0X +reference Arrays.sort 3615 3644 40 6.9 144.6 3.8X +radix sort one byte 501 505 3 49.9 20.1 27.1X +radix sort two bytes 998 1011 21 25.1 39.9 13.6X +radix sort eight bytes 3894 3912 26 6.4 155.8 3.5X +radix sort key prefix array 7299 7316 23 3.4 292.0 1.9X diff --git a/sql/core/benchmarks/SubExprEliminationBenchmark-jdk11-results.txt b/sql/core/benchmarks/SubExprEliminationBenchmark-jdk11-results.txt index 5eeb485a921b8..5d117e1c9d09a 100644 --- a/sql/core/benchmarks/SubExprEliminationBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/SubExprEliminationBenchmark-jdk11-results.txt @@ -3,23 +3,23 @@ Benchmark for performance of subexpression elimination ================================================================================================ Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 11.0.9+11 on Mac OS X 10.15.6 -Intel(R) Core(TM) i7-9750H CPU @ 2.60GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz from_json as subExpr in Project: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -subExprElimination false, codegen: true 22482 23194 652 0.0 224817884.1 1.0X -subExprElimination false, codegen: false 22544 22658 155 0.0 225436869.9 1.0X -subExprElimination true, codegen: true 1371 1403 34 0.0 13710714.3 16.4X -subExprElimination true, codegen: false 1295 1317 20 0.0 12949824.3 17.4X +subExprElimination false, codegen: true 9888 10006 160 0.0 98884264.7 1.0X +subExprElimination false, codegen: false 9007 9149 129 0.0 90070910.8 1.1X +subExprElimination true, codegen: true 1305 1346 53 0.0 13048714.1 7.6X +subExprElimination true, codegen: false 1316 1323 9 0.0 13162352.5 7.5X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 11.0.9+11 on Mac OS X 10.15.6 -Intel(R) Core(TM) i7-9750H CPU @ 2.60GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz from_json as subExpr in Filter: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -subExprElimination false, codegen: true 34976 35331 326 0.0 349759975.5 1.0X -subExprElimination false, codegen: false 34101 34802 607 0.0 341014685.7 1.0X -subExprElimination true, codegen: true 19440 19622 272 0.0 194402251.0 1.8X -subExprElimination true, codegen: false 19247 20064 719 0.0 192466667.6 1.8X +subExprElimination false, codegen: true 14332 15051 631 0.0 143320683.0 1.0X +subExprElimination false, codegen: false 15083 15663 666 0.0 150832091.2 1.0X +subExprElimination true, codegen: true 7865 8153 261 0.0 78653514.4 1.8X +subExprElimination true, codegen: false 8078 8663 605 0.0 80780867.2 1.8X diff --git a/sql/core/benchmarks/SubExprEliminationBenchmark-results.txt b/sql/core/benchmarks/SubExprEliminationBenchmark-results.txt index 49a107f542857..68c911f99c863 100644 --- a/sql/core/benchmarks/SubExprEliminationBenchmark-results.txt +++ b/sql/core/benchmarks/SubExprEliminationBenchmark-results.txt @@ -3,23 +3,23 @@ Benchmark for performance of subexpression elimination ================================================================================================ Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 1.8.0_265-b01 on Mac OS X 10.15.6 -Intel(R) Core(TM) i7-9750H CPU @ 2.60GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz from_json as subExpr in Project: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -subExprElimination false, codegen: true 25399 25869 466 0.0 253992369.6 1.0X -subExprElimination false, codegen: false 24086 25094 888 0.0 240858699.5 1.1X -subExprElimination true, codegen: true 1527 1600 64 0.0 15274388.8 16.6X -subExprElimination true, codegen: false 1560 1600 52 0.0 15597825.4 16.3X +subExprElimination false, codegen: true 8466 8859 497 0.0 84660198.0 1.0X +subExprElimination false, codegen: false 8176 8357 159 0.0 81759220.7 1.0X +subExprElimination true, codegen: true 962 1020 86 0.0 9623297.9 8.8X +subExprElimination true, codegen: false 948 980 31 0.0 9476038.9 8.9X Preparing data for benchmarking ... -OpenJDK 64-Bit Server VM 1.8.0_265-b01 on Mac OS X 10.15.6 -Intel(R) Core(TM) i7-9750H CPU @ 2.60GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz from_json as subExpr in Filter: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -subExprElimination false, codegen: true 39661 40585 844 0.0 396612867.5 1.0X -subExprElimination false, codegen: false 40633 48813 1858 0.0 406328241.3 1.0X -subExprElimination true, codegen: true 25819 27096 1174 0.0 258194064.4 1.5X -subExprElimination true, codegen: false 23467 25137 1447 0.0 234668398.2 1.7X +subExprElimination false, codegen: true 12971 13362 348 0.0 129707796.2 1.0X +subExprElimination false, codegen: false 13796 14144 309 0.0 137961780.5 0.9X +subExprElimination true, codegen: true 6611 7128 449 0.0 66106385.8 2.0X +subExprElimination true, codegen: false 7068 7369 323 0.0 70675302.7 1.8X diff --git a/sql/core/benchmarks/UDFBenchmark-jdk11-results.txt b/sql/core/benchmarks/UDFBenchmark-jdk11-results.txt index 79daf73a95bb4..5f31d536a8af3 100644 --- a/sql/core/benchmarks/UDFBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/UDFBenchmark-jdk11-results.txt @@ -2,58 +2,58 @@ UDF with mixed input types ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -long/nullable int/string to string: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -long/nullable int/string to string wholestage off 279 320 58 0.4 2789.3 1.0X -long/nullable int/string to string wholestage on 182 188 7 0.6 1818.0 1.5X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -long/nullable int/string to option: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -long/nullable int/string to option wholestage off 133 137 5 0.8 1332.3 1.0X -long/nullable int/string to option wholestage on 110 118 8 0.9 1097.3 1.2X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -long/nullable int/string to primitive: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -long/nullable int/string to primitive wholestage off 69 83 19 1.4 694.7 1.0X -long/nullable int/string to primitive wholestage on 66 81 18 1.5 657.5 1.1X +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +long/nullable int/string to string: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +--------------------------------------------------------------------------------------------------------------------------------- +long/nullable int/string to string wholestage off 85 85 1 1.2 846.6 1.0X +long/nullable int/string to string wholestage on 76 81 4 1.3 762.9 1.1X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +long/nullable int/string to option: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +--------------------------------------------------------------------------------------------------------------------------------- +long/nullable int/string to option wholestage off 53 56 4 1.9 529.6 1.0X +long/nullable int/string to option wholestage on 52 54 2 1.9 518.2 1.0X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +long/nullable int/string to primitive: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------------------ +long/nullable int/string to primitive wholestage off 50 51 1 2.0 502.0 1.0X +long/nullable int/string to primitive wholestage on 40 43 4 2.5 404.2 1.2X ================================================================================================ UDF with primitive types ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -long/nullable int to string: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -long/nullable int to string wholestage off 76 80 5 1.3 761.5 1.0X -long/nullable int to string wholestage on 65 67 2 1.5 654.2 1.2X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -long/nullable int to option: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -long/nullable int to option wholestage off 49 50 2 2.0 487.9 1.0X -long/nullable int to option wholestage on 50 66 12 2.0 503.6 1.0X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -long/nullable int to primitive: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -long/nullable int to primitive wholestage off 48 58 14 2.1 483.5 1.0X -long/nullable int to primitive wholestage on 46 52 6 2.2 456.8 1.1X - -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +long/nullable int to string: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +-------------------------------------------------------------------------------------------------------------------------- +long/nullable int to string wholestage off 62 65 4 1.6 617.7 1.0X +long/nullable int to string wholestage on 55 60 9 1.8 547.9 1.1X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +long/nullable int to option: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +-------------------------------------------------------------------------------------------------------------------------- +long/nullable int to option wholestage off 43 46 4 2.3 431.5 1.0X +long/nullable int to option wholestage on 32 34 2 3.1 324.9 1.3X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +long/nullable int to primitive: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +----------------------------------------------------------------------------------------------------------------------------- +long/nullable int to primitive wholestage off 30 31 2 3.4 295.1 1.0X +long/nullable int to primitive wholestage on 27 28 1 3.7 273.7 1.1X + +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz UDF identity overhead: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Baseline 39 41 3 2.6 385.8 1.0X -With identity UDF 44 46 3 2.3 444.4 0.9X +Baseline 18 19 1 5.6 179.1 1.0X +With identity UDF 27 30 6 3.7 267.9 0.7X diff --git a/sql/core/benchmarks/UDFBenchmark-results.txt b/sql/core/benchmarks/UDFBenchmark-results.txt index 3f17a999094a3..f105b390a8e39 100644 --- a/sql/core/benchmarks/UDFBenchmark-results.txt +++ b/sql/core/benchmarks/UDFBenchmark-results.txt @@ -2,58 +2,58 @@ UDF with mixed input types ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -long/nullable int/string to string: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -long/nullable int/string to string wholestage off 250 327 108 0.4 2500.6 1.0X -long/nullable int/string to string wholestage on 142 157 16 0.7 1421.2 1.8X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -long/nullable int/string to option: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -long/nullable int/string to option wholestage off 124 125 2 0.8 1237.8 1.0X -long/nullable int/string to option wholestage on 73 93 27 1.4 730.1 1.7X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -long/nullable int/string to primitive: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -long/nullable int/string to primitive wholestage off 66 69 4 1.5 658.8 1.0X -long/nullable int/string to primitive wholestage on 61 67 11 1.6 611.7 1.1X +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz +long/nullable int/string to string: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +--------------------------------------------------------------------------------------------------------------------------------- +long/nullable int/string to string wholestage off 88 92 6 1.1 877.7 1.0X +long/nullable int/string to string wholestage on 83 84 1 1.2 832.5 1.1X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz +long/nullable int/string to option: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +--------------------------------------------------------------------------------------------------------------------------------- +long/nullable int/string to option wholestage off 56 56 0 1.8 559.1 1.0X +long/nullable int/string to option wholestage on 53 55 2 1.9 532.6 1.0X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz +long/nullable int/string to primitive: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------------------ +long/nullable int/string to primitive wholestage off 52 58 8 1.9 523.8 1.0X +long/nullable int/string to primitive wholestage on 50 50 1 2.0 498.3 1.1X ================================================================================================ UDF with primitive types ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -long/nullable int to string: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -long/nullable int to string wholestage off 66 67 0 1.5 663.9 1.0X -long/nullable int to string wholestage on 66 68 2 1.5 664.6 1.0X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -long/nullable int to option: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -long/nullable int to option wholestage off 40 42 3 2.5 402.6 1.0X -long/nullable int to option wholestage on 40 42 2 2.5 401.3 1.0X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -long/nullable int to primitive: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -long/nullable int to primitive wholestage off 38 39 0 2.6 384.8 1.0X -long/nullable int to primitive wholestage on 39 45 5 2.5 392.6 1.0X - -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz +long/nullable int to string: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +-------------------------------------------------------------------------------------------------------------------------- +long/nullable int to string wholestage off 59 59 0 1.7 594.7 1.0X +long/nullable int to string wholestage on 57 64 13 1.7 574.7 1.0X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz +long/nullable int to option: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +-------------------------------------------------------------------------------------------------------------------------- +long/nullable int to option wholestage off 33 33 1 3.1 326.0 1.0X +long/nullable int to option wholestage on 31 32 1 3.2 308.1 1.1X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz +long/nullable int to primitive: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +----------------------------------------------------------------------------------------------------------------------------- +long/nullable int to primitive wholestage off 30 32 1 3.3 304.9 1.0X +long/nullable int to primitive wholestage on 28 28 1 3.6 276.3 1.1X + +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz UDF identity overhead: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Baseline 32 33 1 3.1 320.8 1.0X -With identity UDF 37 40 6 2.7 369.1 0.9X +Baseline 18 19 1 5.7 176.1 1.0X +With identity UDF 24 29 7 4.1 243.2 0.7X diff --git a/sql/core/benchmarks/UnsafeArrayDataBenchmark-jdk11-results.txt b/sql/core/benchmarks/UnsafeArrayDataBenchmark-jdk11-results.txt index 577cdb0db62b3..872845f28fc11 100644 --- a/sql/core/benchmarks/UnsafeArrayDataBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/UnsafeArrayDataBenchmark-jdk11-results.txt @@ -2,32 +2,32 @@ Benchmark UnsafeArrayData ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Read UnsafeArrayData: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Int 183 184 0 914.7 1.1 1.0X -Double 188 189 0 891.1 1.1 1.0X +Int 131 133 1 1279.4 0.8 1.0X +Double 280 286 3 599.6 1.7 0.5X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Write UnsafeArrayData: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Int 31 32 1 670.0 1.5 1.0X -Double 70 71 1 300.3 3.3 0.4X +Int 53 71 14 392.2 2.5 1.0X +Double 114 143 12 183.8 5.4 0.5X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Get primitive array from UnsafeArrayData: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Int 71 73 3 887.3 1.1 1.0X -Double 144 151 6 438.2 2.3 0.5X +Int 87 108 16 723.4 1.4 1.0X +Double 204 220 19 307.7 3.3 0.4X -OpenJDK 64-Bit Server VM 11.0.4+11-LTS on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Create UnsafeArrayData from primitive array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Int 69 70 1 906.7 1.1 1.0X -Double 140 142 1 448.8 2.2 0.5X +--------------------------------------------------------------------------------------------------------------------------- +Int 87 108 19 725.0 1.4 1.0X +Double 203 217 16 309.2 3.2 0.4X diff --git a/sql/core/benchmarks/UnsafeArrayDataBenchmark-results.txt b/sql/core/benchmarks/UnsafeArrayDataBenchmark-results.txt index 6c4669d7ea442..58cc59e016beb 100644 --- a/sql/core/benchmarks/UnsafeArrayDataBenchmark-results.txt +++ b/sql/core/benchmarks/UnsafeArrayDataBenchmark-results.txt @@ -2,32 +2,32 @@ Benchmark UnsafeArrayData ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Read UnsafeArrayData: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Int 183 183 0 919.0 1.1 1.0X -Double 192 196 4 872.4 1.1 0.9X +Int 4 4 0 47832.8 0.0 1.0X +Double 3 3 0 54217.6 0.0 1.1X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Write UnsafeArrayData: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Int 33 36 3 639.3 1.6 1.0X -Double 76 79 2 274.6 3.6 0.4X +Int 45 46 1 470.8 2.1 1.0X +Double 96 99 2 218.1 4.6 0.5X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Get primitive array from UnsafeArrayData: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Int 71 76 4 890.8 1.1 1.0X -Double 147 151 6 427.4 2.3 0.5X +Int 83 86 2 754.1 1.3 1.0X +Double 165 170 5 381.9 2.6 0.5X -OpenJDK 64-Bit Server VM 1.8.0_222-b10 on Linux 3.10.0-862.3.2.el7.x86_64 -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Create UnsafeArrayData from primitive array: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -Int 73 75 3 866.8 1.2 1.0X -Double 148 150 1 424.8 2.4 0.5X +--------------------------------------------------------------------------------------------------------------------------- +Int 85 87 2 738.6 1.4 1.0X +Double 165 173 6 381.8 2.6 0.5X diff --git a/sql/core/benchmarks/UpdateFieldsBenchmark-results.txt b/sql/core/benchmarks/UpdateFieldsBenchmark-results.txt index 5feca0e100bb1..ce0e806f59c68 100644 --- a/sql/core/benchmarks/UpdateFieldsBenchmark-results.txt +++ b/sql/core/benchmarks/UpdateFieldsBenchmark-results.txt @@ -2,25 +2,25 @@ Add 2 columns and drop 2 columns at 3 different depths of nesting ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_212-b03 on Mac OS X 10.14.6 -Intel(R) Core(TM) i7-7820HQ CPU @ 2.90GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Add 2 columns and drop 2 columns at 3 different depths of nesting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------------------------------- -To non-nullable StructTypes using performant method 10 11 2 0.0 Infinity 1.0X -To nullable StructTypes using performant method 9 10 1 0.0 Infinity 1.0X -To non-nullable StructTypes using non-performant method 2457 2464 10 0.0 Infinity 0.0X -To nullable StructTypes using non-performant method 42641 43804 1644 0.0 Infinity 0.0X +To non-nullable StructTypes using performant method 4 4 1 0.0 Infinity 1.0X +To nullable StructTypes using performant method 3 3 0 0.0 Infinity 1.1X +To non-nullable StructTypes using non-performant method 79 80 1 0.0 Infinity 0.0X +To nullable StructTypes using non-performant method 2263 2290 39 0.0 Infinity 0.0X ================================================================================================ Add 50 columns and drop 50 columns at 100 different depths of nesting ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_212-b03 on Mac OS X 10.14.6 -Intel(R) Core(TM) i7-7820HQ CPU @ 2.90GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz Add 50 columns and drop 50 columns at 100 different depths of nesting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ----------------------------------------------------------------------------------------------------------------------------------------------------- -To non-nullable StructTypes using performant method 4595 4927 470 0.0 Infinity 1.0X -To nullable StructTypes using performant method 5185 5516 468 0.0 Infinity 0.9X +To non-nullable StructTypes using performant method 3243 3258 21 0.0 Infinity 1.0X +To nullable StructTypes using performant method 3184 3192 10 0.0 Infinity 1.0X diff --git a/sql/core/benchmarks/WideSchemaBenchmark-jdk11-results.txt b/sql/core/benchmarks/WideSchemaBenchmark-jdk11-results.txt index 19ce183820c05..b99bd448af594 100644 --- a/sql/core/benchmarks/WideSchemaBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/WideSchemaBenchmark-jdk11-results.txt @@ -2,144 +2,144 @@ parsing large select expressions ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz parsing large select: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 select expressions 8 15 8 0.0 8028037.0 1.0X -100 select expressions 15 18 3 0.0 14899892.0 0.5X -2500 select expressions 237 243 8 0.0 237252523.0 0.0X +1 select expressions 1 2 1 0.0 1421891.0 1.0X +100 select expressions 9 11 2 0.0 8906443.0 0.2X +2500 select expressions 400 444 46 0.0 400078084.0 0.0X ================================================================================================ many column field read and write ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz many column field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 cols x 100000 rows (read in-mem) 59 72 8 1.7 591.0 1.0X -1 cols x 100000 rows (exec in-mem) 57 81 15 1.8 566.0 1.0X -1 cols x 100000 rows (read parquet) 61 78 13 1.6 614.8 1.0X -1 cols x 100000 rows (write parquet) 147 158 10 0.7 1468.5 0.4X -100 cols x 1000 rows (read in-mem) 57 62 6 1.8 565.8 1.0X -100 cols x 1000 rows (exec in-mem) 76 83 10 1.3 758.7 0.8X -100 cols x 1000 rows (read parquet) 70 79 10 1.4 700.8 0.8X -100 cols x 1000 rows (write parquet) 150 162 11 0.7 1498.8 0.4X -2500 cols x 40 rows (read in-mem) 413 424 15 0.2 4134.4 0.1X -2500 cols x 40 rows (exec in-mem) 753 772 23 0.1 7528.2 0.1X -2500 cols x 40 rows (read parquet) 304 312 8 0.3 3044.6 0.2X -2500 cols x 40 rows (write parquet) 507 520 11 0.2 5069.3 0.1X +1 cols x 100000 rows (read in-mem) 19 28 10 5.2 190.6 1.0X +1 cols x 100000 rows (exec in-mem) 23 40 17 4.4 226.2 0.8X +1 cols x 100000 rows (read parquet) 37 54 18 2.7 371.8 0.5X +1 cols x 100000 rows (write parquet) 116 166 62 0.9 1157.6 0.2X +100 cols x 1000 rows (read in-mem) 23 39 20 4.3 231.5 0.8X +100 cols x 1000 rows (exec in-mem) 35 56 24 2.8 352.5 0.5X +100 cols x 1000 rows (read parquet) 36 64 21 2.8 358.0 0.5X +100 cols x 1000 rows (write parquet) 121 148 36 0.8 1211.1 0.2X +2500 cols x 40 rows (read in-mem) 147 169 18 0.7 1474.8 0.1X +2500 cols x 40 rows (exec in-mem) 691 730 41 0.1 6912.5 0.0X +2500 cols x 40 rows (read parquet) 650 679 44 0.2 6495.8 0.0X +2500 cols x 40 rows (write parquet) 265 285 13 0.4 2651.2 0.1X ================================================================================================ wide shallowly nested struct field read and write ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz wide shallowly nested struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 wide x 100000 rows (read in-mem) 54 63 8 1.8 540.7 1.0X -1 wide x 100000 rows (exec in-mem) 67 77 11 1.5 671.8 0.8X -1 wide x 100000 rows (read parquet) 90 97 6 1.1 901.2 0.6X -1 wide x 100000 rows (write parquet) 150 163 11 0.7 1503.9 0.4X -100 wide x 1000 rows (read in-mem) 69 75 8 1.4 689.8 0.8X -100 wide x 1000 rows (exec in-mem) 111 148 96 0.9 1111.5 0.5X -100 wide x 1000 rows (read parquet) 181 241 35 0.6 1808.7 0.3X -100 wide x 1000 rows (write parquet) 164 180 27 0.6 1636.1 0.3X -2500 wide x 40 rows (read in-mem) 78 101 84 1.3 781.0 0.7X -2500 wide x 40 rows (exec in-mem) 943 966 37 0.1 9430.9 0.1X -2500 wide x 40 rows (read parquet) 1385 1453 95 0.1 13853.3 0.0X -2500 wide x 40 rows (write parquet) 175 190 19 0.6 1745.5 0.3X +1 wide x 100000 rows (read in-mem) 29 47 16 3.4 290.5 1.0X +1 wide x 100000 rows (exec in-mem) 35 56 19 2.9 350.3 0.8X +1 wide x 100000 rows (read parquet) 57 82 28 1.8 570.1 0.5X +1 wide x 100000 rows (write parquet) 124 171 44 0.8 1239.2 0.2X +100 wide x 1000 rows (read in-mem) 25 37 13 4.1 245.8 1.2X +100 wide x 1000 rows (exec in-mem) 40 56 16 2.5 404.5 0.7X +100 wide x 1000 rows (read parquet) 37 62 16 2.7 368.6 0.8X +100 wide x 1000 rows (write parquet) 134 156 22 0.7 1341.0 0.2X +2500 wide x 40 rows (read in-mem) 34 49 17 3.0 338.1 0.9X +2500 wide x 40 rows (exec in-mem) 433 454 16 0.2 4334.6 0.1X +2500 wide x 40 rows (read parquet) 163 233 53 0.6 1634.9 0.2X +2500 wide x 40 rows (write parquet) 126 177 45 0.8 1262.7 0.2X ================================================================================================ deeply nested struct field read and write ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz deeply nested struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 deep x 100000 rows (read in-mem) 44 49 6 2.3 441.1 1.0X -1 deep x 100000 rows (exec in-mem) 54 59 6 1.9 536.4 0.8X -1 deep x 100000 rows (read parquet) 65 68 6 1.5 646.1 0.7X -1 deep x 100000 rows (write parquet) 141 147 9 0.7 1413.9 0.3X -100 deep x 1000 rows (read in-mem) 459 470 11 0.2 4592.9 0.1X -100 deep x 1000 rows (exec in-mem) 1736 1740 6 0.1 17355.1 0.0X -100 deep x 1000 rows (read parquet) 1638 1643 6 0.1 16382.2 0.0X -100 deep x 1000 rows (write parquet) 555 567 12 0.2 5548.4 0.1X -250 deep x 400 rows (read in-mem) 2556 2556 1 0.0 25558.5 0.0X -250 deep x 400 rows (exec in-mem) 10410 10416 8 0.0 104102.6 0.0X -250 deep x 400 rows (read parquet) 9670 9688 26 0.0 96699.1 0.0X -250 deep x 400 rows (write parquet) 2638 2642 5 0.0 26379.7 0.0X +1 deep x 100000 rows (read in-mem) 27 40 15 3.7 273.6 1.0X +1 deep x 100000 rows (exec in-mem) 34 46 15 3.0 336.3 0.8X +1 deep x 100000 rows (read parquet) 53 74 17 1.9 527.0 0.5X +1 deep x 100000 rows (write parquet) 134 174 37 0.7 1339.3 0.2X +100 deep x 1000 rows (read in-mem) 87 99 9 1.1 870.2 0.3X +100 deep x 1000 rows (exec in-mem) 917 954 34 0.1 9171.4 0.0X +100 deep x 1000 rows (read parquet) 765 793 28 0.1 7645.5 0.0X +100 deep x 1000 rows (write parquet) 200 222 22 0.5 2003.2 0.1X +250 deep x 400 rows (read in-mem) 394 419 18 0.3 3939.3 0.1X +250 deep x 400 rows (exec in-mem) 6189 6210 29 0.0 61892.7 0.0X +250 deep x 400 rows (read parquet) 4454 4608 218 0.0 44539.5 0.0X +250 deep x 400 rows (write parquet) 448 455 4 0.2 4482.4 0.1X ================================================================================================ bushy struct field read and write ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -bushy struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -1 x 1 deep x 100000 rows (read in-mem) 39 44 6 2.6 388.2 1.0X -1 x 1 deep x 100000 rows (exec in-mem) 48 50 4 2.1 477.4 0.8X -1 x 1 deep x 100000 rows (read parquet) 47 54 9 2.1 466.1 0.8X -1 x 1 deep x 100000 rows (write parquet) 135 141 5 0.7 1350.5 0.3X -128 x 8 deep x 1000 rows (read in-mem) 45 53 9 2.2 445.2 0.9X -128 x 8 deep x 1000 rows (exec in-mem) 155 160 4 0.6 1553.0 0.2X -128 x 8 deep x 1000 rows (read parquet) 173 217 31 0.6 1729.8 0.2X -128 x 8 deep x 1000 rows (write parquet) 139 154 10 0.7 1389.9 0.3X -1024 x 11 deep x 100 rows (read in-mem) 73 77 4 1.4 730.2 0.5X -1024 x 11 deep x 100 rows (exec in-mem) 733 738 8 0.1 7326.1 0.1X -1024 x 11 deep x 100 rows (read parquet) 652 660 8 0.2 6517.6 0.1X -1024 x 11 deep x 100 rows (write parquet) 171 186 20 0.6 1706.4 0.2X +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz +bushy struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------- +1 x 1 deep x 100000 rows (read in-mem) 22 29 9 4.6 217.1 1.0X +1 x 1 deep x 100000 rows (exec in-mem) 29 36 9 3.4 292.1 0.7X +1 x 1 deep x 100000 rows (read parquet) 30 39 11 3.3 301.9 0.7X +1 x 1 deep x 100000 rows (write parquet) 139 181 49 0.7 1388.8 0.2X +128 x 8 deep x 1000 rows (read in-mem) 27 36 11 3.7 267.1 0.8X +128 x 8 deep x 1000 rows (exec in-mem) 62 85 22 1.6 618.8 0.4X +128 x 8 deep x 1000 rows (read parquet) 42 62 19 2.4 422.3 0.5X +128 x 8 deep x 1000 rows (write parquet) 126 141 11 0.8 1258.9 0.2X +1024 x 11 deep x 100 rows (read in-mem) 31 44 12 3.2 313.7 0.7X +1024 x 11 deep x 100 rows (exec in-mem) 363 392 24 0.3 3628.3 0.1X +1024 x 11 deep x 100 rows (read parquet) 79 107 28 1.3 792.5 0.3X +1024 x 11 deep x 100 rows (write parquet) 142 160 17 0.7 1424.1 0.2X ================================================================================================ wide array field read and write ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz wide array field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 wide x 100000 rows (read in-mem) 43 46 4 2.3 429.7 1.0X -1 wide x 100000 rows (exec in-mem) 54 57 4 1.8 542.4 0.8X -1 wide x 100000 rows (read parquet) 82 87 8 1.2 816.6 0.5X -1 wide x 100000 rows (write parquet) 137 159 19 0.7 1374.9 0.3X -100 wide x 1000 rows (read in-mem) 37 39 4 2.7 367.1 1.2X -100 wide x 1000 rows (exec in-mem) 45 50 6 2.2 451.6 1.0X -100 wide x 1000 rows (read parquet) 52 57 5 1.9 520.8 0.8X -100 wide x 1000 rows (write parquet) 125 131 8 0.8 1247.0 0.3X -2500 wide x 40 rows (read in-mem) 35 39 4 2.9 348.8 1.2X -2500 wide x 40 rows (exec in-mem) 46 49 5 2.2 456.0 0.9X -2500 wide x 40 rows (read parquet) 51 55 6 2.0 508.3 0.8X -2500 wide x 40 rows (write parquet) 129 135 6 0.8 1287.3 0.3X +1 wide x 100000 rows (read in-mem) 27 44 17 3.6 274.0 1.0X +1 wide x 100000 rows (exec in-mem) 31 45 17 3.3 305.4 0.9X +1 wide x 100000 rows (read parquet) 74 94 30 1.3 743.7 0.4X +1 wide x 100000 rows (write parquet) 127 156 29 0.8 1268.3 0.2X +100 wide x 1000 rows (read in-mem) 21 32 11 4.8 208.2 1.3X +100 wide x 1000 rows (exec in-mem) 26 37 12 3.8 260.0 1.1X +100 wide x 1000 rows (read parquet) 36 49 14 2.8 361.9 0.8X +100 wide x 1000 rows (write parquet) 128 172 42 0.8 1283.4 0.2X +2500 wide x 40 rows (read in-mem) 22 32 14 4.5 221.6 1.2X +2500 wide x 40 rows (exec in-mem) 26 37 13 3.9 257.0 1.1X +2500 wide x 40 rows (read parquet) 35 48 14 2.8 351.8 0.8X +2500 wide x 40 rows (write parquet) 124 142 16 0.8 1236.5 0.2X ================================================================================================ wide map field read and write ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz wide map field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 wide x 100000 rows (read in-mem) 39 48 9 2.5 394.2 1.0X -1 wide x 100000 rows (exec in-mem) 51 56 9 1.9 514.4 0.8X -1 wide x 100000 rows (read parquet) 119 124 7 0.8 1195.0 0.3X -1 wide x 100000 rows (write parquet) 130 138 8 0.8 1299.8 0.3X -100 wide x 1000 rows (read in-mem) 31 32 3 3.3 306.5 1.3X -100 wide x 1000 rows (exec in-mem) 40 42 3 2.5 402.7 1.0X -100 wide x 1000 rows (read parquet) 65 70 6 1.5 651.8 0.6X -100 wide x 1000 rows (write parquet) 123 129 6 0.8 1228.5 0.3X -2500 wide x 40 rows (read in-mem) 33 37 6 3.0 330.1 1.2X -2500 wide x 40 rows (exec in-mem) 43 44 3 2.3 426.6 0.9X -2500 wide x 40 rows (read parquet) 66 69 9 1.5 657.8 0.6X -2500 wide x 40 rows (write parquet) 123 127 2 0.8 1234.4 0.3X +1 wide x 100000 rows (read in-mem) 22 35 15 4.5 220.3 1.0X +1 wide x 100000 rows (exec in-mem) 31 41 14 3.2 312.3 0.7X +1 wide x 100000 rows (read parquet) 103 116 19 1.0 1032.1 0.2X +1 wide x 100000 rows (write parquet) 128 156 37 0.8 1277.7 0.2X +100 wide x 1000 rows (read in-mem) 14 20 9 7.1 140.0 1.6X +100 wide x 1000 rows (exec in-mem) 20 25 9 5.1 197.8 1.1X +100 wide x 1000 rows (read parquet) 45 60 14 2.2 445.1 0.5X +100 wide x 1000 rows (write parquet) 116 138 17 0.9 1162.6 0.2X +2500 wide x 40 rows (read in-mem) 16 21 9 6.2 160.4 1.4X +2500 wide x 40 rows (exec in-mem) 21 30 12 4.8 210.0 1.0X +2500 wide x 40 rows (read parquet) 47 59 19 2.1 467.4 0.5X +2500 wide x 40 rows (write parquet) 119 125 7 0.8 1186.4 0.2X diff --git a/sql/core/benchmarks/WideSchemaBenchmark-results.txt b/sql/core/benchmarks/WideSchemaBenchmark-results.txt index 59eb181f6b115..8b91921809cae 100644 --- a/sql/core/benchmarks/WideSchemaBenchmark-results.txt +++ b/sql/core/benchmarks/WideSchemaBenchmark-results.txt @@ -2,144 +2,144 @@ parsing large select expressions ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz parsing large select: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 select expressions 5 13 8 0.0 5370143.0 1.0X -100 select expressions 12 16 6 0.0 11995425.0 0.4X -2500 select expressions 211 214 4 0.0 210927791.0 0.0X +1 select expressions 1 2 0 0.0 1296117.0 1.0X +100 select expressions 9 11 1 0.0 8808690.0 0.1X +2500 select expressions 422 426 5 0.0 421632363.0 0.0X ================================================================================================ many column field read and write ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz many column field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 cols x 100000 rows (read in-mem) 44 53 6 2.3 440.3 1.0X -1 cols x 100000 rows (exec in-mem) 44 54 9 2.3 437.0 1.0X -1 cols x 100000 rows (read parquet) 53 61 10 1.9 532.4 0.8X -1 cols x 100000 rows (write parquet) 129 142 36 0.8 1291.6 0.3X -100 cols x 1000 rows (read in-mem) 49 55 7 2.0 494.9 0.9X -100 cols x 1000 rows (exec in-mem) 69 73 5 1.4 693.2 0.6X -100 cols x 1000 rows (read parquet) 60 67 8 1.7 596.3 0.7X -100 cols x 1000 rows (write parquet) 142 156 31 0.7 1417.8 0.3X -2500 cols x 40 rows (read in-mem) 391 399 13 0.3 3912.6 0.1X -2500 cols x 40 rows (exec in-mem) 743 749 8 0.1 7432.5 0.1X -2500 cols x 40 rows (read parquet) 297 310 10 0.3 2972.8 0.1X -2500 cols x 40 rows (write parquet) 485 492 16 0.2 4848.1 0.1X +1 cols x 100000 rows (read in-mem) 15 18 3 6.5 154.0 1.0X +1 cols x 100000 rows (exec in-mem) 20 23 4 4.9 202.1 0.8X +1 cols x 100000 rows (read parquet) 34 41 12 3.0 338.8 0.5X +1 cols x 100000 rows (write parquet) 123 132 6 0.8 1226.7 0.1X +100 cols x 1000 rows (read in-mem) 22 25 4 4.5 221.5 0.7X +100 cols x 1000 rows (exec in-mem) 36 40 5 2.8 357.2 0.4X +100 cols x 1000 rows (read parquet) 33 41 15 3.0 331.2 0.5X +100 cols x 1000 rows (write parquet) 120 133 10 0.8 1199.6 0.1X +2500 cols x 40 rows (read in-mem) 165 179 9 0.6 1645.1 0.1X +2500 cols x 40 rows (exec in-mem) 734 784 51 0.1 7338.1 0.0X +2500 cols x 40 rows (read parquet) 621 634 18 0.2 6210.9 0.0X +2500 cols x 40 rows (write parquet) 268 283 18 0.4 2675.3 0.1X ================================================================================================ wide shallowly nested struct field read and write ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz wide shallowly nested struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 wide x 100000 rows (read in-mem) 43 48 6 2.3 427.0 1.0X -1 wide x 100000 rows (exec in-mem) 56 63 8 1.8 557.8 0.8X -1 wide x 100000 rows (read parquet) 82 88 10 1.2 818.6 0.5X -1 wide x 100000 rows (write parquet) 134 145 21 0.7 1344.6 0.3X -100 wide x 1000 rows (read in-mem) 55 61 16 1.8 553.1 0.8X -100 wide x 1000 rows (exec in-mem) 94 101 17 1.1 941.4 0.5X -100 wide x 1000 rows (read parquet) 151 179 29 0.7 1511.7 0.3X -100 wide x 1000 rows (write parquet) 147 157 9 0.7 1470.0 0.3X -2500 wide x 40 rows (read in-mem) 66 69 9 1.5 658.9 0.6X -2500 wide x 40 rows (exec in-mem) 853 871 30 0.1 8525.7 0.1X -2500 wide x 40 rows (read parquet) 1158 1296 195 0.1 11577.8 0.0X -2500 wide x 40 rows (write parquet) 157 173 23 0.6 1569.6 0.3X +1 wide x 100000 rows (read in-mem) 27 30 5 3.8 265.0 1.0X +1 wide x 100000 rows (exec in-mem) 33 37 5 3.0 331.8 0.8X +1 wide x 100000 rows (read parquet) 54 60 9 1.9 536.1 0.5X +1 wide x 100000 rows (write parquet) 129 140 6 0.8 1293.8 0.2X +100 wide x 1000 rows (read in-mem) 21 26 6 4.8 210.5 1.3X +100 wide x 1000 rows (exec in-mem) 43 51 6 2.3 434.4 0.6X +100 wide x 1000 rows (read parquet) 34 39 8 2.9 340.2 0.8X +100 wide x 1000 rows (write parquet) 119 128 4 0.8 1188.9 0.2X +2500 wide x 40 rows (read in-mem) 31 37 7 3.2 310.6 0.9X +2500 wide x 40 rows (exec in-mem) 524 559 37 0.2 5242.4 0.1X +2500 wide x 40 rows (read parquet) 139 152 6 0.7 1393.4 0.2X +2500 wide x 40 rows (write parquet) 130 151 42 0.8 1300.7 0.2X ================================================================================================ deeply nested struct field read and write ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz deeply nested struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 deep x 100000 rows (read in-mem) 37 41 6 2.7 374.5 1.0X -1 deep x 100000 rows (exec in-mem) 47 50 6 2.1 466.9 0.8X -1 deep x 100000 rows (read parquet) 58 61 7 1.7 577.7 0.6X -1 deep x 100000 rows (write parquet) 128 134 18 0.8 1282.2 0.3X -100 deep x 1000 rows (read in-mem) 345 350 5 0.3 3447.8 0.1X -100 deep x 1000 rows (exec in-mem) 1283 1283 0 0.1 12830.5 0.0X -100 deep x 1000 rows (read parquet) 1201 1205 7 0.1 12005.2 0.0X -100 deep x 1000 rows (write parquet) 436 443 9 0.2 4361.4 0.1X -250 deep x 400 rows (read in-mem) 1882 1883 1 0.1 18819.9 0.0X -250 deep x 400 rows (exec in-mem) 7705 7709 5 0.0 77054.4 0.0X -250 deep x 400 rows (read parquet) 7052 7087 50 0.0 70517.1 0.0X -250 deep x 400 rows (write parquet) 1978 1979 1 0.1 19780.3 0.0X +1 deep x 100000 rows (read in-mem) 21 25 4 4.7 214.6 1.0X +1 deep x 100000 rows (exec in-mem) 27 31 6 3.7 266.7 0.8X +1 deep x 100000 rows (read parquet) 43 51 10 2.3 431.2 0.5X +1 deep x 100000 rows (write parquet) 121 125 4 0.8 1205.3 0.2X +100 deep x 1000 rows (read in-mem) 71 77 4 1.4 707.6 0.3X +100 deep x 1000 rows (exec in-mem) 675 685 13 0.1 6746.2 0.0X +100 deep x 1000 rows (read parquet) 583 588 9 0.2 5832.6 0.0X +100 deep x 1000 rows (write parquet) 169 183 15 0.6 1687.8 0.1X +250 deep x 400 rows (read in-mem) 264 276 11 0.4 2642.9 0.1X +250 deep x 400 rows (exec in-mem) 4254 4289 50 0.0 42538.9 0.0X +250 deep x 400 rows (read parquet) 3280 3348 96 0.0 32796.7 0.0X +250 deep x 400 rows (write parquet) 392 406 14 0.3 3915.9 0.1X ================================================================================================ bushy struct field read and write ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz -bushy struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------- -1 x 1 deep x 100000 rows (read in-mem) 34 39 7 2.9 341.5 1.0X -1 x 1 deep x 100000 rows (exec in-mem) 42 45 5 2.4 423.4 0.8X -1 x 1 deep x 100000 rows (read parquet) 42 45 6 2.4 423.8 0.8X -1 x 1 deep x 100000 rows (write parquet) 124 132 19 0.8 1240.4 0.3X -128 x 8 deep x 1000 rows (read in-mem) 39 42 6 2.6 387.3 0.9X -128 x 8 deep x 1000 rows (exec in-mem) 134 138 6 0.7 1342.5 0.3X -128 x 8 deep x 1000 rows (read parquet) 147 164 27 0.7 1468.2 0.2X -128 x 8 deep x 1000 rows (write parquet) 130 142 34 0.8 1297.7 0.3X -1024 x 11 deep x 100 rows (read in-mem) 64 68 11 1.6 639.3 0.5X -1024 x 11 deep x 100 rows (exec in-mem) 642 652 14 0.2 6416.9 0.1X -1024 x 11 deep x 100 rows (read parquet) 527 531 5 0.2 5268.1 0.1X -1024 x 11 deep x 100 rows (write parquet) 155 166 28 0.6 1545.0 0.2X +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz +bushy struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative +------------------------------------------------------------------------------------------------------------------------- +1 x 1 deep x 100000 rows (read in-mem) 19 22 5 5.3 189.0 1.0X +1 x 1 deep x 100000 rows (exec in-mem) 23 29 5 4.3 231.4 0.8X +1 x 1 deep x 100000 rows (read parquet) 26 31 7 3.8 264.7 0.7X +1 x 1 deep x 100000 rows (write parquet) 119 136 44 0.8 1189.3 0.2X +128 x 8 deep x 1000 rows (read in-mem) 21 24 4 4.8 208.8 0.9X +128 x 8 deep x 1000 rows (exec in-mem) 56 62 4 1.8 561.8 0.3X +128 x 8 deep x 1000 rows (read parquet) 35 40 7 2.8 353.0 0.5X +128 x 8 deep x 1000 rows (write parquet) 119 128 6 0.8 1193.9 0.2X +1024 x 11 deep x 100 rows (read in-mem) 27 31 4 3.7 269.0 0.7X +1024 x 11 deep x 100 rows (exec in-mem) 366 377 9 0.3 3661.4 0.1X +1024 x 11 deep x 100 rows (read parquet) 70 74 6 1.4 698.0 0.3X +1024 x 11 deep x 100 rows (write parquet) 131 141 6 0.8 1314.8 0.1X ================================================================================================ wide array field read and write ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz wide array field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 wide x 100000 rows (read in-mem) 36 39 5 2.7 364.2 1.0X -1 wide x 100000 rows (exec in-mem) 46 50 7 2.2 460.4 0.8X -1 wide x 100000 rows (read parquet) 75 78 8 1.3 749.8 0.5X -1 wide x 100000 rows (write parquet) 127 133 19 0.8 1266.0 0.3X -100 wide x 1000 rows (read in-mem) 31 33 4 3.2 309.9 1.2X -100 wide x 1000 rows (exec in-mem) 40 42 4 2.5 397.3 0.9X -100 wide x 1000 rows (read parquet) 49 52 7 2.0 488.6 0.7X -100 wide x 1000 rows (write parquet) 122 135 23 0.8 1216.2 0.3X -2500 wide x 40 rows (read in-mem) 31 32 3 3.3 305.7 1.2X -2500 wide x 40 rows (exec in-mem) 39 42 5 2.6 391.9 0.9X -2500 wide x 40 rows (read parquet) 48 51 7 2.1 482.9 0.8X -2500 wide x 40 rows (write parquet) 120 130 22 0.8 1203.6 0.3X +1 wide x 100000 rows (read in-mem) 20 24 4 4.9 204.1 1.0X +1 wide x 100000 rows (exec in-mem) 26 31 4 3.8 263.6 0.8X +1 wide x 100000 rows (read parquet) 57 64 8 1.8 565.8 0.4X +1 wide x 100000 rows (write parquet) 115 129 6 0.9 1148.2 0.2X +100 wide x 1000 rows (read in-mem) 17 20 6 5.9 170.0 1.2X +100 wide x 1000 rows (exec in-mem) 21 24 4 4.7 214.3 1.0X +100 wide x 1000 rows (read parquet) 30 36 7 3.3 303.9 0.7X +100 wide x 1000 rows (write parquet) 113 120 4 0.9 1127.2 0.2X +2500 wide x 40 rows (read in-mem) 17 21 4 5.9 169.9 1.2X +2500 wide x 40 rows (exec in-mem) 21 26 5 4.7 214.3 1.0X +2500 wide x 40 rows (read parquet) 30 35 7 3.3 300.8 0.7X +2500 wide x 40 rows (write parquet) 116 122 4 0.9 1161.4 0.2X ================================================================================================ wide map field read and write ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz wide map field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -1 wide x 100000 rows (read in-mem) 35 40 8 2.9 348.8 1.0X -1 wide x 100000 rows (exec in-mem) 46 47 2 2.2 461.8 0.8X -1 wide x 100000 rows (read parquet) 124 127 7 0.8 1236.1 0.3X -1 wide x 100000 rows (write parquet) 125 138 26 0.8 1245.4 0.3X -100 wide x 1000 rows (read in-mem) 26 35 8 3.8 263.1 1.3X -100 wide x 1000 rows (exec in-mem) 35 41 10 2.8 351.8 1.0X -100 wide x 1000 rows (read parquet) 59 62 8 1.7 586.7 0.6X -100 wide x 1000 rows (write parquet) 116 125 32 0.9 1158.2 0.3X -2500 wide x 40 rows (read in-mem) 27 30 5 3.7 270.2 1.3X -2500 wide x 40 rows (exec in-mem) 37 38 3 2.7 366.4 1.0X -2500 wide x 40 rows (read parquet) 58 62 8 1.7 584.3 0.6X -2500 wide x 40 rows (write parquet) 118 126 24 0.9 1176.1 0.3X +1 wide x 100000 rows (read in-mem) 19 23 3 5.1 194.5 1.0X +1 wide x 100000 rows (exec in-mem) 26 29 2 3.8 260.1 0.7X +1 wide x 100000 rows (read parquet) 79 88 7 1.3 785.1 0.2X +1 wide x 100000 rows (write parquet) 120 125 5 0.8 1195.5 0.2X +100 wide x 1000 rows (read in-mem) 13 15 3 7.7 130.1 1.5X +100 wide x 1000 rows (exec in-mem) 18 20 2 5.6 177.7 1.1X +100 wide x 1000 rows (read parquet) 38 43 7 2.6 383.8 0.5X +100 wide x 1000 rows (write parquet) 113 121 6 0.9 1130.0 0.2X +2500 wide x 40 rows (read in-mem) 15 17 4 6.9 145.0 1.3X +2500 wide x 40 rows (exec in-mem) 20 22 3 5.1 195.5 1.0X +2500 wide x 40 rows (read parquet) 38 44 8 2.6 383.8 0.5X +2500 wide x 40 rows (write parquet) 114 120 4 0.9 1137.3 0.2X diff --git a/sql/core/benchmarks/WideTableBenchmark-jdk11-results.txt b/sql/core/benchmarks/WideTableBenchmark-jdk11-results.txt index 8f3920db0dcd9..4a29255009faa 100644 --- a/sql/core/benchmarks/WideTableBenchmark-jdk11-results.txt +++ b/sql/core/benchmarks/WideTableBenchmark-jdk11-results.txt @@ -2,16 +2,16 @@ projection on wide table ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz projection on wide table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -split threshold 10 8915 9048 180 0.1 8501.7 1.0X -split threshold 100 4419 4465 31 0.2 4214.2 2.0X -split threshold 1024 2477 2559 57 0.4 2362.4 3.6X -split threshold 2048 2314 2391 74 0.5 2206.7 3.9X -split threshold 4096 2374 2399 18 0.4 2264.2 3.8X -split threshold 8192 2831 2846 11 0.4 2699.7 3.1X -split threshold 65536 26886 26944 55 0.0 25640.7 0.3X +split threshold 10 3882 3963 54 0.3 3702.2 1.0X +split threshold 100 1810 1821 8 0.6 1726.1 2.1X +split threshold 1024 1435 1457 47 0.7 1368.3 2.7X +split threshold 2048 1357 1369 13 0.8 1294.3 2.9X +split threshold 4096 1902 1921 24 0.6 1814.1 2.0X +split threshold 8192 2700 2719 32 0.4 2574.7 1.4X +split threshold 65536 26623 26688 125 0.0 25389.7 0.1X diff --git a/sql/core/benchmarks/WideTableBenchmark-results.txt b/sql/core/benchmarks/WideTableBenchmark-results.txt index 4f64f877ac0c8..45aaad3817121 100644 --- a/sql/core/benchmarks/WideTableBenchmark-results.txt +++ b/sql/core/benchmarks/WideTableBenchmark-results.txt @@ -2,16 +2,16 @@ projection on wide table ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz projection on wide table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -split threshold 10 6461 6535 84 0.2 6161.9 1.0X -split threshold 100 3643 3725 74 0.3 3474.5 1.8X -split threshold 1024 2217 2255 26 0.5 2113.9 2.9X -split threshold 2048 1941 2003 60 0.5 1851.5 3.3X -split threshold 4096 2195 2220 20 0.5 2093.4 2.9X -split threshold 8192 2592 2652 39 0.4 2472.4 2.5X -split threshold 65536 26324 26365 66 0.0 25104.1 0.2X +split threshold 10 1897 1937 46 0.6 1809.2 1.0X +split threshold 100 1461 1493 29 0.7 1393.2 1.3X +split threshold 1024 1106 1126 14 0.9 1054.3 1.7X +split threshold 2048 1064 1104 62 1.0 1014.4 1.8X +split threshold 4096 1370 1401 49 0.8 1306.9 1.4X +split threshold 8192 1887 1966 56 0.6 1799.4 1.0X +split threshold 65536 20021 20148 133 0.1 19093.4 0.1X diff --git a/sql/hive/benchmarks/InsertIntoHiveTableBenchmark-hive2.3-results.txt b/sql/hive/benchmarks/InsertIntoHiveTableBenchmark-hive2.3-results.txt index ea8e6057ea610..080beb1a7e04c 100644 --- a/sql/hive/benchmarks/InsertIntoHiveTableBenchmark-hive2.3-results.txt +++ b/sql/hive/benchmarks/InsertIntoHiveTableBenchmark-hive2.3-results.txt @@ -1,11 +1,11 @@ -Java HotSpot(TM) 64-Bit Server VM 1.8.0_251-b08 on Mac OS X 10.15.4 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz insert hive table benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -INSERT INTO DYNAMIC 4326 4373 66 0.0 422486.0 1.0X -INSERT INTO HYBRID 726 741 21 0.0 70877.2 6.0X -INSERT INTO STATIC 256 270 12 0.0 25015.7 16.9X -INSERT OVERWRITE DYNAMIC 4115 4150 49 0.0 401828.8 1.1X -INSERT OVERWRITE HYBRID 690 699 8 0.0 67370.5 6.3X -INSERT OVERWRITE STATIC 277 283 5 0.0 27097.9 15.6X +INSERT INTO DYNAMIC 3706 3988 399 0.0 361896.5 1.0X +INSERT INTO HYBRID 546 570 22 0.0 53358.1 6.8X +INSERT INTO STATIC 174 184 6 0.1 16982.0 21.3X +INSERT OVERWRITE DYNAMIC 3263 3290 39 0.0 318624.1 1.1X +INSERT OVERWRITE HYBRID 493 536 42 0.0 48105.7 7.5X +INSERT OVERWRITE STATIC 187 196 10 0.1 18240.2 19.8X diff --git a/sql/hive/benchmarks/InsertIntoHiveTableBenchmark-jdk11-hive2.3-results.txt b/sql/hive/benchmarks/InsertIntoHiveTableBenchmark-jdk11-hive2.3-results.txt index c7a642aad5273..df4abe92db528 100644 --- a/sql/hive/benchmarks/InsertIntoHiveTableBenchmark-jdk11-hive2.3-results.txt +++ b/sql/hive/benchmarks/InsertIntoHiveTableBenchmark-jdk11-hive2.3-results.txt @@ -1,11 +1,11 @@ -Java HotSpot(TM) 64-Bit Server VM 11.0.5+10-LTS on Mac OS X 10.15.4 -Intel(R) Core(TM) i9-9980HK CPU @ 2.40GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz insert hive table benchmark: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -INSERT INTO DYNAMIC 5083 5412 466 0.0 496384.5 1.0X -INSERT INTO HYBRID 822 864 43 0.0 80283.6 6.2X -INSERT INTO STATIC 335 342 5 0.0 32694.1 15.2X -INSERT OVERWRITE DYNAMIC 4941 5068 179 0.0 482534.5 1.0X -INSERT OVERWRITE HYBRID 722 745 27 0.0 70502.7 7.0X -INSERT OVERWRITE STATIC 295 314 12 0.0 28846.8 17.2X +INSERT INTO DYNAMIC 4281 4685 572 0.0 418070.8 1.0X +INSERT INTO HYBRID 776 834 56 0.0 75780.6 5.5X +INSERT INTO STATIC 196 215 14 0.1 19143.1 21.8X +INSERT OVERWRITE DYNAMIC 4597 4775 253 0.0 448878.6 0.9X +INSERT OVERWRITE HYBRID 722 737 22 0.0 70517.6 5.9X +INSERT OVERWRITE STATIC 193 211 14 0.1 18830.4 22.2X diff --git a/sql/hive/benchmarks/ObjectHashAggregateExecBenchmark-jdk11-results.txt b/sql/hive/benchmarks/ObjectHashAggregateExecBenchmark-jdk11-results.txt index 4a8058766319f..90b7b9bede66d 100644 --- a/sql/hive/benchmarks/ObjectHashAggregateExecBenchmark-jdk11-results.txt +++ b/sql/hive/benchmarks/ObjectHashAggregateExecBenchmark-jdk11-results.txt @@ -2,44 +2,44 @@ Hive UDAF vs Spark AF ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz hive udaf vs spark af: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -hive udaf w/o group by 6492 7169 388 0.0 99066.1 1.0X -spark af w/o group by 58 88 24 1.1 890.2 111.3X -hive udaf w/ group by 4864 4888 33 0.0 74221.0 1.3X -spark af w/ group by w/o fallback 60 67 7 1.1 912.9 108.5X -spark af w/ group by w/ fallback 154 164 27 0.4 2348.2 42.2X +hive udaf w/o group by 7504 7577 56 0.0 114496.1 1.0X +spark af w/o group by 37 44 7 1.8 560.2 204.4X +hive udaf w/ group by 5867 6075 194 0.0 89527.2 1.3X +spark af w/ group by w/o fallback 40 46 6 1.6 608.7 188.1X +spark af w/ group by w/ fallback 50 55 5 1.3 764.4 149.8X ================================================================================================ ObjectHashAggregateExec vs SortAggregateExec - typed_count ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz object agg v.s. sort agg: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -sort agg w/ group by 51728 51728 0 2.0 493.3 1.0X -object agg w/ group by w/o fallback 10174 10218 34 10.3 97.0 5.1X -object agg w/ group by w/ fallback 29341 29537 277 3.6 279.8 1.8X -sort agg w/o group by 7541 7577 28 13.9 71.9 6.9X -object agg w/o group by w/o fallback 5574 5620 38 18.8 53.2 9.3X +sort agg w/ group by 41856 42278 597 2.5 399.2 1.0X +object agg w/ group by w/o fallback 12479 12754 320 8.4 119.0 3.4X +object agg w/ group by w/ fallback 25981 26058 109 4.0 247.8 1.6X +sort agg w/o group by 7351 7473 116 14.3 70.1 5.7X +object agg w/o group by w/o fallback 7095 7406 490 14.8 67.7 5.9X ================================================================================================ ObjectHashAggregateExec vs SortAggregateExec - percentile_approx ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz object agg v.s. sort agg: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -sort agg w/ group by 900 925 14 2.3 429.0 1.0X -object agg w/ group by w/o fallback 597 633 14 3.5 284.6 1.5X -object agg w/ group by w/ fallback 905 923 10 2.3 431.6 1.0X -sort agg w/o group by 611 631 10 3.4 291.4 1.5X -object agg w/o group by w/o fallback 559 576 11 3.8 266.5 1.6X +sort agg w/ group by 952 1047 92 2.2 453.9 1.0X +object agg w/ group by w/o fallback 829 957 90 2.5 395.2 1.1X +object agg w/ group by w/ fallback 972 1107 128 2.2 463.5 1.0X +sort agg w/o group by 732 858 98 2.9 349.1 1.3X +object agg w/o group by w/o fallback 770 897 92 2.7 367.4 1.2X diff --git a/sql/hive/benchmarks/ObjectHashAggregateExecBenchmark-results.txt b/sql/hive/benchmarks/ObjectHashAggregateExecBenchmark-results.txt index 8c58a5a5fdf0b..60486269993a6 100644 --- a/sql/hive/benchmarks/ObjectHashAggregateExecBenchmark-results.txt +++ b/sql/hive/benchmarks/ObjectHashAggregateExecBenchmark-results.txt @@ -2,44 +2,44 @@ Hive UDAF vs Spark AF ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz hive udaf vs spark af: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -hive udaf w/o group by 7014 7206 120 0.0 107031.0 1.0X -spark af w/o group by 47 59 11 1.4 716.9 149.3X -hive udaf w/ group by 4811 4831 28 0.0 73409.1 1.5X -spark af w/ group by w/o fallback 50 56 7 1.3 762.9 140.3X -spark af w/ group by w/ fallback 126 130 8 0.5 1916.6 55.8X +hive udaf w/o group by 4805 4881 55 0.0 73323.1 1.0X +spark af w/o group by 34 39 6 2.0 511.6 143.3X +hive udaf w/ group by 3770 3884 202 0.0 57526.2 1.3X +spark af w/ group by w/o fallback 34 39 5 1.9 525.7 139.5X +spark af w/ group by w/ fallback 39 44 5 1.7 596.5 122.9X ================================================================================================ ObjectHashAggregateExec vs SortAggregateExec - typed_count ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz object agg v.s. sort agg: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -sort agg w/ group by 42969 43306 476 2.4 409.8 1.0X -object agg w/ group by w/o fallback 9744 9844 145 10.8 92.9 4.4X -object agg w/ group by w/ fallback 26814 26960 206 3.9 255.7 1.6X -sort agg w/o group by 6278 6330 57 16.7 59.9 6.8X -object agg w/o group by w/o fallback 5433 5478 60 19.3 51.8 7.9X +sort agg w/ group by 30645 31295 919 3.4 292.3 1.0X +object agg w/ group by w/o fallback 7025 7425 425 14.9 67.0 4.4X +object agg w/ group by w/ fallback 17222 18169 1251 6.1 164.2 1.8X +sort agg w/o group by 4755 4827 143 22.1 45.3 6.4X +object agg w/o group by w/o fallback 4183 4495 269 25.1 39.9 7.3X ================================================================================================ ObjectHashAggregateExec vs SortAggregateExec - percentile_approx ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz object agg v.s. sort agg: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -sort agg w/ group by 756 773 9 2.8 360.3 1.0X -object agg w/ group by w/o fallback 548 560 7 3.8 261.3 1.4X -object agg w/ group by w/ fallback 759 773 7 2.8 362.0 1.0X -sort agg w/o group by 471 483 13 4.4 224.8 1.6X -object agg w/o group by w/o fallback 471 482 12 4.5 224.7 1.6X +sort agg w/ group by 625 673 29 3.4 297.9 1.0X +object agg w/ group by w/o fallback 509 549 24 4.1 242.9 1.2X +object agg w/ group by w/ fallback 600 652 33 3.5 286.2 1.0X +sort agg w/o group by 461 499 20 4.6 219.6 1.4X +object agg w/o group by w/o fallback 470 510 22 4.5 224.0 1.3X diff --git a/sql/hive/benchmarks/OrcReadBenchmark-jdk11-results.txt b/sql/hive/benchmarks/OrcReadBenchmark-jdk11-results.txt index d516d3369ad05..114a9c2b4e896 100644 --- a/sql/hive/benchmarks/OrcReadBenchmark-jdk11-results.txt +++ b/sql/hive/benchmarks/OrcReadBenchmark-jdk11-results.txt @@ -2,155 +2,155 @@ SQL Single Numeric Column Scan ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1750 1872 173 9.0 111.2 1.0X -Native ORC Vectorized 433 499 68 36.3 27.5 4.0X -Hive built-in ORC 2540 2575 49 6.2 161.5 0.7X +Native ORC MR 873 886 12 18.0 55.5 1.0X +Native ORC Vectorized 114 162 42 138.2 7.2 7.7X +Hive built-in ORC 1854 1924 99 8.5 117.9 0.5X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1979 2001 31 7.9 125.8 1.0X -Native ORC Vectorized 261 303 42 60.3 16.6 7.6X -Hive built-in ORC 2559 2583 34 6.1 162.7 0.8X +Native ORC MR 1136 1330 275 13.8 72.2 1.0X +Native ORC Vectorized 191 288 85 82.1 12.2 5.9X +Hive built-in ORC 2056 2068 17 7.7 130.7 0.6X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 2094 2158 91 7.5 133.2 1.0X -Native ORC Vectorized 309 361 41 50.8 19.7 6.8X -Hive built-in ORC 2649 2744 135 5.9 168.4 0.8X +Native ORC MR 1389 1457 97 11.3 88.3 1.0X +Native ORC Vectorized 394 408 11 40.0 25.0 3.5X +Hive built-in ORC 2089 2105 23 7.5 132.8 0.7X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 2256 2271 22 7.0 143.4 1.0X -Native ORC Vectorized 511 518 11 30.8 32.5 4.4X -Hive built-in ORC 2867 2880 19 5.5 182.3 0.8X +Native ORC MR 1361 1372 15 11.6 86.6 1.0X +Native ORC Vectorized 468 487 15 33.6 29.7 2.9X +Hive built-in ORC 2305 2323 25 6.8 146.6 0.6X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 2270 2325 78 6.9 144.3 1.0X -Native ORC Vectorized 502 508 5 31.3 31.9 4.5X -Hive built-in ORC 2862 2880 24 5.5 182.0 0.8X +Native ORC MR 1278 1285 10 12.3 81.2 1.0X +Native ORC Vectorized 379 428 49 41.6 24.1 3.4X +Hive built-in ORC 2138 2143 6 7.4 135.9 0.6X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 2376 2426 71 6.6 151.0 1.0X -Native ORC Vectorized 609 616 8 25.8 38.7 3.9X -Hive built-in ORC 2979 2991 17 5.3 189.4 0.8X +Native ORC MR 1327 1341 20 11.9 84.3 1.0X +Native ORC Vectorized 443 466 21 35.5 28.1 3.0X +Hive built-in ORC 2476 2538 88 6.4 157.4 0.5X ================================================================================================ Int and String Scan ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 4112 4232 170 2.6 392.1 1.0X -Native ORC Vectorized 2199 2223 35 4.8 209.7 1.9X -Hive built-in ORC 5150 5238 123 2.0 491.2 0.8X +Native ORC MR 2987 3079 130 3.5 284.9 1.0X +Native ORC Vectorized 1570 1582 16 6.7 149.8 1.9X +Hive built-in ORC 3680 3689 13 2.8 350.9 0.8X ================================================================================================ Partitioned Table Scan ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Data column - Native ORC MR 2398 2435 53 6.6 152.4 1.0X -Data column - Native ORC Vectorized 458 482 26 34.3 29.1 5.2X -Data column - Hive built-in ORC 3126 3171 64 5.0 198.8 0.8X -Partition column - Native ORC MR 1639 1680 58 9.6 104.2 1.5X -Partition column - Native ORC Vectorized 105 119 11 149.6 6.7 22.8X -Partition column - Hive built-in ORC 2223 2229 8 7.1 141.4 1.1X -Both columns - Native ORC MR 2588 2608 28 6.1 164.5 0.9X -Both columns - Native ORC Vectorized 489 522 49 32.2 31.1 4.9X -Both columns - Hive built-in ORC 3258 3292 48 4.8 207.1 0.7X +Data column - Native ORC MR 2264 2285 29 6.9 144.0 1.0X +Data column - Native ORC Vectorized 513 573 41 30.7 32.6 4.4X +Data column - Hive built-in ORC 3257 3303 65 4.8 207.1 0.7X +Partition column - Native ORC MR 1482 1500 24 10.6 94.2 1.5X +Partition column - Native ORC Vectorized 48 77 29 326.2 3.1 47.0X +Partition column - Hive built-in ORC 2104 2105 1 7.5 133.8 1.1X +Both columns - Native ORC MR 2414 2422 11 6.5 153.5 0.9X +Both columns - Native ORC Vectorized 527 566 46 29.8 33.5 4.3X +Both columns - Hive built-in ORC 3101 3123 31 5.1 197.2 0.7X ================================================================================================ Repeated String Scan ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1991 2028 52 5.3 189.9 1.0X -Native ORC Vectorized 392 398 8 26.7 37.4 5.1X -Hive built-in ORC 2810 2816 8 3.7 268.0 0.7X +Native ORC MR 1440 1458 26 7.3 137.3 1.0X +Native ORC Vectorized 253 314 97 41.4 24.1 5.7X +Hive built-in ORC 1907 1915 11 5.5 181.9 0.8X ================================================================================================ String with Nulls Scan ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 3638 3647 13 2.9 346.9 1.0X -Native ORC Vectorized 1171 1181 14 9.0 111.7 3.1X -Hive built-in ORC 4847 4871 34 2.2 462.2 0.8X +Native ORC MR 2394 2484 128 4.4 228.3 1.0X +Native ORC Vectorized 811 819 10 12.9 77.3 3.0X +Hive built-in ORC 3317 3325 12 3.2 316.3 0.7X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 3280 3283 5 3.2 312.8 1.0X -Native ORC Vectorized 1199 1206 10 8.7 114.4 2.7X -Hive built-in ORC 4263 4273 14 2.5 406.5 0.8X +Native ORC MR 1920 1987 94 5.5 183.1 1.0X +Native ORC Vectorized 937 989 46 11.2 89.3 2.0X +Hive built-in ORC 2839 3060 313 3.7 270.7 0.7X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1935 1950 21 5.4 184.6 1.0X -Native ORC Vectorized 451 459 10 23.2 43.1 4.3X -Hive built-in ORC 2542 2552 14 4.1 242.4 0.8X +Native ORC MR 1050 1060 14 10.0 100.1 1.0X +Native ORC Vectorized 283 357 88 37.1 27.0 3.7X +Hive built-in ORC 1745 1752 10 6.0 166.4 0.6X ================================================================================================ Single Column Scan From Wide Columns ================================================================================================ -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 270 292 23 3.9 257.2 1.0X -Native ORC Vectorized 143 155 12 7.3 136.2 1.9X -Hive built-in ORC 1593 1627 48 0.7 1519.1 0.2X +Native ORC MR 125 155 38 8.4 119.5 1.0X +Native ORC Vectorized 87 121 35 12.1 82.7 1.4X +Hive built-in ORC 1261 1401 198 0.8 1202.9 0.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Single Column Scan from 200 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 369 386 17 2.8 351.5 1.0X -Native ORC Vectorized 218 231 15 4.8 208.3 1.7X -Hive built-in ORC 3092 3101 12 0.3 2949.1 0.1X +Native ORC MR 151 197 47 7.0 143.8 1.0X +Native ORC Vectorized 90 121 36 11.7 85.7 1.7X +Hive built-in ORC 2285 2293 12 0.5 2178.9 0.1X -OpenJDK 64-Bit Server VM 11.0.5+10-post-Ubuntu-0ubuntu1.118.04 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 11.0.10+9-LTS on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz Single Column Scan from 300 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 498 531 33 2.1 475.0 1.0X -Native ORC Vectorized 360 376 18 2.9 342.9 1.4X -Hive built-in ORC 4786 4786 1 0.2 4564.1 0.1X +Native ORC MR 172 232 55 6.1 163.7 1.0X +Native ORC Vectorized 111 154 37 9.4 106.2 1.5X +Hive built-in ORC 3211 3218 10 0.3 3062.5 0.1X diff --git a/sql/hive/benchmarks/OrcReadBenchmark-results.txt b/sql/hive/benchmarks/OrcReadBenchmark-results.txt index c7d6c976192b2..c8f47da641dcf 100644 --- a/sql/hive/benchmarks/OrcReadBenchmark-results.txt +++ b/sql/hive/benchmarks/OrcReadBenchmark-results.txt @@ -2,155 +2,155 @@ SQL Single Numeric Column Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1844 1851 10 8.5 117.2 1.0X -Native ORC Vectorized 284 312 36 55.5 18.0 6.5X -Hive built-in ORC 2380 2380 1 6.6 151.3 0.8X +Native ORC MR 897 922 25 17.5 57.0 1.0X +Native ORC Vectorized 117 128 13 134.6 7.4 7.7X +Hive built-in ORC 1328 1332 6 11.8 84.4 0.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1999 2031 45 7.9 127.1 1.0X -Native ORC Vectorized 252 264 15 62.5 16.0 7.9X -Hive built-in ORC 2483 2509 37 6.3 157.9 0.8X +Native ORC MR 1003 1010 10 15.7 63.8 1.0X +Native ORC Vectorized 148 168 34 106.0 9.4 6.8X +Hive built-in ORC 1348 1364 23 11.7 85.7 0.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 2134 2135 2 7.4 135.7 1.0X -Native ORC Vectorized 329 351 34 47.8 20.9 6.5X -Hive built-in ORC 2672 2716 61 5.9 169.9 0.8X +Native ORC MR 1043 1047 6 15.1 66.3 1.0X +Native ORC Vectorized 168 174 10 93.8 10.7 6.2X +Hive built-in ORC 1398 1440 60 11.3 88.9 0.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 2172 2247 105 7.2 138.1 1.0X -Native ORC Vectorized 407 427 23 38.7 25.9 5.3X -Hive built-in ORC 2806 2822 22 5.6 178.4 0.8X +Native ORC MR 1114 1182 96 14.1 70.8 1.0X +Native ORC Vectorized 249 259 17 63.3 15.8 4.5X +Hive built-in ORC 1533 1682 210 10.3 97.5 0.7X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 2187 2200 19 7.2 139.0 1.0X -Native ORC Vectorized 451 457 5 34.9 28.7 4.8X -Hive built-in ORC 2886 2938 73 5.4 183.5 0.8X +Native ORC MR 1120 1127 10 14.0 71.2 1.0X +Native ORC Vectorized 228 232 4 69.1 14.5 4.9X +Hive built-in ORC 1474 1481 9 10.7 93.7 0.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 2313 2319 9 6.8 147.1 1.0X -Native ORC Vectorized 554 562 7 28.4 35.2 4.2X -Hive built-in ORC 2927 2933 8 5.4 186.1 0.8X +Native ORC MR 1177 1206 42 13.4 74.8 1.0X +Native ORC Vectorized 270 295 47 58.3 17.2 4.4X +Hive built-in ORC 1500 1504 6 10.5 95.4 0.8X ================================================================================================ Int and String Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 4162 4294 186 2.5 397.0 1.0X -Native ORC Vectorized 2236 2258 32 4.7 213.2 1.9X -Hive built-in ORC 5054 5135 114 2.1 482.0 0.8X +Native ORC MR 2174 2184 14 4.8 207.3 1.0X +Native ORC Vectorized 1179 1195 22 8.9 112.4 1.8X +Hive built-in ORC 2639 2669 43 4.0 251.7 0.8X ================================================================================================ Partitioned Table Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Data column - Native ORC MR 2436 2447 16 6.5 154.8 1.0X -Data column - Native ORC Vectorized 421 443 35 37.4 26.8 5.8X -Data column - Hive built-in ORC 3007 3026 27 5.2 191.2 0.8X -Partition column - Native ORC MR 1603 1630 39 9.8 101.9 1.5X -Partition column - Native ORC Vectorized 84 96 15 186.7 5.4 28.9X -Partition column - Hive built-in ORC 2174 2187 18 7.2 138.2 1.1X -Both columns - Native ORC MR 2609 2645 51 6.0 165.9 0.9X -Both columns - Native ORC Vectorized 460 470 9 34.2 29.3 5.3X -Both columns - Hive built-in ORC 3094 3099 8 5.1 196.7 0.8X +Data column - Native ORC MR 1502 1510 11 10.5 95.5 1.0X +Data column - Native ORC Vectorized 256 292 50 61.4 16.3 5.9X +Data column - Hive built-in ORC 1783 1793 15 8.8 113.3 0.8X +Partition column - Native ORC MR 968 979 11 16.2 61.6 1.6X +Partition column - Native ORC Vectorized 46 52 16 340.2 2.9 32.5X +Partition column - Hive built-in ORC 1370 1375 6 11.5 87.1 1.1X +Both columns - Native ORC MR 1516 1525 13 10.4 96.4 1.0X +Both columns - Native ORC Vectorized 288 298 10 54.6 18.3 5.2X +Both columns - Hive built-in ORC 1796 1827 44 8.8 114.2 0.8X ================================================================================================ Repeated String Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 2036 2046 13 5.1 194.2 1.0X -Native ORC Vectorized 366 386 18 28.6 34.9 5.6X -Hive built-in ORC 2683 2686 4 3.9 255.9 0.8X +Native ORC MR 1035 1057 32 10.1 98.7 1.0X +Native ORC Vectorized 197 200 2 53.3 18.8 5.3X +Hive built-in ORC 1435 1453 25 7.3 136.9 0.7X ================================================================================================ String with Nulls Scan ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 3614 3643 40 2.9 344.7 1.0X -Native ORC Vectorized 1072 1087 22 9.8 102.2 3.4X -Hive built-in ORC 4625 4636 15 2.3 441.1 0.8X +Native ORC MR 1905 1927 31 5.5 181.7 1.0X +Native ORC Vectorized 563 645 80 18.6 53.7 3.4X +Hive built-in ORC 2469 2477 11 4.2 235.5 0.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 3347 3376 42 3.1 319.2 1.0X -Native ORC Vectorized 1220 1225 7 8.6 116.3 2.7X -Hive built-in ORC 4168 4184 23 2.5 397.5 0.8X +Native ORC MR 1733 1743 14 6.1 165.3 1.0X +Native ORC Vectorized 636 667 39 16.5 60.6 2.7X +Hive built-in ORC 2201 2267 93 4.8 209.9 0.8X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 1851 1862 16 5.7 176.5 1.0X -Native ORC Vectorized 466 471 7 22.5 44.4 4.0X -Hive built-in ORC 2523 2529 8 4.2 240.6 0.7X +Native ORC MR 966 1052 134 10.9 92.1 1.0X +Native ORC Vectorized 241 247 6 43.4 23.0 4.0X +Hive built-in ORC 1285 1287 3 8.2 122.5 0.8X ================================================================================================ Single Column Scan From Wide Columns ================================================================================================ -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 250 264 15 4.2 238.1 1.0X -Native ORC Vectorized 121 138 24 8.7 115.5 2.1X -Hive built-in ORC 1761 1792 43 0.6 1679.3 0.1X +Native ORC MR 124 134 17 8.5 118.3 1.0X +Native ORC Vectorized 64 71 12 16.5 60.8 1.9X +Hive built-in ORC 1037 1043 9 1.0 988.9 0.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Single Column Scan from 200 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 319 341 17 3.3 304.5 1.0X -Native ORC Vectorized 188 222 50 5.6 178.8 1.7X -Hive built-in ORC 3492 3508 24 0.3 3329.8 0.1X +Native ORC MR 143 154 16 7.3 136.6 1.0X +Native ORC Vectorized 85 92 13 12.4 80.7 1.7X +Hive built-in ORC 1987 1997 15 0.5 1894.5 0.1X -OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws -Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz +OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure +Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz Single Column Scan from 300 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative ------------------------------------------------------------------------------------------------------------------------ -Native ORC MR 443 456 12 2.4 422.9 1.0X -Native ORC Vectorized 306 321 23 3.4 292.0 1.4X -Hive built-in ORC 5295 5312 24 0.2 5049.9 0.1X +Native ORC MR 167 190 23 6.3 159.3 1.0X +Native ORC Vectorized 105 117 14 10.0 99.7 1.6X +Hive built-in ORC 2976 2985 13 0.4 2837.8 0.1X