Skip to content

DataSourcesSnapshotBenchmark to measure iterateAllUsedSegmentsInSnapshot perf#10604

Merged
himanshug merged 1 commit intoapache:masterfrom
himanshug:benchmark
Nov 29, 2020
Merged

DataSourcesSnapshotBenchmark to measure iterateAllUsedSegmentsInSnapshot perf#10604
himanshug merged 1 commit intoapache:masterfrom
himanshug:benchmark

Conversation

@himanshug
Copy link
Copy Markdown
Contributor

wrote to get some numbers for the discussion in #10287

On my laptop (I know its not perfect, but gives an idea for the discussion above)..

Benchmark                                                                   (numDataSources)  (numSegmentPerDataSource)  Mode  Cnt         Score        Error  Units
DataSourcesSnapshotBenchmark.iterateUsing_forloops                                       500                       1000    ss   50   4232403.460 ± 219765.673  ns/op
DataSourcesSnapshotBenchmark.iterateUsing_forloops                                       500                       2000    ss   50   8659380.560 ± 185390.719  ns/op
DataSourcesSnapshotBenchmark.iterateUsing_forloops                                      1000                       1000    ss   50   9013917.980 ± 188947.989  ns/op
DataSourcesSnapshotBenchmark.iterateUsing_forloops                                      1000                       2000    ss   50  17031865.840 ± 211728.709  ns/op
DataSourcesSnapshotBenchmark.iterateUsing_iterateAllUsedSegmentsInSnapshot               500                       1000    ss   50  12191110.300 ± 112767.069  ns/op
DataSourcesSnapshotBenchmark.iterateUsing_iterateAllUsedSegmentsInSnapshot               500                       2000    ss   50  25415400.500 ±  94122.833  ns/op
DataSourcesSnapshotBenchmark.iterateUsing_iterateAllUsedSegmentsInSnapshot              1000                       1000    ss   50  24639497.460 ± 142729.255  ns/op
DataSourcesSnapshotBenchmark.iterateUsing_iterateAllUsedSegmentsInSnapshot              1000                       2000    ss   50  53371752.960 ± 395712.839  ns/op

Copy link
Copy Markdown
Member

@nishantmonu51 nishantmonu51 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@himanshug himanshug merged commit 30bcb0f into apache:master Nov 29, 2020
@jihoonson jihoonson added this to the 0.21.0 milestone Jan 4, 2021
JulianJaffePinterest pushed a commit to JulianJaffePinterest/druid that referenced this pull request Jan 22, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants