Skip to content

Add benchmark for VersionedIntervalTimeline#8161

Merged
fjy merged 2 commits intoapache:masterfrom
jihoonson:timeline-benchmark
Jul 30, 2019
Merged

Add benchmark for VersionedIntervalTimeline#8161
fjy merged 2 commits intoapache:masterfrom
jihoonson:timeline-benchmark

Conversation

@jihoonson
Copy link
Copy Markdown
Contributor

Benchmark for VersionedIntervalTimeline introduced in #7547 (comment).

Description

The primary purpose of this benchmark is to measure how much slower VersionedIntervalTimeline is with segment lock than with timeChunk lock.

Data setup

A synthetic segments were created to emulate the usual compaction scenario where initial segments are created and then they got compacted while new segments are appended. The benchmark first generates numInitialRootGenSegmentsPerInterval segments per interval. Then, it generates numInitialRootGenSegmentsPerInterval * COMPACTED_SEGMENTS_RATIO_TO_INITIAL_SEGMENTS compacted segments which overwrites the segments of the previous generation. It also generates new appending segments. This can be repeated more than once based on numNonRootGenerations.


This PR has:

  • been self-reviewed.

@fjy fjy merged commit fb653ce into apache:master Jul 30, 2019
@clintropolis clintropolis added this to the 0.16.0 milestone Aug 8, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants