chore: Add CI job for BTreeSet benchmarks by dragoljub-djuric · Pull Request #341 · dfinity/stable-structures

dragoljub-djuric · 2025-06-10T14:06:02Z

This PR adds a missing CI job for BTreeSet benchmarks.

github-actions · 2025-06-10T14:16:22Z

`canbench` 🏋 (dir: ./benchmarks/vec) `a5b68b2` 2025-06-10 15:29:36 UTC

✅ ./benchmarks/vec/canbench_results.yml is up to date
📦 canbench_results_vec.csv available in artifacts

---------------------------------------------------

Summary:
  instructions:
    status:   No significant changes detected 👍
    counts:   [total 16 | regressed 0 | improved 0 | new 0 | unchanged 16]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  heap_increase:
    status:   No significant changes detected 👍
    counts:   [total 16 | regressed 0 | improved 0 | new 0 | unchanged 16]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  stable_memory_increase:
    status:   No significant changes detected 👍
    counts:   [total 16 | regressed 0 | improved 0 | new 0 | unchanged 16]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------
CSV results saved to canbench_results.csv

github-actions · 2025-06-10T14:16:23Z

`canbench` 🏋 (dir: ./benchmarks/btreeset) `a5b68b2` 2025-06-10 15:30:00 UTC

✅ ./benchmarks/btreeset/canbench_results.yml is up to date
📦 canbench_results_btreeset.csv available in artifacts

---------------------------------------------------

Summary:
  instructions:
    status:   Regressions detected! 🔴
    counts:   [total 100 | regressed 6 | improved 0 | new 0 | unchanged 94]
    change:   [max +7.59M | p75 +526.49K | median +81 | p25 +80 | min -90]
    change %: [max +4.49% | p75 +0.26% | median +0.02% | p25 0.00% | min -0.00%]

  heap_increase:
    status:   No significant changes detected 👍
    counts:   [total 100 | regressed 0 | improved 0 | new 0 | unchanged 100]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  stable_memory_increase:
    status:   No significant changes detected 👍
    counts:   [total 100 | regressed 0 | improved 0 | new 0 | unchanged 100]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------

Only significant changes:
| status | name                    | calls |    ins |  ins Δ% | HI |  HI Δ% | SMI |  SMI Δ% |
|--------|-------------------------|-------|--------|---------|----|--------|-----|---------|
|   +    | btreeset_range_u64      |       |  8.58M |  +4.49% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreeset_range_u32      |       |  8.53M |  +4.39% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreeset_range_blob_8   |       | 11.16M |  +3.41% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreeset_range_blob_16  |       | 11.55M |  +3.17% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreeset_range_blob_256 |       | 80.33M |  +3.04% |  0 |  0.00% |   0 |   0.00% |
|   +    | btreeset_range_blob_32  |       | 15.40M |  +2.32% |  0 |  0.00% |   0 |   0.00% |

ins = instructions, HI = heap_increase, SMI = stable_memory_increase, Δ% = percent change

---------------------------------------------------
CSV results saved to canbench_results.csv

github-actions · 2025-06-10T14:16:26Z

`canbench` 🏋 (dir: ./benchmarks/memory_manager) `a5b68b2` 2025-06-10 15:29:30 UTC

✅ ./benchmarks/memory_manager/canbench_results.yml is up to date
📦 canbench_results_memory-manager.csv available in artifacts

---------------------------------------------------

Summary:
  instructions:
    status:   No significant changes detected 👍
    counts:   [total 3 | regressed 0 | improved 0 | new 0 | unchanged 3]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  heap_increase:
    status:   No significant changes detected 👍
    counts:   [total 3 | regressed 0 | improved 0 | new 0 | unchanged 3]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  stable_memory_increase:
    status:   No significant changes detected 👍
    counts:   [total 3 | regressed 0 | improved 0 | new 0 | unchanged 3]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------
CSV results saved to canbench_results.csv

dsarlis

The results file seem to not be committed/up-to-date?

github-actions · 2025-06-10T15:33:51Z

`canbench` 🏋 (dir: ./benchmarks/btreemap) `a5b68b2` 2025-06-10 15:31:29 UTC

✅ ./benchmarks/btreemap/canbench_results.yml is up to date
📦 canbench_results_btreemap.csv available in artifacts

---------------------------------------------------

Summary:
  instructions:
    status:   No significant changes detected 👍
    counts:   [total 285 | regressed 0 | improved 0 | new 0 | unchanged 285]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  heap_increase:
    status:   No significant changes detected 👍
    counts:   [total 285 | regressed 0 | improved 0 | new 0 | unchanged 285]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  stable_memory_increase:
    status:   No significant changes detected 👍
    counts:   [total 285 | regressed 0 | improved 0 | new 0 | unchanged 285]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------
CSV results saved to canbench_results.csv

github-actions · 2025-06-10T15:33:52Z

`canbench` 🏋 (dir: ./benchmarks/compare) `a5b68b2` 2025-06-10 15:30:32 UTC

✅ ./benchmarks/compare/canbench_results.yml is up to date
📦 canbench_results_compare.csv available in artifacts

---------------------------------------------------

Summary:
  instructions:
    status:   No significant changes detected 👍
    counts:   [total 18 | regressed 0 | improved 0 | new 0 | unchanged 18]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  heap_increase:
    status:   No significant changes detected 👍
    counts:   [total 18 | regressed 0 | improved 0 | new 0 | unchanged 18]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

  stable_memory_increase:
    status:   No significant changes detected 👍
    counts:   [total 18 | regressed 0 | improved 0 | new 0 | unchanged 18]
    change:   [max 0 | p75 0 | median 0 | p25 0 | min 0]
    change %: [max 0.00% | p75 0.00% | median 0.00% | p25 0.00% | min 0.00%]

---------------------------------------------------
CSV results saved to canbench_results.csv

dragoljub-djuric added 6 commits May 2, 2025 09:30

.

8ffe6a0

.

0efd64f

Merge branch 'main' of github.com:dfinity/stable-structures

0f820c4

Merge branch 'main' of github.com:dfinity/stable-structures

822f9d5

Merge branch 'main' of github.com:dfinity/stable-structures

b9ed8e5

Add CI job for BTreeSet.

2b9b08b

dragoljub-djuric requested a review from a team as a code owner June 10, 2025 14:06

add btreeset to matrix

f9b657b

dsarlis approved these changes Jun 10, 2025

View reviewed changes

dragoljub-djuric requested a review from dsarlis June 10, 2025 14:59

Upgrade canbench to fix tests.

9e9e615

dragoljub-djuric merged commit f4d2ebd into main Jun 10, 2025
15 checks passed

dragoljub-djuric deleted the add_ci_job_for_btreeset_benchmarks branch June 10, 2025 15:33

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

chore: Add CI job for BTreeSet benchmarks#341

chore: Add CI job for BTreeSet benchmarks#341
dragoljub-djuric merged 8 commits intomainfrom
add_ci_job_for_btreeset_benchmarks

dragoljub-djuric commented Jun 10, 2025

Uh oh!

github-actions Bot commented Jun 10, 2025 •

edited

Loading

Uh oh!

github-actions Bot commented Jun 10, 2025 •

edited

Loading

Uh oh!

github-actions Bot commented Jun 10, 2025 •

edited

Loading

Uh oh!

dsarlis left a comment •

edited

Loading

Uh oh!

Uh oh!

github-actions Bot commented Jun 10, 2025

Uh oh!

github-actions Bot commented Jun 10, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

dragoljub-djuric commented Jun 10, 2025

Uh oh!

github-actions Bot commented Jun 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

canbench 🏋 (dir: ./benchmarks/vec) a5b68b2 2025-06-10 15:29:36 UTC

Uh oh!

github-actions Bot commented Jun 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

canbench 🏋 (dir: ./benchmarks/btreeset) a5b68b2 2025-06-10 15:30:00 UTC

Uh oh!

github-actions Bot commented Jun 10, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

canbench 🏋 (dir: ./benchmarks/memory_manager) a5b68b2 2025-06-10 15:29:30 UTC

Uh oh!

dsarlis left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

github-actions Bot commented Jun 10, 2025

canbench 🏋 (dir: ./benchmarks/btreemap) a5b68b2 2025-06-10 15:31:29 UTC

Uh oh!

github-actions Bot commented Jun 10, 2025

canbench 🏋 (dir: ./benchmarks/compare) a5b68b2 2025-06-10 15:30:32 UTC

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

github-actions Bot commented Jun 10, 2025 •

edited

Loading

`canbench` 🏋 (dir: ./benchmarks/vec) `a5b68b2` 2025-06-10 15:29:36 UTC

github-actions Bot commented Jun 10, 2025 •

edited

Loading

`canbench` 🏋 (dir: ./benchmarks/btreeset) `a5b68b2` 2025-06-10 15:30:00 UTC

github-actions Bot commented Jun 10, 2025 •

edited

Loading

`canbench` 🏋 (dir: ./benchmarks/memory_manager) `a5b68b2` 2025-06-10 15:29:30 UTC

dsarlis left a comment •

edited

Loading

`canbench` 🏋 (dir: ./benchmarks/btreemap) `a5b68b2` 2025-06-10 15:31:29 UTC

`canbench` 🏋 (dir: ./benchmarks/compare) `a5b68b2` 2025-06-10 15:30:32 UTC