Skip to content

Add TurboMalloc::thread_park() to flush and collect on thread park#92804

Merged
sokra merged 6 commits into
canaryfrom
sokra/mi-collect
Apr 15, 2026
Merged

Add TurboMalloc::thread_park() to flush and collect on thread park#92804
sokra merged 6 commits into
canaryfrom
sokra/mi-collect

Conversation

@sokra
Copy link
Copy Markdown
Member

@sokra sokra commented Apr 14, 2026

What?

Adds TurboMalloc::thread_park() — a new method on TurboMalloc that calls libmimalloc_sys::mi_collect(false) to process mimalloc's lazy free lists when a Tokio worker thread parks.

Registers it as an on_thread_park callback in every Tokio runtime that already registers on_thread_stop:

  • turbopack-cli/src/main.rs
  • turbopack-cli/benches/small_apps.rs
  • next-napi-bindings/src/lib.rs
  • next-build-test/src/main.rs
  • turbo-tasks-backend/fuzz/src/graph.rs

Why?

mimalloc uses deferred freeing: memory freed by one thread is not reclaimed immediately but is queued until that thread performs N more allocations. Tokio worker threads that are parked (waiting for work) don't allocate, so deferred frees accumulate indefinitely — memory is never returned to the OS until the thread wakes up and does real work.

Calling mi_collect(false) on park processes the lazy free lists, allowing mimalloc to reclaim that memory, while avoiding the syscalls and globally synchronized operations that mi_collect(true) would trigger.

How?

  • thread_park() only calls mi_collect(false) — it intentionally does not call flush(). flush() transfers the thread-local allocation counter to the global atomic and resets it to zero, which would violate the trace server's assumption that per-thread counters are monotonically increasing. Counter sync remains exclusively in thread_stop().
  • thread_park() is feature-gated behind cfg(all(feature = "custom_allocator", not(target_family = "wasm"))) and is a no-op otherwise.
  • libmimalloc-sys is added as a direct optional dependency under [target.'cfg(not(target_family = "wasm"))'.dependencies] (it was already a transitive dep via mimalloc) to access mi_collect directly, since mimalloc's use ffi::* is not a public re-export.
  • In each on_thread_park callback, TurboMalloc::thread_park() is called after the existing SWC atom store GC, so atoms freed by that GC pass are also eligible for reclamation in the same collection.

…ct on thread park

mimalloc defers freeing memory until N more allocations happen. Parked tokio
worker threads don't allocate, so deferred frees accumulate. Calling
mi_collect(true) on park forces mimalloc to process deferred frees and return
memory to the OS.

Co-Authored-By: Claude <noreply@anthropic.com>
@nextjs-bot nextjs-bot added created-by: Turbopack team PRs by the Turbopack team. Turbopack Related to Turbopack with Next.js. labels Apr 14, 2026
sokra and others added 2 commits April 14, 2026 23:08
Co-Authored-By: Claude <noreply@anthropic.com>
Co-Authored-By: Claude <noreply@anthropic.com>
@sokra sokra marked this pull request as ready for review April 14, 2026 23:10
@sokra sokra requested a review from lukesandberg April 14, 2026 23:10
Comment thread crates/next-build-test/src/main.rs Outdated
Comment thread turbopack/crates/turbo-tasks-malloc/src/lib.rs Outdated
@nextjs-bot
Copy link
Copy Markdown
Contributor

nextjs-bot commented Apr 14, 2026

Tests Passed

sokra and others added 2 commits April 14, 2026 23:20
Per review feedback: collect deferred mimalloc frees after the SWC atom
store purge so that the atoms freed by GC are also reclaimed in the same
collection pass.

Co-Authored-By: Claude <noreply@anthropic.com>
Per review: mi_collect(false) processes deferred frees without triggering
syscalls or globally synchronized operations, which is sufficient for
reclaiming memory freed by parked threads and less expensive than force=true.

Co-Authored-By: Claude <noreply@anthropic.com>
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Apr 14, 2026

Merging this PR will not alter performance

✅ 17 untouched benchmarks
⏩ 3 skipped benchmarks1


Comparing sokra/mi-collect (0a97949) with canary (0270dfb)

Open in CodSpeed

Footnotes

  1. 3 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

Comment thread turbopack/crates/turbo-tasks-malloc/src/lib.rs Outdated
…iant

The trace server assumes thread allocation counters only go up. flush()
resets the thread-local buffer to zero (transferring the value to the
global atomic), which violates that assumption. thread_park() only needs
mi_collect() to process deferred frees.

Co-Authored-By: Claude <noreply@anthropic.com>
@nextjs-bot
Copy link
Copy Markdown
Contributor

nextjs-bot commented Apr 14, 2026

Stats from current PR

✅ No significant changes detected

📊 All Metrics
📖 Metrics Glossary

Dev Server Metrics:

  • Listen = TCP port starts accepting connections
  • First Request = HTTP server returns successful response
  • Cold = Fresh build (no cache)
  • Warm = With cached build artifacts

Build Metrics:

  • Fresh = Clean build (no .next directory)
  • Cached = With existing .next directory

Change Thresholds:

  • Time: Changes < 50ms AND < 10%, OR < 2% are insignificant
  • Size: Changes < 1KB AND < 1% are insignificant
  • All other changes are flagged to catch regressions

⚡ Dev Server

Metric Canary PR Change Trend
Cold (Listen) 455ms 455ms ▁█▁▁▁
Cold (Ready in log) 439ms 440ms ▂▁▆▂▄
Cold (First Request) 823ms 821ms ██▁█▁
Warm (Listen) 456ms 456ms ▅▅▅▅▁
Warm (Ready in log) 438ms 439ms ▆▅▃▆▁
Warm (First Request) 335ms 335ms ▆▅▅▅▃
📦 Dev Server (Webpack) (Legacy)

📦 Dev Server (Webpack)

Metric Canary PR Change Trend
Cold (Listen) 456ms 457ms ▅▅▅▅▅
Cold (Ready in log) 442ms 442ms ▂▁▂▂▂
Cold (First Request) 1.947s 1.966s ▁▃▄▄▄
Warm (Listen) 456ms 455ms ▅▁█▅▅
Warm (Ready in log) 441ms 442ms ▂▁▂▂▂
Warm (First Request) 1.961s 1.956s ▂▃▃▃▂

⚡ Production Builds

Metric Canary PR Change Trend
Fresh Build 3.945s 3.960s ▁▁▄▁▆
Cached Build 3.981s 3.991s ▁▄▇▁▆
📦 Production Builds (Webpack) (Legacy)

📦 Production Builds (Webpack)

Metric Canary PR Change Trend
Fresh Build 14.601s 14.667s ▂▁▂▂▂
Cached Build 14.738s 14.789s ▂▁▂▂▁
node_modules Size 493 MB 493 MB ▁▇▇▁▁
📦 Bundle Sizes

Bundle Sizes

⚡ Turbopack

Client

Main Bundles
Canary PR Change
01u_z805w4t3r.js gzip 70.8 kB N/A -
03kp96w5wc2qv.js gzip 156 B N/A -
053b9v5j96uu_.js gzip 8.56 kB N/A -
05cxl-rj0djfo.js gzip 159 B N/A -
07rxhp_1_g4mu.js gzip 13.1 kB N/A -
096aa2uod0_wa.js gzip 9.82 kB N/A -
0cz1d0mv5g_q7.js gzip 39.4 kB 39.4 kB
0ea8vo2o6kp_s.js gzip 13.3 kB N/A -
0egovw6-5i1e3.js gzip 8.57 kB N/A -
0f0q1kkuwoc7j.js gzip 156 B N/A -
0fli3_wppnim5.js gzip 12.9 kB N/A -
0ifonet17u21y.js gzip 153 B N/A -
0k09jwjeb-tki.js gzip 13.8 kB N/A -
0kb7_ep3r1z0_.js gzip 10.1 kB N/A -
0kmgih16pb2zy.js gzip 9.24 kB N/A -
0pgjij8f941gy.js gzip 155 B N/A -
0recylvui9x4k.js gzip 156 B N/A -
0tl_3le18ky_5.js gzip 161 B N/A -
0wxpyd8r-vipl.js gzip 1.47 kB N/A -
1-z_xm7pzpbeh.js gzip 49.2 kB N/A -
16lhqjoqbznyg.js gzip 220 B 220 B
16vepdkipri3r.js gzip 8.51 kB N/A -
17n96uu6y1pxq.js gzip 8.6 kB N/A -
1elt1qium-r2m.css gzip 115 B 115 B
1xz7fhgdco-x_.js gzip 8.59 kB N/A -
1y29hfrjns2se.js gzip 65.5 kB N/A -
2__-e_ym8n788.js gzip 450 B N/A -
22o6xd9_ywdu6.js gzip 233 B N/A -
2a6tmoj5ytupe.js gzip 156 B N/A -
2jkp9alxky_et.js gzip 157 B N/A -
2k1q_gre6hp0-.js gzip 8.56 kB N/A -
2kvj8yrfznmwx.js gzip 5.69 kB N/A -
2r1e16b0pmsgq.js gzip 157 B N/A -
2sgqisp4604si.js gzip 8.51 kB N/A -
342ijzvrpe53h.js gzip 2.29 kB N/A -
35jczruy0r4rv.js gzip 158 B N/A -
3n5uj92h17r97.js gzip 168 B N/A -
3v9s-fz24f8oo.js gzip 10.4 kB N/A -
420pn_b9x-3ir.js gzip 8.62 kB N/A -
43sfaasxd0ei5.js gzip 155 B N/A -
44un3--wmqiyh.js gzip 7.61 kB N/A -
turbopack-03..9v_5.js gzip 4.19 kB N/A -
turbopack-0e..wib5.js gzip 4.19 kB N/A -
turbopack-0f..7rkx.js gzip 4.19 kB N/A -
turbopack-0f..wdwo.js gzip 4.19 kB N/A -
turbopack-0x..0oc9.js gzip 4.19 kB N/A -
turbopack-1k..5m60.js gzip 4.19 kB N/A -
turbopack-1v..s_r3.js gzip 4.17 kB N/A -
turbopack-2i..10vn.js gzip 4.19 kB N/A -
turbopack-2j..fz33.js gzip 4.19 kB N/A -
turbopack-2v..plnz.js gzip 4.19 kB N/A -
turbopack-2w..5fz2.js gzip 4.19 kB N/A -
turbopack-2w..-xul.js gzip 4.2 kB N/A -
turbopack-3h..r_ve.js gzip 4.19 kB N/A -
turbopack-3i..94e3.js gzip 4.19 kB N/A -
03_szppy5nakp.js gzip N/A 49.2 kB -
03gqff_wwonz2.js gzip N/A 155 B -
04mkd7mos-80z.js gzip N/A 155 B -
08p0nrdp2y2mr.js gzip N/A 161 B -
0arkbdqpxc37i.js gzip N/A 8.6 kB -
0pg75k3v8e2qm.js gzip N/A 151 B -
0tvekitj587fh.js gzip N/A 8.51 kB -
0z83a1om5rvtt.js gzip N/A 7.61 kB -
1-5i7v4nrnxdr.js gzip N/A 156 B -
1-jqyfc89tixo.js gzip N/A 1.46 kB -
14l6h7vyf9_0p.js gzip N/A 165 B -
14t1kneseb8th.js gzip N/A 2.3 kB -
17p4_rb13-leg.js gzip N/A 70.8 kB -
192q2suy7rwb_.js gzip N/A 8.56 kB -
1ab2xruymo-oj.js gzip N/A 449 B -
1s2k4idk19pll.js gzip N/A 156 B -
1wzrm0xjjbzn5.js gzip N/A 10.1 kB -
23uajhvjot6ng.js gzip N/A 155 B -
24bditgwguy6m.js gzip N/A 153 B -
24hj7zo78v7vv.js gzip N/A 159 B -
25a1yz7zua29z.js gzip N/A 13.8 kB -
2f2bp_kexa37v.js gzip N/A 13.3 kB -
2i5v1taq97gql.js gzip N/A 8.59 kB -
2jp6lnda-pd8a.js gzip N/A 153 B -
2n3vh0w0tnb_2.js gzip N/A 8.52 kB -
2u_rpxq3tzytl.js gzip N/A 233 B -
2wfbykz1avdns.js gzip N/A 8.56 kB -
31pbv3es8ogc6.js gzip N/A 65.5 kB -
32sifemopndov.js gzip N/A 10.4 kB -
368lim5wq0o0r.js gzip N/A 12.9 kB -
38ix7tny7vneh.js gzip N/A 155 B -
3de283pazbu99.js gzip N/A 9.81 kB -
3drqjohogojbw.js gzip N/A 5.69 kB -
3g8l1m2-o-ewi.js gzip N/A 13.1 kB -
3gp2o_v7jcw6s.js gzip N/A 8.57 kB -
3oan8e-b_towu.js gzip N/A 156 B -
3qu7g1q2l_x2n.js gzip N/A 9.24 kB -
43j6fjudq0a3_.js gzip N/A 8.62 kB -
turbopack-04..gggw.js gzip N/A 4.17 kB -
turbopack-05..tn7u.js gzip N/A 4.19 kB -
turbopack-0u..4oe8.js gzip N/A 4.19 kB -
turbopack-13..h7bl.js gzip N/A 4.2 kB -
turbopack-1f..1ml8.js gzip N/A 4.19 kB -
turbopack-1f..fs9k.js gzip N/A 4.19 kB -
turbopack-1z..4ye2.js gzip N/A 4.19 kB -
turbopack-2d..z6ix.js gzip N/A 4.19 kB -
turbopack-2u..e13b.js gzip N/A 4.19 kB -
turbopack-2x..adij.js gzip N/A 4.19 kB -
turbopack-34..k2w_.js gzip N/A 4.19 kB -
turbopack-39..imyo.js gzip N/A 4.19 kB -
turbopack-3c..71_3.js gzip N/A 4.19 kB -
turbopack-40..41x0.js gzip N/A 4.19 kB -
Total 465 kB 465 kB ⚠️ +12 B

Server

Middleware
Canary PR Change
middleware-b..fest.js gzip 716 B 720 B
Total 716 B 720 B ⚠️ +4 B
Build Details
Build Manifests
Canary PR Change
_buildManifest.js gzip 432 B 433 B
Total 432 B 433 B ⚠️ +1 B

📦 Webpack

Client

Main Bundles
Canary PR Change
2637-HASH.js gzip 4.63 kB N/A -
7724.HASH.js gzip 169 B N/A -
8274-HASH.js gzip 61.3 kB N/A -
8817-HASH.js gzip 5.59 kB N/A -
c3500254-HASH.js gzip 62.8 kB N/A -
framework-HASH.js gzip 59.7 kB 59.7 kB
main-app-HASH.js gzip 254 B 255 B
main-HASH.js gzip 39.4 kB 39.4 kB
webpack-HASH.js gzip 1.68 kB 1.68 kB
5887-HASH.js gzip N/A 5.61 kB -
6522-HASH.js gzip N/A 60.7 kB -
6779-HASH.js gzip N/A 4.63 kB -
8854.HASH.js gzip N/A 169 B -
eab920f9-HASH.js gzip N/A 62.8 kB -
Total 235 kB 235 kB ✅ -619 B
Polyfills
Canary PR Change
polyfills-HASH.js gzip 39.4 kB 39.4 kB
Total 39.4 kB 39.4 kB
Pages
Canary PR Change
_app-HASH.js gzip 193 B 193 B
_error-HASH.js gzip 182 B 182 B
css-HASH.js gzip 333 B 334 B
dynamic-HASH.js gzip 1.81 kB 1.8 kB
edge-ssr-HASH.js gzip 255 B 255 B
head-HASH.js gzip 353 B 349 B 🟢 4 B (-1%)
hooks-HASH.js gzip 384 B 382 B
image-HASH.js gzip 581 B 581 B
index-HASH.js gzip 260 B 259 B
link-HASH.js gzip 2.51 kB 2.51 kB
routerDirect..HASH.js gzip 316 B 318 B
script-HASH.js gzip 386 B 386 B
withRouter-HASH.js gzip 313 B 314 B
1afbb74e6ecf..834.css gzip 106 B 106 B
Total 7.98 kB 7.97 kB ✅ -10 B

Server

Edge SSR
Canary PR Change
edge-ssr.js gzip 126 kB 126 kB
page.js gzip 273 kB 273 kB
Total 398 kB 398 kB ✅ -325 B
Middleware
Canary PR Change
middleware-b..fest.js gzip 617 B 617 B
middleware-r..fest.js gzip 156 B 156 B
middleware.js gzip 44.1 kB 44.3 kB
edge-runtime..pack.js gzip 842 B 842 B
Total 45.7 kB 45.9 kB ⚠️ +169 B
Build Details
Build Manifests
Canary PR Change
_buildManifest.js gzip 721 B 720 B
Total 721 B 720 B ✅ -1 B
Build Cache
Canary PR Change
0.pack gzip 4.38 MB 4.38 MB
index.pack gzip 112 kB 113 kB
index.pack.old gzip 114 kB 114 kB
Total 4.6 MB 4.6 MB ⚠️ +2.08 kB

🔄 Shared (bundler-independent)

Runtimes
Canary PR Change
app-page-exp...dev.js gzip 346 kB 346 kB
app-page-exp..prod.js gzip 192 kB 192 kB
app-page-tur...dev.js gzip 346 kB 346 kB
app-page-tur..prod.js gzip 192 kB 192 kB
app-page-tur...dev.js gzip 342 kB 342 kB
app-page-tur..prod.js gzip 190 kB 190 kB
app-page.run...dev.js gzip 343 kB 343 kB
app-page.run..prod.js gzip 190 kB 190 kB
app-route-ex...dev.js gzip 77 kB 77 kB
app-route-ex..prod.js gzip 52.5 kB 52.5 kB
app-route-tu...dev.js gzip 77.1 kB 77.1 kB
app-route-tu..prod.js gzip 52.6 kB 52.6 kB
app-route-tu...dev.js gzip 76.7 kB 76.7 kB
app-route-tu..prod.js gzip 52.3 kB 52.3 kB
app-route.ru...dev.js gzip 76.6 kB 76.6 kB
app-route.ru..prod.js gzip 52.3 kB 52.3 kB
dist_client_...dev.js gzip 324 B 324 B
dist_client_...dev.js gzip 326 B 326 B
dist_client_...dev.js gzip 318 B 318 B
dist_client_...dev.js gzip 317 B 317 B
pages-api-tu...dev.js gzip 43.9 kB 43.9 kB
pages-api-tu..prod.js gzip 33.5 kB 33.5 kB
pages-api.ru...dev.js gzip 43.9 kB 43.9 kB
pages-api.ru..prod.js gzip 33.5 kB 33.5 kB
pages-turbo....dev.js gzip 53.3 kB 53.3 kB
pages-turbo...prod.js gzip 39.1 kB 39.1 kB
pages.runtim...dev.js gzip 53.3 kB 53.3 kB
pages.runtim..prod.js gzip 39.1 kB 39.1 kB
server.runti..prod.js gzip 62.9 kB 62.9 kB
Total 3.06 MB 3.06 MB
📎 Tarball URL
https://vercel-packages.vercel.app/next/commits/0a97949673be1d54cf593acf80e46297d6b13349/next

@sokra sokra merged commit b9cd448 into canary Apr 15, 2026
188 checks passed
@sokra sokra deleted the sokra/mi-collect branch April 15, 2026 01:43
@github-actions github-actions Bot locked as resolved and limited conversation to collaborators Apr 29, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

created-by: Turbopack team PRs by the Turbopack team. locked Turbopack Related to Turbopack with Next.js.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants