docs: update incremental benchmarks (3.0.4)#354
Conversation
Greptile SummaryThis is an automated docs-only PR that appends incremental benchmark results for version 3.0.4 to
Confidence Score: 3/5
Flowchart%%{init: {'theme': 'neutral'}}%%
flowchart TD
A[Incremental Build Triggered] --> B{Any files changed?}
B -- No --> C[No-op Rebuild]
B -- Yes, 1 file --> D[1-File Rebuild]
B -- Yes, all cold --> E[Full Build]
C --> F{Engine}
F -- Native 3.0.3 --> G[4ms ✅]
F -- Native 3.0.4 --> H[319ms ⚠️ +7875%]
F -- WASM 3.0.4 --> I[5ms ✅]
D --> J{Engine}
J -- Native 3.0.4 --> K[338ms ↓2%]
J -- WASM 3.0.4 --> L[568ms ↑12%]
E --> M{Engine}
M -- Native 3.0.4 --> N[1.0s ↓41% ✅]
M -- WASM 3.0.4 --> O[2.5s ↑6%]
Last reviewed commit: 8fdb850 |
|
|
||
| | Version | Engine | Files | Full Build | No-op | 1-File | Resolve (native) | Resolve (JS) | | ||
| |---------|--------|------:|-----------:|------:|-------:|------------------:|-------------:| | ||
| | 3.0.4 | native | 177 | 1.0s ↓41% | 319ms ↑7875% | 338ms ↓2% | 4ms ↑6% | 4ms ~ | |
There was a problem hiding this comment.
Extreme no-op rebuild regression in native engine
The native no-op rebuild time jumped from 4ms → 319ms (+7875%) in 3.0.4. A no-op rebuild (nothing changed) should be one of the fastest operations — just re-checking hashes — so a ~80× slowdown is a strong signal of a real performance bug in the native engine for 3.0.4.
The WASM engine's no-op remains healthy at 5ms (unchanged), which rules out a test/environment artifact and points squarely at a regression in the native Rust path. This may indicate that hash-based change detection in the native engine is no longer short-circuiting correctly, or that some initialization cost is now always paid regardless of whether any files changed.
This benchmark is auto-generated and simply records the measured result, but the anomaly it captures warrants investigation before 3.0.4 is widely adopted.
Rule Used: CLAUDE.md (source)
Automated incremental benchmark update for 3.0.4 from workflow run #221.