-
Notifications
You must be signed in to change notification settings - Fork 295
Closed
Labels
Description
π Performance Regression Detected
Benchmark: BenchmarkExtractWorkflowNameFromFile
Current Performance: 82,538 ns/op (82.54Β΅s)
Historical Average: 68,885 ns/op (68.89Β΅s)
Change: +19.8% slower
Data Points: 1 historical entry (2026-03-12)
π Detailed Performance Metrics
Performance Comparison
| Metric | Yesterday | Today | Change |
|---|---|---|---|
| ns/op | 68,885 | 82,538 | +19.8% |
| B/op | N/A | 5,864 | β |
| allocs/op | N/A | 116 | β |
Baseline Targets
- Simple workflows: <100ms (well within range)
- Complex workflows: <500ms (well within range)
- MCP-heavy workflows: <1s (well within range)
ExtractWorkflowNameFromFileis a CLI helper, no explicit target β but regression threshold is 10%
π Context
This benchmark measures how quickly the CLI extracts workflow names from file paths. A regression here could impact workflows that enumerate or reference workflow files by name.
Note: this comparison is based on 1 historical data point β while the threshold has been crossed (+19.8% > 10%), it should be monitored over the next few runs to confirm this is a real regression and not measurement noise.
π‘ Recommended Actions
- Review recent changes to the workflow name extraction logic in
pkg/cli/orpkg/workflow/ - Run
go test -v -run "TestExtractWorkflowName" ./pkg/cli/to verify correctness - Run
go test -bench=BenchmarkExtractWorkflowNameFromFile ./pkg/cli/ -benchtime=10sfor a more stable measurement - Compare with previous benchmark results using
benchstat
π Full Benchmark Run Context (2026-03-13)
| Benchmark | ns/op | Change | Status |
|---|---|---|---|
| CompileSimpleWorkflow | 22,680,852 | +2.0% | β Stable |
| CompileComplexWorkflow | 5,791,573 | +2.4% | β Stable |
| CompileMCPWorkflow | 15,948,627 | +1.9% | β Stable |
| CompileMemoryUsage | 6,481,048 | +4.0% | β Stable |
| ParseWorkflow | 7,665,307 | -14.8% | β¨ Improvement |
| Validation | 6,062,525 | -7.6% | β¨ Improvement |
| YAMLGeneration | 12,245,479 | +1.6% | β Stable |
| ExtractWorkflowNameFromFile | 82,538 | +19.8% | |
| FindIncludesInContent | 32,851 | -16.6% | β¨ Improvement |
References:
Generated by Daily CLI Performance Agent Β· β·
- expires on Mar 15, 2026, 2:43 PM UTC
Reactions are currently unavailable