-
Notifications
You must be signed in to change notification settings - Fork 5.3k
Closed
Labels
Milestone
Description
Run Information
| Architecture | x64 |
|---|---|
| OS | ubuntu 18.04 |
| Baseline | fc0e636ea3af9b297441a9c9270298937f748300 |
| Compare | d4f078bf983b45554ac917e857fcacb785a53f3a |
| Diff | Diff |
Regressions in Microsoft.Extensions.DependencyInjection.ActivatorUtilitiesBenchmark
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| CreateInstance - Duration of single invocation | 25.69 μs | 27.69 μs | 1.08 | 0.00 | False |
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Microsoft.Extensions.DependencyInjection.ActivatorUtilitiesBenchmark*'Related Issues
Regressions
- [Perf] Windows/x64: 1 Regression on 10/13/2022 10:51:15 PM
- [Perf] Alpine/x64: 1 Regression on 10/13/2022 10:51:15 PM
- [Perf] Windows/x86: 1 Regression on 10/13/2022 10:51:15 PM
Improvements
Details
Payloads
Histogram
Edge Detector Info
Microsoft.Extensions.DependencyInjection.ActivatorUtilitiesBenchmark.CreateInstance
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 27.691086362480934 > 26.986456341054577.
IsChangePoint: Marked as a change because one of 10/13/2022 5:34:08 PM, 10/18/2022 1:35:00 AM falls between 10/7/2022 6:01:23 PM and 10/18/2022 1:35:00 AM.
IsRegressionStdDev: Marked as regression because -29.549336483561028 (T) = (0 -27800.16140104845) / Math.Sqrt((108450.77969472595 / (33)) + (42206.2108730837 / (15))) is less than -2.0128955989180297 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (33) + (15) - 2, .025) and -0.09053346084781927 = (25492.258971527222 - 27800.16140104845) / 25492.258971527222 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository