Regressions in System.Collections.Tests.Perf_BitArray

### Run Information

Architecture | x64
-- | --
OS | Windows 10.0.18362
Baseline | [15dda0efe52c2aaa7a4e783f443eefb558529248](https://github.com/dotnet/runtime/commit/15dda0efe52c2aaa7a4e783f443eefb558529248)
Compare | [fa3a089b0f8a8855e68402742620fd42c090970f](https://github.com/dotnet/runtime/commit/fa3a089b0f8a8855e68402742620fd42c090970f)
Diff | [Diff](https://github.com/dotnet/runtime/compare/15dda0efe52c2aaa7a4e783f443eefb558529248...fa3a089b0f8a8855e68402742620fd42c090970f)


### Regressions in System.Collections.Tests.Perf_BitArray

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[BitArrayCopyToByteArray - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Collections.Tests.Perf_BitArray.BitArrayCopyToByteArray(Size%3a%20512).html>) | 125.44 ns | 134.91 ns | 1.08 | 0.01 | False | | |

![graph](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/05_24_2022/refs/heads/main_x64_Windows%2010.0.18362_Regression/System.Collections.Tests.Perf_BitArray_1.png>)
[Test Report](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/05_24_2022/refs/heads/main_x64_Windows%2010.0.18362_Regression/System.Collections.Tests.Perf_BitArray.html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Tests.Perf_BitArray*'
```
<details>

### Payloads

[Baseline](<https://helixdi8s23ayyeko0k025g8.blob.core.windows.net/helix-job-3b67568f-5f56-4f3a-b916-a84dfda843805cd712eb5c441d6a6/eb142f80-e990-4c87-9af1-4b4f5e06c5a1.zip?sv=2019-07-07&se=2022-06-18T21%3A22%3A09Z&sr=c&sp=rl&sig=tei%2FVycSDR%2FxK40mjTGd5s13dxrdiFMvMc5Eq0Zz7bQ%3D>)
[Compare](<https://helixdi8s23ayyeko0k025g8.blob.core.windows.net/helix-job-a81afe03-5655-4c34-bfba-71c793e2e6a64a70239e8594b98ad/93c25513-4fac-469f-a81f-c4a2585904da.zip?sv=2019-07-07&se=2022-06-19T06%3A53%3A45Z&sr=c&sp=rl&sig=uJ%2FbZIyLt092Qme169oK4PUUxfrzbC9ZtdN6v2DAmGA%3D>)
### Histogram

#### System.Collections.Tests.Perf_BitArray.BitArrayCopyToByteArray(Size: 512)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 134.90516937191248 > 133.94957360975633.
IsChangePoint: Marked as a change because one of 3/15/2022 12:53:39 AM, 3/17/2022 6:54:53 PM, 5/19/2022 10:26:24 PM, 5/24/2022 7:58:36 AM falls between 5/15/2022 6:57:22 PM and 5/24/2022 7:58:36 AM.
IsRegressionStdDev: Marked as regression because -41.81356446042658 (T) = (0 -135.57240919349277) / Math.Sqrt((0.7404654611893858 / (35)) + (0.7499799654451327 / (22))) is less than -2.0040447832881556 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (35) + (22) - 2, .025) and -0.07815914018494677 = (125.74433971800931 - 135.57240919349277) / 125.74433971800931 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>
### Run Information

Architecture | x64
-- | --
OS | Windows 10.0.18362
Baseline | [f6c5698cb612f3b6e56eb41d808ae7fa73c63897](https://github.com/dotnet/runtime/commit/f6c5698cb612f3b6e56eb41d808ae7fa73c63897)
Compare | [fa3a089b0f8a8855e68402742620fd42c090970f](https://github.com/dotnet/runtime/commit/fa3a089b0f8a8855e68402742620fd42c090970f)
Diff | [Diff](https://github.com/dotnet/runtime/compare/f6c5698cb612f3b6e56eb41d808ae7fa73c63897...fa3a089b0f8a8855e68402742620fd42c090970f)


### Regressions in System.Collections.TryGetValueTrue&lt;String, String&gt;

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[ImmutableDictionary - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_Windows 10.0.18362/System.Collections.TryGetValueTrue(String%2c%20String).ImmutableDictionary(Size%3a%20512).html>) | 42.10 μs | 45.50 μs | 1.08 | 0.01 | False | | |

![graph](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/05_24_2022/refs/heads/main_x64_Windows%2010.0.18362_Regression/System.Collections.TryGetValueTrue(String,%20String)_1.png>)
[Test Report](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/05_24_2022/refs/heads/main_x64_Windows%2010.0.18362_Regression/System.Collections.TryGetValueTrue(String,%20String).html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.TryGetValueTrue&lt;String, String&gt;*'
```
<details>

### Payloads

[Baseline](<https://helixdi8s23ayyeko0k025g8.blob.core.windows.net/helix-job-83b0eb83-e3d3-4ea1-be94-f50bdd7a4729b4bd2b1a01549fab4/e17f767b-26cb-44c5-81de-761593c411eb.zip?sv=2019-07-07&se=2022-06-18T18%3A11%3A14Z&sr=c&sp=rl&sig=a6SHrYkdmASPLjlafCIrRkP114DhrdZh%2FTjottKypWg%3D>)
[Compare](<https://helixdi8s23ayyeko0k025g8.blob.core.windows.net/helix-job-a81afe03-5655-4c34-bfba-71c793e2e6a64a70239e8594b98ad/93c25513-4fac-469f-a81f-c4a2585904da.zip?sv=2019-07-07&se=2022-06-19T06%3A53%3A45Z&sr=c&sp=rl&sig=uJ%2FbZIyLt092Qme169oK4PUUxfrzbC9ZtdN6v2DAmGA%3D>)
### Histogram

#### System.Collections.TryGetValueTrue&lt;String, String&gt;.ImmutableDictionary(Size: 512)

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.498561046511625 > 44.84044966884208.
IsChangePoint: Marked as a change because one of 3/21/2022 1:28:14 PM, 3/30/2022 6:37:35 PM, 4/20/2022 2:49:46 PM, 5/19/2022 10:26:24 PM, 5/24/2022 7:58:36 AM falls between 5/15/2022 6:57:22 PM and 5/24/2022 7:58:36 AM.
IsRegressionStdDev: Marked as regression because -14.947790790244614 (T) = (0 -44910.33110137865) / Math.Sqrt((256508.58459698502 / (35)) + (464911.8722779344 / (22))) is less than -2.0040447832881556 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (35) + (22) - 2, .025) and -0.059491459478259734 = (42388.573026812766 - 44910.33110137865) / 42388.573026812766 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>




Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Regressions in System.Collections.Tests.Perf_BitArray #69728

Run Information