[Perf] Linux/x64: 33 Regressions on 5/3/2024 2:25:46 AM #101990

performanceautofiler · 2024-05-07T08:06:58Z

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ee93104aa0e7ac77ca7e4c6db9873356a9e3e622
Compare	15e98e58e6023be3121dcb0ed2e701d1d5cd098e
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Count - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	3.24 ms	3.50 ms	1.08	0.01	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock*'

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\w+\s+Holmes\s+\w+", Options: Compiled)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ee93104aa0e7ac77ca7e4c6db9873356a9e3e622
Compare	15e98e58e6023be3121dcb0ed2e701d1d5cd098e
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Common

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
Uri_IsNotMatch - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	68.46 ns	72.47 ns	1.06	0.01	False
Uri_IsMatch - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	65.11 ns	71.55 ns	1.10	0.05	False
Uri_IsMatch - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	64.63 ns	72.02 ns	1.11	0.02	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Common*'

System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsNotMatch(Options: Compiled)

ETL Files

Histogram

JIT Disasms

System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsMatch(Options: IgnoreCase, Compiled)

ETL Files

Histogram

JIT Disasms

System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsMatch(Options: Compiled)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ee93104aa0e7ac77ca7e4c6db9873356a9e3e622
Compare	15e98e58e6023be3121dcb0ed2e701d1d5cd098e
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.IndexerSetReverse<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
List - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	515.67 ns	566.23 ns	1.10	0.04	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IndexerSetReverse&lt;Int32&gt;*'

System.Collections.IndexerSetReverse<Int32>.List(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ee93104aa0e7ac77ca7e4c6db9873356a9e3e622
Compare	15e98e58e6023be3121dcb0ed2e701d1d5cd098e
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Buffers.Tests.SearchValuesCharTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
LastIndexOfAny - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	90.61 ns	123.09 ns	1.36	0.01	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.SearchValuesCharTests*'

System.Buffers.Tests.SearchValuesCharTests.LastIndexOfAny(Values: "ßäöüÄÖÜ")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ee93104aa0e7ac77ca7e4c6db9873356a9e3e622
Compare	15e98e58e6023be3121dcb0ed2e701d1d5cd098e
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_UInt32

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
TryFormat - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	4.99 ns	6.55 ns	1.31	0.02	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_UInt32*'

System.Tests.Perf_UInt32.TryFormat(value: 4294967295)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ee93104aa0e7ac77ca7e4c6db9873356a9e3e622
Compare	15e98e58e6023be3121dcb0ed2e701d1d5cd098e
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.Json.Document.Tests.Perf_EnumerateObject

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
PropertyIndexer - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	1.64 μs	1.83 μs	1.12	0.02	False
EnumerateProperties - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	535.54 ns	600.00 ns	1.12	0.07	False
PropertyIndexer - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	1.64 μs	1.83 μs	1.12	0.02	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Document.Tests.Perf_EnumerateObject*'

System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: NumericProperties)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Document.Tests.Perf_EnumerateObject.EnumerateProperties(TestCase: StringProperties)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: StringProperties)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ee93104aa0e7ac77ca7e4c6db9873356a9e3e622
Compare	15e98e58e6023be3121dcb0ed2e701d1d5cd098e
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Boolean

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
TryParse - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	1.62 ns	2.64 ns	1.63	0.11	False
TryParse - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	6.35 ns	7.37 ns	1.16	0.13	False
TryParse - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	1.62 ns	2.64 ns	1.63	0.09	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Boolean*'

System.Tests.Perf_Boolean.TryParse(value: "false")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Boolean.TryParse(value: " True ")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Boolean.TryParse(value: "False")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ee93104aa0e7ac77ca7e4c6db9873356a9e3e622
Compare	15e98e58e6023be3121dcb0ed2e701d1d5cd098e
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in LinqBenchmarks

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Where01LinqMethodX - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	152.09 ms	162.11 ms	1.07	0.09	False
Where01LinqQueryX - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	150.21 ms	169.73 ms	1.13	0.11	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'LinqBenchmarks*'

LinqBenchmarks.Where01LinqMethodX

ETL Files

Histogram

JIT Disasms

LinqBenchmarks.Where01LinqQueryX

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ee93104aa0e7ac77ca7e4c6db9873356a9e3e622
Compare	15e98e58e6023be3121dcb0ed2e701d1d5cd098e
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.IterateForEachNonGeneric<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Stack - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	1.58 μs	1.70 μs	1.08	0.00	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEachNonGeneric&lt;Int32&gt;*'

System.Collections.IterateForEachNonGeneric<Int32>.Stack(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ee93104aa0e7ac77ca7e4c6db9873356a9e3e622
Compare	15e98e58e6023be3121dcb0ed2e701d1d5cd098e
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Enum

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
ToString_Flags - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	50.88 ns	56.09 ns	1.10	0.03	False
ToString_Flags - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	20.34 ns	22.49 ns	1.11	0.14	False
ToString_Format_NonFlags - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	21.44 ns	24.96 ns	1.16	0.03	False
ToString_Flags - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	19.67 ns	21.70 ns	1.10	0.18	False
ToString_Flags - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	31.34 ns	33.57 ns	1.07	0.02	False
InterpolateIntoString - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	134.43 ns	145.34 ns	1.08	0.07	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Enum*'

System.Tests.Perf_Enum.ToString_Flags(value: Red, Orange, Yellow, Green, Blue)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.ToString_Flags(value: 36)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.ToString_Format_NonFlags(value: 8, format: "F")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.ToString_Flags(value: 32)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.ToString_Flags(value: Yellow, Blue)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Enum.InterpolateIntoString(value: Red, Green)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ee93104aa0e7ac77ca7e4c6db9873356a9e3e622
Compare	15e98e58e6023be3121dcb0ed2e701d1d5cd098e
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Int32

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
TryParseSpan - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	8.20 ns	9.22 ns	1.12	0.09	False
TryFormat - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	13.16 ns	15.41 ns	1.17	0.09	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int32*'

System.Tests.Perf_Int32.TryParseSpan(value: "4")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Int32.TryFormat(value: -2147483648)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ee93104aa0e7ac77ca7e4c6db9873356a9e3e622
Compare	15e98e58e6023be3121dcb0ed2e701d1d5cd098e
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.IO.Tests.Perf_StreamWriter

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
WriteCharArray - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	69.31 ms	82.27 ms	1.19	0.14	False
WritePartialCharArray - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	84.92 ms	104.18 ms	1.23	0.07	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.Perf_StreamWriter*'

System.IO.Tests.Perf_StreamWriter.WriteCharArray(writeLength: 2)

ETL Files

Histogram

JIT Disasms

System.IO.Tests.Perf_StreamWriter.WritePartialCharArray(writeLength: 2)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

performanceautofiler · 2024-05-07T08:07:01Z

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ee93104aa0e7ac77ca7e4c6db9873356a9e3e622
Compare	15e98e58e6023be3121dcb0ed2e701d1d5cd098e
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_UInt64

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ParseSpan - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	7.76 ns	9.43 ns	1.21	0.13	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_UInt64*'

System.Tests.Perf_UInt64.ParseSpan(value: "0")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ee93104aa0e7ac77ca7e4c6db9873356a9e3e622
Compare	15e98e58e6023be3121dcb0ed2e701d1d5cd098e
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Tests.Perf_Int128

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ToString - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	11.75 ns	13.94 ns	1.19	0.03	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Int128*'

System.Tests.Perf_Int128.ToString(value: 12345)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ee93104aa0e7ac77ca7e4c6db9873356a9e3e622
Compare	15e98e58e6023be3121dcb0ed2e701d1d5cd098e
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.TryGetValueFalse<Int32, Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
FrozenDictionaryOptimized - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	1.58 μs	1.69 μs	1.07	0.02	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueFalse&lt;Int32, Int32&gt;*'

System.Collections.TryGetValueFalse<Int32, Int32>.FrozenDictionaryOptimized(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ee93104aa0e7ac77ca7e4c6db9873356a9e3e622
Compare	15e98e58e6023be3121dcb0ed2e701d1d5cd098e
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.Json.Tests.Perf_Basic

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
WriteBasicUtf8 - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	1.24 ms	1.45 ms	1.18	0.18	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Basic*'

System.Text.Json.Tests.Perf_Basic.WriteBasicUtf8(Formatted: False, SkipValidation: True, DataSize: 100000)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ee93104aa0e7ac77ca7e4c6db9873356a9e3e622
Compare	15e98e58e6023be3121dcb0ed2e701d1d5cd098e
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.IterateForEachNonGeneric<String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Stack - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	1.60 μs	1.70 μs	1.06	0.00	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEachNonGeneric&lt;String&gt;*'

System.Collections.IterateForEachNonGeneric<String>.Stack(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ee93104aa0e7ac77ca7e4c6db9873356a9e3e622
Compare	15e98e58e6023be3121dcb0ed2e701d1d5cd098e
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Count - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	301.74 ms	357.07 ms	1.18	0.02	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig*'

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Leipzig.Count(Pattern: ".{0,2}(Tom|Sawyer|Huckleberry|Finn)", Options: Compiled)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ee93104aa0e7ac77ca7e4c6db9873356a9e3e622
Compare	15e98e58e6023be3121dcb0ed2e701d1d5cd098e
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Text.Json.Tests.Perf_Guids

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
WriteGuids - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	1.26 ms	1.35 ms	1.07	0.12	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Perf_Guids*'

System.Text.Json.Tests.Perf_Guids.WriteGuids(Formatted: True, SkipValidation: True)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

EgorBo · 2024-05-07T16:02:49Z

Likely #101739?

AndyAyersMS · 2024-05-07T16:24:09Z

Yes

DrewScoggins · 2024-05-07T16:26:39Z

Improvements:

[Perf] Linux/x64: 22 Improvements on 5/3/2024 2:25:46 AM perf-autofiling-issues#33895
[Perf] Windows/x64: 2 Improvements on 5/3/2024 2:25:46 AM perf-autofiling-issues#33928
[Perf] Linux/x64: 2 Improvements on 5/2/2024 10:00:56 PM perf-autofiling-issues#33894

Regressions:

[Perf] Linux/arm64: 34 Regressions on 5/3/2024 2:25:46 AM perf-autofiling-issues#34039

DrewScoggins · 2024-05-07T16:27:58Z

@AndyAyersMS

AndyAyersMS · 2024-05-08T02:53:28Z

Will revisit once we enable the new layout. Also curious to see the ARM64 results.

dotnet-policy-service · 2024-05-09T13:23:32Z

Tagging subscribers to this area: @JulieLeeMSFT, @jakobbotsch
See info in area-owners.md if you want to be subscribed.

AndyAyersMS · 2024-07-02T15:28:13Z

Quite a few of these have improved since, eg

Likely from #102343 or #102512

AndyAyersMS · 2024-07-02T15:34:28Z

Some were fixed but then re-regressed later

Others look like noisy benchmarks.

Going to close this as I think it was mostly addressed by the new block layout work.

LoopedBard3 · 2024-08-27T21:12:53Z

Will revisit once we enable the new layout. Also curious to see the ARM64 results.

Not sure if the ARM results were gone over when this first came out, but I just linked a set of Arm64 regressions to the tracking list (dotnet/perf-autofiling-issues#34039) as it seems we are still seeing some regressions from this timeframe.

performanceautofiler bot added arch-x64 os-linux Linux OS (any supported distro) runtime-coreclr specific to the CoreCLR runtime untriaged New issue has not been triaged by the area owner labels May 7, 2024

performanceautofiler bot mentioned this issue May 7, 2024

[SENTINEL] Autofile run complete at 5/7/2024 8:11:04 AM. 20 issues filed. dotnet/perf-autofiling-issues#33898

Closed

DrewScoggins transferred this issue from dotnet/perf-autofiling-issues May 7, 2024

dotnet-issue-labeler bot added the needs-area-label An area label is needed to ensure this gets routed to the appropriate area owners label May 7, 2024

DrewScoggins added tenet-performance Performance related issue tenet-performance-benchmarks Issue from performance benchmark labels May 7, 2024

AndyAyersMS self-assigned this May 8, 2024

AndyAyersMS removed the untriaged New issue has not been triaged by the area owner label May 8, 2024

AndyAyersMS added this to the 9.0.0 milestone May 8, 2024

AndyAyersMS added the Priority:2 Work that is important, but not critical for the release label May 8, 2024

jeffschwMSFT added the area-CodeGen-coreclr CLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMI label May 9, 2024

vcsjones removed the needs-area-label An area label is needed to ensure this gets routed to the appropriate area owners label May 9, 2024

AndyAyersMS closed this as completed Jul 2, 2024

github-actions bot locked and limited conversation to collaborators Aug 2, 2024

[Perf] Linux/x64: 33 Regressions on 5/3/2024 2:25:46 AM #101990

[Perf] Linux/x64: 33 Regressions on 5/3/2024 2:25:46 AM #101990

Comments

performanceautofiler bot commented May 7, 2024 • edited Loading

Run Information

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

Repro

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "\w+\s+Holmes\s+\w+", Options: Compiled)

ETL Files

Histogram

JIT Disasms

Docs

Run Information

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Common

Repro

System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsNotMatch(Options: Compiled)

ETL Files

Histogram

JIT Disasms

System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsMatch(Options: IgnoreCase, Compiled)

ETL Files

Histogram

JIT Disasms

System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsMatch(Options: Compiled)

ETL Files

Histogram

JIT Disasms

Docs

Run Information

Regressions in System.Collections.IndexerSetReverse<Int32>

Repro

System.Collections.IndexerSetReverse<Int32>.List(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Run Information

Regressions in System.Buffers.Tests.SearchValuesCharTests

Repro

System.Buffers.Tests.SearchValuesCharTests.LastIndexOfAny(Values: "ßäöüÄÖÜ")

ETL Files

Histogram

JIT Disasms

Docs

Run Information

Regressions in System.Tests.Perf_UInt32

Repro

System.Tests.Perf_UInt32.TryFormat(value: 4294967295)

ETL Files

Histogram

JIT Disasms

Docs

Run Information

Regressions in System.Text.Json.Document.Tests.Perf_EnumerateObject

Repro

System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: NumericProperties)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Document.Tests.Perf_EnumerateObject.EnumerateProperties(TestCase: StringProperties)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Document.Tests.Perf_EnumerateObject.PropertyIndexer(TestCase: StringProperties)

ETL Files

Histogram

JIT Disasms

Docs

Run Information

Regressions in System.Tests.Perf_Boolean

Repro

System.Tests.Perf_Boolean.TryParse(value: "false")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Boolean.TryParse(value: " True ")

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Boolean.TryParse(value: "False")

performanceautofiler bot commented May 7, 2024 •

edited

Loading