[Perf] Linux/x64: 5 Regressions on 12/12/2024 1:14:47 PM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	c6464250c27ee67af31d6df3141db1722f006e48
Compare	43b89b4a40f7642891e48801d56bd706ab717d6b
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Numerics.Tensors.Tests.Perf_BinaryIntegerTensorPrimitives<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ShiftLeft - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	141.17 ns	178.19 ns	1.26	0.06	False
OnesComplement - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	136.72 ns	176.97 ns	1.29	0.07	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tensors.Tests.Perf_BinaryIntegerTensorPrimitives<Int32>*'

System.Numerics.Tensors.Tests.Perf_BinaryIntegerTensorPrimitives<Int32>.ShiftLeft(BufferLength: 3079)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_BinaryIntegerTensorPrimitives<Int32>.OnesComplement(BufferLength: 3079)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	c6464250c27ee67af31d6df3141db1722f006e48
Compare	7927a192be28c8562a54becdbe0a665837022eaa
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Xml.Linq.Perf_XElementList

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Enumerator - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	141.79 ns	191.12 ns	1.35	0.02	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Xml.Linq.Perf_XElementList*'

System.Xml.Linq.Perf_XElementList.Enumerator

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	c6464250c27ee67af31d6df3141db1722f006e48
Compare	5a9362f509629304c91ae07662f649282f956552
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Numerics.Tests.Perf_VectorOf<Int16>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
DivisionOperatorBenchmark - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	30.24 ns	35.39 ns	1.17	0.12	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Int16>*'

System.Numerics.Tests.Perf_VectorOf<Int16>.DivisionOperatorBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	c6464250c27ee67af31d6df3141db1722f006e48
Compare	5a9362f509629304c91ae07662f649282f956552
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Collections.TryGetValueFalse<SmallClass, SmallClass>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Dictionary - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	4.36 μs	4.84 μs	1.11	0.14	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueFalse<SmallClass, SmallClass>*'

System.Collections.TryGetValueFalse<SmallClass, SmallClass>.Dictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[LoopedBard3]

Compare range: f30cfc0...bf40019. Most likely #110105 as that seems to be the only potentially impactful change to these benchmarks, but it is not clear that it is the cause (it is a roslyn update). The regressions seem to be affecting multiple platforms as well.

Related regressions:

• [Perf] Linux/x64: 5 Regressions on 12/12/2024 1:14:47 PM perf-autofiling-issues#46633
• [Perf] Windows/x64: 11 Regressions on 12/12/2024 1:14:47 PM perf-autofiling-issues#46612
• [Perf] Windows/x64: 9 Regressions on 12/12/2024 1:14:47 PM perf-autofiling-issues#46622

And some improvements in this range:

• [Perf] Linux/x64: 6 Improvements on 12/12/2024 1:14:47 PM perf-autofiling-issues#46636
• [Perf] Windows/x64: 4 Improvements on 12/12/2024 1:14:47 PM perf-autofiling-issues#46614
• [Perf] Windows/x64: 2 Improvements on 12/12/2024 1:14:47 PM perf-autofiling-issues#46625
• [Perf] Linux/x64: 2 Improvements on 12/12/2024 1:14:47 PM perf-autofiling-issues#46605