From 1d2a197f15813983de26c38e223ee2085bbec737 Mon Sep 17 00:00:00 2001 From: mpage Date: Mon, 23 Dec 2024 04:42:47 +0000 Subject: [PATCH] Benchmarking results for @mpage --- README.md | 9 +- RESULTS.md | 4 + configs.json | 4 +- configs.svg | 376 +- longitudinal.json | 4 +- longitudinal.svg | 354 +- memory_configs.json | 4 +- memory_configs.svg | 336 +- memory_long.json | 4 +- memory_long.svg | 348 +- .../README.md | 76 + ...985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.md | 203 + ...85e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.svg | 3069 ++++++++++++++ ...e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.md | 202 + ...8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.svg | 3022 +++++++++++++ ...e8bbef69-3.14.0a3+-9d3a8f4-vs-base-mem.svg | 3278 +++++++++++++++ ...94985e8bbef69-3.14.0a3+-9d3a8f4-vs-base.md | 211 + ...4985e8bbef69-3.14.0a3+-9d3a8f4-vs-base.svg | 3292 +++++++++++++++ ...985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.md | 208 + ...85e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.svg | 3067 ++++++++++++++ ...e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.md | 207 + ...8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.svg | 2970 +++++++++++++ ...e8bbef69-3.14.0a3+-9d3a8f4-vs-base-mem.svg | 3744 +++++++++++++++++ ...94985e8bbef69-3.14.0a3+-9d3a8f4-vs-base.md | 174 + ...4985e8bbef69-3.14.0a3+-9d3a8f4-vs-base.svg | 3447 +++++++++++++++ .../bm-20241222-3.14.0a3+-9d3a8f4/README.md | 60 + ...985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.md | 170 + ...85e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.svg | 3237 ++++++++++++++ ...e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.md | 166 + ...8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.svg | 3255 ++++++++++++++ ...985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.md | 206 + ...85e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.svg | 3060 ++++++++++++++ ...e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.md | 197 + ...8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.svg | 2978 +++++++++++++ 34 files changed, 41230 insertions(+), 712 deletions(-) create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/README.md create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.md create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.svg create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.md create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.svg create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base-mem.svg create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base.md create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base.svg create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.md create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.svg create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.md create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.svg create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base-mem.svg create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base.md create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base.svg create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4/README.md create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.md create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.svg create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.md create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.svg create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.md create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.svg create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.md create mode 100644 results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.svg diff --git a/README.md b/README.md index 44c95467..4f83456c 100644 --- a/README.md +++ b/README.md @@ -12,18 +12,20 @@ Here are some recent and important revisions. 👉 [Complete list of results](RE ## linux x86_64 (linux) | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | +| [2024-12-22](results/bm-20241222-3.14.0a3%2B-9d3a8f4) | python/9d3a8f494985e8bbef69 | 9d3a8f4 | 1.082x ↑
[📄](results/bm-20241222-3.14.0a3%2B-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.md)[📈](results/bm-20241222-3.14.0a3%2B-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.svg) | 1.038x ↑
[📄](results/bm-20241222-3.14.0a3%2B-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.md)[📈](results/bm-20241222-3.14.0a3%2B-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.svg) | | +| [2024-12-22](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL) | python/9d3a8f494985e8bbef69 | 9d3a8f4 (NOGIL) | 1.137x ↓
[📄](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.md)[📈](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.svg) | 1.167x ↓
[📄](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.md)[📈](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.svg) | 1.196x ↓
[📄](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-base.md)[📈](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-base.svg)[🧠](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-base-mem.svg) | | [2024-12-20](results/bm-20241220-3.14.0a3%2B-2a66dd3) | python/2a66dd33dfc0b845042d | 2a66dd3 | 1.106x ↑
[📄](results/bm-20241220-3.14.0a3%2B-2a66dd3/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-3.12.6.md)[📈](results/bm-20241220-3.14.0a3%2B-2a66dd3/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-3.12.6.svg) | 1.059x ↑
[📄](results/bm-20241220-3.14.0a3%2B-2a66dd3/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-3.13.0rc2.md)[📈](results/bm-20241220-3.14.0a3%2B-2a66dd3/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-3.13.0rc2.svg) | | | [2024-12-20](results/bm-20241220-3.14.0a3%2B-2a66dd3-NOGIL) | python/2a66dd33dfc0b845042d | 2a66dd3 (NOGIL) | 1.147x ↓
[📄](results/bm-20241220-3.14.0a3%2B-2a66dd3-NOGIL/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-3.12.6.md)[📈](results/bm-20241220-3.14.0a3%2B-2a66dd3-NOGIL/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-3.12.6.svg) | 1.175x ↓
[📄](results/bm-20241220-3.14.0a3%2B-2a66dd3-NOGIL/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-3.13.0rc2.md)[📈](results/bm-20241220-3.14.0a3%2B-2a66dd3-NOGIL/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-3.13.0rc2.svg) | 1.215x ↓
[📄](results/bm-20241220-3.14.0a3%2B-2a66dd3-NOGIL/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-base.md)[📈](results/bm-20241220-3.14.0a3%2B-2a66dd3-NOGIL/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-base.svg)[🧠](results/bm-20241220-3.14.0a3%2B-2a66dd3-NOGIL/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-base-mem.svg) | | [2024-12-19](results/bm-20241219-3.14.0a3%2B-39e69a7) | python/39e69a7cd54d44c9061d | 39e69a7 | 1.102x ↑
[📄](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.12.6.md)[📈](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.12.6.svg) | 1.058x ↑
[📄](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.13.0rc2.md)[📈](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.13.0rc2.svg) | | | [2024-12-19](results/bm-20241219-3.14.0a3%2B-39e69a7-NOGIL) | python/39e69a7cd54d44c9061d | 39e69a7 (NOGIL) | 1.143x ↓
[📄](results/bm-20241219-3.14.0a3%2B-39e69a7-NOGIL/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.12.6.md)[📈](results/bm-20241219-3.14.0a3%2B-39e69a7-NOGIL/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.12.6.svg) | 1.172x ↓
[📄](results/bm-20241219-3.14.0a3%2B-39e69a7-NOGIL/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.13.0rc2.md)[📈](results/bm-20241219-3.14.0a3%2B-39e69a7-NOGIL/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.13.0rc2.svg) | 1.216x ↓
[📄](results/bm-20241219-3.14.0a3%2B-39e69a7-NOGIL/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-base.md)[📈](results/bm-20241219-3.14.0a3%2B-39e69a7-NOGIL/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-base.svg)[🧠](results/bm-20241219-3.14.0a3%2B-39e69a7-NOGIL/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-base-mem.svg) | -| [2024-12-18](results/bm-20241218-3.14.0a3%2B-f802c8b-NOGIL) | python/f802c8bf872ab882d305 | f802c8b (NOGIL) | 1.181x ↓
[📄](results/bm-20241218-3.14.0a3%2B-f802c8b-NOGIL/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-3.12.6.md)[📈](results/bm-20241218-3.14.0a3%2B-f802c8b-NOGIL/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-3.12.6.svg) | 1.208x ↓
[📄](results/bm-20241218-3.14.0a3%2B-f802c8b-NOGIL/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-3.13.0rc2.md)[📈](results/bm-20241218-3.14.0a3%2B-f802c8b-NOGIL/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-3.13.0rc2.svg) | 1.251x ↓
[📄](results/bm-20241218-3.14.0a3%2B-f802c8b-NOGIL/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-base.md)[📈](results/bm-20241218-3.14.0a3%2B-f802c8b-NOGIL/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-base.svg)[🧠](results/bm-20241218-3.14.0a3%2B-f802c8b-NOGIL/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-base-mem.svg) | -| [2024-12-18](results/bm-20241218-3.14.0a3%2B-f802c8b) | python/f802c8bf872ab882d305 | f802c8b | 1.107x ↑
[📄](results/bm-20241218-3.14.0a3%2B-f802c8b/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-3.12.6.md)[📈](results/bm-20241218-3.14.0a3%2B-f802c8b/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-3.12.6.svg) | 1.064x ↑
[📄](results/bm-20241218-3.14.0a3%2B-f802c8b/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-3.13.0rc2.md)[📈](results/bm-20241218-3.14.0a3%2B-f802c8b/bm-20241218-linux-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-3.13.0rc2.svg) | | ## linux x86_64 (vultr) | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | | [2024-12-22](results/bm-20241222-3.14.0a3%2B-f420bdd-NOGIL) | python/f420bdd29fbc1a97ad20 | f420bdd (NOGIL) | 1.187x ↓
[📄](results/bm-20241222-3.14.0a3%2B-f420bdd-NOGIL/bm-20241222-vultr-x86_64-python-f420bdd29fbc1a97ad20-3.14.0a3%2B-f420bdd-vs-3.12.6.md)[📈](results/bm-20241222-3.14.0a3%2B-f420bdd-NOGIL/bm-20241222-vultr-x86_64-python-f420bdd29fbc1a97ad20-3.14.0a3%2B-f420bdd-vs-3.12.6.svg) | 1.213x ↓
[📄](results/bm-20241222-3.14.0a3%2B-f420bdd-NOGIL/bm-20241222-vultr-x86_64-python-f420bdd29fbc1a97ad20-3.14.0a3%2B-f420bdd-vs-3.13.0rc2.md)[📈](results/bm-20241222-3.14.0a3%2B-f420bdd-NOGIL/bm-20241222-vultr-x86_64-python-f420bdd29fbc1a97ad20-3.14.0a3%2B-f420bdd-vs-3.13.0rc2.svg) | | | [2024-12-22](results/bm-20241222-3.14.0a3%2B-83781d1-NOGIL) | colesbury/align_32 | 83781d1 (NOGIL) | 1.177x ↓
[📄](results/bm-20241222-3.14.0a3%2B-83781d1-NOGIL/bm-20241222-vultr-x86_64-colesbury-align_32-3.14.0a3%2B-83781d1-vs-3.12.6.md)[📈](results/bm-20241222-3.14.0a3%2B-83781d1-NOGIL/bm-20241222-vultr-x86_64-colesbury-align_32-3.14.0a3%2B-83781d1-vs-3.12.6.svg) | 1.203x ↓
[📄](results/bm-20241222-3.14.0a3%2B-83781d1-NOGIL/bm-20241222-vultr-x86_64-colesbury-align_32-3.14.0a3%2B-83781d1-vs-3.13.0rc2.md)[📈](results/bm-20241222-3.14.0a3%2B-83781d1-NOGIL/bm-20241222-vultr-x86_64-colesbury-align_32-3.14.0a3%2B-83781d1-vs-3.13.0rc2.svg) | 1.012x ↑
[📄](results/bm-20241222-3.14.0a3%2B-83781d1-NOGIL/bm-20241222-vultr-x86_64-colesbury-align_32-3.14.0a3%2B-83781d1-vs-base.md)[📈](results/bm-20241222-3.14.0a3%2B-83781d1-NOGIL/bm-20241222-vultr-x86_64-colesbury-align_32-3.14.0a3%2B-83781d1-vs-base.svg)[🧠](results/bm-20241222-3.14.0a3%2B-83781d1-NOGIL/bm-20241222-vultr-x86_64-colesbury-align_32-3.14.0a3%2B-83781d1-vs-base-mem.svg) | +| [2024-12-22](results/bm-20241222-3.14.0a3%2B-9d3a8f4) | python/9d3a8f494985e8bbef69 | 9d3a8f4 | 1.094x ↑
[📄](results/bm-20241222-3.14.0a3%2B-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.md)[📈](results/bm-20241222-3.14.0a3%2B-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.svg) | 1.055x ↑
[📄](results/bm-20241222-3.14.0a3%2B-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.md)[📈](results/bm-20241222-3.14.0a3%2B-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.svg) | | +| [2024-12-22](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL) | python/9d3a8f494985e8bbef69 | 9d3a8f4 (NOGIL) | 1.188x ↓
[📄](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.md)[📈](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.svg) | 1.214x ↓
[📄](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.md)[📈](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.svg) | 1.000x ↓
[📄](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-base.md)[📈](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-base.svg)[🧠](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-base-mem.svg) | | [2024-12-20](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL) | Yhg1s/optimise_recursive_c | b28153d (NOGIL) | 1.168x ↓
[📄](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-3.12.6.md)[📈](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-3.12.6.svg) | 1.195x ↓
[📄](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-3.13.0rc2.md)[📈](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-3.13.0rc2.svg) | 1.024x ↑
[📄](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-base.md)[📈](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-base.svg)[🧠](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-base-mem.svg) | | [2024-12-20](results/bm-20241220-3.14.0a3%2B-4fc4237) | mpage/4fc4237a1ea09f6a31e9 | 4fc4237 | 1.091x ↑
[📄](results/bm-20241220-3.14.0a3%2B-4fc4237/bm-20241220-vultr-x86_64-mpage-4fc4237a1ea09f6a31e9-3.14.0a3%2B-4fc4237-vs-3.12.6.md)[📈](results/bm-20241220-3.14.0a3%2B-4fc4237/bm-20241220-vultr-x86_64-mpage-4fc4237a1ea09f6a31e9-3.14.0a3%2B-4fc4237-vs-3.12.6.svg) | 1.052x ↑
[📄](results/bm-20241220-3.14.0a3%2B-4fc4237/bm-20241220-vultr-x86_64-mpage-4fc4237a1ea09f6a31e9-3.14.0a3%2B-4fc4237-vs-3.13.0rc2.md)[📈](results/bm-20241220-3.14.0a3%2B-4fc4237/bm-20241220-vultr-x86_64-mpage-4fc4237a1ea09f6a31e9-3.14.0a3%2B-4fc4237-vs-3.13.0rc2.svg) | 1.002x ↑
[📄](results/bm-20241220-3.14.0a3%2B-4fc4237/bm-20241220-vultr-x86_64-mpage-4fc4237a1ea09f6a31e9-3.14.0a3%2B-4fc4237-vs-base.md)[📈](results/bm-20241220-3.14.0a3%2B-4fc4237/bm-20241220-vultr-x86_64-mpage-4fc4237a1ea09f6a31e9-3.14.0a3%2B-4fc4237-vs-base.svg)[🧠](results/bm-20241220-3.14.0a3%2B-4fc4237/bm-20241220-vultr-x86_64-mpage-4fc4237a1ea09f6a31e9-3.14.0a3%2B-4fc4237-vs-base-mem.svg) | | [2024-12-20](results/bm-20241220-3.14.0a3%2B-63a53fd) | mpage/63a53fd736f57fcf80df | 63a53fd | 1.085x ↑
[📄](results/bm-20241220-3.14.0a3%2B-63a53fd/bm-20241220-vultr-x86_64-mpage-63a53fd736f57fcf80df-3.14.0a3%2B-63a53fd-vs-3.12.6.md)[📈](results/bm-20241220-3.14.0a3%2B-63a53fd/bm-20241220-vultr-x86_64-mpage-63a53fd736f57fcf80df-3.14.0a3%2B-63a53fd-vs-3.12.6.svg) | 1.046x ↑
[📄](results/bm-20241220-3.14.0a3%2B-63a53fd/bm-20241220-vultr-x86_64-mpage-63a53fd736f57fcf80df-3.14.0a3%2B-63a53fd-vs-3.13.0rc2.md)[📈](results/bm-20241220-3.14.0a3%2B-63a53fd/bm-20241220-vultr-x86_64-mpage-63a53fd736f57fcf80df-3.14.0a3%2B-63a53fd-vs-3.13.0rc2.svg) | 1.002x ↓
[📄](results/bm-20241220-3.14.0a3%2B-63a53fd/bm-20241220-vultr-x86_64-mpage-63a53fd736f57fcf80df-3.14.0a3%2B-63a53fd-vs-base.md)[📈](results/bm-20241220-3.14.0a3%2B-63a53fd/bm-20241220-vultr-x86_64-mpage-63a53fd736f57fcf80df-3.14.0a3%2B-63a53fd-vs-base.svg)[🧠](results/bm-20241220-3.14.0a3%2B-63a53fd/bm-20241220-vultr-x86_64-mpage-63a53fd736f57fcf80df-3.14.0a3%2B-63a53fd-vs-base-mem.svg) | @@ -41,9 +43,6 @@ Here are some recent and important revisions. 👉 [Complete list of results](RE | [2024-12-19](results/bm-20241219-3.14.0a3%2B-39e69a7) | python/39e69a7cd54d44c9061d | 39e69a7 | 1.084x ↑
[📄](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.12.6.md)[📈](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.12.6.svg) | 1.046x ↑
[📄](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.13.0rc2.md)[📈](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.13.0rc2.svg) | | | [2024-12-19](results/bm-20241219-3.14.0a3%2B-39e69a7) | mpage/39e69a7cd54d44c9061d | 39e69a7 | 1.089x ↑
[📄](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-vultr-x86_64-mpage-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.12.6.md)[📈](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-vultr-x86_64-mpage-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.12.6.svg) | 1.051x ↑
[📄](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-vultr-x86_64-mpage-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.13.0rc2.md)[📈](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-vultr-x86_64-mpage-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.13.0rc2.svg) | | | [2024-12-19](results/bm-20241219-3.14.0a3%2B-39e69a7-NOGIL) | python/39e69a7cd54d44c9061d | 39e69a7 (NOGIL) | 1.189x ↓
[📄](results/bm-20241219-3.14.0a3%2B-39e69a7-NOGIL/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.12.6.md)[📈](results/bm-20241219-3.14.0a3%2B-39e69a7-NOGIL/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.12.6.svg) | 1.215x ↓
[📄](results/bm-20241219-3.14.0a3%2B-39e69a7-NOGIL/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.13.0rc2.md)[📈](results/bm-20241219-3.14.0a3%2B-39e69a7-NOGIL/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.13.0rc2.svg) | 1.246x ↓
[📄](results/bm-20241219-3.14.0a3%2B-39e69a7-NOGIL/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-base.md)[📈](results/bm-20241219-3.14.0a3%2B-39e69a7-NOGIL/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-base.svg)[🧠](results/bm-20241219-3.14.0a3%2B-39e69a7-NOGIL/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-base-mem.svg) | -| [2024-12-18](results/bm-20241218-3.14.0a3%2B-f802c8b-NOGIL) | python/f802c8bf872ab882d305 | f802c8b (NOGIL) | 1.218x ↓
[📄](results/bm-20241218-3.14.0a3%2B-f802c8b-NOGIL/bm-20241218-vultr-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-3.12.6.md)[📈](results/bm-20241218-3.14.0a3%2B-f802c8b-NOGIL/bm-20241218-vultr-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-3.12.6.svg) | 1.243x ↓
[📄](results/bm-20241218-3.14.0a3%2B-f802c8b-NOGIL/bm-20241218-vultr-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-3.13.0rc2.md)[📈](results/bm-20241218-3.14.0a3%2B-f802c8b-NOGIL/bm-20241218-vultr-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-3.13.0rc2.svg) | 1.266x ↓
[📄](results/bm-20241218-3.14.0a3%2B-f802c8b-NOGIL/bm-20241218-vultr-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-base.md)[📈](results/bm-20241218-3.14.0a3%2B-f802c8b-NOGIL/bm-20241218-vultr-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-base.svg)[🧠](results/bm-20241218-3.14.0a3%2B-f802c8b-NOGIL/bm-20241218-vultr-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-base-mem.svg) | -| [2024-12-18](results/bm-20241218-3.14.0a3%2B-f802c8b) | python/f802c8bf872ab882d305 | f802c8b | 1.076x ↑
[📄](results/bm-20241218-3.14.0a3%2B-f802c8b/bm-20241218-vultr-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-3.12.6.md)[📈](results/bm-20241218-3.14.0a3%2B-f802c8b/bm-20241218-vultr-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-3.12.6.svg) | 1.037x ↑
[📄](results/bm-20241218-3.14.0a3%2B-f802c8b/bm-20241218-vultr-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-3.13.0rc2.md)[📈](results/bm-20241218-3.14.0a3%2B-f802c8b/bm-20241218-vultr-x86_64-python-f802c8bf872ab882d305-3.14.0a3%2B-f802c8b-vs-3.13.0rc2.svg) | | -| [2024-12-17](results/bm-20241217-3.14.0a3%2B-3291656) | python/329165639f9ac00ba64f | 3291656 | 1.082x ↑
[📄](results/bm-20241217-3.14.0a3%2B-3291656/bm-20241217-vultr-x86_64-python-329165639f9ac00ba64f-3.14.0a3%2B-3291656-vs-3.12.6.md)[📈](results/bm-20241217-3.14.0a3%2B-3291656/bm-20241217-vultr-x86_64-python-329165639f9ac00ba64f-3.14.0a3%2B-3291656-vs-3.12.6.svg) | 1.043x ↑
[📄](results/bm-20241217-3.14.0a3%2B-3291656/bm-20241217-vultr-x86_64-python-329165639f9ac00ba64f-3.14.0a3%2B-3291656-vs-3.13.0rc2.md)[📈](results/bm-20241217-3.14.0a3%2B-3291656/bm-20241217-vultr-x86_64-python-329165639f9ac00ba64f-3.14.0a3%2B-3291656-vs-3.13.0rc2.svg) | | diff --git a/RESULTS.md b/RESULTS.md index 30d417c8..a6ae2560 100644 --- a/RESULTS.md +++ b/RESULTS.md @@ -6,6 +6,8 @@ ## linux x86_64 (linux) | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | +| [2024-12-22](results/bm-20241222-3.14.0a3%2B-9d3a8f4) | python/9d3a8f494985e8bbef69 | 9d3a8f4 | 1.082x ↑
[📄](results/bm-20241222-3.14.0a3%2B-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.md)[📈](results/bm-20241222-3.14.0a3%2B-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.svg) | 1.038x ↑
[📄](results/bm-20241222-3.14.0a3%2B-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.md)[📈](results/bm-20241222-3.14.0a3%2B-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.svg) | | +| [2024-12-22](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL) | python/9d3a8f494985e8bbef69 | 9d3a8f4 (NOGIL) | 1.137x ↓
[📄](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.md)[📈](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.svg) | 1.167x ↓
[📄](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.md)[📈](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.svg) | 1.196x ↓
[📄](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-base.md)[📈](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-base.svg)[🧠](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-base-mem.svg) | | [2024-12-20](results/bm-20241220-3.14.0a3%2B-2a66dd3) | python/2a66dd33dfc0b845042d | 2a66dd3 | 1.106x ↑
[📄](results/bm-20241220-3.14.0a3%2B-2a66dd3/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-3.12.6.md)[📈](results/bm-20241220-3.14.0a3%2B-2a66dd3/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-3.12.6.svg) | 1.059x ↑
[📄](results/bm-20241220-3.14.0a3%2B-2a66dd3/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-3.13.0rc2.md)[📈](results/bm-20241220-3.14.0a3%2B-2a66dd3/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-3.13.0rc2.svg) | | | [2024-12-20](results/bm-20241220-3.14.0a3%2B-2a66dd3-NOGIL) | python/2a66dd33dfc0b845042d | 2a66dd3 (NOGIL) | 1.147x ↓
[📄](results/bm-20241220-3.14.0a3%2B-2a66dd3-NOGIL/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-3.12.6.md)[📈](results/bm-20241220-3.14.0a3%2B-2a66dd3-NOGIL/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-3.12.6.svg) | 1.175x ↓
[📄](results/bm-20241220-3.14.0a3%2B-2a66dd3-NOGIL/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-3.13.0rc2.md)[📈](results/bm-20241220-3.14.0a3%2B-2a66dd3-NOGIL/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-3.13.0rc2.svg) | 1.215x ↓
[📄](results/bm-20241220-3.14.0a3%2B-2a66dd3-NOGIL/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-base.md)[📈](results/bm-20241220-3.14.0a3%2B-2a66dd3-NOGIL/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-base.svg)[🧠](results/bm-20241220-3.14.0a3%2B-2a66dd3-NOGIL/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3%2B-2a66dd3-vs-base-mem.svg) | | [2024-12-19](results/bm-20241219-3.14.0a3%2B-39e69a7) | python/39e69a7cd54d44c9061d | 39e69a7 | 1.102x ↑
[📄](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.12.6.md)[📈](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.12.6.svg) | 1.058x ↑
[📄](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.13.0rc2.md)[📈](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.13.0rc2.svg) | | @@ -209,6 +211,8 @@ | --- | --- | --- | ---: | ---: | ---: | | [2024-12-22](results/bm-20241222-3.14.0a3%2B-f420bdd-NOGIL) | python/f420bdd29fbc1a97ad20 | f420bdd (NOGIL) | 1.187x ↓
[📄](results/bm-20241222-3.14.0a3%2B-f420bdd-NOGIL/bm-20241222-vultr-x86_64-python-f420bdd29fbc1a97ad20-3.14.0a3%2B-f420bdd-vs-3.12.6.md)[📈](results/bm-20241222-3.14.0a3%2B-f420bdd-NOGIL/bm-20241222-vultr-x86_64-python-f420bdd29fbc1a97ad20-3.14.0a3%2B-f420bdd-vs-3.12.6.svg) | 1.213x ↓
[📄](results/bm-20241222-3.14.0a3%2B-f420bdd-NOGIL/bm-20241222-vultr-x86_64-python-f420bdd29fbc1a97ad20-3.14.0a3%2B-f420bdd-vs-3.13.0rc2.md)[📈](results/bm-20241222-3.14.0a3%2B-f420bdd-NOGIL/bm-20241222-vultr-x86_64-python-f420bdd29fbc1a97ad20-3.14.0a3%2B-f420bdd-vs-3.13.0rc2.svg) | | | [2024-12-22](results/bm-20241222-3.14.0a3%2B-83781d1-NOGIL) | colesbury/align_32 | 83781d1 (NOGIL) | 1.177x ↓
[📄](results/bm-20241222-3.14.0a3%2B-83781d1-NOGIL/bm-20241222-vultr-x86_64-colesbury-align_32-3.14.0a3%2B-83781d1-vs-3.12.6.md)[📈](results/bm-20241222-3.14.0a3%2B-83781d1-NOGIL/bm-20241222-vultr-x86_64-colesbury-align_32-3.14.0a3%2B-83781d1-vs-3.12.6.svg) | 1.203x ↓
[📄](results/bm-20241222-3.14.0a3%2B-83781d1-NOGIL/bm-20241222-vultr-x86_64-colesbury-align_32-3.14.0a3%2B-83781d1-vs-3.13.0rc2.md)[📈](results/bm-20241222-3.14.0a3%2B-83781d1-NOGIL/bm-20241222-vultr-x86_64-colesbury-align_32-3.14.0a3%2B-83781d1-vs-3.13.0rc2.svg) | 1.012x ↑
[📄](results/bm-20241222-3.14.0a3%2B-83781d1-NOGIL/bm-20241222-vultr-x86_64-colesbury-align_32-3.14.0a3%2B-83781d1-vs-base.md)[📈](results/bm-20241222-3.14.0a3%2B-83781d1-NOGIL/bm-20241222-vultr-x86_64-colesbury-align_32-3.14.0a3%2B-83781d1-vs-base.svg)[🧠](results/bm-20241222-3.14.0a3%2B-83781d1-NOGIL/bm-20241222-vultr-x86_64-colesbury-align_32-3.14.0a3%2B-83781d1-vs-base-mem.svg) | +| [2024-12-22](results/bm-20241222-3.14.0a3%2B-9d3a8f4) | python/9d3a8f494985e8bbef69 | 9d3a8f4 | 1.094x ↑
[📄](results/bm-20241222-3.14.0a3%2B-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.md)[📈](results/bm-20241222-3.14.0a3%2B-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.svg) | 1.055x ↑
[📄](results/bm-20241222-3.14.0a3%2B-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.md)[📈](results/bm-20241222-3.14.0a3%2B-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.svg) | | +| [2024-12-22](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL) | python/9d3a8f494985e8bbef69 | 9d3a8f4 (NOGIL) | 1.188x ↓
[📄](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.md)[📈](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.svg) | 1.214x ↓
[📄](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.md)[📈](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.svg) | 1.000x ↓
[📄](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-base.md)[📈](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-base.svg)[🧠](results/bm-20241222-3.14.0a3%2B-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-base-mem.svg) | | [2024-12-20](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL) | Yhg1s/optimise_recursive_c | b28153d (NOGIL) | 1.168x ↓
[📄](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-3.12.6.md)[📈](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-3.12.6.svg) | 1.195x ↓
[📄](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-3.13.0rc2.md)[📈](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-3.13.0rc2.svg) | 1.024x ↑
[📄](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-base.md)[📈](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-base.svg)[🧠](results/bm-20241220-3.14.0a3%2B-b28153d-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-b28153d-vs-base-mem.svg) | | [2024-12-20](results/bm-20241220-3.14.0a3%2B-4fc4237) | mpage/4fc4237a1ea09f6a31e9 | 4fc4237 | 1.091x ↑
[📄](results/bm-20241220-3.14.0a3%2B-4fc4237/bm-20241220-vultr-x86_64-mpage-4fc4237a1ea09f6a31e9-3.14.0a3%2B-4fc4237-vs-3.12.6.md)[📈](results/bm-20241220-3.14.0a3%2B-4fc4237/bm-20241220-vultr-x86_64-mpage-4fc4237a1ea09f6a31e9-3.14.0a3%2B-4fc4237-vs-3.12.6.svg) | 1.052x ↑
[📄](results/bm-20241220-3.14.0a3%2B-4fc4237/bm-20241220-vultr-x86_64-mpage-4fc4237a1ea09f6a31e9-3.14.0a3%2B-4fc4237-vs-3.13.0rc2.md)[📈](results/bm-20241220-3.14.0a3%2B-4fc4237/bm-20241220-vultr-x86_64-mpage-4fc4237a1ea09f6a31e9-3.14.0a3%2B-4fc4237-vs-3.13.0rc2.svg) | 1.002x ↑
[📄](results/bm-20241220-3.14.0a3%2B-4fc4237/bm-20241220-vultr-x86_64-mpage-4fc4237a1ea09f6a31e9-3.14.0a3%2B-4fc4237-vs-base.md)[📈](results/bm-20241220-3.14.0a3%2B-4fc4237/bm-20241220-vultr-x86_64-mpage-4fc4237a1ea09f6a31e9-3.14.0a3%2B-4fc4237-vs-base.svg)[🧠](results/bm-20241220-3.14.0a3%2B-4fc4237/bm-20241220-vultr-x86_64-mpage-4fc4237a1ea09f6a31e9-3.14.0a3%2B-4fc4237-vs-base-mem.svg) | | [2024-12-20](results/bm-20241220-3.14.0a3%2B-63a53fd) | mpage/63a53fd736f57fcf80df | 63a53fd | 1.085x ↑
[📄](results/bm-20241220-3.14.0a3%2B-63a53fd/bm-20241220-vultr-x86_64-mpage-63a53fd736f57fcf80df-3.14.0a3%2B-63a53fd-vs-3.12.6.md)[📈](results/bm-20241220-3.14.0a3%2B-63a53fd/bm-20241220-vultr-x86_64-mpage-63a53fd736f57fcf80df-3.14.0a3%2B-63a53fd-vs-3.12.6.svg) | 1.046x ↑
[📄](results/bm-20241220-3.14.0a3%2B-63a53fd/bm-20241220-vultr-x86_64-mpage-63a53fd736f57fcf80df-3.14.0a3%2B-63a53fd-vs-3.13.0rc2.md)[📈](results/bm-20241220-3.14.0a3%2B-63a53fd/bm-20241220-vultr-x86_64-mpage-63a53fd736f57fcf80df-3.14.0a3%2B-63a53fd-vs-3.13.0rc2.svg) | 1.002x ↓
[📄](results/bm-20241220-3.14.0a3%2B-63a53fd/bm-20241220-vultr-x86_64-mpage-63a53fd736f57fcf80df-3.14.0a3%2B-63a53fd-vs-base.md)[📈](results/bm-20241220-3.14.0a3%2B-63a53fd/bm-20241220-vultr-x86_64-mpage-63a53fd736f57fcf80df-3.14.0a3%2B-63a53fd-vs-base.svg)[🧠](results/bm-20241220-3.14.0a3%2B-63a53fd/bm-20241220-vultr-x86_64-mpage-63a53fd736f57fcf80df-3.14.0a3%2B-63a53fd-vs-base-mem.svg) | diff --git a/configs.json b/configs.json index c6efae93..638b405a 100644 --- a/configs.json +++ b/configs.json @@ -150,5 +150,7 @@ "bm-20241219-3.14.0a3+-39e69a7/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7.json,bm-20241219-3.14.0a3+-39e69a7-NOGIL/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7.json": 0.7839182860738906, "bm-20241219-3.14.0a3+-39e69a7/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7.json,bm-20241219-3.14.0a3+-39e69a7-NOGIL/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7.json": 0.7536261809567308, "bm-20241220-3.14.0a3+-2a66dd3/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json,bm-20241220-3.14.0a3+-2a66dd3-NOGIL/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json": 0.7850801138559111, - "bm-20241220-3.14.0a3+-2a66dd3/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json,bm-20241220-3.14.0a3+-2a66dd3-NOGIL/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json": 0.7478704601089704 + "bm-20241220-3.14.0a3+-2a66dd3/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json,bm-20241220-3.14.0a3+-2a66dd3-NOGIL/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json": 0.7478704601089704, + "bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json,bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json": 0.8043091295591326, + "bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json,bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json": 0.74829080875341 } \ No newline at end of file diff --git a/configs.svg b/configs.svg index 6a1a618e..fe4187a9 100644 --- a/configs.svg +++ b/configs.svg @@ -6,12 +6,12 @@ - + - + - - + + @@ -27,9 +27,9 @@ - - - + + + @@ -41,9 +41,9 @@ - - - + + + @@ -55,9 +55,9 @@ - - - + + + @@ -66,9 +66,9 @@ - - - + + + @@ -79,9 +79,9 @@ - + - + @@ -95,7 +95,7 @@ - + @@ -107,7 +107,7 @@ - + @@ -116,7 +116,7 @@ - + @@ -125,7 +125,7 @@ - + @@ -133,167 +133,169 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + @@ -435,49 +437,49 @@ - + - + - + - + - + - + - + @@ -486,7 +488,7 @@ - + @@ -495,7 +497,7 @@ - + @@ -504,7 +506,7 @@ - + @@ -513,7 +515,7 @@ - + @@ -522,7 +524,7 @@ - + diff --git a/longitudinal.json b/longitudinal.json index 4374056b..be166822 100644 --- a/longitudinal.json +++ b/longitudinal.json @@ -188,5 +188,7 @@ "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20241219-3.14.0a3+-39e69a7/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7.json,3.13.0rc2": 1.0584765428261136, "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241219-3.14.0a3+-39e69a7/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7.json,3.13.0rc2": 1.0442422623076015, "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20241220-3.14.0a3+-2a66dd3/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json,3.13.0rc2": 1.0586228156660242, - "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241220-3.14.0a3+-2a66dd3/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json,3.13.0rc2": 1.047993820977566 + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241220-3.14.0a3+-2a66dd3/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json,3.13.0rc2": 1.047993820977566, + "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json,3.13.0rc2": 1.038100037981609, + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json,3.13.0rc2": 1.0538885128844406 } \ No newline at end of file diff --git a/longitudinal.svg b/longitudinal.svg index b65fa4a5..006f12c9 100644 --- a/longitudinal.svg +++ b/longitudinal.svg @@ -387,8 +387,8 @@ - - + + @@ -397,9 +397,9 @@ - - - + + + @@ -408,9 +408,9 @@ - - - + + + @@ -419,9 +419,9 @@ - - - + + + @@ -430,9 +430,9 @@ - - - + + + @@ -523,174 +523,176 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/memory_configs.json b/memory_configs.json index 610de640..6ce58cd1 100644 --- a/memory_configs.json +++ b/memory_configs.json @@ -150,5 +150,7 @@ "bm-20241219-3.14.0a3+-39e69a7/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7.json,bm-20241219-3.14.0a3+-39e69a7-NOGIL/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7.json": 1.19, "bm-20241219-3.14.0a3+-39e69a7/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7.json,bm-20241219-3.14.0a3+-39e69a7-NOGIL/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7.json": 1.19, "bm-20241220-3.14.0a3+-2a66dd3/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json,bm-20241220-3.14.0a3+-2a66dd3-NOGIL/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json": 1.18, - "bm-20241220-3.14.0a3+-2a66dd3/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json,bm-20241220-3.14.0a3+-2a66dd3-NOGIL/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json": 1.18 + "bm-20241220-3.14.0a3+-2a66dd3/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json,bm-20241220-3.14.0a3+-2a66dd3-NOGIL/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json": 1.18, + "bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json,bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json": 1.18, + "bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json,bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json": 1.19 } \ No newline at end of file diff --git a/memory_configs.svg b/memory_configs.svg index 177cc581..6e0ac260 100644 --- a/memory_configs.svg +++ b/memory_configs.svg @@ -6,12 +6,12 @@ - + - - + + @@ -27,9 +27,9 @@ - - - + + + @@ -41,9 +41,9 @@ - - - + + + @@ -55,9 +55,9 @@ - - - + + + @@ -66,9 +66,9 @@ - - - + + + @@ -171,167 +171,169 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/memory_long.json b/memory_long.json index dea270e3..93634819 100644 --- a/memory_long.json +++ b/memory_long.json @@ -188,5 +188,7 @@ "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20241219-3.14.0a3+-39e69a7/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7.json,3.13.0rc2": 1.13, "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241219-3.14.0a3+-39e69a7/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7.json,3.13.0rc2": 1.1, "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20241220-3.14.0a3+-2a66dd3/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json,3.13.0rc2": 1.13, - "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241220-3.14.0a3+-2a66dd3/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json,3.13.0rc2": 1.1 + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241220-3.14.0a3+-2a66dd3/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json,3.13.0rc2": 1.1, + "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json,3.13.0rc2": 1.13, + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json,3.13.0rc2": 1.1 } \ No newline at end of file diff --git a/memory_long.svg b/memory_long.svg index 02ce25e3..3632a16f 100644 --- a/memory_long.svg +++ b/memory_long.svg @@ -381,8 +381,8 @@ - - + + @@ -391,9 +391,9 @@ - - - + + + @@ -402,9 +402,9 @@ - - - + + + @@ -413,9 +413,9 @@ - - - + + + @@ -424,9 +424,9 @@ - - - + + + @@ -517,172 +517,174 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/README.md b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/README.md new file mode 100644 index 00000000..22cf98db --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/README.md @@ -0,0 +1,76 @@ +# Results + +- fork: python/9d3a8f494985e8bbef69 +- version: 3.14.0a3+ +- config: NOGIL +- commit hash: [9d3a8f4](https://github.com/python/cpython/commit/9d3a8f4) +- commit date: 2024-12-22T11:01:45-08:00 +- commit merge base: [f420bdd29fbc1a97ad20d88075c38c937c1f8479](https://github.com/python/cpython/commit/f420bdd29fbc1a97ad20d88075c38c937c1f8479) +- ref: 9d3a8f494985e8bbef69 + +## linux x86_64 (linux) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/12458964992) +- cpu model: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz +- platform: Linux-5.15.0-1071-aws-x86_64-with-glibc2.31 +- [raw results](bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4.json) + +### vs. 3.12.6 + +- Geometric mean: 1.137x slower (HPT: reliability of 100.00%, 1.09x slower at 99th %ile) +- Memory usage: 1.34x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers +- [📄table](bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.md) +- [📈time plot](bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.167x slower (HPT: reliability of 100.00%, 1.12x slower at 99th %ile) +- Memory usage: 1.33x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers +- [📄table](bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.md) +- [📈time plot](bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.svg) + +### vs. base + +- Geometric mean: 1.196x slower (HPT: reliability of 100.00%, 1.17x slower at 99th %ile) +- Memory usage: 1.18x +- [🧠memory plot](bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-base-mem.svg) +- [📄table](bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-base.md) +- [📈time plot](bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-base.svg) + +## linux x86_64 (vultr) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/12458964992) +- cpu model: Intel(R) Xeon(R) E-2286G CPU @ 4.00GHz +- platform: Linux-6.8.0-45-generic-x86_64-with-glibc2.39 +- [raw results](bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4.json) + +### vs. 3.12.6 + +- Geometric mean: 1.188x slower (HPT: reliability of 100.00%, 1.14x slower at 99th %ile) +- Memory usage: 1.34x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers +- [📄table](bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.md) +- [📈time plot](bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.214x slower (HPT: reliability of 100.00%, 1.14x slower at 99th %ile) +- Memory usage: 1.33x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers +- [📄table](bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.md) +- [📈time plot](bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.svg) + +### vs. base + +- Geometric mean: 1.000x slower (HPT: reliability of 96.37%, 1.00x faster at 99th %ile) +- Memory usage: 1.03x +- [🧠memory plot](bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-base-mem.svg) +- [📄table](bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-base.md) +- [📈time plot](bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-base.svg) + diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.md b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.md new file mode 100644 index 00000000..ad534804 --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.md @@ -0,0 +1,203 @@ +# Results vs. 3.12.6 + +- fork: python +- ref: 9d3a8f494985e8bbef69 +- machine: linux-x86_64 +- commit hash: 9d3a8f4 +- commit date: 2024-12-22 +- overall geometric mean: 1.137x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.09x slower +- Memory change: 1.34x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 456 ms | 604 ms: 1.32x slower | +| docutils | 4.00 sec | 4.26 sec: 1.07x slower | +| html5lib | 88.9 ms | 123 ms: 1.39x slower | +| Geometric mean | (ref) | 1.25x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.93 sec | 967 ms: 2.00x faster | +| async_tree_io | 1.85 sec | 1.07 sec: 1.72x faster | +| async_tree_none_tg | 704 ms | 421 ms: 1.67x faster | +| async_tree_memoization_tg | 930 ms | 558 ms: 1.67x faster | +| async_tree_memoization | 977 ms | 617 ms: 1.58x faster | +| async_tree_none | 741 ms | 489 ms: 1.51x faster | +| async_tree_cpu_io_mixed_tg | 1.10 sec | 763 ms: 1.44x faster | +| async_tree_cpu_io_mixed | 1.08 sec | 827 ms: 1.30x faster | +| async_generators | 589 ms | 614 ms: 1.04x slower | +| coroutines | 29.5 ms | 34.4 ms: 1.17x slower | +| Geometric mean | (ref) | 1.38x faster | + +Benchmark hidden because not significant (1): asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 250 ms | 233 ms: 1.07x faster | +| float | 123 ms | 149 ms: 1.21x slower | +| nbody | 119 ms | 180 ms: 1.51x slower | +| Geometric mean | (ref) | 1.19x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 5.13 ms | 4.67 ms: 1.10x faster | +| regex_dna | 278 ms | 293 ms: 1.05x slower | +| regex_compile | 187 ms | 211 ms: 1.13x slower | +| Geometric mean | (ref) | 1.03x slower | + +Benchmark hidden because not significant (1): regex_v8 + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_iterparse | 169 ms | 137 ms: 1.23x faster | +| xml_etree_parse | 241 ms | 200 ms: 1.20x faster | +| xml_etree_generate | 127 ms | 136 ms: 1.07x slower | +| tomli_loads | 2.88 sec | 3.28 sec: 1.14x slower | +| xml_etree_process | 83.7 ms | 103 ms: 1.23x slower | +| json_dumps | 14.3 ms | 17.6 ms: 1.23x slower | +| unpickle_pure_python | 300 us | 421 us: 1.41x slower | +| pickle_pure_python | 436 us | 619 us: 1.42x slower | +| Geometric mean | (ref) | 1.11x slower | + +Benchmark hidden because not significant (1): json_loads + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 17.6 ms | 19.4 ms: 1.10x slower | +| python_startup | 23.7 ms | 31.0 ms: 1.31x slower | +| Geometric mean | (ref) | 1.20x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|-----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 67.6 ms | 87.4 ms: 1.29x slower | +| genshi_text | 30.2 ms | 40.5 ms: 1.34x slower | +| django_template | 44.9 ms | 60.6 ms: 1.35x slower | +| mako | 15.7 ms | 26.7 ms: 1.70x slower | +| Geometric mean | (ref) | 1.41x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.93 sec | 967 ms: 2.00x faster | +| async_tree_io | 1.85 sec | 1.07 sec: 1.72x faster | +| async_tree_none_tg | 704 ms | 421 ms: 1.67x faster | +| async_tree_memoization_tg | 930 ms | 558 ms: 1.67x faster | +| async_tree_memoization | 977 ms | 617 ms: 1.58x faster | +| async_tree_none | 741 ms | 489 ms: 1.51x faster | +| async_tree_cpu_io_mixed_tg | 1.10 sec | 763 ms: 1.44x faster | +| async_tree_cpu_io_mixed | 1.08 sec | 827 ms: 1.30x faster | +| xml_etree_iterparse | 169 ms | 137 ms: 1.23x faster | +| xml_etree_parse | 241 ms | 200 ms: 1.20x faster | +| deepcopy | 468 us | 420 us: 1.11x faster | +| regex_effbot | 5.13 ms | 4.67 ms: 1.10x faster | +| pidigits | 250 ms | 233 ms: 1.07x faster | +| sqlite_synth | 3.87 us | 3.72 us: 1.04x faster | +| async_generators | 589 ms | 614 ms: 1.04x slower | +| deepcopy_memo | 52.4 us | 54.8 us: 1.05x slower | +| regex_dna | 278 ms | 293 ms: 1.05x slower | +| sqlglot_normalize | 157 ms | 167 ms: 1.07x slower | +| docutils | 4.00 sec | 4.26 sec: 1.07x slower | +| xml_etree_generate | 127 ms | 136 ms: 1.07x slower | +| scimark_fft | 500 ms | 543 ms: 1.09x slower | +| nqueens | 117 ms | 127 ms: 1.09x slower | +| python_startup_no_site | 17.6 ms | 19.4 ms: 1.10x slower | +| pylint | 465 ms | 516 ms: 1.11x slower | +| mdp | 3.97 sec | 4.42 sec: 1.11x slower | +| dulwich_log | 100 ms | 112 ms: 1.12x slower | +| regex_compile | 187 ms | 211 ms: 1.13x slower | +| tomli_loads | 2.88 sec | 3.28 sec: 1.14x slower | +| sqlglot_optimize | 76.0 ms | 87.5 ms: 1.15x slower | +| scimark_sparse_mat_mult | 6.70 ms | 7.76 ms: 1.16x slower | +| coroutines | 29.5 ms | 34.4 ms: 1.17x slower | +| richards_super | 72.8 ms | 86.2 ms: 1.18x slower | +| telco | 9.59 ms | 11.4 ms: 1.19x slower | +| crypto_pyaes | 107 ms | 128 ms: 1.20x slower | +| comprehensions | 27.1 us | 32.4 us: 1.20x slower | +| meteor_contest | 146 ms | 175 ms: 1.20x slower | +| gc_traversal | 5.86 ms | 7.02 ms: 1.20x slower | +| logging_simple | 9.45 us | 11.4 us: 1.20x slower | +| typing_runtime_protocols | 224 us | 271 us: 1.21x slower | +| float | 123 ms | 149 ms: 1.21x slower | +| fannkuch | 540 ms | 655 ms: 1.21x slower | +| sqlalchemy_declarative | 218 ms | 264 ms: 1.21x slower | +| pyflate | 727 ms | 885 ms: 1.22x slower | +| xml_etree_process | 83.7 ms | 103 ms: 1.23x slower | +| logging_format | 9.59 us | 11.8 us: 1.23x slower | +| json_dumps | 14.3 ms | 17.6 ms: 1.23x slower | +| bpe_tokeniser | 6.59 sec | 8.15 sec: 1.24x slower | +| thrift | 1.06 ms | 1.32 ms: 1.25x slower | +| generators | 41.1 ms | 51.3 ms: 1.25x slower | +| pprint_safe_repr | 967 ms | 1.25 sec: 1.29x slower | +| genshi_xml | 67.6 ms | 87.4 ms: 1.29x slower | +| pprint_pformat | 1.98 sec | 2.57 sec: 1.30x slower | +| python_startup | 23.7 ms | 31.0 ms: 1.31x slower | +| sympy_integrate | 29.8 ms | 39.2 ms: 1.32x slower | +| 2to3 | 456 ms | 604 ms: 1.32x slower | +| richards | 60.3 ms | 80.8 ms: 1.34x slower | +| genshi_text | 30.2 ms | 40.5 ms: 1.34x slower | +| django_template | 44.9 ms | 60.6 ms: 1.35x slower | +| scimark_lu | 152 ms | 208 ms: 1.37x slower | +| html5lib | 88.9 ms | 123 ms: 1.39x slower | +| unpickle_pure_python | 300 us | 421 us: 1.41x slower | +| pickle_pure_python | 436 us | 619 us: 1.42x slower | +| sqlalchemy_imperative | 24.7 ms | 35.3 ms: 1.43x slower | +| coverage | 95.4 ms | 137 ms: 1.44x slower | +| scimark_monte_carlo | 96.4 ms | 141 ms: 1.46x slower | +| chaos | 84.9 ms | 127 ms: 1.49x slower | +| sympy_str | 385 ms | 578 ms: 1.50x slower | +| sqlglot_transpile | 2.34 ms | 3.52 ms: 1.51x slower | +| nbody | 119 ms | 180 ms: 1.51x slower | +| hexiom | 8.27 ms | 12.5 ms: 1.51x slower | +| raytrace | 408 ms | 624 ms: 1.53x slower | +| scimark_sor | 167 ms | 261 ms: 1.57x slower | +| go | 172 ms | 279 ms: 1.62x slower | +| logging_silent | 139 ns | 227 ns: 1.63x slower | +| sqlglot_parse | 1.79 ms | 3.02 ms: 1.69x slower | +| mako | 15.7 ms | 26.7 ms: 1.70x slower | +| create_gc_cycles | 1.94 ms | 3.30 ms: 1.70x slower | +| sympy_sum | 222 ms | 412 ms: 1.86x slower | +| sympy_expand | 582 ms | 1.10 sec: 1.89x slower | +| deltablue | 4.27 ms | 10.6 ms: 2.49x slower | +| bench_mp_pool | 20.7 ms | 99.4 ms: 4.80x slower | +| Geometric mean | (ref) | 1.18x slower | + +Benchmark hidden because not significant (9): pathlib, pycparser, json_loads, bench_thread_pool, spectral_norm, deepcopy_reduce, json, regex_v8, asyncio_websockets +Ignored benchmarks (15) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (6) of results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers + +- Geometric mean (including insignificant results): 1.137x slower + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.13x +- 95% likely to have a slowdown of 1.11x +- 99% likely to have a slowdown of 1.09x + +# Memory +- memory change: 1.34x \ No newline at end of file diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.svg b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.svg new file mode 100644 index 00000000..ce6b3ccf --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.svg @@ -0,0 +1,3069 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.md b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.md new file mode 100644 index 00000000..fa55df93 --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.md @@ -0,0 +1,202 @@ +# Results vs. 3.13.0rc2 + +- fork: python +- ref: 9d3a8f494985e8bbef69 +- machine: linux-x86_64 +- commit hash: 9d3a8f4 +- commit date: 2024-12-22 +- overall geometric mean: 1.167x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.12x slower +- Memory change: 1.33x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 445 ms | 604 ms: 1.36x slower | +| docutils | 4.01 sec | 4.26 sec: 1.06x slower | +| html5lib | 92.6 ms | 123 ms: 1.33x slower | +| Geometric mean | (ref) | 1.24x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.40 sec | 967 ms: 1.45x faster | +| async_tree_io | 1.39 sec | 1.07 sec: 1.29x faster | +| async_tree_memoization_tg | 670 ms | 558 ms: 1.20x faster | +| async_tree_none_tg | 504 ms | 421 ms: 1.20x faster | +| async_tree_none | 572 ms | 489 ms: 1.17x faster | +| async_tree_memoization | 709 ms | 617 ms: 1.15x faster | +| async_tree_cpu_io_mixed_tg | 852 ms | 763 ms: 1.12x faster | +| async_tree_cpu_io_mixed | 889 ms | 827 ms: 1.07x faster | +| async_generators | 567 ms | 614 ms: 1.08x slower | +| coroutines | 30.9 ms | 34.4 ms: 1.12x slower | +| Geometric mean | (ref) | 1.12x faster | + +Benchmark hidden because not significant (1): asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 251 ms | 233 ms: 1.08x faster | +| float | 116 ms | 149 ms: 1.29x slower | +| nbody | 119 ms | 180 ms: 1.51x slower | +| Geometric mean | (ref) | 1.22x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_dna | 282 ms | 293 ms: 1.04x slower | +| regex_compile | 182 ms | 211 ms: 1.16x slower | +| Geometric mean | (ref) | 1.05x slower | + +Benchmark hidden because not significant (2): regex_effbot, regex_v8 + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_iterparse | 177 ms | 137 ms: 1.29x faster | +| xml_etree_parse | 231 ms | 200 ms: 1.15x faster | +| json_loads | 34.3 us | 37.7 us: 1.10x slower | +| xml_etree_generate | 122 ms | 136 ms: 1.11x slower | +| tomli_loads | 2.78 sec | 3.28 sec: 1.18x slower | +| xml_etree_process | 85.9 ms | 103 ms: 1.19x slower | +| json_dumps | 14.1 ms | 17.6 ms: 1.25x slower | +| unpickle_pure_python | 290 us | 421 us: 1.45x slower | +| pickle_pure_python | 416 us | 619 us: 1.49x slower | +| Geometric mean | (ref) | 1.13x slower | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 15.3 ms | 19.4 ms: 1.26x slower | +| python_startup | 22.4 ms | 31.0 ms: 1.39x slower | +| Geometric mean | (ref) | 1.32x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|-----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 72.1 ms | 87.4 ms: 1.21x slower | +| genshi_text | 31.7 ms | 40.5 ms: 1.28x slower | +| django_template | 44.3 ms | 60.6 ms: 1.37x slower | +| mako | 15.9 ms | 26.7 ms: 1.68x slower | +| Geometric mean | (ref) | 1.37x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.40 sec | 967 ms: 1.45x faster | +| async_tree_io | 1.39 sec | 1.07 sec: 1.29x faster | +| xml_etree_iterparse | 177 ms | 137 ms: 1.29x faster | +| async_tree_memoization_tg | 670 ms | 558 ms: 1.20x faster | +| async_tree_none_tg | 504 ms | 421 ms: 1.20x faster | +| deepcopy | 498 us | 420 us: 1.18x faster | +| async_tree_none | 572 ms | 489 ms: 1.17x faster | +| xml_etree_parse | 231 ms | 200 ms: 1.15x faster | +| async_tree_memoization | 709 ms | 617 ms: 1.15x faster | +| async_tree_cpu_io_mixed_tg | 852 ms | 763 ms: 1.12x faster | +| pidigits | 251 ms | 233 ms: 1.08x faster | +| async_tree_cpu_io_mixed | 889 ms | 827 ms: 1.07x faster | +| sqlite_synth | 3.99 us | 3.72 us: 1.07x faster | +| telco | 12.2 ms | 11.4 ms: 1.07x faster | +| regex_dna | 282 ms | 293 ms: 1.04x slower | +| json | 6.51 ms | 6.92 ms: 1.06x slower | +| docutils | 4.01 sec | 4.26 sec: 1.06x slower | +| async_generators | 567 ms | 614 ms: 1.08x slower | +| deepcopy_memo | 50.1 us | 54.8 us: 1.09x slower | +| pylint | 470 ms | 516 ms: 1.10x slower | +| json_loads | 34.3 us | 37.7 us: 1.10x slower | +| xml_etree_generate | 122 ms | 136 ms: 1.11x slower | +| pycparser | 1.57 sec | 1.75 sec: 1.11x slower | +| coroutines | 30.9 ms | 34.4 ms: 1.12x slower | +| nqueens | 112 ms | 127 ms: 1.14x slower | +| scimark_fft | 473 ms | 543 ms: 1.15x slower | +| scimark_sparse_mat_mult | 6.76 ms | 7.76 ms: 1.15x slower | +| regex_compile | 182 ms | 211 ms: 1.16x slower | +| mdp | 3.80 sec | 4.42 sec: 1.16x slower | +| meteor_contest | 150 ms | 175 ms: 1.17x slower | +| sqlglot_optimize | 74.7 ms | 87.5 ms: 1.17x slower | +| richards_super | 73.2 ms | 86.2 ms: 1.18x slower | +| tomli_loads | 2.78 sec | 3.28 sec: 1.18x slower | +| xml_etree_process | 85.9 ms | 103 ms: 1.19x slower | +| sqlglot_normalize | 140 ms | 167 ms: 1.20x slower | +| dulwich_log | 93.7 ms | 112 ms: 1.20x slower | +| fannkuch | 547 ms | 655 ms: 1.20x slower | +| thrift | 1.10 ms | 1.32 ms: 1.20x slower | +| typing_runtime_protocols | 226 us | 271 us: 1.20x slower | +| bench_thread_pool | 2.89 ms | 3.49 ms: 1.21x slower | +| genshi_xml | 72.1 ms | 87.4 ms: 1.21x slower | +| gc_traversal | 5.70 ms | 7.02 ms: 1.23x slower | +| richards | 65.5 ms | 80.8 ms: 1.23x slower | +| json_dumps | 14.1 ms | 17.6 ms: 1.25x slower | +| python_startup_no_site | 15.3 ms | 19.4 ms: 1.26x slower | +| pprint_safe_repr | 987 ms | 1.25 sec: 1.27x slower | +| logging_format | 9.24 us | 11.8 us: 1.27x slower | +| coverage | 107 ms | 137 ms: 1.28x slower | +| genshi_text | 31.7 ms | 40.5 ms: 1.28x slower | +| crypto_pyaes | 100 ms | 128 ms: 1.28x slower | +| generators | 40.0 ms | 51.3 ms: 1.28x slower | +| float | 116 ms | 149 ms: 1.29x slower | +| sympy_integrate | 30.2 ms | 39.2 ms: 1.30x slower | +| bpe_tokeniser | 6.28 sec | 8.15 sec: 1.30x slower | +| pprint_pformat | 1.94 sec | 2.57 sec: 1.32x slower | +| logging_simple | 8.56 us | 11.4 us: 1.33x slower | +| html5lib | 92.6 ms | 123 ms: 1.33x slower | +| pyflate | 664 ms | 885 ms: 1.33x slower | +| 2to3 | 445 ms | 604 ms: 1.36x slower | +| create_gc_cycles | 2.41 ms | 3.30 ms: 1.37x slower | +| django_template | 44.3 ms | 60.6 ms: 1.37x slower | +| python_startup | 22.4 ms | 31.0 ms: 1.39x slower | +| scimark_lu | 146 ms | 208 ms: 1.42x slower | +| unpickle_pure_python | 290 us | 421 us: 1.45x slower | +| comprehensions | 22.2 us | 32.4 us: 1.46x slower | +| go | 191 ms | 279 ms: 1.46x slower | +| scimark_sor | 179 ms | 261 ms: 1.46x slower | +| pickle_pure_python | 416 us | 619 us: 1.49x slower | +| nbody | 119 ms | 180 ms: 1.51x slower | +| chaos | 83.6 ms | 127 ms: 1.52x slower | +| sympy_str | 379 ms | 578 ms: 1.52x slower | +| hexiom | 8.11 ms | 12.5 ms: 1.54x slower | +| scimark_monte_carlo | 90.6 ms | 141 ms: 1.55x slower | +| sqlglot_transpile | 2.20 ms | 3.52 ms: 1.60x slower | +| mako | 15.9 ms | 26.7 ms: 1.68x slower | +| sqlglot_parse | 1.76 ms | 3.02 ms: 1.72x slower | +| logging_silent | 130 ns | 227 ns: 1.75x slower | +| raytrace | 344 ms | 624 ms: 1.81x slower | +| sympy_expand | 601 ms | 1.10 sec: 1.84x slower | +| sympy_sum | 210 ms | 412 ms: 1.96x slower | +| deltablue | 4.44 ms | 10.6 ms: 2.40x slower | +| bench_mp_pool | 18.7 ms | 99.4 ms: 5.32x slower | +| Geometric mean | (ref) | 1.22x slower | + +Benchmark hidden because not significant (6): regex_effbot, deepcopy_reduce, spectral_norm, asyncio_websockets, regex_v8, pathlib +Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (8) of results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers + +- Geometric mean (including insignificant results): 1.167x slower + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.16x +- 95% likely to have a slowdown of 1.15x +- 99% likely to have a slowdown of 1.12x + +# Memory +- memory change: 1.33x \ No newline at end of file diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.svg b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.svg new file mode 100644 index 00000000..ec6ce374 --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.svg @@ -0,0 +1,3022 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base-mem.svg b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base-mem.svg new file mode 100644 index 00000000..2c41cd43 --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base-mem.svg @@ -0,0 +1,3278 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base.md b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base.md new file mode 100644 index 00000000..f944e5a8 --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base.md @@ -0,0 +1,211 @@ +# Results vs. base + +- fork: python +- ref: 9d3a8f494985e8bbef69 +- machine: linux-x86_64 +- commit hash: 9d3a8f4 +- commit date: 2024-12-22 +- overall geometric mean: 1.196x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.17x slower +- Memory change: 1.18x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json | results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| 2to3 | 466 ms | 604 ms: 1.30x slower | +| docutils | 3.86 sec | 4.26 sec: 1.10x slower | +| html5lib | 84.6 ms | 123 ms: 1.46x slower | +| sphinx | 1.46 sec | 1.67 sec: 1.14x slower | +| Geometric mean | (ref) | 1.24x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json | results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json | +|----------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| async_tree_none_tg | 387 ms | 421 ms: 1.09x slower | +| async_tree_io_tg | 880 ms | 967 ms: 1.10x slower | +| async_tree_cpu_io_mixed_tg | 687 ms | 763 ms: 1.11x slower | +| coroutines | 31.0 ms | 34.4 ms: 1.11x slower | +| async_generators | 552 ms | 614 ms: 1.11x slower | +| async_tree_cpu_io_mixed | 728 ms | 827 ms: 1.14x slower | +| async_tree_io | 894 ms | 1.07 sec: 1.20x slower | +| async_tree_memoization | 514 ms | 617 ms: 1.20x slower | +| async_tree_memoization_tg | 456 ms | 558 ms: 1.22x slower | +| async_tree_none | 374 ms | 489 ms: 1.31x slower | +| Geometric mean | (ref) | 1.14x slower | + +Benchmark hidden because not significant (1): asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json | results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| pidigits | 240 ms | 233 ms: 1.03x faster | +| float | 117 ms | 149 ms: 1.27x slower | +| nbody | 119 ms | 180 ms: 1.51x slower | +| Geometric mean | (ref) | 1.23x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json | results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| regex_dna | 279 ms | 293 ms: 1.05x slower | +| regex_effbot | 4.43 ms | 4.67 ms: 1.05x slower | +| regex_v8 | 31.5 ms | 33.3 ms: 1.06x slower | +| regex_compile | 170 ms | 211 ms: 1.24x slower | +| Geometric mean | (ref) | 1.10x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json | results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json | +|----------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| xml_etree_iterparse | 159 ms | 137 ms: 1.16x faster | +| xml_etree_generate | 128 ms | 136 ms: 1.06x slower | +| json_loads | 33.8 us | 37.7 us: 1.12x slower | +| json_dumps | 15.4 ms | 17.6 ms: 1.15x slower | +| xml_etree_process | 84.5 ms | 103 ms: 1.21x slower | +| tomli_loads | 2.63 sec | 3.28 sec: 1.25x slower | +| unpickle_pure_python | 294 us | 421 us: 1.43x slower | +| pickle_pure_python | 424 us | 619 us: 1.46x slower | +| Geometric mean | (ref) | 1.15x slower | + +Benchmark hidden because not significant (1): xml_etree_parse + +Benchmarks with tag 'startup': +============================== + +| Benchmark | results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json | results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json | +|------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| python_startup | 28.2 ms | 31.0 ms: 1.10x slower | +| python_startup_no_site | 16.3 ms | 19.4 ms: 1.18x slower | +| Geometric mean | (ref) | 1.14x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json | results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json | +|-----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| genshi_xml | 70.2 ms | 87.4 ms: 1.25x slower | +| genshi_text | 30.6 ms | 40.5 ms: 1.32x slower | +| django_template | 43.4 ms | 60.6 ms: 1.40x slower | +| mako | 16.2 ms | 26.7 ms: 1.65x slower | +| Geometric mean | (ref) | 1.40x slower | + +All benchmarks: +=============== + +| Benchmark | results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json | results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json | +|----------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| create_gc_cycles | 4.88 ms | 3.30 ms: 1.48x faster | +| gc_traversal | 9.46 ms | 7.02 ms: 1.35x faster | +| xml_etree_iterparse | 159 ms | 137 ms: 1.16x faster | +| pidigits | 240 ms | 233 ms: 1.03x faster | +| k_core | 4.27 sec | 4.44 sec: 1.04x slower | +| json | 6.61 ms | 6.92 ms: 1.05x slower | +| regex_dna | 279 ms | 293 ms: 1.05x slower | +| regex_effbot | 4.43 ms | 4.67 ms: 1.05x slower | +| regex_v8 | 31.5 ms | 33.3 ms: 1.06x slower | +| xml_etree_generate | 128 ms | 136 ms: 1.06x slower | +| spectral_norm | 146 ms | 156 ms: 1.07x slower | +| async_tree_none_tg | 387 ms | 421 ms: 1.09x slower | +| connected_components | 850 ms | 923 ms: 1.09x slower | +| meteor_contest | 161 ms | 175 ms: 1.09x slower | +| deepcopy_reduce | 3.74 us | 4.07 us: 1.09x slower | +| async_tree_io_tg | 880 ms | 967 ms: 1.10x slower | +| pathlib | 27.7 ms | 30.5 ms: 1.10x slower | +| python_startup | 28.2 ms | 31.0 ms: 1.10x slower | +| shortest_path | 937 ms | 1.03 sec: 1.10x slower | +| docutils | 3.86 sec | 4.26 sec: 1.10x slower | +| pycparser | 1.58 sec | 1.75 sec: 1.11x slower | +| async_tree_cpu_io_mixed_tg | 687 ms | 763 ms: 1.11x slower | +| coroutines | 31.0 ms | 34.4 ms: 1.11x slower | +| async_generators | 552 ms | 614 ms: 1.11x slower | +| json_loads | 33.8 us | 37.7 us: 1.12x slower | +| scimark_fft | 485 ms | 543 ms: 1.12x slower | +| dulwich_log | 99.1 ms | 112 ms: 1.13x slower | +| async_tree_cpu_io_mixed | 728 ms | 827 ms: 1.14x slower | +| scimark_sparse_mat_mult | 6.80 ms | 7.76 ms: 1.14x slower | +| telco | 10.0 ms | 11.4 ms: 1.14x slower | +| sphinx | 1.46 sec | 1.67 sec: 1.14x slower | +| json_dumps | 15.4 ms | 17.6 ms: 1.15x slower | +| nqueens | 108 ms | 127 ms: 1.18x slower | +| logging_format | 9.94 us | 11.8 us: 1.18x slower | +| python_startup_no_site | 16.3 ms | 19.4 ms: 1.18x slower | +| async_tree_io | 894 ms | 1.07 sec: 1.20x slower | +| async_tree_memoization | 514 ms | 617 ms: 1.20x slower | +| mdp | 3.68 sec | 4.42 sec: 1.20x slower | +| xml_etree_process | 84.5 ms | 103 ms: 1.21x slower | +| sqlglot_optimize | 71.8 ms | 87.5 ms: 1.22x slower | +| async_tree_memoization_tg | 456 ms | 558 ms: 1.22x slower | +| generators | 41.8 ms | 51.3 ms: 1.23x slower | +| typing_runtime_protocols | 220 us | 271 us: 1.23x slower | +| regex_compile | 170 ms | 211 ms: 1.24x slower | +| sqlglot_normalize | 135 ms | 167 ms: 1.24x slower | +| tomli_loads | 2.63 sec | 3.28 sec: 1.25x slower | +| genshi_xml | 70.2 ms | 87.4 ms: 1.25x slower | +| thrift | 1.06 ms | 1.32 ms: 1.25x slower | +| subparsers | 33.1 ms | 41.5 ms: 1.25x slower | +| pylint | 410 ms | 516 ms: 1.26x slower | +| scimark_lu | 165 ms | 208 ms: 1.26x slower | +| float | 117 ms | 149 ms: 1.27x slower | +| fannkuch | 516 ms | 655 ms: 1.27x slower | +| coverage | 108 ms | 137 ms: 1.27x slower | +| many_optionals | 1.14 ms | 1.46 ms: 1.28x slower | +| logging_simple | 8.87 us | 11.4 us: 1.28x slower | +| pyflate | 690 ms | 885 ms: 1.28x slower | +| 2to3 | 466 ms | 604 ms: 1.30x slower | +| pprint_safe_repr | 964 ms | 1.25 sec: 1.30x slower | +| pprint_pformat | 1.97 sec | 2.57 sec: 1.31x slower | +| async_tree_none | 374 ms | 489 ms: 1.31x slower | +| sympy_integrate | 29.8 ms | 39.2 ms: 1.32x slower | +| bpe_tokeniser | 6.18 sec | 8.15 sec: 1.32x slower | +| crypto_pyaes | 96.9 ms | 128 ms: 1.32x slower | +| genshi_text | 30.6 ms | 40.5 ms: 1.32x slower | +| deepcopy | 317 us | 420 us: 1.32x slower | +| richards_super | 64.7 ms | 86.2 ms: 1.33x slower | +| deepcopy_memo | 40.6 us | 54.8 us: 1.35x slower | +| comprehensions | 23.6 us | 32.4 us: 1.37x slower | +| richards | 57.9 ms | 80.8 ms: 1.39x slower | +| django_template | 43.4 ms | 60.6 ms: 1.40x slower | +| chaos | 90.3 ms | 127 ms: 1.40x slower | +| unpickle_pure_python | 294 us | 421 us: 1.43x slower | +| pickle_pure_python | 424 us | 619 us: 1.46x slower | +| html5lib | 84.6 ms | 123 ms: 1.46x slower | +| sqlalchemy_imperative | 23.7 ms | 35.3 ms: 1.49x slower | +| sqlglot_transpile | 2.36 ms | 3.52 ms: 1.49x slower | +| scimark_monte_carlo | 93.7 ms | 141 ms: 1.50x slower | +| nbody | 119 ms | 180 ms: 1.51x slower | +| hexiom | 8.18 ms | 12.5 ms: 1.53x slower | +| logging_silent | 146 ns | 227 ns: 1.56x slower | +| scimark_sor | 167 ms | 261 ms: 1.56x slower | +| sympy_str | 369 ms | 578 ms: 1.57x slower | +| sqlalchemy_declarative | 168 ms | 264 ms: 1.57x slower | +| mako | 16.2 ms | 26.7 ms: 1.65x slower | +| go | 168 ms | 279 ms: 1.66x slower | +| sympy_expand | 626 ms | 1.10 sec: 1.76x slower | +| raytrace | 353 ms | 624 ms: 1.77x slower | +| sqlglot_parse | 1.68 ms | 3.02 ms: 1.80x slower | +| sympy_sum | 209 ms | 412 ms: 1.97x slower | +| deltablue | 4.38 ms | 10.6 ms: 2.43x slower | +| Geometric mean | (ref) | 1.24x slower | + +Benchmark hidden because not significant (5): bench_thread_pool, sqlite_synth, xml_etree_parse, asyncio_websockets, bench_mp_pool + +- Geometric mean (including insignificant results): 1.196x slower + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.20x +- 95% likely to have a slowdown of 1.19x +- 99% likely to have a slowdown of 1.17x + +# Memory +- memory change: 1.18x \ No newline at end of file diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base.svg b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base.svg new file mode 100644 index 00000000..4c297ac3 --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base.svg @@ -0,0 +1,3292 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.md b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.md new file mode 100644 index 00000000..ebb7ce2a --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.md @@ -0,0 +1,208 @@ +# Results vs. 3.12.6 + +- fork: python +- ref: 9d3a8f494985e8bbef69 +- machine: linux-x86_64 +- commit hash: 9d3a8f4 +- commit date: 2024-12-22 +- overall geometric mean: 1.188x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.14x slower +- Memory change: 1.34x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 264 ms | 361 ms: 1.37x slower | +| docutils | 2.64 sec | 3.02 sec: 1.15x slower | +| html5lib | 63.6 ms | 94.0 ms: 1.48x slower | +| Geometric mean | (ref) | 1.32x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.11 sec | 737 ms: 1.51x faster | +| async_tree_io | 1.08 sec | 760 ms: 1.42x faster | +| async_tree_none_tg | 446 ms | 315 ms: 1.42x faster | +| async_tree_memoization_tg | 560 ms | 401 ms: 1.40x faster | +| async_tree_none | 464 ms | 349 ms: 1.33x faster | +| async_tree_memoization | 555 ms | 430 ms: 1.29x faster | +| async_tree_cpu_io_mixed_tg | 723 ms | 570 ms: 1.27x faster | +| async_tree_cpu_io_mixed | 715 ms | 598 ms: 1.20x faster | +| asyncio_websockets | 517 ms | 522 ms: 1.01x slower | +| coroutines | 23.9 ms | 24.4 ms: 1.02x slower | +| async_generators | 384 ms | 446 ms: 1.16x slower | +| Geometric mean | (ref) | 1.22x faster | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 184 ms | 184 ms: 1.00x faster | +| float | 80.8 ms | 113 ms: 1.40x slower | +| nbody | 89.3 ms | 126 ms: 1.41x slower | +| Geometric mean | (ref) | 1.25x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 3.17 ms | 2.89 ms: 1.10x faster | +| regex_dna | 168 ms | 182 ms: 1.09x slower | +| regex_compile | 142 ms | 170 ms: 1.19x slower | +| regex_v8 | 20.6 ms | 25.0 ms: 1.21x slower | +| Geometric mean | (ref) | 1.09x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_iterparse | 96.7 ms | 90.2 ms: 1.07x faster | +| xml_etree_parse | 139 ms | 130 ms: 1.07x faster | +| json_loads | 26.5 us | 28.1 us: 1.06x slower | +| xml_etree_generate | 85.2 ms | 97.8 ms: 1.15x slower | +| tomli_loads | 2.11 sec | 2.48 sec: 1.18x slower | +| xml_etree_process | 59.0 ms | 74.1 ms: 1.26x slower | +| json_dumps | 10.4 ms | 14.1 ms: 1.36x slower | +| unpickle_pure_python | 221 us | 326 us: 1.48x slower | +| pickle_pure_python | 308 us | 499 us: 1.62x slower | +| Geometric mean | (ref) | 1.20x slower | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 7.16 ms | 10.2 ms: 1.43x slower | +| python_startup | 9.93 ms | 17.2 ms: 1.74x slower | +| Geometric mean | (ref) | 1.58x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|-----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 50.2 ms | 62.7 ms: 1.25x slower | +| genshi_text | 22.8 ms | 30.5 ms: 1.34x slower | +| django_template | 34.7 ms | 50.4 ms: 1.45x slower | +| mako | 11.0 ms | 17.1 ms: 1.55x slower | +| Geometric mean | (ref) | 1.39x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.11 sec | 737 ms: 1.51x faster | +| async_tree_io | 1.08 sec | 760 ms: 1.42x faster | +| async_tree_none_tg | 446 ms | 315 ms: 1.42x faster | +| async_tree_memoization_tg | 560 ms | 401 ms: 1.40x faster | +| async_tree_none | 464 ms | 349 ms: 1.33x faster | +| async_tree_memoization | 555 ms | 430 ms: 1.29x faster | +| async_tree_cpu_io_mixed_tg | 723 ms | 570 ms: 1.27x faster | +| async_tree_cpu_io_mixed | 715 ms | 598 ms: 1.20x faster | +| regex_effbot | 3.17 ms | 2.89 ms: 1.10x faster | +| pathlib | 21.5 ms | 19.7 ms: 1.09x faster | +| deepcopy | 352 us | 324 us: 1.09x faster | +| xml_etree_iterparse | 96.7 ms | 90.2 ms: 1.07x faster | +| xml_etree_parse | 139 ms | 130 ms: 1.07x faster | +| sqlite_synth | 2.20 us | 2.11 us: 1.04x faster | +| pidigits | 184 ms | 184 ms: 1.00x faster | +| deepcopy_memo | 40.3 us | 40.6 us: 1.01x slower | +| asyncio_websockets | 517 ms | 522 ms: 1.01x slower | +| gc_traversal | 3.46 ms | 3.51 ms: 1.02x slower | +| coroutines | 23.9 ms | 24.4 ms: 1.02x slower | +| spectral_norm | 110 ms | 114 ms: 1.04x slower | +| bpe_tokeniser | 4.74 sec | 5.02 sec: 1.06x slower | +| json_loads | 26.5 us | 28.1 us: 1.06x slower | +| regex_dna | 168 ms | 182 ms: 1.09x slower | +| mdp | 2.42 sec | 2.68 sec: 1.11x slower | +| deepcopy_reduce | 3.08 us | 3.41 us: 1.11x slower | +| scimark_fft | 342 ms | 378 ms: 1.11x slower | +| pylint | 319 ms | 363 ms: 1.14x slower | +| docutils | 2.64 sec | 3.02 sec: 1.15x slower | +| xml_etree_generate | 85.2 ms | 97.8 ms: 1.15x slower | +| dulwich_log | 78.9 ms | 90.5 ms: 1.15x slower | +| async_generators | 384 ms | 446 ms: 1.16x slower | +| crypto_pyaes | 76.6 ms | 89.9 ms: 1.17x slower | +| tomli_loads | 2.11 sec | 2.48 sec: 1.18x slower | +| generators | 32.2 ms | 38.3 ms: 1.19x slower | +| pycparser | 1.17 sec | 1.39 sec: 1.19x slower | +| regex_compile | 142 ms | 170 ms: 1.19x slower | +| regex_v8 | 20.6 ms | 25.0 ms: 1.21x slower | +| nqueens | 80.1 ms | 98.1 ms: 1.23x slower | +| scimark_sparse_mat_mult | 4.39 ms | 5.39 ms: 1.23x slower | +| thrift | 791 us | 977 us: 1.23x slower | +| sqlglot_optimize | 53.3 ms | 66.0 ms: 1.24x slower | +| sqlglot_normalize | 107 ms | 133 ms: 1.25x slower | +| genshi_xml | 50.2 ms | 62.7 ms: 1.25x slower | +| xml_etree_process | 59.0 ms | 74.1 ms: 1.26x slower | +| typing_runtime_protocols | 163 us | 206 us: 1.26x slower | +| meteor_contest | 104 ms | 132 ms: 1.27x slower | +| pprint_safe_repr | 743 ms | 946 ms: 1.27x slower | +| sqlalchemy_imperative | 21.8 ms | 28.0 ms: 1.29x slower | +| pprint_pformat | 1.52 sec | 1.97 sec: 1.29x slower | +| telco | 6.53 ms | 8.59 ms: 1.32x slower | +| fannkuch | 372 ms | 491 ms: 1.32x slower | +| genshi_text | 22.8 ms | 30.5 ms: 1.34x slower | +| json_dumps | 10.4 ms | 14.1 ms: 1.36x slower | +| comprehensions | 19.8 us | 27.1 us: 1.37x slower | +| 2to3 | 264 ms | 361 ms: 1.37x slower | +| sqlalchemy_declarative | 143 ms | 196 ms: 1.37x slower | +| scimark_lu | 114 ms | 157 ms: 1.37x slower | +| logging_simple | 6.63 us | 9.18 us: 1.38x slower | +| logging_format | 7.35 us | 10.3 us: 1.40x slower | +| coverage | 71.4 ms | 99.9 ms: 1.40x slower | +| float | 80.8 ms | 113 ms: 1.40x slower | +| nbody | 89.3 ms | 126 ms: 1.41x slower | +| python_startup_no_site | 7.16 ms | 10.2 ms: 1.43x slower | +| sympy_integrate | 20.5 ms | 29.6 ms: 1.44x slower | +| django_template | 34.7 ms | 50.4 ms: 1.45x slower | +| pyflate | 448 ms | 660 ms: 1.47x slower | +| html5lib | 63.6 ms | 94.0 ms: 1.48x slower | +| unpickle_pure_python | 221 us | 326 us: 1.48x slower | +| richards_super | 51.9 ms | 77.2 ms: 1.49x slower | +| richards | 45.9 ms | 68.8 ms: 1.50x slower | +| chaos | 62.8 ms | 95.1 ms: 1.51x slower | +| mako | 11.0 ms | 17.1 ms: 1.55x slower | +| hexiom | 6.17 ms | 9.62 ms: 1.56x slower | +| scimark_monte_carlo | 68.4 ms | 107 ms: 1.56x slower | +| pickle_pure_python | 308 us | 499 us: 1.62x slower | +| sqlglot_transpile | 1.67 ms | 2.73 ms: 1.64x slower | +| sympy_str | 292 ms | 477 ms: 1.64x slower | +| raytrace | 299 ms | 499 ms: 1.67x slower | +| create_gc_cycles | 1.09 ms | 1.84 ms: 1.68x slower | +| scimark_sor | 130 ms | 218 ms: 1.68x slower | +| logging_silent | 109 ns | 184 ns: 1.69x slower | +| python_startup | 9.93 ms | 17.2 ms: 1.74x slower | +| sqlglot_parse | 1.36 ms | 2.35 ms: 1.74x slower | +| go | 139 ms | 243 ms: 1.75x slower | +| sympy_expand | 468 ms | 952 ms: 2.04x slower | +| sympy_sum | 166 ms | 350 ms: 2.11x slower | +| deltablue | 3.45 ms | 7.66 ms: 2.22x slower | +| bench_thread_pool | 941 us | 3.39 ms: 3.60x slower | +| bench_mp_pool | 10.8 ms | 108 ms: 10.05x slower | +| Geometric mean | (ref) | 1.28x slower | + +Benchmark hidden because not significant (1): json +Ignored benchmarks (15) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (6) of results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers + +- Geometric mean (including insignificant results): 1.188x slower + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.17x +- 95% likely to have a slowdown of 1.16x +- 99% likely to have a slowdown of 1.14x + +# Memory +- memory change: 1.34x \ No newline at end of file diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.svg b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.svg new file mode 100644 index 00000000..a2533332 --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.svg @@ -0,0 +1,3067 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.md b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.md new file mode 100644 index 00000000..64b80d1b --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.md @@ -0,0 +1,207 @@ +# Results vs. 3.13.0rc2 + +- fork: python +- ref: 9d3a8f494985e8bbef69 +- machine: linux-x86_64 +- commit hash: 9d3a8f4 +- commit date: 2024-12-22 +- overall geometric mean: 1.214x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.14x slower +- Memory change: 1.33x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 260 ms | 361 ms: 1.39x slower | +| docutils | 2.62 sec | 3.02 sec: 1.16x slower | +| html5lib | 67.0 ms | 94.0 ms: 1.40x slower | +| Geometric mean | (ref) | 1.31x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 913 ms | 737 ms: 1.24x faster | +| async_tree_io | 876 ms | 760 ms: 1.15x faster | +| async_tree_cpu_io_mixed_tg | 638 ms | 570 ms: 1.12x faster | +| async_tree_cpu_io_mixed | 666 ms | 598 ms: 1.11x faster | +| async_tree_memoization | 461 ms | 430 ms: 1.07x faster | +| async_tree_none_tg | 336 ms | 315 ms: 1.07x faster | +| async_tree_memoization_tg | 414 ms | 401 ms: 1.03x faster | +| async_tree_none | 354 ms | 349 ms: 1.01x faster | +| coroutines | 23.6 ms | 24.4 ms: 1.03x slower | +| async_generators | 377 ms | 446 ms: 1.18x slower | +| Geometric mean | (ref) | 1.05x faster | + +Benchmark hidden because not significant (1): asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 217 ms | 184 ms: 1.18x faster | +| float | 77.5 ms | 113 ms: 1.46x slower | +| nbody | 85.1 ms | 126 ms: 1.48x slower | +| Geometric mean | (ref) | 1.22x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 3.08 ms | 2.89 ms: 1.07x faster | +| regex_dna | 180 ms | 182 ms: 1.01x slower | +| regex_v8 | 22.7 ms | 25.0 ms: 1.10x slower | +| regex_compile | 132 ms | 170 ms: 1.28x slower | +| Geometric mean | (ref) | 1.08x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_iterparse | 94.9 ms | 90.2 ms: 1.05x faster | +| xml_etree_parse | 136 ms | 130 ms: 1.05x faster | +| json_loads | 27.0 us | 28.1 us: 1.04x slower | +| xml_etree_generate | 85.4 ms | 97.8 ms: 1.14x slower | +| tomli_loads | 2.01 sec | 2.48 sec: 1.24x slower | +| xml_etree_process | 59.3 ms | 74.1 ms: 1.25x slower | +| json_dumps | 10.5 ms | 14.1 ms: 1.34x slower | +| unpickle_pure_python | 210 us | 326 us: 1.55x slower | +| pickle_pure_python | 294 us | 499 us: 1.69x slower | +| Geometric mean | (ref) | 1.22x slower | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 7.39 ms | 10.2 ms: 1.39x slower | +| python_startup | 11.0 ms | 17.2 ms: 1.57x slower | +| Geometric mean | (ref) | 1.47x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|-----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 48.8 ms | 62.7 ms: 1.29x slower | +| genshi_text | 21.5 ms | 30.5 ms: 1.41x slower | +| django_template | 34.1 ms | 50.4 ms: 1.48x slower | +| mako | 11.3 ms | 17.1 ms: 1.50x slower | +| Geometric mean | (ref) | 1.42x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 913 ms | 737 ms: 1.24x faster | +| pidigits | 217 ms | 184 ms: 1.18x faster | +| async_tree_io | 876 ms | 760 ms: 1.15x faster | +| async_tree_cpu_io_mixed_tg | 638 ms | 570 ms: 1.12x faster | +| async_tree_cpu_io_mixed | 666 ms | 598 ms: 1.11x faster | +| deepcopy | 355 us | 324 us: 1.10x faster | +| async_tree_memoization | 461 ms | 430 ms: 1.07x faster | +| async_tree_none_tg | 336 ms | 315 ms: 1.07x faster | +| regex_effbot | 3.08 ms | 2.89 ms: 1.07x faster | +| xml_etree_iterparse | 94.9 ms | 90.2 ms: 1.05x faster | +| xml_etree_parse | 136 ms | 130 ms: 1.05x faster | +| sqlite_synth | 2.21 us | 2.11 us: 1.05x faster | +| async_tree_memoization_tg | 414 ms | 401 ms: 1.03x faster | +| async_tree_none | 354 ms | 349 ms: 1.01x faster | +| regex_dna | 180 ms | 182 ms: 1.01x slower | +| json | 4.93 ms | 5.00 ms: 1.02x slower | +| pathlib | 19.2 ms | 19.7 ms: 1.03x slower | +| spectral_norm | 111 ms | 114 ms: 1.03x slower | +| coroutines | 23.6 ms | 24.4 ms: 1.03x slower | +| deepcopy_memo | 39.1 us | 40.6 us: 1.04x slower | +| json_loads | 27.0 us | 28.1 us: 1.04x slower | +| scimark_fft | 349 ms | 378 ms: 1.08x slower | +| deepcopy_reduce | 3.11 us | 3.41 us: 1.09x slower | +| telco | 7.82 ms | 8.59 ms: 1.10x slower | +| regex_v8 | 22.7 ms | 25.0 ms: 1.10x slower | +| gc_traversal | 3.14 ms | 3.51 ms: 1.12x slower | +| bpe_tokeniser | 4.45 sec | 5.02 sec: 1.13x slower | +| mdp | 2.36 sec | 2.68 sec: 1.14x slower | +| scimark_sparse_mat_mult | 4.71 ms | 5.39 ms: 1.14x slower | +| xml_etree_generate | 85.4 ms | 97.8 ms: 1.14x slower | +| pylint | 317 ms | 363 ms: 1.15x slower | +| docutils | 2.62 sec | 3.02 sec: 1.16x slower | +| async_generators | 377 ms | 446 ms: 1.18x slower | +| coverage | 83.0 ms | 99.9 ms: 1.20x slower | +| dulwich_log | 74.8 ms | 90.5 ms: 1.21x slower | +| tomli_loads | 2.01 sec | 2.48 sec: 1.24x slower | +| pycparser | 1.12 sec | 1.39 sec: 1.24x slower | +| nqueens | 78.6 ms | 98.1 ms: 1.25x slower | +| xml_etree_process | 59.3 ms | 74.1 ms: 1.25x slower | +| sqlglot_optimize | 52.7 ms | 66.0 ms: 1.25x slower | +| thrift | 778 us | 977 us: 1.26x slower | +| sqlglot_normalize | 106 ms | 133 ms: 1.26x slower | +| pprint_safe_repr | 738 ms | 946 ms: 1.28x slower | +| regex_compile | 132 ms | 170 ms: 1.28x slower | +| genshi_xml | 48.8 ms | 62.7 ms: 1.29x slower | +| meteor_contest | 102 ms | 132 ms: 1.30x slower | +| pprint_pformat | 1.50 sec | 1.97 sec: 1.31x slower | +| crypto_pyaes | 67.9 ms | 89.9 ms: 1.32x slower | +| fannkuch | 370 ms | 491 ms: 1.33x slower | +| generators | 28.8 ms | 38.3 ms: 1.33x slower | +| typing_runtime_protocols | 155 us | 206 us: 1.33x slower | +| json_dumps | 10.5 ms | 14.1 ms: 1.34x slower | +| create_gc_cycles | 1.34 ms | 1.84 ms: 1.37x slower | +| python_startup_no_site | 7.39 ms | 10.2 ms: 1.39x slower | +| 2to3 | 260 ms | 361 ms: 1.39x slower | +| scimark_lu | 113 ms | 157 ms: 1.39x slower | +| html5lib | 67.0 ms | 94.0 ms: 1.40x slower | +| genshi_text | 21.5 ms | 30.5 ms: 1.41x slower | +| float | 77.5 ms | 113 ms: 1.46x slower | +| pyflate | 449 ms | 660 ms: 1.47x slower | +| django_template | 34.1 ms | 50.4 ms: 1.48x slower | +| nbody | 85.1 ms | 126 ms: 1.48x slower | +| logging_simple | 6.16 us | 9.18 us: 1.49x slower | +| sympy_integrate | 19.8 ms | 29.6 ms: 1.49x slower | +| richards_super | 51.6 ms | 77.2 ms: 1.50x slower | +| logging_format | 6.84 us | 10.3 us: 1.50x slower | +| mako | 11.3 ms | 17.1 ms: 1.50x slower | +| richards | 45.2 ms | 68.8 ms: 1.52x slower | +| unpickle_pure_python | 210 us | 326 us: 1.55x slower | +| python_startup | 11.0 ms | 17.2 ms: 1.57x slower | +| hexiom | 5.99 ms | 9.62 ms: 1.61x slower | +| scimark_sor | 134 ms | 218 ms: 1.62x slower | +| scimark_monte_carlo | 65.4 ms | 107 ms: 1.64x slower | +| comprehensions | 16.5 us | 27.1 us: 1.65x slower | +| chaos | 57.3 ms | 95.1 ms: 1.66x slower | +| pickle_pure_python | 294 us | 499 us: 1.69x slower | +| go | 141 ms | 243 ms: 1.73x slower | +| sympy_str | 275 ms | 477 ms: 1.74x slower | +| sqlglot_transpile | 1.56 ms | 2.73 ms: 1.75x slower | +| logging_silent | 103 ns | 184 ns: 1.79x slower | +| sqlglot_parse | 1.25 ms | 2.35 ms: 1.88x slower | +| raytrace | 253 ms | 499 ms: 1.97x slower | +| sympy_expand | 457 ms | 952 ms: 2.08x slower | +| sympy_sum | 156 ms | 350 ms: 2.25x slower | +| deltablue | 3.12 ms | 7.66 ms: 2.45x slower | +| bench_thread_pool | 919 us | 3.39 ms: 3.69x slower | +| bench_mp_pool | 11.0 ms | 108 ms: 9.87x slower | +| Geometric mean | (ref) | 1.32x slower | + +Benchmark hidden because not significant (1): asyncio_websockets +Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (8) of results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers + +- Geometric mean (including insignificant results): 1.214x slower + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.19x +- 95% likely to have a slowdown of 1.18x +- 99% likely to have a slowdown of 1.14x + +# Memory +- memory change: 1.33x \ No newline at end of file diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.svg b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.svg new file mode 100644 index 00000000..2754c39f --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.svg @@ -0,0 +1,2970 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base-mem.svg b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base-mem.svg new file mode 100644 index 00000000..64e2d5a7 --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base-mem.svg @@ -0,0 +1,3744 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base.md b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base.md new file mode 100644 index 00000000..bd47babb --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base.md @@ -0,0 +1,174 @@ +# Results vs. base + +- fork: python +- ref: 9d3a8f494985e8bbef69 +- machine: linux-x86_64 +- commit hash: 9d3a8f4 +- commit date: 2024-12-22 +- overall geometric mean: 1.000x slower +- HPT reliability: 96.37% +- HPT 99th percentile: 1.00x faster +- Memory change: 1.03x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20241222-vultr-x86_64-python-f420bdd29fbc1a97ad20-3.14.0a3+-f420bdd | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:----------------------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 360 ms | 361 ms: 1.00x slower | +| html5lib | 94.6 ms | 94.0 ms: 1.01x faster | +| Geometric mean | (ref) | 1.00x faster | + +Benchmark hidden because not significant (2): docutils, sphinx + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20241222-vultr-x86_64-python-f420bdd29fbc1a97ad20-3.14.0a3+-f420bdd | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|-------------------------|:----------------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_generators | 450 ms | 446 ms: 1.01x faster | +| coroutines | 24.4 ms | 24.4 ms: 1.00x faster | +| async_tree_io | 754 ms | 760 ms: 1.01x slower | +| async_tree_cpu_io_mixed | 593 ms | 598 ms: 1.01x slower | +| async_tree_memoization | 426 ms | 430 ms: 1.01x slower | +| Geometric mean | (ref) | 1.00x slower | + +Benchmark hidden because not significant (6): async_tree_none_tg, async_tree_none, async_tree_memoization_tg, asyncio_websockets, async_tree_cpu_io_mixed_tg, async_tree_io_tg + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20241222-vultr-x86_64-python-f420bdd29fbc1a97ad20-3.14.0a3+-f420bdd | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:----------------------------------------------------------------------:|:----------------------------------------------------------------------:| +| nbody | 128 ms | 126 ms: 1.02x faster | +| Geometric mean | (ref) | 1.01x faster | + +Benchmark hidden because not significant (2): pidigits, float + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20241222-vultr-x86_64-python-f420bdd29fbc1a97ad20-3.14.0a3+-f420bdd | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:----------------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_dna | 186 ms | 182 ms: 1.02x faster | +| regex_v8 | 24.7 ms | 25.0 ms: 1.01x slower | +| regex_effbot | 2.76 ms | 2.89 ms: 1.05x slower | +| Geometric mean | (ref) | 1.01x slower | + +Benchmark hidden because not significant (1): regex_compile + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20241222-vultr-x86_64-python-f420bdd29fbc1a97ad20-3.14.0a3+-f420bdd | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|--------------------|:----------------------------------------------------------------------:|:----------------------------------------------------------------------:| +| tomli_loads | 2.56 sec | 2.48 sec: 1.03x faster | +| pickle_pure_python | 503 us | 499 us: 1.01x faster | +| xml_etree_generate | 98.1 ms | 97.8 ms: 1.00x faster | +| xml_etree_process | 73.8 ms | 74.1 ms: 1.00x slower | +| Geometric mean | (ref) | 1.00x faster | + +Benchmark hidden because not significant (5): xml_etree_parse, xml_etree_iterparse, json_loads, unpickle_pure_python, json_dumps + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20241222-vultr-x86_64-python-f420bdd29fbc1a97ad20-3.14.0a3+-f420bdd | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|------------------------|:----------------------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 10.2 ms | 10.2 ms: 1.00x slower | +| python_startup | 17.2 ms | 17.2 ms: 1.00x slower | +| Geometric mean | (ref) | 1.00x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20241222-vultr-x86_64-python-f420bdd29fbc1a97ad20-3.14.0a3+-f420bdd | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|-----------------|:----------------------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 63.4 ms | 62.7 ms: 1.01x faster | +| mako | 16.9 ms | 17.1 ms: 1.01x slower | +| django_template | 49.9 ms | 50.4 ms: 1.01x slower | +| Geometric mean | (ref) | 1.00x slower | + +Benchmark hidden because not significant (1): genshi_text + +All benchmarks: +=============== + +| Benchmark | bm-20241222-vultr-x86_64-python-f420bdd29fbc1a97ad20-3.14.0a3+-f420bdd | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|-------------------------|:----------------------------------------------------------------------:|:----------------------------------------------------------------------:| +| tomli_loads | 2.56 sec | 2.48 sec: 1.03x faster | +| thrift | 999 us | 977 us: 1.02x faster | +| nbody | 128 ms | 126 ms: 1.02x faster | +| sqlite_synth | 2.15 us | 2.11 us: 1.02x faster | +| regex_dna | 186 ms | 182 ms: 1.02x faster | +| deepcopy_reduce | 3.47 us | 3.41 us: 1.02x faster | +| nqueens | 99.9 ms | 98.1 ms: 1.02x faster | +| pprint_safe_repr | 961 ms | 946 ms: 1.02x faster | +| deepcopy | 329 us | 324 us: 1.01x faster | +| telco | 8.72 ms | 8.59 ms: 1.01x faster | +| pprint_pformat | 1.99 sec | 1.97 sec: 1.01x faster | +| chaos | 96.4 ms | 95.1 ms: 1.01x faster | +| scimark_sparse_mat_mult | 5.45 ms | 5.39 ms: 1.01x faster | +| many_optionals | 1.25 ms | 1.23 ms: 1.01x faster | +| json | 5.06 ms | 5.00 ms: 1.01x faster | +| genshi_xml | 63.4 ms | 62.7 ms: 1.01x faster | +| scimark_lu | 158 ms | 157 ms: 1.01x faster | +| sympy_expand | 961 ms | 952 ms: 1.01x faster | +| async_generators | 450 ms | 446 ms: 1.01x faster | +| connected_components | 501 ms | 497 ms: 1.01x faster | +| deepcopy_memo | 41.0 us | 40.6 us: 1.01x faster | +| pickle_pure_python | 503 us | 499 us: 1.01x faster | +| dulwich_log | 91.2 ms | 90.5 ms: 1.01x faster | +| sympy_integrate | 29.8 ms | 29.6 ms: 1.01x faster | +| subparsers | 29.0 ms | 28.8 ms: 1.01x faster | +| pycparser | 1.40 sec | 1.39 sec: 1.01x faster | +| html5lib | 94.6 ms | 94.0 ms: 1.01x faster | +| scimark_fft | 381 ms | 378 ms: 1.01x faster | +| mdp | 2.69 sec | 2.68 sec: 1.01x faster | +| crypto_pyaes | 90.4 ms | 89.9 ms: 1.00x faster | +| sqlalchemy_declarative | 197 ms | 196 ms: 1.00x faster | +| xml_etree_generate | 98.1 ms | 97.8 ms: 1.00x faster | +| bpe_tokeniser | 5.03 sec | 5.02 sec: 1.00x faster | +| sympy_sum | 351 ms | 350 ms: 1.00x faster | +| coroutines | 24.4 ms | 24.4 ms: 1.00x faster | +| python_startup_no_site | 10.2 ms | 10.2 ms: 1.00x slower | +| python_startup | 17.2 ms | 17.2 ms: 1.00x slower | +| 2to3 | 360 ms | 361 ms: 1.00x slower | +| sqlglot_normalize | 133 ms | 133 ms: 1.00x slower | +| bench_mp_pool | 108 ms | 108 ms: 1.00x slower | +| xml_etree_process | 73.8 ms | 74.1 ms: 1.00x slower | +| sqlglot_parse | 2.34 ms | 2.35 ms: 1.01x slower | +| scimark_monte_carlo | 106 ms | 107 ms: 1.01x slower | +| async_tree_io | 754 ms | 760 ms: 1.01x slower | +| async_tree_cpu_io_mixed | 593 ms | 598 ms: 1.01x slower | +| mako | 16.9 ms | 17.1 ms: 1.01x slower | +| async_tree_memoization | 426 ms | 430 ms: 1.01x slower | +| django_template | 49.9 ms | 50.4 ms: 1.01x slower | +| pyflate | 653 ms | 660 ms: 1.01x slower | +| regex_v8 | 24.7 ms | 25.0 ms: 1.01x slower | +| hexiom | 9.52 ms | 9.62 ms: 1.01x slower | +| spectral_norm | 113 ms | 114 ms: 1.01x slower | +| create_gc_cycles | 1.81 ms | 1.84 ms: 1.02x slower | +| go | 239 ms | 243 ms: 1.02x slower | +| raytrace | 489 ms | 499 ms: 1.02x slower | +| logging_silent | 177 ns | 184 ns: 1.04x slower | +| richards_super | 74.4 ms | 77.2 ms: 1.04x slower | +| richards | 66.1 ms | 68.8 ms: 1.04x slower | +| regex_effbot | 2.76 ms | 2.89 ms: 1.05x slower | +| deltablue | 7.31 ms | 7.66 ms: 1.05x slower | +| gc_traversal | 3.28 ms | 3.51 ms: 1.07x slower | +| Geometric mean | (ref) | 1.00x slower | + +Benchmark hidden because not significant (35): async_tree_none_tg, logging_simple, xml_etree_parse, genshi_text, meteor_contest, k_core, async_tree_none, sympy_str, docutils, shortest_path, xml_etree_iterparse, json_loads, pylint, bench_thread_pool, coverage, fannkuch, pidigits, async_tree_memoization_tg, comprehensions, asyncio_websockets, generators, async_tree_cpu_io_mixed_tg, sphinx, unpickle_pure_python, float, logging_format, regex_compile, sqlglot_optimize, sqlalchemy_imperative, sqlglot_transpile, json_dumps, async_tree_io_tg, pathlib, typing_runtime_protocols, scimark_sor + +- Geometric mean (including insignificant results): 1.000x slower + +# HPT report + +- Reliability score: 96.37% likely to be faster +- 90% likely to have a speedup of 1.00x +- 95% likely to have a speedup of 1.00x +- 99% likely to have a speedup of 1.00x + +# Memory +- memory change: 1.03x \ No newline at end of file diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base.svg b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base.svg new file mode 100644 index 00000000..fbf90eea --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4-NOGIL/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-base.svg @@ -0,0 +1,3447 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4/README.md b/results/bm-20241222-3.14.0a3+-9d3a8f4/README.md new file mode 100644 index 00000000..94572a08 --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4/README.md @@ -0,0 +1,60 @@ +# Results + +- fork: python/9d3a8f494985e8bbef69 +- version: 3.14.0a3+ +- config: +- commit hash: [9d3a8f4](https://github.com/python/cpython/commit/9d3a8f4) +- commit date: 2024-12-22T11:01:45-08:00 +- commit merge base: [f420bdd29fbc1a97ad20d88075c38c937c1f8479](https://github.com/python/cpython/commit/f420bdd29fbc1a97ad20d88075c38c937c1f8479) +- ref: 9d3a8f494985e8bbef69 + +## linux x86_64 (linux) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/12458964992) +- cpu model: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz +- platform: Linux-5.15.0-1071-aws-x86_64-with-glibc2.31 +- [raw results](bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4.json) + +### vs. 3.12.6 + +- Geometric mean: 1.082x faster (HPT: reliability of 100.00%, 1.02x faster at 99th %ile) +- Memory usage: 1.13x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers +- [📄table](bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.md) +- [📈time plot](bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.038x faster (HPT: reliability of 99.85%, 1.00x faster at 99th %ile) +- Memory usage: 1.13x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers +- [📄table](bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.md) +- [📈time plot](bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.svg) + +## linux x86_64 (vultr) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/12458964992) +- cpu model: Intel(R) Xeon(R) E-2286G CPU @ 4.00GHz +- platform: Linux-6.8.0-45-generic-x86_64-with-glibc2.39 +- [raw results](bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4.json) + +### vs. 3.12.6 + +- Geometric mean: 1.094x faster (HPT: reliability of 100.00%, 1.05x faster at 99th %ile) +- Memory usage: 1.11x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, html5lib, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers +- [📄table](bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.md) +- [📈time plot](bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.055x faster (HPT: reliability of 100.00%, 1.02x faster at 99th %ile) +- Memory usage: 1.10x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, html5lib, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers +- [📄table](bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.md) +- [📈time plot](bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3%2B-9d3a8f4-vs-3.13.0rc2.svg) + diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.md b/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.md new file mode 100644 index 00000000..1be85eb0 --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.md @@ -0,0 +1,170 @@ +# Results vs. 3.12.6 + +- fork: python +- ref: 9d3a8f494985e8bbef69 +- machine: linux-x86_64 +- commit hash: 9d3a8f4 +- commit date: 2024-12-22 +- overall geometric mean: 1.082x faster +- HPT reliability: 100.00% +- HPT 99th percentile: 1.02x faster +- Memory change: 1.13x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| docutils | 4.00 sec | 3.86 sec: 1.04x faster | +| html5lib | 88.9 ms | 84.6 ms: 1.05x faster | +| Geometric mean | (ref) | 1.02x faster | + +Benchmark hidden because not significant (1): 2to3 + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.93 sec | 880 ms: 2.20x faster | +| async_tree_io | 1.85 sec | 894 ms: 2.07x faster | +| async_tree_memoization_tg | 930 ms | 456 ms: 2.04x faster | +| async_tree_none | 741 ms | 374 ms: 1.98x faster | +| async_tree_memoization | 977 ms | 514 ms: 1.90x faster | +| async_tree_none_tg | 704 ms | 387 ms: 1.82x faster | +| async_tree_cpu_io_mixed_tg | 1.10 sec | 687 ms: 1.60x faster | +| async_tree_cpu_io_mixed | 1.08 sec | 728 ms: 1.48x faster | +| async_generators | 589 ms | 552 ms: 1.07x faster | +| asyncio_websockets | 748 ms | 772 ms: 1.03x slower | +| coroutines | 29.5 ms | 31.0 ms: 1.05x slower | +| Geometric mean | (ref) | 1.58x faster | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| float | 123 ms | 117 ms: 1.05x faster | +| pidigits | 250 ms | 240 ms: 1.04x faster | +| Geometric mean | (ref) | 1.03x faster | + +Benchmark hidden because not significant (1): nbody + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 5.13 ms | 4.43 ms: 1.16x faster | +| regex_compile | 187 ms | 170 ms: 1.10x faster | +| Geometric mean | (ref) | 1.07x faster | + +Benchmark hidden because not significant (2): regex_v8, regex_dna + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|---------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_parse | 241 ms | 207 ms: 1.17x faster | +| json_loads | 37.9 us | 33.8 us: 1.12x faster | +| tomli_loads | 2.88 sec | 2.63 sec: 1.10x faster | +| xml_etree_iterparse | 169 ms | 159 ms: 1.06x faster | +| json_dumps | 14.3 ms | 15.4 ms: 1.07x slower | +| Geometric mean | (ref) | 1.04x faster | + +Benchmark hidden because not significant (4): pickle_pure_python, unpickle_pure_python, xml_etree_generate, xml_etree_process + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 17.6 ms | 16.3 ms: 1.08x faster | +| python_startup | 23.7 ms | 28.2 ms: 1.19x slower | +| Geometric mean | (ref) | 1.05x slower | + +Benchmarks with tag 'template': +=============================== + +Benchmark hidden because not significant (4): django_template, genshi_text, mako, genshi_xml + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.93 sec | 880 ms: 2.20x faster | +| async_tree_io | 1.85 sec | 894 ms: 2.07x faster | +| async_tree_memoization_tg | 930 ms | 456 ms: 2.04x faster | +| async_tree_none | 741 ms | 374 ms: 1.98x faster | +| async_tree_memoization | 977 ms | 514 ms: 1.90x faster | +| async_tree_none_tg | 704 ms | 387 ms: 1.82x faster | +| async_tree_cpu_io_mixed_tg | 1.10 sec | 687 ms: 1.60x faster | +| async_tree_cpu_io_mixed | 1.08 sec | 728 ms: 1.48x faster | +| deepcopy | 468 us | 317 us: 1.47x faster | +| sqlalchemy_declarative | 218 ms | 168 ms: 1.29x faster | +| deepcopy_memo | 52.4 us | 40.6 us: 1.29x faster | +| sqlglot_normalize | 157 ms | 135 ms: 1.17x faster | +| xml_etree_parse | 241 ms | 207 ms: 1.17x faster | +| regex_effbot | 5.13 ms | 4.43 ms: 1.16x faster | +| raytrace | 408 ms | 353 ms: 1.15x faster | +| comprehensions | 27.1 us | 23.6 us: 1.15x faster | +| pathlib | 31.6 ms | 27.7 ms: 1.14x faster | +| pylint | 465 ms | 410 ms: 1.13x faster | +| pycparser | 1.79 sec | 1.58 sec: 1.13x faster | +| richards_super | 72.8 ms | 64.7 ms: 1.12x faster | +| json_loads | 37.9 us | 33.8 us: 1.12x faster | +| crypto_pyaes | 107 ms | 96.9 ms: 1.11x faster | +| regex_compile | 187 ms | 170 ms: 1.10x faster | +| tomli_loads | 2.88 sec | 2.63 sec: 1.10x faster | +| nqueens | 117 ms | 108 ms: 1.08x faster | +| mdp | 3.97 sec | 3.68 sec: 1.08x faster | +| deepcopy_reduce | 4.04 us | 3.74 us: 1.08x faster | +| python_startup_no_site | 17.6 ms | 16.3 ms: 1.08x faster | +| async_generators | 589 ms | 552 ms: 1.07x faster | +| sqlglot_parse | 1.79 ms | 1.68 ms: 1.07x faster | +| bpe_tokeniser | 6.59 sec | 6.18 sec: 1.07x faster | +| logging_simple | 9.45 us | 8.87 us: 1.06x faster | +| xml_etree_iterparse | 169 ms | 159 ms: 1.06x faster | +| spectral_norm | 156 ms | 146 ms: 1.06x faster | +| sympy_sum | 222 ms | 209 ms: 1.06x faster | +| sqlglot_optimize | 76.0 ms | 71.8 ms: 1.06x faster | +| pyflate | 727 ms | 690 ms: 1.05x faster | +| html5lib | 88.9 ms | 84.6 ms: 1.05x faster | +| float | 123 ms | 117 ms: 1.05x faster | +| fannkuch | 540 ms | 516 ms: 1.05x faster | +| sympy_str | 385 ms | 369 ms: 1.04x faster | +| pidigits | 250 ms | 240 ms: 1.04x faster | +| json | 6.85 ms | 6.61 ms: 1.04x faster | +| docutils | 4.00 sec | 3.86 sec: 1.04x faster | +| asyncio_websockets | 748 ms | 772 ms: 1.03x slower | +| telco | 9.59 ms | 10.0 ms: 1.04x slower | +| coroutines | 29.5 ms | 31.0 ms: 1.05x slower | +| chaos | 84.9 ms | 90.3 ms: 1.06x slower | +| json_dumps | 14.3 ms | 15.4 ms: 1.07x slower | +| sympy_expand | 582 ms | 626 ms: 1.08x slower | +| scimark_lu | 152 ms | 165 ms: 1.08x slower | +| meteor_contest | 146 ms | 161 ms: 1.10x slower | +| coverage | 95.4 ms | 108 ms: 1.13x slower | +| python_startup | 23.7 ms | 28.2 ms: 1.19x slower | +| gc_traversal | 5.86 ms | 9.46 ms: 1.61x slower | +| create_gc_cycles | 1.94 ms | 4.88 ms: 2.51x slower | +| bench_mp_pool | 20.7 ms | 99.8 ms: 4.82x slower | +| Geometric mean | (ref) | 1.06x faster | + +Benchmark hidden because not significant (33): sqlalchemy_imperative, richards, django_template, regex_v8, scimark_fft, scimark_monte_carlo, pickle_pure_python, go, unpickle_pure_python, typing_runtime_protocols, dulwich_log, hexiom, pprint_pformat, sqlite_synth, pprint_safe_repr, nbody, sympy_integrate, thrift, regex_dna, scimark_sor, xml_etree_generate, xml_etree_process, sqlglot_transpile, genshi_text, generators, scimark_sparse_mat_mult, 2to3, deltablue, mako, logging_format, genshi_xml, logging_silent, bench_thread_pool +Ignored benchmarks (15) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (6) of results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers + +- Geometric mean (including insignificant results): 1.082x faster + +# HPT report + +- Reliability score: 100.00% likely to be faster +- 90% likely to have a speedup of 1.03x +- 95% likely to have a speedup of 1.03x +- 99% likely to have a speedup of 1.02x + +# Memory +- memory change: 1.13x \ No newline at end of file diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.svg b/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.svg new file mode 100644 index 00000000..68c11c4d --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.svg @@ -0,0 +1,3237 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.md b/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.md new file mode 100644 index 00000000..bd6e55c7 --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.md @@ -0,0 +1,166 @@ +# Results vs. 3.13.0rc2 + +- fork: python +- ref: 9d3a8f494985e8bbef69 +- machine: linux-x86_64 +- commit hash: 9d3a8f4 +- commit date: 2024-12-22 +- overall geometric mean: 1.038x faster +- HPT reliability: 99.85% +- HPT 99th percentile: 1.00x faster +- Memory change: 1.13x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| docutils | 4.01 sec | 3.86 sec: 1.04x faster | +| html5lib | 92.6 ms | 84.6 ms: 1.09x faster | +| Geometric mean | (ref) | 1.03x faster | + +Benchmark hidden because not significant (1): 2to3 + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.40 sec | 880 ms: 1.59x faster | +| async_tree_io | 1.39 sec | 894 ms: 1.55x faster | +| async_tree_none | 572 ms | 374 ms: 1.53x faster | +| async_tree_memoization_tg | 670 ms | 456 ms: 1.47x faster | +| async_tree_memoization | 709 ms | 514 ms: 1.38x faster | +| async_tree_none_tg | 504 ms | 387 ms: 1.30x faster | +| async_tree_cpu_io_mixed_tg | 852 ms | 687 ms: 1.24x faster | +| async_tree_cpu_io_mixed | 889 ms | 728 ms: 1.22x faster | +| async_generators | 567 ms | 552 ms: 1.03x faster | +| Geometric mean | (ref) | 1.28x faster | + +Benchmark hidden because not significant (2): coroutines, asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 251 ms | 240 ms: 1.04x faster | +| Geometric mean | (ref) | 1.01x faster | + +Benchmark hidden because not significant (2): nbody, float + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 4.74 ms | 4.43 ms: 1.07x faster | +| regex_compile | 182 ms | 170 ms: 1.07x faster | +| regex_v8 | 32.8 ms | 31.5 ms: 1.04x faster | +| Geometric mean | (ref) | 1.05x faster | + +Benchmark hidden because not significant (1): regex_dna + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|---------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_parse | 231 ms | 207 ms: 1.12x faster | +| xml_etree_iterparse | 177 ms | 159 ms: 1.11x faster | +| tomli_loads | 2.78 sec | 2.63 sec: 1.06x faster | +| xml_etree_generate | 122 ms | 128 ms: 1.05x slower | +| json_dumps | 14.1 ms | 15.4 ms: 1.09x slower | +| Geometric mean | (ref) | 1.02x faster | + +Benchmark hidden because not significant (4): xml_etree_process, json_loads, unpickle_pure_python, pickle_pure_python + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 15.3 ms | 16.3 ms: 1.07x slower | +| python_startup | 22.4 ms | 28.2 ms: 1.26x slower | +| Geometric mean | (ref) | 1.16x slower | + +Benchmarks with tag 'template': +=============================== + +Benchmark hidden because not significant (4): genshi_text, genshi_xml, django_template, mako + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.40 sec | 880 ms: 1.59x faster | +| deepcopy | 498 us | 317 us: 1.57x faster | +| async_tree_io | 1.39 sec | 894 ms: 1.55x faster | +| async_tree_none | 572 ms | 374 ms: 1.53x faster | +| async_tree_memoization_tg | 670 ms | 456 ms: 1.47x faster | +| async_tree_memoization | 709 ms | 514 ms: 1.38x faster | +| async_tree_none_tg | 504 ms | 387 ms: 1.30x faster | +| async_tree_cpu_io_mixed_tg | 852 ms | 687 ms: 1.24x faster | +| deepcopy_memo | 50.1 us | 40.6 us: 1.24x faster | +| async_tree_cpu_io_mixed | 889 ms | 728 ms: 1.22x faster | +| telco | 12.2 ms | 10.0 ms: 1.22x faster | +| pylint | 470 ms | 410 ms: 1.15x faster | +| go | 191 ms | 168 ms: 1.14x faster | +| richards | 65.5 ms | 57.9 ms: 1.13x faster | +| richards_super | 73.2 ms | 64.7 ms: 1.13x faster | +| xml_etree_parse | 231 ms | 207 ms: 1.12x faster | +| xml_etree_iterparse | 177 ms | 159 ms: 1.11x faster | +| deepcopy_reduce | 4.10 us | 3.74 us: 1.10x faster | +| html5lib | 92.6 ms | 84.6 ms: 1.09x faster | +| pathlib | 29.9 ms | 27.7 ms: 1.08x faster | +| spectral_norm | 157 ms | 146 ms: 1.07x faster | +| scimark_sor | 179 ms | 167 ms: 1.07x faster | +| regex_effbot | 4.74 ms | 4.43 ms: 1.07x faster | +| regex_compile | 182 ms | 170 ms: 1.07x faster | +| fannkuch | 547 ms | 516 ms: 1.06x faster | +| tomli_loads | 2.78 sec | 2.63 sec: 1.06x faster | +| sqlglot_parse | 1.76 ms | 1.68 ms: 1.05x faster | +| pidigits | 251 ms | 240 ms: 1.04x faster | +| regex_v8 | 32.8 ms | 31.5 ms: 1.04x faster | +| docutils | 4.01 sec | 3.86 sec: 1.04x faster | +| sqlglot_normalize | 140 ms | 135 ms: 1.04x faster | +| mdp | 3.80 sec | 3.68 sec: 1.03x faster | +| async_generators | 567 ms | 552 ms: 1.03x faster | +| raytrace | 344 ms | 353 ms: 1.03x slower | +| pyflate | 664 ms | 690 ms: 1.04x slower | +| sympy_expand | 601 ms | 626 ms: 1.04x slower | +| generators | 40.0 ms | 41.8 ms: 1.04x slower | +| xml_etree_generate | 122 ms | 128 ms: 1.05x slower | +| dulwich_log | 93.7 ms | 99.1 ms: 1.06x slower | +| comprehensions | 22.2 us | 23.6 us: 1.06x slower | +| python_startup_no_site | 15.3 ms | 16.3 ms: 1.07x slower | +| meteor_contest | 150 ms | 161 ms: 1.07x slower | +| sqlglot_transpile | 2.20 ms | 2.36 ms: 1.07x slower | +| logging_format | 9.24 us | 9.94 us: 1.08x slower | +| chaos | 83.6 ms | 90.3 ms: 1.08x slower | +| json_dumps | 14.1 ms | 15.4 ms: 1.09x slower | +| logging_silent | 130 ns | 146 ns: 1.12x slower | +| scimark_lu | 146 ms | 165 ms: 1.13x slower | +| python_startup | 22.4 ms | 28.2 ms: 1.26x slower | +| bench_thread_pool | 2.89 ms | 3.75 ms: 1.30x slower | +| gc_traversal | 5.70 ms | 9.46 ms: 1.66x slower | +| create_gc_cycles | 2.41 ms | 4.88 ms: 2.02x slower | +| bench_mp_pool | 18.7 ms | 99.8 ms: 5.34x slower | +| Geometric mean | (ref) | 1.01x faster | + +Benchmark hidden because not significant (35): sqlglot_optimize, thrift, nqueens, genshi_text, crypto_pyaes, sqlite_synth, sympy_str, genshi_xml, pprint_safe_repr, typing_runtime_protocols, django_template, bpe_tokeniser, xml_etree_process, sympy_integrate, json_loads, deltablue, regex_dna, sympy_sum, nbody, coroutines, coverage, pycparser, scimark_sparse_mat_mult, asyncio_websockets, hexiom, pprint_pformat, unpickle_pure_python, float, json, mako, pickle_pure_python, scimark_fft, scimark_monte_carlo, logging_simple, 2to3 +Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (8) of results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers + +- Geometric mean (including insignificant results): 1.038x faster + +# HPT report + +- Reliability score: 99.85% likely to be faster +- 90% likely to have a speedup of 1.01x +- 95% likely to have a speedup of 1.01x +- 99% likely to have a speedup of 1.00x + +# Memory +- memory change: 1.13x \ No newline at end of file diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.svg b/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.svg new file mode 100644 index 00000000..a71e594e --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-linux-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.svg @@ -0,0 +1,3255 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.md b/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.md new file mode 100644 index 00000000..efe5a536 --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.md @@ -0,0 +1,206 @@ +# Results vs. 3.12.6 + +- fork: python +- ref: 9d3a8f494985e8bbef69 +- machine: linux-x86_64 +- commit hash: 9d3a8f4 +- commit date: 2024-12-22 +- overall geometric mean: 1.094x faster +- HPT reliability: 100.00% +- HPT 99th percentile: 1.05x faster +- Memory change: 1.11x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 264 ms | 253 ms: 1.04x faster | +| docutils | 2.64 sec | 2.54 sec: 1.04x faster | +| Geometric mean | (ref) | 1.04x faster | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.11 sec | 605 ms: 1.83x faster | +| async_tree_memoization_tg | 560 ms | 306 ms: 1.83x faster | +| async_tree_none_tg | 446 ms | 254 ms: 1.75x faster | +| async_tree_io | 1.08 sec | 622 ms: 1.74x faster | +| async_tree_none | 464 ms | 279 ms: 1.67x faster | +| async_tree_memoization | 555 ms | 334 ms: 1.66x faster | +| async_tree_cpu_io_mixed_tg | 723 ms | 481 ms: 1.50x faster | +| async_tree_cpu_io_mixed | 715 ms | 499 ms: 1.43x faster | +| coroutines | 23.9 ms | 21.4 ms: 1.12x faster | +| async_generators | 384 ms | 357 ms: 1.08x faster | +| asyncio_websockets | 517 ms | 523 ms: 1.01x slower | +| Geometric mean | (ref) | 1.48x faster | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| float | 80.8 ms | 75.4 ms: 1.07x faster | +| pidigits | 184 ms | 185 ms: 1.00x slower | +| nbody | 89.3 ms | 92.9 ms: 1.04x slower | +| Geometric mean | (ref) | 1.01x faster | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_compile | 142 ms | 126 ms: 1.13x faster | +| regex_effbot | 3.17 ms | 2.81 ms: 1.13x faster | +| regex_dna | 168 ms | 172 ms: 1.02x slower | +| regex_v8 | 20.6 ms | 24.2 ms: 1.18x slower | +| Geometric mean | (ref) | 1.01x faster | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| tomli_loads | 2.11 sec | 1.90 sec: 1.11x faster | +| xml_etree_parse | 139 ms | 128 ms: 1.08x faster | +| xml_etree_iterparse | 96.7 ms | 90.4 ms: 1.07x faster | +| unpickle_pure_python | 221 us | 210 us: 1.05x faster | +| json_loads | 26.5 us | 25.8 us: 1.03x faster | +| xml_etree_generate | 85.2 ms | 83.5 ms: 1.02x faster | +| xml_etree_process | 59.0 ms | 58.3 ms: 1.01x faster | +| pickle_pure_python | 308 us | 309 us: 1.01x slower | +| json_dumps | 10.4 ms | 11.3 ms: 1.09x slower | +| Geometric mean | (ref) | 1.03x faster | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 7.16 ms | 7.49 ms: 1.05x slower | +| python_startup | 9.93 ms | 14.7 ms: 1.48x slower | +| Geometric mean | (ref) | 1.24x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_text | 22.8 ms | 21.2 ms: 1.08x faster | +| genshi_xml | 50.2 ms | 48.1 ms: 1.04x faster | +| mako | 11.0 ms | 11.5 ms: 1.05x slower | +| Geometric mean | (ref) | 1.02x faster | + +Benchmark hidden because not significant (1): django_template + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.11 sec | 605 ms: 1.83x faster | +| async_tree_memoization_tg | 560 ms | 306 ms: 1.83x faster | +| async_tree_none_tg | 446 ms | 254 ms: 1.75x faster | +| async_tree_io | 1.08 sec | 622 ms: 1.74x faster | +| async_tree_none | 464 ms | 279 ms: 1.67x faster | +| async_tree_memoization | 555 ms | 334 ms: 1.66x faster | +| async_tree_cpu_io_mixed_tg | 723 ms | 481 ms: 1.50x faster | +| async_tree_cpu_io_mixed | 715 ms | 499 ms: 1.43x faster | +| deepcopy | 352 us | 250 us: 1.41x faster | +| deepcopy_memo | 40.3 us | 29.8 us: 1.35x faster | +| deepcopy_reduce | 3.08 us | 2.53 us: 1.22x faster | +| go | 139 ms | 115 ms: 1.21x faster | +| pathlib | 21.5 ms | 18.1 ms: 1.19x faster | +| generators | 32.2 ms | 27.1 ms: 1.19x faster | +| comprehensions | 19.8 us | 16.8 us: 1.18x faster | +| raytrace | 299 ms | 255 ms: 1.17x faster | +| pylint | 319 ms | 280 ms: 1.14x faster | +| sqlalchemy_imperative | 21.8 ms | 19.2 ms: 1.14x faster | +| scimark_sor | 130 ms | 114 ms: 1.14x faster | +| regex_compile | 142 ms | 126 ms: 1.13x faster | +| crypto_pyaes | 76.6 ms | 67.9 ms: 1.13x faster | +| regex_effbot | 3.17 ms | 2.81 ms: 1.13x faster | +| logging_simple | 6.63 us | 5.92 us: 1.12x faster | +| sqlalchemy_declarative | 143 ms | 128 ms: 1.12x faster | +| coroutines | 23.9 ms | 21.4 ms: 1.12x faster | +| logging_format | 7.35 us | 6.60 us: 1.11x faster | +| tomli_loads | 2.11 sec | 1.90 sec: 1.11x faster | +| bpe_tokeniser | 4.74 sec | 4.28 sec: 1.11x faster | +| deltablue | 3.45 ms | 3.14 ms: 1.10x faster | +| richards | 45.9 ms | 41.9 ms: 1.10x faster | +| spectral_norm | 110 ms | 101 ms: 1.09x faster | +| thrift | 791 us | 727 us: 1.09x faster | +| scimark_fft | 342 ms | 314 ms: 1.09x faster | +| sqlglot_parse | 1.36 ms | 1.25 ms: 1.09x faster | +| sympy_sum | 166 ms | 153 ms: 1.09x faster | +| scimark_monte_carlo | 68.4 ms | 63.0 ms: 1.09x faster | +| xml_etree_parse | 139 ms | 128 ms: 1.08x faster | +| richards_super | 51.9 ms | 47.8 ms: 1.08x faster | +| chaos | 62.8 ms | 58.0 ms: 1.08x faster | +| sympy_str | 292 ms | 270 ms: 1.08x faster | +| async_generators | 384 ms | 357 ms: 1.08x faster | +| genshi_text | 22.8 ms | 21.2 ms: 1.08x faster | +| sqlglot_transpile | 1.67 ms | 1.55 ms: 1.08x faster | +| logging_silent | 109 ns | 102 ns: 1.07x faster | +| pprint_safe_repr | 743 ms | 693 ms: 1.07x faster | +| pprint_pformat | 1.52 sec | 1.42 sec: 1.07x faster | +| float | 80.8 ms | 75.4 ms: 1.07x faster | +| pyflate | 448 ms | 419 ms: 1.07x faster | +| xml_etree_iterparse | 96.7 ms | 90.4 ms: 1.07x faster | +| hexiom | 6.17 ms | 5.83 ms: 1.06x faster | +| scimark_lu | 114 ms | 108 ms: 1.05x faster | +| json | 5.02 ms | 4.77 ms: 1.05x faster | +| typing_runtime_protocols | 163 us | 155 us: 1.05x faster | +| pycparser | 1.17 sec | 1.11 sec: 1.05x faster | +| dulwich_log | 78.9 ms | 75.0 ms: 1.05x faster | +| unpickle_pure_python | 221 us | 210 us: 1.05x faster | +| genshi_xml | 50.2 ms | 48.1 ms: 1.04x faster | +| sympy_integrate | 20.5 ms | 19.7 ms: 1.04x faster | +| meteor_contest | 104 ms | 99.6 ms: 1.04x faster | +| 2to3 | 264 ms | 253 ms: 1.04x faster | +| sqlglot_normalize | 107 ms | 103 ms: 1.04x faster | +| docutils | 2.64 sec | 2.54 sec: 1.04x faster | +| sympy_expand | 468 ms | 453 ms: 1.03x faster | +| sqlglot_optimize | 53.3 ms | 51.7 ms: 1.03x faster | +| json_loads | 26.5 us | 25.8 us: 1.03x faster | +| xml_etree_generate | 85.2 ms | 83.5 ms: 1.02x faster | +| nqueens | 80.1 ms | 78.6 ms: 1.02x faster | +| scimark_sparse_mat_mult | 4.39 ms | 4.34 ms: 1.01x faster | +| xml_etree_process | 59.0 ms | 58.3 ms: 1.01x faster | +| fannkuch | 372 ms | 369 ms: 1.01x faster | +| pidigits | 184 ms | 185 ms: 1.00x slower | +| pickle_pure_python | 308 us | 309 us: 1.01x slower | +| asyncio_websockets | 517 ms | 523 ms: 1.01x slower | +| mdp | 2.42 sec | 2.48 sec: 1.02x slower | +| regex_dna | 168 ms | 172 ms: 1.02x slower | +| nbody | 89.3 ms | 92.9 ms: 1.04x slower | +| python_startup_no_site | 7.16 ms | 7.49 ms: 1.05x slower | +| mako | 11.0 ms | 11.5 ms: 1.05x slower | +| json_dumps | 10.4 ms | 11.3 ms: 1.09x slower | +| coverage | 71.4 ms | 78.6 ms: 1.10x slower | +| telco | 6.53 ms | 7.19 ms: 1.10x slower | +| bench_thread_pool | 941 us | 1.04 ms: 1.10x slower | +| regex_v8 | 20.6 ms | 24.2 ms: 1.18x slower | +| gc_traversal | 3.46 ms | 4.31 ms: 1.25x slower | +| python_startup | 9.93 ms | 14.7 ms: 1.48x slower | +| create_gc_cycles | 1.09 ms | 1.83 ms: 1.67x slower | +| bench_mp_pool | 10.8 ms | 88.9 ms: 8.24x slower | +| Geometric mean | (ref) | 1.07x faster | + +Benchmark hidden because not significant (2): sqlite_synth, django_template +Ignored benchmarks (16) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, html5lib, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (6) of results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers + +- Geometric mean (including insignificant results): 1.094x faster + +# HPT report + +- Reliability score: 100.00% likely to be faster +- 90% likely to have a speedup of 1.06x +- 95% likely to have a speedup of 1.05x +- 99% likely to have a speedup of 1.05x + +# Memory +- memory change: 1.11x \ No newline at end of file diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.svg b/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.svg new file mode 100644 index 00000000..1da81f25 --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.12.6.svg @@ -0,0 +1,3060 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.md b/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.md new file mode 100644 index 00000000..a6d4ab6e --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.md @@ -0,0 +1,197 @@ +# Results vs. 3.13.0rc2 + +- fork: python +- ref: 9d3a8f494985e8bbef69 +- machine: linux-x86_64 +- commit hash: 9d3a8f4 +- commit date: 2024-12-22 +- overall geometric mean: 1.055x faster +- HPT reliability: 100.00% +- HPT 99th percentile: 1.02x faster +- Memory change: 1.10x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 260 ms | 253 ms: 1.02x faster | +| docutils | 2.62 sec | 2.54 sec: 1.03x faster | +| Geometric mean | (ref) | 1.03x faster | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 913 ms | 605 ms: 1.51x faster | +| async_tree_io | 876 ms | 622 ms: 1.41x faster | +| async_tree_memoization | 461 ms | 334 ms: 1.38x faster | +| async_tree_memoization_tg | 414 ms | 306 ms: 1.36x faster | +| async_tree_cpu_io_mixed | 666 ms | 499 ms: 1.33x faster | +| async_tree_cpu_io_mixed_tg | 638 ms | 481 ms: 1.33x faster | +| async_tree_none_tg | 336 ms | 254 ms: 1.32x faster | +| async_tree_none | 354 ms | 279 ms: 1.27x faster | +| coroutines | 23.6 ms | 21.4 ms: 1.10x faster | +| async_generators | 377 ms | 357 ms: 1.06x faster | +| asyncio_websockets | 520 ms | 523 ms: 1.01x slower | +| Geometric mean | (ref) | 1.27x faster | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 217 ms | 185 ms: 1.17x faster | +| float | 77.5 ms | 75.4 ms: 1.03x faster | +| nbody | 85.1 ms | 92.9 ms: 1.09x slower | +| Geometric mean | (ref) | 1.03x faster | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 3.08 ms | 2.81 ms: 1.10x faster | +| regex_compile | 132 ms | 126 ms: 1.05x faster | +| regex_dna | 180 ms | 172 ms: 1.05x faster | +| regex_v8 | 22.7 ms | 24.2 ms: 1.07x slower | +| Geometric mean | (ref) | 1.03x faster | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|---------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_parse | 136 ms | 128 ms: 1.07x faster | +| tomli_loads | 2.01 sec | 1.90 sec: 1.06x faster | +| xml_etree_iterparse | 94.9 ms | 90.4 ms: 1.05x faster | +| json_loads | 27.0 us | 25.8 us: 1.05x faster | +| xml_etree_generate | 85.4 ms | 83.5 ms: 1.02x faster | +| xml_etree_process | 59.3 ms | 58.3 ms: 1.02x faster | +| pickle_pure_python | 294 us | 309 us: 1.05x slower | +| json_dumps | 10.5 ms | 11.3 ms: 1.07x slower | +| Geometric mean | (ref) | 1.01x faster | + +Benchmark hidden because not significant (1): unpickle_pure_python + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 7.39 ms | 7.49 ms: 1.01x slower | +| python_startup | 11.0 ms | 14.7 ms: 1.34x slower | +| Geometric mean | (ref) | 1.16x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|-----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_text | 21.5 ms | 21.2 ms: 1.02x faster | +| genshi_xml | 48.8 ms | 48.1 ms: 1.01x faster | +| django_template | 34.1 ms | 34.5 ms: 1.01x slower | +| mako | 11.3 ms | 11.5 ms: 1.02x slower | +| Geometric mean | (ref) | 1.00x faster | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4 | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 913 ms | 605 ms: 1.51x faster | +| deepcopy | 355 us | 250 us: 1.42x faster | +| async_tree_io | 876 ms | 622 ms: 1.41x faster | +| async_tree_memoization | 461 ms | 334 ms: 1.38x faster | +| async_tree_memoization_tg | 414 ms | 306 ms: 1.36x faster | +| async_tree_cpu_io_mixed | 666 ms | 499 ms: 1.33x faster | +| async_tree_cpu_io_mixed_tg | 638 ms | 481 ms: 1.33x faster | +| async_tree_none_tg | 336 ms | 254 ms: 1.32x faster | +| deepcopy_memo | 39.1 us | 29.8 us: 1.31x faster | +| async_tree_none | 354 ms | 279 ms: 1.27x faster | +| deepcopy_reduce | 3.11 us | 2.53 us: 1.23x faster | +| go | 141 ms | 115 ms: 1.22x faster | +| scimark_sor | 134 ms | 114 ms: 1.18x faster | +| pidigits | 217 ms | 185 ms: 1.17x faster | +| pylint | 317 ms | 280 ms: 1.13x faster | +| scimark_fft | 349 ms | 314 ms: 1.11x faster | +| spectral_norm | 111 ms | 101 ms: 1.10x faster | +| coroutines | 23.6 ms | 21.4 ms: 1.10x faster | +| regex_effbot | 3.08 ms | 2.81 ms: 1.10x faster | +| telco | 7.82 ms | 7.19 ms: 1.09x faster | +| scimark_sparse_mat_mult | 4.71 ms | 4.34 ms: 1.08x faster | +| richards_super | 51.6 ms | 47.8 ms: 1.08x faster | +| richards | 45.2 ms | 41.9 ms: 1.08x faster | +| pyflate | 449 ms | 419 ms: 1.07x faster | +| thrift | 778 us | 727 us: 1.07x faster | +| xml_etree_parse | 136 ms | 128 ms: 1.07x faster | +| pprint_safe_repr | 738 ms | 693 ms: 1.06x faster | +| generators | 28.8 ms | 27.1 ms: 1.06x faster | +| pathlib | 19.2 ms | 18.1 ms: 1.06x faster | +| tomli_loads | 2.01 sec | 1.90 sec: 1.06x faster | +| async_generators | 377 ms | 357 ms: 1.06x faster | +| coverage | 83.0 ms | 78.6 ms: 1.06x faster | +| pprint_pformat | 1.50 sec | 1.42 sec: 1.06x faster | +| regex_compile | 132 ms | 126 ms: 1.05x faster | +| xml_etree_iterparse | 94.9 ms | 90.4 ms: 1.05x faster | +| regex_dna | 180 ms | 172 ms: 1.05x faster | +| json_loads | 27.0 us | 25.8 us: 1.05x faster | +| logging_simple | 6.16 us | 5.92 us: 1.04x faster | +| scimark_lu | 113 ms | 108 ms: 1.04x faster | +| bpe_tokeniser | 4.45 sec | 4.28 sec: 1.04x faster | +| scimark_monte_carlo | 65.4 ms | 63.0 ms: 1.04x faster | +| logging_format | 6.84 us | 6.60 us: 1.04x faster | +| json | 4.93 ms | 4.77 ms: 1.03x faster | +| sqlglot_normalize | 106 ms | 103 ms: 1.03x faster | +| docutils | 2.62 sec | 2.54 sec: 1.03x faster | +| float | 77.5 ms | 75.4 ms: 1.03x faster | +| hexiom | 5.99 ms | 5.83 ms: 1.03x faster | +| 2to3 | 260 ms | 253 ms: 1.02x faster | +| xml_etree_generate | 85.4 ms | 83.5 ms: 1.02x faster | +| meteor_contest | 102 ms | 99.6 ms: 1.02x faster | +| sqlglot_optimize | 52.7 ms | 51.7 ms: 1.02x faster | +| xml_etree_process | 59.3 ms | 58.3 ms: 1.02x faster | +| sympy_sum | 156 ms | 153 ms: 1.02x faster | +| sympy_str | 275 ms | 270 ms: 1.02x faster | +| genshi_text | 21.5 ms | 21.2 ms: 1.02x faster | +| genshi_xml | 48.8 ms | 48.1 ms: 1.01x faster | +| logging_silent | 103 ns | 102 ns: 1.01x faster | +| sympy_expand | 457 ms | 453 ms: 1.01x faster | +| sympy_integrate | 19.8 ms | 19.7 ms: 1.01x faster | +| pycparser | 1.12 sec | 1.11 sec: 1.01x faster | +| asyncio_websockets | 520 ms | 523 ms: 1.01x slower | +| deltablue | 3.12 ms | 3.14 ms: 1.01x slower | +| raytrace | 253 ms | 255 ms: 1.01x slower | +| django_template | 34.1 ms | 34.5 ms: 1.01x slower | +| chaos | 57.3 ms | 58.0 ms: 1.01x slower | +| python_startup_no_site | 7.39 ms | 7.49 ms: 1.01x slower | +| mako | 11.3 ms | 11.5 ms: 1.02x slower | +| comprehensions | 16.5 us | 16.8 us: 1.02x slower | +| pickle_pure_python | 294 us | 309 us: 1.05x slower | +| mdp | 2.36 sec | 2.48 sec: 1.05x slower | +| regex_v8 | 22.7 ms | 24.2 ms: 1.07x slower | +| json_dumps | 10.5 ms | 11.3 ms: 1.07x slower | +| nbody | 85.1 ms | 92.9 ms: 1.09x slower | +| bench_thread_pool | 919 us | 1.04 ms: 1.13x slower | +| python_startup | 11.0 ms | 14.7 ms: 1.34x slower | +| create_gc_cycles | 1.34 ms | 1.83 ms: 1.37x slower | +| gc_traversal | 3.14 ms | 4.31 ms: 1.37x slower | +| bench_mp_pool | 11.0 ms | 88.9 ms: 8.09x slower | +| Geometric mean | (ref) | 1.03x faster | + +Benchmark hidden because not significant (9): sqlite_synth, sqlglot_transpile, sqlglot_parse, fannkuch, crypto_pyaes, nqueens, unpickle_pure_python, dulwich_log, typing_runtime_protocols +Ignored benchmarks (15) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, html5lib, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (8) of results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers + +- Geometric mean (including insignificant results): 1.055x faster + +# HPT report + +- Reliability score: 100.00% likely to be faster +- 90% likely to have a speedup of 1.03x +- 95% likely to have a speedup of 1.02x +- 99% likely to have a speedup of 1.02x + +# Memory +- memory change: 1.10x \ No newline at end of file diff --git a/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.svg b/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.svg new file mode 100644 index 00000000..61b5b6ab --- /dev/null +++ b/results/bm-20241222-3.14.0a3+-9d3a8f4/bm-20241222-vultr-x86_64-python-9d3a8f494985e8bbef69-3.14.0a3+-9d3a8f4-vs-3.13.0rc2.svg @@ -0,0 +1,2978 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +