From ec295a3ef37c7232277b279afaa8c7a1e65ca4f9 Mon Sep 17 00:00:00 2001 From: mpage Date: Thu, 14 Nov 2024 04:05:08 +0000 Subject: [PATCH] Benchmarking results for @mpage --- README.md | 8 +- RESULTS.md | 4 + configs.json | 4 +- configs.svg | 188 +- longitudinal.json | 4 +- longitudinal.svg | 308 +- memory_configs.json | 4 +- memory_configs.svg | 188 +- memory_long.json | 4 +- memory_long.svg | 306 +- .../README.md | 72 + ...2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.md | 199 + ...beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.svg | 3080 +++++++++++++++ ...ef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.md | 197 + ...f0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.svg | 3102 +++++++++++++++ ...ef0f93d9-3.14.0a1+-4ae5061-vs-base-mem.svg | 3081 +++++++++++++++ ...5d2beef0f93d9-3.14.0a1+-4ae5061-vs-base.md | 194 + ...d2beef0f93d9-3.14.0a1+-4ae5061-vs-base.svg | 3104 +++++++++++++++ ...2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.md | 201 + ...beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.svg | 3046 +++++++++++++++ ...ef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.md | 203 + ...f0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.svg | 3042 +++++++++++++++ ...ef0f93d9-3.14.0a1+-4ae5061-vs-base-mem.svg | 2239 +++++++++++ ...5d2beef0f93d9-3.14.0a1+-4ae5061-vs-base.md | 200 + ...d2beef0f93d9-3.14.0a1+-4ae5061-vs-base.svg | 3048 +++++++++++++++ .../bm-20241113-3.14.0a1+-4ae5061/README.md | 56 + ...2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.md | 156 + ...beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.svg | 3300 ++++++++++++++++ ...ef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.md | 141 + ...f0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.svg | 3439 +++++++++++++++++ ...2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.md | 198 + ...beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.svg | 3086 +++++++++++++++ ...ef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.md | 192 + ...f0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.svg | 3136 +++++++++++++++ 34 files changed, 39231 insertions(+), 499 deletions(-) create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/README.md create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.md create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.svg create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.md create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.svg create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base-mem.svg create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base.md create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base.svg create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.md create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.svg create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.md create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.svg create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base-mem.svg create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base.md create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base.svg create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061/README.md create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.md create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.svg create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.md create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.svg create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.md create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.svg create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.md create mode 100644 results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.svg diff --git a/README.md b/README.md index a7d6dc67..636e2968 100644 --- a/README.md +++ b/README.md @@ -12,18 +12,20 @@ Here are some recent and important revisions. 👉 [Complete list of results](RE ## linux x86_64 (linux) | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | +| [2024-11-13](results/bm-20241113-3.14.0a1%2B-4ae5061) | python/4ae50615d2beef0f93d9 | 4ae5061 | 1.00x ↓
[📄](results/bm-20241113-3.14.0a1%2B-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.md)[📈](results/bm-20241113-3.14.0a1%2B-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.svg) | 1.02x ↓
[📄](results/bm-20241113-3.14.0a1%2B-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.md)[📈](results/bm-20241113-3.14.0a1%2B-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.svg) | | +| [2024-11-13](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL) | python/4ae50615d2beef0f93d9 | 4ae5061 (NOGIL) | 1.47x ↓
[📄](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.md)[📈](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.svg) | 1.49x ↓
[📄](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.md)[📈](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.svg) | 1.47x ↓
[📄](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-base.md)[📈](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-base.svg)[🧠](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-base-mem.svg) | | [2024-11-12](results/bm-20241112-3.14.0a1%2B-8cc6e5c) | python/8cc6e5c8751139e86b2a | 8cc6e5c | 1.00x ↑
[📄](results/bm-20241112-3.14.0a1%2B-8cc6e5c/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.12.6.md)[📈](results/bm-20241112-3.14.0a1%2B-8cc6e5c/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.12.6.svg) | 1.01x ↓
[📄](results/bm-20241112-3.14.0a1%2B-8cc6e5c/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.13.0rc2.md)[📈](results/bm-20241112-3.14.0a1%2B-8cc6e5c/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.13.0rc2.svg) | | | [2024-11-12](results/bm-20241112-3.14.0a1%2B-8cc6e5c-NOGIL) | python/8cc6e5c8751139e86b2a | 8cc6e5c (NOGIL) | 1.45x ↓
[📄](results/bm-20241112-3.14.0a1%2B-8cc6e5c-NOGIL/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.12.6.md)[📈](results/bm-20241112-3.14.0a1%2B-8cc6e5c-NOGIL/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.12.6.svg) | 1.47x ↓
[📄](results/bm-20241112-3.14.0a1%2B-8cc6e5c-NOGIL/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.13.0rc2.md)[📈](results/bm-20241112-3.14.0a1%2B-8cc6e5c-NOGIL/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.13.0rc2.svg) | 1.45x ↓
[📄](results/bm-20241112-3.14.0a1%2B-8cc6e5c-NOGIL/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-base.md)[📈](results/bm-20241112-3.14.0a1%2B-8cc6e5c-NOGIL/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-base.svg)[🧠](results/bm-20241112-3.14.0a1%2B-8cc6e5c-NOGIL/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-base-mem.svg) | | [2024-11-12](results/bm-20241112-3.14.0a1%2B-494360a) | python/494360afd00dc8f6b549 | 494360a | 1.01x ↑
[📄](results/bm-20241112-3.14.0a1%2B-494360a/bm-20241112-linux-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-3.12.6.md)[📈](results/bm-20241112-3.14.0a1%2B-494360a/bm-20241112-linux-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-3.12.6.svg) | 1.01x ↓
[📄](results/bm-20241112-3.14.0a1%2B-494360a/bm-20241112-linux-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-3.13.0rc2.md)[📈](results/bm-20241112-3.14.0a1%2B-494360a/bm-20241112-linux-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-3.13.0rc2.svg) | | | [2024-11-12](results/bm-20241112-3.14.0a1%2B-494360a-NOGIL) | python/494360afd00dc8f6b549 | 494360a (NOGIL) | 1.44x ↓
[📄](results/bm-20241112-3.14.0a1%2B-494360a-NOGIL/bm-20241112-linux-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-3.12.6.md)[📈](results/bm-20241112-3.14.0a1%2B-494360a-NOGIL/bm-20241112-linux-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-3.12.6.svg) | 1.46x ↓
[📄](results/bm-20241112-3.14.0a1%2B-494360a-NOGIL/bm-20241112-linux-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-3.13.0rc2.md)[📈](results/bm-20241112-3.14.0a1%2B-494360a-NOGIL/bm-20241112-linux-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-3.13.0rc2.svg) | 1.45x ↓
[📄](results/bm-20241112-3.14.0a1%2B-494360a-NOGIL/bm-20241112-linux-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-base.md)[📈](results/bm-20241112-3.14.0a1%2B-494360a-NOGIL/bm-20241112-linux-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-base.svg)[🧠](results/bm-20241112-3.14.0a1%2B-494360a-NOGIL/bm-20241112-linux-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-base-mem.svg) | | [2024-11-10](results/bm-20241110-3.14.0a1%2B-f435de6-NOGIL) | python/f435de6765e032799585 | f435de6 (NOGIL) | 1.44x ↓
[📄](results/bm-20241110-3.14.0a1%2B-f435de6-NOGIL/bm-20241110-linux-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-3.12.6.md)[📈](results/bm-20241110-3.14.0a1%2B-f435de6-NOGIL/bm-20241110-linux-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-3.12.6.svg) | 1.46x ↓
[📄](results/bm-20241110-3.14.0a1%2B-f435de6-NOGIL/bm-20241110-linux-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-3.13.0rc2.md)[📈](results/bm-20241110-3.14.0a1%2B-f435de6-NOGIL/bm-20241110-linux-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-3.13.0rc2.svg) | 1.44x ↓
[📄](results/bm-20241110-3.14.0a1%2B-f435de6-NOGIL/bm-20241110-linux-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-base.md)[📈](results/bm-20241110-3.14.0a1%2B-f435de6-NOGIL/bm-20241110-linux-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-base.svg)[🧠](results/bm-20241110-3.14.0a1%2B-f435de6-NOGIL/bm-20241110-linux-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-base-mem.svg) | | [2024-11-10](results/bm-20241110-3.14.0a1%2B-f435de6) | python/f435de6765e032799585 | f435de6 | 1.00x ↑
[📄](results/bm-20241110-3.14.0a1%2B-f435de6/bm-20241110-linux-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-3.12.6.md)[📈](results/bm-20241110-3.14.0a1%2B-f435de6/bm-20241110-linux-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-3.12.6.svg) | 1.01x ↓
[📄](results/bm-20241110-3.14.0a1%2B-f435de6/bm-20241110-linux-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-3.13.0rc2.md)[📈](results/bm-20241110-3.14.0a1%2B-f435de6/bm-20241110-linux-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-3.13.0rc2.svg) | | -| [2024-11-09](results/bm-20241109-3.14.0a1%2B-9d08423) | python/9d08423b6e0fa89ce9cf | 9d08423 | 1.01x ↑
[📄](results/bm-20241109-3.14.0a1%2B-9d08423/bm-20241109-linux-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-3.12.6.md)[📈](results/bm-20241109-3.14.0a1%2B-9d08423/bm-20241109-linux-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-3.12.6.svg) | 1.00x ↓
[📄](results/bm-20241109-3.14.0a1%2B-9d08423/bm-20241109-linux-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-3.13.0rc2.md)[📈](results/bm-20241109-3.14.0a1%2B-9d08423/bm-20241109-linux-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-3.13.0rc2.svg) | | -| [2024-11-09](results/bm-20241109-3.14.0a1%2B-9d08423-NOGIL) | python/9d08423b6e0fa89ce9cf | 9d08423 (NOGIL) | 1.44x ↓
[📄](results/bm-20241109-3.14.0a1%2B-9d08423-NOGIL/bm-20241109-linux-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-3.12.6.md)[📈](results/bm-20241109-3.14.0a1%2B-9d08423-NOGIL/bm-20241109-linux-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-3.12.6.svg) | 1.47x ↓
[📄](results/bm-20241109-3.14.0a1%2B-9d08423-NOGIL/bm-20241109-linux-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-3.13.0rc2.md)[📈](results/bm-20241109-3.14.0a1%2B-9d08423-NOGIL/bm-20241109-linux-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-3.13.0rc2.svg) | 1.46x ↓
[📄](results/bm-20241109-3.14.0a1%2B-9d08423-NOGIL/bm-20241109-linux-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-base.md)[📈](results/bm-20241109-3.14.0a1%2B-9d08423-NOGIL/bm-20241109-linux-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-base.svg)[🧠](results/bm-20241109-3.14.0a1%2B-9d08423-NOGIL/bm-20241109-linux-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-base-mem.svg) | ## linux x86_64 (vultr) | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | +| [2024-11-13](results/bm-20241113-3.14.0a1%2B-4ae5061) | python/4ae50615d2beef0f93d9 | 4ae5061 | 1.00x ↓
[📄](results/bm-20241113-3.14.0a1%2B-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.md)[📈](results/bm-20241113-3.14.0a1%2B-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.svg) | 1.02x ↓
[📄](results/bm-20241113-3.14.0a1%2B-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.md)[📈](results/bm-20241113-3.14.0a1%2B-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.svg) | | +| [2024-11-13](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL) | python/4ae50615d2beef0f93d9 | 4ae5061 (NOGIL) | 1.55x ↓
[📄](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.md)[📈](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.svg) | 1.57x ↓
[📄](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.md)[📈](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.svg) | 1.54x ↓
[📄](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-base.md)[📈](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-base.svg)[🧠](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-base-mem.svg) | | [2024-11-13](results/bm-20241113-3.14.0a1%2B-b1f1c71-NOGIL) | corona10/gh_115999_bool | b1f1c71 (NOGIL) | 1.55x ↓
[📄](results/bm-20241113-3.14.0a1%2B-b1f1c71-NOGIL/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-3.12.6.md)[📈](results/bm-20241113-3.14.0a1%2B-b1f1c71-NOGIL/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-3.12.6.svg) | 1.57x ↓
[📄](results/bm-20241113-3.14.0a1%2B-b1f1c71-NOGIL/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-3.13.0rc2.md)[📈](results/bm-20241113-3.14.0a1%2B-b1f1c71-NOGIL/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-3.13.0rc2.svg) | 1.01x ↑
[📄](results/bm-20241113-3.14.0a1%2B-b1f1c71-NOGIL/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-base.md)[📈](results/bm-20241113-3.14.0a1%2B-b1f1c71-NOGIL/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-base.svg)[🧠](results/bm-20241113-3.14.0a1%2B-b1f1c71-NOGIL/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-base-mem.svg) | | [2024-11-13](results/bm-20241113-3.14.0a1%2B-b1f1c71) | corona10/gh_115999_bool | b1f1c71 | 1.00x ↓
[📄](results/bm-20241113-3.14.0a1%2B-b1f1c71/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-3.12.6.md)[📈](results/bm-20241113-3.14.0a1%2B-b1f1c71/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-3.12.6.svg) | 1.02x ↓
[📄](results/bm-20241113-3.14.0a1%2B-b1f1c71/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-3.13.0rc2.md)[📈](results/bm-20241113-3.14.0a1%2B-b1f1c71/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-3.13.0rc2.svg) | 1.01x ↑
[📄](results/bm-20241113-3.14.0a1%2B-b1f1c71/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-base.md)[📈](results/bm-20241113-3.14.0a1%2B-b1f1c71/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-base.svg)[🧠](results/bm-20241113-3.14.0a1%2B-b1f1c71/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-base-mem.svg) | | [2024-11-12](results/bm-20241112-3.14.0a1%2B-8cc6e5c) | python/8cc6e5c8751139e86b2a | 8cc6e5c | 1.01x ↓
[📄](results/bm-20241112-3.14.0a1%2B-8cc6e5c/bm-20241112-vultr-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.12.6.md)[📈](results/bm-20241112-3.14.0a1%2B-8cc6e5c/bm-20241112-vultr-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.12.6.svg) | 1.02x ↓
[📄](results/bm-20241112-3.14.0a1%2B-8cc6e5c/bm-20241112-vultr-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.13.0rc2.md)[📈](results/bm-20241112-3.14.0a1%2B-8cc6e5c/bm-20241112-vultr-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.13.0rc2.svg) | | @@ -32,8 +34,6 @@ Here are some recent and important revisions. 👉 [Complete list of results](RE | [2024-11-12](results/bm-20241112-3.14.0a1%2B-494360a-NOGIL) | python/494360afd00dc8f6b549 | 494360a (NOGIL) | 1.55x ↓
[📄](results/bm-20241112-3.14.0a1%2B-494360a-NOGIL/bm-20241112-vultr-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-3.12.6.md)[📈](results/bm-20241112-3.14.0a1%2B-494360a-NOGIL/bm-20241112-vultr-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-3.12.6.svg) | 1.57x ↓
[📄](results/bm-20241112-3.14.0a1%2B-494360a-NOGIL/bm-20241112-vultr-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-3.13.0rc2.md)[📈](results/bm-20241112-3.14.0a1%2B-494360a-NOGIL/bm-20241112-vultr-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-3.13.0rc2.svg) | 1.54x ↓
[📄](results/bm-20241112-3.14.0a1%2B-494360a-NOGIL/bm-20241112-vultr-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-base.md)[📈](results/bm-20241112-3.14.0a1%2B-494360a-NOGIL/bm-20241112-vultr-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-base.svg)[🧠](results/bm-20241112-3.14.0a1%2B-494360a-NOGIL/bm-20241112-vultr-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-base-mem.svg) | | [2024-11-10](results/bm-20241110-3.14.0a1%2B-f435de6-NOGIL) | python/f435de6765e032799585 | f435de6 (NOGIL) | 1.55x ↓
[📄](results/bm-20241110-3.14.0a1%2B-f435de6-NOGIL/bm-20241110-vultr-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-3.12.6.md)[📈](results/bm-20241110-3.14.0a1%2B-f435de6-NOGIL/bm-20241110-vultr-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-3.12.6.svg) | 1.57x ↓
[📄](results/bm-20241110-3.14.0a1%2B-f435de6-NOGIL/bm-20241110-vultr-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-3.13.0rc2.md)[📈](results/bm-20241110-3.14.0a1%2B-f435de6-NOGIL/bm-20241110-vultr-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-3.13.0rc2.svg) | 1.54x ↓
[📄](results/bm-20241110-3.14.0a1%2B-f435de6-NOGIL/bm-20241110-vultr-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-base.md)[📈](results/bm-20241110-3.14.0a1%2B-f435de6-NOGIL/bm-20241110-vultr-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-base.svg)[🧠](results/bm-20241110-3.14.0a1%2B-f435de6-NOGIL/bm-20241110-vultr-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-base-mem.svg) | | [2024-11-10](results/bm-20241110-3.14.0a1%2B-f435de6) | python/f435de6765e032799585 | f435de6 | 1.00x ↓
[📄](results/bm-20241110-3.14.0a1%2B-f435de6/bm-20241110-vultr-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-3.12.6.md)[📈](results/bm-20241110-3.14.0a1%2B-f435de6/bm-20241110-vultr-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-3.12.6.svg) | 1.02x ↓
[📄](results/bm-20241110-3.14.0a1%2B-f435de6/bm-20241110-vultr-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-3.13.0rc2.md)[📈](results/bm-20241110-3.14.0a1%2B-f435de6/bm-20241110-vultr-x86_64-python-f435de6765e032799585-3.14.0a1%2B-f435de6-vs-3.13.0rc2.svg) | | -| [2024-11-09](results/bm-20241109-3.14.0a1%2B-9d08423) | python/9d08423b6e0fa89ce9cf | 9d08423 | 1.01x ↓
[📄](results/bm-20241109-3.14.0a1%2B-9d08423/bm-20241109-vultr-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-3.12.6.md)[📈](results/bm-20241109-3.14.0a1%2B-9d08423/bm-20241109-vultr-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-3.12.6.svg) | 1.03x ↓
[📄](results/bm-20241109-3.14.0a1%2B-9d08423/bm-20241109-vultr-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-3.13.0rc2.md)[📈](results/bm-20241109-3.14.0a1%2B-9d08423/bm-20241109-vultr-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-3.13.0rc2.svg) | | -| [2024-11-09](results/bm-20241109-3.14.0a1%2B-9d08423-NOGIL) | python/9d08423b6e0fa89ce9cf | 9d08423 (NOGIL) | 1.56x ↓
[📄](results/bm-20241109-3.14.0a1%2B-9d08423-NOGIL/bm-20241109-vultr-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-3.12.6.md)[📈](results/bm-20241109-3.14.0a1%2B-9d08423-NOGIL/bm-20241109-vultr-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-3.12.6.svg) | 1.58x ↓
[📄](results/bm-20241109-3.14.0a1%2B-9d08423-NOGIL/bm-20241109-vultr-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-3.13.0rc2.md)[📈](results/bm-20241109-3.14.0a1%2B-9d08423-NOGIL/bm-20241109-vultr-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-3.13.0rc2.svg) | 1.54x ↓
[📄](results/bm-20241109-3.14.0a1%2B-9d08423-NOGIL/bm-20241109-vultr-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-base.md)[📈](results/bm-20241109-3.14.0a1%2B-9d08423-NOGIL/bm-20241109-vultr-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-base.svg)[🧠](results/bm-20241109-3.14.0a1%2B-9d08423-NOGIL/bm-20241109-vultr-x86_64-python-9d08423b6e0fa89ce9cf-3.14.0a1%2B-9d08423-vs-base-mem.svg) | | [2024-11-09](results/bm-20241109-3.14.0a1%2B-6293d00-NOGIL) | python/6293d00e7201f3f28b1f | 6293d00 (NOGIL) | 1.56x ↓
[📄](results/bm-20241109-3.14.0a1%2B-6293d00-NOGIL/bm-20241109-vultr-x86_64-python-6293d00e7201f3f28b1f-3.14.0a1%2B-6293d00-vs-3.12.6.md)[📈](results/bm-20241109-3.14.0a1%2B-6293d00-NOGIL/bm-20241109-vultr-x86_64-python-6293d00e7201f3f28b1f-3.14.0a1%2B-6293d00-vs-3.12.6.svg) | 1.58x ↓
[📄](results/bm-20241109-3.14.0a1%2B-6293d00-NOGIL/bm-20241109-vultr-x86_64-python-6293d00e7201f3f28b1f-3.14.0a1%2B-6293d00-vs-3.13.0rc2.md)[📈](results/bm-20241109-3.14.0a1%2B-6293d00-NOGIL/bm-20241109-vultr-x86_64-python-6293d00e7201f3f28b1f-3.14.0a1%2B-6293d00-vs-3.13.0rc2.svg) | 1.55x ↓
[📄](results/bm-20241109-3.14.0a1%2B-6293d00-NOGIL/bm-20241109-vultr-x86_64-python-6293d00e7201f3f28b1f-3.14.0a1%2B-6293d00-vs-base.md)[📈](results/bm-20241109-3.14.0a1%2B-6293d00-NOGIL/bm-20241109-vultr-x86_64-python-6293d00e7201f3f28b1f-3.14.0a1%2B-6293d00-vs-base.svg)[🧠](results/bm-20241109-3.14.0a1%2B-6293d00-NOGIL/bm-20241109-vultr-x86_64-python-6293d00e7201f3f28b1f-3.14.0a1%2B-6293d00-vs-base-mem.svg) | | [2024-11-09](results/bm-20241109-3.14.0a1%2B-6293d00) | python/6293d00e7201f3f28b1f | 6293d00 | 1.01x ↓
[📄](results/bm-20241109-3.14.0a1%2B-6293d00/bm-20241109-vultr-x86_64-python-6293d00e7201f3f28b1f-3.14.0a1%2B-6293d00-vs-3.12.6.md)[📈](results/bm-20241109-3.14.0a1%2B-6293d00/bm-20241109-vultr-x86_64-python-6293d00e7201f3f28b1f-3.14.0a1%2B-6293d00-vs-3.12.6.svg) | 1.02x ↓
[📄](results/bm-20241109-3.14.0a1%2B-6293d00/bm-20241109-vultr-x86_64-python-6293d00e7201f3f28b1f-3.14.0a1%2B-6293d00-vs-3.13.0rc2.md)[📈](results/bm-20241109-3.14.0a1%2B-6293d00/bm-20241109-vultr-x86_64-python-6293d00e7201f3f28b1f-3.14.0a1%2B-6293d00-vs-3.13.0rc2.svg) | | | [2024-11-08](results/bm-20241108-3.14.0a1%2B-d49e9e6-NOGIL) | Eclips4/ft_specialize_unpack | d49e9e6 (NOGIL) | 1.52x ↓
[📄](results/bm-20241108-3.14.0a1%2B-d49e9e6-NOGIL/bm-20241108-vultr-x86_64-Eclips4-ft_specialize_unpack-3.14.0a1%2B-d49e9e6-vs-3.12.6.md)[📈](results/bm-20241108-3.14.0a1%2B-d49e9e6-NOGIL/bm-20241108-vultr-x86_64-Eclips4-ft_specialize_unpack-3.14.0a1%2B-d49e9e6-vs-3.12.6.svg) | 1.54x ↓
[📄](results/bm-20241108-3.14.0a1%2B-d49e9e6-NOGIL/bm-20241108-vultr-x86_64-Eclips4-ft_specialize_unpack-3.14.0a1%2B-d49e9e6-vs-3.13.0rc2.md)[📈](results/bm-20241108-3.14.0a1%2B-d49e9e6-NOGIL/bm-20241108-vultr-x86_64-Eclips4-ft_specialize_unpack-3.14.0a1%2B-d49e9e6-vs-3.13.0rc2.svg) | 1.02x ↑
[📄](results/bm-20241108-3.14.0a1%2B-d49e9e6-NOGIL/bm-20241108-vultr-x86_64-Eclips4-ft_specialize_unpack-3.14.0a1%2B-d49e9e6-vs-base.md)[📈](results/bm-20241108-3.14.0a1%2B-d49e9e6-NOGIL/bm-20241108-vultr-x86_64-Eclips4-ft_specialize_unpack-3.14.0a1%2B-d49e9e6-vs-base.svg)[🧠](results/bm-20241108-3.14.0a1%2B-d49e9e6-NOGIL/bm-20241108-vultr-x86_64-Eclips4-ft_specialize_unpack-3.14.0a1%2B-d49e9e6-vs-base-mem.svg) | diff --git a/RESULTS.md b/RESULTS.md index 3e35f025..bb743537 100644 --- a/RESULTS.md +++ b/RESULTS.md @@ -6,6 +6,8 @@ ## linux x86_64 (linux) | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | +| [2024-11-13](results/bm-20241113-3.14.0a1%2B-4ae5061) | python/4ae50615d2beef0f93d9 | 4ae5061 | 1.00x ↓
[📄](results/bm-20241113-3.14.0a1%2B-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.md)[📈](results/bm-20241113-3.14.0a1%2B-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.svg) | 1.02x ↓
[📄](results/bm-20241113-3.14.0a1%2B-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.md)[📈](results/bm-20241113-3.14.0a1%2B-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.svg) | | +| [2024-11-13](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL) | python/4ae50615d2beef0f93d9 | 4ae5061 (NOGIL) | 1.47x ↓
[📄](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.md)[📈](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.svg) | 1.49x ↓
[📄](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.md)[📈](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.svg) | 1.47x ↓
[📄](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-base.md)[📈](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-base.svg)[🧠](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-base-mem.svg) | | [2024-11-12](results/bm-20241112-3.14.0a1%2B-8cc6e5c) | python/8cc6e5c8751139e86b2a | 8cc6e5c | 1.00x ↑
[📄](results/bm-20241112-3.14.0a1%2B-8cc6e5c/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.12.6.md)[📈](results/bm-20241112-3.14.0a1%2B-8cc6e5c/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.12.6.svg) | 1.01x ↓
[📄](results/bm-20241112-3.14.0a1%2B-8cc6e5c/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.13.0rc2.md)[📈](results/bm-20241112-3.14.0a1%2B-8cc6e5c/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.13.0rc2.svg) | | | [2024-11-12](results/bm-20241112-3.14.0a1%2B-8cc6e5c-NOGIL) | python/8cc6e5c8751139e86b2a | 8cc6e5c (NOGIL) | 1.45x ↓
[📄](results/bm-20241112-3.14.0a1%2B-8cc6e5c-NOGIL/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.12.6.md)[📈](results/bm-20241112-3.14.0a1%2B-8cc6e5c-NOGIL/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.12.6.svg) | 1.47x ↓
[📄](results/bm-20241112-3.14.0a1%2B-8cc6e5c-NOGIL/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.13.0rc2.md)[📈](results/bm-20241112-3.14.0a1%2B-8cc6e5c-NOGIL/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.13.0rc2.svg) | 1.45x ↓
[📄](results/bm-20241112-3.14.0a1%2B-8cc6e5c-NOGIL/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-base.md)[📈](results/bm-20241112-3.14.0a1%2B-8cc6e5c-NOGIL/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-base.svg)[🧠](results/bm-20241112-3.14.0a1%2B-8cc6e5c-NOGIL/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-base-mem.svg) | | [2024-11-12](results/bm-20241112-3.14.0a1%2B-494360a) | python/494360afd00dc8f6b549 | 494360a | 1.01x ↑
[📄](results/bm-20241112-3.14.0a1%2B-494360a/bm-20241112-linux-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-3.12.6.md)[📈](results/bm-20241112-3.14.0a1%2B-494360a/bm-20241112-linux-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-3.12.6.svg) | 1.01x ↓
[📄](results/bm-20241112-3.14.0a1%2B-494360a/bm-20241112-linux-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-3.13.0rc2.md)[📈](results/bm-20241112-3.14.0a1%2B-494360a/bm-20241112-linux-x86_64-python-494360afd00dc8f6b549-3.14.0a1%2B-494360a-vs-3.13.0rc2.svg) | | @@ -128,6 +130,8 @@ ## linux x86_64 (vultr) | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | +| [2024-11-13](results/bm-20241113-3.14.0a1%2B-4ae5061) | python/4ae50615d2beef0f93d9 | 4ae5061 | 1.00x ↓
[📄](results/bm-20241113-3.14.0a1%2B-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.md)[📈](results/bm-20241113-3.14.0a1%2B-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.svg) | 1.02x ↓
[📄](results/bm-20241113-3.14.0a1%2B-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.md)[📈](results/bm-20241113-3.14.0a1%2B-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.svg) | | +| [2024-11-13](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL) | python/4ae50615d2beef0f93d9 | 4ae5061 (NOGIL) | 1.55x ↓
[📄](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.md)[📈](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.svg) | 1.57x ↓
[📄](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.md)[📈](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.svg) | 1.54x ↓
[📄](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-base.md)[📈](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-base.svg)[🧠](results/bm-20241113-3.14.0a1%2B-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-base-mem.svg) | | [2024-11-13](results/bm-20241113-3.14.0a1%2B-b1f1c71-NOGIL) | corona10/gh_115999_bool | b1f1c71 (NOGIL) | 1.55x ↓
[📄](results/bm-20241113-3.14.0a1%2B-b1f1c71-NOGIL/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-3.12.6.md)[📈](results/bm-20241113-3.14.0a1%2B-b1f1c71-NOGIL/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-3.12.6.svg) | 1.57x ↓
[📄](results/bm-20241113-3.14.0a1%2B-b1f1c71-NOGIL/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-3.13.0rc2.md)[📈](results/bm-20241113-3.14.0a1%2B-b1f1c71-NOGIL/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-3.13.0rc2.svg) | 1.01x ↑
[📄](results/bm-20241113-3.14.0a1%2B-b1f1c71-NOGIL/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-base.md)[📈](results/bm-20241113-3.14.0a1%2B-b1f1c71-NOGIL/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-base.svg)[🧠](results/bm-20241113-3.14.0a1%2B-b1f1c71-NOGIL/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-base-mem.svg) | | [2024-11-13](results/bm-20241113-3.14.0a1%2B-b1f1c71) | corona10/gh_115999_bool | b1f1c71 | 1.00x ↓
[📄](results/bm-20241113-3.14.0a1%2B-b1f1c71/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-3.12.6.md)[📈](results/bm-20241113-3.14.0a1%2B-b1f1c71/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-3.12.6.svg) | 1.02x ↓
[📄](results/bm-20241113-3.14.0a1%2B-b1f1c71/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-3.13.0rc2.md)[📈](results/bm-20241113-3.14.0a1%2B-b1f1c71/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-3.13.0rc2.svg) | 1.01x ↑
[📄](results/bm-20241113-3.14.0a1%2B-b1f1c71/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-base.md)[📈](results/bm-20241113-3.14.0a1%2B-b1f1c71/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-base.svg)[🧠](results/bm-20241113-3.14.0a1%2B-b1f1c71/bm-20241113-vultr-x86_64-corona10-gh_115999_bool-3.14.0a1%2B-b1f1c71-vs-base-mem.svg) | | [2024-11-12](results/bm-20241112-3.14.0a1%2B-8cc6e5c) | python/8cc6e5c8751139e86b2a | 8cc6e5c | 1.01x ↓
[📄](results/bm-20241112-3.14.0a1%2B-8cc6e5c/bm-20241112-vultr-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.12.6.md)[📈](results/bm-20241112-3.14.0a1%2B-8cc6e5c/bm-20241112-vultr-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.12.6.svg) | 1.02x ↓
[📄](results/bm-20241112-3.14.0a1%2B-8cc6e5c/bm-20241112-vultr-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.13.0rc2.md)[📈](results/bm-20241112-3.14.0a1%2B-8cc6e5c/bm-20241112-vultr-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1%2B-8cc6e5c-vs-3.13.0rc2.svg) | | diff --git a/configs.json b/configs.json index c1208e36..bbb79918 100644 --- a/configs.json +++ b/configs.json @@ -61,5 +61,7 @@ "bm-20241112-3.14.0a1+-8cc6e5c/bm-20241112-vultr-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1+-8cc6e5c.json,bm-20241112-3.14.0a1+-8cc6e5c-NOGIL/bm-20241112-vultr-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1+-8cc6e5c.json": 0.5900000000000001, "bm-20241112-3.14.0a1+-8cc6e5c/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1+-8cc6e5c.json,bm-20241112-3.14.0a1+-8cc6e5c-NOGIL/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1+-8cc6e5c.json": 0.6399999999999999, "bm-20241107-3.14.0a1+-85036c8/bm-20241107-vultr-x86_64-python-85036c8d612007356d21-3.14.0a1+-85036c8.json,bm-20241107-3.14.0a1+-85036c8-NOGIL/bm-20241107-vultr-x86_64-python-85036c8d612007356d21-3.14.0a1+-85036c8.json": 0.5900000000000001, - "bm-20241109-3.14.0a1+-6293d00/bm-20241109-vultr-x86_64-python-6293d00e7201f3f28b1f-3.14.0a1+-6293d00.json,bm-20241109-3.14.0a1+-6293d00-NOGIL/bm-20241109-vultr-x86_64-python-6293d00e7201f3f28b1f-3.14.0a1+-6293d00.json": 0.5900000000000001 + "bm-20241109-3.14.0a1+-6293d00/bm-20241109-vultr-x86_64-python-6293d00e7201f3f28b1f-3.14.0a1+-6293d00.json,bm-20241109-3.14.0a1+-6293d00-NOGIL/bm-20241109-vultr-x86_64-python-6293d00e7201f3f28b1f-3.14.0a1+-6293d00.json": 0.5900000000000001, + "bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json,bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json": 0.6100000000000001, + "bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json,bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json": 0.6000000000000001 } \ No newline at end of file diff --git a/configs.svg b/configs.svg index 0d28d027..027f6132 100644 --- a/configs.svg +++ b/configs.svg @@ -10,8 +10,8 @@ - - + + @@ -31,9 +31,9 @@ - - - + + + @@ -48,9 +48,9 @@ - - - + + + @@ -65,9 +65,9 @@ - - - + + + @@ -79,9 +79,9 @@ - - - + + + @@ -93,9 +93,9 @@ - - - + + + @@ -107,9 +107,9 @@ - - - + + + @@ -121,9 +121,9 @@ - - - + + + @@ -191,78 +191,80 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + @@ -411,35 +413,35 @@ - + - + - + - + - + diff --git a/longitudinal.json b/longitudinal.json index 005f5f32..701a5029 100644 --- a/longitudinal.json +++ b/longitudinal.json @@ -97,5 +97,7 @@ "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241109-3.14.0a1+-6293d00/bm-20241109-vultr-x86_64-python-6293d00e7201f3f28b1f-3.14.0a1+-6293d00.json,3.13.0rc2": 1.0, "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241107-3.14.0a1+-85036c8/bm-20241107-vultr-x86_64-python-85036c8d612007356d21-3.14.0a1+-85036c8.json,3.13.0rc2": 1.0, "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20241112-3.14.0a1+-8cc6e5c/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1+-8cc6e5c.json,3.13.0rc2": 1.0, - "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241112-3.14.0a1+-8cc6e5c/bm-20241112-vultr-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1+-8cc6e5c.json,3.13.0rc2": 1.0 + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241112-3.14.0a1+-8cc6e5c/bm-20241112-vultr-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1+-8cc6e5c.json,3.13.0rc2": 1.0, + "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json,3.13.0rc2": 1.0, + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json,3.13.0rc2": 1.0 } \ No newline at end of file diff --git a/longitudinal.svg b/longitudinal.svg index e5b0aeaf..062f970a 100644 --- a/longitudinal.svg +++ b/longitudinal.svg @@ -5,13 +5,13 @@ - - + + - - + + @@ -31,9 +31,9 @@ - - - + + + @@ -48,9 +48,9 @@ - - - + + + @@ -62,9 +62,9 @@ - - - + + + @@ -79,9 +79,9 @@ - - - + + + @@ -93,9 +93,9 @@ - - - + + + @@ -110,9 +110,9 @@ - - - + + + @@ -124,9 +124,9 @@ - - - + + + @@ -141,9 +141,9 @@ - - - + + + @@ -155,7 +155,7 @@ - + @@ -171,7 +171,7 @@ - + @@ -180,7 +180,7 @@ - + @@ -189,7 +189,7 @@ - + @@ -198,7 +198,7 @@ - + @@ -207,7 +207,7 @@ - + @@ -216,7 +216,7 @@ - + @@ -225,7 +225,7 @@ - + @@ -234,7 +234,7 @@ - + @@ -246,36 +246,36 @@ - + - - - + + + - + - - + + - - - - - + + + + + - - + + @@ -322,7 +322,7 @@ - + @@ -385,10 +385,10 @@ - - - - + + + + @@ -401,7 +401,7 @@ - + @@ -415,7 +415,7 @@ - + @@ -429,8 +429,8 @@ - - + + @@ -443,7 +443,7 @@ - + @@ -457,7 +457,7 @@ - + @@ -471,7 +471,7 @@ - + @@ -485,7 +485,7 @@ - + @@ -498,7 +498,7 @@ - + @@ -507,7 +507,7 @@ - + @@ -516,7 +516,7 @@ - + @@ -525,7 +525,7 @@ - + @@ -534,7 +534,7 @@ - + @@ -543,7 +543,7 @@ - + @@ -552,7 +552,7 @@ - + @@ -561,7 +561,7 @@ - + @@ -570,7 +570,7 @@ - + @@ -580,91 +580,93 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - - - - - + + + + + @@ -692,7 +694,7 @@ - + @@ -795,10 +797,10 @@ - + - + diff --git a/memory_configs.json b/memory_configs.json index 24d85f0a..9ef3189f 100644 --- a/memory_configs.json +++ b/memory_configs.json @@ -61,5 +61,7 @@ "bm-20241112-3.14.0a1+-8cc6e5c/bm-20241112-vultr-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1+-8cc6e5c.json,bm-20241112-3.14.0a1+-8cc6e5c-NOGIL/bm-20241112-vultr-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1+-8cc6e5c.json": 1.2, "bm-20241112-3.14.0a1+-8cc6e5c/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1+-8cc6e5c.json,bm-20241112-3.14.0a1+-8cc6e5c-NOGIL/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1+-8cc6e5c.json": 1.18, "bm-20241107-3.14.0a1+-85036c8/bm-20241107-vultr-x86_64-python-85036c8d612007356d21-3.14.0a1+-85036c8.json,bm-20241107-3.14.0a1+-85036c8-NOGIL/bm-20241107-vultr-x86_64-python-85036c8d612007356d21-3.14.0a1+-85036c8.json": 1.21, - "bm-20241109-3.14.0a1+-6293d00/bm-20241109-vultr-x86_64-python-6293d00e7201f3f28b1f-3.14.0a1+-6293d00.json,bm-20241109-3.14.0a1+-6293d00-NOGIL/bm-20241109-vultr-x86_64-python-6293d00e7201f3f28b1f-3.14.0a1+-6293d00.json": 1.2 + "bm-20241109-3.14.0a1+-6293d00/bm-20241109-vultr-x86_64-python-6293d00e7201f3f28b1f-3.14.0a1+-6293d00.json,bm-20241109-3.14.0a1+-6293d00-NOGIL/bm-20241109-vultr-x86_64-python-6293d00e7201f3f28b1f-3.14.0a1+-6293d00.json": 1.2, + "bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json,bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json": 1.18, + "bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json,bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json": 1.2 } \ No newline at end of file diff --git a/memory_configs.svg b/memory_configs.svg index 517d9ca3..208e88a3 100644 --- a/memory_configs.svg +++ b/memory_configs.svg @@ -10,8 +10,8 @@ - - + + @@ -31,9 +31,9 @@ - - - + + + @@ -48,9 +48,9 @@ - - - + + + @@ -65,9 +65,9 @@ - - - + + + @@ -79,9 +79,9 @@ - - - + + + @@ -93,9 +93,9 @@ - - - + + + @@ -107,9 +107,9 @@ - - - + + + @@ -121,9 +121,9 @@ - - - + + + @@ -226,78 +226,80 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + @@ -441,21 +443,21 @@ - + - + - + @@ -465,14 +467,14 @@ - + - + diff --git a/memory_long.json b/memory_long.json index 43880bfa..8058d910 100644 --- a/memory_long.json +++ b/memory_long.json @@ -97,5 +97,7 @@ "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241109-3.14.0a1+-6293d00/bm-20241109-vultr-x86_64-python-6293d00e7201f3f28b1f-3.14.0a1+-6293d00.json,3.13.0rc2": 1.0, "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241107-3.14.0a1+-85036c8/bm-20241107-vultr-x86_64-python-85036c8d612007356d21-3.14.0a1+-85036c8.json,3.13.0rc2": 1.0, "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20241112-3.14.0a1+-8cc6e5c/bm-20241112-linux-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1+-8cc6e5c.json,3.13.0rc2": 1.01, - "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241112-3.14.0a1+-8cc6e5c/bm-20241112-vultr-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1+-8cc6e5c.json,3.13.0rc2": 1.0 + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241112-3.14.0a1+-8cc6e5c/bm-20241112-vultr-x86_64-python-8cc6e5c8751139e86b2a-3.14.0a1+-8cc6e5c.json,3.13.0rc2": 1.0, + "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json,3.13.0rc2": 1.01, + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json,3.13.0rc2": 1.0 } \ No newline at end of file diff --git a/memory_long.svg b/memory_long.svg index c7eeb054..f50bc540 100644 --- a/memory_long.svg +++ b/memory_long.svg @@ -5,13 +5,13 @@ - - + + - - + + @@ -31,9 +31,9 @@ - - - + + + @@ -48,9 +48,9 @@ - - - + + + @@ -62,9 +62,9 @@ - - - + + + @@ -79,9 +79,9 @@ - - - + + + @@ -93,9 +93,9 @@ - - - + + + @@ -110,9 +110,9 @@ - - - + + + @@ -124,9 +124,9 @@ - - - + + + @@ -141,9 +141,9 @@ - - - + + + @@ -155,7 +155,7 @@ - + @@ -171,7 +171,7 @@ - + @@ -180,7 +180,7 @@ - + @@ -189,7 +189,7 @@ - + @@ -198,7 +198,7 @@ - + @@ -207,7 +207,7 @@ - + @@ -216,7 +216,7 @@ - + @@ -225,7 +225,7 @@ - + @@ -234,7 +234,7 @@ - + @@ -246,36 +246,36 @@ - + - - - + + + - + - - + + - - - - - + + + + + - - + + @@ -315,7 +315,7 @@ - + @@ -379,10 +379,10 @@ - - - - + + + + @@ -395,7 +395,7 @@ - + @@ -409,7 +409,7 @@ - + @@ -423,8 +423,8 @@ - - + + @@ -437,7 +437,7 @@ - + @@ -451,7 +451,7 @@ - + @@ -465,7 +465,7 @@ - + @@ -479,7 +479,7 @@ - + @@ -492,7 +492,7 @@ - + @@ -501,7 +501,7 @@ - + @@ -510,7 +510,7 @@ - + @@ -519,7 +519,7 @@ - + @@ -528,7 +528,7 @@ - + @@ -537,7 +537,7 @@ - + @@ -546,7 +546,7 @@ - + @@ -555,7 +555,7 @@ - + @@ -564,7 +564,7 @@ - + @@ -574,90 +574,92 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - - - - - + + + + + @@ -684,7 +686,7 @@ - + @@ -783,10 +785,10 @@ - + - + diff --git a/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/README.md b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/README.md new file mode 100644 index 00000000..51ec739f --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/README.md @@ -0,0 +1,72 @@ +# Results + +- fork: python +- version: 3.14.0a1+ +- config: NOGIL +- commit hash: [4ae5061](https://github.com/python/cpython/commit/4ae5061) +- commit date: 2024-11-13T15:45:08-08:00 +- commit merge base: [fd4b5453df74e249987553b12c14ad75fafa4991](https://github.com/python/cpython/commit/fd4b5453df74e249987553b12c14ad75fafa4991) +- ref: 4ae50615d2beef0f93d9 + +## linux x86_64 (linux) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/11828233702) +- cpu model: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz +- platform: Linux-5.15.0-1071-aws-x86_64-with-glibc2.31 +- [raw results](bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061.json) + +### vs. 3.12.6 + +- Geometric mean: 1.47x slower (HPT: reliability of 100.00%, 1.39x slower at 99th %ile) +- Memory usage: 1.20x +- missing benchmarks: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, mypy2, sqlalchemy_declarative, sqlalchemy_imperative, tornado_http +- [📄table](bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.md) +- [📈time plot](bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.49x slower (HPT: reliability of 100.00%, 1.39x slower at 99th %ile) +- Memory usage: 1.19x +- missing benchmarks: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, tornado_http +- [📄table](bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.md) +- [📈time plot](bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.svg) + +### vs. base + +- Geometric mean: 1.47x slower (HPT: reliability of 100.00%, 1.39x slower at 99th %ile) +- Memory usage: 1.18x +- [🧠memory plot](bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-base-mem.svg) +- [📄table](bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-base.md) +- [📈time plot](bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-base.svg) + +## linux x86_64 (vultr) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/11828233702) +- cpu model: Intel(R) Xeon(R) E-2286G CPU @ 4.00GHz +- platform: Linux-6.8.0-45-generic-x86_64-with-glibc2.39 +- [raw results](bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061.json) + +### vs. 3.12.6 + +- Geometric mean: 1.55x slower (HPT: reliability of 100.00%, 1.38x slower at 99th %ile) +- Memory usage: 1.23x +- missing benchmarks: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, mypy2, sqlalchemy_declarative, sqlalchemy_imperative, tornado_http +- [📄table](bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.md) +- [📈time plot](bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.57x slower (HPT: reliability of 100.00%, 1.40x slower at 99th %ile) +- Memory usage: 1.21x +- missing benchmarks: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, tornado_http +- [📄table](bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.md) +- [📈time plot](bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.svg) + +### vs. base + +- Geometric mean: 1.54x slower (HPT: reliability of 100.00%, 1.40x slower at 99th %ile) +- Memory usage: 1.20x +- [🧠memory plot](bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-base-mem.svg) +- [📄table](bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-base.md) +- [📈time plot](bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-base.svg) + diff --git a/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.md b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.md new file mode 100644 index 00000000..38330b8e --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.md @@ -0,0 +1,199 @@ +# Results vs. 3.12.6 + +- fork: python +- ref: 4ae50615d2beef0f93d9 +- machine: linux-x86_64 +- commit hash: 4ae5061 +- commit date: 2024-11-13 +- overall geometric mean: 1.47x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.39x slower +- Memory change: 1.20x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 456 ms | 659 ms: 1.44x slower | +| docutils | 4.00 sec | 4.84 sec: 1.21x slower | +| html5lib | 88.9 ms | 136 ms: 1.53x slower | +| Geometric mean | (ref) | 1.39x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_generators | 589 ms | 693 ms: 1.18x slower | +| asyncio_tcp_ssl | 2.81 sec | 3.43 sec: 1.22x slower | +| asyncio_tcp | 923 ms | 1.13 sec: 1.22x slower | +| coroutines | 29.5 ms | 41.7 ms: 1.41x slower | +| Geometric mean | (ref) | 1.20x slower | + +Benchmark hidden because not significant (1): asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 250 ms | 264 ms: 1.06x slower | +| float | 123 ms | 218 ms: 1.77x slower | +| nbody | 119 ms | 269 ms: 2.26x slower | +| Geometric mean | (ref) | 1.62x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 5.13 ms | 4.73 ms: 1.08x faster | +| regex_v8 | 32.5 ms | 34.6 ms: 1.06x slower | +| regex_compile | 187 ms | 282 ms: 1.51x slower | +| Geometric mean | (ref) | 1.11x slower | + +Benchmark hidden because not significant (1): regex_dna + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| pickle_dict | 52.7 us | 45.9 us: 1.15x faster | +| xml_etree_parse | 241 ms | 226 ms: 1.07x faster | +| unpickle | 21.2 us | 22.8 us: 1.07x slower | +| unpickle_list | 6.83 us | 7.48 us: 1.09x slower | +| pickle_list | 6.97 us | 7.68 us: 1.10x slower | +| json_loads | 37.9 us | 41.8 us: 1.10x slower | +| xml_etree_generate | 127 ms | 160 ms: 1.26x slower | +| tomli_loads | 2.88 sec | 4.12 sec: 1.43x slower | +| xml_etree_process | 83.7 ms | 125 ms: 1.50x slower | +| json_dumps | 14.3 ms | 22.4 ms: 1.56x slower | +| unpickle_pure_python | 300 us | 549 us: 1.83x slower | +| pickle_pure_python | 436 us | 842 us: 1.93x slower | +| Geometric mean | (ref) | 1.22x slower | + +Benchmark hidden because not significant (2): pickle, xml_etree_iterparse + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 17.6 ms | 19.9 ms: 1.13x slower | +| python_startup | 23.7 ms | 31.2 ms: 1.32x slower | +| Geometric mean | (ref) | 1.22x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|-----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 67.6 ms | 123 ms: 1.82x slower | +| django_template | 44.9 ms | 83.8 ms: 1.86x slower | +| genshi_text | 30.2 ms | 59.5 ms: 1.97x slower | +| mako | 15.7 ms | 32.1 ms: 2.04x slower | +| Geometric mean | (ref) | 1.92x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|--------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| gc_traversal | 5.86 ms | 4.45 ms: 1.32x faster | +| pickle_dict | 52.7 us | 45.9 us: 1.15x faster | +| regex_effbot | 5.13 ms | 4.73 ms: 1.08x faster | +| xml_etree_parse | 241 ms | 226 ms: 1.07x faster | +| pidigits | 250 ms | 264 ms: 1.06x slower | +| regex_v8 | 32.5 ms | 34.6 ms: 1.06x slower | +| unpickle | 21.2 us | 22.8 us: 1.07x slower | +| unpickle_list | 6.83 us | 7.48 us: 1.09x slower | +| pickle_list | 6.97 us | 7.68 us: 1.10x slower | +| json_loads | 37.9 us | 41.8 us: 1.10x slower | +| bench_thread_pool | 3.48 ms | 3.86 ms: 1.11x slower | +| python_startup_no_site | 17.6 ms | 19.9 ms: 1.13x slower | +| sqlite_synth | 3.87 us | 4.45 us: 1.15x slower | +| async_generators | 589 ms | 693 ms: 1.18x slower | +| pycparser | 1.79 sec | 2.11 sec: 1.18x slower | +| json | 6.85 ms | 8.10 ms: 1.18x slower | +| scimark_fft | 500 ms | 596 ms: 1.19x slower | +| docutils | 4.00 sec | 4.84 sec: 1.21x slower | +| asyncio_tcp_ssl | 2.81 sec | 3.43 sec: 1.22x slower | +| asyncio_tcp | 923 ms | 1.13 sec: 1.22x slower | +| deepcopy | 468 us | 586 us: 1.25x slower | +| xml_etree_generate | 127 ms | 160 ms: 1.26x slower | +| pylint | 465 ms | 591 ms: 1.27x slower | +| mdp | 3.97 sec | 5.12 sec: 1.29x slower | +| python_startup | 23.7 ms | 31.2 ms: 1.32x slower | +| scimark_sparse_mat_mult | 6.70 ms | 8.88 ms: 1.32x slower | +| nqueens | 117 ms | 161 ms: 1.38x slower | +| deepcopy_memo | 52.4 us | 72.6 us: 1.38x slower | +| comprehensions | 27.1 us | 37.7 us: 1.39x slower | +| telco | 9.59 ms | 13.5 ms: 1.41x slower | +| coroutines | 29.5 ms | 41.7 ms: 1.41x slower | +| tomli_loads | 2.88 sec | 4.12 sec: 1.43x slower | +| generators | 41.1 ms | 59.1 ms: 1.44x slower | +| 2to3 | 456 ms | 659 ms: 1.44x slower | +| bpe_tokeniser | 6.59 sec | 9.54 sec: 1.45x slower | +| crypto_pyaes | 107 ms | 156 ms: 1.45x slower | +| dulwich_log | 100 ms | 146 ms: 1.45x slower | +| pyflate | 727 ms | 1.06 sec: 1.46x slower | +| meteor_contest | 146 ms | 215 ms: 1.47x slower | +| deepcopy_reduce | 4.04 us | 5.94 us: 1.47x slower | +| fannkuch | 540 ms | 802 ms: 1.48x slower | +| spectral_norm | 156 ms | 231 ms: 1.49x slower | +| xml_etree_process | 83.7 ms | 125 ms: 1.50x slower | +| sqlglot_normalize | 157 ms | 236 ms: 1.50x slower | +| coverage | 95.4 ms | 144 ms: 1.51x slower | +| regex_compile | 187 ms | 282 ms: 1.51x slower | +| html5lib | 88.9 ms | 136 ms: 1.53x slower | +| typing_runtime_protocols | 224 us | 348 us: 1.55x slower | +| json_dumps | 14.3 ms | 22.4 ms: 1.56x slower | +| logging_simple | 9.45 us | 14.9 us: 1.58x slower | +| sympy_integrate | 29.8 ms | 47.0 ms: 1.58x slower | +| sqlglot_optimize | 76.0 ms | 122 ms: 1.61x slower | +| scimark_monte_carlo | 96.4 ms | 158 ms: 1.64x slower | +| thrift | 1.06 ms | 1.79 ms: 1.69x slower | +| pprint_pformat | 1.98 sec | 3.34 sec: 1.69x slower | +| sympy_str | 385 ms | 659 ms: 1.71x slower | +| pprint_safe_repr | 967 ms | 1.66 sec: 1.71x slower | +| float | 123 ms | 218 ms: 1.77x slower | +| raytrace | 408 ms | 734 ms: 1.80x slower | +| genshi_xml | 67.6 ms | 123 ms: 1.82x slower | +| richards_super | 72.8 ms | 133 ms: 1.83x slower | +| unpickle_pure_python | 300 us | 549 us: 1.83x slower | +| logging_format | 9.59 us | 17.7 us: 1.85x slower | +| chaos | 84.9 ms | 158 ms: 1.86x slower | +| django_template | 44.9 ms | 83.8 ms: 1.86x slower | +| hexiom | 8.27 ms | 15.5 ms: 1.87x slower | +| sqlglot_transpile | 2.34 ms | 4.43 ms: 1.90x slower | +| logging_silent | 139 ns | 265 ns: 1.90x slower | +| scimark_lu | 152 ms | 292 ms: 1.92x slower | +| richards | 60.3 ms | 116 ms: 1.93x slower | +| pickle_pure_python | 436 us | 842 us: 1.93x slower | +| genshi_text | 30.2 ms | 59.5 ms: 1.97x slower | +| mako | 15.7 ms | 32.1 ms: 2.04x slower | +| sympy_sum | 222 ms | 462 ms: 2.08x slower | +| scimark_sor | 167 ms | 352 ms: 2.11x slower | +| go | 172 ms | 383 ms: 2.23x slower | +| sqlglot_parse | 1.79 ms | 4.01 ms: 2.24x slower | +| sympy_expand | 582 ms | 1.31 sec: 2.25x slower | +| nbody | 119 ms | 269 ms: 2.26x slower | +| deltablue | 4.27 ms | 11.8 ms: 2.78x slower | +| bench_mp_pool | 20.7 ms | 66.3 ms: 3.20x slower | +| unpack_sequence | 60.2 ns | 200 ns: 3.32x slower | +| Geometric mean | (ref) | 1.47x slower | + +Benchmark hidden because not significant (6): pickle, create_gc_cycles, xml_etree_iterparse, asyncio_websockets, regex_dna, pathlib +Ignored benchmarks (17) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, mypy2, sqlalchemy_declarative, sqlalchemy_imperative, tornado_http + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.43x +- 95% likely to have a slowdown of 1.42x +- 99% likely to have a slowdown of 1.39x + +# Memory +- memory change: 1.20x \ No newline at end of file diff --git a/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.svg b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.svg new file mode 100644 index 00000000..82cb148e --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.svg @@ -0,0 +1,3080 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.md b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.md new file mode 100644 index 00000000..1228d7ba --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.md @@ -0,0 +1,197 @@ +# Results vs. 3.13.0rc2 + +- fork: python +- ref: 4ae50615d2beef0f93d9 +- machine: linux-x86_64 +- commit hash: 4ae5061 +- commit date: 2024-11-13 +- overall geometric mean: 1.49x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.39x slower +- Memory change: 1.19x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 445 ms | 659 ms: 1.48x slower | +| docutils | 4.01 sec | 4.84 sec: 1.21x slower | +| html5lib | 92.6 ms | 136 ms: 1.47x slower | +| Geometric mean | (ref) | 1.38x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| asyncio_tcp | 948 ms | 1.13 sec: 1.19x slower | +| async_generators | 567 ms | 693 ms: 1.22x slower | +| asyncio_tcp_ssl | 2.77 sec | 3.43 sec: 1.23x slower | +| coroutines | 30.9 ms | 41.7 ms: 1.35x slower | +| Geometric mean | (ref) | 1.19x slower | + +Benchmark hidden because not significant (1): asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 251 ms | 264 ms: 1.05x slower | +| float | 116 ms | 218 ms: 1.88x slower | +| nbody | 119 ms | 269 ms: 2.26x slower | +| Geometric mean | (ref) | 1.65x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_v8 | 32.8 ms | 34.6 ms: 1.05x slower | +| regex_compile | 182 ms | 282 ms: 1.55x slower | +| Geometric mean | (ref) | 1.13x slower | + +Benchmark hidden because not significant (2): regex_effbot, regex_dna + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| pickle | 15.1 us | 15.9 us: 1.05x slower | +| unpickle | 20.5 us | 22.8 us: 1.11x slower | +| pickle_list | 6.86 us | 7.68 us: 1.12x slower | +| unpickle_list | 6.68 us | 7.48 us: 1.12x slower | +| json_loads | 34.3 us | 41.8 us: 1.22x slower | +| xml_etree_generate | 122 ms | 160 ms: 1.31x slower | +| xml_etree_process | 85.9 ms | 125 ms: 1.46x slower | +| tomli_loads | 2.78 sec | 4.12 sec: 1.48x slower | +| json_dumps | 14.1 ms | 22.4 ms: 1.58x slower | +| unpickle_pure_python | 290 us | 549 us: 1.89x slower | +| pickle_pure_python | 416 us | 842 us: 2.02x slower | +| Geometric mean | (ref) | 1.27x slower | + +Benchmark hidden because not significant (3): xml_etree_iterparse, pickle_dict, xml_etree_parse + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 15.3 ms | 19.9 ms: 1.30x slower | +| python_startup | 22.4 ms | 31.2 ms: 1.39x slower | +| Geometric mean | (ref) | 1.35x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|-----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 72.1 ms | 123 ms: 1.71x slower | +| genshi_text | 31.7 ms | 59.5 ms: 1.88x slower | +| django_template | 44.3 ms | 83.8 ms: 1.89x slower | +| mako | 15.9 ms | 32.1 ms: 2.01x slower | +| Geometric mean | (ref) | 1.87x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|--------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| gc_traversal | 5.70 ms | 4.45 ms: 1.28x faster | +| create_gc_cycles | 2.41 ms | 1.92 ms: 1.25x faster | +| pickle | 15.1 us | 15.9 us: 1.05x slower | +| pidigits | 251 ms | 264 ms: 1.05x slower | +| regex_v8 | 32.8 ms | 34.6 ms: 1.05x slower | +| pathlib | 29.9 ms | 32.6 ms: 1.09x slower | +| unpickle | 20.5 us | 22.8 us: 1.11x slower | +| telco | 12.2 ms | 13.5 ms: 1.11x slower | +| sqlite_synth | 3.99 us | 4.45 us: 1.12x slower | +| pickle_list | 6.86 us | 7.68 us: 1.12x slower | +| unpickle_list | 6.68 us | 7.48 us: 1.12x slower | +| deepcopy | 498 us | 586 us: 1.18x slower | +| asyncio_tcp | 948 ms | 1.13 sec: 1.19x slower | +| docutils | 4.01 sec | 4.84 sec: 1.21x slower | +| json_loads | 34.3 us | 41.8 us: 1.22x slower | +| async_generators | 567 ms | 693 ms: 1.22x slower | +| asyncio_tcp_ssl | 2.77 sec | 3.43 sec: 1.23x slower | +| json | 6.51 ms | 8.10 ms: 1.24x slower | +| pylint | 470 ms | 591 ms: 1.26x slower | +| scimark_fft | 473 ms | 596 ms: 1.26x slower | +| python_startup_no_site | 15.3 ms | 19.9 ms: 1.30x slower | +| xml_etree_generate | 122 ms | 160 ms: 1.31x slower | +| scimark_sparse_mat_mult | 6.76 ms | 8.88 ms: 1.31x slower | +| bench_thread_pool | 2.89 ms | 3.86 ms: 1.34x slower | +| coverage | 107 ms | 144 ms: 1.34x slower | +| pycparser | 1.57 sec | 2.11 sec: 1.34x slower | +| mdp | 3.80 sec | 5.12 sec: 1.35x slower | +| coroutines | 30.9 ms | 41.7 ms: 1.35x slower | +| python_startup | 22.4 ms | 31.2 ms: 1.39x slower | +| meteor_contest | 150 ms | 215 ms: 1.43x slower | +| nqueens | 112 ms | 161 ms: 1.44x slower | +| deepcopy_memo | 50.1 us | 72.6 us: 1.45x slower | +| deepcopy_reduce | 4.10 us | 5.94 us: 1.45x slower | +| xml_etree_process | 85.9 ms | 125 ms: 1.46x slower | +| fannkuch | 547 ms | 802 ms: 1.47x slower | +| html5lib | 92.6 ms | 136 ms: 1.47x slower | +| generators | 40.0 ms | 59.1 ms: 1.48x slower | +| spectral_norm | 157 ms | 231 ms: 1.48x slower | +| 2to3 | 445 ms | 659 ms: 1.48x slower | +| tomli_loads | 2.78 sec | 4.12 sec: 1.48x slower | +| bpe_tokeniser | 6.28 sec | 9.54 sec: 1.52x slower | +| typing_runtime_protocols | 226 us | 348 us: 1.54x slower | +| regex_compile | 182 ms | 282 ms: 1.55x slower | +| crypto_pyaes | 100 ms | 156 ms: 1.55x slower | +| dulwich_log | 93.7 ms | 146 ms: 1.56x slower | +| sympy_integrate | 30.2 ms | 47.0 ms: 1.56x slower | +| json_dumps | 14.1 ms | 22.4 ms: 1.58x slower | +| pyflate | 664 ms | 1.06 sec: 1.60x slower | +| thrift | 1.10 ms | 1.79 ms: 1.62x slower | +| sqlglot_optimize | 74.7 ms | 122 ms: 1.63x slower | +| pprint_safe_repr | 987 ms | 1.66 sec: 1.68x slower | +| sqlglot_normalize | 140 ms | 236 ms: 1.69x slower | +| comprehensions | 22.2 us | 37.7 us: 1.70x slower | +| genshi_xml | 72.1 ms | 123 ms: 1.71x slower | +| pprint_pformat | 1.94 sec | 3.34 sec: 1.72x slower | +| sympy_str | 379 ms | 659 ms: 1.74x slower | +| logging_simple | 8.56 us | 14.9 us: 1.74x slower | +| scimark_monte_carlo | 90.6 ms | 158 ms: 1.75x slower | +| richards | 65.5 ms | 116 ms: 1.77x slower | +| richards_super | 73.2 ms | 133 ms: 1.82x slower | +| genshi_text | 31.7 ms | 59.5 ms: 1.88x slower | +| float | 116 ms | 218 ms: 1.88x slower | +| unpickle_pure_python | 290 us | 549 us: 1.89x slower | +| django_template | 44.3 ms | 83.8 ms: 1.89x slower | +| chaos | 83.6 ms | 158 ms: 1.89x slower | +| hexiom | 8.11 ms | 15.5 ms: 1.91x slower | +| logging_format | 9.24 us | 17.7 us: 1.92x slower | +| scimark_sor | 179 ms | 352 ms: 1.97x slower | +| scimark_lu | 146 ms | 292 ms: 2.00x slower | +| go | 191 ms | 383 ms: 2.01x slower | +| mako | 15.9 ms | 32.1 ms: 2.01x slower | +| sqlglot_transpile | 2.20 ms | 4.43 ms: 2.02x slower | +| pickle_pure_python | 416 us | 842 us: 2.02x slower | +| logging_silent | 130 ns | 265 ns: 2.04x slower | +| raytrace | 344 ms | 734 ms: 2.13x slower | +| sympy_expand | 601 ms | 1.31 sec: 2.18x slower | +| sympy_sum | 210 ms | 462 ms: 2.20x slower | +| nbody | 119 ms | 269 ms: 2.26x slower | +| sqlglot_parse | 1.76 ms | 4.01 ms: 2.28x slower | +| deltablue | 4.44 ms | 11.8 ms: 2.67x slower | +| unpack_sequence | 74.3 ns | 200 ns: 2.69x slower | +| bench_mp_pool | 18.7 ms | 66.3 ms: 3.54x slower | +| Geometric mean | (ref) | 1.49x slower | + +Benchmark hidden because not significant (6): xml_etree_iterparse, pickle_dict, asyncio_websockets, xml_etree_parse, regex_effbot, regex_dna +Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, tornado_http + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.45x +- 95% likely to have a slowdown of 1.44x +- 99% likely to have a slowdown of 1.39x + +# Memory +- memory change: 1.19x \ No newline at end of file diff --git a/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.svg b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.svg new file mode 100644 index 00000000..1cbefb44 --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.svg @@ -0,0 +1,3102 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base-mem.svg b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base-mem.svg new file mode 100644 index 00000000..be0f914f --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base-mem.svg @@ -0,0 +1,3081 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base.md b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base.md new file mode 100644 index 00000000..0fa75b7e --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base.md @@ -0,0 +1,194 @@ +# Results vs. base + +- fork: python +- ref: 4ae50615d2beef0f93d9 +- machine: linux-x86_64 +- commit hash: 4ae5061 +- commit date: 2024-11-13 +- overall geometric mean: 1.47x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.39x slower +- Memory change: 1.18x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| 2to3 | 448 ms | 659 ms: 1.47x slower | +| docutils | 3.87 sec | 4.84 sec: 1.25x slower | +| html5lib | 87.9 ms | 136 ms: 1.55x slower | +| Geometric mean | (ref) | 1.42x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | +|------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| asyncio_tcp | 968 ms | 1.13 sec: 1.17x slower | +| async_generators | 586 ms | 693 ms: 1.18x slower | +| coroutines | 34.9 ms | 41.7 ms: 1.19x slower | +| asyncio_tcp_ssl | 2.78 sec | 3.43 sec: 1.23x slower | +| Geometric mean | (ref) | 1.15x slower | + +Benchmark hidden because not significant (1): asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| pidigits | 250 ms | 264 ms: 1.06x slower | +| float | 117 ms | 218 ms: 1.86x slower | +| nbody | 130 ms | 269 ms: 2.06x slower | +| Geometric mean | (ref) | 1.60x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| regex_dna | 273 ms | 284 ms: 1.04x slower | +| regex_compile | 174 ms | 282 ms: 1.62x slower | +| Geometric mean | (ref) | 1.14x slower | + +Benchmark hidden because not significant (2): regex_effbot, regex_v8 + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | +|----------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| pickle | 17.5 us | 15.9 us: 1.10x faster | +| unpickle_list | 6.71 us | 7.48 us: 1.11x slower | +| unpickle | 20.2 us | 22.8 us: 1.13x slower | +| json_loads | 36.4 us | 41.8 us: 1.15x slower | +| xml_etree_generate | 130 ms | 160 ms: 1.23x slower | +| tomli_loads | 2.83 sec | 4.12 sec: 1.46x slower | +| json_dumps | 15.3 ms | 22.4 ms: 1.47x slower | +| xml_etree_process | 82.3 ms | 125 ms: 1.52x slower | +| pickle_pure_python | 441 us | 842 us: 1.91x slower | +| unpickle_pure_python | 286 us | 549 us: 1.92x slower | +| Geometric mean | (ref) | 1.23x slower | + +Benchmark hidden because not significant (4): pickle_dict, xml_etree_parse, xml_etree_iterparse, pickle_list + +Benchmarks with tag 'startup': +============================== + +| Benchmark | results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | +|------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| python_startup_no_site | 15.4 ms | 19.9 ms: 1.29x slower | +| python_startup | 22.4 ms | 31.2 ms: 1.40x slower | +| Geometric mean | (ref) | 1.34x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | +|-----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| django_template | 47.6 ms | 83.8 ms: 1.76x slower | +| genshi_xml | 67.6 ms | 123 ms: 1.83x slower | +| genshi_text | 32.0 ms | 59.5 ms: 1.86x slower | +| mako | 16.4 ms | 32.1 ms: 1.96x slower | +| Geometric mean | (ref) | 1.85x slower | + +All benchmarks: +=============== + +| Benchmark | results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | +|--------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| gc_traversal | 6.18 ms | 4.45 ms: 1.39x faster | +| create_gc_cycles | 2.49 ms | 1.92 ms: 1.29x faster | +| pickle | 17.5 us | 15.9 us: 1.10x faster | +| bench_mp_pool | 72.1 ms | 66.3 ms: 1.09x faster | +| regex_dna | 273 ms | 284 ms: 1.04x slower | +| pidigits | 250 ms | 264 ms: 1.06x slower | +| coverage | 132 ms | 144 ms: 1.09x slower | +| unpickle_list | 6.71 us | 7.48 us: 1.11x slower | +| unpickle | 20.2 us | 22.8 us: 1.13x slower | +| pathlib | 28.7 ms | 32.6 ms: 1.14x slower | +| sqlite_synth | 3.88 us | 4.45 us: 1.15x slower | +| json_loads | 36.4 us | 41.8 us: 1.15x slower | +| asyncio_tcp | 968 ms | 1.13 sec: 1.17x slower | +| async_generators | 586 ms | 693 ms: 1.18x slower | +| json | 6.84 ms | 8.10 ms: 1.18x slower | +| coroutines | 34.9 ms | 41.7 ms: 1.19x slower | +| pylint | 486 ms | 591 ms: 1.22x slower | +| xml_etree_generate | 130 ms | 160 ms: 1.23x slower | +| telco | 11.0 ms | 13.5 ms: 1.23x slower | +| asyncio_tcp_ssl | 2.78 sec | 3.43 sec: 1.23x slower | +| scimark_fft | 478 ms | 596 ms: 1.25x slower | +| docutils | 3.87 sec | 4.84 sec: 1.25x slower | +| pycparser | 1.68 sec | 2.11 sec: 1.26x slower | +| python_startup_no_site | 15.4 ms | 19.9 ms: 1.29x slower | +| bench_thread_pool | 2.93 ms | 3.86 ms: 1.32x slower | +| scimark_sparse_mat_mult | 6.52 ms | 8.88 ms: 1.36x slower | +| python_startup | 22.4 ms | 31.2 ms: 1.40x slower | +| mdp | 3.61 sec | 5.12 sec: 1.42x slower | +| tomli_loads | 2.83 sec | 4.12 sec: 1.46x slower | +| spectral_norm | 159 ms | 231 ms: 1.46x slower | +| json_dumps | 15.3 ms | 22.4 ms: 1.47x slower | +| 2to3 | 448 ms | 659 ms: 1.47x slower | +| nqueens | 108 ms | 161 ms: 1.49x slower | +| fannkuch | 537 ms | 802 ms: 1.49x slower | +| generators | 39.5 ms | 59.1 ms: 1.49x slower | +| dulwich_log | 97.5 ms | 146 ms: 1.50x slower | +| meteor_contest | 144 ms | 215 ms: 1.50x slower | +| xml_etree_process | 82.3 ms | 125 ms: 1.52x slower | +| html5lib | 87.9 ms | 136 ms: 1.55x slower | +| pyflate | 676 ms | 1.06 sec: 1.57x slower | +| crypto_pyaes | 98.9 ms | 156 ms: 1.57x slower | +| bpe_tokeniser | 6.06 sec | 9.54 sec: 1.57x slower | +| typing_runtime_protocols | 221 us | 348 us: 1.58x slower | +| sympy_integrate | 29.6 ms | 47.0 ms: 1.59x slower | +| deepcopy | 364 us | 586 us: 1.61x slower | +| regex_compile | 174 ms | 282 ms: 1.62x slower | +| deepcopy_reduce | 3.65 us | 5.94 us: 1.63x slower | +| thrift | 1.09 ms | 1.79 ms: 1.64x slower | +| sqlglot_normalize | 143 ms | 236 ms: 1.65x slower | +| sqlglot_optimize | 72.3 ms | 122 ms: 1.69x slower | +| logging_simple | 8.76 us | 14.9 us: 1.70x slower | +| comprehensions | 22.1 us | 37.7 us: 1.71x slower | +| richards | 67.7 ms | 116 ms: 1.72x slower | +| scimark_monte_carlo | 91.8 ms | 158 ms: 1.72x slower | +| pprint_pformat | 1.94 sec | 3.34 sec: 1.73x slower | +| sympy_str | 376 ms | 659 ms: 1.75x slower | +| django_template | 47.6 ms | 83.8 ms: 1.76x slower | +| pprint_safe_repr | 930 ms | 1.66 sec: 1.78x slower | +| genshi_xml | 67.6 ms | 123 ms: 1.83x slower | +| deepcopy_memo | 39.5 us | 72.6 us: 1.84x slower | +| sqlglot_transpile | 2.40 ms | 4.43 ms: 1.85x slower | +| chaos | 85.5 ms | 158 ms: 1.85x slower | +| hexiom | 8.33 ms | 15.5 ms: 1.86x slower | +| genshi_text | 32.0 ms | 59.5 ms: 1.86x slower | +| float | 117 ms | 218 ms: 1.86x slower | +| richards_super | 71.2 ms | 133 ms: 1.87x slower | +| scimark_lu | 155 ms | 292 ms: 1.89x slower | +| logging_silent | 140 ns | 265 ns: 1.90x slower | +| pickle_pure_python | 441 us | 842 us: 1.91x slower | +| unpickle_pure_python | 286 us | 549 us: 1.92x slower | +| logging_format | 9.21 us | 17.7 us: 1.92x slower | +| mako | 16.4 ms | 32.1 ms: 1.96x slower | +| scimark_sor | 175 ms | 352 ms: 2.00x slower | +| raytrace | 362 ms | 734 ms: 2.03x slower | +| nbody | 130 ms | 269 ms: 2.06x slower | +| sympy_sum | 222 ms | 462 ms: 2.08x slower | +| go | 176 ms | 383 ms: 2.18x slower | +| sympy_expand | 597 ms | 1.31 sec: 2.19x slower | +| sqlglot_parse | 1.82 ms | 4.01 ms: 2.20x slower | +| deltablue | 4.57 ms | 11.8 ms: 2.59x slower | +| unpack_sequence | 75.2 ns | 200 ns: 2.65x slower | +| Geometric mean | (ref) | 1.47x slower | + +Benchmark hidden because not significant (7): pickle_dict, xml_etree_parse, xml_etree_iterparse, regex_effbot, regex_v8, asyncio_websockets, pickle_list + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.45x +- 95% likely to have a slowdown of 1.44x +- 99% likely to have a slowdown of 1.39x + +# Memory +- memory change: 1.18x \ No newline at end of file diff --git a/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base.svg b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base.svg new file mode 100644 index 00000000..484ac476 --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base.svg @@ -0,0 +1,3104 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.md b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.md new file mode 100644 index 00000000..24e70eff --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.md @@ -0,0 +1,201 @@ +# Results vs. 3.12.6 + +- fork: python +- ref: 4ae50615d2beef0f93d9 +- machine: linux-x86_64 +- commit hash: 4ae5061 +- commit date: 2024-11-13 +- overall geometric mean: 1.55x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.38x slower +- Memory change: 1.23x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 264 ms | 416 ms: 1.58x slower | +| docutils | 2.64 sec | 3.39 sec: 1.29x slower | +| html5lib | 63.6 ms | 104 ms: 1.64x slower | +| Geometric mean | (ref) | 1.49x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|--------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| asyncio_websockets | 517 ms | 519 ms: 1.00x slower | +| asyncio_tcp | 519 ms | 583 ms: 1.12x slower | +| asyncio_tcp_ssl | 1.51 sec | 1.83 sec: 1.22x slower | +| coroutines | 23.9 ms | 30.8 ms: 1.29x slower | +| async_generators | 384 ms | 496 ms: 1.29x slower | +| Geometric mean | (ref) | 1.18x slower | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 184 ms | 186 ms: 1.01x slower | +| float | 80.8 ms | 152 ms: 1.88x slower | +| nbody | 89.3 ms | 199 ms: 2.22x slower | +| Geometric mean | (ref) | 1.62x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 3.17 ms | 3.09 ms: 1.02x faster | +| regex_dna | 168 ms | 184 ms: 1.10x slower | +| regex_v8 | 20.6 ms | 25.2 ms: 1.22x slower | +| regex_compile | 142 ms | 232 ms: 1.63x slower | +| Geometric mean | (ref) | 1.21x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_parse | 139 ms | 133 ms: 1.04x faster | +| pickle_dict | 31.8 us | 31.5 us: 1.01x faster | +| unpickle | 14.1 us | 14.4 us: 1.02x slower | +| unpickle_list | 4.67 us | 5.03 us: 1.08x slower | +| json_loads | 26.5 us | 28.7 us: 1.08x slower | +| pickle_list | 4.77 us | 5.17 us: 1.08x slower | +| pickle | 10.9 us | 12.0 us: 1.09x slower | +| xml_etree_iterparse | 96.7 ms | 110 ms: 1.14x slower | +| xml_etree_generate | 85.2 ms | 115 ms: 1.35x slower | +| json_dumps | 10.4 ms | 15.3 ms: 1.47x slower | +| tomli_loads | 2.11 sec | 3.23 sec: 1.54x slower | +| xml_etree_process | 59.0 ms | 93.9 ms: 1.59x slower | +| unpickle_pure_python | 221 us | 428 us: 1.94x slower | +| pickle_pure_python | 308 us | 632 us: 2.05x slower | +| Geometric mean | (ref) | 1.27x slower | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 7.16 ms | 10.3 ms: 1.43x slower | +| python_startup | 9.93 ms | 15.7 ms: 1.58x slower | +| Geometric mean | (ref) | 1.50x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|-----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 50.2 ms | 82.8 ms: 1.65x slower | +| genshi_text | 22.8 ms | 40.5 ms: 1.78x slower | +| django_template | 34.7 ms | 64.7 ms: 1.87x slower | +| mako | 11.0 ms | 20.8 ms: 1.89x slower | +| Geometric mean | (ref) | 1.79x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|--------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| gc_traversal | 3.46 ms | 2.47 ms: 1.40x faster | +| xml_etree_parse | 139 ms | 133 ms: 1.04x faster | +| regex_effbot | 3.17 ms | 3.09 ms: 1.02x faster | +| pickle_dict | 31.8 us | 31.5 us: 1.01x faster | +| asyncio_websockets | 517 ms | 519 ms: 1.00x slower | +| pidigits | 184 ms | 186 ms: 1.01x slower | +| pathlib | 21.5 ms | 21.9 ms: 1.02x slower | +| unpickle | 14.1 us | 14.4 us: 1.02x slower | +| create_gc_cycles | 1.09 ms | 1.13 ms: 1.03x slower | +| json | 5.02 ms | 5.26 ms: 1.05x slower | +| unpickle_list | 4.67 us | 5.03 us: 1.08x slower | +| json_loads | 26.5 us | 28.7 us: 1.08x slower | +| pickle_list | 4.77 us | 5.17 us: 1.08x slower | +| pickle | 10.9 us | 12.0 us: 1.09x slower | +| regex_dna | 168 ms | 184 ms: 1.10x slower | +| sqlite_synth | 2.20 us | 2.46 us: 1.12x slower | +| asyncio_tcp | 519 ms | 583 ms: 1.12x slower | +| xml_etree_iterparse | 96.7 ms | 110 ms: 1.14x slower | +| scimark_fft | 342 ms | 415 ms: 1.21x slower | +| asyncio_tcp_ssl | 1.51 sec | 1.83 sec: 1.22x slower | +| regex_v8 | 20.6 ms | 25.2 ms: 1.22x slower | +| deepcopy | 352 us | 439 us: 1.25x slower | +| generators | 32.2 ms | 41.3 ms: 1.28x slower | +| docutils | 2.64 sec | 3.39 sec: 1.29x slower | +| coroutines | 23.9 ms | 30.8 ms: 1.29x slower | +| async_generators | 384 ms | 496 ms: 1.29x slower | +| mdp | 2.42 sec | 3.14 sec: 1.30x slower | +| scimark_sparse_mat_mult | 4.39 ms | 5.71 ms: 1.30x slower | +| bpe_tokeniser | 4.74 sec | 6.17 sec: 1.30x slower | +| dulwich_log | 78.9 ms | 104 ms: 1.32x slower | +| pylint | 319 ms | 422 ms: 1.32x slower | +| meteor_contest | 104 ms | 139 ms: 1.34x slower | +| deepcopy_memo | 40.3 us | 54.3 us: 1.35x slower | +| xml_etree_generate | 85.2 ms | 115 ms: 1.35x slower | +| crypto_pyaes | 76.6 ms | 109 ms: 1.42x slower | +| telco | 6.53 ms | 9.26 ms: 1.42x slower | +| python_startup_no_site | 7.16 ms | 10.3 ms: 1.43x slower | +| nqueens | 80.1 ms | 115 ms: 1.44x slower | +| deepcopy_reduce | 3.08 us | 4.52 us: 1.47x slower | +| json_dumps | 10.4 ms | 15.3 ms: 1.47x slower | +| coverage | 71.4 ms | 105 ms: 1.48x slower | +| spectral_norm | 110 ms | 163 ms: 1.48x slower | +| pycparser | 1.17 sec | 1.73 sec: 1.48x slower | +| fannkuch | 372 ms | 561 ms: 1.51x slower | +| tomli_loads | 2.11 sec | 3.23 sec: 1.54x slower | +| comprehensions | 19.8 us | 30.9 us: 1.56x slower | +| typing_runtime_protocols | 163 us | 256 us: 1.57x slower | +| 2to3 | 264 ms | 416 ms: 1.58x slower | +| python_startup | 9.93 ms | 15.7 ms: 1.58x slower | +| xml_etree_process | 59.0 ms | 93.9 ms: 1.59x slower | +| sympy_integrate | 20.5 ms | 33.3 ms: 1.62x slower | +| regex_compile | 142 ms | 232 ms: 1.63x slower | +| thrift | 791 us | 1.29 ms: 1.63x slower | +| html5lib | 63.6 ms | 104 ms: 1.64x slower | +| genshi_xml | 50.2 ms | 82.8 ms: 1.65x slower | +| sqlglot_normalize | 107 ms | 183 ms: 1.71x slower | +| sqlglot_optimize | 53.3 ms | 91.8 ms: 1.72x slower | +| pyflate | 448 ms | 780 ms: 1.74x slower | +| genshi_text | 22.8 ms | 40.5 ms: 1.78x slower | +| pprint_safe_repr | 743 ms | 1.35 sec: 1.82x slower | +| pprint_pformat | 1.52 sec | 2.78 sec: 1.83x slower | +| logging_format | 7.35 us | 13.5 us: 1.84x slower | +| logging_simple | 6.63 us | 12.2 us: 1.85x slower | +| sympy_str | 292 ms | 542 ms: 1.86x slower | +| scimark_monte_carlo | 68.4 ms | 127 ms: 1.86x slower | +| django_template | 34.7 ms | 64.7 ms: 1.87x slower | +| float | 80.8 ms | 152 ms: 1.88x slower | +| mako | 11.0 ms | 20.8 ms: 1.89x slower | +| unpickle_pure_python | 221 us | 428 us: 1.94x slower | +| chaos | 62.8 ms | 123 ms: 1.96x slower | +| sqlglot_transpile | 1.67 ms | 3.36 ms: 2.01x slower | +| hexiom | 6.17 ms | 12.4 ms: 2.02x slower | +| logging_silent | 109 ns | 221 ns: 2.03x slower | +| pickle_pure_python | 308 us | 632 us: 2.05x slower | +| richards | 45.9 ms | 94.8 ms: 2.06x slower | +| scimark_sor | 130 ms | 274 ms: 2.11x slower | +| raytrace | 299 ms | 633 ms: 2.12x slower | +| sqlglot_parse | 1.36 ms | 2.89 ms: 2.13x slower | +| richards_super | 51.9 ms | 111 ms: 2.14x slower | +| scimark_lu | 114 ms | 246 ms: 2.15x slower | +| go | 139 ms | 301 ms: 2.16x slower | +| nbody | 89.3 ms | 199 ms: 2.22x slower | +| sympy_expand | 468 ms | 1.06 sec: 2.27x slower | +| sympy_sum | 166 ms | 382 ms: 2.30x slower | +| deltablue | 3.45 ms | 9.29 ms: 2.70x slower | +| unpack_sequence | 52.1 ns | 141 ns: 2.72x slower | +| bench_thread_pool | 941 us | 3.49 ms: 3.71x slower | +| bench_mp_pool | 10.8 ms | 72.4 ms: 6.70x slower | +| Geometric mean | (ref) | 1.55x slower | +Ignored benchmarks (17) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, mypy2, sqlalchemy_declarative, sqlalchemy_imperative, tornado_http + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.47x +- 95% likely to have a slowdown of 1.44x +- 99% likely to have a slowdown of 1.38x + +# Memory +- memory change: 1.23x \ No newline at end of file diff --git a/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.svg b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.svg new file mode 100644 index 00000000..8551096f --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.svg @@ -0,0 +1,3046 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.md b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.md new file mode 100644 index 00000000..8650bb81 --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.md @@ -0,0 +1,203 @@ +# Results vs. 3.13.0rc2 + +- fork: python +- ref: 4ae50615d2beef0f93d9 +- machine: linux-x86_64 +- commit hash: 4ae5061 +- commit date: 2024-11-13 +- overall geometric mean: 1.57x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.40x slower +- Memory change: 1.21x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 260 ms | 416 ms: 1.60x slower | +| docutils | 2.62 sec | 3.39 sec: 1.30x slower | +| html5lib | 67.0 ms | 104 ms: 1.56x slower | +| Geometric mean | (ref) | 1.48x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| asyncio_tcp | 505 ms | 583 ms: 1.15x slower | +| asyncio_tcp_ssl | 1.51 sec | 1.83 sec: 1.21x slower | +| coroutines | 23.6 ms | 30.8 ms: 1.31x slower | +| async_generators | 377 ms | 496 ms: 1.32x slower | +| Geometric mean | (ref) | 1.19x slower | + +Benchmark hidden because not significant (1): asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 217 ms | 186 ms: 1.16x faster | +| float | 77.5 ms | 152 ms: 1.96x slower | +| nbody | 85.1 ms | 199 ms: 2.33x slower | +| Geometric mean | (ref) | 1.58x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 3.08 ms | 3.09 ms: 1.00x slower | +| regex_dna | 180 ms | 184 ms: 1.02x slower | +| regex_v8 | 22.7 ms | 25.2 ms: 1.11x slower | +| regex_compile | 132 ms | 232 ms: 1.75x slower | +| Geometric mean | (ref) | 1.19x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| pickle_dict | 32.5 us | 31.5 us: 1.03x faster | +| xml_etree_parse | 136 ms | 133 ms: 1.02x faster | +| pickle_list | 4.93 us | 5.17 us: 1.05x slower | +| pickle | 11.3 us | 12.0 us: 1.05x slower | +| json_loads | 27.0 us | 28.7 us: 1.06x slower | +| unpickle_list | 4.71 us | 5.03 us: 1.07x slower | +| xml_etree_iterparse | 94.9 ms | 110 ms: 1.16x slower | +| xml_etree_generate | 85.4 ms | 115 ms: 1.35x slower | +| json_dumps | 10.5 ms | 15.3 ms: 1.45x slower | +| xml_etree_process | 59.3 ms | 93.9 ms: 1.58x slower | +| tomli_loads | 2.01 sec | 3.23 sec: 1.61x slower | +| unpickle_pure_python | 210 us | 428 us: 2.04x slower | +| pickle_pure_python | 294 us | 632 us: 2.15x slower | +| Geometric mean | (ref) | 1.27x slower | + +Benchmark hidden because not significant (1): unpickle + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 7.39 ms | 10.3 ms: 1.39x slower | +| python_startup | 11.0 ms | 15.7 ms: 1.43x slower | +| Geometric mean | (ref) | 1.41x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|-----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 48.8 ms | 82.8 ms: 1.70x slower | +| mako | 11.3 ms | 20.8 ms: 1.84x slower | +| genshi_text | 21.5 ms | 40.5 ms: 1.88x slower | +| django_template | 34.1 ms | 64.7 ms: 1.90x slower | +| Geometric mean | (ref) | 1.83x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|--------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| gc_traversal | 3.14 ms | 2.47 ms: 1.27x faster | +| create_gc_cycles | 1.34 ms | 1.13 ms: 1.19x faster | +| pidigits | 217 ms | 186 ms: 1.16x faster | +| pickle_dict | 32.5 us | 31.5 us: 1.03x faster | +| xml_etree_parse | 136 ms | 133 ms: 1.02x faster | +| regex_effbot | 3.08 ms | 3.09 ms: 1.00x slower | +| regex_dna | 180 ms | 184 ms: 1.02x slower | +| pickle_list | 4.93 us | 5.17 us: 1.05x slower | +| pickle | 11.3 us | 12.0 us: 1.05x slower | +| json_loads | 27.0 us | 28.7 us: 1.06x slower | +| unpickle_list | 4.71 us | 5.03 us: 1.07x slower | +| json | 4.93 ms | 5.26 ms: 1.07x slower | +| regex_v8 | 22.7 ms | 25.2 ms: 1.11x slower | +| sqlite_synth | 2.21 us | 2.46 us: 1.11x slower | +| pathlib | 19.2 ms | 21.9 ms: 1.14x slower | +| asyncio_tcp | 505 ms | 583 ms: 1.15x slower | +| xml_etree_iterparse | 94.9 ms | 110 ms: 1.16x slower | +| telco | 7.82 ms | 9.26 ms: 1.18x slower | +| scimark_fft | 349 ms | 415 ms: 1.19x slower | +| scimark_sparse_mat_mult | 4.71 ms | 5.71 ms: 1.21x slower | +| asyncio_tcp_ssl | 1.51 sec | 1.83 sec: 1.21x slower | +| deepcopy | 355 us | 439 us: 1.24x slower | +| coverage | 83.0 ms | 105 ms: 1.27x slower | +| docutils | 2.62 sec | 3.39 sec: 1.30x slower | +| coroutines | 23.6 ms | 30.8 ms: 1.31x slower | +| async_generators | 377 ms | 496 ms: 1.32x slower | +| pylint | 317 ms | 422 ms: 1.33x slower | +| mdp | 2.36 sec | 3.14 sec: 1.33x slower | +| xml_etree_generate | 85.4 ms | 115 ms: 1.35x slower | +| meteor_contest | 102 ms | 139 ms: 1.37x slower | +| python_startup_no_site | 7.39 ms | 10.3 ms: 1.39x slower | +| bpe_tokeniser | 4.45 sec | 6.17 sec: 1.39x slower | +| deepcopy_memo | 39.1 us | 54.3 us: 1.39x slower | +| dulwich_log | 74.8 ms | 104 ms: 1.39x slower | +| python_startup | 11.0 ms | 15.7 ms: 1.43x slower | +| generators | 28.8 ms | 41.3 ms: 1.43x slower | +| json_dumps | 10.5 ms | 15.3 ms: 1.45x slower | +| deepcopy_reduce | 3.11 us | 4.52 us: 1.45x slower | +| nqueens | 78.6 ms | 115 ms: 1.47x slower | +| spectral_norm | 111 ms | 163 ms: 1.47x slower | +| fannkuch | 370 ms | 561 ms: 1.52x slower | +| pycparser | 1.12 sec | 1.73 sec: 1.55x slower | +| html5lib | 67.0 ms | 104 ms: 1.56x slower | +| xml_etree_process | 59.3 ms | 93.9 ms: 1.58x slower | +| crypto_pyaes | 67.9 ms | 109 ms: 1.60x slower | +| 2to3 | 260 ms | 416 ms: 1.60x slower | +| tomli_loads | 2.01 sec | 3.23 sec: 1.61x slower | +| typing_runtime_protocols | 155 us | 256 us: 1.66x slower | +| thrift | 778 us | 1.29 ms: 1.66x slower | +| sympy_integrate | 19.8 ms | 33.3 ms: 1.68x slower | +| genshi_xml | 48.8 ms | 82.8 ms: 1.70x slower | +| sqlglot_normalize | 106 ms | 183 ms: 1.73x slower | +| pyflate | 449 ms | 780 ms: 1.74x slower | +| sqlglot_optimize | 52.7 ms | 91.8 ms: 1.74x slower | +| regex_compile | 132 ms | 232 ms: 1.75x slower | +| pprint_safe_repr | 738 ms | 1.35 sec: 1.83x slower | +| mako | 11.3 ms | 20.8 ms: 1.84x slower | +| pprint_pformat | 1.50 sec | 2.78 sec: 1.86x slower | +| comprehensions | 16.5 us | 30.9 us: 1.88x slower | +| genshi_text | 21.5 ms | 40.5 ms: 1.88x slower | +| django_template | 34.1 ms | 64.7 ms: 1.90x slower | +| scimark_monte_carlo | 65.4 ms | 127 ms: 1.95x slower | +| float | 77.5 ms | 152 ms: 1.96x slower | +| sympy_str | 275 ms | 542 ms: 1.97x slower | +| logging_format | 6.84 us | 13.5 us: 1.98x slower | +| logging_simple | 6.16 us | 12.2 us: 1.99x slower | +| unpickle_pure_python | 210 us | 428 us: 2.04x slower | +| scimark_sor | 134 ms | 274 ms: 2.04x slower | +| hexiom | 5.99 ms | 12.4 ms: 2.08x slower | +| richards | 45.2 ms | 94.8 ms: 2.10x slower | +| go | 141 ms | 301 ms: 2.14x slower | +| richards_super | 51.6 ms | 111 ms: 2.14x slower | +| chaos | 57.3 ms | 123 ms: 2.15x slower | +| pickle_pure_python | 294 us | 632 us: 2.15x slower | +| sqlglot_transpile | 1.56 ms | 3.36 ms: 2.16x slower | +| logging_silent | 103 ns | 221 ns: 2.16x slower | +| scimark_lu | 113 ms | 246 ms: 2.18x slower | +| sqlglot_parse | 1.25 ms | 2.89 ms: 2.31x slower | +| sympy_expand | 457 ms | 1.06 sec: 2.33x slower | +| nbody | 85.1 ms | 199 ms: 2.33x slower | +| sympy_sum | 156 ms | 382 ms: 2.45x slower | +| raytrace | 253 ms | 633 ms: 2.51x slower | +| deltablue | 3.12 ms | 9.29 ms: 2.97x slower | +| unpack_sequence | 44.8 ns | 141 ns: 3.16x slower | +| bench_thread_pool | 919 us | 3.49 ms: 3.80x slower | +| bench_mp_pool | 11.0 ms | 72.4 ms: 6.58x slower | +| Geometric mean | (ref) | 1.57x slower | + +Benchmark hidden because not significant (2): asyncio_websockets, unpickle +Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, tornado_http + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.47x +- 95% likely to have a slowdown of 1.46x +- 99% likely to have a slowdown of 1.40x + +# Memory +- memory change: 1.21x \ No newline at end of file diff --git a/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.svg b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.svg new file mode 100644 index 00000000..a6feb400 --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.svg @@ -0,0 +1,3042 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base-mem.svg b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base-mem.svg new file mode 100644 index 00000000..2393d6be --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base-mem.svg @@ -0,0 +1,2239 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base.md b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base.md new file mode 100644 index 00000000..d4d22a8d --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base.md @@ -0,0 +1,200 @@ +# Results vs. base + +- fork: python +- ref: 4ae50615d2beef0f93d9 +- machine: linux-x86_64 +- commit hash: 4ae5061 +- commit date: 2024-11-13 +- overall geometric mean: 1.54x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.40x slower +- Memory change: 1.20x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| 2to3 | 254 ms | 416 ms: 1.63x slower | +| docutils | 2.61 sec | 3.39 sec: 1.30x slower | +| html5lib | 66.5 ms | 104 ms: 1.57x slower | +| Geometric mean | (ref) | 1.49x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | +|--------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| asyncio_websockets | 521 ms | 519 ms: 1.00x faster | +| asyncio_tcp | 507 ms | 583 ms: 1.15x slower | +| asyncio_tcp_ssl | 1.52 sec | 1.83 sec: 1.21x slower | +| async_generators | 367 ms | 496 ms: 1.35x slower | +| coroutines | 22.7 ms | 30.8 ms: 1.36x slower | +| Geometric mean | (ref) | 1.21x slower | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| pidigits | 186 ms | 186 ms: 1.00x slower | +| float | 78.6 ms | 152 ms: 1.93x slower | +| nbody | 92.9 ms | 199 ms: 2.14x slower | +| Geometric mean | (ref) | 1.61x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| regex_effbot | 3.11 ms | 3.09 ms: 1.01x faster | +| regex_dna | 182 ms | 184 ms: 1.01x slower | +| regex_v8 | 24.2 ms | 25.2 ms: 1.04x slower | +| regex_compile | 132 ms | 232 ms: 1.75x slower | +| Geometric mean | (ref) | 1.16x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | +|----------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| pickle_dict | 33.4 us | 31.5 us: 1.06x faster | +| pickle | 12.7 us | 12.0 us: 1.06x faster | +| xml_etree_parse | 135 ms | 133 ms: 1.01x faster | +| pickle_list | 5.22 us | 5.17 us: 1.01x faster | +| unpickle | 13.7 us | 14.4 us: 1.05x slower | +| unpickle_list | 4.74 us | 5.03 us: 1.06x slower | +| xml_etree_iterparse | 95.4 ms | 110 ms: 1.15x slower | +| json_loads | 24.8 us | 28.7 us: 1.16x slower | +| json_dumps | 11.5 ms | 15.3 ms: 1.33x slower | +| xml_etree_generate | 84.8 ms | 115 ms: 1.36x slower | +| tomli_loads | 2.09 sec | 3.23 sec: 1.55x slower | +| xml_etree_process | 59.2 ms | 93.9 ms: 1.59x slower | +| unpickle_pure_python | 215 us | 428 us: 1.98x slower | +| pickle_pure_python | 316 us | 632 us: 2.00x slower | +| Geometric mean | (ref) | 1.25x slower | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | +|------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| python_startup_no_site | 7.48 ms | 10.3 ms: 1.37x slower | +| python_startup | 11.1 ms | 15.7 ms: 1.41x slower | +| Geometric mean | (ref) | 1.39x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | +|-----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| genshi_xml | 50.1 ms | 82.8 ms: 1.65x slower | +| mako | 11.6 ms | 20.8 ms: 1.79x slower | +| genshi_text | 22.6 ms | 40.5 ms: 1.79x slower | +| django_template | 35.2 ms | 64.7 ms: 1.84x slower | +| Geometric mean | (ref) | 1.77x slower | + +All benchmarks: +=============== + +| Benchmark | results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061.json | +|--------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| gc_traversal | 3.75 ms | 2.47 ms: 1.52x faster | +| create_gc_cycles | 1.35 ms | 1.13 ms: 1.20x faster | +| pickle_dict | 33.4 us | 31.5 us: 1.06x faster | +| pickle | 12.7 us | 12.0 us: 1.06x faster | +| xml_etree_parse | 135 ms | 133 ms: 1.01x faster | +| pickle_list | 5.22 us | 5.17 us: 1.01x faster | +| regex_effbot | 3.11 ms | 3.09 ms: 1.01x faster | +| asyncio_websockets | 521 ms | 519 ms: 1.00x faster | +| pidigits | 186 ms | 186 ms: 1.00x slower | +| regex_dna | 182 ms | 184 ms: 1.01x slower | +| regex_v8 | 24.2 ms | 25.2 ms: 1.04x slower | +| unpickle | 13.7 us | 14.4 us: 1.05x slower | +| unpickle_list | 4.74 us | 5.03 us: 1.06x slower | +| bench_mp_pool | 64.3 ms | 72.4 ms: 1.13x slower | +| sqlite_synth | 2.17 us | 2.46 us: 1.13x slower | +| json | 4.64 ms | 5.26 ms: 1.14x slower | +| asyncio_tcp | 507 ms | 583 ms: 1.15x slower | +| xml_etree_iterparse | 95.4 ms | 110 ms: 1.15x slower | +| json_loads | 24.8 us | 28.7 us: 1.16x slower | +| pathlib | 18.4 ms | 21.9 ms: 1.19x slower | +| asyncio_tcp_ssl | 1.52 sec | 1.83 sec: 1.21x slower | +| scimark_fft | 339 ms | 415 ms: 1.22x slower | +| scimark_sparse_mat_mult | 4.57 ms | 5.71 ms: 1.25x slower | +| telco | 7.31 ms | 9.26 ms: 1.27x slower | +| coverage | 81.4 ms | 105 ms: 1.30x slower | +| docutils | 2.61 sec | 3.39 sec: 1.30x slower | +| pylint | 319 ms | 422 ms: 1.32x slower | +| json_dumps | 11.5 ms | 15.3 ms: 1.33x slower | +| mdp | 2.35 sec | 3.14 sec: 1.33x slower | +| async_generators | 367 ms | 496 ms: 1.35x slower | +| xml_etree_generate | 84.8 ms | 115 ms: 1.36x slower | +| coroutines | 22.7 ms | 30.8 ms: 1.36x slower | +| python_startup_no_site | 7.48 ms | 10.3 ms: 1.37x slower | +| meteor_contest | 101 ms | 139 ms: 1.37x slower | +| dulwich_log | 75.8 ms | 104 ms: 1.38x slower | +| python_startup | 11.1 ms | 15.7 ms: 1.41x slower | +| bpe_tokeniser | 4.36 sec | 6.17 sec: 1.41x slower | +| generators | 29.0 ms | 41.3 ms: 1.42x slower | +| spectral_norm | 113 ms | 163 ms: 1.44x slower | +| nqueens | 79.7 ms | 115 ms: 1.45x slower | +| fannkuch | 384 ms | 561 ms: 1.46x slower | +| pycparser | 1.14 sec | 1.73 sec: 1.52x slower | +| tomli_loads | 2.09 sec | 3.23 sec: 1.55x slower | +| html5lib | 66.5 ms | 104 ms: 1.57x slower | +| xml_etree_process | 59.2 ms | 93.9 ms: 1.59x slower | +| typing_runtime_protocols | 161 us | 256 us: 1.59x slower | +| 2to3 | 254 ms | 416 ms: 1.63x slower | +| crypto_pyaes | 66.1 ms | 109 ms: 1.64x slower | +| genshi_xml | 50.1 ms | 82.8 ms: 1.65x slower | +| deepcopy | 262 us | 439 us: 1.67x slower | +| sympy_integrate | 19.9 ms | 33.3 ms: 1.67x slower | +| deepcopy_reduce | 2.68 us | 4.52 us: 1.69x slower | +| sqlglot_optimize | 53.8 ms | 91.8 ms: 1.71x slower | +| sqlglot_normalize | 107 ms | 183 ms: 1.71x slower | +| pyflate | 452 ms | 780 ms: 1.72x slower | +| regex_compile | 132 ms | 232 ms: 1.75x slower | +| thrift | 738 us | 1.29 ms: 1.75x slower | +| mako | 11.6 ms | 20.8 ms: 1.79x slower | +| genshi_text | 22.6 ms | 40.5 ms: 1.79x slower | +| comprehensions | 17.2 us | 30.9 us: 1.79x slower | +| deepcopy_memo | 30.1 us | 54.3 us: 1.80x slower | +| django_template | 35.2 ms | 64.7 ms: 1.84x slower | +| pprint_pformat | 1.47 sec | 2.78 sec: 1.89x slower | +| pprint_safe_repr | 713 ms | 1.35 sec: 1.90x slower | +| scimark_monte_carlo | 66.2 ms | 127 ms: 1.92x slower | +| float | 78.6 ms | 152 ms: 1.93x slower | +| sympy_str | 274 ms | 542 ms: 1.98x slower | +| logging_simple | 6.18 us | 12.2 us: 1.98x slower | +| unpickle_pure_python | 215 us | 428 us: 1.98x slower | +| logging_format | 6.81 us | 13.5 us: 1.99x slower | +| pickle_pure_python | 316 us | 632 us: 2.00x slower | +| scimark_sor | 135 ms | 274 ms: 2.03x slower | +| richards | 45.9 ms | 94.8 ms: 2.06x slower | +| sqlglot_transpile | 1.61 ms | 3.36 ms: 2.09x slower | +| chaos | 58.6 ms | 123 ms: 2.10x slower | +| hexiom | 5.93 ms | 12.4 ms: 2.10x slower | +| richards_super | 52.1 ms | 111 ms: 2.12x slower | +| nbody | 92.9 ms | 199 ms: 2.14x slower | +| scimark_lu | 114 ms | 246 ms: 2.15x slower | +| logging_silent | 103 ns | 221 ns: 2.15x slower | +| sqlglot_parse | 1.30 ms | 2.89 ms: 2.22x slower | +| sympy_expand | 458 ms | 1.06 sec: 2.32x slower | +| raytrace | 260 ms | 633 ms: 2.44x slower | +| sympy_sum | 153 ms | 382 ms: 2.50x slower | +| go | 120 ms | 301 ms: 2.51x slower | +| deltablue | 3.23 ms | 9.29 ms: 2.88x slower | +| unpack_sequence | 45.4 ns | 141 ns: 3.12x slower | +| bench_thread_pool | 1.02 ms | 3.49 ms: 3.44x slower | +| Geometric mean | (ref) | 1.54x slower | + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.45x +- 95% likely to have a slowdown of 1.43x +- 99% likely to have a slowdown of 1.40x + +# Memory +- memory change: 1.20x \ No newline at end of file diff --git a/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base.svg b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base.svg new file mode 100644 index 00000000..4ba8bbce --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061-NOGIL/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-base.svg @@ -0,0 +1,3048 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241113-3.14.0a1+-4ae5061/README.md b/results/bm-20241113-3.14.0a1+-4ae5061/README.md new file mode 100644 index 00000000..78ccdfc1 --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061/README.md @@ -0,0 +1,56 @@ +# Results + +- fork: python +- version: 3.14.0a1+ +- config: +- commit hash: [4ae5061](https://github.com/python/cpython/commit/4ae5061) +- commit date: 2024-11-13T15:45:08-08:00 +- commit merge base: [fd4b5453df74e249987553b12c14ad75fafa4991](https://github.com/python/cpython/commit/fd4b5453df74e249987553b12c14ad75fafa4991) +- ref: 4ae50615d2beef0f93d9 + +## linux x86_64 (linux) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/11828233702) +- cpu model: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz +- platform: Linux-5.15.0-1071-aws-x86_64-with-glibc2.31 +- [raw results](bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061.json) + +### vs. 3.12.6 + +- Geometric mean: 1.00x slower (HPT: reliability of 87.88%, 1.00x faster at 99th %ile) +- Memory usage: 1.02x +- missing benchmarks: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, mypy2, sqlalchemy_declarative, sqlalchemy_imperative, tornado_http +- [📄table](bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.md) +- [📈time plot](bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.02x slower (HPT: reliability of 71.99%, 1.00x slower at 99th %ile) +- Memory usage: 1.01x +- missing benchmarks: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, tornado_http +- [📄table](bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.md) +- [📈time plot](bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.svg) + +## linux x86_64 (vultr) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/11828233702) +- cpu model: Intel(R) Xeon(R) E-2286G CPU @ 4.00GHz +- platform: Linux-6.8.0-45-generic-x86_64-with-glibc2.39 +- [raw results](bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061.json) + +### vs. 3.12.6 + +- Geometric mean: 1.00x slower (HPT: reliability of 98.55%, 1.00x faster at 99th %ile) +- Memory usage: 1.02x +- missing benchmarks: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, mypy2, sqlalchemy_declarative, sqlalchemy_imperative, tornado_http +- [📄table](bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.md) +- [📈time plot](bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.02x slower (HPT: reliability of 92.62%, 1.00x slower at 99th %ile) +- Memory usage: 1.00x +- missing benchmarks: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, tornado_http +- [📄table](bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.md) +- [📈time plot](bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1%2B-4ae5061-vs-3.13.0rc2.svg) + diff --git a/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.md b/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.md new file mode 100644 index 00000000..223dcba2 --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.md @@ -0,0 +1,156 @@ +# Results vs. 3.12.6 + +- fork: python +- ref: 4ae50615d2beef0f93d9 +- machine: linux-x86_64 +- commit hash: 4ae5061 +- commit date: 2024-11-13 +- overall geometric mean: 1.00x slower +- HPT reliability: 87.88% +- HPT 99th percentile: 1.00x faster +- Memory change: 1.02x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| docutils | 4.00 sec | 3.87 sec: 1.03x faster | +| Geometric mean | (ref) | 1.02x faster | + +Benchmark hidden because not significant (2): 2to3, html5lib + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| asyncio_tcp | 923 ms | 968 ms: 1.05x slower | +| coroutines | 29.5 ms | 34.9 ms: 1.18x slower | +| Geometric mean | (ref) | 1.04x slower | + +Benchmark hidden because not significant (3): asyncio_tcp_ssl, async_generators, asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| float | 123 ms | 117 ms: 1.05x faster | +| nbody | 119 ms | 130 ms: 1.09x slower | +| Geometric mean | (ref) | 1.01x slower | + +Benchmark hidden because not significant (1): pidigits + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 5.13 ms | 4.75 ms: 1.08x faster | +| regex_compile | 187 ms | 174 ms: 1.07x faster | +| regex_v8 | 32.5 ms | 34.6 ms: 1.06x slower | +| Geometric mean | (ref) | 1.03x faster | + +Benchmark hidden because not significant (1): regex_dna + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| pickle_dict | 52.7 us | 47.9 us: 1.10x faster | +| unpickle_pure_python | 300 us | 286 us: 1.05x faster | +| pickle | 16.4 us | 17.5 us: 1.07x slower | +| json_dumps | 14.3 ms | 15.3 ms: 1.07x slower | +| pickle_list | 6.97 us | 7.44 us: 1.07x slower | +| Geometric mean | (ref) | 1.01x faster | + +Benchmark hidden because not significant (9): unpickle, json_loads, xml_etree_parse, tomli_loads, unpickle_list, xml_etree_process, xml_etree_iterparse, pickle_pure_python, xml_etree_generate + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 17.6 ms | 15.4 ms: 1.14x faster | +| python_startup | 23.7 ms | 22.4 ms: 1.06x faster | +| Geometric mean | (ref) | 1.10x faster | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|-----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| mako | 15.7 ms | 16.4 ms: 1.04x slower | +| genshi_text | 30.2 ms | 32.0 ms: 1.06x slower | +| django_template | 44.9 ms | 47.6 ms: 1.06x slower | +| Geometric mean | (ref) | 1.04x slower | + +Benchmark hidden because not significant (1): genshi_xml + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| deepcopy_memo | 52.4 us | 39.5 us: 1.33x faster | +| deepcopy | 468 us | 364 us: 1.29x faster | +| comprehensions | 27.1 us | 22.1 us: 1.23x faster | +| bench_thread_pool | 3.48 ms | 2.93 ms: 1.19x faster | +| python_startup_no_site | 17.6 ms | 15.4 ms: 1.14x faster | +| raytrace | 408 ms | 362 ms: 1.13x faster | +| deepcopy_reduce | 4.04 us | 3.65 us: 1.11x faster | +| pathlib | 31.6 ms | 28.7 ms: 1.10x faster | +| mdp | 3.97 sec | 3.61 sec: 1.10x faster | +| pickle_dict | 52.7 us | 47.9 us: 1.10x faster | +| sqlglot_normalize | 157 ms | 143 ms: 1.10x faster | +| bpe_tokeniser | 6.59 sec | 6.06 sec: 1.09x faster | +| crypto_pyaes | 107 ms | 98.9 ms: 1.08x faster | +| nqueens | 117 ms | 108 ms: 1.08x faster | +| regex_effbot | 5.13 ms | 4.75 ms: 1.08x faster | +| logging_simple | 9.45 us | 8.76 us: 1.08x faster | +| pyflate | 727 ms | 676 ms: 1.08x faster | +| regex_compile | 187 ms | 174 ms: 1.07x faster | +| pycparser | 1.79 sec | 1.68 sec: 1.07x faster | +| python_startup | 23.7 ms | 22.4 ms: 1.06x faster | +| float | 123 ms | 117 ms: 1.05x faster | +| sqlglot_optimize | 76.0 ms | 72.3 ms: 1.05x faster | +| scimark_monte_carlo | 96.4 ms | 91.8 ms: 1.05x faster | +| unpickle_pure_python | 300 us | 286 us: 1.05x faster | +| scimark_fft | 500 ms | 478 ms: 1.05x faster | +| pprint_safe_repr | 967 ms | 930 ms: 1.04x faster | +| docutils | 4.00 sec | 3.87 sec: 1.03x faster | +| mako | 15.7 ms | 16.4 ms: 1.04x slower | +| asyncio_tcp | 923 ms | 968 ms: 1.05x slower | +| scimark_sor | 167 ms | 175 ms: 1.05x slower | +| gc_traversal | 5.86 ms | 6.18 ms: 1.05x slower | +| genshi_text | 30.2 ms | 32.0 ms: 1.06x slower | +| django_template | 44.9 ms | 47.6 ms: 1.06x slower | +| regex_v8 | 32.5 ms | 34.6 ms: 1.06x slower | +| pickle | 16.4 us | 17.5 us: 1.07x slower | +| json_dumps | 14.3 ms | 15.3 ms: 1.07x slower | +| pickle_list | 6.97 us | 7.44 us: 1.07x slower | +| deltablue | 4.27 ms | 4.57 ms: 1.07x slower | +| nbody | 119 ms | 130 ms: 1.09x slower | +| richards | 60.3 ms | 67.7 ms: 1.12x slower | +| telco | 9.59 ms | 11.0 ms: 1.15x slower | +| coroutines | 29.5 ms | 34.9 ms: 1.18x slower | +| unpack_sequence | 60.2 ns | 75.2 ns: 1.25x slower | +| create_gc_cycles | 1.94 ms | 2.49 ms: 1.28x slower | +| coverage | 95.4 ms | 132 ms: 1.38x slower | +| bench_mp_pool | 20.7 ms | 72.1 ms: 3.49x slower | +| Geometric mean | (ref) | 1.00x slower | + +Benchmark hidden because not significant (42): unpickle, json_loads, logging_format, generators, xml_etree_parse, dulwich_log, scimark_sparse_mat_mult, sympy_str, pprint_pformat, richards_super, 2to3, meteor_contest, regex_dna, tomli_loads, unpickle_list, xml_etree_process, typing_runtime_protocols, html5lib, asyncio_tcp_ssl, fannkuch, async_generators, sympy_integrate, json, pidigits, genshi_xml, asyncio_websockets, sympy_sum, sqlite_synth, logging_silent, hexiom, chaos, xml_etree_iterparse, pickle_pure_python, sqlglot_parse, scimark_lu, spectral_norm, go, xml_etree_generate, sympy_expand, sqlglot_transpile, thrift, pylint +Ignored benchmarks (17) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, mypy2, sqlalchemy_declarative, sqlalchemy_imperative, tornado_http + +# HPT report + +- Reliability score: 87.88% likely to be faster +- 90% likely to have a speedup of 1.00x +- 95% likely to have a speedup of 1.00x +- 99% likely to have a speedup of 1.00x + +# Memory +- memory change: 1.02x \ No newline at end of file diff --git a/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.svg b/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.svg new file mode 100644 index 00000000..1ecc8651 --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.svg @@ -0,0 +1,3300 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.md b/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.md new file mode 100644 index 00000000..99369318 --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.md @@ -0,0 +1,141 @@ +# Results vs. 3.13.0rc2 + +- fork: python +- ref: 4ae50615d2beef0f93d9 +- machine: linux-x86_64 +- commit hash: 4ae5061 +- commit date: 2024-11-13 +- overall geometric mean: 1.02x slower +- HPT reliability: 71.99% +- HPT 99th percentile: 1.00x slower +- Memory change: 1.01x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| docutils | 4.01 sec | 3.87 sec: 1.04x faster | +| html5lib | 92.6 ms | 87.9 ms: 1.05x faster | +| Geometric mean | (ref) | 1.03x faster | + +Benchmark hidden because not significant (1): 2to3 + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_generators | 567 ms | 586 ms: 1.03x slower | +| coroutines | 30.9 ms | 34.9 ms: 1.13x slower | +| Geometric mean | (ref) | 1.03x slower | + +Benchmark hidden because not significant (3): asyncio_websockets, asyncio_tcp_ssl, asyncio_tcp + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| nbody | 119 ms | 130 ms: 1.10x slower | +| Geometric mean | (ref) | 1.03x slower | + +Benchmark hidden because not significant (2): pidigits, float + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_compile | 182 ms | 174 ms: 1.05x faster | +| regex_v8 | 32.8 ms | 34.6 ms: 1.05x slower | +| Geometric mean | (ref) | 1.01x faster | + +Benchmark hidden because not significant (2): regex_dna, regex_effbot + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|--------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_process | 85.9 ms | 82.3 ms: 1.04x faster | +| pickle_pure_python | 416 us | 441 us: 1.06x slower | +| json_loads | 34.3 us | 36.4 us: 1.06x slower | +| xml_etree_generate | 122 ms | 130 ms: 1.07x slower | +| json_dumps | 14.1 ms | 15.3 ms: 1.08x slower | +| pickle_list | 6.86 us | 7.44 us: 1.08x slower | +| pickle | 15.1 us | 17.5 us: 1.15x slower | +| Geometric mean | (ref) | 1.03x slower | + +Benchmark hidden because not significant (7): xml_etree_iterparse, unpickle, unpickle_pure_python, xml_etree_parse, unpickle_list, pickle_dict, tomli_loads + +Benchmarks with tag 'startup': +============================== + +Benchmark hidden because not significant (2): python_startup, python_startup_no_site + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|-----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 72.1 ms | 67.6 ms: 1.07x faster | +| django_template | 44.3 ms | 47.6 ms: 1.08x slower | +| Geometric mean | (ref) | 1.01x slower | + +Benchmark hidden because not significant (2): genshi_text, mako + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|--------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| deepcopy | 498 us | 364 us: 1.37x faster | +| deepcopy_memo | 50.1 us | 39.5 us: 1.27x faster | +| deepcopy_reduce | 4.10 us | 3.65 us: 1.12x faster | +| telco | 12.2 ms | 11.0 ms: 1.11x faster | +| go | 191 ms | 176 ms: 1.09x faster | +| genshi_xml | 72.1 ms | 67.6 ms: 1.07x faster | +| pprint_safe_repr | 987 ms | 930 ms: 1.06x faster | +| mdp | 3.80 sec | 3.61 sec: 1.05x faster | +| html5lib | 92.6 ms | 87.9 ms: 1.05x faster | +| regex_compile | 182 ms | 174 ms: 1.05x faster | +| meteor_contest | 150 ms | 144 ms: 1.05x faster | +| xml_etree_process | 85.9 ms | 82.3 ms: 1.04x faster | +| bpe_tokeniser | 6.28 sec | 6.06 sec: 1.04x faster | +| docutils | 4.01 sec | 3.87 sec: 1.04x faster | +| async_generators | 567 ms | 586 ms: 1.03x slower | +| json | 6.51 ms | 6.84 ms: 1.05x slower | +| raytrace | 344 ms | 362 ms: 1.05x slower | +| regex_v8 | 32.8 ms | 34.6 ms: 1.05x slower | +| sympy_sum | 210 ms | 222 ms: 1.06x slower | +| pickle_pure_python | 416 us | 441 us: 1.06x slower | +| scimark_lu | 146 ms | 155 ms: 1.06x slower | +| json_loads | 34.3 us | 36.4 us: 1.06x slower | +| xml_etree_generate | 122 ms | 130 ms: 1.07x slower | +| pycparser | 1.57 sec | 1.68 sec: 1.07x slower | +| logging_silent | 130 ns | 140 ns: 1.07x slower | +| django_template | 44.3 ms | 47.6 ms: 1.08x slower | +| json_dumps | 14.1 ms | 15.3 ms: 1.08x slower | +| gc_traversal | 5.70 ms | 6.18 ms: 1.08x slower | +| pickle_list | 6.86 us | 7.44 us: 1.08x slower | +| sqlglot_transpile | 2.20 ms | 2.40 ms: 1.09x slower | +| nbody | 119 ms | 130 ms: 1.10x slower | +| coroutines | 30.9 ms | 34.9 ms: 1.13x slower | +| pickle | 15.1 us | 17.5 us: 1.15x slower | +| coverage | 107 ms | 132 ms: 1.23x slower | +| bench_mp_pool | 18.7 ms | 72.1 ms: 3.86x slower | +| Geometric mean | (ref) | 1.02x slower | + +Benchmark hidden because not significant (53): pathlib, scimark_sparse_mat_mult, xml_etree_iterparse, nqueens, sqlglot_optimize, regex_dna, sqlite_synth, richards_super, asyncio_websockets, typing_runtime_protocols, sympy_integrate, scimark_sor, fannkuch, unpickle, unpickle_pure_python, crypto_pyaes, generators, sympy_str, thrift, comprehensions, sympy_expand, pidigits, logging_format, pprint_pformat, python_startup, asyncio_tcp_ssl, regex_effbot, xml_etree_parse, unpickle_list, 2to3, python_startup_no_site, scimark_fft, genshi_text, float, unpack_sequence, scimark_monte_carlo, spectral_norm, bench_thread_pool, pickle_dict, pyflate, tomli_loads, asyncio_tcp, chaos, logging_simple, sqlglot_normalize, hexiom, mako, deltablue, create_gc_cycles, richards, pylint, sqlglot_parse, dulwich_log +Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, tornado_http + +# HPT report + +- Reliability score: 71.99% likely to be slow +- 90% likely to have a slowdown of 1.00x +- 95% likely to have a slowdown of 1.00x +- 99% likely to have a slowdown of 1.00x + +# Memory +- memory change: 1.01x \ No newline at end of file diff --git a/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.svg b/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.svg new file mode 100644 index 00000000..6f0c56a7 --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-linux-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.svg @@ -0,0 +1,3439 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.md b/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.md new file mode 100644 index 00000000..4a0b0c82 --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.md @@ -0,0 +1,198 @@ +# Results vs. 3.12.6 + +- fork: python +- ref: 4ae50615d2beef0f93d9 +- machine: linux-x86_64 +- commit hash: 4ae5061 +- commit date: 2024-11-13 +- overall geometric mean: 1.00x slower +- HPT reliability: 98.55% +- HPT 99th percentile: 1.00x faster +- Memory change: 1.02x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 264 ms | 254 ms: 1.04x faster | +| docutils | 2.64 sec | 2.61 sec: 1.01x faster | +| html5lib | 63.6 ms | 66.5 ms: 1.05x slower | +| Geometric mean | (ref) | 1.00x faster | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|--------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| coroutines | 23.9 ms | 22.7 ms: 1.06x faster | +| async_generators | 384 ms | 367 ms: 1.05x faster | +| asyncio_tcp | 519 ms | 507 ms: 1.02x faster | +| asyncio_websockets | 517 ms | 521 ms: 1.01x slower | +| asyncio_tcp_ssl | 1.51 sec | 1.52 sec: 1.01x slower | +| Geometric mean | (ref) | 1.02x faster | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| float | 80.8 ms | 78.6 ms: 1.03x faster | +| pidigits | 184 ms | 186 ms: 1.01x slower | +| nbody | 89.3 ms | 92.9 ms: 1.04x slower | +| Geometric mean | (ref) | 1.01x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_compile | 142 ms | 132 ms: 1.08x faster | +| regex_effbot | 3.17 ms | 3.11 ms: 1.02x faster | +| regex_dna | 168 ms | 182 ms: 1.09x slower | +| regex_v8 | 20.6 ms | 24.2 ms: 1.17x slower | +| Geometric mean | (ref) | 1.04x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| json_loads | 26.5 us | 24.8 us: 1.07x faster | +| unpickle | 14.1 us | 13.7 us: 1.03x faster | +| xml_etree_parse | 139 ms | 135 ms: 1.03x faster | +| unpickle_pure_python | 221 us | 215 us: 1.02x faster | +| xml_etree_iterparse | 96.7 ms | 95.4 ms: 1.01x faster | +| tomli_loads | 2.11 sec | 2.09 sec: 1.01x faster | +| xml_etree_generate | 85.2 ms | 84.8 ms: 1.01x faster | +| xml_etree_process | 59.0 ms | 59.2 ms: 1.00x slower | +| unpickle_list | 4.67 us | 4.74 us: 1.01x slower | +| pickle_pure_python | 308 us | 316 us: 1.03x slower | +| pickle_dict | 31.8 us | 33.4 us: 1.05x slower | +| pickle_list | 4.77 us | 5.22 us: 1.09x slower | +| json_dumps | 10.4 ms | 11.5 ms: 1.11x slower | +| pickle | 10.9 us | 12.7 us: 1.16x slower | +| Geometric mean | (ref) | 1.02x slower | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 7.16 ms | 7.48 ms: 1.04x slower | +| python_startup | 9.93 ms | 11.1 ms: 1.12x slower | +| Geometric mean | (ref) | 1.08x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|-----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_text | 22.8 ms | 22.6 ms: 1.01x faster | +| django_template | 34.7 ms | 35.2 ms: 1.02x slower | +| mako | 11.0 ms | 11.6 ms: 1.06x slower | +| Geometric mean | (ref) | 1.01x slower | + +Benchmark hidden because not significant (1): genshi_xml + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|--------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| deepcopy | 352 us | 262 us: 1.34x faster | +| deepcopy_memo | 40.3 us | 30.1 us: 1.34x faster | +| pathlib | 21.5 ms | 18.4 ms: 1.17x faster | +| go | 139 ms | 120 ms: 1.16x faster | +| crypto_pyaes | 76.6 ms | 66.1 ms: 1.16x faster | +| raytrace | 299 ms | 260 ms: 1.15x faster | +| comprehensions | 19.8 us | 17.2 us: 1.15x faster | +| deepcopy_reduce | 3.08 us | 2.68 us: 1.15x faster | +| unpack_sequence | 52.1 ns | 45.4 ns: 1.15x faster | +| generators | 32.2 ms | 29.0 ms: 1.11x faster | +| sympy_sum | 166 ms | 153 ms: 1.09x faster | +| bpe_tokeniser | 4.74 sec | 4.36 sec: 1.09x faster | +| json | 5.02 ms | 4.64 ms: 1.08x faster | +| logging_format | 7.35 us | 6.81 us: 1.08x faster | +| regex_compile | 142 ms | 132 ms: 1.08x faster | +| thrift | 791 us | 738 us: 1.07x faster | +| logging_simple | 6.63 us | 6.18 us: 1.07x faster | +| chaos | 62.8 ms | 58.6 ms: 1.07x faster | +| json_loads | 26.5 us | 24.8 us: 1.07x faster | +| deltablue | 3.45 ms | 3.23 ms: 1.07x faster | +| sympy_str | 292 ms | 274 ms: 1.06x faster | +| logging_silent | 109 ns | 103 ns: 1.06x faster | +| coroutines | 23.9 ms | 22.7 ms: 1.06x faster | +| async_generators | 384 ms | 367 ms: 1.05x faster | +| pprint_safe_repr | 743 ms | 713 ms: 1.04x faster | +| sqlglot_parse | 1.36 ms | 1.30 ms: 1.04x faster | +| dulwich_log | 78.9 ms | 75.8 ms: 1.04x faster | +| hexiom | 6.17 ms | 5.93 ms: 1.04x faster | +| sqlglot_transpile | 1.67 ms | 1.61 ms: 1.04x faster | +| 2to3 | 264 ms | 254 ms: 1.04x faster | +| scimark_monte_carlo | 68.4 ms | 66.2 ms: 1.03x faster | +| pprint_pformat | 1.52 sec | 1.47 sec: 1.03x faster | +| sympy_integrate | 20.5 ms | 19.9 ms: 1.03x faster | +| unpickle | 14.1 us | 13.7 us: 1.03x faster | +| xml_etree_parse | 139 ms | 135 ms: 1.03x faster | +| float | 80.8 ms | 78.6 ms: 1.03x faster | +| mdp | 2.42 sec | 2.35 sec: 1.03x faster | +| unpickle_pure_python | 221 us | 215 us: 1.02x faster | +| meteor_contest | 104 ms | 101 ms: 1.02x faster | +| asyncio_tcp | 519 ms | 507 ms: 1.02x faster | +| pycparser | 1.17 sec | 1.14 sec: 1.02x faster | +| sympy_expand | 468 ms | 458 ms: 1.02x faster | +| regex_effbot | 3.17 ms | 3.11 ms: 1.02x faster | +| typing_runtime_protocols | 163 us | 161 us: 1.02x faster | +| xml_etree_iterparse | 96.7 ms | 95.4 ms: 1.01x faster | +| sqlite_synth | 2.20 us | 2.17 us: 1.01x faster | +| docutils | 2.64 sec | 2.61 sec: 1.01x faster | +| genshi_text | 22.8 ms | 22.6 ms: 1.01x faster | +| tomli_loads | 2.11 sec | 2.09 sec: 1.01x faster | +| scimark_fft | 342 ms | 339 ms: 1.01x faster | +| xml_etree_generate | 85.2 ms | 84.8 ms: 1.01x faster | +| nqueens | 80.1 ms | 79.7 ms: 1.01x faster | +| xml_etree_process | 59.0 ms | 59.2 ms: 1.00x slower | +| pidigits | 184 ms | 186 ms: 1.01x slower | +| asyncio_websockets | 517 ms | 521 ms: 1.01x slower | +| asyncio_tcp_ssl | 1.51 sec | 1.52 sec: 1.01x slower | +| pyflate | 448 ms | 452 ms: 1.01x slower | +| sqlglot_optimize | 53.3 ms | 53.8 ms: 1.01x slower | +| unpickle_list | 4.67 us | 4.74 us: 1.01x slower | +| django_template | 34.7 ms | 35.2 ms: 1.02x slower | +| pickle_pure_python | 308 us | 316 us: 1.03x slower | +| spectral_norm | 110 ms | 113 ms: 1.03x slower | +| fannkuch | 372 ms | 384 ms: 1.03x slower | +| nbody | 89.3 ms | 92.9 ms: 1.04x slower | +| scimark_sparse_mat_mult | 4.39 ms | 4.57 ms: 1.04x slower | +| scimark_sor | 130 ms | 135 ms: 1.04x slower | +| python_startup_no_site | 7.16 ms | 7.48 ms: 1.04x slower | +| html5lib | 63.6 ms | 66.5 ms: 1.05x slower | +| pickle_dict | 31.8 us | 33.4 us: 1.05x slower | +| mako | 11.0 ms | 11.6 ms: 1.06x slower | +| bench_thread_pool | 941 us | 1.02 ms: 1.08x slower | +| gc_traversal | 3.46 ms | 3.75 ms: 1.09x slower | +| regex_dna | 168 ms | 182 ms: 1.09x slower | +| pickle_list | 4.77 us | 5.22 us: 1.09x slower | +| json_dumps | 10.4 ms | 11.5 ms: 1.11x slower | +| python_startup | 9.93 ms | 11.1 ms: 1.12x slower | +| telco | 6.53 ms | 7.31 ms: 1.12x slower | +| coverage | 71.4 ms | 81.4 ms: 1.14x slower | +| pickle | 10.9 us | 12.7 us: 1.16x slower | +| regex_v8 | 20.6 ms | 24.2 ms: 1.17x slower | +| create_gc_cycles | 1.09 ms | 1.35 ms: 1.24x slower | +| bench_mp_pool | 10.8 ms | 64.3 ms: 5.96x slower | +| Geometric mean | (ref) | 1.00x slower | + +Benchmark hidden because not significant (6): genshi_xml, richards, pylint, scimark_lu, sqlglot_normalize, richards_super +Ignored benchmarks (17) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, mypy2, sqlalchemy_declarative, sqlalchemy_imperative, tornado_http + +# HPT report + +- Reliability score: 98.55% likely to be faster +- 90% likely to have a speedup of 1.00x +- 95% likely to have a speedup of 1.00x +- 99% likely to have a speedup of 1.00x + +# Memory +- memory change: 1.02x \ No newline at end of file diff --git a/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.svg b/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.svg new file mode 100644 index 00000000..d63a83fd --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.12.6.svg @@ -0,0 +1,3086 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.md b/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.md new file mode 100644 index 00000000..f8c79f42 --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.md @@ -0,0 +1,192 @@ +# Results vs. 3.13.0rc2 + +- fork: python +- ref: 4ae50615d2beef0f93d9 +- machine: linux-x86_64 +- commit hash: 4ae5061 +- commit date: 2024-11-13 +- overall geometric mean: 1.02x slower +- HPT reliability: 92.62% +- HPT 99th percentile: 1.00x slower +- Memory change: 1.00x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 260 ms | 254 ms: 1.02x faster | +| html5lib | 67.0 ms | 66.5 ms: 1.01x faster | +| Geometric mean | (ref) | 1.01x faster | + +Benchmark hidden because not significant (1): docutils + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| coroutines | 23.6 ms | 22.7 ms: 1.04x faster | +| async_generators | 377 ms | 367 ms: 1.03x faster | +| asyncio_tcp_ssl | 1.51 sec | 1.52 sec: 1.01x slower | +| Geometric mean | (ref) | 1.01x faster | + +Benchmark hidden because not significant (2): asyncio_websockets, asyncio_tcp + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 217 ms | 186 ms: 1.17x faster | +| float | 77.5 ms | 78.6 ms: 1.01x slower | +| nbody | 85.1 ms | 92.9 ms: 1.09x slower | +| Geometric mean | (ref) | 1.02x faster | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 3.08 ms | 3.11 ms: 1.01x slower | +| regex_dna | 180 ms | 182 ms: 1.01x slower | +| regex_v8 | 22.7 ms | 24.2 ms: 1.07x slower | +| Geometric mean | (ref) | 1.02x slower | + +Benchmark hidden because not significant (1): regex_compile + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|----------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| json_loads | 27.0 us | 24.8 us: 1.09x faster | +| unpickle | 14.3 us | 13.7 us: 1.05x faster | +| xml_etree_parse | 136 ms | 135 ms: 1.01x faster | +| xml_etree_generate | 85.4 ms | 84.8 ms: 1.01x faster | +| unpickle_list | 4.71 us | 4.74 us: 1.01x slower | +| unpickle_pure_python | 210 us | 215 us: 1.03x slower | +| pickle_dict | 32.5 us | 33.4 us: 1.03x slower | +| tomli_loads | 2.01 sec | 2.09 sec: 1.04x slower | +| pickle_list | 4.93 us | 5.22 us: 1.06x slower | +| pickle_pure_python | 294 us | 316 us: 1.07x slower | +| json_dumps | 10.5 ms | 11.5 ms: 1.09x slower | +| pickle | 11.3 us | 12.7 us: 1.12x slower | +| Geometric mean | (ref) | 1.02x slower | + +Benchmark hidden because not significant (2): xml_etree_process, xml_etree_iterparse + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 7.39 ms | 7.48 ms: 1.01x slower | +| python_startup | 11.0 ms | 11.1 ms: 1.01x slower | +| Geometric mean | (ref) | 1.01x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|-----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| mako | 11.3 ms | 11.6 ms: 1.02x slower | +| genshi_xml | 48.8 ms | 50.1 ms: 1.03x slower | +| django_template | 34.1 ms | 35.2 ms: 1.03x slower | +| genshi_text | 21.5 ms | 22.6 ms: 1.05x slower | +| Geometric mean | (ref) | 1.03x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061 | +|--------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| deepcopy | 355 us | 262 us: 1.35x faster | +| deepcopy_memo | 39.1 us | 30.1 us: 1.30x faster | +| go | 141 ms | 120 ms: 1.17x faster | +| pidigits | 217 ms | 186 ms: 1.17x faster | +| deepcopy_reduce | 3.11 us | 2.68 us: 1.16x faster | +| json_loads | 27.0 us | 24.8 us: 1.09x faster | +| telco | 7.82 ms | 7.31 ms: 1.07x faster | +| json | 4.93 ms | 4.64 ms: 1.06x faster | +| thrift | 778 us | 738 us: 1.06x faster | +| unpickle | 14.3 us | 13.7 us: 1.05x faster | +| pathlib | 19.2 ms | 18.4 ms: 1.04x faster | +| coroutines | 23.6 ms | 22.7 ms: 1.04x faster | +| pprint_safe_repr | 738 ms | 713 ms: 1.04x faster | +| scimark_sparse_mat_mult | 4.71 ms | 4.57 ms: 1.03x faster | +| scimark_fft | 349 ms | 339 ms: 1.03x faster | +| async_generators | 377 ms | 367 ms: 1.03x faster | +| crypto_pyaes | 67.9 ms | 66.1 ms: 1.03x faster | +| 2to3 | 260 ms | 254 ms: 1.02x faster | +| bpe_tokeniser | 4.45 sec | 4.36 sec: 1.02x faster | +| sympy_sum | 156 ms | 153 ms: 1.02x faster | +| coverage | 83.0 ms | 81.4 ms: 1.02x faster | +| pprint_pformat | 1.50 sec | 1.47 sec: 1.02x faster | +| sqlite_synth | 2.21 us | 2.17 us: 1.02x faster | +| xml_etree_parse | 136 ms | 135 ms: 1.01x faster | +| hexiom | 5.99 ms | 5.93 ms: 1.01x faster | +| xml_etree_generate | 85.4 ms | 84.8 ms: 1.01x faster | +| html5lib | 67.0 ms | 66.5 ms: 1.01x faster | +| logging_silent | 103 ns | 103 ns: 1.00x slower | +| sympy_integrate | 19.8 ms | 19.9 ms: 1.00x slower | +| scimark_sor | 134 ms | 135 ms: 1.01x slower | +| unpickle_list | 4.71 us | 4.74 us: 1.01x slower | +| asyncio_tcp_ssl | 1.51 sec | 1.52 sec: 1.01x slower | +| generators | 28.8 ms | 29.0 ms: 1.01x slower | +| pyflate | 449 ms | 452 ms: 1.01x slower | +| richards_super | 51.6 ms | 52.1 ms: 1.01x slower | +| regex_effbot | 3.08 ms | 3.11 ms: 1.01x slower | +| sqlglot_normalize | 106 ms | 107 ms: 1.01x slower | +| python_startup_no_site | 7.39 ms | 7.48 ms: 1.01x slower | +| python_startup | 11.0 ms | 11.1 ms: 1.01x slower | +| regex_dna | 180 ms | 182 ms: 1.01x slower | +| scimark_monte_carlo | 65.4 ms | 66.2 ms: 1.01x slower | +| create_gc_cycles | 1.34 ms | 1.35 ms: 1.01x slower | +| dulwich_log | 74.8 ms | 75.8 ms: 1.01x slower | +| unpack_sequence | 44.8 ns | 45.4 ns: 1.01x slower | +| nqueens | 78.6 ms | 79.7 ms: 1.01x slower | +| float | 77.5 ms | 78.6 ms: 1.01x slower | +| richards | 45.2 ms | 45.9 ms: 1.02x slower | +| scimark_lu | 113 ms | 114 ms: 1.02x slower | +| spectral_norm | 111 ms | 113 ms: 1.02x slower | +| sqlglot_optimize | 52.7 ms | 53.8 ms: 1.02x slower | +| chaos | 57.3 ms | 58.6 ms: 1.02x slower | +| pycparser | 1.12 sec | 1.14 sec: 1.02x slower | +| mako | 11.3 ms | 11.6 ms: 1.02x slower | +| unpickle_pure_python | 210 us | 215 us: 1.03x slower | +| pickle_dict | 32.5 us | 33.4 us: 1.03x slower | +| genshi_xml | 48.8 ms | 50.1 ms: 1.03x slower | +| raytrace | 253 ms | 260 ms: 1.03x slower | +| sqlglot_transpile | 1.56 ms | 1.61 ms: 1.03x slower | +| django_template | 34.1 ms | 35.2 ms: 1.03x slower | +| deltablue | 3.12 ms | 3.23 ms: 1.03x slower | +| fannkuch | 370 ms | 384 ms: 1.04x slower | +| typing_runtime_protocols | 155 us | 161 us: 1.04x slower | +| sqlglot_parse | 1.25 ms | 1.30 ms: 1.04x slower | +| tomli_loads | 2.01 sec | 2.09 sec: 1.04x slower | +| comprehensions | 16.5 us | 17.2 us: 1.05x slower | +| genshi_text | 21.5 ms | 22.6 ms: 1.05x slower | +| pickle_list | 4.93 us | 5.22 us: 1.06x slower | +| regex_v8 | 22.7 ms | 24.2 ms: 1.07x slower | +| pickle_pure_python | 294 us | 316 us: 1.07x slower | +| json_dumps | 10.5 ms | 11.5 ms: 1.09x slower | +| nbody | 85.1 ms | 92.9 ms: 1.09x slower | +| bench_thread_pool | 919 us | 1.02 ms: 1.10x slower | +| pickle | 11.3 us | 12.7 us: 1.12x slower | +| gc_traversal | 3.14 ms | 3.75 ms: 1.19x slower | +| bench_mp_pool | 11.0 ms | 64.3 ms: 5.85x slower | +| Geometric mean | (ref) | 1.02x slower | + +Benchmark hidden because not significant (13): meteor_contest, logging_format, xml_etree_process, docutils, sympy_str, mdp, asyncio_websockets, regex_compile, sympy_expand, asyncio_tcp, logging_simple, pylint, xml_etree_iterparse +Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, tornado_http + +# HPT report + +- Reliability score: 92.62% likely to be slow +- 90% likely to have a slowdown of 1.00x +- 95% likely to have a slowdown of 1.00x +- 99% likely to have a slowdown of 1.00x + +# Memory +- memory change: 1.00x \ No newline at end of file diff --git a/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.svg b/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.svg new file mode 100644 index 00000000..e136115a --- /dev/null +++ b/results/bm-20241113-3.14.0a1+-4ae5061/bm-20241113-vultr-x86_64-python-4ae50615d2beef0f93d9-3.14.0a1+-4ae5061-vs-3.13.0rc2.svg @@ -0,0 +1,3136 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +