diff --git a/README.md b/README.md index b4ba933..87fa24f 100644 --- a/README.md +++ b/README.md @@ -12,6 +12,7 @@ Here are some recent and important revisions. 👉 [Complete list of results](RE ## linux x86_64 (linux) | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | +| [2025-01-11](results/bm-20250111-3.14.0a3%2B-553cdc6) | python/553cdc6d6856c1b4539a | 553cdc6 | 1.071x ↑
[📄](results/bm-20250111-3.14.0a3%2B-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3%2B-553cdc6-vs-3.12.6.md)[📈](results/bm-20250111-3.14.0a3%2B-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3%2B-553cdc6-vs-3.12.6.svg) | 1.034x ↑
[📄](results/bm-20250111-3.14.0a3%2B-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3%2B-553cdc6-vs-3.13.0rc2.md)[📈](results/bm-20250111-3.14.0a3%2B-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3%2B-553cdc6-vs-3.13.0rc2.svg) | | | [2025-01-09](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL) | nascheme/nogil_gc_mark_alive | f509a13 (NOGIL) | 1.184x ↓
[📄](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-linux-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-3.12.6.md)[📈](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-linux-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-3.12.6.svg) | 1.213x ↓
[📄](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-linux-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-3.13.0rc2.md)[📈](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-linux-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-3.13.0rc2.svg) | 1.058x ↓
[📄](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-linux-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-base.md)[📈](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-linux-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-base.svg)[🧠](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-linux-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-base-mem.svg) | | [2025-01-09](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL) | python/087bb48acac997c06e69 | 087bb48 (NOGIL) | 1.180x ↓
[📄](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.12.6.md)[📈](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.12.6.svg) | 1.207x ↓
[📄](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.13.0rc2.md)[📈](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.13.0rc2.svg) | 1.221x ↓
[📄](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-base.md)[📈](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-base.svg)[🧠](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-base-mem.svg) | | [2025-01-09](results/bm-20250109-3.14.0a3%2B-087bb48) | python/087bb48acac997c06e69 | 087bb48 | 1.063x ↑
[📄](results/bm-20250109-3.14.0a3%2B-087bb48/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.12.6.md)[📈](results/bm-20250109-3.14.0a3%2B-087bb48/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.12.6.svg) | 1.023x ↑
[📄](results/bm-20250109-3.14.0a3%2B-087bb48/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.13.0rc2.md)[📈](results/bm-20250109-3.14.0a3%2B-087bb48/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.13.0rc2.svg) | | @@ -26,7 +27,9 @@ Here are some recent and important revisions. 👉 [Complete list of results](RE | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | | [2025-01-10](results/bm-20250110-3.14.0a3%2B-7ab3ec6-NOGIL) | mpage/gh_115999_load_attr_ | 7ab3ec6 (NOGIL) | 1.056x ↓
[📄](results/bm-20250110-3.14.0a3%2B-7ab3ec6-NOGIL/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-3.12.6.md)[📈](results/bm-20250110-3.14.0a3%2B-7ab3ec6-NOGIL/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-3.12.6.svg) | 1.086x ↓
[📄](results/bm-20250110-3.14.0a3%2B-7ab3ec6-NOGIL/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-3.13.0rc2.md)[📈](results/bm-20250110-3.14.0a3%2B-7ab3ec6-NOGIL/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-3.13.0rc2.svg) | 1.117x ↑
[📄](results/bm-20250110-3.14.0a3%2B-7ab3ec6-NOGIL/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-base.md)[📈](results/bm-20250110-3.14.0a3%2B-7ab3ec6-NOGIL/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-base.svg)[🧠](results/bm-20250110-3.14.0a3%2B-7ab3ec6-NOGIL/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-base-mem.svg) | -| [2025-01-10](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL) | python/1b39b502d33c68f52fd7 | 1b39b50 (NOGIL) | 1.159x ↓
[📄](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.12.6.md)[📈](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.12.6.svg) | 1.186x ↓
[📄](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.13.0rc2.md)[📈](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.13.0rc2.svg) | | +| [2025-01-10](results/bm-20250110-3.14.0a3%2B-7ab3ec6) | mpage/gh_115999_load_attr_ | 7ab3ec6 | 1.101x ↑
[📄](results/bm-20250110-3.14.0a3%2B-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-3.12.6.md)[📈](results/bm-20250110-3.14.0a3%2B-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-3.12.6.svg) | 1.062x ↑
[📄](results/bm-20250110-3.14.0a3%2B-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-3.13.0rc2.md)[📈](results/bm-20250110-3.14.0a3%2B-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-3.13.0rc2.svg) | 1.000x ↑
[📄](results/bm-20250110-3.14.0a3%2B-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-base.md)[📈](results/bm-20250110-3.14.0a3%2B-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-base.svg)[🧠](results/bm-20250110-3.14.0a3%2B-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-base-mem.svg) | +| [2025-01-10](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL) | python/1b39b502d33c68f52fd7 | 1b39b50 (NOGIL) | 1.159x ↓
[📄](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.12.6.md)[📈](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.12.6.svg) | 1.186x ↓
[📄](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.13.0rc2.md)[📈](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.13.0rc2.svg) | 1.230x ↓
[📄](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-base.md)[📈](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-base.svg)[🧠](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-base-mem.svg) | +| [2025-01-10](results/bm-20250110-3.14.0a3%2B-1b39b50) | python/1b39b502d33c68f52fd7 | 1b39b50 | 1.100x ↑
[📄](results/bm-20250110-3.14.0a3%2B-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.12.6.md)[📈](results/bm-20250110-3.14.0a3%2B-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.12.6.svg) | 1.061x ↑
[📄](results/bm-20250110-3.14.0a3%2B-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.13.0rc2.md)[📈](results/bm-20250110-3.14.0a3%2B-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.13.0rc2.svg) | | | [2025-01-09](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL) | nascheme/nogil_gc_mark_alive | f509a13 (NOGIL) | 1.157x ↓
[📄](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-vultr-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-3.12.6.md)[📈](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-vultr-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-3.12.6.svg) | 1.184x ↓
[📄](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-vultr-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-3.13.0rc2.md)[📈](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-vultr-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-3.13.0rc2.svg) | 1.002x ↑
[📄](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-vultr-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-base.md)[📈](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-vultr-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-base.svg)[🧠](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-vultr-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-base-mem.svg) | | [2025-01-09](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL) | python/087bb48acac997c06e69 | 087bb48 (NOGIL) | 1.165x ↓
[📄](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.12.6.md)[📈](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.12.6.svg) | 1.192x ↓
[📄](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.13.0rc2.md)[📈](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.13.0rc2.svg) | 1.233x ↓
[📄](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-base.md)[📈](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-base.svg)[🧠](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-base-mem.svg) | | [2025-01-09](results/bm-20250109-3.14.0a3%2B-087bb48) | python/087bb48acac997c06e69 | 087bb48 | 1.096x ↑
[📄](results/bm-20250109-3.14.0a3%2B-087bb48/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.12.6.md)[📈](results/bm-20250109-3.14.0a3%2B-087bb48/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.12.6.svg) | 1.057x ↑
[📄](results/bm-20250109-3.14.0a3%2B-087bb48/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.13.0rc2.md)[📈](results/bm-20250109-3.14.0a3%2B-087bb48/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.13.0rc2.svg) | | diff --git a/RESULTS.md b/RESULTS.md index 4e91090..41b50b7 100644 --- a/RESULTS.md +++ b/RESULTS.md @@ -6,6 +6,7 @@ ## linux x86_64 (linux) | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | +| [2025-01-11](results/bm-20250111-3.14.0a3%2B-553cdc6) | python/553cdc6d6856c1b4539a | 553cdc6 | 1.071x ↑
[📄](results/bm-20250111-3.14.0a3%2B-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3%2B-553cdc6-vs-3.12.6.md)[📈](results/bm-20250111-3.14.0a3%2B-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3%2B-553cdc6-vs-3.12.6.svg) | 1.034x ↑
[📄](results/bm-20250111-3.14.0a3%2B-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3%2B-553cdc6-vs-3.13.0rc2.md)[📈](results/bm-20250111-3.14.0a3%2B-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3%2B-553cdc6-vs-3.13.0rc2.svg) | | | [2025-01-09](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL) | nascheme/nogil_gc_mark_alive | f509a13 (NOGIL) | 1.184x ↓
[📄](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-linux-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-3.12.6.md)[📈](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-linux-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-3.12.6.svg) | 1.213x ↓
[📄](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-linux-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-3.13.0rc2.md)[📈](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-linux-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-3.13.0rc2.svg) | 1.058x ↓
[📄](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-linux-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-base.md)[📈](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-linux-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-base.svg)[🧠](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-linux-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-base-mem.svg) | | [2025-01-09](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL) | python/087bb48acac997c06e69 | 087bb48 (NOGIL) | 1.180x ↓
[📄](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.12.6.md)[📈](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.12.6.svg) | 1.207x ↓
[📄](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.13.0rc2.md)[📈](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.13.0rc2.svg) | 1.221x ↓
[📄](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-base.md)[📈](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-base.svg)[🧠](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-base-mem.svg) | | [2025-01-09](results/bm-20250109-3.14.0a3%2B-087bb48) | python/087bb48acac997c06e69 | 087bb48 | 1.063x ↑
[📄](results/bm-20250109-3.14.0a3%2B-087bb48/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.12.6.md)[📈](results/bm-20250109-3.14.0a3%2B-087bb48/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.12.6.svg) | 1.023x ↑
[📄](results/bm-20250109-3.14.0a3%2B-087bb48/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.13.0rc2.md)[📈](results/bm-20250109-3.14.0a3%2B-087bb48/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.13.0rc2.svg) | | @@ -249,7 +250,9 @@ | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | | [2025-01-10](results/bm-20250110-3.14.0a3%2B-7ab3ec6-NOGIL) | mpage/gh_115999_load_attr_ | 7ab3ec6 (NOGIL) | 1.056x ↓
[📄](results/bm-20250110-3.14.0a3%2B-7ab3ec6-NOGIL/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-3.12.6.md)[📈](results/bm-20250110-3.14.0a3%2B-7ab3ec6-NOGIL/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-3.12.6.svg) | 1.086x ↓
[📄](results/bm-20250110-3.14.0a3%2B-7ab3ec6-NOGIL/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-3.13.0rc2.md)[📈](results/bm-20250110-3.14.0a3%2B-7ab3ec6-NOGIL/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-3.13.0rc2.svg) | 1.117x ↑
[📄](results/bm-20250110-3.14.0a3%2B-7ab3ec6-NOGIL/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-base.md)[📈](results/bm-20250110-3.14.0a3%2B-7ab3ec6-NOGIL/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-base.svg)[🧠](results/bm-20250110-3.14.0a3%2B-7ab3ec6-NOGIL/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-base-mem.svg) | -| [2025-01-10](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL) | python/1b39b502d33c68f52fd7 | 1b39b50 (NOGIL) | 1.159x ↓
[📄](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.12.6.md)[📈](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.12.6.svg) | 1.186x ↓
[📄](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.13.0rc2.md)[📈](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.13.0rc2.svg) | | +| [2025-01-10](results/bm-20250110-3.14.0a3%2B-7ab3ec6) | mpage/gh_115999_load_attr_ | 7ab3ec6 | 1.101x ↑
[📄](results/bm-20250110-3.14.0a3%2B-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-3.12.6.md)[📈](results/bm-20250110-3.14.0a3%2B-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-3.12.6.svg) | 1.062x ↑
[📄](results/bm-20250110-3.14.0a3%2B-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-3.13.0rc2.md)[📈](results/bm-20250110-3.14.0a3%2B-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-3.13.0rc2.svg) | 1.000x ↑
[📄](results/bm-20250110-3.14.0a3%2B-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-base.md)[📈](results/bm-20250110-3.14.0a3%2B-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-base.svg)[🧠](results/bm-20250110-3.14.0a3%2B-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-base-mem.svg) | +| [2025-01-10](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL) | python/1b39b502d33c68f52fd7 | 1b39b50 (NOGIL) | 1.159x ↓
[📄](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.12.6.md)[📈](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.12.6.svg) | 1.186x ↓
[📄](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.13.0rc2.md)[📈](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.13.0rc2.svg) | 1.230x ↓
[📄](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-base.md)[📈](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-base.svg)[🧠](results/bm-20250110-3.14.0a3%2B-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-base-mem.svg) | +| [2025-01-10](results/bm-20250110-3.14.0a3%2B-1b39b50) | python/1b39b502d33c68f52fd7 | 1b39b50 | 1.100x ↑
[📄](results/bm-20250110-3.14.0a3%2B-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.12.6.md)[📈](results/bm-20250110-3.14.0a3%2B-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.12.6.svg) | 1.061x ↑
[📄](results/bm-20250110-3.14.0a3%2B-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.13.0rc2.md)[📈](results/bm-20250110-3.14.0a3%2B-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.13.0rc2.svg) | | | [2025-01-09](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL) | nascheme/nogil_gc_mark_alive | f509a13 (NOGIL) | 1.157x ↓
[📄](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-vultr-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-3.12.6.md)[📈](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-vultr-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-3.12.6.svg) | 1.184x ↓
[📄](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-vultr-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-3.13.0rc2.md)[📈](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-vultr-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-3.13.0rc2.svg) | 1.002x ↑
[📄](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-vultr-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-base.md)[📈](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-vultr-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-base.svg)[🧠](results/bm-20250109-3.14.0a3%2B-f509a13-NOGIL/bm-20250109-vultr-x86_64-nascheme-nogil_gc_mark_alive-3.14.0a3%2B-f509a13-vs-base-mem.svg) | | [2025-01-09](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL) | python/087bb48acac997c06e69 | 087bb48 (NOGIL) | 1.165x ↓
[📄](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.12.6.md)[📈](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.12.6.svg) | 1.192x ↓
[📄](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.13.0rc2.md)[📈](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.13.0rc2.svg) | 1.233x ↓
[📄](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-base.md)[📈](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-base.svg)[🧠](results/bm-20250109-3.14.0a3%2B-087bb48-NOGIL/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-base-mem.svg) | | [2025-01-09](results/bm-20250109-3.14.0a3%2B-087bb48) | python/087bb48acac997c06e69 | 087bb48 | 1.096x ↑
[📄](results/bm-20250109-3.14.0a3%2B-087bb48/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.12.6.md)[📈](results/bm-20250109-3.14.0a3%2B-087bb48/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.12.6.svg) | 1.057x ↑
[📄](results/bm-20250109-3.14.0a3%2B-087bb48/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.13.0rc2.md)[📈](results/bm-20250109-3.14.0a3%2B-087bb48/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3%2B-087bb48-vs-3.13.0rc2.svg) | | diff --git a/configs.json b/configs.json index 7b5793c..f3626b4 100644 --- a/configs.json +++ b/configs.json @@ -187,5 +187,6 @@ "bm-20250107-3.14.0a3+-e08b282/bm-20250107-vultr-x86_64-python-e08b28235a863323ca3a-3.14.0a3+-e08b282.json,bm-20250107-3.14.0a3+-e08b282-NOGIL/bm-20250107-vultr-x86_64-python-e08b28235a863323ca3a-3.14.0a3+-e08b282.json": 0.7681507517420866, "bm-20250108-3.14.0a3+-a1284e9/bm-20250108-linux-x86_64-python-a1284e97979ff73ad72a-3.14.0a3+-a1284e9.json,bm-20250108-3.14.0a3+-a1284e9-NOGIL/bm-20250108-linux-x86_64-python-a1284e97979ff73ad72a-3.14.0a3+-a1284e9.json": 0.7976116126209034, "bm-20250109-3.14.0a3+-087bb48/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3+-087bb48.json,bm-20250109-3.14.0a3+-087bb48-NOGIL/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3+-087bb48.json": 0.7787215480758796, - "bm-20250109-3.14.0a3+-087bb48/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3+-087bb48.json,bm-20250109-3.14.0a3+-087bb48-NOGIL/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3+-087bb48.json": 0.7667536026096173 + "bm-20250109-3.14.0a3+-087bb48/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3+-087bb48.json,bm-20250109-3.14.0a3+-087bb48-NOGIL/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3+-087bb48.json": 0.7667536026096173, + "bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json,bm-20250110-3.14.0a3+-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json": 0.7696642866698067 } \ No newline at end of file diff --git a/configs.svg b/configs.svg index 4b4cc47..309dcde 100644 --- a/configs.svg +++ b/configs.svg @@ -252,8 +252,8 @@ - - + + @@ -265,9 +265,9 @@ - - - + + + @@ -279,9 +279,9 @@ - - - + + + @@ -290,9 +290,9 @@ - - - + + + @@ -301,9 +301,9 @@ - - - + + + @@ -312,9 +312,9 @@ - - - + + + @@ -374,204 +374,205 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/longitudinal.json b/longitudinal.json index 7ae3c5e..260c1c9 100644 --- a/longitudinal.json +++ b/longitudinal.json @@ -225,5 +225,7 @@ "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20250107-3.14.0a3+-e08b282/bm-20250107-vultr-x86_64-python-e08b28235a863323ca3a-3.14.0a3+-e08b282.json,3.13.0rc2": 1.0616423755425834, "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20250108-3.14.0a3+-a1284e9/bm-20250108-linux-x86_64-python-a1284e97979ff73ad72a-3.14.0a3+-a1284e9.json,3.13.0rc2": 1.0546767049178476, "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20250109-3.14.0a3+-087bb48/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3+-087bb48.json,3.13.0rc2": 1.0234589670620329, - "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20250109-3.14.0a3+-087bb48/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3+-087bb48.json,3.13.0rc2": 1.0560906543163064 + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20250109-3.14.0a3+-087bb48/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3+-087bb48.json,3.13.0rc2": 1.0560906543163064, + "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6.json,3.13.0rc2": 1.0343809271595037, + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json,3.13.0rc2": 1.059885346636748 } \ No newline at end of file diff --git a/longitudinal.svg b/longitudinal.svg index 3b12be1..0de87e9 100644 --- a/longitudinal.svg +++ b/longitudinal.svg @@ -387,8 +387,8 @@ - - + + @@ -397,9 +397,9 @@ - - - + + + @@ -408,9 +408,9 @@ - - - + + + @@ -419,9 +419,9 @@ - - - + + + @@ -430,9 +430,9 @@ - - - + + + @@ -441,9 +441,9 @@ - - - + + + @@ -534,211 +534,213 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/memory_configs.json b/memory_configs.json index df41b13..ae24ad5 100644 --- a/memory_configs.json +++ b/memory_configs.json @@ -187,5 +187,6 @@ "bm-20250107-3.14.0a3+-e08b282/bm-20250107-vultr-x86_64-python-e08b28235a863323ca3a-3.14.0a3+-e08b282.json,bm-20250107-3.14.0a3+-e08b282-NOGIL/bm-20250107-vultr-x86_64-python-e08b28235a863323ca3a-3.14.0a3+-e08b282.json": 1.19, "bm-20250108-3.14.0a3+-a1284e9/bm-20250108-linux-x86_64-python-a1284e97979ff73ad72a-3.14.0a3+-a1284e9.json,bm-20250108-3.14.0a3+-a1284e9-NOGIL/bm-20250108-linux-x86_64-python-a1284e97979ff73ad72a-3.14.0a3+-a1284e9.json": 1.18, "bm-20250109-3.14.0a3+-087bb48/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3+-087bb48.json,bm-20250109-3.14.0a3+-087bb48-NOGIL/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3+-087bb48.json": 1.18, - "bm-20250109-3.14.0a3+-087bb48/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3+-087bb48.json,bm-20250109-3.14.0a3+-087bb48-NOGIL/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3+-087bb48.json": 1.2 + "bm-20250109-3.14.0a3+-087bb48/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3+-087bb48.json,bm-20250109-3.14.0a3+-087bb48-NOGIL/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3+-087bb48.json": 1.2, + "bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json,bm-20250110-3.14.0a3+-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json": 1.19 } \ No newline at end of file diff --git a/memory_configs.svg b/memory_configs.svg index 1f611ac..d31b6d9 100644 --- a/memory_configs.svg +++ b/memory_configs.svg @@ -6,7 +6,7 @@ - + @@ -20,7 +20,7 @@ - + @@ -30,7 +30,7 @@ - + @@ -40,7 +40,7 @@ - + @@ -50,7 +50,7 @@ - + @@ -60,7 +60,7 @@ - + @@ -70,7 +70,7 @@ - + @@ -85,7 +85,7 @@ - + @@ -94,7 +94,7 @@ - + @@ -103,7 +103,7 @@ - + @@ -112,7 +112,7 @@ - + @@ -121,7 +121,7 @@ - + @@ -134,7 +134,7 @@ - + @@ -151,7 +151,7 @@ - + @@ -248,8 +248,8 @@ - - + + @@ -261,9 +261,9 @@ - - - + + + @@ -275,9 +275,9 @@ - - - + + + @@ -286,9 +286,9 @@ - - - + + + @@ -297,9 +297,9 @@ - - - + + + @@ -308,9 +308,9 @@ - - - + + + @@ -406,204 +406,205 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + @@ -710,49 +711,49 @@ - + - + - + - + - + - + - + @@ -761,7 +762,7 @@ - + @@ -770,7 +771,7 @@ - + @@ -779,7 +780,7 @@ - + @@ -788,7 +789,7 @@ - + @@ -797,7 +798,7 @@ - + @@ -810,7 +811,7 @@ - + @@ -820,7 +821,7 @@ - + @@ -918,13 +919,13 @@ - + - + diff --git a/memory_long.json b/memory_long.json index d49ebac..208248c 100644 --- a/memory_long.json +++ b/memory_long.json @@ -225,5 +225,7 @@ "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20250107-3.14.0a3+-e08b282/bm-20250107-vultr-x86_64-python-e08b28235a863323ca3a-3.14.0a3+-e08b282.json,3.13.0rc2": 1.1, "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20250108-3.14.0a3+-a1284e9/bm-20250108-linux-x86_64-python-a1284e97979ff73ad72a-3.14.0a3+-a1284e9.json,3.13.0rc2": 1.12, "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20250109-3.14.0a3+-087bb48/bm-20250109-linux-x86_64-python-087bb48acac997c06e69-3.14.0a3+-087bb48.json,3.13.0rc2": 1.12, - "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20250109-3.14.0a3+-087bb48/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3+-087bb48.json,3.13.0rc2": 1.1 + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20250109-3.14.0a3+-087bb48/bm-20250109-vultr-x86_64-python-087bb48acac997c06e69-3.14.0a3+-087bb48.json,3.13.0rc2": 1.1, + "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6.json,3.13.0rc2": 1.12, + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json,3.13.0rc2": 1.1 } \ No newline at end of file diff --git a/memory_long.svg b/memory_long.svg index 13bd649..34736c2 100644 --- a/memory_long.svg +++ b/memory_long.svg @@ -381,8 +381,8 @@ - - + + @@ -391,9 +391,9 @@ - - - + + + @@ -402,9 +402,9 @@ - - - + + + @@ -413,9 +413,9 @@ - - - + + + @@ -424,9 +424,9 @@ - - - + + + @@ -435,9 +435,9 @@ - - - + + + @@ -528,210 +528,212 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/README.md b/results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/README.md index d8c4ffd..bb2f7ac 100644 --- a/results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/README.md +++ b/results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/README.md @@ -33,3 +33,12 @@ - [📄table](bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.13.0rc2.md) - [📈time plot](bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.13.0rc2.svg) +### vs. base + +- Geometric mean: 1.230x slower (HPT: reliability of 100.00%, 1.23x slower at 99th %ile) +- Memory usage: 1.19x +- new benchmarks: html5lib +- [🧠memory plot](bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-base-mem.svg) +- [📄table](bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-base.md) +- [📈time plot](bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-base.svg) + diff --git a/results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50-vs-base-mem.svg b/results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50-vs-base-mem.svg new file mode 100644 index 0000000..c9703c1 --- /dev/null +++ b/results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50-vs-base-mem.svg @@ -0,0 +1,3236 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50-vs-base.md b/results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50-vs-base.md new file mode 100644 index 0000000..1097c10 --- /dev/null +++ b/results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50-vs-base.md @@ -0,0 +1,211 @@ +# Results vs. base + +- fork: python +- ref: 1b39b502d33c68f52fd7 +- machine: linux-x86_64 +- commit hash: 1b39b50 +- commit date: 2025-01-10 +- overall geometric mean: 1.230x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.23x slower +- Memory change: 1.19x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json | results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| 2to3 | 252 ms | 344 ms: 1.37x slower | +| docutils | 2.53 sec | 2.98 sec: 1.18x slower | +| sphinx | 977 ms | 1.16 sec: 1.19x slower | +| Geometric mean | (ref) | 1.24x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json | results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json | +|----------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| asyncio_websockets | 523 ms | 518 ms: 1.01x faster | +| coroutines | 21.0 ms | 24.3 ms: 1.15x slower | +| async_tree_io_tg | 602 ms | 726 ms: 1.21x slower | +| async_tree_cpu_io_mixed_tg | 470 ms | 570 ms: 1.21x slower | +| async_generators | 358 ms | 434 ms: 1.21x slower | +| async_tree_cpu_io_mixed | 490 ms | 601 ms: 1.23x slower | +| async_tree_none_tg | 252 ms | 311 ms: 1.23x slower | +| async_tree_io | 603 ms | 749 ms: 1.24x slower | +| async_tree_none | 268 ms | 348 ms: 1.30x slower | +| async_tree_memoization | 324 ms | 427 ms: 1.32x slower | +| async_tree_memoization_tg | 300 ms | 397 ms: 1.32x slower | +| Geometric mean | (ref) | 1.22x slower | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json | results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| pidigits | 184 ms | 189 ms: 1.03x slower | +| nbody | 89.9 ms | 125 ms: 1.40x slower | +| float | 71.8 ms | 106 ms: 1.47x slower | +| Geometric mean | (ref) | 1.28x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json | results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| regex_effbot | 2.82 ms | 2.77 ms: 1.02x faster | +| regex_v8 | 24.4 ms | 24.1 ms: 1.01x faster | +| regex_dna | 182 ms | 182 ms: 1.00x slower | +| regex_compile | 125 ms | 166 ms: 1.32x slower | +| Geometric mean | (ref) | 1.06x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json | results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json | +|----------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| xml_etree_iterparse | 90.3 ms | 89.6 ms: 1.01x faster | +| xml_etree_parse | 128 ms | 130 ms: 1.02x slower | +| json_loads | 25.8 us | 28.8 us: 1.12x slower | +| xml_etree_generate | 82.5 ms | 97.8 ms: 1.19x slower | +| json_dumps | 11.4 ms | 14.1 ms: 1.24x slower | +| tomli_loads | 1.89 sec | 2.38 sec: 1.26x slower | +| xml_etree_process | 56.9 ms | 73.7 ms: 1.29x slower | +| unpickle_pure_python | 209 us | 321 us: 1.54x slower | +| pickle_pure_python | 303 us | 491 us: 1.62x slower | +| Geometric mean | (ref) | 1.24x slower | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json | results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json | +|------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| python_startup | 14.6 ms | 15.7 ms: 1.07x slower | +| python_startup_no_site | 7.48 ms | 9.79 ms: 1.31x slower | +| Geometric mean | (ref) | 1.18x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json | results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json | +|-----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| genshi_xml | 48.7 ms | 63.3 ms: 1.30x slower | +| django_template | 34.6 ms | 49.5 ms: 1.43x slower | +| genshi_text | 21.0 ms | 30.2 ms: 1.44x slower | +| mako | 11.6 ms | 17.0 ms: 1.46x slower | +| Geometric mean | (ref) | 1.41x slower | + +All benchmarks: +=============== + +| Benchmark | results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json | results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json | +|----------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| gc_traversal | 4.39 ms | 3.29 ms: 1.33x faster | +| sqlite_synth | 2.20 us | 2.13 us: 1.03x faster | +| create_gc_cycles | 1.85 ms | 1.81 ms: 1.02x faster | +| regex_effbot | 2.82 ms | 2.77 ms: 1.02x faster | +| regex_v8 | 24.4 ms | 24.1 ms: 1.01x faster | +| asyncio_websockets | 523 ms | 518 ms: 1.01x faster | +| xml_etree_iterparse | 90.3 ms | 89.6 ms: 1.01x faster | +| regex_dna | 182 ms | 182 ms: 1.00x slower | +| xml_etree_parse | 128 ms | 130 ms: 1.02x slower | +| pidigits | 184 ms | 189 ms: 1.03x slower | +| python_startup | 14.6 ms | 15.7 ms: 1.07x slower | +| json | 4.73 ms | 5.11 ms: 1.08x slower | +| pathlib | 17.8 ms | 19.2 ms: 1.08x slower | +| spectral_norm | 102 ms | 114 ms: 1.12x slower | +| json_loads | 25.8 us | 28.8 us: 1.12x slower | +| bench_mp_pool | 88.8 ms | 100 ms: 1.13x slower | +| k_core | 2.05 sec | 2.34 sec: 1.14x slower | +| coroutines | 21.0 ms | 24.3 ms: 1.15x slower | +| bpe_tokeniser | 4.23 sec | 4.95 sec: 1.17x slower | +| docutils | 2.53 sec | 2.98 sec: 1.18x slower | +| xml_etree_generate | 82.5 ms | 97.8 ms: 1.19x slower | +| sphinx | 977 ms | 1.16 sec: 1.19x slower | +| many_optionals | 1.02 ms | 1.23 ms: 1.20x slower | +| dulwich_log | 75.0 ms | 90.1 ms: 1.20x slower | +| async_tree_io_tg | 602 ms | 726 ms: 1.21x slower | +| mdp | 2.30 sec | 2.78 sec: 1.21x slower | +| telco | 7.20 ms | 8.71 ms: 1.21x slower | +| pycparser | 1.11 sec | 1.34 sec: 1.21x slower | +| async_tree_cpu_io_mixed_tg | 470 ms | 570 ms: 1.21x slower | +| async_generators | 358 ms | 434 ms: 1.21x slower | +| scimark_fft | 312 ms | 380 ms: 1.22x slower | +| async_tree_cpu_io_mixed | 490 ms | 601 ms: 1.23x slower | +| pylint | 279 ms | 342 ms: 1.23x slower | +| nqueens | 77.7 ms | 95.7 ms: 1.23x slower | +| async_tree_none_tg | 252 ms | 311 ms: 1.23x slower | +| json_dumps | 11.4 ms | 14.1 ms: 1.24x slower | +| async_tree_io | 603 ms | 749 ms: 1.24x slower | +| coverage | 79.1 ms | 99.0 ms: 1.25x slower | +| tomli_loads | 1.89 sec | 2.38 sec: 1.26x slower | +| sympy_expand | 454 ms | 572 ms: 1.26x slower | +| shortest_path | 431 ms | 547 ms: 1.27x slower | +| connected_components | 389 ms | 493 ms: 1.27x slower | +| sympy_integrate | 19.6 ms | 24.9 ms: 1.27x slower | +| scimark_sparse_mat_mult | 4.42 ms | 5.62 ms: 1.27x slower | +| sympy_sum | 151 ms | 193 ms: 1.28x slower | +| sqlglot_optimize | 51.8 ms | 66.1 ms: 1.28x slower | +| sqlglot_normalize | 102 ms | 131 ms: 1.28x slower | +| deepcopy | 251 us | 324 us: 1.29x slower | +| sympy_str | 270 ms | 350 ms: 1.29x slower | +| xml_etree_process | 56.9 ms | 73.7 ms: 1.29x slower | +| genshi_xml | 48.7 ms | 63.3 ms: 1.30x slower | +| async_tree_none | 268 ms | 348 ms: 1.30x slower | +| python_startup_no_site | 7.48 ms | 9.79 ms: 1.31x slower | +| subparsers | 21.5 ms | 28.2 ms: 1.31x slower | +| meteor_contest | 98.5 ms | 129 ms: 1.31x slower | +| async_tree_memoization | 324 ms | 427 ms: 1.32x slower | +| fannkuch | 364 ms | 481 ms: 1.32x slower | +| typing_runtime_protocols | 155 us | 205 us: 1.32x slower | +| regex_compile | 125 ms | 166 ms: 1.32x slower | +| async_tree_memoization_tg | 300 ms | 397 ms: 1.32x slower | +| deepcopy_reduce | 2.54 us | 3.37 us: 1.33x slower | +| 2to3 | 252 ms | 344 ms: 1.37x slower | +| pprint_safe_repr | 682 ms | 934 ms: 1.37x slower | +| thrift | 725 us | 993 us: 1.37x slower | +| crypto_pyaes | 64.9 ms | 89.3 ms: 1.37x slower | +| deepcopy_memo | 29.7 us | 40.8 us: 1.38x slower | +| pprint_pformat | 1.39 sec | 1.93 sec: 1.39x slower | +| nbody | 89.9 ms | 125 ms: 1.40x slower | +| generators | 27.4 ms | 38.4 ms: 1.40x slower | +| scimark_lu | 110 ms | 157 ms: 1.43x slower | +| sqlalchemy_declarative | 127 ms | 182 ms: 1.43x slower | +| django_template | 34.6 ms | 49.5 ms: 1.43x slower | +| logging_simple | 6.11 us | 8.75 us: 1.43x slower | +| genshi_text | 21.0 ms | 30.2 ms: 1.44x slower | +| logging_format | 6.85 us | 9.91 us: 1.45x slower | +| sqlalchemy_imperative | 19.2 ms | 27.9 ms: 1.45x slower | +| mako | 11.6 ms | 17.0 ms: 1.46x slower | +| float | 71.8 ms | 106 ms: 1.47x slower | +| pyflate | 413 ms | 629 ms: 1.52x slower | +| unpickle_pure_python | 209 us | 321 us: 1.54x slower | +| richards_super | 47.8 ms | 73.6 ms: 1.54x slower | +| richards | 41.7 ms | 66.2 ms: 1.59x slower | +| comprehensions | 16.8 us | 27.0 us: 1.61x slower | +| hexiom | 5.69 ms | 9.16 ms: 1.61x slower | +| pickle_pure_python | 303 us | 491 us: 1.62x slower | +| chaos | 57.3 ms | 94.4 ms: 1.65x slower | +| scimark_monte_carlo | 61.7 ms | 103 ms: 1.67x slower | +| sqlglot_transpile | 1.54 ms | 2.60 ms: 1.69x slower | +| scimark_sor | 114 ms | 203 ms: 1.77x slower | +| logging_silent | 104 ns | 185 ns: 1.78x slower | +| sqlglot_parse | 1.24 ms | 2.26 ms: 1.82x slower | +| raytrace | 256 ms | 486 ms: 1.90x slower | +| go | 113 ms | 229 ms: 2.02x slower | +| deltablue | 3.12 ms | 7.20 ms: 2.30x slower | +| bench_thread_pool | 1.03 ms | 3.37 ms: 3.27x slower | +| Geometric mean | (ref) | 1.31x slower | +Ignored benchmarks (1) of results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json: html5lib + +- Geometric mean (including insignificant results): 1.230x slower + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.25x +- 95% likely to have a slowdown of 1.24x +- 99% likely to have a slowdown of 1.23x + +# Memory +- memory change: 1.19x \ No newline at end of file diff --git a/results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50-vs-base.svg b/results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50-vs-base.svg new file mode 100644 index 0000000..7caefc7 --- /dev/null +++ b/results/bm-20250110-3.14.0a3+-1b39b50-NOGIL/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50-vs-base.svg @@ -0,0 +1,3205 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250110-3.14.0a3+-1b39b50/README.md b/results/bm-20250110-3.14.0a3+-1b39b50/README.md new file mode 100644 index 0000000..90237ff --- /dev/null +++ b/results/bm-20250110-3.14.0a3+-1b39b50/README.md @@ -0,0 +1,35 @@ +# Results + +- fork: python/1b39b502d33c68f52fd7 +- version: 3.14.0a3+ +- config: +- commit hash: [1b39b50](https://github.com/python/cpython/commit/1b39b50) +- commit date: 2025-01-10T10:54:45-05:00 +- commit merge base: [802556abfa008abe0bdd78e6f9e18bef71db90c1](https://github.com/python/cpython/commit/802556abfa008abe0bdd78e6f9e18bef71db90c1) +- ref: 1b39b502d33c68f52fd7 + +## linux x86_64 (vultr) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/12719509421) +- cpu model: Intel(R) Xeon(R) E-2286G CPU @ 4.00GHz +- platform: Linux-6.8.0-45-generic-x86_64-with-glibc2.39 +- [raw results](bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50.json) + +### vs. 3.12.6 + +- Geometric mean: 1.100x faster (HPT: reliability of 100.00%, 1.05x faster at 99th %ile) +- Memory usage: 1.11x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, html5lib, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers +- [📄table](bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.12.6.md) +- [📈time plot](bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.061x faster (HPT: reliability of 100.00%, 1.02x faster at 99th %ile) +- Memory usage: 1.10x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, html5lib, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers +- [📄table](bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.13.0rc2.md) +- [📈time plot](bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3%2B-1b39b50-vs-3.13.0rc2.svg) + diff --git a/results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50-vs-3.12.6.md b/results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50-vs-3.12.6.md new file mode 100644 index 0000000..41f56e5 --- /dev/null +++ b/results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50-vs-3.12.6.md @@ -0,0 +1,206 @@ +# Results vs. 3.12.6 + +- fork: python +- ref: 1b39b502d33c68f52fd7 +- machine: linux-x86_64 +- commit hash: 1b39b50 +- commit date: 2025-01-10 +- overall geometric mean: 1.100x faster +- HPT reliability: 100.00% +- HPT 99th percentile: 1.05x faster +- Memory change: 1.11x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 264 ms | 252 ms: 1.05x faster | +| docutils | 2.64 sec | 2.53 sec: 1.04x faster | +| Geometric mean | (ref) | 1.05x faster | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_memoization_tg | 560 ms | 300 ms: 1.86x faster | +| async_tree_io_tg | 1.11 sec | 602 ms: 1.84x faster | +| async_tree_io | 1.08 sec | 603 ms: 1.80x faster | +| async_tree_none_tg | 446 ms | 252 ms: 1.77x faster | +| async_tree_none | 464 ms | 268 ms: 1.73x faster | +| async_tree_memoization | 555 ms | 324 ms: 1.71x faster | +| async_tree_cpu_io_mixed_tg | 723 ms | 470 ms: 1.54x faster | +| async_tree_cpu_io_mixed | 715 ms | 490 ms: 1.46x faster | +| coroutines | 23.9 ms | 21.0 ms: 1.14x faster | +| async_generators | 384 ms | 358 ms: 1.07x faster | +| asyncio_websockets | 517 ms | 523 ms: 1.01x slower | +| Geometric mean | (ref) | 1.50x faster | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| float | 80.8 ms | 71.8 ms: 1.13x faster | +| pidigits | 184 ms | 184 ms: 1.00x slower | +| Geometric mean | (ref) | 1.04x faster | + +Benchmark hidden because not significant (1): nbody + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_compile | 142 ms | 125 ms: 1.14x faster | +| regex_effbot | 3.17 ms | 2.82 ms: 1.12x faster | +| regex_dna | 168 ms | 182 ms: 1.08x slower | +| regex_v8 | 20.6 ms | 24.4 ms: 1.19x slower | +| Geometric mean | (ref) | 1.00x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | +|----------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| tomli_loads | 2.11 sec | 1.89 sec: 1.11x faster | +| xml_etree_parse | 139 ms | 128 ms: 1.08x faster | +| xml_etree_iterparse | 96.7 ms | 90.3 ms: 1.07x faster | +| unpickle_pure_python | 221 us | 209 us: 1.05x faster | +| xml_etree_process | 59.0 ms | 56.9 ms: 1.04x faster | +| xml_etree_generate | 85.2 ms | 82.5 ms: 1.03x faster | +| json_loads | 26.5 us | 25.8 us: 1.03x faster | +| pickle_pure_python | 308 us | 303 us: 1.02x faster | +| json_dumps | 10.4 ms | 11.4 ms: 1.10x slower | +| Geometric mean | (ref) | 1.04x faster | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 7.16 ms | 7.48 ms: 1.04x slower | +| python_startup | 9.93 ms | 14.6 ms: 1.47x slower | +| Geometric mean | (ref) | 1.24x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_text | 22.8 ms | 21.0 ms: 1.09x faster | +| genshi_xml | 50.2 ms | 48.7 ms: 1.03x faster | +| mako | 11.0 ms | 11.6 ms: 1.05x slower | +| Geometric mean | (ref) | 1.02x faster | + +Benchmark hidden because not significant (1): django_template + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_memoization_tg | 560 ms | 300 ms: 1.86x faster | +| async_tree_io_tg | 1.11 sec | 602 ms: 1.84x faster | +| async_tree_io | 1.08 sec | 603 ms: 1.80x faster | +| async_tree_none_tg | 446 ms | 252 ms: 1.77x faster | +| async_tree_none | 464 ms | 268 ms: 1.73x faster | +| async_tree_memoization | 555 ms | 324 ms: 1.71x faster | +| async_tree_cpu_io_mixed_tg | 723 ms | 470 ms: 1.54x faster | +| async_tree_cpu_io_mixed | 715 ms | 490 ms: 1.46x faster | +| deepcopy | 352 us | 251 us: 1.40x faster | +| deepcopy_memo | 40.3 us | 29.7 us: 1.36x faster | +| go | 139 ms | 113 ms: 1.23x faster | +| pathlib | 21.5 ms | 17.8 ms: 1.21x faster | +| deepcopy_reduce | 3.08 us | 2.54 us: 1.21x faster | +| comprehensions | 19.8 us | 16.8 us: 1.18x faster | +| crypto_pyaes | 76.6 ms | 64.9 ms: 1.18x faster | +| generators | 32.2 ms | 27.4 ms: 1.18x faster | +| raytrace | 299 ms | 256 ms: 1.17x faster | +| pylint | 319 ms | 279 ms: 1.14x faster | +| regex_compile | 142 ms | 125 ms: 1.14x faster | +| coroutines | 23.9 ms | 21.0 ms: 1.14x faster | +| sqlalchemy_imperative | 21.8 ms | 19.2 ms: 1.14x faster | +| scimark_sor | 130 ms | 114 ms: 1.13x faster | +| float | 80.8 ms | 71.8 ms: 1.13x faster | +| sqlalchemy_declarative | 143 ms | 127 ms: 1.12x faster | +| regex_effbot | 3.17 ms | 2.82 ms: 1.12x faster | +| bpe_tokeniser | 4.74 sec | 4.23 sec: 1.12x faster | +| tomli_loads | 2.11 sec | 1.89 sec: 1.11x faster | +| scimark_monte_carlo | 68.4 ms | 61.7 ms: 1.11x faster | +| deltablue | 3.45 ms | 3.12 ms: 1.10x faster | +| richards | 45.9 ms | 41.7 ms: 1.10x faster | +| sympy_sum | 166 ms | 151 ms: 1.10x faster | +| chaos | 62.8 ms | 57.3 ms: 1.10x faster | +| scimark_fft | 342 ms | 312 ms: 1.09x faster | +| sqlglot_parse | 1.36 ms | 1.24 ms: 1.09x faster | +| thrift | 791 us | 725 us: 1.09x faster | +| pprint_pformat | 1.52 sec | 1.39 sec: 1.09x faster | +| pprint_safe_repr | 743 ms | 682 ms: 1.09x faster | +| genshi_text | 22.8 ms | 21.0 ms: 1.09x faster | +| richards_super | 51.9 ms | 47.8 ms: 1.09x faster | +| logging_simple | 6.63 us | 6.11 us: 1.09x faster | +| pyflate | 448 ms | 413 ms: 1.09x faster | +| hexiom | 6.17 ms | 5.69 ms: 1.08x faster | +| sqlglot_transpile | 1.67 ms | 1.54 ms: 1.08x faster | +| xml_etree_parse | 139 ms | 128 ms: 1.08x faster | +| spectral_norm | 110 ms | 102 ms: 1.08x faster | +| sympy_str | 292 ms | 270 ms: 1.08x faster | +| async_generators | 384 ms | 358 ms: 1.07x faster | +| logging_format | 7.35 us | 6.85 us: 1.07x faster | +| xml_etree_iterparse | 96.7 ms | 90.3 ms: 1.07x faster | +| json | 5.02 ms | 4.73 ms: 1.06x faster | +| pycparser | 1.17 sec | 1.11 sec: 1.06x faster | +| unpickle_pure_python | 221 us | 209 us: 1.05x faster | +| typing_runtime_protocols | 163 us | 155 us: 1.05x faster | +| mdp | 2.42 sec | 2.30 sec: 1.05x faster | +| dulwich_log | 78.9 ms | 75.0 ms: 1.05x faster | +| meteor_contest | 104 ms | 98.5 ms: 1.05x faster | +| logging_silent | 109 ns | 104 ns: 1.05x faster | +| sympy_integrate | 20.5 ms | 19.6 ms: 1.05x faster | +| 2to3 | 264 ms | 252 ms: 1.05x faster | +| docutils | 2.64 sec | 2.53 sec: 1.04x faster | +| sqlglot_normalize | 107 ms | 102 ms: 1.04x faster | +| scimark_lu | 114 ms | 110 ms: 1.04x faster | +| xml_etree_process | 59.0 ms | 56.9 ms: 1.04x faster | +| xml_etree_generate | 85.2 ms | 82.5 ms: 1.03x faster | +| nqueens | 80.1 ms | 77.7 ms: 1.03x faster | +| genshi_xml | 50.2 ms | 48.7 ms: 1.03x faster | +| sympy_expand | 468 ms | 454 ms: 1.03x faster | +| sqlglot_optimize | 53.3 ms | 51.8 ms: 1.03x faster | +| json_loads | 26.5 us | 25.8 us: 1.03x faster | +| fannkuch | 372 ms | 364 ms: 1.02x faster | +| pickle_pure_python | 308 us | 303 us: 1.02x faster | +| pidigits | 184 ms | 184 ms: 1.00x slower | +| scimark_sparse_mat_mult | 4.39 ms | 4.42 ms: 1.01x slower | +| asyncio_websockets | 517 ms | 523 ms: 1.01x slower | +| python_startup_no_site | 7.16 ms | 7.48 ms: 1.04x slower | +| mako | 11.0 ms | 11.6 ms: 1.05x slower | +| regex_dna | 168 ms | 182 ms: 1.08x slower | +| bench_thread_pool | 941 us | 1.03 ms: 1.09x slower | +| json_dumps | 10.4 ms | 11.4 ms: 1.10x slower | +| telco | 6.53 ms | 7.20 ms: 1.10x slower | +| coverage | 71.4 ms | 79.1 ms: 1.11x slower | +| regex_v8 | 20.6 ms | 24.4 ms: 1.19x slower | +| gc_traversal | 3.46 ms | 4.39 ms: 1.27x slower | +| python_startup | 9.93 ms | 14.6 ms: 1.47x slower | +| create_gc_cycles | 1.09 ms | 1.85 ms: 1.70x slower | +| bench_mp_pool | 10.8 ms | 88.8 ms: 8.22x slower | +| Geometric mean | (ref) | 1.07x faster | + +Benchmark hidden because not significant (3): django_template, sqlite_synth, nbody +Ignored benchmarks (16) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, html5lib, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (6) of results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers + +- Geometric mean (including insignificant results): 1.100x faster + +# HPT report + +- Reliability score: 100.00% likely to be faster +- 90% likely to have a speedup of 1.07x +- 95% likely to have a speedup of 1.06x +- 99% likely to have a speedup of 1.05x + +# Memory +- memory change: 1.11x \ No newline at end of file diff --git a/results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50-vs-3.12.6.svg b/results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50-vs-3.12.6.svg new file mode 100644 index 0000000..5654738 --- /dev/null +++ b/results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50-vs-3.12.6.svg @@ -0,0 +1,3067 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50-vs-3.13.0rc2.md b/results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50-vs-3.13.0rc2.md new file mode 100644 index 0000000..17ae2d4 --- /dev/null +++ b/results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50-vs-3.13.0rc2.md @@ -0,0 +1,199 @@ +# Results vs. 3.13.0rc2 + +- fork: python +- ref: 1b39b502d33c68f52fd7 +- machine: linux-x86_64 +- commit hash: 1b39b50 +- commit date: 2025-01-10 +- overall geometric mean: 1.061x faster +- HPT reliability: 100.00% +- HPT 99th percentile: 1.02x faster +- Memory change: 1.10x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 260 ms | 252 ms: 1.03x faster | +| docutils | 2.62 sec | 2.53 sec: 1.04x faster | +| Geometric mean | (ref) | 1.03x faster | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 913 ms | 602 ms: 1.52x faster | +| async_tree_io | 876 ms | 603 ms: 1.45x faster | +| async_tree_memoization | 461 ms | 324 ms: 1.42x faster | +| async_tree_memoization_tg | 414 ms | 300 ms: 1.38x faster | +| async_tree_cpu_io_mixed | 666 ms | 490 ms: 1.36x faster | +| async_tree_cpu_io_mixed_tg | 638 ms | 470 ms: 1.36x faster | +| async_tree_none_tg | 336 ms | 252 ms: 1.33x faster | +| async_tree_none | 354 ms | 268 ms: 1.32x faster | +| coroutines | 23.6 ms | 21.0 ms: 1.12x faster | +| async_generators | 377 ms | 358 ms: 1.05x faster | +| asyncio_websockets | 520 ms | 523 ms: 1.00x slower | +| Geometric mean | (ref) | 1.29x faster | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 217 ms | 184 ms: 1.17x faster | +| float | 77.5 ms | 71.8 ms: 1.08x faster | +| nbody | 85.1 ms | 89.9 ms: 1.06x slower | +| Geometric mean | (ref) | 1.06x faster | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 3.08 ms | 2.82 ms: 1.09x faster | +| regex_compile | 132 ms | 125 ms: 1.06x faster | +| regex_dna | 180 ms | 182 ms: 1.01x slower | +| regex_v8 | 22.7 ms | 24.4 ms: 1.08x slower | +| Geometric mean | (ref) | 1.02x faster | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | +|----------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_parse | 136 ms | 128 ms: 1.06x faster | +| tomli_loads | 2.01 sec | 1.89 sec: 1.06x faster | +| xml_etree_iterparse | 94.9 ms | 90.3 ms: 1.05x faster | +| json_loads | 27.0 us | 25.8 us: 1.05x faster | +| xml_etree_process | 59.3 ms | 56.9 ms: 1.04x faster | +| xml_etree_generate | 85.4 ms | 82.5 ms: 1.04x faster | +| unpickle_pure_python | 210 us | 209 us: 1.00x faster | +| pickle_pure_python | 294 us | 303 us: 1.03x slower | +| json_dumps | 10.5 ms | 11.4 ms: 1.08x slower | +| Geometric mean | (ref) | 1.02x faster | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | +|------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 7.39 ms | 7.48 ms: 1.01x slower | +| python_startup | 11.0 ms | 14.6 ms: 1.33x slower | +| Geometric mean | (ref) | 1.16x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | +|-----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_text | 21.5 ms | 21.0 ms: 1.03x faster | +| django_template | 34.1 ms | 34.6 ms: 1.01x slower | +| mako | 11.3 ms | 11.6 ms: 1.02x slower | +| Geometric mean | (ref) | 1.00x slower | + +Benchmark hidden because not significant (1): genshi_xml + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 913 ms | 602 ms: 1.52x faster | +| async_tree_io | 876 ms | 603 ms: 1.45x faster | +| async_tree_memoization | 461 ms | 324 ms: 1.42x faster | +| deepcopy | 355 us | 251 us: 1.42x faster | +| async_tree_memoization_tg | 414 ms | 300 ms: 1.38x faster | +| async_tree_cpu_io_mixed | 666 ms | 490 ms: 1.36x faster | +| async_tree_cpu_io_mixed_tg | 638 ms | 470 ms: 1.36x faster | +| async_tree_none_tg | 336 ms | 252 ms: 1.33x faster | +| async_tree_none | 354 ms | 268 ms: 1.32x faster | +| deepcopy_memo | 39.1 us | 29.7 us: 1.32x faster | +| go | 141 ms | 113 ms: 1.24x faster | +| deepcopy_reduce | 3.11 us | 2.54 us: 1.22x faster | +| scimark_sor | 134 ms | 114 ms: 1.18x faster | +| pidigits | 217 ms | 184 ms: 1.17x faster | +| pylint | 317 ms | 279 ms: 1.14x faster | +| coroutines | 23.6 ms | 21.0 ms: 1.12x faster | +| scimark_fft | 349 ms | 312 ms: 1.12x faster | +| regex_effbot | 3.08 ms | 2.82 ms: 1.09x faster | +| spectral_norm | 111 ms | 102 ms: 1.09x faster | +| telco | 7.82 ms | 7.20 ms: 1.09x faster | +| pyflate | 449 ms | 413 ms: 1.09x faster | +| richards | 45.2 ms | 41.7 ms: 1.08x faster | +| richards_super | 51.6 ms | 47.8 ms: 1.08x faster | +| pprint_safe_repr | 738 ms | 682 ms: 1.08x faster | +| float | 77.5 ms | 71.8 ms: 1.08x faster | +| pathlib | 19.2 ms | 17.8 ms: 1.08x faster | +| pprint_pformat | 1.50 sec | 1.39 sec: 1.07x faster | +| thrift | 778 us | 725 us: 1.07x faster | +| scimark_sparse_mat_mult | 4.71 ms | 4.42 ms: 1.07x faster | +| xml_etree_parse | 136 ms | 128 ms: 1.06x faster | +| tomli_loads | 2.01 sec | 1.89 sec: 1.06x faster | +| scimark_monte_carlo | 65.4 ms | 61.7 ms: 1.06x faster | +| regex_compile | 132 ms | 125 ms: 1.06x faster | +| async_generators | 377 ms | 358 ms: 1.05x faster | +| hexiom | 5.99 ms | 5.69 ms: 1.05x faster | +| xml_etree_iterparse | 94.9 ms | 90.3 ms: 1.05x faster | +| bpe_tokeniser | 4.45 sec | 4.23 sec: 1.05x faster | +| generators | 28.8 ms | 27.4 ms: 1.05x faster | +| coverage | 83.0 ms | 79.1 ms: 1.05x faster | +| json_loads | 27.0 us | 25.8 us: 1.05x faster | +| crypto_pyaes | 67.9 ms | 64.9 ms: 1.05x faster | +| xml_etree_process | 59.3 ms | 56.9 ms: 1.04x faster | +| json | 4.93 ms | 4.73 ms: 1.04x faster | +| docutils | 2.62 sec | 2.53 sec: 1.04x faster | +| xml_etree_generate | 85.4 ms | 82.5 ms: 1.04x faster | +| sqlglot_normalize | 106 ms | 102 ms: 1.03x faster | +| meteor_contest | 102 ms | 98.5 ms: 1.03x faster | +| 2to3 | 260 ms | 252 ms: 1.03x faster | +| sympy_sum | 156 ms | 151 ms: 1.03x faster | +| genshi_text | 21.5 ms | 21.0 ms: 1.03x faster | +| mdp | 2.36 sec | 2.30 sec: 1.02x faster | +| scimark_lu | 113 ms | 110 ms: 1.02x faster | +| sqlglot_optimize | 52.7 ms | 51.8 ms: 1.02x faster | +| sympy_str | 275 ms | 270 ms: 1.02x faster | +| fannkuch | 370 ms | 364 ms: 1.02x faster | +| sympy_integrate | 19.8 ms | 19.6 ms: 1.01x faster | +| nqueens | 78.6 ms | 77.7 ms: 1.01x faster | +| sqlglot_transpile | 1.56 ms | 1.54 ms: 1.01x faster | +| pycparser | 1.12 sec | 1.11 sec: 1.01x faster | +| logging_simple | 6.16 us | 6.11 us: 1.01x faster | +| sqlglot_parse | 1.25 ms | 1.24 ms: 1.01x faster | +| sympy_expand | 457 ms | 454 ms: 1.01x faster | +| unpickle_pure_python | 210 us | 209 us: 1.00x faster | +| asyncio_websockets | 520 ms | 523 ms: 1.00x slower | +| regex_dna | 180 ms | 182 ms: 1.01x slower | +| python_startup_no_site | 7.39 ms | 7.48 ms: 1.01x slower | +| logging_silent | 103 ns | 104 ns: 1.01x slower | +| raytrace | 253 ms | 256 ms: 1.01x slower | +| django_template | 34.1 ms | 34.6 ms: 1.01x slower | +| comprehensions | 16.5 us | 16.8 us: 1.02x slower | +| mako | 11.3 ms | 11.6 ms: 1.02x slower | +| pickle_pure_python | 294 us | 303 us: 1.03x slower | +| nbody | 85.1 ms | 89.9 ms: 1.06x slower | +| regex_v8 | 22.7 ms | 24.4 ms: 1.08x slower | +| json_dumps | 10.5 ms | 11.4 ms: 1.08x slower | +| bench_thread_pool | 919 us | 1.03 ms: 1.12x slower | +| python_startup | 11.0 ms | 14.6 ms: 1.33x slower | +| create_gc_cycles | 1.34 ms | 1.85 ms: 1.39x slower | +| gc_traversal | 3.14 ms | 4.39 ms: 1.40x slower | +| bench_mp_pool | 11.0 ms | 88.8 ms: 8.08x slower | +| Geometric mean | (ref) | 1.03x faster | + +Benchmark hidden because not significant (7): sqlite_synth, genshi_xml, chaos, deltablue, logging_format, typing_runtime_protocols, dulwich_log +Ignored benchmarks (15) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, html5lib, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (8) of results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers + +- Geometric mean (including insignificant results): 1.061x faster + +# HPT report + +- Reliability score: 100.00% likely to be faster +- 90% likely to have a speedup of 1.03x +- 95% likely to have a speedup of 1.03x +- 99% likely to have a speedup of 1.02x + +# Memory +- memory change: 1.10x \ No newline at end of file diff --git a/results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50-vs-3.13.0rc2.svg b/results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50-vs-3.13.0rc2.svg new file mode 100644 index 0000000..9fbd9a1 --- /dev/null +++ b/results/bm-20250110-3.14.0a3+-1b39b50/bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50-vs-3.13.0rc2.svg @@ -0,0 +1,2985 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250110-3.14.0a3+-7ab3ec6-NOGIL/README.md b/results/bm-20250110-3.14.0a3+-7ab3ec6-NOGIL/README.md index 60dfaf0..64c6bec 100644 --- a/results/bm-20250110-3.14.0a3+-7ab3ec6-NOGIL/README.md +++ b/results/bm-20250110-3.14.0a3+-7ab3ec6-NOGIL/README.md @@ -41,3 +41,11 @@ - [📄table](bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-base.md) - [📈time plot](bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-base.svg) +### vs. default_base_vs_NOGIL + +- Geometric mean: 1.142x slower (HPT: reliability of 100.00%, 1.12x slower at 99th %ile) +- Memory usage: 1.20x +- new benchmarks: html5lib +- [📄table](bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-default_base_vs_NOGIL.md) +- [📈time plot](bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-default_base_vs_NOGIL.svg) + diff --git a/results/bm-20250110-3.14.0a3+-7ab3ec6-NOGIL/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-default_base_vs_NOGIL.md b/results/bm-20250110-3.14.0a3+-7ab3ec6-NOGIL/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-default_base_vs_NOGIL.md new file mode 100644 index 0000000..6f1f594 --- /dev/null +++ b/results/bm-20250110-3.14.0a3+-7ab3ec6-NOGIL/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-default_base_vs_NOGIL.md @@ -0,0 +1,213 @@ +# Results vs. default_base_vs_NOGIL + +- fork: mpage +- ref: gh_115999_load_attr_ +- machine: linux-x86_64 +- commit hash: 7ab3ec6 +- commit date: 2025-01-10 +- overall geometric mean: 1.142x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.12x slower +- Memory change: 1.20x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| 2to3 | 252 ms | 310 ms: 1.23x slower | +| docutils | 2.53 sec | 2.83 sec: 1.12x slower | +| sphinx | 977 ms | 1.13 sec: 1.15x slower | +| Geometric mean | (ref) | 1.17x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| async_tree_none_tg | 252 ms | 240 ms: 1.05x faster | +| async_tree_io_tg | 602 ms | 589 ms: 1.02x faster | +| asyncio_websockets | 523 ms | 516 ms: 1.01x faster | +| async_tree_cpu_io_mixed_tg | 470 ms | 481 ms: 1.02x slower | +| async_tree_memoization_tg | 300 ms | 308 ms: 1.03x slower | +| async_tree_none | 268 ms | 286 ms: 1.07x slower | +| async_tree_cpu_io_mixed | 490 ms | 523 ms: 1.07x slower | +| async_tree_memoization | 324 ms | 350 ms: 1.08x slower | +| coroutines | 21.0 ms | 24.1 ms: 1.14x slower | +| async_generators | 358 ms | 426 ms: 1.19x slower | +| Geometric mean | (ref) | 1.04x slower | + +Benchmark hidden because not significant (1): async_tree_io + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| pidigits | 184 ms | 194 ms: 1.05x slower | +| float | 71.8 ms | 75.6 ms: 1.05x slower | +| nbody | 89.9 ms | 130 ms: 1.45x slower | +| Geometric mean | (ref) | 1.17x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| regex_dna | 182 ms | 175 ms: 1.04x faster | +| regex_v8 | 24.4 ms | 23.7 ms: 1.03x faster | +| regex_effbot | 2.82 ms | 2.93 ms: 1.04x slower | +| regex_compile | 125 ms | 149 ms: 1.19x slower | +| Geometric mean | (ref) | 1.04x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| xml_etree_iterparse | 90.3 ms | 87.1 ms: 1.04x faster | +| xml_etree_parse | 128 ms | 129 ms: 1.01x slower | +| json_loads | 25.8 us | 28.3 us: 1.10x slower | +| json_dumps | 11.4 ms | 12.8 ms: 1.13x slower | +| unpickle_pure_python | 209 us | 241 us: 1.15x slower | +| xml_etree_generate | 82.5 ms | 95.7 ms: 1.16x slower | +| xml_etree_process | 56.9 ms | 68.1 ms: 1.20x slower | +| pickle_pure_python | 303 us | 364 us: 1.20x slower | +| tomli_loads | 1.89 sec | 2.32 sec: 1.23x slower | +| Geometric mean | (ref) | 1.12x slower | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|------------------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| python_startup | 14.6 ms | 15.5 ms: 1.06x slower | +| python_startup_no_site | 7.48 ms | 9.73 ms: 1.30x slower | +| Geometric mean | (ref) | 1.18x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|-----------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| genshi_xml | 48.7 ms | 59.4 ms: 1.22x slower | +| django_template | 34.6 ms | 43.0 ms: 1.24x slower | +| mako | 11.6 ms | 15.7 ms: 1.35x slower | +| genshi_text | 21.0 ms | 28.4 ms: 1.35x slower | +| Geometric mean | (ref) | 1.29x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| gc_traversal | 4.39 ms | 3.22 ms: 1.36x faster | +| sqlite_synth | 2.20 us | 2.05 us: 1.07x faster | +| async_tree_none_tg | 252 ms | 240 ms: 1.05x faster | +| xml_etree_iterparse | 90.3 ms | 87.1 ms: 1.04x faster | +| regex_dna | 182 ms | 175 ms: 1.04x faster | +| regex_v8 | 24.4 ms | 23.7 ms: 1.03x faster | +| async_tree_io_tg | 602 ms | 589 ms: 1.02x faster | +| asyncio_websockets | 523 ms | 516 ms: 1.01x faster | +| create_gc_cycles | 1.85 ms | 1.84 ms: 1.01x faster | +| xml_etree_parse | 128 ms | 129 ms: 1.01x slower | +| async_tree_cpu_io_mixed_tg | 470 ms | 481 ms: 1.02x slower | +| async_tree_memoization_tg | 300 ms | 308 ms: 1.03x slower | +| regex_effbot | 2.82 ms | 2.93 ms: 1.04x slower | +| json | 4.73 ms | 4.96 ms: 1.05x slower | +| pidigits | 184 ms | 194 ms: 1.05x slower | +| float | 71.8 ms | 75.6 ms: 1.05x slower | +| python_startup | 14.6 ms | 15.5 ms: 1.06x slower | +| async_tree_none | 268 ms | 286 ms: 1.07x slower | +| async_tree_cpu_io_mixed | 490 ms | 523 ms: 1.07x slower | +| pathlib | 17.8 ms | 19.1 ms: 1.07x slower | +| async_tree_memoization | 324 ms | 350 ms: 1.08x slower | +| pycparser | 1.11 sec | 1.20 sec: 1.08x slower | +| dulwich_log | 75.0 ms | 82.0 ms: 1.09x slower | +| json_loads | 25.8 us | 28.3 us: 1.10x slower | +| spectral_norm | 102 ms | 112 ms: 1.10x slower | +| bench_mp_pool | 88.8 ms | 97.8 ms: 1.10x slower | +| logging_silent | 104 ns | 116 ns: 1.12x slower | +| docutils | 2.53 sec | 2.83 sec: 1.12x slower | +| bpe_tokeniser | 4.23 sec | 4.74 sec: 1.12x slower | +| generators | 27.4 ms | 30.8 ms: 1.12x slower | +| json_dumps | 11.4 ms | 12.8 ms: 1.13x slower | +| k_core | 2.05 sec | 2.31 sec: 1.13x slower | +| many_optionals | 1.02 ms | 1.17 ms: 1.14x slower | +| coroutines | 21.0 ms | 24.1 ms: 1.14x slower | +| sphinx | 977 ms | 1.13 sec: 1.15x slower | +| unpickle_pure_python | 209 us | 241 us: 1.15x slower | +| scimark_sor | 114 ms | 133 ms: 1.16x slower | +| xml_etree_generate | 82.5 ms | 95.7 ms: 1.16x slower | +| pyflate | 413 ms | 482 ms: 1.17x slower | +| pylint | 279 ms | 326 ms: 1.17x slower | +| subparsers | 21.5 ms | 25.2 ms: 1.17x slower | +| mdp | 2.30 sec | 2.70 sec: 1.18x slower | +| sqlglot_normalize | 102 ms | 121 ms: 1.19x slower | +| regex_compile | 125 ms | 149 ms: 1.19x slower | +| async_generators | 358 ms | 426 ms: 1.19x slower | +| logging_simple | 6.11 us | 7.28 us: 1.19x slower | +| xml_etree_process | 56.9 ms | 68.1 ms: 1.20x slower | +| sqlglot_optimize | 51.8 ms | 61.9 ms: 1.20x slower | +| pprint_safe_repr | 682 ms | 819 ms: 1.20x slower | +| pickle_pure_python | 303 us | 364 us: 1.20x slower | +| go | 113 ms | 136 ms: 1.20x slower | +| sympy_expand | 454 ms | 549 ms: 1.21x slower | +| logging_format | 6.85 us | 8.31 us: 1.21x slower | +| telco | 7.20 ms | 8.73 ms: 1.21x slower | +| pprint_pformat | 1.39 sec | 1.69 sec: 1.22x slower | +| genshi_xml | 48.7 ms | 59.4 ms: 1.22x slower | +| scimark_fft | 312 ms | 381 ms: 1.22x slower | +| chaos | 57.3 ms | 70.3 ms: 1.23x slower | +| 2to3 | 252 ms | 310 ms: 1.23x slower | +| tomli_loads | 1.89 sec | 2.32 sec: 1.23x slower | +| sympy_sum | 151 ms | 186 ms: 1.23x slower | +| comprehensions | 16.8 us | 20.7 us: 1.23x slower | +| sympy_integrate | 19.6 ms | 24.2 ms: 1.24x slower | +| sympy_str | 270 ms | 335 ms: 1.24x slower | +| shortest_path | 431 ms | 535 ms: 1.24x slower | +| sqlglot_transpile | 1.54 ms | 1.92 ms: 1.24x slower | +| django_template | 34.6 ms | 43.0 ms: 1.24x slower | +| nqueens | 77.7 ms | 97.0 ms: 1.25x slower | +| scimark_sparse_mat_mult | 4.42 ms | 5.52 ms: 1.25x slower | +| connected_components | 389 ms | 486 ms: 1.25x slower | +| deepcopy | 251 us | 315 us: 1.25x slower | +| coverage | 79.1 ms | 99.2 ms: 1.25x slower | +| raytrace | 256 ms | 323 ms: 1.26x slower | +| thrift | 725 us | 917 us: 1.26x slower | +| scimark_lu | 110 ms | 139 ms: 1.27x slower | +| sqlalchemy_imperative | 19.2 ms | 24.3 ms: 1.27x slower | +| sqlglot_parse | 1.24 ms | 1.58 ms: 1.27x slower | +| sqlalchemy_declarative | 127 ms | 163 ms: 1.28x slower | +| hexiom | 5.69 ms | 7.30 ms: 1.28x slower | +| typing_runtime_protocols | 155 us | 199 us: 1.29x slower | +| python_startup_no_site | 7.48 ms | 9.73 ms: 1.30x slower | +| deepcopy_reduce | 2.54 us | 3.32 us: 1.30x slower | +| richards | 41.7 ms | 54.5 ms: 1.31x slower | +| fannkuch | 364 ms | 477 ms: 1.31x slower | +| deepcopy_memo | 29.7 us | 38.9 us: 1.31x slower | +| scimark_monte_carlo | 61.7 ms | 81.1 ms: 1.31x slower | +| meteor_contest | 98.5 ms | 131 ms: 1.33x slower | +| crypto_pyaes | 64.9 ms | 86.6 ms: 1.33x slower | +| richards_super | 47.8 ms | 64.4 ms: 1.35x slower | +| mako | 11.6 ms | 15.7 ms: 1.35x slower | +| genshi_text | 21.0 ms | 28.4 ms: 1.35x slower | +| nbody | 89.9 ms | 130 ms: 1.45x slower | +| deltablue | 3.12 ms | 4.63 ms: 1.48x slower | +| bench_thread_pool | 1.03 ms | 3.33 ms: 3.23x slower | +| Geometric mean | (ref) | 1.18x slower | + +Benchmark hidden because not significant (1): async_tree_io +Ignored benchmarks (1) of results/bm-20250110-3.14.0a3+-7ab3ec6-NOGIL/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6.json: html5lib + +- Geometric mean (including insignificant results): 1.142x slower + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.14x +- 95% likely to have a slowdown of 1.14x +- 99% likely to have a slowdown of 1.12x + +# Memory +- memory change: 1.20x \ No newline at end of file diff --git a/results/bm-20250110-3.14.0a3+-7ab3ec6-NOGIL/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-default_base_vs_NOGIL.svg b/results/bm-20250110-3.14.0a3+-7ab3ec6-NOGIL/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-default_base_vs_NOGIL.svg new file mode 100644 index 0000000..5b3c13f --- /dev/null +++ b/results/bm-20250110-3.14.0a3+-7ab3ec6-NOGIL/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-default_base_vs_NOGIL.svg @@ -0,0 +1,3237 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250110-3.14.0a3+-7ab3ec6/README.md b/results/bm-20250110-3.14.0a3+-7ab3ec6/README.md new file mode 100644 index 0000000..1b57e67 --- /dev/null +++ b/results/bm-20250110-3.14.0a3+-7ab3ec6/README.md @@ -0,0 +1,43 @@ +# Results + +- fork: mpage/gh_115999_load_attr_ +- version: 3.14.0a3+ +- config: +- commit hash: [7ab3ec6](https://github.com/mpage/cpython/commit/7ab3ec6) +- commit date: 2025-01-10T13:07:57-08:00 +- commit merge base: [1b39b502d33c68f52fd775c4e6c2174baddd40bd](https://github.com/python/cpython/commit/1b39b502d33c68f52fd775c4e6c2174baddd40bd) +- ref: gh_115999_load_attr_ + +## linux x86_64 (vultr) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/12719509421) +- cpu model: Intel(R) Xeon(R) E-2286G CPU @ 4.00GHz +- platform: Linux-6.8.0-45-generic-x86_64-with-glibc2.39 +- [raw results](bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6.json) + +### vs. 3.12.6 + +- Geometric mean: 1.101x faster (HPT: reliability of 100.00%, 1.05x faster at 99th %ile) +- Memory usage: 1.11x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, html5lib, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers +- [📄table](bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-3.12.6.md) +- [📈time plot](bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.062x faster (HPT: reliability of 100.00%, 1.02x faster at 99th %ile) +- Memory usage: 1.10x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, html5lib, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers +- [📄table](bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-3.13.0rc2.md) +- [📈time plot](bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-3.13.0rc2.svg) + +### vs. base + +- Geometric mean: 1.000x faster (HPT: reliability of 59.69%, 1.00x slower at 99th %ile) +- Memory usage: 1.00x +- [🧠memory plot](bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-base-mem.svg) +- [📄table](bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-base.md) +- [📈time plot](bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-7ab3ec6-vs-base.svg) + diff --git a/results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-3.12.6.md b/results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-3.12.6.md new file mode 100644 index 0000000..841a62c --- /dev/null +++ b/results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-3.12.6.md @@ -0,0 +1,206 @@ +# Results vs. 3.12.6 + +- fork: mpage +- ref: gh_115999_load_attr_ +- machine: linux-x86_64 +- commit hash: 7ab3ec6 +- commit date: 2025-01-10 +- overall geometric mean: 1.101x faster +- HPT reliability: 100.00% +- HPT 99th percentile: 1.05x faster +- Memory change: 1.11x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------|:------------------------------------------------------:|:---------------------------------------------------------------------:| +| 2to3 | 264 ms | 253 ms: 1.04x faster | +| docutils | 2.64 sec | 2.55 sec: 1.04x faster | +| Geometric mean | (ref) | 1.04x faster | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------------------|:------------------------------------------------------:|:---------------------------------------------------------------------:| +| async_tree_memoization_tg | 560 ms | 297 ms: 1.89x faster | +| async_tree_io_tg | 1.11 sec | 598 ms: 1.86x faster | +| async_tree_io | 1.08 sec | 601 ms: 1.80x faster | +| async_tree_none_tg | 446 ms | 250 ms: 1.79x faster | +| async_tree_none | 464 ms | 266 ms: 1.75x faster | +| async_tree_memoization | 555 ms | 320 ms: 1.74x faster | +| async_tree_cpu_io_mixed_tg | 723 ms | 469 ms: 1.54x faster | +| async_tree_cpu_io_mixed | 715 ms | 486 ms: 1.47x faster | +| coroutines | 23.9 ms | 21.1 ms: 1.13x faster | +| async_generators | 384 ms | 357 ms: 1.08x faster | +| asyncio_websockets | 517 ms | 522 ms: 1.01x slower | +| Geometric mean | (ref) | 1.51x faster | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------|:------------------------------------------------------:|:---------------------------------------------------------------------:| +| float | 80.8 ms | 71.7 ms: 1.13x faster | +| nbody | 89.3 ms | 88.2 ms: 1.01x faster | +| Geometric mean | (ref) | 1.04x faster | + +Benchmark hidden because not significant (1): pidigits + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------|:------------------------------------------------------:|:---------------------------------------------------------------------:| +| regex_compile | 142 ms | 125 ms: 1.14x faster | +| regex_effbot | 3.17 ms | 2.79 ms: 1.13x faster | +| regex_dna | 168 ms | 179 ms: 1.07x slower | +| regex_v8 | 20.6 ms | 24.3 ms: 1.18x slower | +| Geometric mean | (ref) | 1.01x faster | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------------|:------------------------------------------------------:|:---------------------------------------------------------------------:| +| tomli_loads | 2.11 sec | 1.89 sec: 1.11x faster | +| xml_etree_parse | 139 ms | 127 ms: 1.09x faster | +| xml_etree_iterparse | 96.7 ms | 90.3 ms: 1.07x faster | +| unpickle_pure_python | 221 us | 211 us: 1.04x faster | +| json_loads | 26.5 us | 25.6 us: 1.04x faster | +| xml_etree_generate | 85.2 ms | 83.1 ms: 1.03x faster | +| xml_etree_process | 59.0 ms | 57.5 ms: 1.02x faster | +| pickle_pure_python | 308 us | 305 us: 1.01x faster | +| json_dumps | 10.4 ms | 11.4 ms: 1.10x slower | +| Geometric mean | (ref) | 1.03x faster | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|------------------------|:------------------------------------------------------:|:---------------------------------------------------------------------:| +| python_startup_no_site | 7.16 ms | 7.48 ms: 1.05x slower | +| python_startup | 9.93 ms | 14.6 ms: 1.48x slower | +| Geometric mean | (ref) | 1.24x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------|:------------------------------------------------------:|:---------------------------------------------------------------------:| +| genshi_text | 22.8 ms | 21.1 ms: 1.08x faster | +| genshi_xml | 50.2 ms | 48.3 ms: 1.04x faster | +| mako | 11.0 ms | 11.4 ms: 1.03x slower | +| Geometric mean | (ref) | 1.02x faster | + +Benchmark hidden because not significant (1): django_template + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------------------|:------------------------------------------------------:|:---------------------------------------------------------------------:| +| async_tree_memoization_tg | 560 ms | 297 ms: 1.89x faster | +| async_tree_io_tg | 1.11 sec | 598 ms: 1.86x faster | +| async_tree_io | 1.08 sec | 601 ms: 1.80x faster | +| async_tree_none_tg | 446 ms | 250 ms: 1.79x faster | +| async_tree_none | 464 ms | 266 ms: 1.75x faster | +| async_tree_memoization | 555 ms | 320 ms: 1.74x faster | +| async_tree_cpu_io_mixed_tg | 723 ms | 469 ms: 1.54x faster | +| async_tree_cpu_io_mixed | 715 ms | 486 ms: 1.47x faster | +| deepcopy | 352 us | 251 us: 1.40x faster | +| deepcopy_memo | 40.3 us | 29.4 us: 1.37x faster | +| go | 139 ms | 115 ms: 1.21x faster | +| deepcopy_reduce | 3.08 us | 2.55 us: 1.21x faster | +| pathlib | 21.5 ms | 18.0 ms: 1.20x faster | +| generators | 32.2 ms | 26.9 ms: 1.20x faster | +| comprehensions | 19.8 us | 16.8 us: 1.18x faster | +| raytrace | 299 ms | 255 ms: 1.17x faster | +| crypto_pyaes | 76.6 ms | 65.9 ms: 1.16x faster | +| pylint | 319 ms | 279 ms: 1.14x faster | +| sqlalchemy_imperative | 21.8 ms | 19.1 ms: 1.14x faster | +| regex_compile | 142 ms | 125 ms: 1.14x faster | +| coroutines | 23.9 ms | 21.1 ms: 1.13x faster | +| regex_effbot | 3.17 ms | 2.79 ms: 1.13x faster | +| scimark_sor | 130 ms | 115 ms: 1.13x faster | +| float | 80.8 ms | 71.7 ms: 1.13x faster | +| sqlalchemy_declarative | 143 ms | 127 ms: 1.12x faster | +| bpe_tokeniser | 4.74 sec | 4.24 sec: 1.12x faster | +| logging_simple | 6.63 us | 5.95 us: 1.11x faster | +| tomli_loads | 2.11 sec | 1.89 sec: 1.11x faster | +| deltablue | 3.45 ms | 3.11 ms: 1.11x faster | +| scimark_monte_carlo | 68.4 ms | 62.1 ms: 1.10x faster | +| chaos | 62.8 ms | 57.4 ms: 1.10x faster | +| richards | 45.9 ms | 42.0 ms: 1.09x faster | +| sympy_sum | 166 ms | 152 ms: 1.09x faster | +| sqlglot_parse | 1.36 ms | 1.24 ms: 1.09x faster | +| scimark_fft | 342 ms | 313 ms: 1.09x faster | +| xml_etree_parse | 139 ms | 127 ms: 1.09x faster | +| spectral_norm | 110 ms | 101 ms: 1.09x faster | +| logging_format | 7.35 us | 6.77 us: 1.08x faster | +| richards_super | 51.9 ms | 47.8 ms: 1.08x faster | +| sqlglot_transpile | 1.67 ms | 1.55 ms: 1.08x faster | +| genshi_text | 22.8 ms | 21.1 ms: 1.08x faster | +| async_generators | 384 ms | 357 ms: 1.08x faster | +| pprint_pformat | 1.52 sec | 1.41 sec: 1.08x faster | +| thrift | 791 us | 735 us: 1.08x faster | +| pprint_safe_repr | 743 ms | 691 ms: 1.08x faster | +| sympy_str | 292 ms | 271 ms: 1.07x faster | +| pyflate | 448 ms | 417 ms: 1.07x faster | +| json | 5.02 ms | 4.68 ms: 1.07x faster | +| hexiom | 6.17 ms | 5.76 ms: 1.07x faster | +| xml_etree_iterparse | 96.7 ms | 90.3 ms: 1.07x faster | +| logging_silent | 109 ns | 103 ns: 1.06x faster | +| dulwich_log | 78.9 ms | 74.4 ms: 1.06x faster | +| pycparser | 1.17 sec | 1.11 sec: 1.06x faster | +| typing_runtime_protocols | 163 us | 155 us: 1.06x faster | +| meteor_contest | 104 ms | 98.6 ms: 1.05x faster | +| mdp | 2.42 sec | 2.31 sec: 1.05x faster | +| unpickle_pure_python | 221 us | 211 us: 1.04x faster | +| 2to3 | 264 ms | 253 ms: 1.04x faster | +| json_loads | 26.5 us | 25.6 us: 1.04x faster | +| genshi_xml | 50.2 ms | 48.3 ms: 1.04x faster | +| sympy_integrate | 20.5 ms | 19.8 ms: 1.04x faster | +| docutils | 2.64 sec | 2.55 sec: 1.04x faster | +| scimark_lu | 114 ms | 110 ms: 1.04x faster | +| sqlglot_normalize | 107 ms | 103 ms: 1.03x faster | +| nqueens | 80.1 ms | 77.6 ms: 1.03x faster | +| sympy_expand | 468 ms | 453 ms: 1.03x faster | +| xml_etree_generate | 85.2 ms | 83.1 ms: 1.03x faster | +| xml_etree_process | 59.0 ms | 57.5 ms: 1.02x faster | +| sqlglot_optimize | 53.3 ms | 52.1 ms: 1.02x faster | +| sqlite_synth | 2.20 us | 2.16 us: 1.02x faster | +| nbody | 89.3 ms | 88.2 ms: 1.01x faster | +| pickle_pure_python | 308 us | 305 us: 1.01x faster | +| asyncio_websockets | 517 ms | 522 ms: 1.01x slower | +| fannkuch | 372 ms | 377 ms: 1.01x slower | +| mako | 11.0 ms | 11.4 ms: 1.03x slower | +| python_startup_no_site | 7.16 ms | 7.48 ms: 1.05x slower | +| regex_dna | 168 ms | 179 ms: 1.07x slower | +| bench_thread_pool | 941 us | 1.03 ms: 1.09x slower | +| json_dumps | 10.4 ms | 11.4 ms: 1.10x slower | +| coverage | 71.4 ms | 79.4 ms: 1.11x slower | +| telco | 6.53 ms | 7.29 ms: 1.12x slower | +| regex_v8 | 20.6 ms | 24.3 ms: 1.18x slower | +| gc_traversal | 3.46 ms | 4.20 ms: 1.21x slower | +| python_startup | 9.93 ms | 14.6 ms: 1.48x slower | +| create_gc_cycles | 1.09 ms | 1.84 ms: 1.68x slower | +| bench_mp_pool | 10.8 ms | 88.8 ms: 8.22x slower | +| Geometric mean | (ref) | 1.07x faster | + +Benchmark hidden because not significant (3): scimark_sparse_mat_mult, pidigits, django_template +Ignored benchmarks (16) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, html5lib, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (6) of results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers + +- Geometric mean (including insignificant results): 1.101x faster + +# HPT report + +- Reliability score: 100.00% likely to be faster +- 90% likely to have a speedup of 1.07x +- 95% likely to have a speedup of 1.06x +- 99% likely to have a speedup of 1.05x + +# Memory +- memory change: 1.11x \ No newline at end of file diff --git a/results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-3.12.6.svg b/results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-3.12.6.svg new file mode 100644 index 0000000..8922ae2 --- /dev/null +++ b/results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-3.12.6.svg @@ -0,0 +1,3064 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-3.13.0rc2.md b/results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-3.13.0rc2.md new file mode 100644 index 0000000..b4f0f7b --- /dev/null +++ b/results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-3.13.0rc2.md @@ -0,0 +1,201 @@ +# Results vs. 3.13.0rc2 + +- fork: mpage +- ref: gh_115999_load_attr_ +- machine: linux-x86_64 +- commit hash: 7ab3ec6 +- commit date: 2025-01-10 +- overall geometric mean: 1.062x faster +- HPT reliability: 100.00% +- HPT 99th percentile: 1.02x faster +- Memory change: 1.10x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------|:------------------------------------------------------------:|:---------------------------------------------------------------------:| +| 2to3 | 260 ms | 253 ms: 1.03x faster | +| docutils | 2.62 sec | 2.55 sec: 1.03x faster | +| Geometric mean | (ref) | 1.03x faster | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------------------|:------------------------------------------------------------:|:---------------------------------------------------------------------:| +| async_tree_io_tg | 913 ms | 598 ms: 1.53x faster | +| async_tree_io | 876 ms | 601 ms: 1.46x faster | +| async_tree_memoization | 461 ms | 320 ms: 1.44x faster | +| async_tree_memoization_tg | 414 ms | 297 ms: 1.40x faster | +| async_tree_cpu_io_mixed | 666 ms | 486 ms: 1.37x faster | +| async_tree_cpu_io_mixed_tg | 638 ms | 469 ms: 1.36x faster | +| async_tree_none_tg | 336 ms | 250 ms: 1.35x faster | +| async_tree_none | 354 ms | 266 ms: 1.33x faster | +| coroutines | 23.6 ms | 21.1 ms: 1.12x faster | +| async_generators | 377 ms | 357 ms: 1.06x faster | +| asyncio_websockets | 520 ms | 522 ms: 1.00x slower | +| Geometric mean | (ref) | 1.30x faster | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------|:------------------------------------------------------------:|:---------------------------------------------------------------------:| +| pidigits | 217 ms | 184 ms: 1.18x faster | +| float | 77.5 ms | 71.7 ms: 1.08x faster | +| nbody | 85.1 ms | 88.2 ms: 1.04x slower | +| Geometric mean | (ref) | 1.07x faster | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------|:------------------------------------------------------------:|:---------------------------------------------------------------------:| +| regex_effbot | 3.08 ms | 2.79 ms: 1.10x faster | +| regex_compile | 132 ms | 125 ms: 1.05x faster | +| regex_dna | 180 ms | 179 ms: 1.01x faster | +| regex_v8 | 22.7 ms | 24.3 ms: 1.07x slower | +| Geometric mean | (ref) | 1.02x faster | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------------|:------------------------------------------------------------:|:---------------------------------------------------------------------:| +| xml_etree_parse | 136 ms | 127 ms: 1.07x faster | +| tomli_loads | 2.01 sec | 1.89 sec: 1.06x faster | +| json_loads | 27.0 us | 25.6 us: 1.06x faster | +| xml_etree_iterparse | 94.9 ms | 90.3 ms: 1.05x faster | +| xml_etree_process | 59.3 ms | 57.5 ms: 1.03x faster | +| xml_etree_generate | 85.4 ms | 83.1 ms: 1.03x faster | +| unpickle_pure_python | 210 us | 211 us: 1.01x slower | +| pickle_pure_python | 294 us | 305 us: 1.04x slower | +| json_dumps | 10.5 ms | 11.4 ms: 1.08x slower | +| Geometric mean | (ref) | 1.02x faster | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|------------------------|:------------------------------------------------------------:|:---------------------------------------------------------------------:| +| python_startup_no_site | 7.39 ms | 7.48 ms: 1.01x slower | +| python_startup | 11.0 ms | 14.6 ms: 1.33x slower | +| Geometric mean | (ref) | 1.16x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|-----------------|:------------------------------------------------------------:|:---------------------------------------------------------------------:| +| genshi_text | 21.5 ms | 21.1 ms: 1.02x faster | +| genshi_xml | 48.8 ms | 48.3 ms: 1.01x faster | +| django_template | 34.1 ms | 34.8 ms: 1.02x slower | +| Geometric mean | (ref) | 1.00x faster | + +Benchmark hidden because not significant (1): mako + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------------------|:------------------------------------------------------------:|:---------------------------------------------------------------------:| +| async_tree_io_tg | 913 ms | 598 ms: 1.53x faster | +| async_tree_io | 876 ms | 601 ms: 1.46x faster | +| async_tree_memoization | 461 ms | 320 ms: 1.44x faster | +| deepcopy | 355 us | 251 us: 1.41x faster | +| async_tree_memoization_tg | 414 ms | 297 ms: 1.40x faster | +| async_tree_cpu_io_mixed | 666 ms | 486 ms: 1.37x faster | +| async_tree_cpu_io_mixed_tg | 638 ms | 469 ms: 1.36x faster | +| async_tree_none_tg | 336 ms | 250 ms: 1.35x faster | +| async_tree_none | 354 ms | 266 ms: 1.33x faster | +| deepcopy_memo | 39.1 us | 29.4 us: 1.33x faster | +| go | 141 ms | 115 ms: 1.22x faster | +| deepcopy_reduce | 3.11 us | 2.55 us: 1.22x faster | +| pidigits | 217 ms | 184 ms: 1.18x faster | +| scimark_sor | 134 ms | 115 ms: 1.17x faster | +| pylint | 317 ms | 279 ms: 1.14x faster | +| scimark_fft | 349 ms | 313 ms: 1.12x faster | +| coroutines | 23.6 ms | 21.1 ms: 1.12x faster | +| regex_effbot | 3.08 ms | 2.79 ms: 1.10x faster | +| spectral_norm | 111 ms | 101 ms: 1.10x faster | +| float | 77.5 ms | 71.7 ms: 1.08x faster | +| richards_super | 51.6 ms | 47.8 ms: 1.08x faster | +| scimark_sparse_mat_mult | 4.71 ms | 4.37 ms: 1.08x faster | +| richards | 45.2 ms | 42.0 ms: 1.08x faster | +| pyflate | 449 ms | 417 ms: 1.08x faster | +| telco | 7.82 ms | 7.29 ms: 1.07x faster | +| xml_etree_parse | 136 ms | 127 ms: 1.07x faster | +| generators | 28.8 ms | 26.9 ms: 1.07x faster | +| pathlib | 19.2 ms | 18.0 ms: 1.07x faster | +| pprint_safe_repr | 738 ms | 691 ms: 1.07x faster | +| tomli_loads | 2.01 sec | 1.89 sec: 1.06x faster | +| pprint_pformat | 1.50 sec | 1.41 sec: 1.06x faster | +| thrift | 778 us | 735 us: 1.06x faster | +| async_generators | 377 ms | 357 ms: 1.06x faster | +| json_loads | 27.0 us | 25.6 us: 1.06x faster | +| regex_compile | 132 ms | 125 ms: 1.05x faster | +| scimark_monte_carlo | 65.4 ms | 62.1 ms: 1.05x faster | +| json | 4.93 ms | 4.68 ms: 1.05x faster | +| xml_etree_iterparse | 94.9 ms | 90.3 ms: 1.05x faster | +| bpe_tokeniser | 4.45 sec | 4.24 sec: 1.05x faster | +| coverage | 83.0 ms | 79.4 ms: 1.05x faster | +| hexiom | 5.99 ms | 5.76 ms: 1.04x faster | +| logging_simple | 6.16 us | 5.95 us: 1.04x faster | +| xml_etree_process | 59.3 ms | 57.5 ms: 1.03x faster | +| meteor_contest | 102 ms | 98.6 ms: 1.03x faster | +| crypto_pyaes | 67.9 ms | 65.9 ms: 1.03x faster | +| docutils | 2.62 sec | 2.55 sec: 1.03x faster | +| xml_etree_generate | 85.4 ms | 83.1 ms: 1.03x faster | +| 2to3 | 260 ms | 253 ms: 1.03x faster | +| sqlglot_normalize | 106 ms | 103 ms: 1.02x faster | +| sympy_sum | 156 ms | 152 ms: 1.02x faster | +| scimark_lu | 113 ms | 110 ms: 1.02x faster | +| sqlite_synth | 2.21 us | 2.16 us: 1.02x faster | +| genshi_text | 21.5 ms | 21.1 ms: 1.02x faster | +| mdp | 2.36 sec | 2.31 sec: 1.02x faster | +| nqueens | 78.6 ms | 77.6 ms: 1.01x faster | +| sqlglot_optimize | 52.7 ms | 52.1 ms: 1.01x faster | +| sympy_str | 275 ms | 271 ms: 1.01x faster | +| pycparser | 1.12 sec | 1.11 sec: 1.01x faster | +| logging_format | 6.84 us | 6.77 us: 1.01x faster | +| sqlglot_transpile | 1.56 ms | 1.55 ms: 1.01x faster | +| genshi_xml | 48.8 ms | 48.3 ms: 1.01x faster | +| sympy_expand | 457 ms | 453 ms: 1.01x faster | +| regex_dna | 180 ms | 179 ms: 1.01x faster | +| sqlglot_parse | 1.25 ms | 1.24 ms: 1.01x faster | +| deltablue | 3.12 ms | 3.11 ms: 1.01x faster | +| dulwich_log | 74.8 ms | 74.4 ms: 1.01x faster | +| asyncio_websockets | 520 ms | 522 ms: 1.00x slower | +| unpickle_pure_python | 210 us | 211 us: 1.01x slower | +| raytrace | 253 ms | 255 ms: 1.01x slower | +| python_startup_no_site | 7.39 ms | 7.48 ms: 1.01x slower | +| django_template | 34.1 ms | 34.8 ms: 1.02x slower | +| fannkuch | 370 ms | 377 ms: 1.02x slower | +| comprehensions | 16.5 us | 16.8 us: 1.02x slower | +| pickle_pure_python | 294 us | 305 us: 1.04x slower | +| nbody | 85.1 ms | 88.2 ms: 1.04x slower | +| regex_v8 | 22.7 ms | 24.3 ms: 1.07x slower | +| json_dumps | 10.5 ms | 11.4 ms: 1.08x slower | +| bench_thread_pool | 919 us | 1.03 ms: 1.12x slower | +| python_startup | 11.0 ms | 14.6 ms: 1.33x slower | +| gc_traversal | 3.14 ms | 4.20 ms: 1.34x slower | +| create_gc_cycles | 1.34 ms | 1.84 ms: 1.37x slower | +| bench_mp_pool | 11.0 ms | 88.8 ms: 8.07x slower | +| Geometric mean | (ref) | 1.03x faster | + +Benchmark hidden because not significant (5): typing_runtime_protocols, sympy_integrate, mako, logging_silent, chaos +Ignored benchmarks (15) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, html5lib, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (8) of results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers + +- Geometric mean (including insignificant results): 1.062x faster + +# HPT report + +- Reliability score: 100.00% likely to be faster +- 90% likely to have a speedup of 1.03x +- 95% likely to have a speedup of 1.02x +- 99% likely to have a speedup of 1.02x + +# Memory +- memory change: 1.10x \ No newline at end of file diff --git a/results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-3.13.0rc2.svg b/results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-3.13.0rc2.svg new file mode 100644 index 0000000..aa95e4e --- /dev/null +++ b/results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-3.13.0rc2.svg @@ -0,0 +1,2963 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-base-mem.svg b/results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-base-mem.svg new file mode 100644 index 0000000..5d96ab5 --- /dev/null +++ b/results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-base-mem.svg @@ -0,0 +1,3733 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-base.md b/results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-base.md new file mode 100644 index 0000000..e74cc3c --- /dev/null +++ b/results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-base.md @@ -0,0 +1,168 @@ +# Results vs. base + +- fork: mpage +- ref: gh_115999_load_attr_ +- machine: linux-x86_64 +- commit hash: 7ab3ec6 +- commit date: 2025-01-10 +- overall geometric mean: 1.000x faster +- HPT reliability: 59.69% +- HPT 99th percentile: 1.00x slower +- Memory change: 1.00x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| 2to3 | 252 ms | 253 ms: 1.00x slower | +| docutils | 2.53 sec | 2.55 sec: 1.01x slower | +| Geometric mean | (ref) | 1.01x slower | + +Benchmark hidden because not significant (1): sphinx + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|---------------------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| async_tree_memoization | 324 ms | 320 ms: 1.01x faster | +| async_tree_memoization_tg | 300 ms | 297 ms: 1.01x faster | +| async_tree_none_tg | 252 ms | 250 ms: 1.01x faster | +| coroutines | 21.0 ms | 21.1 ms: 1.00x slower | +| Geometric mean | (ref) | 1.01x faster | + +Benchmark hidden because not significant (7): async_tree_cpu_io_mixed, async_tree_none, async_tree_io_tg, async_generators, async_tree_io, async_tree_cpu_io_mixed_tg, asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| nbody | 89.9 ms | 88.2 ms: 1.02x faster | +| Geometric mean | (ref) | 1.01x faster | + +Benchmark hidden because not significant (2): pidigits, float + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| regex_dna | 182 ms | 179 ms: 1.01x faster | +| regex_effbot | 2.82 ms | 2.79 ms: 1.01x faster | +| regex_v8 | 24.4 ms | 24.3 ms: 1.00x faster | +| Geometric mean | (ref) | 1.01x faster | + +Benchmark hidden because not significant (1): regex_compile + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| json_loads | 25.8 us | 25.6 us: 1.01x faster | +| xml_etree_parse | 128 ms | 127 ms: 1.01x faster | +| pickle_pure_python | 303 us | 305 us: 1.01x slower | +| xml_etree_generate | 82.5 ms | 83.1 ms: 1.01x slower | +| unpickle_pure_python | 209 us | 211 us: 1.01x slower | +| xml_etree_process | 56.9 ms | 57.5 ms: 1.01x slower | +| Geometric mean | (ref) | 1.00x slower | + +Benchmark hidden because not significant (3): tomli_loads, xml_etree_iterparse, json_dumps + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|------------------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| python_startup_no_site | 7.48 ms | 7.48 ms: 1.00x slower | +| Geometric mean | (ref) | 1.00x slower | + +Benchmark hidden because not significant (1): python_startup + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|----------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| mako | 11.6 ms | 11.4 ms: 1.02x faster | +| genshi_xml | 48.7 ms | 48.3 ms: 1.01x faster | +| genshi_text | 21.0 ms | 21.1 ms: 1.01x slower | +| Geometric mean | (ref) | 1.00x faster | + +Benchmark hidden because not significant (1): django_template + +All benchmarks: +=============== + +| Benchmark | bm-20250110-vultr-x86_64-python-1b39b502d33c68f52fd7-3.14.0a3+-1b39b50 | bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6 | +|---------------------------|:----------------------------------------------------------------------:|:---------------------------------------------------------------------:| +| gc_traversal | 4.39 ms | 4.20 ms: 1.05x faster | +| logging_simple | 6.11 us | 5.95 us: 1.03x faster | +| mako | 11.6 ms | 11.4 ms: 1.02x faster | +| nbody | 89.9 ms | 88.2 ms: 1.02x faster | +| generators | 27.4 ms | 26.9 ms: 1.02x faster | +| sqlite_synth | 2.20 us | 2.16 us: 1.02x faster | +| regex_dna | 182 ms | 179 ms: 1.01x faster | +| async_tree_memoization | 324 ms | 320 ms: 1.01x faster | +| async_tree_memoization_tg | 300 ms | 297 ms: 1.01x faster | +| logging_format | 6.85 us | 6.77 us: 1.01x faster | +| regex_effbot | 2.82 ms | 2.79 ms: 1.01x faster | +| json | 4.73 ms | 4.68 ms: 1.01x faster | +| logging_silent | 104 ns | 103 ns: 1.01x faster | +| async_tree_none_tg | 252 ms | 250 ms: 1.01x faster | +| json_loads | 25.8 us | 25.6 us: 1.01x faster | +| spectral_norm | 102 ms | 101 ms: 1.01x faster | +| scimark_sparse_mat_mult | 4.42 ms | 4.37 ms: 1.01x faster | +| create_gc_cycles | 1.85 ms | 1.84 ms: 1.01x faster | +| xml_etree_parse | 128 ms | 127 ms: 1.01x faster | +| deepcopy_memo | 29.7 us | 29.4 us: 1.01x faster | +| dulwich_log | 75.0 ms | 74.4 ms: 1.01x faster | +| genshi_xml | 48.7 ms | 48.3 ms: 1.01x faster | +| deltablue | 3.12 ms | 3.11 ms: 1.01x faster | +| regex_v8 | 24.4 ms | 24.3 ms: 1.00x faster | +| raytrace | 256 ms | 255 ms: 1.00x faster | +| python_startup_no_site | 7.48 ms | 7.48 ms: 1.00x slower | +| bpe_tokeniser | 4.23 sec | 4.24 sec: 1.00x slower | +| coroutines | 21.0 ms | 21.1 ms: 1.00x slower | +| coverage | 79.1 ms | 79.4 ms: 1.00x slower | +| 2to3 | 252 ms | 253 ms: 1.00x slower | +| sqlglot_optimize | 51.8 ms | 52.1 ms: 1.01x slower | +| scimark_monte_carlo | 61.7 ms | 62.1 ms: 1.01x slower | +| richards | 41.7 ms | 42.0 ms: 1.01x slower | +| mdp | 2.30 sec | 2.31 sec: 1.01x slower | +| pickle_pure_python | 303 us | 305 us: 1.01x slower | +| xml_etree_generate | 82.5 ms | 83.1 ms: 1.01x slower | +| docutils | 2.53 sec | 2.55 sec: 1.01x slower | +| genshi_text | 21.0 ms | 21.1 ms: 1.01x slower | +| sqlglot_normalize | 102 ms | 103 ms: 1.01x slower | +| pyflate | 413 ms | 417 ms: 1.01x slower | +| unpickle_pure_python | 209 us | 211 us: 1.01x slower | +| xml_etree_process | 56.9 ms | 57.5 ms: 1.01x slower | +| pathlib | 17.8 ms | 18.0 ms: 1.01x slower | +| sympy_integrate | 19.6 ms | 19.8 ms: 1.01x slower | +| hexiom | 5.69 ms | 5.76 ms: 1.01x slower | +| telco | 7.20 ms | 7.29 ms: 1.01x slower | +| pprint_pformat | 1.39 sec | 1.41 sec: 1.01x slower | +| pprint_safe_repr | 682 ms | 691 ms: 1.01x slower | +| thrift | 725 us | 735 us: 1.01x slower | +| go | 113 ms | 115 ms: 1.01x slower | +| crypto_pyaes | 64.9 ms | 65.9 ms: 1.02x slower | +| subparsers | 21.5 ms | 21.9 ms: 1.02x slower | +| fannkuch | 364 ms | 377 ms: 1.04x slower | +| Geometric mean | (ref) | 1.00x faster | + +Benchmark hidden because not significant (42): k_core, async_tree_cpu_io_mixed, async_tree_none, async_tree_io_tg, shortest_path, async_generators, async_tree_io, typing_runtime_protocols, sqlalchemy_imperative, bench_thread_pool, sympy_expand, pycparser, nqueens, sqlalchemy_declarative, connected_components, pidigits, async_tree_cpu_io_mixed_tg, float, bench_mp_pool, asyncio_websockets, tomli_loads, comprehensions, sqlglot_parse, pylint, deepcopy, sqlglot_transpile, xml_etree_iterparse, python_startup, meteor_contest, chaos, regex_compile, deepcopy_reduce, scimark_lu, scimark_fft, richards_super, many_optionals, json_dumps, sympy_sum, sympy_str, django_template, sphinx, scimark_sor + +- Geometric mean (including insignificant results): 1.000x faster + +# HPT report + +- Reliability score: 59.69% likely to be slow +- 90% likely to have a slowdown of 1.00x +- 95% likely to have a slowdown of 1.00x +- 99% likely to have a slowdown of 1.00x + +# Memory +- memory change: 1.00x \ No newline at end of file diff --git a/results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-base.svg b/results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-base.svg new file mode 100644 index 0000000..8de7dbd --- /dev/null +++ b/results/bm-20250110-3.14.0a3+-7ab3ec6/bm-20250110-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3+-7ab3ec6-vs-base.svg @@ -0,0 +1,3450 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250111-3.14.0a3+-553cdc6/README.md b/results/bm-20250111-3.14.0a3+-553cdc6/README.md new file mode 100644 index 0000000..d020505 --- /dev/null +++ b/results/bm-20250111-3.14.0a3+-553cdc6/README.md @@ -0,0 +1,35 @@ +# Results + +- fork: python/553cdc6d6856c1b4539a +- version: 3.14.0a3+ +- config: +- commit hash: [553cdc6](https://github.com/python/cpython/commit/553cdc6) +- commit date: 2025-01-11T01:03:12+00:00 +- commit merge base: [1b39b502d33c68f52fd775c4e6c2174baddd40bd](https://github.com/python/cpython/commit/1b39b502d33c68f52fd775c4e6c2174baddd40bd) +- ref: 553cdc6d6856c1b4539a + +## linux x86_64 (linux) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/12720021809) +- cpu model: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz +- platform: Linux-5.15.0-1071-aws-x86_64-with-glibc2.31 +- [raw results](bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3%2B-553cdc6.json) + +### vs. 3.12.6 + +- Geometric mean: 1.071x faster (HPT: reliability of 99.98%, 1.01x faster at 99th %ile) +- Memory usage: 1.13x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers +- [📄table](bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3%2B-553cdc6-vs-3.12.6.md) +- [📈time plot](bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3%2B-553cdc6-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.034x faster (HPT: reliability of 97.69%, 1.00x faster at 99th %ile) +- Memory usage: 1.12x +- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers +- [📄table](bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3%2B-553cdc6-vs-3.13.0rc2.md) +- [📈time plot](bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3%2B-553cdc6-vs-3.13.0rc2.svg) + diff --git a/results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6-vs-3.12.6.md b/results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6-vs-3.12.6.md new file mode 100644 index 0000000..9763c76 --- /dev/null +++ b/results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6-vs-3.12.6.md @@ -0,0 +1,174 @@ +# Results vs. 3.12.6 + +- fork: python +- ref: 553cdc6d6856c1b4539a +- machine: linux-x86_64 +- commit hash: 553cdc6 +- commit date: 2025-01-11 +- overall geometric mean: 1.071x faster +- HPT reliability: 99.98% +- HPT 99th percentile: 1.01x faster +- Memory change: 1.13x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 456 ms | 495 ms: 1.09x slower | +| docutils | 4.00 sec | 3.87 sec: 1.03x faster | +| html5lib | 88.9 ms | 98.0 ms: 1.10x slower | +| Geometric mean | (ref) | 1.05x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6 | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.93 sec | 860 ms: 2.25x faster | +| async_tree_io | 1.85 sec | 871 ms: 2.12x faster | +| async_tree_memoization | 977 ms | 488 ms: 2.00x faster | +| async_tree_none | 741 ms | 385 ms: 1.92x faster | +| async_tree_none_tg | 704 ms | 385 ms: 1.83x faster | +| async_tree_memoization_tg | 930 ms | 517 ms: 1.80x faster | +| async_tree_cpu_io_mixed_tg | 1.10 sec | 636 ms: 1.73x faster | +| async_tree_cpu_io_mixed | 1.08 sec | 698 ms: 1.54x faster | +| coroutines | 29.5 ms | 31.8 ms: 1.08x slower | +| Geometric mean | (ref) | 1.58x faster | + +Benchmark hidden because not significant (2): async_generators, asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| float | 123 ms | 106 ms: 1.16x faster | +| nbody | 119 ms | 143 ms: 1.20x slower | +| Geometric mean | (ref) | 1.00x faster | + +Benchmark hidden because not significant (1): pidigits + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 5.13 ms | 4.44 ms: 1.16x faster | +| regex_compile | 187 ms | 166 ms: 1.13x faster | +| regex_dna | 278 ms | 301 ms: 1.08x slower | +| regex_v8 | 32.5 ms | 38.5 ms: 1.19x slower | +| Geometric mean | (ref) | 1.00x faster | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6 | +|----------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_parse | 241 ms | 202 ms: 1.19x faster | +| tomli_loads | 2.88 sec | 2.55 sec: 1.13x faster | +| xml_etree_process | 83.7 ms | 89.0 ms: 1.06x slower | +| unpickle_pure_python | 300 us | 327 us: 1.09x slower | +| json_dumps | 14.3 ms | 16.3 ms: 1.14x slower | +| Geometric mean | (ref) | 1.02x slower | + +Benchmark hidden because not significant (4): xml_etree_generate, json_loads, pickle_pure_python, xml_etree_iterparse + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6 | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 17.6 ms | 16.6 ms: 1.06x faster | +| python_startup | 23.7 ms | 29.8 ms: 1.26x slower | +| Geometric mean | (ref) | 1.09x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6 | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 67.6 ms | 80.8 ms: 1.20x slower | +| Geometric mean | (ref) | 1.04x slower | + +Benchmark hidden because not significant (3): genshi_text, django_template, mako + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6 | +|----------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.93 sec | 860 ms: 2.25x faster | +| async_tree_io | 1.85 sec | 871 ms: 2.12x faster | +| async_tree_memoization | 977 ms | 488 ms: 2.00x faster | +| async_tree_none | 741 ms | 385 ms: 1.92x faster | +| async_tree_none_tg | 704 ms | 385 ms: 1.83x faster | +| async_tree_memoization_tg | 930 ms | 517 ms: 1.80x faster | +| async_tree_cpu_io_mixed_tg | 1.10 sec | 636 ms: 1.73x faster | +| async_tree_cpu_io_mixed | 1.08 sec | 698 ms: 1.54x faster | +| comprehensions | 27.1 us | 20.8 us: 1.30x faster | +| deepcopy | 468 us | 372 us: 1.26x faster | +| sqlalchemy_declarative | 218 ms | 175 ms: 1.24x faster | +| deepcopy_memo | 52.4 us | 42.4 us: 1.24x faster | +| xml_etree_parse | 241 ms | 202 ms: 1.19x faster | +| pycparser | 1.79 sec | 1.51 sec: 1.19x faster | +| float | 123 ms | 106 ms: 1.16x faster | +| crypto_pyaes | 107 ms | 92.5 ms: 1.16x faster | +| regex_effbot | 5.13 ms | 4.44 ms: 1.16x faster | +| scimark_sparse_mat_mult | 6.70 ms | 5.86 ms: 1.14x faster | +| sqlglot_normalize | 157 ms | 138 ms: 1.14x faster | +| scimark_fft | 500 ms | 441 ms: 1.13x faster | +| tomli_loads | 2.88 sec | 2.55 sec: 1.13x faster | +| regex_compile | 187 ms | 166 ms: 1.13x faster | +| raytrace | 408 ms | 363 ms: 1.12x faster | +| pylint | 465 ms | 414 ms: 1.12x faster | +| scimark_monte_carlo | 96.4 ms | 87.8 ms: 1.10x faster | +| scimark_sor | 167 ms | 153 ms: 1.09x faster | +| json | 6.85 ms | 6.34 ms: 1.08x faster | +| nqueens | 117 ms | 108 ms: 1.08x faster | +| pprint_pformat | 1.98 sec | 1.84 sec: 1.07x faster | +| mdp | 3.97 sec | 3.73 sec: 1.07x faster | +| python_startup_no_site | 17.6 ms | 16.6 ms: 1.06x faster | +| deepcopy_reduce | 4.04 us | 3.82 us: 1.06x faster | +| generators | 41.1 ms | 39.1 ms: 1.05x faster | +| fannkuch | 540 ms | 515 ms: 1.05x faster | +| bpe_tokeniser | 6.59 sec | 6.37 sec: 1.03x faster | +| docutils | 4.00 sec | 3.87 sec: 1.03x faster | +| xml_etree_process | 83.7 ms | 89.0 ms: 1.06x slower | +| thrift | 1.06 ms | 1.13 ms: 1.07x slower | +| hexiom | 8.27 ms | 8.86 ms: 1.07x slower | +| telco | 9.59 ms | 10.3 ms: 1.08x slower | +| coroutines | 29.5 ms | 31.8 ms: 1.08x slower | +| regex_dna | 278 ms | 301 ms: 1.08x slower | +| 2to3 | 456 ms | 495 ms: 1.09x slower | +| bench_thread_pool | 3.48 ms | 3.79 ms: 1.09x slower | +| unpickle_pure_python | 300 us | 327 us: 1.09x slower | +| html5lib | 88.9 ms | 98.0 ms: 1.10x slower | +| deltablue | 4.27 ms | 4.75 ms: 1.11x slower | +| meteor_contest | 146 ms | 163 ms: 1.12x slower | +| coverage | 95.4 ms | 108 ms: 1.13x slower | +| json_dumps | 14.3 ms | 16.3 ms: 1.14x slower | +| regex_v8 | 32.5 ms | 38.5 ms: 1.19x slower | +| genshi_xml | 67.6 ms | 80.8 ms: 1.20x slower | +| nbody | 119 ms | 143 ms: 1.20x slower | +| python_startup | 23.7 ms | 29.8 ms: 1.26x slower | +| gc_traversal | 5.86 ms | 8.53 ms: 1.46x slower | +| create_gc_cycles | 1.94 ms | 3.75 ms: 1.93x slower | +| bench_mp_pool | 20.7 ms | 96.0 ms: 4.64x slower | +| Geometric mean | (ref) | 1.04x faster | + +Benchmark hidden because not significant (33): logging_simple, genshi_text, sqlglot_optimize, pathlib, go, pidigits, sympy_str, richards, async_generators, sqlalchemy_imperative, sqlglot_parse, pyflate, django_template, dulwich_log, scimark_lu, sympy_sum, sqlglot_transpile, pprint_safe_repr, sympy_expand, sqlite_synth, spectral_norm, chaos, xml_etree_generate, logging_silent, typing_runtime_protocols, asyncio_websockets, mako, richards_super, logging_format, json_loads, pickle_pure_python, xml_etree_iterparse, sympy_integrate +Ignored benchmarks (15) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (6) of results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6.json: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers + +- Geometric mean (including insignificant results): 1.071x faster + +# HPT report + +- Reliability score: 99.98% likely to be faster +- 90% likely to have a speedup of 1.03x +- 95% likely to have a speedup of 1.03x +- 99% likely to have a speedup of 1.01x + +# Memory +- memory change: 1.13x \ No newline at end of file diff --git a/results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6-vs-3.12.6.svg b/results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6-vs-3.12.6.svg new file mode 100644 index 0000000..eaacfdd --- /dev/null +++ b/results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6-vs-3.12.6.svg @@ -0,0 +1,3259 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6-vs-3.13.0rc2.md b/results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6-vs-3.13.0rc2.md new file mode 100644 index 0000000..cd4c923 --- /dev/null +++ b/results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6-vs-3.13.0rc2.md @@ -0,0 +1,174 @@ +# Results vs. 3.13.0rc2 + +- fork: python +- ref: 553cdc6d6856c1b4539a +- machine: linux-x86_64 +- commit hash: 553cdc6 +- commit date: 2025-01-11 +- overall geometric mean: 1.034x faster +- HPT reliability: 97.69% +- HPT 99th percentile: 1.00x faster +- Memory change: 1.12x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 445 ms | 495 ms: 1.11x slower | +| docutils | 4.01 sec | 3.87 sec: 1.04x faster | +| Geometric mean | (ref) | 1.04x slower | + +Benchmark hidden because not significant (1): html5lib + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6 | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.40 sec | 860 ms: 1.63x faster | +| async_tree_io | 1.39 sec | 871 ms: 1.59x faster | +| async_tree_none | 572 ms | 385 ms: 1.48x faster | +| async_tree_memoization | 709 ms | 488 ms: 1.45x faster | +| async_tree_cpu_io_mixed_tg | 852 ms | 636 ms: 1.34x faster | +| async_tree_none_tg | 504 ms | 385 ms: 1.31x faster | +| async_tree_memoization_tg | 670 ms | 517 ms: 1.30x faster | +| async_tree_cpu_io_mixed | 889 ms | 698 ms: 1.27x faster | +| Geometric mean | (ref) | 1.28x faster | + +Benchmark hidden because not significant (3): asyncio_websockets, async_generators, coroutines + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| float | 116 ms | 106 ms: 1.09x faster | +| nbody | 119 ms | 143 ms: 1.21x slower | +| Geometric mean | (ref) | 1.02x slower | + +Benchmark hidden because not significant (1): pidigits + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_compile | 182 ms | 166 ms: 1.10x faster | +| regex_effbot | 4.74 ms | 4.44 ms: 1.07x faster | +| regex_dna | 282 ms | 301 ms: 1.07x slower | +| regex_v8 | 32.8 ms | 38.5 ms: 1.17x slower | +| Geometric mean | (ref) | 1.02x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6 | +|----------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_parse | 231 ms | 202 ms: 1.14x faster | +| tomli_loads | 2.78 sec | 2.55 sec: 1.09x faster | +| xml_etree_generate | 122 ms | 129 ms: 1.05x slower | +| pickle_pure_python | 416 us | 457 us: 1.10x slower | +| unpickle_pure_python | 290 us | 327 us: 1.13x slower | +| json_dumps | 14.1 ms | 16.3 ms: 1.15x slower | +| json_loads | 34.3 us | 39.6 us: 1.16x slower | +| Geometric mean | (ref) | 1.04x slower | + +Benchmark hidden because not significant (2): xml_etree_iterparse, xml_etree_process + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6 | +|------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 15.3 ms | 16.6 ms: 1.08x slower | +| python_startup | 22.4 ms | 29.8 ms: 1.33x slower | +| Geometric mean | (ref) | 1.20x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6 | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_text | 31.7 ms | 28.9 ms: 1.09x faster | +| genshi_xml | 72.1 ms | 80.8 ms: 1.12x slower | +| Geometric mean | (ref) | 1.01x slower | + +Benchmark hidden because not significant (2): django_template, mako + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6 | +|----------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| async_tree_io_tg | 1.40 sec | 860 ms: 1.63x faster | +| async_tree_io | 1.39 sec | 871 ms: 1.59x faster | +| async_tree_none | 572 ms | 385 ms: 1.48x faster | +| async_tree_memoization | 709 ms | 488 ms: 1.45x faster | +| async_tree_cpu_io_mixed_tg | 852 ms | 636 ms: 1.34x faster | +| deepcopy | 498 us | 372 us: 1.34x faster | +| async_tree_none_tg | 504 ms | 385 ms: 1.31x faster | +| async_tree_memoization_tg | 670 ms | 517 ms: 1.30x faster | +| async_tree_cpu_io_mixed | 889 ms | 698 ms: 1.27x faster | +| deepcopy_memo | 50.1 us | 42.4 us: 1.18x faster | +| telco | 12.2 ms | 10.3 ms: 1.18x faster | +| scimark_sor | 179 ms | 153 ms: 1.17x faster | +| scimark_sparse_mat_mult | 6.76 ms | 5.86 ms: 1.15x faster | +| go | 191 ms | 166 ms: 1.15x faster | +| xml_etree_parse | 231 ms | 202 ms: 1.14x faster | +| pylint | 470 ms | 414 ms: 1.13x faster | +| richards | 65.5 ms | 58.3 ms: 1.12x faster | +| regex_compile | 182 ms | 166 ms: 1.10x faster | +| genshi_text | 31.7 ms | 28.9 ms: 1.09x faster | +| float | 116 ms | 106 ms: 1.09x faster | +| tomli_loads | 2.78 sec | 2.55 sec: 1.09x faster | +| crypto_pyaes | 100 ms | 92.5 ms: 1.08x faster | +| scimark_fft | 473 ms | 441 ms: 1.07x faster | +| deepcopy_reduce | 4.10 us | 3.82 us: 1.07x faster | +| comprehensions | 22.2 us | 20.8 us: 1.07x faster | +| regex_effbot | 4.74 ms | 4.44 ms: 1.07x faster | +| fannkuch | 547 ms | 515 ms: 1.06x faster | +| pprint_pformat | 1.94 sec | 1.84 sec: 1.05x faster | +| pycparser | 1.57 sec | 1.51 sec: 1.04x faster | +| docutils | 4.01 sec | 3.87 sec: 1.04x faster | +| scimark_monte_carlo | 90.6 ms | 87.8 ms: 1.03x faster | +| xml_etree_generate | 122 ms | 129 ms: 1.05x slower | +| raytrace | 344 ms | 363 ms: 1.05x slower | +| pyflate | 664 ms | 709 ms: 1.07x slower | +| regex_dna | 282 ms | 301 ms: 1.07x slower | +| deltablue | 4.44 ms | 4.75 ms: 1.07x slower | +| logging_format | 9.24 us | 9.99 us: 1.08x slower | +| python_startup_no_site | 15.3 ms | 16.6 ms: 1.08x slower | +| logging_silent | 130 ns | 141 ns: 1.08x slower | +| meteor_contest | 150 ms | 163 ms: 1.09x slower | +| hexiom | 8.11 ms | 8.86 ms: 1.09x slower | +| pickle_pure_python | 416 us | 457 us: 1.10x slower | +| 2to3 | 445 ms | 495 ms: 1.11x slower | +| genshi_xml | 72.1 ms | 80.8 ms: 1.12x slower | +| unpickle_pure_python | 290 us | 327 us: 1.13x slower | +| json_dumps | 14.1 ms | 16.3 ms: 1.15x slower | +| json_loads | 34.3 us | 39.6 us: 1.16x slower | +| regex_v8 | 32.8 ms | 38.5 ms: 1.17x slower | +| nbody | 119 ms | 143 ms: 1.21x slower | +| bench_thread_pool | 2.89 ms | 3.79 ms: 1.31x slower | +| python_startup | 22.4 ms | 29.8 ms: 1.33x slower | +| gc_traversal | 5.70 ms | 8.53 ms: 1.50x slower | +| create_gc_cycles | 2.41 ms | 3.75 ms: 1.55x slower | +| bench_mp_pool | 18.7 ms | 96.0 ms: 5.14x slower | +| Geometric mean | (ref) | 1.00x faster | + +Benchmark hidden because not significant (34): pidigits, sympy_expand, nqueens, pprint_safe_repr, sqlglot_optimize, json, generators, sqlite_synth, mdp, sympy_str, sqlglot_normalize, sqlglot_parse, django_template, asyncio_websockets, spectral_norm, coverage, async_generators, bpe_tokeniser, pathlib, typing_runtime_protocols, xml_etree_iterparse, scimark_lu, mako, chaos, thrift, coroutines, richards_super, xml_etree_process, sympy_sum, dulwich_log, sqlglot_transpile, logging_simple, sympy_integrate, html5lib +Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list +Ignored benchmarks (8) of results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers + +- Geometric mean (including insignificant results): 1.034x faster + +# HPT report + +- Reliability score: 97.69% likely to be faster +- 90% likely to have a speedup of 1.00x +- 95% likely to have a speedup of 1.00x +- 99% likely to have a speedup of 1.00x + +# Memory +- memory change: 1.12x \ No newline at end of file diff --git a/results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6-vs-3.13.0rc2.svg b/results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6-vs-3.13.0rc2.svg new file mode 100644 index 0000000..aa0b02f --- /dev/null +++ b/results/bm-20250111-3.14.0a3+-553cdc6/bm-20250111-linux-x86_64-python-553cdc6d6856c1b4539a-3.14.0a3+-553cdc6-vs-3.13.0rc2.svg @@ -0,0 +1,3235 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +