diff --git a/README.md b/README.md index 9728a7fa..d1c08631 100644 --- a/README.md +++ b/README.md @@ -12,18 +12,20 @@ Here are some recent and important revisions. 👉 [Complete list of results](RE ## linux x86_64 (linux) | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | +| [2024-11-20](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL) | python/32428cf9ea03bce6d64c | 32428cf (NOGIL) | 1.42x ↓
[📄](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.svg) | 1.44x ↓
[📄](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.svg) | 1.45x ↓
[📄](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base.svg)[🧠](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base-mem.svg) | +| [2024-11-20](results/bm-20241120-3.14.0a2%2B-32428cf) | python/32428cf9ea03bce6d64c | 32428cf | 1.03x ↑
[📄](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.svg) | 1.01x ↑
[📄](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.svg) | | | [2024-11-19](results/bm-20241119-3.14.0a2%2B-c9b399f) | python/c9b399fbdb01584dcfff | c9b399f | 1.01x ↑
[📄](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.12.6.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.12.6.svg) | 1.00x ↓
[📄](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.13.0rc2.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.13.0rc2.svg) | | | [2024-11-19](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL) | python/c9b399fbdb01584dcfff | c9b399f (NOGIL) | 1.41x ↓
[📄](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.12.6.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.12.6.svg) | 1.43x ↓
[📄](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.13.0rc2.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.13.0rc2.svg) | 1.43x ↓
[📄](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-base.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-base.svg)[🧠](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-base-mem.svg) | | [2024-11-19](results/bm-20241119-3.14.0a1%2B-d6b3e78) | python/d6b3e78504b3168c432b | d6b3e78 | 1.03x ↑
[📄](results/bm-20241119-3.14.0a1%2B-d6b3e78/bm-20241119-linux-x86_64-python-d6b3e78504b3168c432b-3.14.0a1%2B-d6b3e78-vs-3.12.6.md)[📈](results/bm-20241119-3.14.0a1%2B-d6b3e78/bm-20241119-linux-x86_64-python-d6b3e78504b3168c432b-3.14.0a1%2B-d6b3e78-vs-3.12.6.svg) | 1.01x ↑
[📄](results/bm-20241119-3.14.0a1%2B-d6b3e78/bm-20241119-linux-x86_64-python-d6b3e78504b3168c432b-3.14.0a1%2B-d6b3e78-vs-3.13.0rc2.md)[📈](results/bm-20241119-3.14.0a1%2B-d6b3e78/bm-20241119-linux-x86_64-python-d6b3e78504b3168c432b-3.14.0a1%2B-d6b3e78-vs-3.13.0rc2.svg) | | | [2024-11-19](results/bm-20241119-3.14.0a1%2B-d6b3e78-NOGIL) | python/d6b3e78504b3168c432b | d6b3e78 (NOGIL) | 1.40x ↓
[📄](results/bm-20241119-3.14.0a1%2B-d6b3e78-NOGIL/bm-20241119-linux-x86_64-python-d6b3e78504b3168c432b-3.14.0a1%2B-d6b3e78-vs-3.12.6.md)[📈](results/bm-20241119-3.14.0a1%2B-d6b3e78-NOGIL/bm-20241119-linux-x86_64-python-d6b3e78504b3168c432b-3.14.0a1%2B-d6b3e78-vs-3.12.6.svg) | 1.43x ↓
[📄](results/bm-20241119-3.14.0a1%2B-d6b3e78-NOGIL/bm-20241119-linux-x86_64-python-d6b3e78504b3168c432b-3.14.0a1%2B-d6b3e78-vs-3.13.0rc2.md)[📈](results/bm-20241119-3.14.0a1%2B-d6b3e78-NOGIL/bm-20241119-linux-x86_64-python-d6b3e78504b3168c432b-3.14.0a1%2B-d6b3e78-vs-3.13.0rc2.svg) | 1.45x ↓
[📄](results/bm-20241119-3.14.0a1%2B-d6b3e78-NOGIL/bm-20241119-linux-x86_64-python-d6b3e78504b3168c432b-3.14.0a1%2B-d6b3e78-vs-base.md)[📈](results/bm-20241119-3.14.0a1%2B-d6b3e78-NOGIL/bm-20241119-linux-x86_64-python-d6b3e78504b3168c432b-3.14.0a1%2B-d6b3e78-vs-base.svg)[🧠](results/bm-20241119-3.14.0a1%2B-d6b3e78-NOGIL/bm-20241119-linux-x86_64-python-d6b3e78504b3168c432b-3.14.0a1%2B-d6b3e78-vs-base-mem.svg) | | [2024-11-18](results/bm-20241118-3.14.0a1%2B-500a471) | python/500a4712bb42355eeb78 | 500a471 | 1.03x ↑
[📄](results/bm-20241118-3.14.0a1%2B-500a471/bm-20241118-linux-x86_64-python-500a4712bb42355eeb78-3.14.0a1%2B-500a471-vs-3.12.6.md)[📈](results/bm-20241118-3.14.0a1%2B-500a471/bm-20241118-linux-x86_64-python-500a4712bb42355eeb78-3.14.0a1%2B-500a471-vs-3.12.6.svg) | 1.01x ↑
[📄](results/bm-20241118-3.14.0a1%2B-500a471/bm-20241118-linux-x86_64-python-500a4712bb42355eeb78-3.14.0a1%2B-500a471-vs-3.13.0rc2.md)[📈](results/bm-20241118-3.14.0a1%2B-500a471/bm-20241118-linux-x86_64-python-500a4712bb42355eeb78-3.14.0a1%2B-500a471-vs-3.13.0rc2.svg) | | | [2024-11-18](results/bm-20241118-3.14.0a1%2B-500a471-NOGIL) | python/500a4712bb42355eeb78 | 500a471 (NOGIL) | 1.42x ↓
[📄](results/bm-20241118-3.14.0a1%2B-500a471-NOGIL/bm-20241118-linux-x86_64-python-500a4712bb42355eeb78-3.14.0a1%2B-500a471-vs-3.12.6.md)[📈](results/bm-20241118-3.14.0a1%2B-500a471-NOGIL/bm-20241118-linux-x86_64-python-500a4712bb42355eeb78-3.14.0a1%2B-500a471-vs-3.12.6.svg) | 1.44x ↓
[📄](results/bm-20241118-3.14.0a1%2B-500a471-NOGIL/bm-20241118-linux-x86_64-python-500a4712bb42355eeb78-3.14.0a1%2B-500a471-vs-3.13.0rc2.md)[📈](results/bm-20241118-3.14.0a1%2B-500a471-NOGIL/bm-20241118-linux-x86_64-python-500a4712bb42355eeb78-3.14.0a1%2B-500a471-vs-3.13.0rc2.svg) | 1.46x ↓
[📄](results/bm-20241118-3.14.0a1%2B-500a471-NOGIL/bm-20241118-linux-x86_64-python-500a4712bb42355eeb78-3.14.0a1%2B-500a471-vs-base.md)[📈](results/bm-20241118-3.14.0a1%2B-500a471-NOGIL/bm-20241118-linux-x86_64-python-500a4712bb42355eeb78-3.14.0a1%2B-500a471-vs-base.svg)[🧠](results/bm-20241118-3.14.0a1%2B-500a471-NOGIL/bm-20241118-linux-x86_64-python-500a4712bb42355eeb78-3.14.0a1%2B-500a471-vs-base-mem.svg) | -| [2024-11-17](results/bm-20241117-3.14.0a1%2B-acbd5c9-NOGIL) | python/acbd5c9c6c62dac34d2e | acbd5c9 (NOGIL) | 1.41x ↓
[📄](results/bm-20241117-3.14.0a1%2B-acbd5c9-NOGIL/bm-20241117-linux-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-3.12.6.md)[📈](results/bm-20241117-3.14.0a1%2B-acbd5c9-NOGIL/bm-20241117-linux-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-3.12.6.svg) | 1.43x ↓
[📄](results/bm-20241117-3.14.0a1%2B-acbd5c9-NOGIL/bm-20241117-linux-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-3.13.0rc2.md)[📈](results/bm-20241117-3.14.0a1%2B-acbd5c9-NOGIL/bm-20241117-linux-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-3.13.0rc2.svg) | 1.42x ↓
[📄](results/bm-20241117-3.14.0a1%2B-acbd5c9-NOGIL/bm-20241117-linux-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-base.md)[📈](results/bm-20241117-3.14.0a1%2B-acbd5c9-NOGIL/bm-20241117-linux-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-base.svg)[🧠](results/bm-20241117-3.14.0a1%2B-acbd5c9-NOGIL/bm-20241117-linux-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-base-mem.svg) | -| [2024-11-17](results/bm-20241117-3.14.0a1%2B-acbd5c9) | python/acbd5c9c6c62dac34d2e | acbd5c9 | 1.01x ↑
[📄](results/bm-20241117-3.14.0a1%2B-acbd5c9/bm-20241117-linux-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-3.12.6.md)[📈](results/bm-20241117-3.14.0a1%2B-acbd5c9/bm-20241117-linux-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-3.12.6.svg) | 1.01x ↓
[📄](results/bm-20241117-3.14.0a1%2B-acbd5c9/bm-20241117-linux-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-3.13.0rc2.md)[📈](results/bm-20241117-3.14.0a1%2B-acbd5c9/bm-20241117-linux-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-3.13.0rc2.svg) | | ## linux x86_64 (vultr) | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | +| [2024-11-20](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL) | python/32428cf9ea03bce6d64c | 32428cf (NOGIL) | 1.54x ↓
[📄](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.svg) | 1.56x ↓
[📄](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.svg) | 1.53x ↓
[📄](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base.svg)[🧠](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base-mem.svg) | +| [2024-11-20](results/bm-20241120-3.14.0a2%2B-32428cf) | python/32428cf9ea03bce6d64c | 32428cf | 1.00x ↓
[📄](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.svg) | 1.02x ↓
[📄](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.svg) | | | [2024-11-19](results/bm-20241119-3.14.0a2%2B-c9b399f) | python/c9b399fbdb01584dcfff | c9b399f | 1.01x ↓
[📄](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.12.6.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.12.6.svg) | 1.02x ↓
[📄](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.13.0rc2.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.13.0rc2.svg) | | | [2024-11-19](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL) | python/c9b399fbdb01584dcfff | c9b399f (NOGIL) | 1.54x ↓
[📄](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.12.6.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.12.6.svg) | 1.56x ↓
[📄](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.13.0rc2.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.13.0rc2.svg) | 1.53x ↓
[📄](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-base.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-base.svg)[🧠](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-base-mem.svg) | | [2024-11-19](results/bm-20241119-3.14.0a1%2B-29cbcbd-NOGIL) | python/29cbcbd73bbfd8c953c0 | 29cbcbd (NOGIL) | 1.55x ↓
[📄](results/bm-20241119-3.14.0a1%2B-29cbcbd-NOGIL/bm-20241119-vultr-x86_64-python-29cbcbd73bbfd8c953c0-3.14.0a1%2B-29cbcbd-vs-3.12.6.md)[📈](results/bm-20241119-3.14.0a1%2B-29cbcbd-NOGIL/bm-20241119-vultr-x86_64-python-29cbcbd73bbfd8c953c0-3.14.0a1%2B-29cbcbd-vs-3.12.6.svg) | 1.58x ↓
[📄](results/bm-20241119-3.14.0a1%2B-29cbcbd-NOGIL/bm-20241119-vultr-x86_64-python-29cbcbd73bbfd8c953c0-3.14.0a1%2B-29cbcbd-vs-3.13.0rc2.md)[📈](results/bm-20241119-3.14.0a1%2B-29cbcbd-NOGIL/bm-20241119-vultr-x86_64-python-29cbcbd73bbfd8c953c0-3.14.0a1%2B-29cbcbd-vs-3.13.0rc2.svg) | | @@ -39,8 +41,6 @@ Here are some recent and important revisions. 👉 [Complete list of results](RE | [2024-11-18](results/bm-20241118-3.14.0a1%2B-500a471-NOGIL) | python/500a4712bb42355eeb78 | 500a471 (NOGIL) | 1.55x ↓
[📄](results/bm-20241118-3.14.0a1%2B-500a471-NOGIL/bm-20241118-vultr-x86_64-python-500a4712bb42355eeb78-3.14.0a1%2B-500a471-vs-3.12.6.md)[📈](results/bm-20241118-3.14.0a1%2B-500a471-NOGIL/bm-20241118-vultr-x86_64-python-500a4712bb42355eeb78-3.14.0a1%2B-500a471-vs-3.12.6.svg) | 1.58x ↓
[📄](results/bm-20241118-3.14.0a1%2B-500a471-NOGIL/bm-20241118-vultr-x86_64-python-500a4712bb42355eeb78-3.14.0a1%2B-500a471-vs-3.13.0rc2.md)[📈](results/bm-20241118-3.14.0a1%2B-500a471-NOGIL/bm-20241118-vultr-x86_64-python-500a4712bb42355eeb78-3.14.0a1%2B-500a471-vs-3.13.0rc2.svg) | 1.54x ↓
[📄](results/bm-20241118-3.14.0a1%2B-500a471-NOGIL/bm-20241118-vultr-x86_64-python-500a4712bb42355eeb78-3.14.0a1%2B-500a471-vs-base.md)[📈](results/bm-20241118-3.14.0a1%2B-500a471-NOGIL/bm-20241118-vultr-x86_64-python-500a4712bb42355eeb78-3.14.0a1%2B-500a471-vs-base.svg)[🧠](results/bm-20241118-3.14.0a1%2B-500a471-NOGIL/bm-20241118-vultr-x86_64-python-500a4712bb42355eeb78-3.14.0a1%2B-500a471-vs-base-mem.svg) | | [2024-11-17](results/bm-20241117-3.14.0a1%2B-9d6366b-NOGIL) | python/9d6366b60d01305fc5e4 | 9d6366b (NOGIL) | 1.55x ↓
[📄](results/bm-20241117-3.14.0a1%2B-9d6366b-NOGIL/bm-20241117-vultr-x86_64-python-9d6366b60d01305fc5e4-3.14.0a1%2B-9d6366b-vs-3.12.6.md)[📈](results/bm-20241117-3.14.0a1%2B-9d6366b-NOGIL/bm-20241117-vultr-x86_64-python-9d6366b60d01305fc5e4-3.14.0a1%2B-9d6366b-vs-3.12.6.svg) | 1.57x ↓
[📄](results/bm-20241117-3.14.0a1%2B-9d6366b-NOGIL/bm-20241117-vultr-x86_64-python-9d6366b60d01305fc5e4-3.14.0a1%2B-9d6366b-vs-3.13.0rc2.md)[📈](results/bm-20241117-3.14.0a1%2B-9d6366b-NOGIL/bm-20241117-vultr-x86_64-python-9d6366b60d01305fc5e4-3.14.0a1%2B-9d6366b-vs-3.13.0rc2.svg) | 1.01x ↑
[📄](results/bm-20241117-3.14.0a1%2B-9d6366b-NOGIL/bm-20241117-vultr-x86_64-python-9d6366b60d01305fc5e4-3.14.0a1%2B-9d6366b-vs-base.md)[📈](results/bm-20241117-3.14.0a1%2B-9d6366b-NOGIL/bm-20241117-vultr-x86_64-python-9d6366b60d01305fc5e4-3.14.0a1%2B-9d6366b-vs-base.svg)[🧠](results/bm-20241117-3.14.0a1%2B-9d6366b-NOGIL/bm-20241117-vultr-x86_64-python-9d6366b60d01305fc5e4-3.14.0a1%2B-9d6366b-vs-base-mem.svg) | | [2024-11-17](results/bm-20241117-3.14.0a1%2B-9d6366b) | python/9d6366b60d01305fc5e4 | 9d6366b | 1.00x ↓
[📄](results/bm-20241117-3.14.0a1%2B-9d6366b/bm-20241117-vultr-x86_64-python-9d6366b60d01305fc5e4-3.14.0a1%2B-9d6366b-vs-3.12.6.md)[📈](results/bm-20241117-3.14.0a1%2B-9d6366b/bm-20241117-vultr-x86_64-python-9d6366b60d01305fc5e4-3.14.0a1%2B-9d6366b-vs-3.12.6.svg) | 1.02x ↓
[📄](results/bm-20241117-3.14.0a1%2B-9d6366b/bm-20241117-vultr-x86_64-python-9d6366b60d01305fc5e4-3.14.0a1%2B-9d6366b-vs-3.13.0rc2.md)[📈](results/bm-20241117-3.14.0a1%2B-9d6366b/bm-20241117-vultr-x86_64-python-9d6366b60d01305fc5e4-3.14.0a1%2B-9d6366b-vs-3.13.0rc2.svg) | 1.00x ↓
[📄](results/bm-20241117-3.14.0a1%2B-9d6366b/bm-20241117-vultr-x86_64-python-9d6366b60d01305fc5e4-3.14.0a1%2B-9d6366b-vs-base.md)[📈](results/bm-20241117-3.14.0a1%2B-9d6366b/bm-20241117-vultr-x86_64-python-9d6366b60d01305fc5e4-3.14.0a1%2B-9d6366b-vs-base.svg)[🧠](results/bm-20241117-3.14.0a1%2B-9d6366b/bm-20241117-vultr-x86_64-python-9d6366b60d01305fc5e4-3.14.0a1%2B-9d6366b-vs-base-mem.svg) | -| [2024-11-17](results/bm-20241117-3.14.0a1%2B-acbd5c9-NOGIL) | python/acbd5c9c6c62dac34d2e | acbd5c9 (NOGIL) | 1.56x ↓
[📄](results/bm-20241117-3.14.0a1%2B-acbd5c9-NOGIL/bm-20241117-vultr-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-3.12.6.md)[📈](results/bm-20241117-3.14.0a1%2B-acbd5c9-NOGIL/bm-20241117-vultr-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-3.12.6.svg) | 1.58x ↓
[📄](results/bm-20241117-3.14.0a1%2B-acbd5c9-NOGIL/bm-20241117-vultr-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-3.13.0rc2.md)[📈](results/bm-20241117-3.14.0a1%2B-acbd5c9-NOGIL/bm-20241117-vultr-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-3.13.0rc2.svg) | 1.56x ↓
[📄](results/bm-20241117-3.14.0a1%2B-acbd5c9-NOGIL/bm-20241117-vultr-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-base.md)[📈](results/bm-20241117-3.14.0a1%2B-acbd5c9-NOGIL/bm-20241117-vultr-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-base.svg)[🧠](results/bm-20241117-3.14.0a1%2B-acbd5c9-NOGIL/bm-20241117-vultr-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-base-mem.svg) | -| [2024-11-17](results/bm-20241117-3.14.0a1%2B-acbd5c9) | python/acbd5c9c6c62dac34d2e | acbd5c9 | 1.00x ↓
[📄](results/bm-20241117-3.14.0a1%2B-acbd5c9/bm-20241117-vultr-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-3.12.6.md)[📈](results/bm-20241117-3.14.0a1%2B-acbd5c9/bm-20241117-vultr-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-3.12.6.svg) | 1.02x ↓
[📄](results/bm-20241117-3.14.0a1%2B-acbd5c9/bm-20241117-vultr-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-3.13.0rc2.md)[📈](results/bm-20241117-3.14.0a1%2B-acbd5c9/bm-20241117-vultr-x86_64-python-acbd5c9c6c62dac34d2e-3.14.0a1%2B-acbd5c9-vs-3.13.0rc2.svg) | | diff --git a/RESULTS.md b/RESULTS.md index 84276b63..bda6c8e5 100644 --- a/RESULTS.md +++ b/RESULTS.md @@ -6,6 +6,8 @@ ## linux x86_64 (linux) | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | +| [2024-11-20](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL) | python/32428cf9ea03bce6d64c | 32428cf (NOGIL) | 1.42x ↓
[📄](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.svg) | 1.44x ↓
[📄](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.svg) | 1.45x ↓
[📄](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base.svg)[🧠](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base-mem.svg) | +| [2024-11-20](results/bm-20241120-3.14.0a2%2B-32428cf) | python/32428cf9ea03bce6d64c | 32428cf | 1.03x ↑
[📄](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.svg) | 1.01x ↑
[📄](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.svg) | | | [2024-11-19](results/bm-20241119-3.14.0a2%2B-c9b399f) | python/c9b399fbdb01584dcfff | c9b399f | 1.01x ↑
[📄](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.12.6.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.12.6.svg) | 1.00x ↓
[📄](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.13.0rc2.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.13.0rc2.svg) | | | [2024-11-19](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL) | python/c9b399fbdb01584dcfff | c9b399f (NOGIL) | 1.41x ↓
[📄](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.12.6.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.12.6.svg) | 1.43x ↓
[📄](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.13.0rc2.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.13.0rc2.svg) | 1.43x ↓
[📄](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-base.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-base.svg)[🧠](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-base-mem.svg) | | [2024-11-19](results/bm-20241119-3.14.0a1%2B-d6b3e78) | python/d6b3e78504b3168c432b | d6b3e78 | 1.03x ↑
[📄](results/bm-20241119-3.14.0a1%2B-d6b3e78/bm-20241119-linux-x86_64-python-d6b3e78504b3168c432b-3.14.0a1%2B-d6b3e78-vs-3.12.6.md)[📈](results/bm-20241119-3.14.0a1%2B-d6b3e78/bm-20241119-linux-x86_64-python-d6b3e78504b3168c432b-3.14.0a1%2B-d6b3e78-vs-3.12.6.svg) | 1.01x ↑
[📄](results/bm-20241119-3.14.0a1%2B-d6b3e78/bm-20241119-linux-x86_64-python-d6b3e78504b3168c432b-3.14.0a1%2B-d6b3e78-vs-3.13.0rc2.md)[📈](results/bm-20241119-3.14.0a1%2B-d6b3e78/bm-20241119-linux-x86_64-python-d6b3e78504b3168c432b-3.14.0a1%2B-d6b3e78-vs-3.13.0rc2.svg) | | @@ -142,6 +144,8 @@ ## linux x86_64 (vultr) | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: | | --- | --- | --- | ---: | ---: | ---: | +| [2024-11-20](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL) | python/32428cf9ea03bce6d64c | 32428cf (NOGIL) | 1.54x ↓
[📄](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.svg) | 1.56x ↓
[📄](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.svg) | 1.53x ↓
[📄](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base.svg)[🧠](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base-mem.svg) | +| [2024-11-20](results/bm-20241120-3.14.0a2%2B-32428cf) | python/32428cf9ea03bce6d64c | 32428cf | 1.00x ↓
[📄](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.svg) | 1.02x ↓
[📄](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.svg) | | | [2024-11-19](results/bm-20241119-3.14.0a2%2B-c9b399f) | python/c9b399fbdb01584dcfff | c9b399f | 1.01x ↓
[📄](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.12.6.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.12.6.svg) | 1.02x ↓
[📄](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.13.0rc2.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.13.0rc2.svg) | | | [2024-11-19](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL) | python/c9b399fbdb01584dcfff | c9b399f (NOGIL) | 1.54x ↓
[📄](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.12.6.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.12.6.svg) | 1.56x ↓
[📄](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.13.0rc2.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.13.0rc2.svg) | 1.53x ↓
[📄](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-base.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-base.svg)[🧠](results/bm-20241119-3.14.0a2%2B-c9b399f-NOGIL/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-base-mem.svg) | | [2024-11-19](results/bm-20241119-3.14.0a1%2B-29cbcbd-NOGIL) | python/29cbcbd73bbfd8c953c0 | 29cbcbd (NOGIL) | 1.55x ↓
[📄](results/bm-20241119-3.14.0a1%2B-29cbcbd-NOGIL/bm-20241119-vultr-x86_64-python-29cbcbd73bbfd8c953c0-3.14.0a1%2B-29cbcbd-vs-3.12.6.md)[📈](results/bm-20241119-3.14.0a1%2B-29cbcbd-NOGIL/bm-20241119-vultr-x86_64-python-29cbcbd73bbfd8c953c0-3.14.0a1%2B-29cbcbd-vs-3.12.6.svg) | 1.58x ↓
[📄](results/bm-20241119-3.14.0a1%2B-29cbcbd-NOGIL/bm-20241119-vultr-x86_64-python-29cbcbd73bbfd8c953c0-3.14.0a1%2B-29cbcbd-vs-3.13.0rc2.md)[📈](results/bm-20241119-3.14.0a1%2B-29cbcbd-NOGIL/bm-20241119-vultr-x86_64-python-29cbcbd73bbfd8c953c0-3.14.0a1%2B-29cbcbd-vs-3.13.0rc2.svg) | | diff --git a/configs.json b/configs.json index ec9fa243..095387b9 100644 --- a/configs.json +++ b/configs.json @@ -76,5 +76,7 @@ "bm-20241119-3.14.0a1+-d6b3e78/bm-20241119-vultr-x86_64-python-d6b3e78504b3168c432b-3.14.0a1+-d6b3e78.json,bm-20241119-3.14.0a1+-d6b3e78-NOGIL/bm-20241119-vultr-x86_64-python-d6b3e78504b3168c432b-3.14.0a1+-d6b3e78.json": 0.6000000000000001, "bm-20241117-3.14.0a1+-9d6366b/bm-20241117-vultr-x86_64-python-9d6366b60d01305fc5e4-3.14.0a1+-9d6366b.json,bm-20241117-3.14.0a1+-9d6366b-NOGIL/bm-20241117-vultr-x86_64-python-9d6366b60d01305fc5e4-3.14.0a1+-9d6366b.json": 0.5900000000000001, "bm-20241119-3.14.0a2+-c9b399f/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2+-c9b399f.json,bm-20241119-3.14.0a2+-c9b399f-NOGIL/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2+-c9b399f.json": 0.6499999999999999, - "bm-20241119-3.14.0a2+-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2+-c9b399f.json,bm-20241119-3.14.0a2+-c9b399f-NOGIL/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2+-c9b399f.json": 0.6000000000000001 + "bm-20241119-3.14.0a2+-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2+-c9b399f.json,bm-20241119-3.14.0a2+-c9b399f-NOGIL/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2+-c9b399f.json": 0.6000000000000001, + "bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json,bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json": 0.6599999999999999, + "bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json,bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json": 0.6100000000000001 } \ No newline at end of file diff --git a/configs.svg b/configs.svg index dc1f3933..62a9e6d5 100644 --- a/configs.svg +++ b/configs.svg @@ -6,12 +6,12 @@ - + - - + + @@ -31,9 +31,9 @@ - - - + + + @@ -48,9 +48,9 @@ - - - + + + @@ -65,9 +65,9 @@ - - - + + + @@ -79,9 +79,9 @@ - - - + + + @@ -93,9 +93,9 @@ - - - + + + @@ -107,9 +107,9 @@ - - - + + + @@ -121,9 +121,9 @@ - - - + + + @@ -191,93 +191,95 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/longitudinal.json b/longitudinal.json index 81dcc341..56c35dc1 100644 --- a/longitudinal.json +++ b/longitudinal.json @@ -112,5 +112,7 @@ "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241119-3.14.0a1+-d6b3e78/bm-20241119-vultr-x86_64-python-d6b3e78504b3168c432b-3.14.0a1+-d6b3e78.json,3.13.0rc2": 1.0, "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241117-3.14.0a1+-9d6366b/bm-20241117-vultr-x86_64-python-9d6366b60d01305fc5e4-3.14.0a1+-9d6366b.json,3.13.0rc2": 1.0, "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20241119-3.14.0a2+-c9b399f/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2+-c9b399f.json,3.13.0rc2": 1.0, - "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241119-3.14.0a2+-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2+-c9b399f.json,3.13.0rc2": 1.0 + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241119-3.14.0a2+-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2+-c9b399f.json,3.13.0rc2": 1.0, + "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json,3.13.0rc2": 1.0, + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json,3.13.0rc2": 1.0 } \ No newline at end of file diff --git a/longitudinal.svg b/longitudinal.svg index 64f0700e..9d671415 100644 --- a/longitudinal.svg +++ b/longitudinal.svg @@ -386,9 +386,9 @@ - - - + + + @@ -400,9 +400,9 @@ - - - + + + @@ -414,9 +414,9 @@ - - - + + + @@ -428,9 +428,9 @@ - - - + + + @@ -442,9 +442,9 @@ - - - + + + @@ -456,9 +456,9 @@ - - - + + + @@ -470,9 +470,9 @@ - - - + + + @@ -484,9 +484,9 @@ - - - + + + @@ -580,97 +580,99 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/memory_configs.json b/memory_configs.json index adfb8157..a1af2112 100644 --- a/memory_configs.json +++ b/memory_configs.json @@ -76,5 +76,7 @@ "bm-20241119-3.14.0a1+-d6b3e78/bm-20241119-vultr-x86_64-python-d6b3e78504b3168c432b-3.14.0a1+-d6b3e78.json,bm-20241119-3.14.0a1+-d6b3e78-NOGIL/bm-20241119-vultr-x86_64-python-d6b3e78504b3168c432b-3.14.0a1+-d6b3e78.json": 1.23, "bm-20241117-3.14.0a1+-9d6366b/bm-20241117-vultr-x86_64-python-9d6366b60d01305fc5e4-3.14.0a1+-9d6366b.json,bm-20241117-3.14.0a1+-9d6366b-NOGIL/bm-20241117-vultr-x86_64-python-9d6366b60d01305fc5e4-3.14.0a1+-9d6366b.json": 1.21, "bm-20241119-3.14.0a2+-c9b399f/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2+-c9b399f.json,bm-20241119-3.14.0a2+-c9b399f-NOGIL/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2+-c9b399f.json": 1.18, - "bm-20241119-3.14.0a2+-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2+-c9b399f.json,bm-20241119-3.14.0a2+-c9b399f-NOGIL/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2+-c9b399f.json": 1.2 + "bm-20241119-3.14.0a2+-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2+-c9b399f.json,bm-20241119-3.14.0a2+-c9b399f-NOGIL/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2+-c9b399f.json": 1.2, + "bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json,bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json": 1.18, + "bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json,bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json": 1.21 } \ No newline at end of file diff --git a/memory_configs.svg b/memory_configs.svg index bd1e50d8..d8939cb8 100644 --- a/memory_configs.svg +++ b/memory_configs.svg @@ -6,12 +6,12 @@ - + - - + + @@ -31,9 +31,9 @@ - - - + + + @@ -48,9 +48,9 @@ - - - + + + @@ -65,9 +65,9 @@ - - - + + + @@ -79,9 +79,9 @@ - - - + + + @@ -93,9 +93,9 @@ - - - + + + @@ -107,9 +107,9 @@ - - - + + + @@ -121,9 +121,9 @@ - - - + + + @@ -226,93 +226,95 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/memory_long.json b/memory_long.json index 97bee7dc..fc8c6780 100644 --- a/memory_long.json +++ b/memory_long.json @@ -112,5 +112,7 @@ "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241119-3.14.0a1+-d6b3e78/bm-20241119-vultr-x86_64-python-d6b3e78504b3168c432b-3.14.0a1+-d6b3e78.json,3.13.0rc2": 0.99, "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241117-3.14.0a1+-9d6366b/bm-20241117-vultr-x86_64-python-9d6366b60d01305fc5e4-3.14.0a1+-9d6366b.json,3.13.0rc2": 1.0, "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20241119-3.14.0a2+-c9b399f/bm-20241119-linux-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2+-c9b399f.json,3.13.0rc2": 1.01, - "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241119-3.14.0a2+-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2+-c9b399f.json,3.13.0rc2": 1.0 + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241119-3.14.0a2+-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2+-c9b399f.json,3.13.0rc2": 1.0, + "bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json,bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json,3.13.0rc2": 1.01, + "bm-20240920-3.13.0rc2-4981ec5/bm-20240920-vultr-x86_64-python-4981ec59ded050919eb2-3.13.0rc2-4981ec5.json,bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json,3.13.0rc2": 1.01 } \ No newline at end of file diff --git a/memory_long.svg b/memory_long.svg index 2aba7e59..2e57d273 100644 --- a/memory_long.svg +++ b/memory_long.svg @@ -380,9 +380,9 @@ - - - + + + @@ -394,9 +394,9 @@ - - - + + + @@ -408,9 +408,9 @@ - - - + + + @@ -422,9 +422,9 @@ - - - + + + @@ -436,9 +436,9 @@ - - - + + + @@ -450,9 +450,9 @@ - - - + + + @@ -464,9 +464,9 @@ - - - + + + @@ -478,9 +478,9 @@ - - - + + + @@ -574,97 +574,99 @@ - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/README.md b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/README.md new file mode 100644 index 00000000..c822a696 --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/README.md @@ -0,0 +1,72 @@ +# Results + +- fork: python +- version: 3.14.0a2+ +- config: NOGIL +- commit hash: [32428cf](https://github.com/python/cpython/commit/32428cf) +- commit date: 2024-11-20T14:54:48-08:00 +- commit merge base: [0af4ec30bd2e3a52350344d1011c0c125d6dcd71](https://github.com/python/cpython/commit/0af4ec30bd2e3a52350344d1011c0c125d6dcd71) +- ref: 32428cf9ea03bce6d64c + +## linux x86_64 (linux) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/11944155772) +- cpu model: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz +- platform: Linux-5.15.0-1071-aws-x86_64-with-glibc2.31 +- [raw results](bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf.json) + +### vs. 3.12.6 + +- Geometric mean: 1.42x slower (HPT: reliability of 100.00%, 1.30x slower at 99th %ile) +- Memory usage: 1.20x +- missing benchmarks: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, mypy2, sqlalchemy_declarative, sqlalchemy_imperative, tornado_http +- [📄table](bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.md) +- [📈time plot](bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.44x slower (HPT: reliability of 100.00%, 1.33x slower at 99th %ile) +- Memory usage: 1.19x +- missing benchmarks: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, tornado_http +- [📄table](bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.md) +- [📈time plot](bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.svg) + +### vs. base + +- Geometric mean: 1.45x slower (HPT: reliability of 100.00%, 1.34x slower at 99th %ile) +- Memory usage: 1.18x +- [🧠memory plot](bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base-mem.svg) +- [📄table](bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base.md) +- [📈time plot](bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base.svg) + +## linux x86_64 (vultr) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/11944155772) +- cpu model: Intel(R) Xeon(R) E-2286G CPU @ 4.00GHz +- platform: Linux-6.8.0-45-generic-x86_64-with-glibc2.39 +- [raw results](bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf.json) + +### vs. 3.12.6 + +- Geometric mean: 1.54x slower (HPT: reliability of 100.00%, 1.38x slower at 99th %ile) +- Memory usage: 1.24x +- missing benchmarks: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, mypy2, sqlalchemy_declarative, sqlalchemy_imperative, tornado_http +- [📄table](bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.md) +- [📈time plot](bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.56x slower (HPT: reliability of 100.00%, 1.39x slower at 99th %ile) +- Memory usage: 1.22x +- missing benchmarks: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, tornado_http +- [📄table](bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.md) +- [📈time plot](bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.svg) + +### vs. base + +- Geometric mean: 1.53x slower (HPT: reliability of 100.00%, 1.39x slower at 99th %ile) +- Memory usage: 1.21x +- [🧠memory plot](bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base-mem.svg) +- [📄table](bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base.md) +- [📈time plot](bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base.svg) + diff --git a/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.md b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.md new file mode 100644 index 00000000..2f0f50aa --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.md @@ -0,0 +1,200 @@ +# Results vs. 3.12.6 + +- fork: python +- ref: 32428cf9ea03bce6d64c +- machine: linux-x86_64 +- commit hash: 32428cf +- commit date: 2024-11-20 +- overall geometric mean: 1.42x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.30x slower +- Memory change: 1.20x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 456 ms | 644 ms: 1.41x slower | +| docutils | 4.00 sec | 4.61 sec: 1.15x slower | +| html5lib | 88.9 ms | 140 ms: 1.57x slower | +| Geometric mean | (ref) | 1.37x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| asyncio_tcp | 923 ms | 1.03 sec: 1.11x slower | +| asyncio_tcp_ssl | 2.81 sec | 3.25 sec: 1.15x slower | +| async_generators | 589 ms | 704 ms: 1.19x slower | +| coroutines | 29.5 ms | 40.3 ms: 1.37x slower | +| Geometric mean | (ref) | 1.16x slower | + +Benchmark hidden because not significant (1): asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| float | 123 ms | 191 ms: 1.56x slower | +| nbody | 119 ms | 263 ms: 2.21x slower | +| Geometric mean | (ref) | 1.51x slower | + +Benchmark hidden because not significant (1): pidigits + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 5.13 ms | 4.56 ms: 1.12x faster | +| regex_dna | 278 ms | 303 ms: 1.09x slower | +| regex_v8 | 32.5 ms | 35.5 ms: 1.09x slower | +| regex_compile | 187 ms | 288 ms: 1.54x slower | +| Geometric mean | (ref) | 1.13x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| pickle_dict | 52.7 us | 43.7 us: 1.21x faster | +| xml_etree_parse | 241 ms | 219 ms: 1.10x faster | +| pickle | 16.4 us | 15.4 us: 1.06x faster | +| pickle_list | 6.97 us | 6.59 us: 1.06x faster | +| json_loads | 37.9 us | 39.4 us: 1.04x slower | +| unpickle_list | 6.83 us | 7.23 us: 1.06x slower | +| xml_etree_generate | 127 ms | 153 ms: 1.21x slower | +| json_dumps | 14.3 ms | 19.3 ms: 1.35x slower | +| tomli_loads | 2.88 sec | 4.04 sec: 1.40x slower | +| xml_etree_process | 83.7 ms | 126 ms: 1.51x slower | +| unpickle_pure_python | 300 us | 540 us: 1.80x slower | +| pickle_pure_python | 436 us | 809 us: 1.86x slower | +| Geometric mean | (ref) | 1.16x slower | + +Benchmark hidden because not significant (2): xml_etree_iterparse, unpickle + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 17.6 ms | 18.3 ms: 1.04x slower | +| python_startup | 23.7 ms | 27.5 ms: 1.16x slower | +| Geometric mean | (ref) | 1.10x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|-----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 67.6 ms | 115 ms: 1.69x slower | +| genshi_text | 30.2 ms | 54.6 ms: 1.81x slower | +| django_template | 44.9 ms | 82.9 ms: 1.84x slower | +| mako | 15.7 ms | 30.0 ms: 1.91x slower | +| Geometric mean | (ref) | 1.81x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|--------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| gc_traversal | 5.86 ms | 4.45 ms: 1.32x faster | +| pickle_dict | 52.7 us | 43.7 us: 1.21x faster | +| regex_effbot | 5.13 ms | 4.56 ms: 1.12x faster | +| xml_etree_parse | 241 ms | 219 ms: 1.10x faster | +| pickle | 16.4 us | 15.4 us: 1.06x faster | +| pickle_list | 6.97 us | 6.59 us: 1.06x faster | +| python_startup_no_site | 17.6 ms | 18.3 ms: 1.04x slower | +| json_loads | 37.9 us | 39.4 us: 1.04x slower | +| pathlib | 31.6 ms | 33.1 ms: 1.05x slower | +| unpickle_list | 6.83 us | 7.23 us: 1.06x slower | +| json | 6.85 ms | 7.28 ms: 1.06x slower | +| sqlite_synth | 3.87 us | 4.18 us: 1.08x slower | +| regex_dna | 278 ms | 303 ms: 1.09x slower | +| regex_v8 | 32.5 ms | 35.5 ms: 1.09x slower | +| create_gc_cycles | 1.94 ms | 2.13 ms: 1.10x slower | +| asyncio_tcp | 923 ms | 1.03 sec: 1.11x slower | +| docutils | 4.00 sec | 4.61 sec: 1.15x slower | +| scimark_fft | 500 ms | 577 ms: 1.15x slower | +| asyncio_tcp_ssl | 2.81 sec | 3.25 sec: 1.15x slower | +| python_startup | 23.7 ms | 27.5 ms: 1.16x slower | +| pycparser | 1.79 sec | 2.09 sec: 1.17x slower | +| mdp | 3.97 sec | 4.64 sec: 1.17x slower | +| async_generators | 589 ms | 704 ms: 1.19x slower | +| xml_etree_generate | 127 ms | 153 ms: 1.21x slower | +| pylint | 465 ms | 565 ms: 1.22x slower | +| deepcopy | 468 us | 570 us: 1.22x slower | +| meteor_contest | 146 ms | 182 ms: 1.24x slower | +| scimark_sparse_mat_mult | 6.70 ms | 8.52 ms: 1.27x slower | +| dulwich_log | 100 ms | 131 ms: 1.30x slower | +| deepcopy_memo | 52.4 us | 68.8 us: 1.31x slower | +| generators | 41.1 ms | 54.6 ms: 1.33x slower | +| bpe_tokeniser | 6.59 sec | 8.75 sec: 1.33x slower | +| nqueens | 117 ms | 155 ms: 1.33x slower | +| json_dumps | 14.3 ms | 19.3 ms: 1.35x slower | +| coroutines | 29.5 ms | 40.3 ms: 1.37x slower | +| crypto_pyaes | 107 ms | 147 ms: 1.37x slower | +| fannkuch | 540 ms | 742 ms: 1.37x slower | +| tomli_loads | 2.88 sec | 4.04 sec: 1.40x slower | +| telco | 9.59 ms | 13.5 ms: 1.41x slower | +| 2to3 | 456 ms | 644 ms: 1.41x slower | +| pyflate | 727 ms | 1.04 sec: 1.43x slower | +| deepcopy_reduce | 4.04 us | 5.77 us: 1.43x slower | +| spectral_norm | 156 ms | 225 ms: 1.44x slower | +| comprehensions | 27.1 us | 39.4 us: 1.45x slower | +| coverage | 95.4 ms | 141 ms: 1.48x slower | +| sqlglot_normalize | 157 ms | 236 ms: 1.50x slower | +| xml_etree_process | 83.7 ms | 126 ms: 1.51x slower | +| typing_runtime_protocols | 224 us | 339 us: 1.51x slower | +| sympy_integrate | 29.8 ms | 45.3 ms: 1.52x slower | +| logging_simple | 9.45 us | 14.4 us: 1.53x slower | +| regex_compile | 187 ms | 288 ms: 1.54x slower | +| thrift | 1.06 ms | 1.64 ms: 1.55x slower | +| float | 123 ms | 191 ms: 1.56x slower | +| html5lib | 88.9 ms | 140 ms: 1.57x slower | +| scimark_monte_carlo | 96.4 ms | 153 ms: 1.59x slower | +| sqlglot_optimize | 76.0 ms | 124 ms: 1.64x slower | +| pprint_pformat | 1.98 sec | 3.30 sec: 1.67x slower | +| pprint_safe_repr | 967 ms | 1.63 sec: 1.69x slower | +| genshi_xml | 67.6 ms | 115 ms: 1.69x slower | +| richards_super | 72.8 ms | 124 ms: 1.71x slower | +| sympy_str | 385 ms | 674 ms: 1.75x slower | +| logging_format | 9.59 us | 16.9 us: 1.77x slower | +| raytrace | 408 ms | 732 ms: 1.79x slower | +| sqlglot_transpile | 2.34 ms | 4.20 ms: 1.80x slower | +| unpickle_pure_python | 300 us | 540 us: 1.80x slower | +| genshi_text | 30.2 ms | 54.6 ms: 1.81x slower | +| richards | 60.3 ms | 110 ms: 1.82x slower | +| django_template | 44.9 ms | 82.9 ms: 1.84x slower | +| pickle_pure_python | 436 us | 809 us: 1.86x slower | +| logging_silent | 139 ns | 259 ns: 1.86x slower | +| chaos | 84.9 ms | 161 ms: 1.89x slower | +| mako | 15.7 ms | 30.0 ms: 1.91x slower | +| scimark_lu | 152 ms | 295 ms: 1.94x slower | +| hexiom | 8.27 ms | 16.2 ms: 1.96x slower | +| scimark_sor | 167 ms | 335 ms: 2.01x slower | +| sqlglot_parse | 1.79 ms | 3.61 ms: 2.02x slower | +| go | 172 ms | 356 ms: 2.06x slower | +| sympy_sum | 222 ms | 459 ms: 2.07x slower | +| sympy_expand | 582 ms | 1.23 sec: 2.12x slower | +| nbody | 119 ms | 263 ms: 2.21x slower | +| deltablue | 4.27 ms | 11.5 ms: 2.69x slower | +| bench_mp_pool | 20.7 ms | 59.2 ms: 2.86x slower | +| unpack_sequence | 60.2 ns | 201 ns: 3.34x slower | +| Geometric mean | (ref) | 1.42x slower | + +Benchmark hidden because not significant (5): xml_etree_iterparse, unpickle, asyncio_websockets, pidigits, bench_thread_pool +Ignored benchmarks (17) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, mypy2, sqlalchemy_declarative, sqlalchemy_imperative, tornado_http + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.36x +- 95% likely to have a slowdown of 1.33x +- 99% likely to have a slowdown of 1.30x + +# Memory +- memory change: 1.20x \ No newline at end of file diff --git a/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.svg b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.svg new file mode 100644 index 00000000..db8ecf9f --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.svg @@ -0,0 +1,3111 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.md b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.md new file mode 100644 index 00000000..359ff4e3 --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.md @@ -0,0 +1,201 @@ +# Results vs. 3.13.0rc2 + +- fork: python +- ref: 32428cf9ea03bce6d64c +- machine: linux-x86_64 +- commit hash: 32428cf +- commit date: 2024-11-20 +- overall geometric mean: 1.44x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.33x slower +- Memory change: 1.19x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 445 ms | 644 ms: 1.45x slower | +| docutils | 4.01 sec | 4.61 sec: 1.15x slower | +| html5lib | 92.6 ms | 140 ms: 1.51x slower | +| Geometric mean | (ref) | 1.36x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|--------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| asyncio_websockets | 766 ms | 740 ms: 1.04x faster | +| asyncio_tcp | 948 ms | 1.03 sec: 1.08x slower | +| asyncio_tcp_ssl | 2.77 sec | 3.25 sec: 1.17x slower | +| async_generators | 567 ms | 704 ms: 1.24x slower | +| coroutines | 30.9 ms | 40.3 ms: 1.31x slower | +| Geometric mean | (ref) | 1.15x slower | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| float | 116 ms | 191 ms: 1.65x slower | +| nbody | 119 ms | 263 ms: 2.21x slower | +| Geometric mean | (ref) | 1.54x slower | + +Benchmark hidden because not significant (1): pidigits + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_dna | 282 ms | 303 ms: 1.08x slower | +| regex_v8 | 32.8 ms | 35.5 ms: 1.08x slower | +| regex_compile | 182 ms | 288 ms: 1.58x slower | +| Geometric mean | (ref) | 1.15x slower | + +Benchmark hidden because not significant (1): regex_effbot + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_iterparse | 177 ms | 162 ms: 1.09x faster | +| pickle_dict | 47.2 us | 43.7 us: 1.08x faster | +| xml_etree_parse | 231 ms | 219 ms: 1.06x faster | +| pickle_list | 6.86 us | 6.59 us: 1.04x faster | +| unpickle_list | 6.68 us | 7.23 us: 1.08x slower | +| json_loads | 34.3 us | 39.4 us: 1.15x slower | +| xml_etree_generate | 122 ms | 153 ms: 1.25x slower | +| json_dumps | 14.1 ms | 19.3 ms: 1.37x slower | +| tomli_loads | 2.78 sec | 4.04 sec: 1.45x slower | +| xml_etree_process | 85.9 ms | 126 ms: 1.47x slower | +| unpickle_pure_python | 290 us | 540 us: 1.86x slower | +| pickle_pure_python | 416 us | 809 us: 1.94x slower | +| Geometric mean | (ref) | 1.20x slower | + +Benchmark hidden because not significant (2): unpickle, pickle + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 15.3 ms | 18.3 ms: 1.19x slower | +| python_startup | 22.4 ms | 27.5 ms: 1.23x slower | +| Geometric mean | (ref) | 1.21x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|-----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 72.1 ms | 115 ms: 1.59x slower | +| genshi_text | 31.7 ms | 54.6 ms: 1.73x slower | +| django_template | 44.3 ms | 82.9 ms: 1.87x slower | +| mako | 15.9 ms | 30.0 ms: 1.88x slower | +| Geometric mean | (ref) | 1.76x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|--------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| gc_traversal | 5.70 ms | 4.45 ms: 1.28x faster | +| create_gc_cycles | 2.41 ms | 2.13 ms: 1.13x faster | +| xml_etree_iterparse | 177 ms | 162 ms: 1.09x faster | +| pickle_dict | 47.2 us | 43.7 us: 1.08x faster | +| xml_etree_parse | 231 ms | 219 ms: 1.06x faster | +| pickle_list | 6.86 us | 6.59 us: 1.04x faster | +| asyncio_websockets | 766 ms | 740 ms: 1.04x faster | +| sqlite_synth | 3.99 us | 4.18 us: 1.05x slower | +| regex_dna | 282 ms | 303 ms: 1.08x slower | +| regex_v8 | 32.8 ms | 35.5 ms: 1.08x slower | +| unpickle_list | 6.68 us | 7.23 us: 1.08x slower | +| asyncio_tcp | 948 ms | 1.03 sec: 1.08x slower | +| pathlib | 29.9 ms | 33.1 ms: 1.11x slower | +| telco | 12.2 ms | 13.5 ms: 1.11x slower | +| json | 6.51 ms | 7.28 ms: 1.12x slower | +| deepcopy | 498 us | 570 us: 1.15x slower | +| docutils | 4.01 sec | 4.61 sec: 1.15x slower | +| json_loads | 34.3 us | 39.4 us: 1.15x slower | +| asyncio_tcp_ssl | 2.77 sec | 3.25 sec: 1.17x slower | +| python_startup_no_site | 15.3 ms | 18.3 ms: 1.19x slower | +| pylint | 470 ms | 565 ms: 1.20x slower | +| meteor_contest | 150 ms | 182 ms: 1.21x slower | +| scimark_fft | 473 ms | 577 ms: 1.22x slower | +| mdp | 3.80 sec | 4.64 sec: 1.22x slower | +| python_startup | 22.4 ms | 27.5 ms: 1.23x slower | +| async_generators | 567 ms | 704 ms: 1.24x slower | +| xml_etree_generate | 122 ms | 153 ms: 1.25x slower | +| scimark_sparse_mat_mult | 6.76 ms | 8.52 ms: 1.26x slower | +| bench_thread_pool | 2.89 ms | 3.67 ms: 1.27x slower | +| coroutines | 30.9 ms | 40.3 ms: 1.31x slower | +| coverage | 107 ms | 141 ms: 1.32x slower | +| pycparser | 1.57 sec | 2.09 sec: 1.33x slower | +| fannkuch | 547 ms | 742 ms: 1.36x slower | +| generators | 40.0 ms | 54.6 ms: 1.36x slower | +| json_dumps | 14.1 ms | 19.3 ms: 1.37x slower | +| deepcopy_memo | 50.1 us | 68.8 us: 1.37x slower | +| nqueens | 112 ms | 155 ms: 1.39x slower | +| dulwich_log | 93.7 ms | 131 ms: 1.39x slower | +| bpe_tokeniser | 6.28 sec | 8.75 sec: 1.39x slower | +| deepcopy_reduce | 4.10 us | 5.77 us: 1.41x slower | +| spectral_norm | 157 ms | 225 ms: 1.43x slower | +| 2to3 | 445 ms | 644 ms: 1.45x slower | +| tomli_loads | 2.78 sec | 4.04 sec: 1.45x slower | +| crypto_pyaes | 100 ms | 147 ms: 1.46x slower | +| xml_etree_process | 85.9 ms | 126 ms: 1.47x slower | +| thrift | 1.10 ms | 1.64 ms: 1.49x slower | +| sympy_integrate | 30.2 ms | 45.3 ms: 1.50x slower | +| typing_runtime_protocols | 226 us | 339 us: 1.50x slower | +| html5lib | 92.6 ms | 140 ms: 1.51x slower | +| pyflate | 664 ms | 1.04 sec: 1.56x slower | +| regex_compile | 182 ms | 288 ms: 1.58x slower | +| genshi_xml | 72.1 ms | 115 ms: 1.59x slower | +| float | 116 ms | 191 ms: 1.65x slower | +| pprint_safe_repr | 987 ms | 1.63 sec: 1.66x slower | +| sqlglot_optimize | 74.7 ms | 124 ms: 1.66x slower | +| richards | 65.5 ms | 110 ms: 1.68x slower | +| logging_simple | 8.56 us | 14.4 us: 1.69x slower | +| scimark_monte_carlo | 90.6 ms | 153 ms: 1.69x slower | +| sqlglot_normalize | 140 ms | 236 ms: 1.69x slower | +| pprint_pformat | 1.94 sec | 3.30 sec: 1.70x slower | +| richards_super | 73.2 ms | 124 ms: 1.70x slower | +| genshi_text | 31.7 ms | 54.6 ms: 1.73x slower | +| comprehensions | 22.2 us | 39.4 us: 1.77x slower | +| sympy_str | 379 ms | 674 ms: 1.78x slower | +| logging_format | 9.24 us | 16.9 us: 1.83x slower | +| go | 191 ms | 356 ms: 1.86x slower | +| unpickle_pure_python | 290 us | 540 us: 1.86x slower | +| django_template | 44.3 ms | 82.9 ms: 1.87x slower | +| scimark_sor | 179 ms | 335 ms: 1.88x slower | +| mako | 15.9 ms | 30.0 ms: 1.88x slower | +| sqlglot_transpile | 2.20 ms | 4.20 ms: 1.91x slower | +| chaos | 83.6 ms | 161 ms: 1.92x slower | +| pickle_pure_python | 416 us | 809 us: 1.94x slower | +| logging_silent | 130 ns | 259 ns: 1.99x slower | +| hexiom | 8.11 ms | 16.2 ms: 2.00x slower | +| scimark_lu | 146 ms | 295 ms: 2.02x slower | +| sympy_expand | 601 ms | 1.23 sec: 2.05x slower | +| sqlglot_parse | 1.76 ms | 3.61 ms: 2.06x slower | +| raytrace | 344 ms | 732 ms: 2.12x slower | +| sympy_sum | 210 ms | 459 ms: 2.19x slower | +| nbody | 119 ms | 263 ms: 2.21x slower | +| deltablue | 4.44 ms | 11.5 ms: 2.58x slower | +| unpack_sequence | 74.3 ns | 201 ns: 2.70x slower | +| bench_mp_pool | 18.7 ms | 59.2 ms: 3.17x slower | +| Geometric mean | (ref) | 1.44x slower | + +Benchmark hidden because not significant (4): regex_effbot, pidigits, unpickle, pickle +Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, tornado_http + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.38x +- 95% likely to have a slowdown of 1.36x +- 99% likely to have a slowdown of 1.33x + +# Memory +- memory change: 1.19x \ No newline at end of file diff --git a/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.svg b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.svg new file mode 100644 index 00000000..5eeb509b --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.svg @@ -0,0 +1,3109 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-base-mem.svg b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-base-mem.svg new file mode 100644 index 00000000..a167bd43 --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-base-mem.svg @@ -0,0 +1,3081 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-base.md b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-base.md new file mode 100644 index 00000000..2abf64d9 --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-base.md @@ -0,0 +1,199 @@ +# Results vs. base + +- fork: python +- ref: 32428cf9ea03bce6d64c +- machine: linux-x86_64 +- commit hash: 32428cf +- commit date: 2024-11-20 +- overall geometric mean: 1.45x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.34x slower +- Memory change: 1.18x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| 2to3 | 430 ms | 644 ms: 1.50x slower | +| docutils | 3.72 sec | 4.61 sec: 1.24x slower | +| html5lib | 90.8 ms | 140 ms: 1.54x slower | +| Geometric mean | (ref) | 1.42x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | +|------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| asyncio_tcp | 899 ms | 1.03 sec: 1.14x slower | +| asyncio_tcp_ssl | 2.73 sec | 3.25 sec: 1.19x slower | +| async_generators | 574 ms | 704 ms: 1.23x slower | +| coroutines | 31.6 ms | 40.3 ms: 1.27x slower | +| Geometric mean | (ref) | 1.17x slower | + +Benchmark hidden because not significant (1): asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| float | 113 ms | 191 ms: 1.69x slower | +| nbody | 130 ms | 263 ms: 2.02x slower | +| Geometric mean | (ref) | 1.51x slower | + +Benchmark hidden because not significant (1): pidigits + +Benchmarks with tag 'regex': +============================ + +| Benchmark | results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| regex_v8 | 34.0 ms | 35.5 ms: 1.04x slower | +| regex_dna | 287 ms | 303 ms: 1.06x slower | +| regex_compile | 180 ms | 288 ms: 1.60x slower | +| Geometric mean | (ref) | 1.16x slower | + +Benchmark hidden because not significant (1): regex_effbot + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | +|----------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| pickle | 17.5 us | 15.4 us: 1.14x faster | +| pickle_list | 7.07 us | 6.59 us: 1.07x faster | +| pickle_dict | 45.6 us | 43.7 us: 1.05x faster | +| unpickle_list | 7.05 us | 7.23 us: 1.03x slower | +| unpickle | 19.0 us | 20.8 us: 1.10x slower | +| json_loads | 34.8 us | 39.4 us: 1.13x slower | +| json_dumps | 15.3 ms | 19.3 ms: 1.26x slower | +| xml_etree_generate | 118 ms | 153 ms: 1.30x slower | +| tomli_loads | 2.70 sec | 4.04 sec: 1.50x slower | +| xml_etree_process | 82.9 ms | 126 ms: 1.52x slower | +| pickle_pure_python | 428 us | 809 us: 1.89x slower | +| unpickle_pure_python | 284 us | 540 us: 1.90x slower | +| Geometric mean | (ref) | 1.21x slower | + +Benchmark hidden because not significant (2): xml_etree_iterparse, xml_etree_parse + +Benchmarks with tag 'startup': +============================== + +| Benchmark | results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | +|------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| python_startup_no_site | 13.4 ms | 18.3 ms: 1.36x slower | +| python_startup | 19.7 ms | 27.5 ms: 1.39x slower | +| Geometric mean | (ref) | 1.38x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | +|-----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| genshi_text | 31.1 ms | 54.6 ms: 1.76x slower | +| mako | 17.0 ms | 30.0 ms: 1.77x slower | +| genshi_xml | 64.8 ms | 115 ms: 1.77x slower | +| django_template | 45.2 ms | 82.9 ms: 1.83x slower | +| Geometric mean | (ref) | 1.78x slower | + +All benchmarks: +=============== + +| Benchmark | results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | +|--------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| gc_traversal | 5.28 ms | 4.45 ms: 1.18x faster | +| bench_mp_pool | 69.4 ms | 59.2 ms: 1.17x faster | +| pickle | 17.5 us | 15.4 us: 1.14x faster | +| create_gc_cycles | 2.32 ms | 2.13 ms: 1.09x faster | +| pickle_list | 7.07 us | 6.59 us: 1.07x faster | +| pickle_dict | 45.6 us | 43.7 us: 1.05x faster | +| unpickle_list | 7.05 us | 7.23 us: 1.03x slower | +| regex_v8 | 34.0 ms | 35.5 ms: 1.04x slower | +| regex_dna | 287 ms | 303 ms: 1.06x slower | +| unpickle | 19.0 us | 20.8 us: 1.10x slower | +| json_loads | 34.8 us | 39.4 us: 1.13x slower | +| sqlite_synth | 3.69 us | 4.18 us: 1.14x slower | +| asyncio_tcp | 899 ms | 1.03 sec: 1.14x slower | +| pathlib | 28.6 ms | 33.1 ms: 1.15x slower | +| asyncio_tcp_ssl | 2.73 sec | 3.25 sec: 1.19x slower | +| scimark_fft | 479 ms | 577 ms: 1.20x slower | +| async_generators | 574 ms | 704 ms: 1.23x slower | +| docutils | 3.72 sec | 4.61 sec: 1.24x slower | +| bench_thread_pool | 2.91 ms | 3.67 ms: 1.26x slower | +| json_dumps | 15.3 ms | 19.3 ms: 1.26x slower | +| telco | 10.6 ms | 13.5 ms: 1.27x slower | +| coverage | 111 ms | 141 ms: 1.27x slower | +| coroutines | 31.6 ms | 40.3 ms: 1.27x slower | +| mdp | 3.57 sec | 4.64 sec: 1.30x slower | +| meteor_contest | 139 ms | 182 ms: 1.30x slower | +| scimark_sparse_mat_mult | 6.54 ms | 8.52 ms: 1.30x slower | +| xml_etree_generate | 118 ms | 153 ms: 1.30x slower | +| dulwich_log | 97.8 ms | 131 ms: 1.34x slower | +| python_startup_no_site | 13.4 ms | 18.3 ms: 1.36x slower | +| pycparser | 1.53 sec | 2.09 sec: 1.36x slower | +| generators | 39.7 ms | 54.6 ms: 1.37x slower | +| python_startup | 19.7 ms | 27.5 ms: 1.39x slower | +| nqueens | 109 ms | 155 ms: 1.42x slower | +| spectral_norm | 155 ms | 225 ms: 1.45x slower | +| fannkuch | 512 ms | 742 ms: 1.45x slower | +| bpe_tokeniser | 5.92 sec | 8.75 sec: 1.48x slower | +| typing_runtime_protocols | 229 us | 339 us: 1.48x slower | +| 2to3 | 430 ms | 644 ms: 1.50x slower | +| tomli_loads | 2.70 sec | 4.04 sec: 1.50x slower | +| xml_etree_process | 82.9 ms | 126 ms: 1.52x slower | +| crypto_pyaes | 96.2 ms | 147 ms: 1.52x slower | +| html5lib | 90.8 ms | 140 ms: 1.54x slower | +| pyflate | 671 ms | 1.04 sec: 1.55x slower | +| thrift | 1.05 ms | 1.64 ms: 1.56x slower | +| pylint | 358 ms | 565 ms: 1.58x slower | +| deepcopy_reduce | 3.63 us | 5.77 us: 1.59x slower | +| regex_compile | 180 ms | 288 ms: 1.60x slower | +| sqlglot_normalize | 145 ms | 236 ms: 1.63x slower | +| sqlglot_optimize | 76.4 ms | 124 ms: 1.63x slower | +| logging_simple | 8.86 us | 14.4 us: 1.63x slower | +| deepcopy | 347 us | 570 us: 1.64x slower | +| deepcopy_memo | 41.5 us | 68.8 us: 1.66x slower | +| sympy_integrate | 27.3 ms | 45.3 ms: 1.66x slower | +| richards | 65.5 ms | 110 ms: 1.68x slower | +| float | 113 ms | 191 ms: 1.69x slower | +| scimark_monte_carlo | 89.8 ms | 153 ms: 1.71x slower | +| comprehensions | 22.9 us | 39.4 us: 1.72x slower | +| pprint_safe_repr | 946 ms | 1.63 sec: 1.73x slower | +| logging_silent | 148 ns | 259 ns: 1.75x slower | +| genshi_text | 31.1 ms | 54.6 ms: 1.76x slower | +| pprint_pformat | 1.88 sec | 3.30 sec: 1.76x slower | +| richards_super | 70.4 ms | 124 ms: 1.77x slower | +| mako | 17.0 ms | 30.0 ms: 1.77x slower | +| genshi_xml | 64.8 ms | 115 ms: 1.77x slower | +| django_template | 45.2 ms | 82.9 ms: 1.83x slower | +| chaos | 87.4 ms | 161 ms: 1.84x slower | +| logging_format | 9.18 us | 16.9 us: 1.84x slower | +| sympy_str | 365 ms | 674 ms: 1.85x slower | +| sqlglot_transpile | 2.24 ms | 4.20 ms: 1.88x slower | +| pickle_pure_python | 428 us | 809 us: 1.89x slower | +| scimark_lu | 156 ms | 295 ms: 1.89x slower | +| hexiom | 8.54 ms | 16.2 ms: 1.90x slower | +| unpickle_pure_python | 284 us | 540 us: 1.90x slower | +| scimark_sor | 173 ms | 335 ms: 1.94x slower | +| raytrace | 364 ms | 732 ms: 2.01x slower | +| nbody | 130 ms | 263 ms: 2.02x slower | +| sqlglot_parse | 1.78 ms | 3.61 ms: 2.03x slower | +| sympy_expand | 594 ms | 1.23 sec: 2.07x slower | +| go | 157 ms | 356 ms: 2.27x slower | +| sympy_sum | 202 ms | 459 ms: 2.28x slower | +| deltablue | 4.52 ms | 11.5 ms: 2.54x slower | +| unpack_sequence | 59.4 ns | 201 ns: 3.38x slower | +| Geometric mean | (ref) | 1.45x slower | + +Benchmark hidden because not significant (6): pidigits, xml_etree_iterparse, asyncio_websockets, regex_effbot, xml_etree_parse, json + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.40x +- 95% likely to have a slowdown of 1.38x +- 99% likely to have a slowdown of 1.34x + +# Memory +- memory change: 1.18x \ No newline at end of file diff --git a/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-base.svg b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-base.svg new file mode 100644 index 00000000..77fa907e --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-base.svg @@ -0,0 +1,3120 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.md b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.md new file mode 100644 index 00000000..bb694378 --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.md @@ -0,0 +1,201 @@ +# Results vs. 3.12.6 + +- fork: python +- ref: 32428cf9ea03bce6d64c +- machine: linux-x86_64 +- commit hash: 32428cf +- commit date: 2024-11-20 +- overall geometric mean: 1.54x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.38x slower +- Memory change: 1.24x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 264 ms | 414 ms: 1.57x slower | +| docutils | 2.64 sec | 3.35 sec: 1.27x slower | +| html5lib | 63.6 ms | 106 ms: 1.66x slower | +| Geometric mean | (ref) | 1.49x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|--------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| asyncio_websockets | 517 ms | 520 ms: 1.01x slower | +| asyncio_tcp | 519 ms | 584 ms: 1.13x slower | +| asyncio_tcp_ssl | 1.51 sec | 1.84 sec: 1.22x slower | +| async_generators | 384 ms | 485 ms: 1.26x slower | +| coroutines | 23.9 ms | 30.4 ms: 1.27x slower | +| Geometric mean | (ref) | 1.17x slower | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 184 ms | 187 ms: 1.02x slower | +| float | 80.8 ms | 150 ms: 1.86x slower | +| nbody | 89.3 ms | 195 ms: 2.19x slower | +| Geometric mean | (ref) | 1.60x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 3.17 ms | 2.88 ms: 1.10x faster | +| regex_dna | 168 ms | 193 ms: 1.15x slower | +| regex_v8 | 20.6 ms | 25.5 ms: 1.24x slower | +| regex_compile | 142 ms | 230 ms: 1.62x slower | +| Geometric mean | (ref) | 1.20x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_parse | 139 ms | 133 ms: 1.04x faster | +| pickle_dict | 31.8 us | 31.9 us: 1.00x slower | +| unpickle | 14.1 us | 14.4 us: 1.03x slower | +| unpickle_list | 4.67 us | 5.02 us: 1.07x slower | +| json_loads | 26.5 us | 28.7 us: 1.08x slower | +| pickle_list | 4.77 us | 5.15 us: 1.08x slower | +| xml_etree_iterparse | 96.7 ms | 109 ms: 1.13x slower | +| pickle | 10.9 us | 12.7 us: 1.16x slower | +| xml_etree_generate | 85.2 ms | 114 ms: 1.33x slower | +| json_dumps | 10.4 ms | 15.0 ms: 1.45x slower | +| tomli_loads | 2.11 sec | 3.20 sec: 1.52x slower | +| xml_etree_process | 59.0 ms | 93.4 ms: 1.58x slower | +| unpickle_pure_python | 221 us | 421 us: 1.91x slower | +| pickle_pure_python | 308 us | 616 us: 2.00x slower | +| Geometric mean | (ref) | 1.27x slower | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 7.16 ms | 10.3 ms: 1.44x slower | +| python_startup | 9.93 ms | 15.8 ms: 1.59x slower | +| Geometric mean | (ref) | 1.51x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|-----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 50.2 ms | 82.6 ms: 1.65x slower | +| genshi_text | 22.8 ms | 40.6 ms: 1.78x slower | +| django_template | 34.7 ms | 64.6 ms: 1.86x slower | +| mako | 11.0 ms | 20.7 ms: 1.88x slower | +| Geometric mean | (ref) | 1.79x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|--------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| gc_traversal | 3.46 ms | 2.68 ms: 1.29x faster | +| regex_effbot | 3.17 ms | 2.88 ms: 1.10x faster | +| xml_etree_parse | 139 ms | 133 ms: 1.04x faster | +| pickle_dict | 31.8 us | 31.9 us: 1.00x slower | +| asyncio_websockets | 517 ms | 520 ms: 1.01x slower | +| pidigits | 184 ms | 187 ms: 1.02x slower | +| unpickle | 14.1 us | 14.4 us: 1.03x slower | +| pathlib | 21.5 ms | 22.1 ms: 1.03x slower | +| json | 5.02 ms | 5.22 ms: 1.04x slower | +| unpickle_list | 4.67 us | 5.02 us: 1.07x slower | +| json_loads | 26.5 us | 28.7 us: 1.08x slower | +| pickle_list | 4.77 us | 5.15 us: 1.08x slower | +| create_gc_cycles | 1.09 ms | 1.19 ms: 1.09x slower | +| sqlite_synth | 2.20 us | 2.44 us: 1.11x slower | +| asyncio_tcp | 519 ms | 584 ms: 1.13x slower | +| xml_etree_iterparse | 96.7 ms | 109 ms: 1.13x slower | +| regex_dna | 168 ms | 193 ms: 1.15x slower | +| pickle | 10.9 us | 12.7 us: 1.16x slower | +| scimark_fft | 342 ms | 415 ms: 1.21x slower | +| asyncio_tcp_ssl | 1.51 sec | 1.84 sec: 1.22x slower | +| deepcopy | 352 us | 431 us: 1.23x slower | +| regex_v8 | 20.6 ms | 25.5 ms: 1.24x slower | +| async_generators | 384 ms | 485 ms: 1.26x slower | +| generators | 32.2 ms | 40.8 ms: 1.27x slower | +| docutils | 2.64 sec | 3.35 sec: 1.27x slower | +| coroutines | 23.9 ms | 30.4 ms: 1.27x slower | +| bpe_tokeniser | 4.74 sec | 6.16 sec: 1.30x slower | +| mdp | 2.42 sec | 3.16 sec: 1.31x slower | +| dulwich_log | 78.9 ms | 104 ms: 1.32x slower | +| deepcopy_memo | 40.3 us | 53.0 us: 1.32x slower | +| pylint | 319 ms | 421 ms: 1.32x slower | +| scimark_sparse_mat_mult | 4.39 ms | 5.81 ms: 1.32x slower | +| xml_etree_generate | 85.2 ms | 114 ms: 1.33x slower | +| meteor_contest | 104 ms | 139 ms: 1.35x slower | +| crypto_pyaes | 76.6 ms | 108 ms: 1.41x slower | +| coverage | 71.4 ms | 102 ms: 1.43x slower | +| telco | 6.53 ms | 9.37 ms: 1.44x slower | +| python_startup_no_site | 7.16 ms | 10.3 ms: 1.44x slower | +| nqueens | 80.1 ms | 116 ms: 1.45x slower | +| json_dumps | 10.4 ms | 15.0 ms: 1.45x slower | +| deepcopy_reduce | 3.08 us | 4.50 us: 1.46x slower | +| pycparser | 1.17 sec | 1.71 sec: 1.46x slower | +| spectral_norm | 110 ms | 163 ms: 1.48x slower | +| tomli_loads | 2.11 sec | 3.20 sec: 1.52x slower | +| fannkuch | 372 ms | 573 ms: 1.54x slower | +| typing_runtime_protocols | 163 us | 252 us: 1.54x slower | +| comprehensions | 19.8 us | 30.6 us: 1.54x slower | +| 2to3 | 264 ms | 414 ms: 1.57x slower | +| xml_etree_process | 59.0 ms | 93.4 ms: 1.58x slower | +| python_startup | 9.93 ms | 15.8 ms: 1.59x slower | +| sympy_integrate | 20.5 ms | 33.1 ms: 1.61x slower | +| regex_compile | 142 ms | 230 ms: 1.62x slower | +| thrift | 791 us | 1.29 ms: 1.63x slower | +| genshi_xml | 50.2 ms | 82.6 ms: 1.65x slower | +| html5lib | 63.6 ms | 106 ms: 1.66x slower | +| sqlglot_optimize | 53.3 ms | 90.5 ms: 1.70x slower | +| sqlglot_normalize | 107 ms | 183 ms: 1.72x slower | +| pyflate | 448 ms | 772 ms: 1.72x slower | +| genshi_text | 22.8 ms | 40.6 ms: 1.78x slower | +| pprint_safe_repr | 743 ms | 1.32 sec: 1.78x slower | +| pprint_pformat | 1.52 sec | 2.74 sec: 1.80x slower | +| logging_format | 7.35 us | 13.4 us: 1.82x slower | +| logging_simple | 6.63 us | 12.1 us: 1.83x slower | +| scimark_monte_carlo | 68.4 ms | 126 ms: 1.84x slower | +| sympy_str | 292 ms | 540 ms: 1.85x slower | +| float | 80.8 ms | 150 ms: 1.86x slower | +| django_template | 34.7 ms | 64.6 ms: 1.86x slower | +| mako | 11.0 ms | 20.7 ms: 1.88x slower | +| unpickle_pure_python | 221 us | 421 us: 1.91x slower | +| chaos | 62.8 ms | 122 ms: 1.94x slower | +| logging_silent | 109 ns | 212 ns: 1.95x slower | +| richards | 45.9 ms | 89.7 ms: 1.95x slower | +| sqlglot_transpile | 1.67 ms | 3.33 ms: 1.99x slower | +| hexiom | 6.17 ms | 12.3 ms: 2.00x slower | +| pickle_pure_python | 308 us | 616 us: 2.00x slower | +| scimark_sor | 130 ms | 269 ms: 2.08x slower | +| richards_super | 51.9 ms | 108 ms: 2.09x slower | +| raytrace | 299 ms | 632 ms: 2.11x slower | +| sqlglot_parse | 1.36 ms | 2.86 ms: 2.11x slower | +| scimark_lu | 114 ms | 245 ms: 2.14x slower | +| go | 139 ms | 298 ms: 2.14x slower | +| nbody | 89.3 ms | 195 ms: 2.19x slower | +| sympy_expand | 468 ms | 1.06 sec: 2.26x slower | +| sympy_sum | 166 ms | 381 ms: 2.30x slower | +| unpack_sequence | 52.1 ns | 136 ns: 2.61x slower | +| deltablue | 3.45 ms | 9.13 ms: 2.65x slower | +| bench_thread_pool | 941 us | 3.49 ms: 3.71x slower | +| bench_mp_pool | 10.8 ms | 70.2 ms: 6.50x slower | +| Geometric mean | (ref) | 1.54x slower | +Ignored benchmarks (17) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, mypy2, sqlalchemy_declarative, sqlalchemy_imperative, tornado_http + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.45x +- 95% likely to have a slowdown of 1.43x +- 99% likely to have a slowdown of 1.38x + +# Memory +- memory change: 1.24x \ No newline at end of file diff --git a/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.svg b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.svg new file mode 100644 index 00000000..4646c21c --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.svg @@ -0,0 +1,3031 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.md b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.md new file mode 100644 index 00000000..bc2cc61a --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.md @@ -0,0 +1,203 @@ +# Results vs. 3.13.0rc2 + +- fork: python +- ref: 32428cf9ea03bce6d64c +- machine: linux-x86_64 +- commit hash: 32428cf +- commit date: 2024-11-20 +- overall geometric mean: 1.56x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.39x slower +- Memory change: 1.22x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 260 ms | 414 ms: 1.59x slower | +| docutils | 2.62 sec | 3.35 sec: 1.28x slower | +| html5lib | 67.0 ms | 106 ms: 1.58x slower | +| Geometric mean | (ref) | 1.48x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| asyncio_tcp | 505 ms | 584 ms: 1.16x slower | +| asyncio_tcp_ssl | 1.51 sec | 1.84 sec: 1.22x slower | +| async_generators | 377 ms | 485 ms: 1.28x slower | +| coroutines | 23.6 ms | 30.4 ms: 1.29x slower | +| Geometric mean | (ref) | 1.19x slower | + +Benchmark hidden because not significant (1): asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 217 ms | 187 ms: 1.16x faster | +| float | 77.5 ms | 150 ms: 1.94x slower | +| nbody | 85.1 ms | 195 ms: 2.29x slower | +| Geometric mean | (ref) | 1.57x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 3.08 ms | 2.88 ms: 1.07x faster | +| regex_dna | 180 ms | 193 ms: 1.07x slower | +| regex_v8 | 22.7 ms | 25.5 ms: 1.13x slower | +| regex_compile | 132 ms | 230 ms: 1.74x slower | +| Geometric mean | (ref) | 1.18x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_parse | 136 ms | 133 ms: 1.02x faster | +| pickle_dict | 32.5 us | 31.9 us: 1.02x faster | +| pickle_list | 4.93 us | 5.15 us: 1.05x slower | +| json_loads | 27.0 us | 28.7 us: 1.06x slower | +| unpickle_list | 4.71 us | 5.02 us: 1.07x slower | +| pickle | 11.3 us | 12.7 us: 1.12x slower | +| xml_etree_iterparse | 94.9 ms | 109 ms: 1.15x slower | +| xml_etree_generate | 85.4 ms | 114 ms: 1.33x slower | +| json_dumps | 10.5 ms | 15.0 ms: 1.43x slower | +| xml_etree_process | 59.3 ms | 93.4 ms: 1.57x slower | +| tomli_loads | 2.01 sec | 3.20 sec: 1.60x slower | +| unpickle_pure_python | 210 us | 421 us: 2.00x slower | +| pickle_pure_python | 294 us | 616 us: 2.09x slower | +| Geometric mean | (ref) | 1.27x slower | + +Benchmark hidden because not significant (1): unpickle + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 7.39 ms | 10.3 ms: 1.39x slower | +| python_startup | 11.0 ms | 15.8 ms: 1.43x slower | +| Geometric mean | (ref) | 1.41x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|-----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 48.8 ms | 82.6 ms: 1.69x slower | +| mako | 11.3 ms | 20.7 ms: 1.83x slower | +| genshi_text | 21.5 ms | 40.6 ms: 1.89x slower | +| django_template | 34.1 ms | 64.6 ms: 1.89x slower | +| Geometric mean | (ref) | 1.82x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|--------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| gc_traversal | 3.14 ms | 2.68 ms: 1.17x faster | +| pidigits | 217 ms | 187 ms: 1.16x faster | +| create_gc_cycles | 1.34 ms | 1.19 ms: 1.12x faster | +| regex_effbot | 3.08 ms | 2.88 ms: 1.07x faster | +| xml_etree_parse | 136 ms | 133 ms: 1.02x faster | +| pickle_dict | 32.5 us | 31.9 us: 1.02x faster | +| pickle_list | 4.93 us | 5.15 us: 1.05x slower | +| json | 4.93 ms | 5.22 ms: 1.06x slower | +| json_loads | 27.0 us | 28.7 us: 1.06x slower | +| unpickle_list | 4.71 us | 5.02 us: 1.07x slower | +| regex_dna | 180 ms | 193 ms: 1.07x slower | +| sqlite_synth | 2.21 us | 2.44 us: 1.10x slower | +| pickle | 11.3 us | 12.7 us: 1.12x slower | +| regex_v8 | 22.7 ms | 25.5 ms: 1.13x slower | +| xml_etree_iterparse | 94.9 ms | 109 ms: 1.15x slower | +| pathlib | 19.2 ms | 22.1 ms: 1.15x slower | +| asyncio_tcp | 505 ms | 584 ms: 1.16x slower | +| scimark_fft | 349 ms | 415 ms: 1.19x slower | +| telco | 7.82 ms | 9.37 ms: 1.20x slower | +| deepcopy | 355 us | 431 us: 1.21x slower | +| asyncio_tcp_ssl | 1.51 sec | 1.84 sec: 1.22x slower | +| coverage | 83.0 ms | 102 ms: 1.23x slower | +| scimark_sparse_mat_mult | 4.71 ms | 5.81 ms: 1.24x slower | +| docutils | 2.62 sec | 3.35 sec: 1.28x slower | +| async_generators | 377 ms | 485 ms: 1.28x slower | +| coroutines | 23.6 ms | 30.4 ms: 1.29x slower | +| pylint | 317 ms | 421 ms: 1.33x slower | +| xml_etree_generate | 85.4 ms | 114 ms: 1.33x slower | +| mdp | 2.36 sec | 3.16 sec: 1.34x slower | +| deepcopy_memo | 39.1 us | 53.0 us: 1.36x slower | +| meteor_contest | 102 ms | 139 ms: 1.37x slower | +| bpe_tokeniser | 4.45 sec | 6.16 sec: 1.39x slower | +| dulwich_log | 74.8 ms | 104 ms: 1.39x slower | +| python_startup_no_site | 7.39 ms | 10.3 ms: 1.39x slower | +| generators | 28.8 ms | 40.8 ms: 1.42x slower | +| json_dumps | 10.5 ms | 15.0 ms: 1.43x slower | +| python_startup | 11.0 ms | 15.8 ms: 1.43x slower | +| deepcopy_reduce | 3.11 us | 4.50 us: 1.44x slower | +| spectral_norm | 111 ms | 163 ms: 1.46x slower | +| nqueens | 78.6 ms | 116 ms: 1.48x slower | +| pycparser | 1.12 sec | 1.71 sec: 1.53x slower | +| fannkuch | 370 ms | 573 ms: 1.55x slower | +| xml_etree_process | 59.3 ms | 93.4 ms: 1.57x slower | +| html5lib | 67.0 ms | 106 ms: 1.58x slower | +| crypto_pyaes | 67.9 ms | 108 ms: 1.59x slower | +| 2to3 | 260 ms | 414 ms: 1.59x slower | +| tomli_loads | 2.01 sec | 3.20 sec: 1.60x slower | +| typing_runtime_protocols | 155 us | 252 us: 1.63x slower | +| thrift | 778 us | 1.29 ms: 1.66x slower | +| sympy_integrate | 19.8 ms | 33.1 ms: 1.67x slower | +| genshi_xml | 48.8 ms | 82.6 ms: 1.69x slower | +| sqlglot_optimize | 52.7 ms | 90.5 ms: 1.72x slower | +| pyflate | 449 ms | 772 ms: 1.72x slower | +| sqlglot_normalize | 106 ms | 183 ms: 1.74x slower | +| regex_compile | 132 ms | 230 ms: 1.74x slower | +| pprint_safe_repr | 738 ms | 1.32 sec: 1.79x slower | +| mako | 11.3 ms | 20.7 ms: 1.83x slower | +| pprint_pformat | 1.50 sec | 2.74 sec: 1.83x slower | +| comprehensions | 16.5 us | 30.6 us: 1.86x slower | +| genshi_text | 21.5 ms | 40.6 ms: 1.89x slower | +| django_template | 34.1 ms | 64.6 ms: 1.89x slower | +| scimark_monte_carlo | 65.4 ms | 126 ms: 1.93x slower | +| float | 77.5 ms | 150 ms: 1.94x slower | +| logging_format | 6.84 us | 13.4 us: 1.96x slower | +| sympy_str | 275 ms | 540 ms: 1.97x slower | +| logging_simple | 6.16 us | 12.1 us: 1.97x slower | +| richards | 45.2 ms | 89.7 ms: 1.98x slower | +| scimark_sor | 134 ms | 269 ms: 2.00x slower | +| unpickle_pure_python | 210 us | 421 us: 2.00x slower | +| hexiom | 5.99 ms | 12.3 ms: 2.06x slower | +| logging_silent | 103 ns | 212 ns: 2.07x slower | +| pickle_pure_python | 294 us | 616 us: 2.09x slower | +| richards_super | 51.6 ms | 108 ms: 2.10x slower | +| go | 141 ms | 298 ms: 2.12x slower | +| chaos | 57.3 ms | 122 ms: 2.12x slower | +| sqlglot_transpile | 1.56 ms | 3.33 ms: 2.14x slower | +| scimark_lu | 113 ms | 245 ms: 2.17x slower | +| sqlglot_parse | 1.25 ms | 2.86 ms: 2.29x slower | +| nbody | 85.1 ms | 195 ms: 2.29x slower | +| sympy_expand | 457 ms | 1.06 sec: 2.32x slower | +| sympy_sum | 156 ms | 381 ms: 2.45x slower | +| raytrace | 253 ms | 632 ms: 2.50x slower | +| deltablue | 3.12 ms | 9.13 ms: 2.92x slower | +| unpack_sequence | 44.8 ns | 136 ns: 3.04x slower | +| bench_thread_pool | 919 us | 3.49 ms: 3.80x slower | +| bench_mp_pool | 11.0 ms | 70.2 ms: 6.38x slower | +| Geometric mean | (ref) | 1.56x slower | + +Benchmark hidden because not significant (2): asyncio_websockets, unpickle +Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, tornado_http + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.47x +- 95% likely to have a slowdown of 1.45x +- 99% likely to have a slowdown of 1.39x + +# Memory +- memory change: 1.22x \ No newline at end of file diff --git a/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.svg b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.svg new file mode 100644 index 00000000..33e60b65 --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.svg @@ -0,0 +1,3044 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-base-mem.svg b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-base-mem.svg new file mode 100644 index 00000000..c44bff3e --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-base-mem.svg @@ -0,0 +1,2283 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-base.md b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-base.md new file mode 100644 index 00000000..b62a867d --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-base.md @@ -0,0 +1,202 @@ +# Results vs. base + +- fork: python +- ref: 32428cf9ea03bce6d64c +- machine: linux-x86_64 +- commit hash: 32428cf +- commit date: 2024-11-20 +- overall geometric mean: 1.53x slower +- HPT reliability: 100.00% +- HPT 99th percentile: 1.39x slower +- Memory change: 1.21x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| 2to3 | 256 ms | 414 ms: 1.62x slower | +| docutils | 2.63 sec | 3.35 sec: 1.28x slower | +| html5lib | 66.9 ms | 106 ms: 1.58x slower | +| Geometric mean | (ref) | 1.48x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | +|------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| asyncio_tcp | 506 ms | 584 ms: 1.15x slower | +| asyncio_tcp_ssl | 1.53 sec | 1.84 sec: 1.21x slower | +| async_generators | 378 ms | 485 ms: 1.28x slower | +| coroutines | 22.6 ms | 30.4 ms: 1.35x slower | +| Geometric mean | (ref) | 1.19x slower | + +Benchmark hidden because not significant (1): asyncio_websockets + +Benchmarks with tag 'math': +=========================== + +| Benchmark | results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| pidigits | 217 ms | 187 ms: 1.16x faster | +| float | 78.8 ms | 150 ms: 1.90x slower | +| nbody | 95.9 ms | 195 ms: 2.03x slower | +| Geometric mean | (ref) | 1.50x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | +|----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| regex_v8 | 23.6 ms | 25.5 ms: 1.08x slower | +| regex_dna | 177 ms | 193 ms: 1.09x slower | +| regex_compile | 135 ms | 230 ms: 1.71x slower | +| Geometric mean | (ref) | 1.19x slower | + +Benchmark hidden because not significant (1): regex_effbot + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | +|----------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| pickle_list | 5.29 us | 5.15 us: 1.03x faster | +| xml_etree_parse | 137 ms | 133 ms: 1.03x faster | +| pickle_dict | 32.3 us | 31.9 us: 1.01x faster | +| unpickle_list | 4.81 us | 5.02 us: 1.04x slower | +| unpickle | 13.5 us | 14.4 us: 1.07x slower | +| xml_etree_iterparse | 96.1 ms | 109 ms: 1.14x slower | +| json_loads | 25.0 us | 28.7 us: 1.14x slower | +| xml_etree_generate | 86.2 ms | 114 ms: 1.32x slower | +| json_dumps | 11.3 ms | 15.0 ms: 1.33x slower | +| tomli_loads | 2.15 sec | 3.20 sec: 1.49x slower | +| xml_etree_process | 60.2 ms | 93.4 ms: 1.55x slower | +| pickle_pure_python | 320 us | 616 us: 1.93x slower | +| unpickle_pure_python | 217 us | 421 us: 1.94x slower | +| Geometric mean | (ref) | 1.24x slower | + +Benchmark hidden because not significant (1): pickle + +Benchmarks with tag 'startup': +============================== + +| Benchmark | results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | +|------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| python_startup_no_site | 7.41 ms | 10.3 ms: 1.39x slower | +| python_startup | 11.1 ms | 15.8 ms: 1.42x slower | +| Geometric mean | (ref) | 1.41x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | +|-----------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| genshi_xml | 50.3 ms | 82.6 ms: 1.64x slower | +| mako | 12.0 ms | 20.7 ms: 1.73x slower | +| django_template | 35.7 ms | 64.6 ms: 1.81x slower | +| genshi_text | 21.9 ms | 40.6 ms: 1.85x slower | +| Geometric mean | (ref) | 1.76x slower | + +All benchmarks: +=============== + +| Benchmark | results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf.json | +|--------------------------|:-----------------------------------------------------------------------------------------------------------------:|:-----------------------------------------------------------------------------------------------------------------------:| +| gc_traversal | 3.63 ms | 2.68 ms: 1.36x faster | +| pidigits | 217 ms | 187 ms: 1.16x faster | +| create_gc_cycles | 1.34 ms | 1.19 ms: 1.12x faster | +| pickle_list | 5.29 us | 5.15 us: 1.03x faster | +| xml_etree_parse | 137 ms | 133 ms: 1.03x faster | +| pickle_dict | 32.3 us | 31.9 us: 1.01x faster | +| unpickle_list | 4.81 us | 5.02 us: 1.04x slower | +| unpickle | 13.5 us | 14.4 us: 1.07x slower | +| regex_v8 | 23.6 ms | 25.5 ms: 1.08x slower | +| sqlite_synth | 2.24 us | 2.44 us: 1.09x slower | +| regex_dna | 177 ms | 193 ms: 1.09x slower | +| bench_mp_pool | 63.6 ms | 70.2 ms: 1.10x slower | +| json | 4.61 ms | 5.22 ms: 1.13x slower | +| xml_etree_iterparse | 96.1 ms | 109 ms: 1.14x slower | +| json_loads | 25.0 us | 28.7 us: 1.14x slower | +| asyncio_tcp | 506 ms | 584 ms: 1.15x slower | +| pathlib | 18.6 ms | 22.1 ms: 1.19x slower | +| asyncio_tcp_ssl | 1.53 sec | 1.84 sec: 1.21x slower | +| scimark_fft | 337 ms | 415 ms: 1.23x slower | +| coverage | 80.2 ms | 102 ms: 1.27x slower | +| docutils | 2.63 sec | 3.35 sec: 1.28x slower | +| async_generators | 378 ms | 485 ms: 1.28x slower | +| scimark_sparse_mat_mult | 4.48 ms | 5.81 ms: 1.30x slower | +| telco | 7.22 ms | 9.37 ms: 1.30x slower | +| xml_etree_generate | 86.2 ms | 114 ms: 1.32x slower | +| json_dumps | 11.3 ms | 15.0 ms: 1.33x slower | +| mdp | 2.36 sec | 3.16 sec: 1.34x slower | +| coroutines | 22.6 ms | 30.4 ms: 1.35x slower | +| dulwich_log | 75.9 ms | 104 ms: 1.37x slower | +| meteor_contest | 100 ms | 139 ms: 1.39x slower | +| python_startup_no_site | 7.41 ms | 10.3 ms: 1.39x slower | +| generators | 29.2 ms | 40.8 ms: 1.40x slower | +| bpe_tokeniser | 4.34 sec | 6.16 sec: 1.42x slower | +| python_startup | 11.1 ms | 15.8 ms: 1.42x slower | +| spectral_norm | 113 ms | 163 ms: 1.43x slower | +| nqueens | 79.2 ms | 116 ms: 1.47x slower | +| tomli_loads | 2.15 sec | 3.20 sec: 1.49x slower | +| pycparser | 1.14 sec | 1.71 sec: 1.51x slower | +| fannkuch | 371 ms | 573 ms: 1.54x slower | +| pylint | 272 ms | 421 ms: 1.55x slower | +| xml_etree_process | 60.2 ms | 93.4 ms: 1.55x slower | +| typing_runtime_protocols | 160 us | 252 us: 1.57x slower | +| html5lib | 66.9 ms | 106 ms: 1.58x slower | +| crypto_pyaes | 67.9 ms | 108 ms: 1.59x slower | +| 2to3 | 256 ms | 414 ms: 1.62x slower | +| deepcopy | 266 us | 431 us: 1.62x slower | +| genshi_xml | 50.3 ms | 82.6 ms: 1.64x slower | +| sympy_integrate | 20.0 ms | 33.1 ms: 1.65x slower | +| sqlglot_optimize | 53.9 ms | 90.5 ms: 1.68x slower | +| deepcopy_reduce | 2.65 us | 4.50 us: 1.69x slower | +| sqlglot_normalize | 108 ms | 183 ms: 1.70x slower | +| regex_compile | 135 ms | 230 ms: 1.71x slower | +| thrift | 752 us | 1.29 ms: 1.72x slower | +| pyflate | 448 ms | 772 ms: 1.72x slower | +| mako | 12.0 ms | 20.7 ms: 1.73x slower | +| deepcopy_memo | 30.3 us | 53.0 us: 1.75x slower | +| comprehensions | 17.3 us | 30.6 us: 1.77x slower | +| django_template | 35.7 ms | 64.6 ms: 1.81x slower | +| pprint_safe_repr | 716 ms | 1.32 sec: 1.85x slower | +| pprint_pformat | 1.48 sec | 2.74 sec: 1.85x slower | +| genshi_text | 21.9 ms | 40.6 ms: 1.85x slower | +| float | 78.8 ms | 150 ms: 1.90x slower | +| logging_format | 6.99 us | 13.4 us: 1.91x slower | +| logging_simple | 6.30 us | 12.1 us: 1.92x slower | +| pickle_pure_python | 320 us | 616 us: 1.93x slower | +| scimark_monte_carlo | 65.4 ms | 126 ms: 1.93x slower | +| logging_silent | 109 ns | 212 ns: 1.94x slower | +| unpickle_pure_python | 217 us | 421 us: 1.94x slower | +| richards | 45.9 ms | 89.7 ms: 1.95x slower | +| sympy_str | 275 ms | 540 ms: 1.96x slower | +| scimark_sor | 136 ms | 269 ms: 1.98x slower | +| nbody | 95.9 ms | 195 ms: 2.03x slower | +| chaos | 59.0 ms | 122 ms: 2.06x slower | +| hexiom | 5.96 ms | 12.3 ms: 2.06x slower | +| richards_super | 52.0 ms | 108 ms: 2.09x slower | +| sqlglot_transpile | 1.59 ms | 3.33 ms: 2.09x slower | +| scimark_lu | 113 ms | 245 ms: 2.17x slower | +| sqlglot_parse | 1.30 ms | 2.86 ms: 2.20x slower | +| sympy_expand | 460 ms | 1.06 sec: 2.30x slower | +| raytrace | 264 ms | 632 ms: 2.39x slower | +| go | 122 ms | 298 ms: 2.45x slower | +| sympy_sum | 153 ms | 381 ms: 2.48x slower | +| deltablue | 3.25 ms | 9.13 ms: 2.81x slower | +| unpack_sequence | 47.0 ns | 136 ns: 2.90x slower | +| bench_thread_pool | 1.02 ms | 3.49 ms: 3.43x slower | +| Geometric mean | (ref) | 1.53x slower | + +Benchmark hidden because not significant (3): asyncio_websockets, regex_effbot, pickle + +# HPT report + +- Reliability score: 100.00% likely to be slow +- 90% likely to have a slowdown of 1.46x +- 95% likely to have a slowdown of 1.43x +- 99% likely to have a slowdown of 1.39x + +# Memory +- memory change: 1.21x \ No newline at end of file diff --git a/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-base.svg b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-base.svg new file mode 100644 index 00000000..0e25e047 --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-base.svg @@ -0,0 +1,3048 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241120-3.14.0a2+-32428cf/README.md b/results/bm-20241120-3.14.0a2+-32428cf/README.md new file mode 100644 index 00000000..2cdb8325 --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf/README.md @@ -0,0 +1,56 @@ +# Results + +- fork: python +- version: 3.14.0a2+ +- config: +- commit hash: [32428cf](https://github.com/python/cpython/commit/32428cf) +- commit date: 2024-11-20T14:54:48-08:00 +- commit merge base: [0af4ec30bd2e3a52350344d1011c0c125d6dcd71](https://github.com/python/cpython/commit/0af4ec30bd2e3a52350344d1011c0c125d6dcd71) +- ref: 32428cf9ea03bce6d64c + +## linux x86_64 (linux) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/11944155772) +- cpu model: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz +- platform: Linux-5.15.0-1071-aws-x86_64-with-glibc2.31 +- [raw results](bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf.json) + +### vs. 3.12.6 + +- Geometric mean: 1.03x faster (HPT: reliability of 99.91%, 1.00x faster at 99th %ile) +- Memory usage: 1.02x +- missing benchmarks: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, mypy2, sqlalchemy_declarative, sqlalchemy_imperative, tornado_http +- [📄table](bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.md) +- [📈time plot](bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.01x faster (HPT: reliability of 97.08%, 1.00x faster at 99th %ile) +- Memory usage: 1.01x +- missing benchmarks: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, tornado_http +- [📄table](bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.md) +- [📈time plot](bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.svg) + +## linux x86_64 (vultr) + +- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/11944155772) +- cpu model: Intel(R) Xeon(R) E-2286G CPU @ 4.00GHz +- platform: Linux-6.8.0-45-generic-x86_64-with-glibc2.39 +- [raw results](bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf.json) + +### vs. 3.12.6 + +- Geometric mean: 1.00x slower (HPT: reliability of 97.47%, 1.00x faster at 99th %ile) +- Memory usage: 1.02x +- missing benchmarks: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, mypy2, sqlalchemy_declarative, sqlalchemy_imperative, tornado_http +- [📄table](bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.md) +- [📈time plot](bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.svg) + +### vs. 3.13.0rc2 + +- Geometric mean: 1.02x slower (HPT: reliability of 99.66%, 1.00x slower at 99th %ile) +- Memory usage: 1.01x +- missing benchmarks: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, tornado_http +- [📄table](bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.md) +- [📈time plot](bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.svg) + diff --git a/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.md b/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.md new file mode 100644 index 00000000..a610aa46 --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.md @@ -0,0 +1,175 @@ +# Results vs. 3.12.6 + +- fork: python +- ref: 32428cf9ea03bce6d64c +- machine: linux-x86_64 +- commit hash: 32428cf +- commit date: 2024-11-20 +- overall geometric mean: 1.03x faster +- HPT reliability: 99.91% +- HPT 99th percentile: 1.00x faster +- Memory change: 1.02x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 456 ms | 430 ms: 1.06x faster | +| docutils | 4.00 sec | 3.72 sec: 1.07x faster | +| Geometric mean | (ref) | 1.04x faster | + +Benchmark hidden because not significant (1): html5lib + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|--------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| asyncio_tcp_ssl | 2.81 sec | 2.73 sec: 1.03x faster | +| asyncio_websockets | 748 ms | 726 ms: 1.03x faster | +| async_generators | 589 ms | 574 ms: 1.03x faster | +| coroutines | 29.5 ms | 31.6 ms: 1.07x slower | +| Geometric mean | (ref) | 1.01x faster | + +Benchmark hidden because not significant (1): asyncio_tcp + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| float | 123 ms | 113 ms: 1.09x faster | +| nbody | 119 ms | 130 ms: 1.09x slower | +| Geometric mean | (ref) | 1.00x slower | + +Benchmark hidden because not significant (1): pidigits + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 5.13 ms | 4.45 ms: 1.15x faster | +| Geometric mean | (ref) | 1.03x faster | + +Benchmark hidden because not significant (3): regex_compile, regex_dna, regex_v8 + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| pickle_dict | 52.7 us | 45.6 us: 1.15x faster | +| xml_etree_parse | 241 ms | 212 ms: 1.14x faster | +| unpickle | 21.2 us | 19.0 us: 1.12x faster | +| json_loads | 37.9 us | 34.8 us: 1.09x faster | +| xml_etree_generate | 127 ms | 118 ms: 1.08x faster | +| tomli_loads | 2.88 sec | 2.70 sec: 1.07x faster | +| xml_etree_iterparse | 169 ms | 160 ms: 1.06x faster | +| unpickle_pure_python | 300 us | 284 us: 1.06x faster | +| unpickle_list | 6.83 us | 7.05 us: 1.03x slower | +| json_dumps | 14.3 ms | 15.3 ms: 1.07x slower | +| pickle | 16.4 us | 17.5 us: 1.07x slower | +| Geometric mean | (ref) | 1.04x faster | + +Benchmark hidden because not significant (3): pickle_pure_python, xml_etree_process, pickle_list + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 17.6 ms | 13.4 ms: 1.31x faster | +| python_startup | 23.7 ms | 19.7 ms: 1.20x faster | +| Geometric mean | (ref) | 1.26x faster | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| mako | 15.7 ms | 17.0 ms: 1.08x slower | +| Geometric mean | (ref) | 1.02x slower | + +Benchmark hidden because not significant (3): genshi_xml, django_template, genshi_text + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| deepcopy | 468 us | 347 us: 1.35x faster | +| python_startup_no_site | 17.6 ms | 13.4 ms: 1.31x faster | +| pylint | 465 ms | 358 ms: 1.30x faster | +| deepcopy_memo | 52.4 us | 41.5 us: 1.26x faster | +| python_startup | 23.7 ms | 19.7 ms: 1.20x faster | +| bench_thread_pool | 3.48 ms | 2.91 ms: 1.20x faster | +| comprehensions | 27.1 us | 22.9 us: 1.19x faster | +| pycparser | 1.79 sec | 1.53 sec: 1.17x faster | +| pickle_dict | 52.7 us | 45.6 us: 1.15x faster | +| regex_effbot | 5.13 ms | 4.45 ms: 1.15x faster | +| xml_etree_parse | 241 ms | 212 ms: 1.14x faster | +| unpickle | 21.2 us | 19.0 us: 1.12x faster | +| raytrace | 408 ms | 364 ms: 1.12x faster | +| crypto_pyaes | 107 ms | 96.2 ms: 1.12x faster | +| bpe_tokeniser | 6.59 sec | 5.92 sec: 1.11x faster | +| mdp | 3.97 sec | 3.57 sec: 1.11x faster | +| gc_traversal | 5.86 ms | 5.28 ms: 1.11x faster | +| deepcopy_reduce | 4.04 us | 3.63 us: 1.11x faster | +| pathlib | 31.6 ms | 28.6 ms: 1.10x faster | +| sympy_sum | 222 ms | 202 ms: 1.10x faster | +| go | 172 ms | 157 ms: 1.10x faster | +| sympy_integrate | 29.8 ms | 27.3 ms: 1.09x faster | +| json_loads | 37.9 us | 34.8 us: 1.09x faster | +| float | 123 ms | 113 ms: 1.09x faster | +| pyflate | 727 ms | 671 ms: 1.08x faster | +| xml_etree_generate | 127 ms | 118 ms: 1.08x faster | +| sqlglot_normalize | 157 ms | 145 ms: 1.08x faster | +| docutils | 4.00 sec | 3.72 sec: 1.07x faster | +| scimark_monte_carlo | 96.4 ms | 89.8 ms: 1.07x faster | +| nqueens | 117 ms | 109 ms: 1.07x faster | +| tomli_loads | 2.88 sec | 2.70 sec: 1.07x faster | +| logging_simple | 9.45 us | 8.86 us: 1.07x faster | +| xml_etree_iterparse | 169 ms | 160 ms: 1.06x faster | +| 2to3 | 456 ms | 430 ms: 1.06x faster | +| fannkuch | 540 ms | 512 ms: 1.06x faster | +| unpickle_pure_python | 300 us | 284 us: 1.06x faster | +| pprint_pformat | 1.98 sec | 1.88 sec: 1.05x faster | +| sympy_str | 385 ms | 365 ms: 1.05x faster | +| sqlite_synth | 3.87 us | 3.69 us: 1.05x faster | +| meteor_contest | 146 ms | 139 ms: 1.05x faster | +| sqlglot_transpile | 2.34 ms | 2.24 ms: 1.05x faster | +| scimark_fft | 500 ms | 479 ms: 1.04x faster | +| generators | 41.1 ms | 39.7 ms: 1.04x faster | +| asyncio_tcp_ssl | 2.81 sec | 2.73 sec: 1.03x faster | +| asyncio_websockets | 748 ms | 726 ms: 1.03x faster | +| async_generators | 589 ms | 574 ms: 1.03x faster | +| unpickle_list | 6.83 us | 7.05 us: 1.03x slower | +| scimark_sor | 167 ms | 173 ms: 1.04x slower | +| deltablue | 4.27 ms | 4.52 ms: 1.06x slower | +| logging_silent | 139 ns | 148 ns: 1.06x slower | +| json_dumps | 14.3 ms | 15.3 ms: 1.07x slower | +| pickle | 16.4 us | 17.5 us: 1.07x slower | +| coroutines | 29.5 ms | 31.6 ms: 1.07x slower | +| mako | 15.7 ms | 17.0 ms: 1.08x slower | +| richards | 60.3 ms | 65.5 ms: 1.08x slower | +| nbody | 119 ms | 130 ms: 1.09x slower | +| telco | 9.59 ms | 10.6 ms: 1.11x slower | +| coverage | 95.4 ms | 111 ms: 1.16x slower | +| create_gc_cycles | 1.94 ms | 2.32 ms: 1.19x slower | +| bench_mp_pool | 20.7 ms | 69.4 ms: 3.35x slower | +| Geometric mean | (ref) | 1.03x faster | + +Benchmark hidden because not significant (28): logging_format, genshi_xml, regex_compile, richards_super, asyncio_tcp, dulwich_log, scimark_sparse_mat_mult, pprint_safe_repr, pickle_pure_python, unpack_sequence, thrift, xml_etree_process, sqlglot_parse, spectral_norm, pidigits, sqlglot_optimize, django_template, pickle_list, typing_runtime_protocols, sympy_expand, html5lib, json, scimark_lu, genshi_text, chaos, regex_dna, hexiom, regex_v8 +Ignored benchmarks (17) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-linux-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, mypy2, sqlalchemy_declarative, sqlalchemy_imperative, tornado_http + +# HPT report + +- Reliability score: 99.91% likely to be faster +- 90% likely to have a speedup of 1.01x +- 95% likely to have a speedup of 1.01x +- 99% likely to have a speedup of 1.00x + +# Memory +- memory change: 1.02x \ No newline at end of file diff --git a/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.svg b/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.svg new file mode 100644 index 00000000..4435bf0e --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.svg @@ -0,0 +1,3268 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.md b/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.md new file mode 100644 index 00000000..66125230 --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.md @@ -0,0 +1,158 @@ +# Results vs. 3.13.0rc2 + +- fork: python +- ref: 32428cf9ea03bce6d64c +- machine: linux-x86_64 +- commit hash: 32428cf +- commit date: 2024-11-20 +- overall geometric mean: 1.01x faster +- HPT reliability: 97.08% +- HPT 99th percentile: 1.00x faster +- Memory change: 1.01x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| docutils | 4.01 sec | 3.72 sec: 1.08x faster | +| Geometric mean | (ref) | 1.04x faster | + +Benchmark hidden because not significant (2): 2to3, html5lib + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|--------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| asyncio_websockets | 766 ms | 726 ms: 1.06x faster | +| asyncio_tcp | 948 ms | 899 ms: 1.06x faster | +| Geometric mean | (ref) | 1.02x faster | + +Benchmark hidden because not significant (3): asyncio_tcp_ssl, async_generators, coroutines + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| nbody | 119 ms | 130 ms: 1.10x slower | +| Geometric mean | (ref) | 1.02x slower | + +Benchmark hidden because not significant (2): float, pidigits + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 4.74 ms | 4.45 ms: 1.06x faster | +| regex_v8 | 32.8 ms | 34.0 ms: 1.04x slower | +| Geometric mean | (ref) | 1.01x faster | + +Benchmark hidden because not significant (2): regex_compile, regex_dna + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|---------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| xml_etree_iterparse | 177 ms | 160 ms: 1.11x faster | +| xml_etree_parse | 231 ms | 212 ms: 1.09x faster | +| unpickle | 20.5 us | 19.0 us: 1.08x faster | +| xml_etree_generate | 122 ms | 118 ms: 1.04x faster | +| tomli_loads | 2.78 sec | 2.70 sec: 1.03x faster | +| unpickle_list | 6.68 us | 7.05 us: 1.06x slower | +| json_dumps | 14.1 ms | 15.3 ms: 1.08x slower | +| pickle | 15.1 us | 17.5 us: 1.15x slower | +| Geometric mean | (ref) | 1.01x faster | + +Benchmark hidden because not significant (6): xml_etree_process, pickle_dict, unpickle_pure_python, json_loads, pickle_pure_python, pickle_list + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 15.3 ms | 13.4 ms: 1.14x faster | +| python_startup | 22.4 ms | 19.7 ms: 1.14x faster | +| Geometric mean | (ref) | 1.14x faster | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_xml | 72.1 ms | 64.8 ms: 1.11x faster | +| mako | 15.9 ms | 17.0 ms: 1.07x slower | +| Geometric mean | (ref) | 1.01x faster | + +Benchmark hidden because not significant (2): genshi_text, django_template + +All benchmarks: +=============== + +| Benchmark | bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| deepcopy | 498 us | 347 us: 1.43x faster | +| pylint | 470 ms | 358 ms: 1.31x faster | +| unpack_sequence | 74.3 ns | 59.4 ns: 1.25x faster | +| go | 191 ms | 157 ms: 1.22x faster | +| deepcopy_memo | 50.1 us | 41.5 us: 1.21x faster | +| telco | 12.2 ms | 10.6 ms: 1.14x faster | +| python_startup_no_site | 15.3 ms | 13.4 ms: 1.14x faster | +| python_startup | 22.4 ms | 19.7 ms: 1.14x faster | +| deepcopy_reduce | 4.10 us | 3.63 us: 1.13x faster | +| genshi_xml | 72.1 ms | 64.8 ms: 1.11x faster | +| xml_etree_iterparse | 177 ms | 160 ms: 1.11x faster | +| sympy_integrate | 30.2 ms | 27.3 ms: 1.11x faster | +| xml_etree_parse | 231 ms | 212 ms: 1.09x faster | +| unpickle | 20.5 us | 19.0 us: 1.08x faster | +| sqlite_synth | 3.99 us | 3.69 us: 1.08x faster | +| gc_traversal | 5.70 ms | 5.28 ms: 1.08x faster | +| docutils | 4.01 sec | 3.72 sec: 1.08x faster | +| meteor_contest | 150 ms | 139 ms: 1.08x faster | +| fannkuch | 547 ms | 512 ms: 1.07x faster | +| regex_effbot | 4.74 ms | 4.45 ms: 1.06x faster | +| mdp | 3.80 sec | 3.57 sec: 1.06x faster | +| bpe_tokeniser | 6.28 sec | 5.92 sec: 1.06x faster | +| asyncio_websockets | 766 ms | 726 ms: 1.06x faster | +| asyncio_tcp | 948 ms | 899 ms: 1.06x faster | +| thrift | 1.10 ms | 1.05 ms: 1.05x faster | +| pprint_safe_repr | 987 ms | 946 ms: 1.04x faster | +| sympy_sum | 210 ms | 202 ms: 1.04x faster | +| crypto_pyaes | 100 ms | 96.2 ms: 1.04x faster | +| xml_etree_generate | 122 ms | 118 ms: 1.04x faster | +| richards_super | 73.2 ms | 70.4 ms: 1.04x faster | +| pprint_pformat | 1.94 sec | 1.88 sec: 1.04x faster | +| scimark_sor | 179 ms | 173 ms: 1.04x faster | +| tomli_loads | 2.78 sec | 2.70 sec: 1.03x faster | +| pycparser | 1.57 sec | 1.53 sec: 1.03x faster | +| coverage | 107 ms | 111 ms: 1.03x slower | +| regex_v8 | 32.8 ms | 34.0 ms: 1.04x slower | +| sqlglot_normalize | 140 ms | 145 ms: 1.04x slower | +| hexiom | 8.11 ms | 8.54 ms: 1.05x slower | +| unpickle_list | 6.68 us | 7.05 us: 1.06x slower | +| raytrace | 344 ms | 364 ms: 1.06x slower | +| mako | 15.9 ms | 17.0 ms: 1.07x slower | +| scimark_lu | 146 ms | 156 ms: 1.07x slower | +| json | 6.51 ms | 7.01 ms: 1.08x slower | +| json_dumps | 14.1 ms | 15.3 ms: 1.08x slower | +| nbody | 119 ms | 130 ms: 1.10x slower | +| logging_silent | 130 ns | 148 ns: 1.14x slower | +| pickle | 15.1 us | 17.5 us: 1.15x slower | +| bench_mp_pool | 18.7 ms | 69.4 ms: 3.71x slower | +| Geometric mean | (ref) | 1.01x faster | + +Benchmark hidden because not significant (40): pathlib, create_gc_cycles, sympy_str, xml_etree_process, 2to3, pickle_dict, scimark_sparse_mat_mult, nqueens, float, unpickle_pure_python, html5lib, genshi_text, asyncio_tcp_ssl, regex_compile, sympy_expand, spectral_norm, scimark_monte_carlo, generators, logging_format, pidigits, richards, bench_thread_pool, pyflate, async_generators, scimark_fft, typing_runtime_protocols, json_loads, sqlglot_parse, regex_dna, sqlglot_transpile, deltablue, django_template, sqlglot_optimize, coroutines, pickle_pure_python, comprehensions, pickle_list, logging_simple, dulwich_log, chaos +Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, tornado_http + +# HPT report + +- Reliability score: 97.08% likely to be faster +- 90% likely to have a speedup of 1.00x +- 95% likely to have a speedup of 1.00x +- 99% likely to have a speedup of 1.00x + +# Memory +- memory change: 1.01x \ No newline at end of file diff --git a/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.svg b/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.svg new file mode 100644 index 00000000..d7408d5c --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-linux-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.svg @@ -0,0 +1,3348 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.md b/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.md new file mode 100644 index 00000000..06a7fb1f --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.md @@ -0,0 +1,199 @@ +# Results vs. 3.12.6 + +- fork: python +- ref: 32428cf9ea03bce6d64c +- machine: linux-x86_64 +- commit hash: 32428cf +- commit date: 2024-11-20 +- overall geometric mean: 1.00x slower +- HPT reliability: 97.47% +- HPT 99th percentile: 1.00x faster +- Memory change: 1.02x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 264 ms | 256 ms: 1.03x faster | +| docutils | 2.64 sec | 2.63 sec: 1.01x faster | +| html5lib | 63.6 ms | 66.9 ms: 1.05x slower | +| Geometric mean | (ref) | 1.00x slower | + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|--------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| coroutines | 23.9 ms | 22.6 ms: 1.06x faster | +| asyncio_tcp | 519 ms | 506 ms: 1.02x faster | +| async_generators | 384 ms | 378 ms: 1.02x faster | +| asyncio_websockets | 517 ms | 521 ms: 1.01x slower | +| asyncio_tcp_ssl | 1.51 sec | 1.53 sec: 1.01x slower | +| Geometric mean | (ref) | 1.02x faster | + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| float | 80.8 ms | 78.8 ms: 1.02x faster | +| nbody | 89.3 ms | 95.9 ms: 1.07x slower | +| pidigits | 184 ms | 217 ms: 1.18x slower | +| Geometric mean | (ref) | 1.07x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 3.17 ms | 2.86 ms: 1.11x faster | +| regex_compile | 142 ms | 135 ms: 1.06x faster | +| regex_dna | 168 ms | 177 ms: 1.05x slower | +| regex_v8 | 20.6 ms | 23.6 ms: 1.15x slower | +| Geometric mean | (ref) | 1.01x slower | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| json_loads | 26.5 us | 25.0 us: 1.06x faster | +| unpickle | 14.1 us | 13.5 us: 1.04x faster | +| unpickle_pure_python | 221 us | 217 us: 1.02x faster | +| xml_etree_parse | 139 ms | 137 ms: 1.01x faster | +| xml_etree_iterparse | 96.7 ms | 96.1 ms: 1.01x faster | +| xml_etree_generate | 85.2 ms | 86.2 ms: 1.01x slower | +| pickle_dict | 31.8 us | 32.3 us: 1.02x slower | +| tomli_loads | 2.11 sec | 2.15 sec: 1.02x slower | +| xml_etree_process | 59.0 ms | 60.2 ms: 1.02x slower | +| unpickle_list | 4.67 us | 4.81 us: 1.03x slower | +| pickle_pure_python | 308 us | 320 us: 1.04x slower | +| json_dumps | 10.4 ms | 11.3 ms: 1.09x slower | +| pickle_list | 4.77 us | 5.29 us: 1.11x slower | +| pickle | 10.9 us | 12.3 us: 1.12x slower | +| Geometric mean | (ref) | 1.02x slower | + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 7.16 ms | 7.41 ms: 1.03x slower | +| python_startup | 9.93 ms | 11.1 ms: 1.11x slower | +| Geometric mean | (ref) | 1.07x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|-----------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_text | 22.8 ms | 21.9 ms: 1.04x faster | +| django_template | 34.7 ms | 35.7 ms: 1.03x slower | +| mako | 11.0 ms | 12.0 ms: 1.09x slower | +| Geometric mean | (ref) | 1.02x slower | + +Benchmark hidden because not significant (1): genshi_xml + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|--------------------------|:------------------------------------------------------:|:----------------------------------------------------------------------:| +| deepcopy_memo | 40.3 us | 30.3 us: 1.33x faster | +| deepcopy | 352 us | 266 us: 1.32x faster | +| pylint | 319 ms | 272 ms: 1.17x faster | +| deepcopy_reduce | 3.08 us | 2.65 us: 1.16x faster | +| pathlib | 21.5 ms | 18.6 ms: 1.16x faster | +| comprehensions | 19.8 us | 17.3 us: 1.14x faster | +| go | 139 ms | 122 ms: 1.14x faster | +| raytrace | 299 ms | 264 ms: 1.13x faster | +| crypto_pyaes | 76.6 ms | 67.9 ms: 1.13x faster | +| unpack_sequence | 52.1 ns | 47.0 ns: 1.11x faster | +| regex_effbot | 3.17 ms | 2.86 ms: 1.11x faster | +| generators | 32.2 ms | 29.2 ms: 1.10x faster | +| bpe_tokeniser | 4.74 sec | 4.34 sec: 1.09x faster | +| json | 5.02 ms | 4.61 ms: 1.09x faster | +| sympy_sum | 166 ms | 153 ms: 1.08x faster | +| chaos | 62.8 ms | 59.0 ms: 1.07x faster | +| coroutines | 23.9 ms | 22.6 ms: 1.06x faster | +| sympy_str | 292 ms | 275 ms: 1.06x faster | +| json_loads | 26.5 us | 25.0 us: 1.06x faster | +| deltablue | 3.45 ms | 3.25 ms: 1.06x faster | +| regex_compile | 142 ms | 135 ms: 1.06x faster | +| thrift | 791 us | 752 us: 1.05x faster | +| logging_simple | 6.63 us | 6.30 us: 1.05x faster | +| logging_format | 7.35 us | 6.99 us: 1.05x faster | +| sqlglot_transpile | 1.67 ms | 1.59 ms: 1.05x faster | +| scimark_monte_carlo | 68.4 ms | 65.4 ms: 1.05x faster | +| genshi_text | 22.8 ms | 21.9 ms: 1.04x faster | +| unpickle | 14.1 us | 13.5 us: 1.04x faster | +| sqlglot_parse | 1.36 ms | 1.30 ms: 1.04x faster | +| dulwich_log | 78.9 ms | 75.9 ms: 1.04x faster | +| pprint_safe_repr | 743 ms | 716 ms: 1.04x faster | +| hexiom | 6.17 ms | 5.96 ms: 1.03x faster | +| meteor_contest | 104 ms | 100 ms: 1.03x faster | +| 2to3 | 264 ms | 256 ms: 1.03x faster | +| pycparser | 1.17 sec | 1.14 sec: 1.03x faster | +| sympy_integrate | 20.5 ms | 20.0 ms: 1.03x faster | +| pprint_pformat | 1.52 sec | 1.48 sec: 1.03x faster | +| asyncio_tcp | 519 ms | 506 ms: 1.02x faster | +| float | 80.8 ms | 78.8 ms: 1.02x faster | +| mdp | 2.42 sec | 2.36 sec: 1.02x faster | +| typing_runtime_protocols | 163 us | 160 us: 1.02x faster | +| unpickle_pure_python | 221 us | 217 us: 1.02x faster | +| sympy_expand | 468 ms | 460 ms: 1.02x faster | +| async_generators | 384 ms | 378 ms: 1.02x faster | +| scimark_fft | 342 ms | 337 ms: 1.01x faster | +| xml_etree_parse | 139 ms | 137 ms: 1.01x faster | +| scimark_lu | 114 ms | 113 ms: 1.01x faster | +| nqueens | 80.1 ms | 79.2 ms: 1.01x faster | +| xml_etree_iterparse | 96.7 ms | 96.1 ms: 1.01x faster | +| docutils | 2.64 sec | 2.63 sec: 1.01x faster | +| fannkuch | 372 ms | 371 ms: 1.00x faster | +| asyncio_websockets | 517 ms | 521 ms: 1.01x slower | +| sqlglot_normalize | 107 ms | 108 ms: 1.01x slower | +| sqlglot_optimize | 53.3 ms | 53.9 ms: 1.01x slower | +| asyncio_tcp_ssl | 1.51 sec | 1.53 sec: 1.01x slower | +| xml_etree_generate | 85.2 ms | 86.2 ms: 1.01x slower | +| pickle_dict | 31.8 us | 32.3 us: 1.02x slower | +| tomli_loads | 2.11 sec | 2.15 sec: 1.02x slower | +| sqlite_synth | 2.20 us | 2.24 us: 1.02x slower | +| scimark_sparse_mat_mult | 4.39 ms | 4.48 ms: 1.02x slower | +| xml_etree_process | 59.0 ms | 60.2 ms: 1.02x slower | +| spectral_norm | 110 ms | 113 ms: 1.03x slower | +| unpickle_list | 4.67 us | 4.81 us: 1.03x slower | +| django_template | 34.7 ms | 35.7 ms: 1.03x slower | +| python_startup_no_site | 7.16 ms | 7.41 ms: 1.03x slower | +| pickle_pure_python | 308 us | 320 us: 1.04x slower | +| scimark_sor | 130 ms | 136 ms: 1.05x slower | +| gc_traversal | 3.46 ms | 3.63 ms: 1.05x slower | +| html5lib | 63.6 ms | 66.9 ms: 1.05x slower | +| regex_dna | 168 ms | 177 ms: 1.05x slower | +| nbody | 89.3 ms | 95.9 ms: 1.07x slower | +| bench_thread_pool | 941 us | 1.02 ms: 1.08x slower | +| mako | 11.0 ms | 12.0 ms: 1.09x slower | +| json_dumps | 10.4 ms | 11.3 ms: 1.09x slower | +| telco | 6.53 ms | 7.22 ms: 1.11x slower | +| pickle_list | 4.77 us | 5.29 us: 1.11x slower | +| python_startup | 9.93 ms | 11.1 ms: 1.11x slower | +| pickle | 10.9 us | 12.3 us: 1.12x slower | +| coverage | 71.4 ms | 80.2 ms: 1.12x slower | +| regex_v8 | 20.6 ms | 23.6 ms: 1.15x slower | +| pidigits | 184 ms | 217 ms: 1.18x slower | +| create_gc_cycles | 1.09 ms | 1.34 ms: 1.23x slower | +| bench_mp_pool | 10.8 ms | 63.6 ms: 5.89x slower | +| Geometric mean | (ref) | 1.00x slower | + +Benchmark hidden because not significant (5): richards, pyflate, richards_super, genshi_xml, logging_silent +Ignored benchmarks (17) of results/bm-20240906-3.12.6-a4a2d2b/bm-20240906-vultr-x86_64-python-v3.12.6-3.12.6-a4a2d2b.json: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, mypy2, sqlalchemy_declarative, sqlalchemy_imperative, tornado_http + +# HPT report + +- Reliability score: 97.47% likely to be faster +- 90% likely to have a speedup of 1.00x +- 95% likely to have a speedup of 1.00x +- 99% likely to have a speedup of 1.00x + +# Memory +- memory change: 1.02x \ No newline at end of file diff --git a/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.svg b/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.svg new file mode 100644 index 00000000..ec6c031b --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.12.6.svg @@ -0,0 +1,3081 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.md b/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.md new file mode 100644 index 00000000..a465af54 --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.md @@ -0,0 +1,193 @@ +# Results vs. 3.13.0rc2 + +- fork: python +- ref: 32428cf9ea03bce6d64c +- machine: linux-x86_64 +- commit hash: 32428cf +- commit date: 2024-11-20 +- overall geometric mean: 1.02x slower +- HPT reliability: 99.66% +- HPT 99th percentile: 1.00x slower +- Memory change: 1.01x + +Benchmarks with tag 'apps': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| 2to3 | 260 ms | 256 ms: 1.02x faster | +| docutils | 2.62 sec | 2.63 sec: 1.00x slower | +| Geometric mean | (ref) | 1.00x faster | + +Benchmark hidden because not significant (1): html5lib + +Benchmarks with tag 'asyncio': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|-----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| coroutines | 23.6 ms | 22.6 ms: 1.04x faster | +| asyncio_tcp_ssl | 1.51 sec | 1.53 sec: 1.01x slower | +| Geometric mean | (ref) | 1.01x faster | + +Benchmark hidden because not significant (3): asyncio_websockets, asyncio_tcp, async_generators + +Benchmarks with tag 'math': +=========================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| pidigits | 217 ms | 217 ms: 1.00x slower | +| float | 77.5 ms | 78.8 ms: 1.02x slower | +| nbody | 85.1 ms | 95.9 ms: 1.13x slower | +| Geometric mean | (ref) | 1.05x slower | + +Benchmarks with tag 'regex': +============================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| regex_effbot | 3.08 ms | 2.86 ms: 1.08x faster | +| regex_dna | 180 ms | 177 ms: 1.02x faster | +| regex_compile | 132 ms | 135 ms: 1.02x slower | +| regex_v8 | 22.7 ms | 23.6 ms: 1.04x slower | +| Geometric mean | (ref) | 1.01x faster | + +Benchmarks with tag 'serialize': +================================ + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|----------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| json_loads | 27.0 us | 25.0 us: 1.08x faster | +| unpickle | 14.3 us | 13.5 us: 1.06x faster | +| pickle_dict | 32.5 us | 32.3 us: 1.01x faster | +| xml_etree_generate | 85.4 ms | 86.2 ms: 1.01x slower | +| xml_etree_iterparse | 94.9 ms | 96.1 ms: 1.01x slower | +| xml_etree_process | 59.3 ms | 60.2 ms: 1.01x slower | +| unpickle_list | 4.71 us | 4.81 us: 1.02x slower | +| unpickle_pure_python | 210 us | 217 us: 1.03x slower | +| tomli_loads | 2.01 sec | 2.15 sec: 1.07x slower | +| pickle_list | 4.93 us | 5.29 us: 1.07x slower | +| json_dumps | 10.5 ms | 11.3 ms: 1.08x slower | +| pickle | 11.3 us | 12.3 us: 1.08x slower | +| pickle_pure_python | 294 us | 320 us: 1.09x slower | +| Geometric mean | (ref) | 1.02x slower | + +Benchmark hidden because not significant (1): xml_etree_parse + +Benchmarks with tag 'startup': +============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| python_startup_no_site | 7.39 ms | 7.41 ms: 1.00x slower | +| python_startup | 11.0 ms | 11.1 ms: 1.01x slower | +| Geometric mean | (ref) | 1.00x slower | + +Benchmarks with tag 'template': +=============================== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|-----------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| genshi_text | 21.5 ms | 21.9 ms: 1.02x slower | +| genshi_xml | 48.8 ms | 50.3 ms: 1.03x slower | +| django_template | 34.1 ms | 35.7 ms: 1.05x slower | +| mako | 11.3 ms | 12.0 ms: 1.06x slower | +| Geometric mean | (ref) | 1.04x slower | + +All benchmarks: +=============== + +| Benchmark | bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 | bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf | +|--------------------------|:------------------------------------------------------------:|:----------------------------------------------------------------------:| +| deepcopy | 355 us | 266 us: 1.34x faster | +| deepcopy_memo | 39.1 us | 30.3 us: 1.29x faster | +| deepcopy_reduce | 3.11 us | 2.65 us: 1.17x faster | +| pylint | 317 ms | 272 ms: 1.17x faster | +| go | 141 ms | 122 ms: 1.16x faster | +| telco | 7.82 ms | 7.22 ms: 1.08x faster | +| json_loads | 27.0 us | 25.0 us: 1.08x faster | +| regex_effbot | 3.08 ms | 2.86 ms: 1.08x faster | +| json | 4.93 ms | 4.61 ms: 1.07x faster | +| unpickle | 14.3 us | 13.5 us: 1.06x faster | +| scimark_sparse_mat_mult | 4.71 ms | 4.48 ms: 1.05x faster | +| coroutines | 23.6 ms | 22.6 ms: 1.04x faster | +| scimark_fft | 349 ms | 337 ms: 1.04x faster | +| coverage | 83.0 ms | 80.2 ms: 1.03x faster | +| thrift | 778 us | 752 us: 1.03x faster | +| pathlib | 19.2 ms | 18.6 ms: 1.03x faster | +| pprint_safe_repr | 738 ms | 716 ms: 1.03x faster | +| bpe_tokeniser | 4.45 sec | 4.34 sec: 1.02x faster | +| regex_dna | 180 ms | 177 ms: 1.02x faster | +| 2to3 | 260 ms | 256 ms: 1.02x faster | +| sympy_sum | 156 ms | 153 ms: 1.01x faster | +| meteor_contest | 102 ms | 100 ms: 1.01x faster | +| pprint_pformat | 1.50 sec | 1.48 sec: 1.01x faster | +| pickle_dict | 32.5 us | 32.3 us: 1.01x faster | +| hexiom | 5.99 ms | 5.96 ms: 1.00x faster | +| pidigits | 217 ms | 217 ms: 1.00x slower | +| python_startup_no_site | 7.39 ms | 7.41 ms: 1.00x slower | +| mdp | 2.36 sec | 2.36 sec: 1.00x slower | +| docutils | 2.62 sec | 2.63 sec: 1.00x slower | +| fannkuch | 370 ms | 371 ms: 1.00x slower | +| sympy_expand | 457 ms | 460 ms: 1.01x slower | +| richards_super | 51.6 ms | 52.0 ms: 1.01x slower | +| python_startup | 11.0 ms | 11.1 ms: 1.01x slower | +| nqueens | 78.6 ms | 79.2 ms: 1.01x slower | +| sympy_integrate | 19.8 ms | 20.0 ms: 1.01x slower | +| xml_etree_generate | 85.4 ms | 86.2 ms: 1.01x slower | +| asyncio_tcp_ssl | 1.51 sec | 1.53 sec: 1.01x slower | +| scimark_sor | 134 ms | 136 ms: 1.01x slower | +| xml_etree_iterparse | 94.9 ms | 96.1 ms: 1.01x slower | +| xml_etree_process | 59.3 ms | 60.2 ms: 1.01x slower | +| dulwich_log | 74.8 ms | 75.9 ms: 1.01x slower | +| generators | 28.8 ms | 29.2 ms: 1.01x slower | +| richards | 45.2 ms | 45.9 ms: 1.02x slower | +| sqlite_synth | 2.21 us | 2.24 us: 1.02x slower | +| genshi_text | 21.5 ms | 21.9 ms: 1.02x slower | +| pycparser | 1.12 sec | 1.14 sec: 1.02x slower | +| regex_compile | 132 ms | 135 ms: 1.02x slower | +| sqlglot_normalize | 106 ms | 108 ms: 1.02x slower | +| float | 77.5 ms | 78.8 ms: 1.02x slower | +| spectral_norm | 111 ms | 113 ms: 1.02x slower | +| unpickle_list | 4.71 us | 4.81 us: 1.02x slower | +| logging_format | 6.84 us | 6.99 us: 1.02x slower | +| sqlglot_optimize | 52.7 ms | 53.9 ms: 1.02x slower | +| sqlglot_transpile | 1.56 ms | 1.59 ms: 1.02x slower | +| logging_simple | 6.16 us | 6.30 us: 1.02x slower | +| chaos | 57.3 ms | 59.0 ms: 1.03x slower | +| genshi_xml | 48.8 ms | 50.3 ms: 1.03x slower | +| unpickle_pure_python | 210 us | 217 us: 1.03x slower | +| typing_runtime_protocols | 155 us | 160 us: 1.04x slower | +| regex_v8 | 22.7 ms | 23.6 ms: 1.04x slower | +| deltablue | 3.12 ms | 3.25 ms: 1.04x slower | +| sqlglot_parse | 1.25 ms | 1.30 ms: 1.04x slower | +| raytrace | 253 ms | 264 ms: 1.05x slower | +| django_template | 34.1 ms | 35.7 ms: 1.05x slower | +| unpack_sequence | 44.8 ns | 47.0 ns: 1.05x slower | +| comprehensions | 16.5 us | 17.3 us: 1.05x slower | +| mako | 11.3 ms | 12.0 ms: 1.06x slower | +| logging_silent | 103 ns | 109 ns: 1.07x slower | +| tomli_loads | 2.01 sec | 2.15 sec: 1.07x slower | +| pickle_list | 4.93 us | 5.29 us: 1.07x slower | +| json_dumps | 10.5 ms | 11.3 ms: 1.08x slower | +| pickle | 11.3 us | 12.3 us: 1.08x slower | +| pickle_pure_python | 294 us | 320 us: 1.09x slower | +| bench_thread_pool | 919 us | 1.02 ms: 1.11x slower | +| nbody | 85.1 ms | 95.9 ms: 1.13x slower | +| gc_traversal | 3.14 ms | 3.63 ms: 1.16x slower | +| bench_mp_pool | 11.0 ms | 63.6 ms: 5.79x slower | +| Geometric mean | (ref) | 1.02x slower | + +Benchmark hidden because not significant (11): html5lib, pyflate, crypto_pyaes, asyncio_websockets, sympy_str, scimark_monte_carlo, asyncio_tcp, create_gc_cycles, scimark_lu, async_generators, xml_etree_parse +Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-vultr-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, tornado_http + +# HPT report + +- Reliability score: 99.66% likely to be slow +- 90% likely to have a slowdown of 1.00x +- 95% likely to have a slowdown of 1.00x +- 99% likely to have a slowdown of 1.00x + +# Memory +- memory change: 1.01x \ No newline at end of file diff --git a/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.svg b/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.svg new file mode 100644 index 00000000..3f32565e --- /dev/null +++ b/results/bm-20241120-3.14.0a2+-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2+-32428cf-vs-3.13.0rc2.svg @@ -0,0 +1,3143 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +