Skip to content

Commit

Permalink
Benchmarking results for @mpage
Browse files Browse the repository at this point in the history
  • Loading branch information
mpage committed Dec 20, 2024
1 parent e3dae1e commit 271c22c
Show file tree
Hide file tree
Showing 15 changed files with 20,175 additions and 0 deletions.
2 changes: 2 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,8 @@ Here are some recent and important revisions. 👉 [Complete list of results](RE
## linux x86_64 (vultr)
| date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: |
| --- | --- | --- | ---: | ---: | ---: |
| [2024-12-20](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL) | Yhg1s/optimise_recursive_c | ddb794a (NOGIL) | 1.185x ↓<br>[📄](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-3.12.6.md)[📈](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-3.12.6.svg) | 1.212x ↓<br>[📄](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-3.13.0rc2.md)[📈](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-3.13.0rc2.svg) | 1.003x ↑<br>[📄](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-base.md)[📈](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-base.svg)[🧠](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-base-mem.svg) |
| [2024-12-20](results/bm-20241220-3.14.0a3%2B-78ffba4-NOGIL) | python/78ffba4221dcb2e39fd5 | 78ffba4 (NOGIL) | 1.188x ↓<br>[📄](results/bm-20241220-3.14.0a3%2B-78ffba4-NOGIL/bm-20241220-vultr-x86_64-python-78ffba4221dcb2e39fd5-3.14.0a3%2B-78ffba4-vs-3.12.6.md)[📈](results/bm-20241220-3.14.0a3%2B-78ffba4-NOGIL/bm-20241220-vultr-x86_64-python-78ffba4221dcb2e39fd5-3.14.0a3%2B-78ffba4-vs-3.12.6.svg) | 1.215x ↓<br>[📄](results/bm-20241220-3.14.0a3%2B-78ffba4-NOGIL/bm-20241220-vultr-x86_64-python-78ffba4221dcb2e39fd5-3.14.0a3%2B-78ffba4-vs-3.13.0rc2.md)[📈](results/bm-20241220-3.14.0a3%2B-78ffba4-NOGIL/bm-20241220-vultr-x86_64-python-78ffba4221dcb2e39fd5-3.14.0a3%2B-78ffba4-vs-3.13.0rc2.svg) | |
| [2024-12-19](results/bm-20241219-3.14.0a3%2B-3876bc7-NOGIL) | mpage/gh_115999_load_attr_ | 3876bc7 (NOGIL) | 1.091x ↓<br>[📄](results/bm-20241219-3.14.0a3%2B-3876bc7-NOGIL/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-3.12.6.md)[📈](results/bm-20241219-3.14.0a3%2B-3876bc7-NOGIL/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-3.12.6.svg) | 1.120x ↓<br>[📄](results/bm-20241219-3.14.0a3%2B-3876bc7-NOGIL/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-3.13.0rc2.md)[📈](results/bm-20241219-3.14.0a3%2B-3876bc7-NOGIL/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-3.13.0rc2.svg) | 1.116x ↑<br>[📄](results/bm-20241219-3.14.0a3%2B-3876bc7-NOGIL/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-base.md)[📈](results/bm-20241219-3.14.0a3%2B-3876bc7-NOGIL/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-base.svg)[🧠](results/bm-20241219-3.14.0a3%2B-3876bc7-NOGIL/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-base-mem.svg) |
| [2024-12-19](results/bm-20241219-3.14.0a3%2B-3876bc7) | mpage/gh_115999_load_attr_ | 3876bc7 | 1.094x ↑<br>[📄](results/bm-20241219-3.14.0a3%2B-3876bc7/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-3.12.6.md)[📈](results/bm-20241219-3.14.0a3%2B-3876bc7/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-3.12.6.svg) | 1.055x ↑<br>[📄](results/bm-20241219-3.14.0a3%2B-3876bc7/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-3.13.0rc2.md)[📈](results/bm-20241219-3.14.0a3%2B-3876bc7/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-3.13.0rc2.svg) | 1.008x ↑<br>[📄](results/bm-20241219-3.14.0a3%2B-3876bc7/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-base.md)[📈](results/bm-20241219-3.14.0a3%2B-3876bc7/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-base.svg)[🧠](results/bm-20241219-3.14.0a3%2B-3876bc7/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-base-mem.svg) |
| [2024-12-19](results/bm-20241219-3.14.0a3%2B-39e69a7) | python/39e69a7cd54d44c9061d | 39e69a7 | 1.084x ↑<br>[📄](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.12.6.md)[📈](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.12.6.svg) | 1.046x ↑<br>[📄](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.13.0rc2.md)[📈](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.13.0rc2.svg) | |
Expand Down
2 changes: 2 additions & 0 deletions RESULTS.md
Original file line number Diff line number Diff line change
Expand Up @@ -205,6 +205,8 @@
## linux x86_64 (vultr)
| date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: |
| --- | --- | --- | ---: | ---: | ---: |
| [2024-12-20](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL) | Yhg1s/optimise_recursive_c | ddb794a (NOGIL) | 1.185x ↓<br>[📄](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-3.12.6.md)[📈](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-3.12.6.svg) | 1.212x ↓<br>[📄](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-3.13.0rc2.md)[📈](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-3.13.0rc2.svg) | 1.003x ↑<br>[📄](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-base.md)[📈](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-base.svg)[🧠](results/bm-20241220-3.14.0a3%2B-ddb794a-NOGIL/bm-20241220-vultr-x86_64-Yhg1s-optimise_recursive_c-3.14.0a3%2B-ddb794a-vs-base-mem.svg) |
| [2024-12-20](results/bm-20241220-3.14.0a3%2B-78ffba4-NOGIL) | python/78ffba4221dcb2e39fd5 | 78ffba4 (NOGIL) | 1.188x ↓<br>[📄](results/bm-20241220-3.14.0a3%2B-78ffba4-NOGIL/bm-20241220-vultr-x86_64-python-78ffba4221dcb2e39fd5-3.14.0a3%2B-78ffba4-vs-3.12.6.md)[📈](results/bm-20241220-3.14.0a3%2B-78ffba4-NOGIL/bm-20241220-vultr-x86_64-python-78ffba4221dcb2e39fd5-3.14.0a3%2B-78ffba4-vs-3.12.6.svg) | 1.215x ↓<br>[📄](results/bm-20241220-3.14.0a3%2B-78ffba4-NOGIL/bm-20241220-vultr-x86_64-python-78ffba4221dcb2e39fd5-3.14.0a3%2B-78ffba4-vs-3.13.0rc2.md)[📈](results/bm-20241220-3.14.0a3%2B-78ffba4-NOGIL/bm-20241220-vultr-x86_64-python-78ffba4221dcb2e39fd5-3.14.0a3%2B-78ffba4-vs-3.13.0rc2.svg) | |
| [2024-12-19](results/bm-20241219-3.14.0a3%2B-3876bc7-NOGIL) | mpage/gh_115999_load_attr_ | 3876bc7 (NOGIL) | 1.091x ↓<br>[📄](results/bm-20241219-3.14.0a3%2B-3876bc7-NOGIL/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-3.12.6.md)[📈](results/bm-20241219-3.14.0a3%2B-3876bc7-NOGIL/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-3.12.6.svg) | 1.120x ↓<br>[📄](results/bm-20241219-3.14.0a3%2B-3876bc7-NOGIL/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-3.13.0rc2.md)[📈](results/bm-20241219-3.14.0a3%2B-3876bc7-NOGIL/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-3.13.0rc2.svg) | 1.116x ↑<br>[📄](results/bm-20241219-3.14.0a3%2B-3876bc7-NOGIL/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-base.md)[📈](results/bm-20241219-3.14.0a3%2B-3876bc7-NOGIL/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-base.svg)[🧠](results/bm-20241219-3.14.0a3%2B-3876bc7-NOGIL/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-base-mem.svg) |
| [2024-12-19](results/bm-20241219-3.14.0a3%2B-3876bc7) | mpage/gh_115999_load_attr_ | 3876bc7 | 1.094x ↑<br>[📄](results/bm-20241219-3.14.0a3%2B-3876bc7/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-3.12.6.md)[📈](results/bm-20241219-3.14.0a3%2B-3876bc7/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-3.12.6.svg) | 1.055x ↑<br>[📄](results/bm-20241219-3.14.0a3%2B-3876bc7/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-3.13.0rc2.md)[📈](results/bm-20241219-3.14.0a3%2B-3876bc7/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-3.13.0rc2.svg) | 1.008x ↑<br>[📄](results/bm-20241219-3.14.0a3%2B-3876bc7/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-base.md)[📈](results/bm-20241219-3.14.0a3%2B-3876bc7/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-base.svg)[🧠](results/bm-20241219-3.14.0a3%2B-3876bc7/bm-20241219-vultr-x86_64-mpage-gh_115999_load_attr_-3.14.0a3%2B-3876bc7-vs-base-mem.svg) |
| [2024-12-19](results/bm-20241219-3.14.0a3%2B-39e69a7) | python/39e69a7cd54d44c9061d | 39e69a7 | 1.084x ↑<br>[📄](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.12.6.md)[📈](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.12.6.svg) | 1.046x ↑<br>[📄](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.13.0rc2.md)[📈](results/bm-20241219-3.14.0a3%2B-39e69a7/bm-20241219-vultr-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3%2B-39e69a7-vs-3.13.0rc2.svg) | |
Expand Down
35 changes: 35 additions & 0 deletions results/bm-20241220-3.14.0a3+-78ffba4-NOGIL/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@
# Results

- fork: python/78ffba4221dcb2e39fd5
- version: 3.14.0a3+
- config: NOGIL
- commit hash: [78ffba4](https://github.com/python/cpython/commit/78ffba4)
- commit date: 2024-12-20T14:28:18+01:00
- commit merge base: [ba45e5cdd41a39ce0b3de08bdcfa9d8e28e0e4f3](https://github.com/python/cpython/commit/ba45e5cdd41a39ce0b3de08bdcfa9d8e28e0e4f3)
- ref: 78ffba4221dcb2e39fd5

## linux x86_64 (vultr)

- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/12434814924)
- cpu model: Intel(R) Xeon(R) E-2286G CPU @ 4.00GHz
- platform: Linux-6.8.0-45-generic-x86_64-with-glibc2.39
- [raw results](bm-20241220-vultr-x86_64-python-78ffba4221dcb2e39fd5-3.14.0a3%2B-78ffba4.json)

### vs. 3.12.6

- Geometric mean: 1.188x slower (HPT: reliability of 100.00%, 1.15x slower at 99th %ile)
- Memory usage: 1.34x
- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, mypy2, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list
- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, subparsers
- [📄table](bm-20241220-vultr-x86_64-python-78ffba4221dcb2e39fd5-3.14.0a3%2B-78ffba4-vs-3.12.6.md)
- [📈time plot](bm-20241220-vultr-x86_64-python-78ffba4221dcb2e39fd5-3.14.0a3%2B-78ffba4-vs-3.12.6.svg)

### vs. 3.13.0rc2

- Geometric mean: 1.215x slower (HPT: reliability of 100.00%, 1.16x slower at 99th %ile)
- Memory usage: 1.32x
- missing benchmarks: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list
- new benchmarks: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers
- [📄table](bm-20241220-vultr-x86_64-python-78ffba4221dcb2e39fd5-3.14.0a3%2B-78ffba4-vs-3.13.0rc2.md)
- [📈time plot](bm-20241220-vultr-x86_64-python-78ffba4221dcb2e39fd5-3.14.0a3%2B-78ffba4-vs-3.13.0rc2.svg)

Loading

0 comments on commit 271c22c

Please sign in to comment.