Skip to content

Commit

Permalink
Benchmarking results for @mpage
Browse files Browse the repository at this point in the history
  • Loading branch information
mpage committed Nov 21, 2024
1 parent f569bba commit f689685
Show file tree
Hide file tree
Showing 10 changed files with 13,222 additions and 0 deletions.
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,7 @@ Here are some recent and important revisions. 👉 [Complete list of results](RE
## linux x86_64 (vultr)
| date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: |
| --- | --- | --- | ---: | ---: | ---: |
| [2024-11-20](results/bm-20241120-3.14.0a2%2B-8ebd73d) | mpage/gh_115999_tlbc_call | 8ebd73d | 1.00x ↓<br>[📄](results/bm-20241120-3.14.0a2%2B-8ebd73d/bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d-vs-3.12.6.md)[📈](results/bm-20241120-3.14.0a2%2B-8ebd73d/bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d-vs-3.12.6.svg) | 1.02x ↓<br>[📄](results/bm-20241120-3.14.0a2%2B-8ebd73d/bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d-vs-3.13.0rc2.md)[📈](results/bm-20241120-3.14.0a2%2B-8ebd73d/bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d-vs-3.13.0rc2.svg) | 1.00x ↑<br>[📄](results/bm-20241120-3.14.0a2%2B-8ebd73d/bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d-vs-base.md)[📈](results/bm-20241120-3.14.0a2%2B-8ebd73d/bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d-vs-base.svg)[🧠](results/bm-20241120-3.14.0a2%2B-8ebd73d/bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d-vs-base-mem.svg) |
| [2024-11-20](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL) | python/32428cf9ea03bce6d64c | 32428cf (NOGIL) | 1.54x ↓<br>[📄](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.svg) | 1.56x ↓<br>[📄](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.svg) | 1.53x ↓<br>[📄](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base.svg)[🧠](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base-mem.svg) |
| [2024-11-20](results/bm-20241120-3.14.0a2%2B-32428cf) | python/32428cf9ea03bce6d64c | 32428cf | 1.00x ↓<br>[📄](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.svg) | 1.02x ↓<br>[📄](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.svg) | |
| [2024-11-19](results/bm-20241119-3.14.0a2%2B-c9b399f) | python/c9b399fbdb01584dcfff | c9b399f | 1.01x ↓<br>[📄](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.12.6.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.12.6.svg) | 1.02x ↓<br>[📄](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.13.0rc2.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.13.0rc2.svg) | |
Expand Down
1 change: 1 addition & 0 deletions RESULTS.md
Original file line number Diff line number Diff line change
Expand Up @@ -144,6 +144,7 @@
## linux x86_64 (vultr)
| date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: |
| --- | --- | --- | ---: | ---: | ---: |
| [2024-11-20](results/bm-20241120-3.14.0a2%2B-8ebd73d) | mpage/gh_115999_tlbc_call | 8ebd73d | 1.00x ↓<br>[📄](results/bm-20241120-3.14.0a2%2B-8ebd73d/bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d-vs-3.12.6.md)[📈](results/bm-20241120-3.14.0a2%2B-8ebd73d/bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d-vs-3.12.6.svg) | 1.02x ↓<br>[📄](results/bm-20241120-3.14.0a2%2B-8ebd73d/bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d-vs-3.13.0rc2.md)[📈](results/bm-20241120-3.14.0a2%2B-8ebd73d/bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d-vs-3.13.0rc2.svg) | 1.00x ↑<br>[📄](results/bm-20241120-3.14.0a2%2B-8ebd73d/bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d-vs-base.md)[📈](results/bm-20241120-3.14.0a2%2B-8ebd73d/bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d-vs-base.svg)[🧠](results/bm-20241120-3.14.0a2%2B-8ebd73d/bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d-vs-base-mem.svg) |
| [2024-11-20](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL) | python/32428cf9ea03bce6d64c | 32428cf (NOGIL) | 1.54x ↓<br>[📄](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.svg) | 1.56x ↓<br>[📄](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.svg) | 1.53x ↓<br>[📄](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base.svg)[🧠](results/bm-20241120-3.14.0a2%2B-32428cf-NOGIL/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-base-mem.svg) |
| [2024-11-20](results/bm-20241120-3.14.0a2%2B-32428cf) | python/32428cf9ea03bce6d64c | 32428cf | 1.00x ↓<br>[📄](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.12.6.svg) | 1.02x ↓<br>[📄](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.md)[📈](results/bm-20241120-3.14.0a2%2B-32428cf/bm-20241120-vultr-x86_64-python-32428cf9ea03bce6d64c-3.14.0a2%2B-32428cf-vs-3.13.0rc2.svg) | |
| [2024-11-19](results/bm-20241119-3.14.0a2%2B-c9b399f) | python/c9b399fbdb01584dcfff | c9b399f | 1.01x ↓<br>[📄](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.12.6.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.12.6.svg) | 1.02x ↓<br>[📄](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.13.0rc2.md)[📈](results/bm-20241119-3.14.0a2%2B-c9b399f/bm-20241119-vultr-x86_64-python-c9b399fbdb01584dcfff-3.14.0a2%2B-c9b399f-vs-3.13.0rc2.svg) | |
Expand Down
41 changes: 41 additions & 0 deletions results/bm-20241120-3.14.0a2+-8ebd73d/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,41 @@
# Results

- fork: mpage
- version: 3.14.0a2+
- config:
- commit hash: [8ebd73d](https://github.com/mpage/cpython/commit/8ebd73d)
- commit date: 2024-11-20T22:27:45-08:00
- commit merge base: [32428cf9ea03bce6d64c7acd28e0b7d92774eb53](https://github.com/mpage/cpython/commit/32428cf9ea03bce6d64c7acd28e0b7d92774eb53)
- ref: gh_115999_tlbc_call

## linux x86_64 (vultr)

- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/11959013491)
- cpu model: Intel(R) Xeon(R) E-2286G CPU @ 4.00GHz
- platform: Linux-6.8.0-45-generic-x86_64-with-glibc2.39
- [raw results](bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d.json)

### vs. 3.12.6

- Geometric mean: 1.00x slower (HPT: reliability of 90.85%, 1.00x faster at 99th %ile)
- Memory usage: 1.02x
- missing benchmarks: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, mypy2, sqlalchemy_declarative, sqlalchemy_imperative, tornado_http
- [📄table](bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d-vs-3.12.6.md)
- [📈time plot](bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d-vs-3.12.6.svg)

### vs. 3.13.0rc2

- Geometric mean: 1.02x slower (HPT: reliability of 90.85%, 1.00x slower at 99th %ile)
- Memory usage: 1.01x
- missing benchmarks: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, tornado_http
- [📄table](bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d-vs-3.13.0rc2.md)
- [📈time plot](bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d-vs-3.13.0rc2.svg)

### vs. base

- Geometric mean: 1.00x faster (HPT: reliability of 59.05%, 1.00x faster at 99th %ile)
- Memory usage: 1.00x
- [🧠memory plot](bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d-vs-base-mem.svg)
- [📄table](bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d-vs-base.md)
- [📈time plot](bm-20241120-vultr-x86_64-mpage-gh_115999_tlbc_call-3.14.0a2%2B-8ebd73d-vs-base.svg)

Loading

0 comments on commit f689685

Please sign in to comment.