Benchmarking results for @mpage

facebookexperimental · Nov 6, 2024 · c27f8c2 · c27f8c2
1 parent 7e94433
commit c27f8c2
Show file tree

Hide file tree

Showing 15 changed files with 20,089 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -16,6 +16,8 @@ Here are some recent and important revisions. 👉 [Complete list of results](RE
 | [2024-11-05](results/bm-20241105-3.14.0a1%2B-83ba8c2) | python/83ba8c2bba834c0b92de | 83ba8c2 | 1.12x ↓<br>[📄](results/bm-20241105-3.14.0a1%2B-83ba8c2/bm-20241105-linux-x86_64-python-83ba8c2bba834c0b92de-3.14.0a1%2B-83ba8c2-vs-3.12.6.md)[📈](results/bm-20241105-3.14.0a1%2B-83ba8c2/bm-20241105-linux-x86_64-python-83ba8c2bba834c0b92de-3.14.0a1%2B-83ba8c2-vs-3.12.6.svg) | 1.14x ↓<br>[📄](results/bm-20241105-3.14.0a1%2B-83ba8c2/bm-20241105-linux-x86_64-python-83ba8c2bba834c0b92de-3.14.0a1%2B-83ba8c2-vs-3.13.0rc2.md)[📈](results/bm-20241105-3.14.0a1%2B-83ba8c2/bm-20241105-linux-x86_64-python-83ba8c2bba834c0b92de-3.14.0a1%2B-83ba8c2-vs-3.13.0rc2.svg) |  |
 | [2024-11-04](results/bm-20241104-3.14.0a1%2B-532fc08-NOGIL) | python/532fc08102d62c04d55f | 532fc08 (NOGIL) | 1.57x ↓<br>[📄](results/bm-20241104-3.14.0a1%2B-532fc08-NOGIL/bm-20241104-linux-x86_64-python-532fc08102d62c04d55f-3.14.0a1%2B-532fc08-vs-3.12.6.md)[📈](results/bm-20241104-3.14.0a1%2B-532fc08-NOGIL/bm-20241104-linux-x86_64-python-532fc08102d62c04d55f-3.14.0a1%2B-532fc08-vs-3.12.6.svg) | 1.59x ↓<br>[📄](results/bm-20241104-3.14.0a1%2B-532fc08-NOGIL/bm-20241104-linux-x86_64-python-532fc08102d62c04d55f-3.14.0a1%2B-532fc08-vs-3.13.0rc2.md)[📈](results/bm-20241104-3.14.0a1%2B-532fc08-NOGIL/bm-20241104-linux-x86_64-python-532fc08102d62c04d55f-3.14.0a1%2B-532fc08-vs-3.13.0rc2.svg) | 1.39x ↓<br>[📄](results/bm-20241104-3.14.0a1%2B-532fc08-NOGIL/bm-20241104-linux-x86_64-python-532fc08102d62c04d55f-3.14.0a1%2B-532fc08-vs-base.md)[📈](results/bm-20241104-3.14.0a1%2B-532fc08-NOGIL/bm-20241104-linux-x86_64-python-532fc08102d62c04d55f-3.14.0a1%2B-532fc08-vs-base.svg)[🧠](results/bm-20241104-3.14.0a1%2B-532fc08-NOGIL/bm-20241104-linux-x86_64-python-532fc08102d62c04d55f-3.14.0a1%2B-532fc08-vs-base-mem.svg) |
 | [2024-11-04](results/bm-20241104-3.14.0a1%2B-532fc08) | python/532fc08102d62c04d55f | 532fc08 | 1.13x ↓<br>[📄](results/bm-20241104-3.14.0a1%2B-532fc08/bm-20241104-linux-x86_64-python-532fc08102d62c04d55f-3.14.0a1%2B-532fc08-vs-3.12.6.md)[📈](results/bm-20241104-3.14.0a1%2B-532fc08/bm-20241104-linux-x86_64-python-532fc08102d62c04d55f-3.14.0a1%2B-532fc08-vs-3.12.6.svg) | 1.15x ↓<br>[📄](results/bm-20241104-3.14.0a1%2B-532fc08/bm-20241104-linux-x86_64-python-532fc08102d62c04d55f-3.14.0a1%2B-532fc08-vs-3.13.0rc2.md)[📈](results/bm-20241104-3.14.0a1%2B-532fc08/bm-20241104-linux-x86_64-python-532fc08102d62c04d55f-3.14.0a1%2B-532fc08-vs-3.13.0rc2.svg) |  |
+| [2024-10-31](results/bm-20241031-3.14.0a0-0a68813-NOGIL) | mpage/gh_115999_tlbc_integ | 0a68813 (NOGIL) | 1.49x ↓<br>[📄](results/bm-20241031-3.14.0a0-0a68813-NOGIL/bm-20241031-linux-x86_64-mpage-gh_115999_tlbc_integ-3.14.0a0-0a68813-vs-3.12.6.md)[📈](results/bm-20241031-3.14.0a0-0a68813-NOGIL/bm-20241031-linux-x86_64-mpage-gh_115999_tlbc_integ-3.14.0a0-0a68813-vs-3.12.6.svg) | 1.51x ↓<br>[📄](results/bm-20241031-3.14.0a0-0a68813-NOGIL/bm-20241031-linux-x86_64-mpage-gh_115999_tlbc_integ-3.14.0a0-0a68813-vs-3.13.0rc2.md)[📈](results/bm-20241031-3.14.0a0-0a68813-NOGIL/bm-20241031-linux-x86_64-mpage-gh_115999_tlbc_integ-3.14.0a0-0a68813-vs-3.13.0rc2.svg) | 1.04x ↑<br>[📄](results/bm-20241031-3.14.0a0-0a68813-NOGIL/bm-20241031-linux-x86_64-mpage-gh_115999_tlbc_integ-3.14.0a0-0a68813-vs-base.md)[📈](results/bm-20241031-3.14.0a0-0a68813-NOGIL/bm-20241031-linux-x86_64-mpage-gh_115999_tlbc_integ-3.14.0a0-0a68813-vs-base.svg)[🧠](results/bm-20241031-3.14.0a0-0a68813-NOGIL/bm-20241031-linux-x86_64-mpage-gh_115999_tlbc_integ-3.14.0a0-0a68813-vs-base-mem.svg) |
+| [2024-10-13](results/bm-20241013-3.14.0a0-f1d33db-NOGIL) | python/f1d33dbddd3496b062e1 | f1d33db (NOGIL) | 1.55x ↓<br>[📄](results/bm-20241013-3.14.0a0-f1d33db-NOGIL/bm-20241013-linux-x86_64-python-f1d33dbddd3496b062e1-3.14.0a0-f1d33db-vs-3.12.6.md)[📈](results/bm-20241013-3.14.0a0-f1d33db-NOGIL/bm-20241013-linux-x86_64-python-f1d33dbddd3496b062e1-3.14.0a0-f1d33db-vs-3.12.6.svg) | 1.57x ↓<br>[📄](results/bm-20241013-3.14.0a0-f1d33db-NOGIL/bm-20241013-linux-x86_64-python-f1d33dbddd3496b062e1-3.14.0a0-f1d33db-vs-3.13.0rc2.md)[📈](results/bm-20241013-3.14.0a0-f1d33db-NOGIL/bm-20241013-linux-x86_64-python-f1d33dbddd3496b062e1-3.14.0a0-f1d33db-vs-3.13.0rc2.svg) |  |
 
 ## linux x86_64 (vultr)
 | date | fork/ref | hash/flags | vs. 3.12.6: | vs. 3.13.0rc2: | vs. base: |

diff --git a/RESULTS.md b/RESULTS.md
@@ -14,6 +14,8 @@
 | [2024-10-22](results/bm-20241022-3.14.0a1%2B-34653bb-NOGIL) | python/34653bba644aa5481613 | 34653bb (NOGIL) | 1.48x ↓<br>[📄](results/bm-20241022-3.14.0a1%2B-34653bb-NOGIL/bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1%2B-34653bb-vs-3.12.6.md)[📈](results/bm-20241022-3.14.0a1%2B-34653bb-NOGIL/bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1%2B-34653bb-vs-3.12.6.svg) | 1.50x ↓<br>[📄](results/bm-20241022-3.14.0a1%2B-34653bb-NOGIL/bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1%2B-34653bb-vs-3.13.0rc2.md)[📈](results/bm-20241022-3.14.0a1%2B-34653bb-NOGIL/bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1%2B-34653bb-vs-3.13.0rc2.svg) | 1.43x ↓<br>[📄](results/bm-20241022-3.14.0a1%2B-34653bb-NOGIL/bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1%2B-34653bb-vs-base.md)[📈](results/bm-20241022-3.14.0a1%2B-34653bb-NOGIL/bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1%2B-34653bb-vs-base.svg)[🧠](results/bm-20241022-3.14.0a1%2B-34653bb-NOGIL/bm-20241022-linux-x86_64-python-34653bba644aa5481613-3.14.0a1%2B-34653bb-vs-base-mem.svg) |
 | [2024-10-21](results/bm-20241021-3.14.0a1%2B-d0bfff4) | python/d0bfff47fb2aea9272b5 | d0bfff4 | 1.00x ↑<br>[📄](results/bm-20241021-3.14.0a1%2B-d0bfff4/bm-20241021-linux-x86_64-python-d0bfff47fb2aea9272b5-3.14.0a1%2B-d0bfff4-vs-3.12.6.md)[📈](results/bm-20241021-3.14.0a1%2B-d0bfff4/bm-20241021-linux-x86_64-python-d0bfff47fb2aea9272b5-3.14.0a1%2B-d0bfff4-vs-3.12.6.svg) | 1.01x ↓<br>[📄](results/bm-20241021-3.14.0a1%2B-d0bfff4/bm-20241021-linux-x86_64-python-d0bfff47fb2aea9272b5-3.14.0a1%2B-d0bfff4-vs-3.13.0rc2.md)[📈](results/bm-20241021-3.14.0a1%2B-d0bfff4/bm-20241021-linux-x86_64-python-d0bfff47fb2aea9272b5-3.14.0a1%2B-d0bfff4-vs-3.13.0rc2.svg) |  |
 | [2024-10-21](results/bm-20241021-3.14.0a1%2B-d0bfff4-NOGIL) | python/d0bfff47fb2aea9272b5 | d0bfff4 (NOGIL) | 1.51x ↓<br>[📄](results/bm-20241021-3.14.0a1%2B-d0bfff4-NOGIL/bm-20241021-linux-x86_64-python-d0bfff47fb2aea9272b5-3.14.0a1%2B-d0bfff4-vs-3.12.6.md)[📈](results/bm-20241021-3.14.0a1%2B-d0bfff4-NOGIL/bm-20241021-linux-x86_64-python-d0bfff47fb2aea9272b5-3.14.0a1%2B-d0bfff4-vs-3.12.6.svg) | 1.53x ↓<br>[📄](results/bm-20241021-3.14.0a1%2B-d0bfff4-NOGIL/bm-20241021-linux-x86_64-python-d0bfff47fb2aea9272b5-3.14.0a1%2B-d0bfff4-vs-3.13.0rc2.md)[📈](results/bm-20241021-3.14.0a1%2B-d0bfff4-NOGIL/bm-20241021-linux-x86_64-python-d0bfff47fb2aea9272b5-3.14.0a1%2B-d0bfff4-vs-3.13.0rc2.svg) | 1.51x ↓<br>[📄](results/bm-20241021-3.14.0a1%2B-d0bfff4-NOGIL/bm-20241021-linux-x86_64-python-d0bfff47fb2aea9272b5-3.14.0a1%2B-d0bfff4-vs-base.md)[📈](results/bm-20241021-3.14.0a1%2B-d0bfff4-NOGIL/bm-20241021-linux-x86_64-python-d0bfff47fb2aea9272b5-3.14.0a1%2B-d0bfff4-vs-base.svg)[🧠](results/bm-20241021-3.14.0a1%2B-d0bfff4-NOGIL/bm-20241021-linux-x86_64-python-d0bfff47fb2aea9272b5-3.14.0a1%2B-d0bfff4-vs-base-mem.svg) |
+| [2024-10-31](results/bm-20241031-3.14.0a0-0a68813-NOGIL) | mpage/gh_115999_tlbc_integ | 0a68813 (NOGIL) | 1.49x ↓<br>[📄](results/bm-20241031-3.14.0a0-0a68813-NOGIL/bm-20241031-linux-x86_64-mpage-gh_115999_tlbc_integ-3.14.0a0-0a68813-vs-3.12.6.md)[📈](results/bm-20241031-3.14.0a0-0a68813-NOGIL/bm-20241031-linux-x86_64-mpage-gh_115999_tlbc_integ-3.14.0a0-0a68813-vs-3.12.6.svg) | 1.51x ↓<br>[📄](results/bm-20241031-3.14.0a0-0a68813-NOGIL/bm-20241031-linux-x86_64-mpage-gh_115999_tlbc_integ-3.14.0a0-0a68813-vs-3.13.0rc2.md)[📈](results/bm-20241031-3.14.0a0-0a68813-NOGIL/bm-20241031-linux-x86_64-mpage-gh_115999_tlbc_integ-3.14.0a0-0a68813-vs-3.13.0rc2.svg) | 1.04x ↑<br>[📄](results/bm-20241031-3.14.0a0-0a68813-NOGIL/bm-20241031-linux-x86_64-mpage-gh_115999_tlbc_integ-3.14.0a0-0a68813-vs-base.md)[📈](results/bm-20241031-3.14.0a0-0a68813-NOGIL/bm-20241031-linux-x86_64-mpage-gh_115999_tlbc_integ-3.14.0a0-0a68813-vs-base.svg)[🧠](results/bm-20241031-3.14.0a0-0a68813-NOGIL/bm-20241031-linux-x86_64-mpage-gh_115999_tlbc_integ-3.14.0a0-0a68813-vs-base-mem.svg) |
+| [2024-10-13](results/bm-20241013-3.14.0a0-f1d33db-NOGIL) | python/f1d33dbddd3496b062e1 | f1d33db (NOGIL) | 1.55x ↓<br>[📄](results/bm-20241013-3.14.0a0-f1d33db-NOGIL/bm-20241013-linux-x86_64-python-f1d33dbddd3496b062e1-3.14.0a0-f1d33db-vs-3.12.6.md)[📈](results/bm-20241013-3.14.0a0-f1d33db-NOGIL/bm-20241013-linux-x86_64-python-f1d33dbddd3496b062e1-3.14.0a0-f1d33db-vs-3.12.6.svg) | 1.57x ↓<br>[📄](results/bm-20241013-3.14.0a0-f1d33db-NOGIL/bm-20241013-linux-x86_64-python-f1d33dbddd3496b062e1-3.14.0a0-f1d33db-vs-3.13.0rc2.md)[📈](results/bm-20241013-3.14.0a0-f1d33db-NOGIL/bm-20241013-linux-x86_64-python-f1d33dbddd3496b062e1-3.14.0a0-f1d33db-vs-3.13.0rc2.svg) |  |
 | [2024-09-30](results/bm-20240930-3.14.0a0-e44eebf) | python/main | e44eebf | not sig<br>[📄](results/bm-20240930-3.14.0a0-e44eebf/bm-20240930-linux-x86_64-python-main-3.14.0a0-e44eebf-vs-3.12.6.md)[📈](results/bm-20240930-3.14.0a0-e44eebf/bm-20240930-linux-x86_64-python-main-3.14.0a0-e44eebf-vs-3.12.6.svg) | not sig<br>[📄](results/bm-20240930-3.14.0a0-e44eebf/bm-20240930-linux-x86_64-python-main-3.14.0a0-e44eebf-vs-3.13.0rc2.md)[📈](results/bm-20240930-3.14.0a0-e44eebf/bm-20240930-linux-x86_64-python-main-3.14.0a0-e44eebf-vs-3.13.0rc2.svg) |  |
 | [2024-09-30](results/bm-20240930-3.14.0a0-fac5e7a) | python/fac5e7aa171f8547fcb5 | fac5e7a | not sig<br>[📄](results/bm-20240930-3.14.0a0-fac5e7a/bm-20240930-linux-x86_64-python-fac5e7aa171f8547fcb5-3.14.0a0-fac5e7a-vs-3.12.6.md)[📈](results/bm-20240930-3.14.0a0-fac5e7a/bm-20240930-linux-x86_64-python-fac5e7aa171f8547fcb5-3.14.0a0-fac5e7a-vs-3.12.6.svg) | not sig<br>[📄](results/bm-20240930-3.14.0a0-fac5e7a/bm-20240930-linux-x86_64-python-fac5e7aa171f8547fcb5-3.14.0a0-fac5e7a-vs-3.13.0rc2.md)[📈](results/bm-20240930-3.14.0a0-fac5e7a/bm-20240930-linux-x86_64-python-fac5e7aa171f8547fcb5-3.14.0a0-fac5e7a-vs-3.13.0rc2.svg) |  |
 | [2024-09-30](results/bm-20240930-3.14.0a0-fac5e7a-NOGIL) | python/fac5e7aa171f8547fcb5 | fac5e7a (NOGIL) | not sig<br>[📄](results/bm-20240930-3.14.0a0-fac5e7a-NOGIL/bm-20240930-linux-x86_64-python-fac5e7aa171f8547fcb5-3.14.0a0-fac5e7a-vs-3.12.6.md)[📈](results/bm-20240930-3.14.0a0-fac5e7a-NOGIL/bm-20240930-linux-x86_64-python-fac5e7aa171f8547fcb5-3.14.0a0-fac5e7a-vs-3.12.6.svg) | not sig<br>[📄](results/bm-20240930-3.14.0a0-fac5e7a-NOGIL/bm-20240930-linux-x86_64-python-fac5e7aa171f8547fcb5-3.14.0a0-fac5e7a-vs-3.13.0rc2.md)[📈](results/bm-20240930-3.14.0a0-fac5e7a-NOGIL/bm-20240930-linux-x86_64-python-fac5e7aa171f8547fcb5-3.14.0a0-fac5e7a-vs-3.13.0rc2.svg) | not sig<br>[📄](results/bm-20240930-3.14.0a0-fac5e7a-NOGIL/bm-20240930-linux-x86_64-python-fac5e7aa171f8547fcb5-3.14.0a0-fac5e7a-vs-base.md)[📈](results/bm-20240930-3.14.0a0-fac5e7a-NOGIL/bm-20240930-linux-x86_64-python-fac5e7aa171f8547fcb5-3.14.0a0-fac5e7a-vs-base.svg)[🧠](results/bm-20240930-3.14.0a0-fac5e7a-NOGIL/bm-20240930-linux-x86_64-python-fac5e7aa171f8547fcb5-3.14.0a0-fac5e7a-vs-base-mem.svg) |

diff --git a/results/bm-20241013-3.14.0a0-f1d33db-NOGIL/README.md b/results/bm-20241013-3.14.0a0-f1d33db-NOGIL/README.md
@@ -8,6 +8,29 @@
 - commit merge base: [cb8e5995d89d9b90e83cf43310ec50e177484e70](https://github.com/python/cpython/commit/cb8e5995d89d9b90e83cf43310ec50e177484e70)
 - ref: f1d33dbddd3496b062e1
 
+## linux x86_64 (linux)
+
+- [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/11695013805)
+- cpu model: Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
+- platform: Linux-5.15.0-1071-aws-x86_64-with-glibc2.31
+- [raw results](bm-20241013-linux-x86_64-python-f1d33dbddd3496b062e1-3.14.0a0-f1d33db.json)
+
+### vs. 3.12.6
+
+- Geometric mean: 1.55x slower (HPT: reliability of 100.00%, 1.43x slower at 99th %ile)
+- Memory usage: 1.17x
+- missing benchmarks: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn, mypy2, sqlalchemy_declarative, sqlalchemy_imperative
+- [📄table](bm-20241013-linux-x86_64-python-f1d33dbddd3496b062e1-3.14.0a0-f1d33db-vs-3.12.6.md)
+- [📈time plot](bm-20241013-linux-x86_64-python-f1d33dbddd3496b062e1-3.14.0a0-f1d33db-vs-3.12.6.svg)
+
+### vs. 3.13.0rc2
+
+- Geometric mean: 1.57x slower (HPT: reliability of 100.00%, 1.44x slower at 99th %ile)
+- Memory usage: 1.16x
+- missing benchmarks: aiohttp, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_io, async_tree_io_tg, async_tree_memoization, async_tree_memoization_tg, async_tree_none, async_tree_none_tg, chameleon, dask, flaskblogging, gunicorn
+- [📄table](bm-20241013-linux-x86_64-python-f1d33dbddd3496b062e1-3.14.0a0-f1d33db-vs-3.13.0rc2.md)
+- [📈time plot](bm-20241013-linux-x86_64-python-f1d33dbddd3496b062e1-3.14.0a0-f1d33db-vs-3.13.0rc2.svg)
+
 ## linux x86_64 (vultr)
 
 - [GitHub Action run](https://github.com/facebookexperimental/free-threading-benchmarking/actions/runs/11336596568)