Skip to content

Latest commit

 

History

History
167 lines (140 loc) · 18.2 KB

bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3-vs-3.13.0rc2.md

File metadata and controls

167 lines (140 loc) · 18.2 KB
Raw

Results vs. 3.13.0rc2

  • fork: python
  • ref: 2a66dd33dfc0b845042d
  • machine: linux-x86_64
  • commit hash: 2a66dd3
  • commit date: 2024-12-20
  • overall geometric mean: 1.059x faster
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.02x faster
  • Memory change: 1.13x

Benchmarks with tag 'apps':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3
2to3 445 ms 478 ms: 1.07x slower
docutils 4.01 sec 3.78 sec: 1.06x faster
html5lib 92.6 ms 82.3 ms: 1.12x faster
Geometric mean (ref) 1.04x faster

Benchmarks with tag 'asyncio':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3
async_tree_io 1.39 sec 903 ms: 1.54x faster
async_tree_io_tg 1.40 sec 913 ms: 1.54x faster
async_tree_memoization 709 ms 480 ms: 1.48x faster
async_tree_none 572 ms 397 ms: 1.44x faster
async_tree_none_tg 504 ms 358 ms: 1.41x faster
async_tree_memoization_tg 670 ms 490 ms: 1.37x faster
async_tree_cpu_io_mixed 889 ms 698 ms: 1.27x faster
async_tree_cpu_io_mixed_tg 852 ms 688 ms: 1.24x faster
async_generators 567 ms 548 ms: 1.04x faster
Geometric mean (ref) 1.29x faster

Benchmark hidden because not significant (2): asyncio_websockets, coroutines

Benchmarks with tag 'math':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3
float 116 ms 110 ms: 1.06x faster
nbody 119 ms 129 ms: 1.09x slower
Geometric mean (ref) 1.02x slower

Benchmark hidden because not significant (1): pidigits

Benchmarks with tag 'regex':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3
regex_effbot 4.74 ms 4.33 ms: 1.09x faster
regex_dna 282 ms 271 ms: 1.04x faster
Geometric mean (ref) 1.04x faster

Benchmark hidden because not significant (2): regex_compile, regex_v8

Benchmarks with tag 'serialize':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3
tomli_loads 2.78 sec 2.49 sec: 1.12x faster
xml_etree_parse 231 ms 219 ms: 1.06x faster
json_dumps 14.1 ms 15.1 ms: 1.07x slower
Geometric mean (ref) 1.00x slower

Benchmark hidden because not significant (6): xml_etree_iterparse, json_loads, xml_etree_process, xml_etree_generate, unpickle_pure_python, pickle_pure_python

Benchmarks with tag 'startup':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3
python_startup_no_site 15.3 ms 14.8 ms: 1.03x faster
python_startup 22.4 ms 26.6 ms: 1.19x slower
Geometric mean (ref) 1.07x slower

Benchmarks with tag 'template':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3
genshi_xml 72.1 ms 62.9 ms: 1.15x faster
Geometric mean (ref) 1.03x faster

Benchmark hidden because not significant (3): genshi_text, django_template, mako

All benchmarks:

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3
async_tree_io 1.39 sec 903 ms: 1.54x faster
async_tree_io_tg 1.40 sec 913 ms: 1.54x faster
deepcopy 498 us 332 us: 1.50x faster
async_tree_memoization 709 ms 480 ms: 1.48x faster
async_tree_none 572 ms 397 ms: 1.44x faster
async_tree_none_tg 504 ms 358 ms: 1.41x faster
async_tree_memoization_tg 670 ms 490 ms: 1.37x faster
go 191 ms 148 ms: 1.29x faster
async_tree_cpu_io_mixed 889 ms 698 ms: 1.27x faster
telco 12.2 ms 9.66 ms: 1.26x faster
deepcopy_memo 50.1 us 40.4 us: 1.24x faster
async_tree_cpu_io_mixed_tg 852 ms 688 ms: 1.24x faster
pylint 470 ms 392 ms: 1.20x faster
spectral_norm 157 ms 131 ms: 1.19x faster
richards 65.5 ms 56.3 ms: 1.16x faster
genshi_xml 72.1 ms 62.9 ms: 1.15x faster
scimark_sparse_mat_mult 6.76 ms 5.91 ms: 1.14x faster
html5lib 92.6 ms 82.3 ms: 1.12x faster
scimark_sor 179 ms 159 ms: 1.12x faster
sqlite_synth 3.99 us 3.57 us: 1.12x faster
tomli_loads 2.78 sec 2.49 sec: 1.12x faster
deepcopy_reduce 4.10 us 3.68 us: 1.11x faster
typing_runtime_protocols 226 us 205 us: 1.10x faster
regex_effbot 4.74 ms 4.33 ms: 1.09x faster
pprint_safe_repr 987 ms 918 ms: 1.08x faster
chaos 83.6 ms 78.1 ms: 1.07x faster
bpe_tokeniser 6.28 sec 5.91 sec: 1.06x faster
docutils 4.01 sec 3.78 sec: 1.06x faster
sqlglot_normalize 140 ms 132 ms: 1.06x faster
pprint_pformat 1.94 sec 1.83 sec: 1.06x faster
float 116 ms 110 ms: 1.06x faster
xml_etree_parse 231 ms 219 ms: 1.06x faster
logging_format 9.24 us 8.76 us: 1.05x faster
pycparser 1.57 sec 1.49 sec: 1.05x faster
mdp 3.80 sec 3.62 sec: 1.05x faster
sympy_sum 210 ms 201 ms: 1.05x faster
pyflate 664 ms 637 ms: 1.04x faster
regex_dna 282 ms 271 ms: 1.04x faster
async_generators 567 ms 548 ms: 1.04x faster
python_startup_no_site 15.3 ms 14.8 ms: 1.03x faster
raytrace 344 ms 356 ms: 1.03x slower
scimark_lu 146 ms 154 ms: 1.05x slower
hexiom 8.11 ms 8.56 ms: 1.06x slower
dulwich_log 93.7 ms 99.3 ms: 1.06x slower
json_dumps 14.1 ms 15.1 ms: 1.07x slower
2to3 445 ms 478 ms: 1.07x slower
nbody 119 ms 129 ms: 1.09x slower
bench_thread_pool 2.89 ms 3.32 ms: 1.15x slower
python_startup 22.4 ms 26.6 ms: 1.19x slower
gc_traversal 5.70 ms 8.77 ms: 1.54x slower
create_gc_cycles 2.41 ms 3.72 ms: 1.54x slower
bench_mp_pool 18.7 ms 95.5 ms: 5.11x slower
Geometric mean (ref) 1.04x faster

Benchmark hidden because not significant (36): logging_simple, sympy_integrate, regex_compile, meteor_contest, thrift, asyncio_websockets, sqlglot_optimize, coroutines, crypto_pyaes, scimark_monte_carlo, pathlib, generators, fannkuch, sympy_str, xml_etree_iterparse, deltablue, coverage, genshi_text, regex_v8, richards_super, json, nqueens, json_loads, sqlglot_transpile, scimark_fft, django_template, sympy_expand, mako, xml_etree_process, sqlglot_parse, pidigits, logging_silent, comprehensions, xml_etree_generate, unpickle_pure_python, pickle_pure_python Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list Ignored benchmarks (8) of results/bm-20241220-3.14.0a3+-2a66dd3/bm-20241220-linux-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers

  • Geometric mean (including insignificant results): 1.059x faster

HPT report

  • Reliability score: 100.00% likely to be faster
  • 90% likely to have a speedup of 1.03x
  • 95% likely to have a speedup of 1.03x
  • 99% likely to have a speedup of 1.02x

Memory

  • memory change: 1.13x