Skip to content

Latest commit

 

History

History
171 lines (144 loc) · 18.8 KB

bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7-vs-3.13.0rc2.md

File metadata and controls

171 lines (144 loc) · 18.8 KB
Raw

Results vs. 3.13.0rc2

  • fork: python
  • ref: 39e69a7cd54d44c9061d
  • machine: linux-x86_64
  • commit hash: 39e69a7
  • commit date: 2024-12-19
  • overall geometric mean: 1.058x faster
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.03x faster
  • Memory change: 1.13x

Benchmarks with tag 'apps':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7
2to3 445 ms 472 ms: 1.06x slower
docutils 4.01 sec 3.74 sec: 1.07x faster
html5lib 92.6 ms 86.3 ms: 1.07x faster
Geometric mean (ref) 1.03x faster

Benchmarks with tag 'asyncio':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7
async_tree_io_tg 1.40 sec 882 ms: 1.59x faster
async_tree_io 1.39 sec 894 ms: 1.55x faster
async_tree_none 572 ms 382 ms: 1.50x faster
async_tree_memoization_tg 670 ms 465 ms: 1.44x faster
async_tree_memoization 709 ms 496 ms: 1.43x faster
async_tree_none_tg 504 ms 397 ms: 1.27x faster
async_tree_cpu_io_mixed_tg 852 ms 710 ms: 1.20x faster
async_tree_cpu_io_mixed 889 ms 777 ms: 1.14x faster
Geometric mean (ref) 1.27x faster

Benchmark hidden because not significant (3): coroutines, asyncio_websockets, async_generators

Benchmarks with tag 'math':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7
pidigits 251 ms 226 ms: 1.11x faster
nbody 119 ms 133 ms: 1.12x slower
Geometric mean (ref) 1.01x faster

Benchmark hidden because not significant (1): float

Benchmarks with tag 'regex':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7
regex_effbot 4.74 ms 4.29 ms: 1.10x faster
regex_compile 182 ms 171 ms: 1.07x faster
Geometric mean (ref) 1.03x faster

Benchmark hidden because not significant (2): regex_v8, regex_dna

Benchmarks with tag 'serialize':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7
xml_etree_iterparse 177 ms 142 ms: 1.25x faster
xml_etree_parse 231 ms 199 ms: 1.16x faster
xml_etree_process 85.9 ms 80.2 ms: 1.07x faster
tomli_loads 2.78 sec 2.63 sec: 1.06x faster
json_dumps 14.1 ms 16.2 ms: 1.15x slower
Geometric mean (ref) 1.04x faster

Benchmark hidden because not significant (4): xml_etree_generate, json_loads, unpickle_pure_python, pickle_pure_python

Benchmarks with tag 'startup':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7
python_startup_no_site 15.3 ms 16.2 ms: 1.06x slower
python_startup 22.4 ms 26.9 ms: 1.20x slower
Geometric mean (ref) 1.13x slower

Benchmarks with tag 'template':

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7
genshi_xml 72.1 ms 67.1 ms: 1.07x faster
genshi_text 31.7 ms 29.5 ms: 1.07x faster
Geometric mean (ref) 1.04x faster

Benchmark hidden because not significant (2): django_template, mako

All benchmarks:

Benchmark bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006 bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7
async_tree_io_tg 1.40 sec 882 ms: 1.59x faster
async_tree_io 1.39 sec 894 ms: 1.55x faster
async_tree_none 572 ms 382 ms: 1.50x faster
async_tree_memoization_tg 670 ms 465 ms: 1.44x faster
async_tree_memoization 709 ms 496 ms: 1.43x faster
deepcopy 498 us 369 us: 1.35x faster
async_tree_none_tg 504 ms 397 ms: 1.27x faster
xml_etree_iterparse 177 ms 142 ms: 1.25x faster
async_tree_cpu_io_mixed_tg 852 ms 710 ms: 1.20x faster
pylint 470 ms 394 ms: 1.19x faster
telco 12.2 ms 10.3 ms: 1.18x faster
richards 65.5 ms 56.4 ms: 1.16x faster
xml_etree_parse 231 ms 199 ms: 1.16x faster
go 191 ms 166 ms: 1.15x faster
deepcopy_memo 50.1 us 43.7 us: 1.15x faster
async_tree_cpu_io_mixed 889 ms 777 ms: 1.14x faster
richards_super 73.2 ms 64.1 ms: 1.14x faster
thrift 1.10 ms 964 us: 1.14x faster
scimark_sor 179 ms 158 ms: 1.13x faster
scimark_sparse_mat_mult 6.76 ms 5.97 ms: 1.13x faster
pidigits 251 ms 226 ms: 1.11x faster
regex_effbot 4.74 ms 4.29 ms: 1.10x faster
sqlite_synth 3.99 us 3.65 us: 1.09x faster
typing_runtime_protocols 226 us 206 us: 1.09x faster
sympy_str 379 ms 348 ms: 1.09x faster
spectral_norm 157 ms 144 ms: 1.08x faster
bpe_tokeniser 6.28 sec 5.80 sec: 1.08x faster
fannkuch 547 ms 506 ms: 1.08x faster
genshi_xml 72.1 ms 67.1 ms: 1.07x faster
genshi_text 31.7 ms 29.5 ms: 1.07x faster
html5lib 92.6 ms 86.3 ms: 1.07x faster
docutils 4.01 sec 3.74 sec: 1.07x faster
xml_etree_process 85.9 ms 80.2 ms: 1.07x faster
sqlglot_transpile 2.20 ms 2.06 ms: 1.07x faster
regex_compile 182 ms 171 ms: 1.07x faster
meteor_contest 150 ms 141 ms: 1.06x faster
pprint_pformat 1.94 sec 1.83 sec: 1.06x faster
pprint_safe_repr 987 ms 932 ms: 1.06x faster
tomli_loads 2.78 sec 2.63 sec: 1.06x faster
pyflate 664 ms 633 ms: 1.05x faster
hexiom 8.11 ms 8.53 ms: 1.05x slower
raytrace 344 ms 362 ms: 1.05x slower
python_startup_no_site 15.3 ms 16.2 ms: 1.06x slower
2to3 445 ms 472 ms: 1.06x slower
json 6.51 ms 7.17 ms: 1.10x slower
nbody 119 ms 133 ms: 1.12x slower
chaos 83.6 ms 94.9 ms: 1.13x slower
logging_silent 130 ns 149 ns: 1.14x slower
json_dumps 14.1 ms 16.2 ms: 1.15x slower
python_startup 22.4 ms 26.9 ms: 1.20x slower
bench_thread_pool 2.89 ms 3.79 ms: 1.31x slower
create_gc_cycles 2.41 ms 3.39 ms: 1.41x slower
gc_traversal 5.70 ms 8.83 ms: 1.55x slower
bench_mp_pool 18.7 ms 94.7 ms: 5.06x slower
Geometric mean (ref) 1.03x faster

Benchmark hidden because not significant (34): logging_simple, sympy_integrate, coroutines, crypto_pyaes, pathlib, float, nqueens, sympy_sum, pycparser, xml_etree_generate, scimark_fft, django_template, mdp, dulwich_log, deltablue, sqlglot_parse, sqlglot_optimize, sympy_expand, coverage, mako, json_loads, sqlglot_normalize, scimark_monte_carlo, unpickle_pure_python, asyncio_websockets, regex_v8, deepcopy_reduce, async_generators, pickle_pure_python, logging_format, generators, regex_dna, comprehensions, scimark_lu Ignored benchmarks (14) of results/bm-20240906-3.13.0rc2-ec61006/bm-20240906-linux-x86_64-python-v3.13.0rc2-3.13.0rc2-ec61006.json: aiohttp, asyncio_tcp, asyncio_tcp_ssl, chameleon, dask, flaskblogging, gunicorn, pickle, pickle_dict, pickle_list, tornado_http, unpack_sequence, unpickle, unpickle_list Ignored benchmarks (8) of results/bm-20241219-3.14.0a3+-39e69a7/bm-20241219-linux-x86_64-python-39e69a7cd54d44c9061d-3.14.0a3+-39e69a7.json: connected_components, k_core, many_optionals, shortest_path, sphinx, sqlalchemy_declarative, sqlalchemy_imperative, subparsers

  • Geometric mean (including insignificant results): 1.058x faster

HPT report

  • Reliability score: 100.00% likely to be faster
  • 90% likely to have a speedup of 1.04x
  • 95% likely to have a speedup of 1.04x
  • 99% likely to have a speedup of 1.03x

Memory

  • memory change: 1.13x