Skip to content

Latest commit

 

History

History
212 lines (189 loc) · 40.8 KB

bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3-vs-base.md

File metadata and controls

212 lines (189 loc) · 40.8 KB
Raw

Results vs. base

  • fork: python
  • ref: 2a66dd33dfc0b845042d
  • machine: linux-x86_64
  • commit hash: 2a66dd3
  • commit date: 2024-12-20
  • overall geometric mean: 1.252x slower
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.24x slower
  • Memory change: 1.18x

Benchmarks with tag 'apps':

Benchmark results/bm-20241220-3.14.0a3+-2a66dd3/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json results/bm-20241220-3.14.0a3+-2a66dd3-NOGIL/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json
2to3 255 ms 362 ms: 1.42x slower
docutils 2.54 sec 3.05 sec: 1.20x slower
sphinx 986 ms 1.16 sec: 1.18x slower
Geometric mean (ref) 1.26x slower

Benchmarks with tag 'asyncio':

Benchmark results/bm-20241220-3.14.0a3+-2a66dd3/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json results/bm-20241220-3.14.0a3+-2a66dd3-NOGIL/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json
asyncio_websockets 523 ms 520 ms: 1.01x faster
coroutines 22.1 ms 24.7 ms: 1.12x slower
async_tree_cpu_io_mixed_tg 481 ms 567 ms: 1.18x slower
async_tree_cpu_io_mixed 499 ms 594 ms: 1.19x slower
async_tree_io_tg 611 ms 735 ms: 1.20x slower
async_tree_io 621 ms 762 ms: 1.23x slower
async_tree_none_tg 254 ms 314 ms: 1.24x slower
async_generators 358 ms 449 ms: 1.25x slower
async_tree_none 276 ms 349 ms: 1.26x slower
async_tree_memoization 334 ms 429 ms: 1.28x slower
async_tree_memoization_tg 305 ms 402 ms: 1.32x slower
Geometric mean (ref) 1.20x slower

Benchmarks with tag 'math':

Benchmark results/bm-20241220-3.14.0a3+-2a66dd3/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json results/bm-20241220-3.14.0a3+-2a66dd3-NOGIL/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json
pidigits 186 ms 183 ms: 1.02x faster
nbody 91.3 ms 131 ms: 1.43x slower
float 76.7 ms 115 ms: 1.50x slower
Geometric mean (ref) 1.28x slower

Benchmarks with tag 'regex':

Benchmark results/bm-20241220-3.14.0a3+-2a66dd3/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json results/bm-20241220-3.14.0a3+-2a66dd3-NOGIL/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json
regex_effbot 2.68 ms 2.79 ms: 1.04x slower
regex_v8 24.1 ms 25.1 ms: 1.04x slower
regex_dna 173 ms 187 ms: 1.08x slower
regex_compile 127 ms 172 ms: 1.35x slower
Geometric mean (ref) 1.12x slower

Benchmarks with tag 'serialize':

Benchmark results/bm-20241220-3.14.0a3+-2a66dd3/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json results/bm-20241220-3.14.0a3+-2a66dd3-NOGIL/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json
xml_etree_parse 128 ms 130 ms: 1.02x slower
json_loads 25.8 us 28.2 us: 1.09x slower
xml_etree_generate 83.5 ms 98.3 ms: 1.18x slower
json_dumps 11.4 ms 14.2 ms: 1.24x slower
xml_etree_process 57.9 ms 74.3 ms: 1.28x slower
tomli_loads 1.92 sec 2.58 sec: 1.34x slower
unpickle_pure_python 213 us 333 us: 1.56x slower
pickle_pure_python 315 us 506 us: 1.61x slower
Geometric mean (ref) 1.24x slower

Benchmark hidden because not significant (1): xml_etree_iterparse

Benchmarks with tag 'startup':

Benchmark results/bm-20241220-3.14.0a3+-2a66dd3/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json results/bm-20241220-3.14.0a3+-2a66dd3-NOGIL/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json
python_startup 14.6 ms 17.2 ms: 1.18x slower
python_startup_no_site 7.46 ms 10.2 ms: 1.37x slower
Geometric mean (ref) 1.27x slower

Benchmarks with tag 'template':

Benchmark results/bm-20241220-3.14.0a3+-2a66dd3/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json results/bm-20241220-3.14.0a3+-2a66dd3-NOGIL/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json
genshi_xml 49.1 ms 63.6 ms: 1.30x slower
genshi_text 21.6 ms 31.1 ms: 1.44x slower
django_template 34.6 ms 50.1 ms: 1.45x slower
mako 11.7 ms 17.4 ms: 1.48x slower
Geometric mean (ref) 1.41x slower

All benchmarks:

Benchmark results/bm-20241220-3.14.0a3+-2a66dd3/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json results/bm-20241220-3.14.0a3+-2a66dd3-NOGIL/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json
gc_traversal 4.54 ms 3.28 ms: 1.38x faster
pidigits 186 ms 183 ms: 1.02x faster
asyncio_websockets 523 ms 520 ms: 1.01x faster
create_gc_cycles 1.82 ms 1.81 ms: 1.01x faster
xml_etree_parse 128 ms 130 ms: 1.02x slower
regex_effbot 2.68 ms 2.79 ms: 1.04x slower
regex_v8 24.1 ms 25.1 ms: 1.04x slower
json 4.75 ms 5.05 ms: 1.06x slower
regex_dna 173 ms 187 ms: 1.08x slower
json_loads 25.8 us 28.2 us: 1.09x slower
pathlib 18.0 ms 20.0 ms: 1.11x slower
coroutines 22.1 ms 24.7 ms: 1.12x slower
spectral_norm 99.9 ms 114 ms: 1.14x slower
k_core 2.05 sec 2.36 sec: 1.15x slower
mdp 2.32 sec 2.70 sec: 1.16x slower
bpe_tokeniser 4.32 sec 5.07 sec: 1.17x slower
telco 7.35 ms 8.64 ms: 1.18x slower
python_startup 14.6 ms 17.2 ms: 1.18x slower
xml_etree_generate 83.5 ms 98.3 ms: 1.18x slower
async_tree_cpu_io_mixed_tg 481 ms 567 ms: 1.18x slower
sphinx 986 ms 1.16 sec: 1.18x slower
async_tree_cpu_io_mixed 499 ms 594 ms: 1.19x slower
docutils 2.54 sec 3.05 sec: 1.20x slower
async_tree_io_tg 611 ms 735 ms: 1.20x slower
many_optionals 1.03 ms 1.25 ms: 1.20x slower
dulwich_log 75.4 ms 91.3 ms: 1.21x slower
bench_mp_pool 88.4 ms 108 ms: 1.22x slower
async_tree_io 621 ms 762 ms: 1.23x slower
scimark_fft 314 ms 388 ms: 1.24x slower
async_tree_none_tg 254 ms 314 ms: 1.24x slower
json_dumps 11.4 ms 14.2 ms: 1.24x slower
async_generators 358 ms 449 ms: 1.25x slower
pycparser 1.11 sec 1.39 sec: 1.25x slower
coverage 79.1 ms 99.3 ms: 1.25x slower
sqlglot_optimize 52.4 ms 66.0 ms: 1.26x slower
async_tree_none 276 ms 349 ms: 1.26x slower
shortest_path 435 ms 551 ms: 1.27x slower
nqueens 78.3 ms 99.7 ms: 1.27x slower
deepcopy 257 us 328 us: 1.28x slower
connected_components 393 ms 502 ms: 1.28x slower
sqlglot_normalize 104 ms 133 ms: 1.28x slower
xml_etree_process 57.9 ms 74.3 ms: 1.28x slower
async_tree_memoization 334 ms 429 ms: 1.28x slower
genshi_xml 49.1 ms 63.6 ms: 1.30x slower
pylint 281 ms 364 ms: 1.30x slower
typing_runtime_protocols 157 us 205 us: 1.31x slower
async_tree_memoization_tg 305 ms 402 ms: 1.32x slower
meteor_contest 99.4 ms 131 ms: 1.32x slower
deepcopy_reduce 2.57 us 3.40 us: 1.32x slower
subparsers 21.8 ms 28.9 ms: 1.33x slower
deepcopy_memo 30.6 us 40.9 us: 1.34x slower
tomli_loads 1.92 sec 2.58 sec: 1.34x slower
fannkuch 371 ms 499 ms: 1.35x slower
thrift 741 us 998 us: 1.35x slower
regex_compile 127 ms 172 ms: 1.35x slower
pprint_safe_repr 704 ms 963 ms: 1.37x slower
scimark_sparse_mat_mult 4.20 ms 5.77 ms: 1.37x slower
python_startup_no_site 7.46 ms 10.2 ms: 1.37x slower
pprint_pformat 1.44 sec 2.00 sec: 1.39x slower
crypto_pyaes 66.3 ms 92.9 ms: 1.40x slower
2to3 255 ms 362 ms: 1.42x slower
nbody 91.3 ms 131 ms: 1.43x slower
scimark_lu 111 ms 159 ms: 1.44x slower
genshi_text 21.6 ms 31.1 ms: 1.44x slower
django_template 34.6 ms 50.1 ms: 1.45x slower
generators 27.2 ms 39.4 ms: 1.45x slower
sqlalchemy_imperative 19.1 ms 27.7 ms: 1.45x slower
mako 11.7 ms 17.4 ms: 1.48x slower
float 76.7 ms 115 ms: 1.50x slower
sympy_integrate 19.9 ms 29.8 ms: 1.50x slower
sqlalchemy_declarative 128 ms 196 ms: 1.54x slower
pyflate 427 ms 663 ms: 1.55x slower
richards_super 48.7 ms 75.7 ms: 1.56x slower
logging_format 6.63 us 10.3 us: 1.56x slower
unpickle_pure_python 213 us 333 us: 1.56x slower
comprehensions 17.1 us 27.0 us: 1.58x slower
logging_simple 5.87 us 9.38 us: 1.60x slower
pickle_pure_python 315 us 506 us: 1.61x slower
richards 42.3 ms 68.5 ms: 1.62x slower
chaos 58.7 ms 95.7 ms: 1.63x slower
hexiom 5.99 ms 9.76 ms: 1.63x slower
logging_silent 107 ns 178 ns: 1.66x slower
scimark_monte_carlo 64.3 ms 108 ms: 1.67x slower
sqlglot_transpile 1.58 ms 2.73 ms: 1.73x slower
sympy_str 271 ms 480 ms: 1.77x slower
sqlglot_parse 1.27 ms 2.38 ms: 1.88x slower
scimark_sor 116 ms 218 ms: 1.88x slower
raytrace 261 ms 492 ms: 1.88x slower
go 117 ms 241 ms: 2.05x slower
sympy_expand 454 ms 962 ms: 2.12x slower
sympy_sum 153 ms 351 ms: 2.29x slower
deltablue 3.16 ms 7.56 ms: 2.39x slower
bench_thread_pool 1.04 ms 3.39 ms: 3.28x slower
Geometric mean (ref) 1.35x slower

Benchmark hidden because not significant (2): sqlite_synth, xml_etree_iterparse Ignored benchmarks (1) of results/bm-20241220-3.14.0a3+-2a66dd3-NOGIL/bm-20241220-vultr-x86_64-python-2a66dd33dfc0b845042d-3.14.0a3+-2a66dd3.json: html5lib

  • Geometric mean (including insignificant results): 1.252x slower

HPT report

  • Reliability score: 100.00% likely to be slow
  • 90% likely to have a slowdown of 1.26x
  • 95% likely to have a slowdown of 1.25x
  • 99% likely to have a slowdown of 1.24x

Memory

  • memory change: 1.18x