Skip to content

Latest commit

 

History

History
196 lines (173 loc) · 36.5 KB

bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26-vs-base.md

File metadata and controls

196 lines (173 loc) · 36.5 KB

Results vs. base

  • fork: python
  • ref: a19bb261a327e1008f21
  • machine: linux-x86_64
  • commit hash: a19bb26
  • commit date: 2024-06-15
  • overall geometric mean: 1.00x faster
  • HPT reliability: 87.79%
  • HPT 99th percentile: 1.00x slower
  • Memory change: 1.09x

Benchmarks with tag 'apps':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-JIT/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
2to3 274 ms 281 ms: 1.03x slower
docutils 2.83 sec 2.98 sec: 1.05x slower
tornado_http 94.1 ms 97.5 ms: 1.04x slower
Geometric mean (ref) 1.02x slower

Benchmark hidden because not significant (2): chameleon, html5lib

Benchmarks with tag 'asyncio':

Benchmark hidden because not significant (8): async_tree_io, async_tree_memoization, async_tree_io_tg, async_tree_cpu_io_mixed, async_tree_cpu_io_mixed_tg, async_tree_memoization_tg, async_tree_none_tg, async_tree_none

Benchmarks with tag 'math':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-JIT/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
nbody 89.3 ms 80.6 ms: 1.11x faster
float 79.6 ms 72.1 ms: 1.10x faster
pidigits 189 ms 188 ms: 1.00x faster
Geometric mean (ref) 1.07x faster

Benchmarks with tag 'regex':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-JIT/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
regex_dna 235 ms 220 ms: 1.07x faster
regex_effbot 3.78 ms 3.56 ms: 1.06x faster
regex_v8 24.8 ms 24.1 ms: 1.03x faster
regex_compile 136 ms 142 ms: 1.04x slower
Geometric mean (ref) 1.03x faster

Benchmarks with tag 'serialize':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-JIT/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
tomli_loads 2.18 sec 1.96 sec: 1.11x faster
unpickle_list 5.54 us 5.19 us: 1.07x faster
xml_etree_generate 88.5 ms 82.9 ms: 1.07x faster
xml_etree_iterparse 108 ms 102 ms: 1.06x faster
xml_etree_parse 159 ms 150 ms: 1.06x faster
xml_etree_process 62.1 ms 58.9 ms: 1.05x faster
json_dumps 10.8 ms 10.3 ms: 1.05x faster
pickle_pure_python 304 us 298 us: 1.02x faster
pickle 11.9 us 12.1 us: 1.01x slower
unpickle_pure_python 220 us 224 us: 1.01x slower
pickle_list 5.02 us 5.11 us: 1.02x slower
pickle_dict 34.4 us 35.6 us: 1.04x slower
unpickle 16.1 us 16.7 us: 1.04x slower
Geometric mean (ref) 1.03x faster

Benchmark hidden because not significant (1): json_loads

Benchmarks with tag 'startup':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-JIT/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
python_startup 10.9 ms 11.3 ms: 1.03x slower
python_startup_no_site 7.21 ms 7.64 ms: 1.06x slower
Geometric mean (ref) 1.04x slower

Benchmarks with tag 'template':

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-JIT/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
mako 11.4 ms 9.78 ms: 1.17x faster
django_template 35.0 ms 36.9 ms: 1.06x slower
genshi_text 23.8 ms 25.7 ms: 1.08x slower
genshi_xml 52.4 ms 60.1 ms: 1.15x slower
Geometric mean (ref) 1.03x slower

All benchmarks:

Benchmark results/bm-20240615-3.13.0b2+-a19bb26/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json results/bm-20240615-3.13.0b2+-a19bb26-JIT/bm-20240615-linux-x86_64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json
scimark_fft 377 ms 315 ms: 1.20x faster
scimark_sparse_mat_mult 5.22 ms 4.46 ms: 1.17x faster
mako 11.4 ms 9.78 ms: 1.17x faster
richards 50.2 ms 43.0 ms: 1.17x faster
spectral_norm 116 ms 101 ms: 1.15x faster
richards_super 56.8 ms 49.4 ms: 1.15x faster
fannkuch 406 ms 354 ms: 1.14x faster
crypto_pyaes 76.7 ms 67.4 ms: 1.14x faster
tomli_loads 2.18 sec 1.96 sec: 1.11x faster
nbody 89.3 ms 80.6 ms: 1.11x faster
float 79.6 ms 72.1 ms: 1.10x faster
pyflate 485 ms 439 ms: 1.10x faster
scimark_monte_carlo 69.3 ms 63.0 ms: 1.10x faster
pprint_pformat 1.56 sec 1.45 sec: 1.08x faster
regex_dna 235 ms 220 ms: 1.07x faster
unpickle_list 5.54 us 5.19 us: 1.07x faster
xml_etree_generate 88.5 ms 82.9 ms: 1.07x faster
gc_traversal 3.81 ms 3.57 ms: 1.07x faster
xml_etree_iterparse 108 ms 102 ms: 1.06x faster
pprint_safe_repr 764 ms 720 ms: 1.06x faster
regex_effbot 3.78 ms 3.56 ms: 1.06x faster
xml_etree_parse 159 ms 150 ms: 1.06x faster
sqlite_synth 3.00 us 2.85 us: 1.06x faster
xml_etree_process 62.1 ms 58.9 ms: 1.05x faster
json_dumps 10.8 ms 10.3 ms: 1.05x faster
telco 8.47 ms 8.07 ms: 1.05x faster
deepcopy_memo 39.8 us 37.9 us: 1.05x faster
regex_v8 24.8 ms 24.1 ms: 1.03x faster
pickle_pure_python 304 us 298 us: 1.02x faster
meteor_contest 112 ms 110 ms: 1.02x faster
comprehensions 17.0 us 16.7 us: 1.02x faster
bpe_tokeniser 4.95 sec 4.88 sec: 1.02x faster
chaos 61.2 ms 60.3 ms: 1.02x faster
pathlib 17.5 ms 17.2 ms: 1.01x faster
pidigits 189 ms 188 ms: 1.00x faster
logging_simple 5.68 us 5.71 us: 1.01x slower
asyncio_tcp_ssl 1.85 sec 1.86 sec: 1.01x slower
logging_format 6.35 us 6.40 us: 1.01x slower
deepcopy_reduce 3.27 us 3.31 us: 1.01x slower
pickle 11.9 us 12.1 us: 1.01x slower
coroutines 22.7 ms 23.1 ms: 1.01x slower
unpickle_pure_python 220 us 224 us: 1.01x slower
sqlglot_transpile 1.62 ms 1.65 ms: 1.02x slower
pickle_list 5.02 us 5.11 us: 1.02x slower
thrift 816 us 834 us: 1.02x slower
generators 29.3 ms 30.0 ms: 1.02x slower
2to3 274 ms 281 ms: 1.03x slower
raytrace 272 ms 279 ms: 1.03x slower
python_startup 10.9 ms 11.3 ms: 1.03x slower
dask 369 ms 380 ms: 1.03x slower
logging_silent 104 ns 107 ns: 1.03x slower
sqlglot_optimize 55.3 ms 57.1 ms: 1.03x slower
deepcopy 366 us 379 us: 1.03x slower
asyncio_tcp 505 ms 522 ms: 1.03x slower
tornado_http 94.1 ms 97.5 ms: 1.04x slower
typing_runtime_protocols 165 us 171 us: 1.04x slower
pickle_dict 34.4 us 35.6 us: 1.04x slower
json 5.28 ms 5.48 ms: 1.04x slower
unpickle 16.1 us 16.7 us: 1.04x slower
regex_compile 136 ms 142 ms: 1.04x slower
go 143 ms 148 ms: 1.04x slower
sqlglot_normalize 110 ms 115 ms: 1.04x slower
djangocms 31.1 us 32.5 us: 1.04x slower
bench_thread_pool 830 us 868 us: 1.05x slower
dulwich_log 65.8 ms 68.9 ms: 1.05x slower
flaskblogging 8.90 ms 9.32 ms: 1.05x slower
docutils 2.83 sec 2.98 sec: 1.05x slower
gunicorn 1.28 ms 1.35 ms: 1.05x slower
django_template 35.0 ms 36.9 ms: 1.06x slower
aiohttp 1.18 ms 1.25 ms: 1.06x slower
python_startup_no_site 7.21 ms 7.64 ms: 1.06x slower
scimark_sor 129 ms 137 ms: 1.06x slower
hexiom 6.25 ms 6.64 ms: 1.06x slower
scimark_lu 119 ms 126 ms: 1.07x slower
mdp 2.60 sec 2.79 sec: 1.07x slower
async_generators 441 ms 474 ms: 1.07x slower
genshi_text 23.8 ms 25.7 ms: 1.08x slower
nqueens 80.4 ms 86.7 ms: 1.08x slower
sympy_str 281 ms 305 ms: 1.08x slower
sympy_expand 470 ms 516 ms: 1.10x slower
mypy2 741 ms 819 ms: 1.11x slower
sympy_integrate 20.5 ms 22.8 ms: 1.11x slower
sympy_sum 155 ms 173 ms: 1.11x slower
pylint 317 ms 354 ms: 1.12x slower
deltablue 3.32 ms 3.76 ms: 1.13x slower
genshi_xml 52.4 ms 60.1 ms: 1.15x slower
Geometric mean (ref) 1.00x faster

Benchmark hidden because not significant (17): async_tree_io, chameleon, coverage, async_tree_memoization, html5lib, create_gc_cycles, asyncio_websockets, sqlglot_parse, bench_mp_pool, async_tree_io_tg, pycparser, async_tree_cpu_io_mixed, json_loads, async_tree_cpu_io_mixed_tg, async_tree_memoization_tg, async_tree_none_tg, async_tree_none

HPT report

  • Reliability score: 87.79% likely to be slow
  • 90% likely to have a slowdown of 1.00x
  • 95% likely to have a slowdown of 1.00x
  • 99% likely to have a slowdown of 1.00x

Memory

  • memory change: 1.09x