Skip to content

Latest commit

 

History

History
217 lines (195 loc) · 28.5 KB

bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26-vs-3.11.0.md

File metadata and controls

217 lines (195 loc) · 28.5 KB

Results vs. 3.11.0

  • fork: python
  • ref: a19bb261a327e1008f21
  • machine: linux-aarch64
  • commit hash: a19bb26
  • commit date: 2024-06-15
  • overall geometric mean: 1.06x slower
  • HPT reliability: 99.98%
  • HPT 99th percentile: 1.03x slower
  • Memory change: 1.05x

Benchmarks with tag 'apps':

Benchmark bm-20221024-arminc-aarch64-python-deaf509e8fc6e0363bd6-3.11.0-deaf509 bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
2to3 300 ms 346 ms: 1.15x slower
chameleon 8.29 ms 10.1 ms: 1.22x slower
docutils 2.92 sec 3.51 sec: 1.20x slower
html5lib 65.3 ms 72.5 ms: 1.11x slower
tornado_http 140 ms 136 ms: 1.03x faster
Geometric mean (ref) 1.13x slower

Benchmarks with tag 'asyncio':

Benchmark bm-20221024-arminc-aarch64-python-deaf509e8fc6e0363bd6-3.11.0-deaf509 bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
async_tree_none 701 ms 521 ms: 1.34x faster
async_tree_memoization_tg 828 ms 629 ms: 1.32x faster
async_tree_memoization 872 ms 674 ms: 1.29x faster
async_tree_io 1.61 sec 1.26 sec: 1.28x faster
async_tree_none_tg 620 ms 489 ms: 1.27x faster
async_tree_io_tg 1.54 sec 1.24 sec: 1.23x faster
async_tree_cpu_io_mixed_tg 922 ms 794 ms: 1.16x faster
async_tree_cpu_io_mixed 955 ms 826 ms: 1.16x faster
Geometric mean (ref) 1.25x faster

Benchmarks with tag 'math':

Benchmark bm-20221024-arminc-aarch64-python-deaf509e8fc6e0363bd6-3.11.0-deaf509 bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
pidigits 242 ms 237 ms: 1.02x faster
nbody 113 ms 131 ms: 1.16x slower
float 89.6 ms 108 ms: 1.21x slower
Geometric mean (ref) 1.11x slower

Benchmarks with tag 'regex':

Benchmark bm-20221024-arminc-aarch64-python-deaf509e8fc6e0363bd6-3.11.0-deaf509 bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
regex_v8 29.1 ms 31.3 ms: 1.08x slower
regex_dna 239 ms 257 ms: 1.08x slower
regex_compile 137 ms 159 ms: 1.17x slower
regex_effbot 4.25 ms 4.97 ms: 1.17x slower
Geometric mean (ref) 1.12x slower

Benchmarks with tag 'serialize':

Benchmark bm-20221024-arminc-aarch64-python-deaf509e8fc6e0363bd6-3.11.0-deaf509 bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
json_dumps 15.4 ms 13.4 ms: 1.15x faster
xml_etree_parse 209 ms 191 ms: 1.09x faster
unpickle_list 6.86 us 6.38 us: 1.08x faster
xml_etree_iterparse 152 ms 155 ms: 1.02x slower
json_loads 30.3 us 32.1 us: 1.06x slower
pickle_list 5.01 us 5.33 us: 1.06x slower
pickle 12.8 us 13.7 us: 1.07x slower
xml_etree_process 76.1 ms 85.9 ms: 1.13x slower
tomli_loads 2.62 sec 2.97 sec: 1.14x slower
pickle_pure_python 374 us 428 us: 1.15x slower
xml_etree_generate 104 ms 122 ms: 1.18x slower
unpickle 16.9 us 19.8 us: 1.18x slower
unpickle_pure_python 278 us 329 us: 1.18x slower
Geometric mean (ref) 1.06x slower

Benchmark hidden because not significant (1): pickle_dict

Benchmarks with tag 'startup':

Benchmark bm-20221024-arminc-aarch64-python-deaf509e8fc6e0363bd6-3.11.0-deaf509 bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
python_startup_no_site 7.35 ms 8.70 ms: 1.18x slower
python_startup 10.2 ms 13.0 ms: 1.28x slower
Geometric mean (ref) 1.23x slower

Benchmarks with tag 'template':

Benchmark bm-20221024-arminc-aarch64-python-deaf509e8fc6e0363bd6-3.11.0-deaf509 bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
django_template 41.8 ms 48.5 ms: 1.16x slower
mako 13.3 ms 15.6 ms: 1.18x slower
genshi_xml 62.2 ms 75.6 ms: 1.22x slower
genshi_text 28.2 ms 35.7 ms: 1.27x slower
Geometric mean (ref) 1.20x slower

All benchmarks:

Benchmark bm-20221024-arminc-aarch64-python-deaf509e8fc6e0363bd6-3.11.0-deaf509 bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26
typing_runtime_protocols 653 us 225 us: 2.90x faster
generators 64.2 ms 39.9 ms: 1.61x faster
asyncio_tcp 920 ms 602 ms: 1.53x faster
asyncio_tcp_ssl 3.19 sec 2.25 sec: 1.42x faster
async_tree_none 701 ms 521 ms: 1.34x faster
async_tree_memoization_tg 828 ms 629 ms: 1.32x faster
async_tree_memoization 872 ms 674 ms: 1.29x faster
async_tree_io 1.61 sec 1.26 sec: 1.28x faster
async_tree_none_tg 620 ms 489 ms: 1.27x faster
async_tree_io_tg 1.54 sec 1.24 sec: 1.23x faster
async_tree_cpu_io_mixed_tg 922 ms 794 ms: 1.16x faster
async_tree_cpu_io_mixed 955 ms 826 ms: 1.16x faster
json_dumps 15.4 ms 13.4 ms: 1.15x faster
coroutines 33.3 ms 30.3 ms: 1.10x faster
xml_etree_parse 209 ms 191 ms: 1.09x faster
unpickle_list 6.86 us 6.38 us: 1.08x faster
pathlib 24.8 ms 23.5 ms: 1.06x faster
raytrace 351 ms 335 ms: 1.05x faster
comprehensions 29.0 us 28.0 us: 1.03x faster
logging_format 8.22 us 7.94 us: 1.03x faster
tornado_http 140 ms 136 ms: 1.03x faster
logging_simple 7.57 us 7.37 us: 1.03x faster
pidigits 242 ms 237 ms: 1.02x faster
asyncio_websockets 656 ms 659 ms: 1.00x slower
sqlglot_parse 1.65 ms 1.66 ms: 1.01x slower
xml_etree_iterparse 152 ms 155 ms: 1.02x slower
dulwich_log 63.2 ms 65.0 ms: 1.03x slower
chaos 78.8 ms 81.8 ms: 1.04x slower
sympy_str 295 ms 309 ms: 1.05x slower
sqlglot_transpile 2.00 ms 2.10 ms: 1.05x slower
json_loads 30.3 us 32.1 us: 1.06x slower
pickle_list 5.01 us 5.33 us: 1.06x slower
mdp 3.35 sec 3.57 sec: 1.06x slower
json 5.52 ms 5.88 ms: 1.06x slower
gunicorn 1.19 ms 1.27 ms: 1.07x slower
thrift 910 us 973 us: 1.07x slower
sympy_expand 482 ms 516 ms: 1.07x slower
deltablue 4.75 ms 5.09 ms: 1.07x slower
pickle 12.8 us 13.7 us: 1.07x slower
regex_v8 29.1 ms 31.3 ms: 1.08x slower
regex_dna 239 ms 257 ms: 1.08x slower
pycparser 1.25 sec 1.34 sec: 1.08x slower
sympy_integrate 23.2 ms 25.1 ms: 1.08x slower
richards 58.1 ms 63.3 ms: 1.09x slower
sqlglot_normalize 132 ms 147 ms: 1.11x slower
html5lib 65.3 ms 72.5 ms: 1.11x slower
aiohttp 1.13 ms 1.27 ms: 1.12x slower
crypto_pyaes 86.5 ms 96.8 ms: 1.12x slower
sqlite_synth 3.56 us 4.00 us: 1.12x slower
sqlglot_optimize 63.4 ms 71.3 ms: 1.13x slower
xml_etree_process 76.1 ms 85.9 ms: 1.13x slower
meteor_contest 115 ms 130 ms: 1.13x slower
tomli_loads 2.62 sec 2.97 sec: 1.14x slower
bench_mp_pool 7.44 ms 8.48 ms: 1.14x slower
pickle_pure_python 374 us 428 us: 1.15x slower
2to3 300 ms 346 ms: 1.15x slower
nbody 113 ms 131 ms: 1.16x slower
django_template 41.8 ms 48.5 ms: 1.16x slower
gc_traversal 4.33 ms 5.03 ms: 1.16x slower
fannkuch 451 ms 525 ms: 1.16x slower
regex_compile 137 ms 159 ms: 1.17x slower
mypy2 737 ms 860 ms: 1.17x slower
regex_effbot 4.25 ms 4.97 ms: 1.17x slower
xml_etree_generate 104 ms 122 ms: 1.18x slower
mako 13.3 ms 15.6 ms: 1.18x slower
unpickle 16.9 us 19.8 us: 1.18x slower
go 163 ms 192 ms: 1.18x slower
unpickle_pure_python 278 us 329 us: 1.18x slower
python_startup_no_site 7.35 ms 8.70 ms: 1.18x slower
deepcopy_reduce 3.89 us 4.61 us: 1.19x slower
flaskblogging 4.19 ms 5.01 ms: 1.19x slower
docutils 2.92 sec 3.51 sec: 1.20x slower
deepcopy 435 us 525 us: 1.21x slower
float 89.6 ms 108 ms: 1.21x slower
coverage 84.1 ms 102 ms: 1.21x slower
chameleon 8.29 ms 10.1 ms: 1.22x slower
genshi_xml 62.2 ms 75.6 ms: 1.22x slower
nqueens 102 ms 125 ms: 1.22x slower
scimark_sparse_mat_mult 6.29 ms 7.70 ms: 1.23x slower
pprint_pformat 1.85 sec 2.32 sec: 1.25x slower
pprint_safe_repr 903 ms 1.13 sec: 1.25x slower
genshi_text 28.2 ms 35.7 ms: 1.27x slower
create_gc_cycles 1.87 ms 2.38 ms: 1.27x slower
python_startup 10.2 ms 13.0 ms: 1.28x slower
scimark_fft 402 ms 516 ms: 1.28x slower
scimark_monte_carlo 83.2 ms 107 ms: 1.29x slower
pyflate 516 ms 674 ms: 1.31x slower
spectral_norm 131 ms 172 ms: 1.32x slower
hexiom 7.57 ms 9.96 ms: 1.32x slower
logging_silent 133 ns 175 ns: 1.32x slower
scimark_sor 145 ms 197 ms: 1.35x slower
async_generators 378 ms 521 ms: 1.38x slower
deepcopy_memo 49.0 us 67.5 us: 1.38x slower
telco 7.80 ms 10.8 ms: 1.39x slower
scimark_lu 140 ms 205 ms: 1.47x slower
Geometric mean (ref) 1.06x slower

Benchmark hidden because not significant (6): pylint, sympy_sum, bench_thread_pool, pickle_dict, richards_super, dask Ignored benchmarks (2) of results/bm-20221024-3.11.0-deaf509/bm-20221024-arminc-aarch64-python-deaf509e8fc6e0363bd6-3.11.0-deaf509.json: sqlalchemy_declarative, sqlalchemy_imperative Ignored benchmarks (1) of results/bm-20240615-3.13.0b2+-a19bb26-PYTHON_UOPS/bm-20240615-arminc-aarch64-python-a19bb261a327e1008f21-3.13.0b2+-a19bb26.json: bpe_tokeniser

HPT report

  • Reliability score: 99.98% likely to be slow
  • 90% likely to have a slowdown of 1.06x
  • 95% likely to have a slowdown of 1.05x
  • 99% likely to have a slowdown of 1.03x

Memory

  • memory change: 1.05x