Skip to content

Latest commit

 

History

History
210 lines (187 loc) · 26.4 KB

bm-20250415-pythonperf2-x86_64-python-2ff5eb8582939eb9182d-3.14.0a7+-2ff5eb8-vs-3.13.0.md

File metadata and controls

210 lines (187 loc) · 26.4 KB

Results vs. 3.13.0

  • fork: python
  • ref: 2ff5eb8582939eb9182d
  • machine: linux-x86_64
  • commit hash: 2ff5eb8
  • commit date: 2025-04-15
  • overall geometric mean: 1.079x faster
  • HPT reliability: 100.00%
  • HPT 99th percentile: 1.03x faster
  • Memory change: 1.04x

Benchmarks with tag 'apps':

Benchmark bm-20241007-pythonperf2-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20250415-pythonperf2-x86_64-python-2ff5eb8582939eb9182d-3.14.0a7+-2ff5eb8
2to3 293 ms 273 ms: 1.07x faster
docutils 2.83 sec 2.84 sec: 1.01x slower
html5lib 73.5 ms 65.5 ms: 1.12x faster
sphinx 1.12 sec 1.09 sec: 1.03x faster
Geometric mean (ref) 1.05x faster

Benchmarks with tag 'asyncio':

Benchmark bm-20241007-pythonperf2-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20250415-pythonperf2-x86_64-python-2ff5eb8582939eb9182d-3.14.0a7+-2ff5eb8
async_tree_memoization_tg 466 ms 333 ms: 1.40x faster
async_tree_memoization 453 ms 327 ms: 1.39x faster
async_tree_io 843 ms 627 ms: 1.35x faster
async_tree_none 376 ms 283 ms: 1.33x faster
async_tree_io_tg 831 ms 631 ms: 1.32x faster
async_tree_none_tg 346 ms 271 ms: 1.28x faster
async_tree_cpu_io_mixed 604 ms 505 ms: 1.20x faster
async_tree_cpu_io_mixed_tg 581 ms 501 ms: 1.16x faster
async_generators 457 ms 413 ms: 1.11x faster
coroutines 21.6 ms 21.7 ms: 1.00x slower
Geometric mean (ref) 1.22x faster

Benchmark hidden because not significant (1): asyncio_websockets

Benchmarks with tag 'math':

Benchmark bm-20241007-pythonperf2-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20250415-pythonperf2-x86_64-python-2ff5eb8582939eb9182d-3.14.0a7+-2ff5eb8
float 81.3 ms 66.8 ms: 1.22x faster
pidigits 252 ms 254 ms: 1.01x slower
nbody 89.3 ms 91.9 ms: 1.03x slower
Geometric mean (ref) 1.06x faster

Benchmarks with tag 'regex':

Benchmark bm-20241007-pythonperf2-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20250415-pythonperf2-x86_64-python-2ff5eb8582939eb9182d-3.14.0a7+-2ff5eb8
regex_effbot 3.67 ms 3.02 ms: 1.22x faster
regex_compile 143 ms 132 ms: 1.08x faster
regex_v8 26.1 ms 24.7 ms: 1.06x faster
regex_dna 247 ms 239 ms: 1.03x faster
Geometric mean (ref) 1.09x faster

Benchmarks with tag 'serialize':

Benchmark bm-20241007-pythonperf2-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20250415-pythonperf2-x86_64-python-2ff5eb8582939eb9182d-3.14.0a7+-2ff5eb8
tomli_loads 2.46 sec 2.03 sec: 1.21x faster
xml_etree_parse 150 ms 136 ms: 1.11x faster
xml_etree_iterparse 103 ms 96.8 ms: 1.06x faster
unpickle_pure_python 217 us 207 us: 1.05x faster
xml_etree_process 61.2 ms 58.3 ms: 1.05x faster
xml_etree_generate 86.5 ms 84.1 ms: 1.03x faster
pickle_pure_python 323 us 321 us: 1.01x faster
json_dumps 11.1 ms 11.5 ms: 1.03x slower
json_loads 24.7 us 25.9 us: 1.05x slower
Geometric mean (ref) 1.05x faster

Benchmarks with tag 'startup':

Benchmark bm-20241007-pythonperf2-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20250415-pythonperf2-x86_64-python-2ff5eb8582939eb9182d-3.14.0a7+-2ff5eb8
python_startup 15.9 ms 16.4 ms: 1.03x slower
python_startup_no_site 8.96 ms 10.5 ms: 1.17x slower
Geometric mean (ref) 1.10x slower

Benchmarks with tag 'template':

Benchmark bm-20241007-pythonperf2-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20250415-pythonperf2-x86_64-python-2ff5eb8582939eb9182d-3.14.0a7+-2ff5eb8
genshi_text 26.2 ms 22.9 ms: 1.15x faster
genshi_xml 57.1 ms 52.1 ms: 1.09x faster
django_template 36.4 ms 35.5 ms: 1.02x faster
mako 10.4 ms 10.9 ms: 1.05x slower
Geometric mean (ref) 1.05x faster

All benchmarks:

Benchmark bm-20241007-pythonperf2-x86_64-python-v3.13.0-3.13.0-60403a5 bm-20250415-pythonperf2-x86_64-python-2ff5eb8582939eb9182d-3.14.0a7+-2ff5eb8
mdp 2.54 sec 1.28 sec: 1.99x faster
deepcopy 392 us 272 us: 1.44x faster
deepcopy_memo 38.6 us 27.4 us: 1.41x faster
async_tree_memoization_tg 466 ms 333 ms: 1.40x faster
async_tree_memoization 453 ms 327 ms: 1.39x faster
async_tree_io 843 ms 627 ms: 1.35x faster
go 162 ms 122 ms: 1.33x faster
async_tree_none 376 ms 283 ms: 1.33x faster
async_tree_io_tg 831 ms 631 ms: 1.32x faster
async_tree_none_tg 346 ms 271 ms: 1.28x faster
float 81.3 ms 66.8 ms: 1.22x faster
regex_effbot 3.67 ms 3.02 ms: 1.22x faster
deepcopy_reduce 3.54 us 2.92 us: 1.21x faster
tomli_loads 2.46 sec 2.03 sec: 1.21x faster
async_tree_cpu_io_mixed 604 ms 505 ms: 1.20x faster
scimark_sor 123 ms 104 ms: 1.19x faster
richards_super 59.6 ms 50.5 ms: 1.18x faster
generators 33.6 ms 28.6 ms: 1.18x faster
richards 52.9 ms 45.1 ms: 1.17x faster
async_tree_cpu_io_mixed_tg 581 ms 501 ms: 1.16x faster
genshi_text 26.2 ms 22.9 ms: 1.15x faster
pyflate 503 ms 441 ms: 1.14x faster
html5lib 73.5 ms 65.5 ms: 1.12x faster
deltablue 3.42 ms 3.08 ms: 1.11x faster
async_generators 457 ms 413 ms: 1.11x faster
xml_etree_parse 150 ms 136 ms: 1.11x faster
dulwich_log 68.2 ms 61.9 ms: 1.10x faster
hexiom 6.55 ms 5.95 ms: 1.10x faster
telco 8.79 ms 8.00 ms: 1.10x faster
scimark_monte_carlo 66.1 ms 60.2 ms: 1.10x faster
genshi_xml 57.1 ms 52.1 ms: 1.09x faster
spectral_norm 97.0 ms 89.2 ms: 1.09x faster
scimark_fft 328 ms 302 ms: 1.09x faster
pylint 347 ms 319 ms: 1.09x faster
logging_silent 97.9 ns 90.5 ns: 1.08x faster
regex_compile 143 ms 132 ms: 1.08x faster
sympy_integrate 23.6 ms 21.8 ms: 1.08x faster
bpe_tokeniser 5.09 sec 4.72 sec: 1.08x faster
pprint_pformat 1.72 sec 1.60 sec: 1.08x faster
pprint_safe_repr 843 ms 784 ms: 1.07x faster
2to3 293 ms 273 ms: 1.07x faster
logging_simple 6.39 us 5.99 us: 1.07x faster
xml_etree_iterparse 103 ms 96.8 ms: 1.06x faster
regex_v8 26.1 ms 24.7 ms: 1.06x faster
unpickle_pure_python 217 us 207 us: 1.05x faster
xml_etree_process 61.2 ms 58.3 ms: 1.05x faster
connected_components 432 ms 414 ms: 1.05x faster
sympy_expand 509 ms 488 ms: 1.04x faster
pathlib 17.5 ms 16.8 ms: 1.04x faster
sympy_str 298 ms 286 ms: 1.04x faster
json 5.69 ms 5.47 ms: 1.04x faster
scimark_sparse_mat_mult 4.77 ms 4.60 ms: 1.04x faster
logging_format 6.94 us 6.70 us: 1.04x faster
regex_dna 247 ms 239 ms: 1.03x faster
scimark_lu 98.7 ms 95.7 ms: 1.03x faster
shortest_path 460 ms 446 ms: 1.03x faster
sphinx 1.12 sec 1.09 sec: 1.03x faster
xml_etree_generate 86.5 ms 84.1 ms: 1.03x faster
meteor_contest 130 ms 126 ms: 1.03x faster
sqlite_synth 2.91 us 2.83 us: 1.03x faster
sympy_sum 155 ms 151 ms: 1.03x faster
k_core 2.17 sec 2.11 sec: 1.03x faster
django_template 36.4 ms 35.5 ms: 1.02x faster
sqlalchemy_imperative 18.3 ms 18.0 ms: 1.02x faster
raytrace 273 ms 269 ms: 1.01x faster
pycparser 1.24 sec 1.23 sec: 1.01x faster
chaos 60.2 ms 59.4 ms: 1.01x faster
pickle_pure_python 323 us 321 us: 1.01x faster
sqlalchemy_declarative 148 ms 148 ms: 1.01x faster
coroutines 21.6 ms 21.7 ms: 1.00x slower
docutils 2.83 sec 2.84 sec: 1.01x slower
pidigits 252 ms 254 ms: 1.01x slower
typing_runtime_protocols 169 us 170 us: 1.01x slower
create_gc_cycles 2.68 ms 2.73 ms: 1.02x slower
nqueens 90.7 ms 92.3 ms: 1.02x slower
bench_thread_pool 942 us 967 us: 1.03x slower
coverage 80.0 ms 82.1 ms: 1.03x slower
nbody 89.3 ms 91.9 ms: 1.03x slower
fannkuch 363 ms 375 ms: 1.03x slower
python_startup 15.9 ms 16.4 ms: 1.03x slower
json_dumps 11.1 ms 11.5 ms: 1.03x slower
mako 10.4 ms 10.9 ms: 1.05x slower
json_loads 24.7 us 25.9 us: 1.05x slower
crypto_pyaes 73.3 ms 78.1 ms: 1.07x slower
many_optionals 930 us 1.01 ms: 1.08x slower
python_startup_no_site 8.96 ms 10.5 ms: 1.17x slower
subparsers 17.5 ms 22.5 ms: 1.29x slower
gc_traversal 4.74 ms 6.37 ms: 1.34x slower
bench_mp_pool 5.12 ms 1.37 sec: 267.88x slower
Geometric mean (ref) 1.01x faster

Benchmark hidden because not significant (2): asyncio_websockets, comprehensions Ignored benchmarks (10) of results/bm-20241007-3.13.0-60403a5/bm-20241007-pythonperf2-x86_64-python-v3.13.0-3.13.0-60403a5.json: chameleon, djangocms, gevent_hub, gunicorn, sqlglot_normalize, sqlglot_optimize, sqlglot_parse, sqlglot_transpile, thrift, tornado_http Ignored benchmarks (4) of results/bm-20250415-3.14.0a7+-2ff5eb8/bm-20250415-pythonperf2-x86_64-python-2ff5eb8582939eb9182d-3.14.0a7+-2ff5eb8.json: sqlglot_v2_normalize, sqlglot_v2_optimize, sqlglot_v2_parse, sqlglot_v2_transpile

  • Geometric mean (including insignificant results): 1.079x faster

HPT report

  • Reliability score: 100.00% likely to be faster
  • 90% likely to have a speedup of 1.04x
  • 95% likely to have a speedup of 1.04x
  • 99% likely to have a speedup of 1.03x

Memory

  • memory change: 1.04x