fork: python
ref: 2fd09b011031f3c00c34
machine: windows-x86
commit hash: 2fd09b0
commit date: 2025-05-24
overall geometric mean: 1.067x slower
HPT reliability: 99.98%
HPT 99th percentile: 1.05x slower
Memory change: unknown
Benchmarks with tag 'apps':
Benchmark
bm-20241007-pythonperf1_win32-x86-python-v3.13.0-3.13.0-60403a5
bm-20250524-pythonperf1_win32-x86-python-2fd09b011031f3c00c34-3.15.0a0-2fd09b0
2to3
250 ms
268 ms: 1.07x slower
docutils
1.78 sec
3.10 sec: 1.74x slower
html5lib
47.5 ms
48.8 ms: 1.03x slower
sphinx
719 ms
918 ms: 1.28x slower
Geometric mean
(ref)
1.25x slower
Benchmarks with tag 'asyncio':
Benchmark
bm-20241007-pythonperf1_win32-x86-python-v3.13.0-3.13.0-60403a5
bm-20250524-pythonperf1_win32-x86-python-2fd09b011031f3c00c34-3.15.0a0-2fd09b0
asyncio_websockets
363 ms
166 ms: 2.18x faster
async_tree_memoization_tg
282 ms
221 ms: 1.28x faster
async_tree_io_tg
494 ms
389 ms: 1.27x faster
async_tree_io
526 ms
415 ms: 1.27x faster
async_tree_none_tg
214 ms
175 ms: 1.22x faster
async_tree_none
245 ms
200 ms: 1.22x faster
async_tree_memoization
297 ms
244 ms: 1.22x faster
async_tree_cpu_io_mixed
484 ms
459 ms: 1.05x faster
async_tree_cpu_io_mixed_tg
456 ms
434 ms: 1.05x faster
async_generators
270 ms
305 ms: 1.13x slower
Geometric mean
(ref)
1.21x faster
Benchmark hidden because not significant (1): coroutines
Benchmarks with tag 'math':
Benchmark
bm-20241007-pythonperf1_win32-x86-python-v3.13.0-3.13.0-60403a5
bm-20250524-pythonperf1_win32-x86-python-2fd09b011031f3c00c34-3.15.0a0-2fd09b0
pidigits
201 ms
189 ms: 1.06x faster
float
54.6 ms
57.3 ms: 1.05x slower
nbody
80.0 ms
109 ms: 1.36x slower
Geometric mean
(ref)
1.10x slower
Benchmarks with tag 'regex':
Benchmark
bm-20241007-pythonperf1_win32-x86-python-v3.13.0-3.13.0-60403a5
bm-20250524-pythonperf1_win32-x86-python-2fd09b011031f3c00c34-3.15.0a0-2fd09b0
regex_v8
16.8 ms
13.9 ms: 1.21x faster
regex_effbot
1.80 ms
1.67 ms: 1.08x faster
regex_dna
114 ms
110 ms: 1.03x faster
regex_compile
101 ms
121 ms: 1.20x slower
Geometric mean
(ref)
1.03x faster
Benchmarks with tag 'serialize':
Benchmark
bm-20241007-pythonperf1_win32-x86-python-v3.13.0-3.13.0-60403a5
bm-20250524-pythonperf1_win32-x86-python-2fd09b011031f3c00c34-3.15.0a0-2fd09b0
xml_etree_parse
107 ms
109 ms: 1.01x slower
json_loads
21.6 us
22.6 us: 1.04x slower
xml_etree_iterparse
62.6 ms
67.7 ms: 1.08x slower
json_dumps
7.30 ms
8.31 ms: 1.14x slower
xml_etree_generate
61.4 ms
75.2 ms: 1.22x slower
xml_etree_process
44.2 ms
54.1 ms: 1.22x slower
unpickle_pure_python
160 us
206 us: 1.28x slower
pickle_pure_python
231 us
303 us: 1.31x slower
tomli_loads
1.71 sec
3.24 sec: 1.89x slower
Geometric mean
(ref)
1.22x slower
Benchmarks with tag 'startup':
Benchmark
bm-20241007-pythonperf1_win32-x86-python-v3.13.0-3.13.0-60403a5
bm-20250524-pythonperf1_win32-x86-python-2fd09b011031f3c00c34-3.15.0a0-2fd09b0
python_startup
28.3 ms
27.5 ms: 1.03x faster
python_startup_no_site
19.7 ms
20.7 ms: 1.05x slower
Geometric mean
(ref)
1.01x slower
Benchmarks with tag 'template':
Benchmark
bm-20241007-pythonperf1_win32-x86-python-v3.13.0-3.13.0-60403a5
bm-20250524-pythonperf1_win32-x86-python-2fd09b011031f3c00c34-3.15.0a0-2fd09b0
genshi_xml
50.1 ms
55.3 ms: 1.10x slower
genshi_text
21.5 ms
25.7 ms: 1.20x slower
django_template
29.8 ms
36.9 ms: 1.24x slower
mako
7.09 ms
11.4 ms: 1.62x slower
Geometric mean
(ref)
1.27x slower
Benchmark
bm-20241007-pythonperf1_win32-x86-python-v3.13.0-3.13.0-60403a5
bm-20250524-pythonperf1_win32-x86-python-2fd09b011031f3c00c34-3.15.0a0-2fd09b0
thrift
9.98 ms
826 us: 12.08x faster
coverage
324 ms
74.9 ms: 4.32x faster
pathlib
82.9 ms
34.6 ms: 2.40x faster
asyncio_websockets
363 ms
166 ms: 2.18x faster
gc_traversal
1.75 ms
1.11 ms: 1.58x faster
async_tree_memoization_tg
282 ms
221 ms: 1.28x faster
async_tree_io_tg
494 ms
389 ms: 1.27x faster
async_tree_io
526 ms
415 ms: 1.27x faster
async_tree_none_tg
214 ms
175 ms: 1.22x faster
async_tree_none
245 ms
200 ms: 1.22x faster
async_tree_memoization
297 ms
244 ms: 1.22x faster
regex_v8
16.8 ms
13.9 ms: 1.21x faster
sqlite_synth
1.95 us
1.63 us: 1.20x faster
deepcopy
314 us
265 us: 1.18x faster
create_gc_cycles
1.06 ms
930 us: 1.14x faster
mdp
1.62 sec
1.44 sec: 1.13x faster
bench_mp_pool
90.6 ms
81.6 ms: 1.11x faster
regex_effbot
1.80 ms
1.67 ms: 1.08x faster
pidigits
201 ms
189 ms: 1.06x faster
async_tree_cpu_io_mixed
484 ms
459 ms: 1.05x faster
async_tree_cpu_io_mixed_tg
456 ms
434 ms: 1.05x faster
regex_dna
114 ms
110 ms: 1.03x faster
python_startup
28.3 ms
27.5 ms: 1.03x faster
deepcopy_reduce
2.92 us
2.84 us: 1.03x faster
deepcopy_memo
25.4 us
25.2 us: 1.01x faster
xml_etree_parse
107 ms
109 ms: 1.01x slower
json
4.27 ms
4.33 ms: 1.01x slower
html5lib
47.5 ms
48.8 ms: 1.03x slower
json_loads
21.6 us
22.6 us: 1.04x slower
float
54.6 ms
57.3 ms: 1.05x slower
python_startup_no_site
19.7 ms
20.7 ms: 1.05x slower
dulwich_log
48.8 ms
51.3 ms: 1.05x slower
telco
6.96 ms
7.33 ms: 1.05x slower
pylint
227 ms
241 ms: 1.07x slower
2to3
250 ms
268 ms: 1.07x slower
xml_etree_iterparse
62.6 ms
67.7 ms: 1.08x slower
go
109 ms
119 ms: 1.10x slower
sympy_expand
373 ms
410 ms: 1.10x slower
genshi_xml
50.1 ms
55.3 ms: 1.10x slower
sympy_str
212 ms
236 ms: 1.12x slower
sympy_integrate
15.0 ms
16.8 ms: 1.12x slower
async_generators
270 ms
305 ms: 1.13x slower
json_dumps
7.30 ms
8.31 ms: 1.14x slower
sympy_sum
106 ms
121 ms: 1.15x slower
logging_format
8.72 us
10.1 us: 1.15x slower
scimark_sor
85.9 ms
100 ms: 1.17x slower
logging_simple
7.99 us
9.37 us: 1.17x slower
pyflate
320 ms
376 ms: 1.18x slower
regex_compile
101 ms
121 ms: 1.20x slower
genshi_text
21.5 ms
25.7 ms: 1.20x slower
chaos
50.2 ms
60.9 ms: 1.21x slower
pycparser
872 ms
1.06 sec: 1.21x slower
spectral_norm
69.4 ms
84.5 ms: 1.22x slower
xml_etree_generate
61.4 ms
75.2 ms: 1.22x slower
xml_etree_process
44.2 ms
54.1 ms: 1.22x slower
scimark_monte_carlo
47.7 ms
58.5 ms: 1.23x slower
meteor_contest
74.6 ms
91.8 ms: 1.23x slower
bench_thread_pool
1.00 ms
1.23 ms: 1.23x slower
django_template
29.8 ms
36.9 ms: 1.24x slower
nqueens
72.1 ms
89.3 ms: 1.24x slower
fannkuch
299 ms
371 ms: 1.24x slower
scimark_fft
205 ms
256 ms: 1.25x slower
hexiom
4.44 ms
5.58 ms: 1.26x slower
scimark_sparse_mat_mult
2.84 ms
3.58 ms: 1.26x slower
deltablue
2.33 ms
2.96 ms: 1.27x slower
sphinx
719 ms
918 ms: 1.28x slower
crypto_pyaes
56.9 ms
72.7 ms: 1.28x slower
unpickle_pure_python
160 us
206 us: 1.28x slower
comprehensions
12.5 us
16.2 us: 1.29x slower
typing_runtime_protocols
138 us
179 us: 1.30x slower
generators
21.8 ms
28.4 ms: 1.31x slower
richards
32.7 ms
42.7 ms: 1.31x slower
scimark_lu
60.2 ms
79.0 ms: 1.31x slower
pickle_pure_python
231 us
303 us: 1.31x slower
pprint_safe_repr
648 ms
855 ms: 1.32x slower
richards_super
36.7 ms
49.3 ms: 1.34x slower
nbody
80.0 ms
109 ms: 1.36x slower
raytrace
201 ms
277 ms: 1.38x slower
many_optionals
436 us
612 us: 1.40x slower
mako
7.09 ms
11.4 ms: 1.62x slower
subparsers
14.8 ms
24.8 ms: 1.68x slower
bpe_tokeniser
3.46 sec
6.00 sec: 1.73x slower
docutils
1.78 sec
3.10 sec: 1.74x slower
k_core
1.38 sec
2.44 sec: 1.77x slower
tomli_loads
1.71 sec
3.24 sec: 1.89x slower
pprint_pformat
1.33 sec
2.53 sec: 1.90x slower
shortest_path
290 ms
598 ms: 2.06x slower
connected_components
267 ms
564 ms: 2.11x slower
logging_silent
60.3 ns
419 ns: 6.94x slower
Geometric mean
(ref)
1.10x slower
Benchmark hidden because not significant (1): coroutines
Ignored benchmarks (10) of results/bm-20241007-3.13.0-60403a5/bm-20241007-pythonperf1_win32-x86-python-v3.13.0-3.13.0-60403a5.json: chameleon, djangocms, gevent_hub, sqlalchemy_declarative, sqlalchemy_imperative, sqlglot_normalize, sqlglot_optimize, sqlglot_parse, sqlglot_transpile, tornado_http
Ignored benchmarks (12) of results/bm-20250524-3.15.0a0-2fd09b0-NOGIL/bm-20250524-pythonperf1_win32-x86-python-2fd09b011031f3c00c34-3.15.0a0-2fd09b0.json: asyncio_tcp, asyncio_tcp_ssl, pickle, pickle_dict, pickle_list, sqlglot_v2_normalize, sqlglot_v2_optimize, sqlglot_v2_parse, sqlglot_v2_transpile, unpack_sequence, unpickle, unpickle_list
Geometric mean (including insignificant results): 1.067x slower
Reliability score: 99.98% likely to be slow
90% likely to have a slowdown of 1.09x
95% likely to have a slowdown of 1.08x
99% likely to have a slowdown of 1.05x