fork: python
ref: 2fd09b011031f3c00c34
machine: windows-x86
commit hash: 2fd09b0
commit date: 2025-05-24
overall geometric mean: 1.085x faster
HPT reliability: 99.94%
HPT 99th percentile: 1.02x faster
Memory change: unknown
Benchmarks with tag 'apps':
Benchmark
bm-20231002-pythonperf1_win32-x86-python-v3.12.0-3.12.0-0fb18b0
bm-20250524-pythonperf1_win32-x86-python-2fd09b011031f3c00c34-3.15.0a0-2fd09b0
2to3
280 ms
268 ms: 1.05x faster
docutils
1.98 sec
3.10 sec: 1.56x slower
Geometric mean
(ref)
1.22x slower
Benchmarks with tag 'asyncio':
Benchmark
bm-20231002-pythonperf1_win32-x86-python-v3.12.0-3.12.0-0fb18b0
bm-20250524-pythonperf1_win32-x86-python-2fd09b011031f3c00c34-3.15.0a0-2fd09b0
async_tree_io_tg
677 ms
389 ms: 1.74x faster
async_tree_io
693 ms
415 ms: 1.67x faster
async_tree_memoization_tg
350 ms
221 ms: 1.59x faster
async_tree_none_tg
278 ms
175 ms: 1.58x faster
async_tree_memoization
364 ms
244 ms: 1.49x faster
async_tree_none
298 ms
200 ms: 1.49x faster
async_tree_cpu_io_mixed_tg
546 ms
434 ms: 1.26x faster
async_tree_cpu_io_mixed
564 ms
459 ms: 1.23x faster
Geometric mean
(ref)
1.50x faster
Benchmarks with tag 'math':
Benchmark
bm-20231002-pythonperf1_win32-x86-python-v3.12.0-3.12.0-0fb18b0
bm-20250524-pythonperf1_win32-x86-python-2fd09b011031f3c00c34-3.15.0a0-2fd09b0
float
76.7 ms
57.3 ms: 1.34x faster
nbody
127 ms
109 ms: 1.17x faster
pidigits
199 ms
189 ms: 1.06x faster
Geometric mean
(ref)
1.18x faster
Benchmarks with tag 'regex':
Benchmark
bm-20231002-pythonperf1_win32-x86-python-v3.12.0-3.12.0-0fb18b0
bm-20250524-pythonperf1_win32-x86-python-2fd09b011031f3c00c34-3.15.0a0-2fd09b0
regex_effbot
2.04 ms
1.67 ms: 1.22x faster
regex_dna
127 ms
110 ms: 1.15x faster
regex_v8
15.0 ms
13.9 ms: 1.08x faster
regex_compile
129 ms
121 ms: 1.07x faster
Geometric mean
(ref)
1.13x faster
Benchmarks with tag 'serialize':
Benchmark
bm-20231002-pythonperf1_win32-x86-python-v3.12.0-3.12.0-0fb18b0
bm-20250524-pythonperf1_win32-x86-python-2fd09b011031f3c00c34-3.15.0a0-2fd09b0
xml_etree_iterparse
77.6 ms
67.7 ms: 1.15x faster
xml_etree_parse
113 ms
109 ms: 1.04x faster
unpickle_pure_python
210 us
206 us: 1.02x faster
xml_etree_process
53.2 ms
54.1 ms: 1.02x slower
xml_etree_generate
72.1 ms
75.2 ms: 1.04x slower
pickle_pure_python
286 us
303 us: 1.06x slower
json_loads
20.4 us
22.6 us: 1.11x slower
json_dumps
7.40 ms
8.31 ms: 1.12x slower
pickle_list
3.37 us
3.95 us: 1.17x slower
unpickle_list
2.95 us
3.59 us: 1.22x slower
pickle_dict
19.9 us
24.4 us: 1.22x slower
pickle
7.79 us
9.74 us: 1.25x slower
unpickle
9.71 us
12.8 us: 1.32x slower
tomli_loads
2.20 sec
3.24 sec: 1.48x slower
Geometric mean
(ref)
1.12x slower
Benchmarks with tag 'startup':
Benchmark
bm-20231002-pythonperf1_win32-x86-python-v3.12.0-3.12.0-0fb18b0
bm-20250524-pythonperf1_win32-x86-python-2fd09b011031f3c00c34-3.15.0a0-2fd09b0
python_startup_no_site
19.1 ms
20.7 ms: 1.08x slower
python_startup
22.4 ms
27.5 ms: 1.23x slower
Geometric mean
(ref)
1.15x slower
Benchmarks with tag 'template':
Benchmark
bm-20231002-pythonperf1_win32-x86-python-v3.12.0-3.12.0-0fb18b0
bm-20250524-pythonperf1_win32-x86-python-2fd09b011031f3c00c34-3.15.0a0-2fd09b0
mako
9.96 ms
11.4 ms: 1.15x slower
Geometric mean
(ref)
1.07x slower
Benchmark hidden because not significant (1): django_template
Benchmark
bm-20231002-pythonperf1_win32-x86-python-v3.12.0-3.12.0-0fb18b0
bm-20250524-pythonperf1_win32-x86-python-2fd09b011031f3c00c34-3.15.0a0-2fd09b0
pathlib
91.4 ms
34.6 ms: 2.64x faster
async_tree_io_tg
677 ms
389 ms: 1.74x faster
async_tree_io
693 ms
415 ms: 1.67x faster
async_tree_memoization_tg
350 ms
221 ms: 1.59x faster
async_tree_none_tg
278 ms
175 ms: 1.58x faster
deepcopy_memo
38.4 us
25.2 us: 1.52x faster
async_tree_memoization
364 ms
244 ms: 1.49x faster
async_tree_none
298 ms
200 ms: 1.49x faster
deepcopy
360 us
265 us: 1.36x faster
generators
38.5 ms
28.4 ms: 1.36x faster
float
76.7 ms
57.3 ms: 1.34x faster
mdp
1.91 sec
1.44 sec: 1.33x faster
asyncio_tcp
662 ms
498 ms: 1.33x faster
gc_traversal
1.44 ms
1.11 ms: 1.30x faster
unpack_sequence
62.5 ns
48.2 ns: 1.30x faster
scimark_sor
130 ms
100 ms: 1.30x faster
coroutines
20.9 ms
16.2 ms: 1.29x faster
sqlite_synth
2.07 us
1.63 us: 1.27x faster
async_tree_cpu_io_mixed_tg
546 ms
434 ms: 1.26x faster
spectral_norm
104 ms
84.5 ms: 1.23x faster
async_tree_cpu_io_mixed
564 ms
459 ms: 1.23x faster
regex_effbot
2.04 ms
1.67 ms: 1.22x faster
hexiom
6.82 ms
5.58 ms: 1.22x faster
deltablue
3.58 ms
2.96 ms: 1.21x faster
comprehensions
19.2 us
16.2 us: 1.19x faster
scimark_lu
93.2 ms
79.0 ms: 1.18x faster
nbody
127 ms
109 ms: 1.17x faster
regex_dna
127 ms
110 ms: 1.15x faster
go
137 ms
119 ms: 1.15x faster
xml_etree_iterparse
77.6 ms
67.7 ms: 1.15x faster
chaos
69.4 ms
60.9 ms: 1.14x faster
dulwich_log
58.5 ms
51.3 ms: 1.14x faster
deepcopy_reduce
3.23 us
2.84 us: 1.14x faster
scimark_monte_carlo
66.4 ms
58.5 ms: 1.13x faster
pyflate
424 ms
376 ms: 1.13x faster
raytrace
308 ms
277 ms: 1.11x faster
regex_v8
15.0 ms
13.9 ms: 1.08x faster
scimark_sparse_mat_mult
3.86 ms
3.58 ms: 1.08x faster
regex_compile
129 ms
121 ms: 1.07x faster
scimark_fft
271 ms
256 ms: 1.06x faster
pidigits
199 ms
189 ms: 1.06x faster
nqueens
93.7 ms
89.3 ms: 1.05x faster
2to3
280 ms
268 ms: 1.05x faster
sympy_integrate
17.5 ms
16.8 ms: 1.04x faster
xml_etree_parse
113 ms
109 ms: 1.04x faster
logging_simple
9.75 us
9.37 us: 1.04x faster
logging_format
10.4 us
10.1 us: 1.03x faster
async_generators
313 ms
305 ms: 1.03x faster
unpickle_pure_python
210 us
206 us: 1.02x faster
sympy_sum
123 ms
121 ms: 1.01x faster
sympy_str
240 ms
236 ms: 1.01x faster
xml_etree_process
53.2 ms
54.1 ms: 1.02x slower
sympy_expand
398 ms
410 ms: 1.03x slower
richards
41.3 ms
42.7 ms: 1.03x slower
xml_etree_generate
72.1 ms
75.2 ms: 1.04x slower
json
4.15 ms
4.33 ms: 1.04x slower
fannkuch
354 ms
371 ms: 1.05x slower
crypto_pyaes
69.2 ms
72.7 ms: 1.05x slower
meteor_contest
86.9 ms
91.8 ms: 1.06x slower
pickle_pure_python
286 us
303 us: 1.06x slower
richards_super
46.5 ms
49.3 ms: 1.06x slower
pycparser
978 ms
1.06 sec: 1.08x slower
bench_mp_pool
75.4 ms
81.6 ms: 1.08x slower
python_startup_no_site
19.1 ms
20.7 ms: 1.08x slower
json_loads
20.4 us
22.6 us: 1.11x slower
bench_thread_pool
1.10 ms
1.23 ms: 1.12x slower
json_dumps
7.40 ms
8.31 ms: 1.12x slower
mako
9.96 ms
11.4 ms: 1.15x slower
pickle_list
3.37 us
3.95 us: 1.17x slower
pprint_safe_repr
721 ms
855 ms: 1.19x slower
unpickle_list
2.95 us
3.59 us: 1.22x slower
pickle_dict
19.9 us
24.4 us: 1.22x slower
python_startup
22.4 ms
27.5 ms: 1.23x slower
pickle
7.79 us
9.74 us: 1.25x slower
asyncio_tcp_ssl
17.7 sec
22.4 sec: 1.27x slower
unpickle
9.71 us
12.8 us: 1.32x slower
telco
5.51 ms
7.33 ms: 1.33x slower
typing_runtime_protocols
126 us
179 us: 1.42x slower
create_gc_cycles
652 us
930 us: 1.43x slower
tomli_loads
2.20 sec
3.24 sec: 1.48x slower
coverage
48.4 ms
74.9 ms: 1.55x slower
docutils
1.98 sec
3.10 sec: 1.56x slower
pprint_pformat
1.50 sec
2.53 sec: 1.69x slower
logging_silent
101 ns
419 ns: 4.14x slower
Geometric mean
(ref)
1.04x faster
Benchmark hidden because not significant (1): django_template
Ignored benchmarks (11) of results/bm-20231002-3.12.0-0fb18b0/bm-20231002-pythonperf1_win32-x86-python-v3.12.0-3.12.0-0fb18b0.json: aiohttp, chameleon, dask, mypy2, sqlalchemy_declarative, sqlalchemy_imperative, sqlglot_normalize, sqlglot_optimize, sqlglot_parse, sqlglot_transpile, tornado_http
Ignored benchmarks (17) of results/bm-20250524-3.15.0a0-2fd09b0-NOGIL/bm-20250524-pythonperf1_win32-x86-python-2fd09b011031f3c00c34-3.15.0a0-2fd09b0.json: asyncio_websockets, bpe_tokeniser, connected_components, genshi_text, genshi_xml, html5lib, k_core, many_optionals, pylint, shortest_path, sphinx, sqlglot_v2_normalize, sqlglot_v2_optimize, sqlglot_v2_parse, sqlglot_v2_transpile, subparsers, thrift
Geometric mean (including insignificant results): 1.085x faster
Reliability score: 99.94% likely to be faster
90% likely to have a speedup of 1.05x
95% likely to have a speedup of 1.04x
99% likely to have a speedup of 1.02x