Skip to content

fix: benchmark timeout for too much outer joins on concat #2408

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ilan-gold merged 2 commits into from
Apr 22, 2026
+2 −2

Update sparse_dataset.py

df3b7a3
Select commit
Loading
Failed to load commit list.
Merged

fix: benchmark timeout for too much outer joins on concat #2408

Update sparse_dataset.py
df3b7a3
Select commit
Loading
Failed to load commit list.
scverse-benchmark / benchmark succeeded Apr 22, 2026 in 54m 27s

Benchmark

Benchmark run successful

Details

All benchmarks:

Change Before [91b6289] After [df3b7a3] Ratio Benchmark (Parameter)
266009.0 266454.0 1.00 anndata.GarbargeCollectionSuite.track_peakmem_garbage_collection
222M 222M 1.00 backed_hdf5.BackedHDF5Indexing.peakmem_fancy_index_no_dupes('sparse')
222M 222M 1.00 backed_hdf5.BackedHDF5Indexing.peakmem_index_with_dupes_obs('sparse')
222M 223M 1.00 backed_hdf5.BackedHDF5Indexing.peakmem_slice_obs('sparse')
251M 251M 1.00 backed_hdf5.BackedHDF5Indexing.peakmem_to_memory_subset('sparse')
1.80±0.01ms 1.80±0.01ms 1.00 backed_hdf5.BackedHDF5Indexing.time_fancy_index_no_dupes('sparse')
36.7±1ms 38.9±1ms 1.06 backed_hdf5.BackedHDF5Indexing.time_fancy_index_no_dupes_to_memory('sparse')
1.47±0.01ms 1.41±0.01ms 0.96 backed_hdf5.BackedHDF5Indexing.time_index_with_dupes_obs('sparse')
1.48±0.07ms 1.40±0ms 0.95 backed_hdf5.BackedHDF5Indexing.time_slice_obs('sparse')
28.0±4ms 34.8±2ms ~1.24 backed_hdf5.BackedHDF5Indexing.time_slice_obs_to_memory('sparse')
15.0±0.4ms 15.4±0.3ms 1.02 backed_hdf5.BackedHDF5Indexing.time_to_memory_subset('sparse')
236M 236M 1.00 dataset2d.Dataset2D.peakmem_full_to_memory('h5ad', (-1,), 'all')
219M 219M 1.00 dataset2d.Dataset2D.peakmem_full_to_memory('h5ad', (-1,), 'cat')
219M 219M 1.00 dataset2d.Dataset2D.peakmem_full_to_memory('h5ad', (-1,), 'nullable-string-array')
224M 223M 1.00 dataset2d.Dataset2D.peakmem_full_to_memory('h5ad', (-1,), 'numeric')
224M 223M 1.00 dataset2d.Dataset2D.peakmem_full_to_memory('h5ad', (-1,), 'string-array')
255M 256M 1.00 dataset2d.Dataset2D.peakmem_full_to_memory('h5ad', None, 'all')
219M 219M 1.00 dataset2d.Dataset2D.peakmem_full_to_memory('h5ad', None, 'cat')
219M 219M 1.00 dataset2d.Dataset2D.peakmem_full_to_memory('h5ad', None, 'nullable-string-array')
242M 243M 1.00 dataset2d.Dataset2D.peakmem_full_to_memory('h5ad', None, 'numeric')
223M 225M 1.01 dataset2d.Dataset2D.peakmem_full_to_memory('h5ad', None, 'string-array')
230M 235M 1.02 dataset2d.Dataset2D.peakmem_full_to_memory('zarr', (-1,), 'all')
209M 207M 0.99 dataset2d.Dataset2D.peakmem_full_to_memory('zarr', (-1,), 'cat')
207M 207M 1.00 dataset2d.Dataset2D.peakmem_full_to_memory('zarr', (-1,), 'nullable-string-array')
217M 216M 1.00 dataset2d.Dataset2D.peakmem_full_to_memory('zarr', (-1,), 'numeric')
219M 219M 1.00 dataset2d.Dataset2D.peakmem_full_to_memory('zarr', (-1,), 'string-array')
237M 237M 1.00 dataset2d.Dataset2D.peakmem_full_to_memory('zarr', None, 'all')
208M 209M 1.01 dataset2d.Dataset2D.peakmem_full_to_memory('zarr', None, 'cat')
209M 209M 1.00 dataset2d.Dataset2D.peakmem_full_to_memory('zarr', None, 'nullable-string-array')
218M 213M 0.98 dataset2d.Dataset2D.peakmem_full_to_memory('zarr', None, 'numeric')
221M 219M 0.99 dataset2d.Dataset2D.peakmem_full_to_memory('zarr', None, 'string-array')
237M 237M 1.00 dataset2d.Dataset2D.peakmem_getitem_bool_mask('h5ad', (-1,), 'all')
219M 219M 1.00 dataset2d.Dataset2D.peakmem_getitem_bool_mask('h5ad', (-1,), 'cat')
220M 220M 1.00 dataset2d.Dataset2D.peakmem_getitem_bool_mask('h5ad', (-1,), 'nullable-string-array')
228M 227M 1.00 dataset2d.Dataset2D.peakmem_getitem_bool_mask('h5ad', (-1,), 'numeric')
229M 227M 0.99 dataset2d.Dataset2D.peakmem_getitem_bool_mask('h5ad', (-1,), 'string-array')
281M 280M 1.00 dataset2d.Dataset2D.peakmem_getitem_bool_mask('h5ad', None, 'all')
219M 220M 1.00 dataset2d.Dataset2D.peakmem_getitem_bool_mask('h5ad', None, 'cat')
219M 220M 1.00 dataset2d.Dataset2D.peakmem_getitem_bool_mask('h5ad', None, 'nullable-string-array')
272M 273M 1.00 dataset2d.Dataset2D.peakmem_getitem_bool_mask('h5ad', None, 'numeric')
271M 271M 1.00 dataset2d.Dataset2D.peakmem_getitem_bool_mask('h5ad', None, 'string-array')
230M 229M 0.99 dataset2d.Dataset2D.peakmem_getitem_bool_mask('zarr', (-1,), 'all')
209M 209M 1.00 dataset2d.Dataset2D.peakmem_getitem_bool_mask('zarr', (-1,), 'cat')
209M 210M 1.00 dataset2d.Dataset2D.peakmem_getitem_bool_mask('zarr', (-1,), 'nullable-string-array')
217M 220M 1.01 dataset2d.Dataset2D.peakmem_getitem_bool_mask('zarr', (-1,), 'numeric')
222M 220M 0.99 dataset2d.Dataset2D.peakmem_getitem_bool_mask('zarr', (-1,), 'string-array')
236M 232M 0.98 dataset2d.Dataset2D.peakmem_getitem_bool_mask('zarr', None, 'all')
209M 210M 1.00 dataset2d.Dataset2D.peakmem_getitem_bool_mask('zarr', None, 'cat')
210M 209M 1.00 dataset2d.Dataset2D.peakmem_getitem_bool_mask('zarr', None, 'nullable-string-array')
218M 217M 1.00 dataset2d.Dataset2D.peakmem_getitem_bool_mask('zarr', None, 'numeric')
219M 221M 1.01 dataset2d.Dataset2D.peakmem_getitem_bool_mask('zarr', None, 'string-array')
230M 229M 1.00 dataset2d.Dataset2D.peakmem_getitem_slice('h5ad', (-1,), 'all')
219M 219M 1.00 dataset2d.Dataset2D.peakmem_getitem_slice('h5ad', (-1,), 'cat')
219M 220M 1.00 dataset2d.Dataset2D.peakmem_getitem_slice('h5ad', (-1,), 'nullable-string-array')
223M 223M 1.00 dataset2d.Dataset2D.peakmem_getitem_slice('h5ad', (-1,), 'numeric')
223M 223M 1.00 dataset2d.Dataset2D.peakmem_getitem_slice('h5ad', (-1,), 'string-array')
242M 244M 1.01 dataset2d.Dataset2D.peakmem_getitem_slice('h5ad', None, 'all')
219M 219M 1.00 dataset2d.Dataset2D.peakmem_getitem_slice('h5ad', None, 'cat')
219M 219M 1.00 dataset2d.Dataset2D.peakmem_getitem_slice('h5ad', None, 'nullable-string-array')
235M 235M 1.00 dataset2d.Dataset2D.peakmem_getitem_slice('h5ad', None, 'numeric')
234M 233M 1.00 dataset2d.Dataset2D.peakmem_getitem_slice('h5ad', None, 'string-array')
225M 224M 0.99 dataset2d.Dataset2D.peakmem_getitem_slice('zarr', (-1,), 'all')
210M 209M 1.00 dataset2d.Dataset2D.peakmem_getitem_slice('zarr', (-1,), 'cat')
209M 210M 1.00 dataset2d.Dataset2D.peakmem_getitem_slice('zarr', (-1,), 'nullable-string-array')
215M 215M 1.00 dataset2d.Dataset2D.peakmem_getitem_slice('zarr', (-1,), 'numeric')
218M 218M 1.00 dataset2d.Dataset2D.peakmem_getitem_slice('zarr', (-1,), 'string-array')
224M 229M 1.02 dataset2d.Dataset2D.peakmem_getitem_slice('zarr', None, 'all')
209M 209M 1.00 dataset2d.Dataset2D.peakmem_getitem_slice('zarr', None, 'cat')
207M 207M 1.00 dataset2d.Dataset2D.peakmem_getitem_slice('zarr', None, 'nullable-string-array')
217M 217M 1.00 dataset2d.Dataset2D.peakmem_getitem_slice('zarr', None, 'numeric')
216M 218M 1.01 dataset2d.Dataset2D.peakmem_getitem_slice('zarr', None, 'string-array')
224M 224M 1.00 dataset2d.Dataset2D.peakmem_read_lazy_default('h5ad', (-1,), 'all')
224M 224M 1.00 dataset2d.Dataset2D.peakmem_read_lazy_default('h5ad', (-1,), 'cat')
224M 224M 1.00 dataset2d.Dataset2D.peakmem_read_lazy_default('h5ad', (-1,), 'nullable-string-array')
224M 224M 1.00 dataset2d.Dataset2D.peakmem_read_lazy_default('h5ad', (-1,), 'numeric')
225M 225M 1.00 dataset2d.Dataset2D.peakmem_read_lazy_default('h5ad', (-1,), 'string-array')
224M 224M 1.00 dataset2d.Dataset2D.peakmem_read_lazy_default('h5ad', None, 'all')
224M 224M 1.00 dataset2d.Dataset2D.peakmem_read_lazy_default('h5ad', None, 'cat')
223M 224M 1.00 dataset2d.Dataset2D.peakmem_read_lazy_default('h5ad', None, 'nullable-string-array')
224M 224M 1.00 dataset2d.Dataset2D.peakmem_read_lazy_default('h5ad', None, 'numeric')
225M 225M 1.00 dataset2d.Dataset2D.peakmem_read_lazy_default('h5ad', None, 'string-array')
215M 215M 1.00 dataset2d.Dataset2D.peakmem_read_lazy_default('zarr', (-1,), 'all')
214M 214M 1.00 dataset2d.Dataset2D.peakmem_read_lazy_default('zarr', (-1,), 'cat')
215M 214M 1.00 dataset2d.Dataset2D.peakmem_read_lazy_default('zarr', (-1,), 'nullable-string-array')
213M 212M 1.00 dataset2d.Dataset2D.peakmem_read_lazy_default('zarr', (-1,), 'numeric')
213M 213M 1.00 dataset2d.Dataset2D.peakmem_read_lazy_default('zarr', (-1,), 'string-array')
214M 217M 1.02 dataset2d.Dataset2D.peakmem_read_lazy_default('zarr', None, 'all')
215M 215M 1.00 dataset2d.Dataset2D.peakmem_read_lazy_default('zarr', None, 'cat')
214M 217M 1.02 dataset2d.Dataset2D.peakmem_read_lazy_default('zarr', None, 'nullable-string-array')
215M 217M 1.01 dataset2d.Dataset2D.peakmem_read_lazy_default('zarr', None, 'numeric')
215M 214M 1.00 dataset2d.Dataset2D.peakmem_read_lazy_default('zarr', None, 'string-array')
8.00±0.05s 8.02±0.03s 1.00 dataset2d.Dataset2D.time_concat('h5ad', (-1,), 'all')
3.76±0.01s 3.74±0.01s 0.99 dataset2d.Dataset2D.time_concat('h5ad', (-1,), 'cat')
5.81±0.01s 5.87±0s 1.01 dataset2d.Dataset2D.time_concat('h5ad', (-1,), 'nullable-string-array')
3.56±0.02s 3.58±0.05s 1.01 dataset2d.Dataset2D.time_concat('h5ad', (-1,), 'numeric')
3.55±0.01s 3.55±0s 1.00 dataset2d.Dataset2D.time_concat('h5ad', (-1,), 'string-array')
8.03±0s 8.02±0.01s 1.00 dataset2d.Dataset2D.time_concat('h5ad', None, 'all')
3.72±0.01s 3.73±0.01s 1.00 dataset2d.Dataset2D.time_concat('h5ad', None, 'cat')
5.83±0.02s 5.81±0.02s 1.00 dataset2d.Dataset2D.time_concat('h5ad', None, 'nullable-string-array')
3.57±0.01s 3.57±0.01s 1.00 dataset2d.Dataset2D.time_concat('h5ad', None, 'numeric')
3.57±0.01s 3.62±0.04s 1.02 dataset2d.Dataset2D.time_concat('h5ad', None, 'string-array')
9.31±0.1s 9.11±0.05s 0.98 dataset2d.Dataset2D.time_concat('zarr', (-1,), 'all')
4.10±0.05s 4.02±0.07s 0.98 dataset2d.Dataset2D.time_concat('zarr', (-1,), 'cat')
6.52±0s 6.49±0.02s 1.00 dataset2d.Dataset2D.time_concat('zarr', (-1,), 'nullable-string-array')
3.58±0.02s 3.60±0.01s 1.00 dataset2d.Dataset2D.time_concat('zarr', (-1,), 'numeric')
3.55±0.02s 3.66±0.1s 1.03 dataset2d.Dataset2D.time_concat('zarr', (-1,), 'string-array')
9.04±0.05s 9.17±0.02s 1.01 dataset2d.Dataset2D.time_concat('zarr', None, 'all')
3.90±0.1s 3.82±0.07s 0.98 dataset2d.Dataset2D.time_concat('zarr', None, 'cat')
6.49±0s 6.52±0s 1.00 dataset2d.Dataset2D.time_concat('zarr', None, 'nullable-string-array')
3.66±0.05s 3.53±0.03s 0.97 dataset2d.Dataset2D.time_concat('zarr', None, 'numeric')
3.64±0.02s 3.82±0.2s 1.05 dataset2d.Dataset2D.time_concat('zarr', None, 'string-array')
271±1ms 271±0.8ms 1.00 dataset2d.Dataset2D.time_full_to_memory('h5ad', (-1,), 'all')
9.05±0.8ms 9.11±0.8ms 1.01 dataset2d.Dataset2D.time_full_to_memory('h5ad', (-1,), 'cat')
137±0.3ms 137±0.6ms 1.00 dataset2d.Dataset2D.time_full_to_memory('h5ad', (-1,), 'nullable-string-array')
- 5.93±0.08ms 5.09±0.1ms 0.86 dataset2d.Dataset2D.time_full_to_memory('h5ad', (-1,), 'numeric')
9.96±0.06ms 9.98±0.1ms 1.00 dataset2d.Dataset2D.time_full_to_memory('h5ad', (-1,), 'string-array')
492±5ms 503±6ms 1.02 dataset2d.Dataset2D.time_full_to_memory('h5ad', None, 'all')
8.37±0.04ms 8.39±0.02ms 1.00 dataset2d.Dataset2D.time_full_to_memory('h5ad', None, 'cat')
136±0.3ms 137±0.2ms 1.00 dataset2d.Dataset2D.time_full_to_memory('h5ad', None, 'nullable-string-array')
208±2ms 207±3ms 0.99 dataset2d.Dataset2D.time_full_to_memory('h5ad', None, 'numeric')
13.2±0.3ms 13.2±0.3ms 1.00 dataset2d.Dataset2D.time_full_to_memory('h5ad', None, 'string-array')
303±6ms 321±3ms 1.06 dataset2d.Dataset2D.time_full_to_memory('zarr', (-1,), 'all')
16.1±0.7ms 16.7±0.4ms 1.03 dataset2d.Dataset2D.time_full_to_memory('zarr', (-1,), 'cat')
157±1ms 158±4ms 1.01 dataset2d.Dataset2D.time_full_to_memory('zarr', (-1,), 'nullable-string-array')
12.9±0.8ms 11.9±0.5ms 0.92 dataset2d.Dataset2D.time_full_to_memory('zarr', (-1,), 'numeric')
56.2±0.4ms 53.6±2ms 0.95 dataset2d.Dataset2D.time_full_to_memory('zarr', (-1,), 'string-array')
327±4ms 322±7ms 0.98 dataset2d.Dataset2D.time_full_to_memory('zarr', None, 'all')
18.3±0.2ms 15.1±0.4ms ~0.82 dataset2d.Dataset2D.time_full_to_memory('zarr', None, 'cat')
157±2ms 161±3ms 1.03 dataset2d.Dataset2D.time_full_to_memory('zarr', None, 'nullable-string-array')
16.6±1ms 14.6±0.4ms ~0.88 dataset2d.Dataset2D.time_full_to_memory('zarr', None, 'numeric')
52.6±0.9ms 55.8±0.9ms 1.06 dataset2d.Dataset2D.time_full_to_memory('zarr', None, 'string-array')
446±1ms 451±1ms 1.01 dataset2d.Dataset2D.time_getitem_bool_mask('h5ad', (-1,), 'all')
64.6±0.8ms 74.1±5ms ~1.15 dataset2d.Dataset2D.time_getitem_bool_mask('h5ad', (-1,), 'cat')
189±0.5ms 200±7ms 1.06 dataset2d.Dataset2D.time_getitem_bool_mask('h5ad', (-1,), 'nullable-string-array')
21.1±0.8ms 19.2±0.5ms ~0.91 dataset2d.Dataset2D.time_getitem_bool_mask('h5ad', (-1,), 'numeric')
21.8±0.3ms 21.6±0.5ms 0.99 dataset2d.Dataset2D.time_getitem_bool_mask('h5ad', (-1,), 'string-array')
2.12±0.02s 2.11±0.04s 1.00 dataset2d.Dataset2D.time_getitem_bool_mask('h5ad', None, 'all')
64.5±0.07ms 64.4±0.2ms 1.00 dataset2d.Dataset2D.time_getitem_bool_mask('h5ad', None, 'cat')
209±0.7ms 208±3ms 1.00 dataset2d.Dataset2D.time_getitem_bool_mask('h5ad', None, 'nullable-string-array')
1.62±0.02s 1.62±0.02s 1.00 dataset2d.Dataset2D.time_getitem_bool_mask('h5ad', None, 'numeric')
1.31±0.01s 1.28±0.01s 0.98 dataset2d.Dataset2D.time_getitem_bool_mask('h5ad', None, 'string-array')
360±5ms 367±4ms 1.02 dataset2d.Dataset2D.time_getitem_bool_mask('zarr', (-1,), 'all')
21.5±0.3ms 21.6±0.4ms 1.00 dataset2d.Dataset2D.time_getitem_bool_mask('zarr', (-1,), 'cat')
168±0.7ms 169±0.9ms 1.00 dataset2d.Dataset2D.time_getitem_bool_mask('zarr', (-1,), 'nullable-string-array')
30.3±0.6ms 30.4±0.4ms 1.01 dataset2d.Dataset2D.time_getitem_bool_mask('zarr', (-1,), 'numeric')
72.4±1ms 74.5±1ms 1.03 dataset2d.Dataset2D.time_getitem_bool_mask('zarr', (-1,), 'string-array')
374±3ms 377±6ms 1.01 dataset2d.Dataset2D.time_getitem_bool_mask('zarr', None, 'all')
21.9±0.09ms 20.3±1ms 0.93 dataset2d.Dataset2D.time_getitem_bool_mask('zarr', None, 'cat')
172±0.8ms 168±1ms 0.98 dataset2d.Dataset2D.time_getitem_bool_mask('zarr', None, 'nullable-string-array')
39.6±1ms 41.0±0.5ms 1.04 dataset2d.Dataset2D.time_getitem_bool_mask('zarr', None, 'numeric')
74.1±1ms 71.9±0.6ms 0.97 dataset2d.Dataset2D.time_getitem_bool_mask('zarr', None, 'string-array')
140±0.9ms 141±0.8ms 1.01 dataset2d.Dataset2D.time_getitem_slice('h5ad', (-1,), 'all')
6.53±0.05ms 6.05±0.5ms 0.93 dataset2d.Dataset2D.time_getitem_slice('h5ad', (-1,), 'cat')
67.0±0.1ms 67.1±0.06ms 1.00 dataset2d.Dataset2D.time_getitem_slice('h5ad', (-1,), 'nullable-string-array')
6.13±0.4ms 5.56±0.1ms ~0.91 dataset2d.Dataset2D.time_getitem_slice('h5ad', (-1,), 'numeric')
7.56±0.2ms 8.15±0.3ms 1.08 dataset2d.Dataset2D.time_getitem_slice('h5ad', (-1,), 'string-array')
292±6ms 293±5ms 1.00 dataset2d.Dataset2D.time_getitem_slice('h5ad', None, 'all')
5.50±0.04ms 5.49±0.01ms 1.00 dataset2d.Dataset2D.time_getitem_slice('h5ad', None, 'cat')
68.5±0.4ms 67.6±1ms 0.99 dataset2d.Dataset2D.time_getitem_slice('h5ad', None, 'nullable-string-array')
144±2ms 141±5ms 0.98 dataset2d.Dataset2D.time_getitem_slice('h5ad', None, 'numeric')
30.7±3ms 30.2±0.9ms 0.98 dataset2d.Dataset2D.time_getitem_slice('h5ad', None, 'string-array')
265±5ms 260±4ms 0.98 dataset2d.Dataset2D.time_getitem_slice('zarr', (-1,), 'all')
15.3±0.09ms 15.7±0.2ms 1.02 dataset2d.Dataset2D.time_getitem_slice('zarr', (-1,), 'cat')
134±1ms 136±1ms 1.01 dataset2d.Dataset2D.time_getitem_slice('zarr', (-1,), 'nullable-string-array')
9.82±0.5ms 9.57±0.4ms 0.97 dataset2d.Dataset2D.time_getitem_slice('zarr', (-1,), 'numeric')
47.4±1ms 47.0±1ms 0.99 dataset2d.Dataset2D.time_getitem_slice('zarr', (-1,), 'string-array')
263±5ms 262±4ms 1.00 dataset2d.Dataset2D.time_getitem_slice('zarr', None, 'all')
+ 12.3±2ms 15.3±0.1ms 1.24 dataset2d.Dataset2D.time_getitem_slice('zarr', None, 'cat')
133±5ms 137±2ms 1.03 dataset2d.Dataset2D.time_getitem_slice('zarr', None, 'nullable-string-array')
12.6±0.7ms 12.5±0.5ms 0.99 dataset2d.Dataset2D.time_getitem_slice('zarr', None, 'numeric')
46.8±0.7ms 47.3±1ms 1.01 dataset2d.Dataset2D.time_getitem_slice('zarr', None, 'string-array')
58.9±0.4ms 59.0±0.5ms 1.00 dataset2d.Dataset2D.time_read_lazy_default('h5ad', (-1,), 'all')
56.3±2ms 56.7±1ms 1.01 dataset2d.Dataset2D.time_read_lazy_default('h5ad', (-1,), 'cat')
55.1±0.2ms 54.6±0.2ms 0.99 dataset2d.Dataset2D.time_read_lazy_default('h5ad', (-1,), 'nullable-string-array')
57.1±0.6ms 56.5±0.5ms 0.99 dataset2d.Dataset2D.time_read_lazy_default('h5ad', (-1,), 'numeric')
107±1ms 107±0.4ms 1.01 dataset2d.Dataset2D.time_read_lazy_default('h5ad', (-1,), 'string-array')
58.7±0.5ms 58.8±0.4ms 1.00 dataset2d.Dataset2D.time_read_lazy_default('h5ad', None, 'all')
54.8±0.5ms 54.9±0.4ms 1.00 dataset2d.Dataset2D.time_read_lazy_default('h5ad', None, 'cat')
55.0±0.3ms 54.9±0.1ms 1.00 dataset2d.Dataset2D.time_read_lazy_default('h5ad', None, 'nullable-string-array')
57.1±0.4ms 56.5±0.2ms 0.99 dataset2d.Dataset2D.time_read_lazy_default('h5ad', None, 'numeric')
107±0.6ms 106±0.3ms 0.99 dataset2d.Dataset2D.time_read_lazy_default('h5ad', None, 'string-array')
95.7±3ms 100±2ms 1.05 dataset2d.Dataset2D.time_read_lazy_default('zarr', (-1,), 'all')
82.0±0.8ms 82.0±2ms 1.00 dataset2d.Dataset2D.time_read_lazy_default('zarr', (-1,), 'cat')
81.8±2ms 82.9±1ms 1.01 dataset2d.Dataset2D.time_read_lazy_default('zarr', (-1,), 'nullable-string-array')
82.4±1ms 82.8±2ms 1.00 dataset2d.Dataset2D.time_read_lazy_default('zarr', (-1,), 'numeric')
82.7±1ms 83.2±2ms 1.01 dataset2d.Dataset2D.time_read_lazy_default('zarr', (-1,), 'string-array')
101±3ms 98.2±6ms 0.97 dataset2d.Dataset2D.time_read_lazy_default('zarr', None, 'all')
79.6±1ms 83.4±0.9ms 1.05 dataset2d.Dataset2D.time_read_lazy_default('zarr', None, 'cat')
81.1±1ms 82.1±0.8ms 1.01 dataset2d.Dataset2D.time_read_lazy_default('zarr', None, 'nullable-string-array')
83.1±0.6ms 82.4±1ms 0.99 dataset2d.Dataset2D.time_read_lazy_default('zarr', None, 'numeric')
81.3±2ms 82.4±1ms 1.01 dataset2d.Dataset2D.time_read_lazy_default('zarr', None, 'string-array')
246M 246M 1.00 readwrite.H5ADBackedWriteSuite.peakmem_write_compressed('pbmc3k')
246M 246M 1.00 readwrite.H5ADBackedWriteSuite.peakmem_write_full('pbmc3k')
693±5ms 706±8ms 1.02 readwrite.H5ADBackedWriteSuite.time_write_compressed('pbmc3k')
197±0.4ms 197±0.5ms 1.00 readwrite.H5ADBackedWriteSuite.time_write_full('pbmc3k')
44.60546875 44.47265625 1.00 readwrite.H5ADBackedWriteSuite.track_peakmem_write_compressed('pbmc3k')
45.1796875 45.33984375 1.00 readwrite.H5ADBackedWriteSuite.track_peakmem_write_full('pbmc3k')
96547485 96547485 1.00 readwrite.H5ADInMemorySizeSuite.track_actual_in_memory_size
19646182 19646182 1.00 readwrite.H5ADInMemorySizeSuite.track_in_memory_size
19.6M 19.6M 1.00 readwrite.H5ADReadSuite.mem_readfull_object
208M 208M 1.00 readwrite.H5ADReadSuite.peakmem_read_backed
239M 240M 1.00 readwrite.H5ADReadSuite.peakmem_read_full
145±0.5ms 144±1ms 1.00 readwrite.H5ADReadSuite.time_read_full
1.114072206716485 1.1016100178890877 0.99 readwrite.H5ADReadSuite.track_read_full_memratio
243M 243M 1.00 readwrite.H5ADWriteSuite.peakmem_write_compressed('pbmc3k')
244M 243M 1.00 readwrite.H5ADWriteSuite.peakmem_write_full('pbmc3k')
570±6ms 572±6ms 1.00 readwrite.H5ADWriteSuite.time_write_compressed('pbmc3k')
86.6±7ms 87.1±7ms 1.01 readwrite.H5ADWriteSuite.time_write_full('pbmc3k')
+ 8.0234375 9.0234375 1.12 readwrite.H5ADWriteSuite.track_peakmem_write_compressed('pbmc3k')
9.0234375 9.0234375 1.00 readwrite.H5ADWriteSuite.track_peakmem_write_full('pbmc3k')
198M 199M 1.00 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem('0:1000', False)
215M 219M 1.02 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem('0:1000', True)
230M 232M 1.01 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem('0:9000', False)
286M 284M 0.99 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem('0:9000', True)
204M 204M 1.00 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem(':9000:-1', False)
214M 216M 1.01 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem(':9000:-1', True)
241M 241M 1.00 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem('::-2', False)
270M 281M 1.04 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem('::-2', True)
264M 265M 1.01 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem('alternating', False)
307M 316M 1.03 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem('alternating', True)
204M 204M 1.00 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem('arange', False)
218M 218M 1.00 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem('arange', True)
201M 199M 0.99 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem('array', False)
228M 226M 0.99 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem('array', True)
196M 196M 1.00 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem('first', False)
217M 214M 0.99 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem('first', True)
198M 196M 0.99 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata('0:1000', False)
196M 195M 1.00 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata('0:1000', True)
198M 198M 1.00 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata('0:9000', False)
198M 198M 1.00 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata('0:9000', True)
196M 196M 1.00 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata(':9000:-1', False)
199M 199M 1.00 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata(':9000:-1', True)
196M 196M 1.00 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata('::-2', False)
198M 196M 0.99 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata('::-2', True)
199M 196M 0.99 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata('alternating', False)
199M 199M 1.00 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata('alternating', True)
196M 196M 1.00 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata('arange', False)
198M 196M 0.99 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata('arange', True)
198M 196M 0.99 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata('array', False)
196M 198M 1.01 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata('array', True)
198M 196M 0.99 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata('first', False)
196M 198M 1.01 sparse_dataset.SparseCSRContiguousSlice.peakmem_getitem_adata('first', True)
13.5±1ms 14.7±1ms 1.09 sparse_dataset.SparseCSRContiguousSlice.time_getitem('0:1000', False)
22.5±1ms 21.4±0.4ms 0.95 sparse_dataset.SparseCSRContiguousSlice.time_getitem('0:1000', True)
38.1±0.9ms 38.1±2ms 1.00 sparse_dataset.SparseCSRContiguousSlice.time_getitem('0:9000', False)
121±5ms 128±3ms 1.06 sparse_dataset.SparseCSRContiguousSlice.time_getitem('0:9000', True)
31.8±0.7ms 32.2±0.5ms 1.01 sparse_dataset.SparseCSRContiguousSlice.time_getitem(':9000:-1', False)
23.6±0.6ms 24.1±0.7ms 1.02 sparse_dataset.SparseCSRContiguousSlice.time_getitem(':9000:-1', True)
103±2ms 101±2ms 0.98 sparse_dataset.SparseCSRContiguousSlice.time_getitem('::-2', False)
130±3ms 136±5ms 1.05 sparse_dataset.SparseCSRContiguousSlice.time_getitem('::-2', True)
112±3ms 112±2ms 1.00 sparse_dataset.SparseCSRContiguousSlice.time_getitem('alternating', False)
174±3ms 175±3ms 1.01 sparse_dataset.SparseCSRContiguousSlice.time_getitem('alternating', True)
28.7±3ms 30.3±2ms 1.06 sparse_dataset.SparseCSRContiguousSlice.time_getitem('arange', False)
25.3±1ms 26.4±0.6ms 1.04 sparse_dataset.SparseCSRContiguousSlice.time_getitem('arange', True)
20.6±0.5ms 20.4±0.7ms 0.99 sparse_dataset.SparseCSRContiguousSlice.time_getitem('array', False)
46.7±2ms 44.1±4ms 0.95 sparse_dataset.SparseCSRContiguousSlice.time_getitem('array', True)
14.0±0.6ms 14.3±0.2ms 1.02 sparse_dataset.SparseCSRContiguousSlice.time_getitem('first', False)
22.4±2ms 23.3±0.2ms 1.04 sparse_dataset.SparseCSRContiguousSlice.time_getitem('first', True)
179±0.4μs 179±0.08μs 1.00 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata('0:1000', False)
180±0.2μs 179±0.2μs 1.00 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata('0:1000', True)
179±0.9μs 180±0.7μs 1.01 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata('0:9000', False)
179±0.3μs 178±1μs 1.00 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata('0:9000', True)
221±4μs 222±1μs 1.00 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata(':9000:-1', False)
221±1μs 226±0.7μs 1.02 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata(':9000:-1', True)
260±1μs 256±7μs 0.98 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata('::-2', False)
269±0.7μs 265±2μs 0.98 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata('::-2', True)
556±5μs 575±2μs 1.03 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata('alternating', False)
526±50μs 568±8μs 1.08 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata('alternating', True)
358±20μs 357±20μs 1.00 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata('arange', False)
384±4μs 360±20μs 0.94 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata('arange', True)
342±20μs 361±4μs 1.06 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata('array', False)
344±1μs 332±10μs 0.96 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata('array', True)
181±1μs 181±0.4μs 1.00 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata('first', False)
182±0.6μs 183±1μs 1.01 sparse_dataset.SparseCSRContiguousSlice.time_getitem_adata('first', True)
196M 196M 1.00 sparse_dataset.SparseCSRDask.peakmem_read
12.4±2ms 12.5±1ms 1.01 sparse_dataset.SparseCSRDask.time_read
211M 210M 1.00 sparse_dataset.SparseCSRDaskConcat.peakmem_concat('inner', -1)
210M 210M 1.00 sparse_dataset.SparseCSRDaskConcat.peakmem_concat('inner', 0)
210M 211M 1.00 sparse_dataset.SparseCSRDaskConcat.peakmem_concat('outer', -1)
210M 212M 1.01 sparse_dataset.SparseCSRDaskConcat.peakmem_concat('outer', 0)
414M 407M 0.98 sparse_dataset.SparseCSRDaskConcat.peakmem_concat_with_mem('inner', -1)
416M 414M 1.00 sparse_dataset.SparseCSRDaskConcat.peakmem_concat_with_mem('inner', 0)
788M 789M 1.00 sparse_dataset.SparseCSRDaskConcat.peakmem_concat_with_mem('outer', -1)
490M 487M 0.99 sparse_dataset.SparseCSRDaskConcat.peakmem_concat_with_mem('outer', 0)
62.0±2ms 60.8±5ms 0.98 sparse_dataset.SparseCSRDaskConcat.time_concat('inner', -1)
64.4±0.2ms 60.0±4ms 0.93 sparse_dataset.SparseCSRDaskConcat.time_concat('inner', 0)
58.3±0.4ms 58.2±0.2ms 1.00 sparse_dataset.SparseCSRDaskConcat.time_concat('outer', -1)
59.3±3ms 58.1±2ms 0.98 sparse_dataset.SparseCSRDaskConcat.time_concat('outer', 0)
302±10ms 305±10ms 1.01 sparse_dataset.SparseCSRDaskConcat.time_concat_with_mem('inner', -1)
287±20ms 294±20ms 1.03 sparse_dataset.SparseCSRDaskConcat.time_concat_with_mem('inner', 0)
2.16±0.01s 2.18±0s 1.01 sparse_dataset.SparseCSRDaskConcat.time_concat_with_mem('outer', -1)
406±8ms 406±7ms 1.00 sparse_dataset.SparseCSRDaskConcat.time_concat_with_mem('outer', 0)
View more details on scverse-benchmark