Skip to content

[Deprecation] Default memmap robust_key to True - #1717

Merged
vmoens merged 2 commits into
mainfrom
enact-robust-key-default-0.13
May 24, 2026
Merged

[Deprecation] Default memmap robust_key to True#1717
vmoens merged 2 commits into
mainfrom
enact-robust-key-default-0.13

Conversation

@vmoens

@vmoens vmoens commented May 24, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Enact the advertised robust memmap key encoding default by treating robust_key=None as robust behavior.
  • Change public robust_key defaults to True while preserving robust_key=False for legacy file names.
  • Remove the obsolete FutureWarning path and update tests/docs.

Validation

  • python -m pytest test/test_utils_key_json_split.py test/test_tensordict.py::TestMemmap -q
  • git diff --check

Release context

This addresses the deprecation warning audit for TensorDict 0.13.0. Other warnings found are either targeted for v0.14 or have no explicit removal target.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label May 24, 2026
@github-actions github-actions Bot added Test tensorclass store tensordict.store module Deprecation Announces or enacts a deprecation persistent PersistentTensorDict / HDF5 labels May 24, 2026
@github-actions

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 341. Improved: $\large\color{#35bf28}9$. Worsened: $\large\color{#d91a1a}19$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_collector_preallocated_write[stack_out-cpu-32-2] 0.2214ms 0.1673ms 5.9771 KOps/s 5.8625 KOps/s $\color{#35bf28}+1.96\%$
test_collector_preallocated_write[stack_out-cpu-32-8] 0.3737ms 0.2965ms 3.3732 KOps/s 3.3700 KOps/s $\color{#35bf28}+0.09\%$
test_collector_preallocated_write[stack_out-cpu-32-32] 0.9309ms 0.7727ms 1.2942 KOps/s 1.2792 KOps/s $\color{#35bf28}+1.17\%$
test_collector_preallocated_write[stack_out-cpu-4096-2] 0.3944ms 0.3466ms 2.8854 KOps/s 2.8732 KOps/s $\color{#35bf28}+0.42\%$
test_collector_preallocated_write[stack_out-cpu-4096-8] 1.4648ms 1.1997ms 833.5605 Ops/s 866.9477 Ops/s $\color{#d91a1a}-3.85\%$
test_collector_preallocated_write[stack_out-cpu-4096-32] 7.8960ms 7.5512ms 132.4285 Ops/s 132.9309 Ops/s $\color{#d91a1a}-0.38\%$
test_collector_preallocated_write[stack_out-cuda-32-2] 0.3067ms 0.2592ms 3.8583 KOps/s 4.0563 KOps/s $\color{#d91a1a}-4.88\%$
test_collector_preallocated_write[stack_out-cuda-32-8] 0.4495ms 0.3839ms 2.6048 KOps/s 2.7049 KOps/s $\color{#d91a1a}-3.70\%$
test_collector_preallocated_write[stack_out-cuda-32-32] 0.9519ms 0.8302ms 1.2046 KOps/s 1.2178 KOps/s $\color{#d91a1a}-1.09\%$
test_collector_preallocated_write[stack_out-cuda-4096-2] 0.3082ms 0.2575ms 3.8830 KOps/s 4.0600 KOps/s $\color{#d91a1a}-4.36\%$
test_collector_preallocated_write[stack_out-cuda-4096-8] 0.4817ms 0.3818ms 2.6190 KOps/s 2.7012 KOps/s $\color{#d91a1a}-3.04\%$
test_collector_preallocated_write[stack_out-cuda-4096-32] 1.0367ms 0.8908ms 1.1225 KOps/s 1.1304 KOps/s $\color{#d91a1a}-0.69\%$
test_collector_preallocated_write[set_at_loop-cpu-32-2] 0.2743ms 0.2146ms 4.6599 KOps/s 4.5600 KOps/s $\color{#35bf28}+2.19\%$
test_collector_preallocated_write[set_at_loop-cpu-32-8] 0.8821ms 0.8247ms 1.2126 KOps/s 1.1953 KOps/s $\color{#35bf28}+1.45\%$
test_collector_preallocated_write[set_at_loop-cpu-32-32] 3.3844ms 3.2900ms 303.9532 Ops/s 302.9519 Ops/s $\color{#35bf28}+0.33\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-2] 0.4491ms 0.3693ms 2.7077 KOps/s 2.6169 KOps/s $\color{#35bf28}+3.47\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-8] 1.9102ms 1.7359ms 576.0624 Ops/s 595.7228 Ops/s $\color{#d91a1a}-3.30\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-32] 10.9683ms 10.4540ms 95.6571 Ops/s 94.8847 Ops/s $\color{#35bf28}+0.81\%$
test_collector_preallocated_write[set_at_loop-cuda-32-2] 0.4369ms 0.3915ms 2.5540 KOps/s 2.5619 KOps/s $\color{#d91a1a}-0.31\%$
test_collector_preallocated_write[set_at_loop-cuda-32-8] 1.5550ms 1.4381ms 695.3619 Ops/s 688.0956 Ops/s $\color{#35bf28}+1.06\%$
test_collector_preallocated_write[set_at_loop-cuda-32-32] 5.8100ms 5.6072ms 178.3415 Ops/s 167.4152 Ops/s $\textbf{\color{#35bf28}+6.53\%}$
test_collector_preallocated_write[set_at_loop-cuda-4096-2] 0.5441ms 0.4037ms 2.4771 KOps/s 2.4021 KOps/s $\color{#35bf28}+3.12\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-8] 1.6341ms 1.5379ms 650.2292 Ops/s 641.6959 Ops/s $\color{#35bf28}+1.33\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-32] 6.1770ms 5.9235ms 168.8181 Ops/s 164.0137 Ops/s $\color{#35bf28}+2.93\%$
test_collector_preallocated_write[copy_at-cpu-32-2] 0.2249ms 0.1749ms 5.7166 KOps/s 5.7870 KOps/s $\color{#d91a1a}-1.22\%$
test_collector_preallocated_write[copy_at-cpu-32-8] 0.7669ms 0.6801ms 1.4704 KOps/s 1.4764 KOps/s $\color{#d91a1a}-0.40\%$
test_collector_preallocated_write[copy_at-cpu-32-32] 2.7845ms 2.7108ms 368.8949 Ops/s 371.9779 Ops/s $\color{#d91a1a}-0.83\%$
test_collector_preallocated_write[copy_at-cpu-4096-2] 0.4036ms 0.3306ms 3.0247 KOps/s 3.1544 KOps/s $\color{#d91a1a}-4.11\%$
test_collector_preallocated_write[copy_at-cpu-4096-8] 1.8457ms 1.5782ms 633.6507 Ops/s 676.1264 Ops/s $\textbf{\color{#d91a1a}-6.28\%}$
test_collector_preallocated_write[copy_at-cpu-4096-32] 10.2576ms 9.8470ms 101.5539 Ops/s 102.1990 Ops/s $\color{#d91a1a}-0.63\%$
test_collector_preallocated_write[copy_at-cuda-32-2] 0.3884ms 0.3229ms 3.0971 KOps/s 3.1072 KOps/s $\color{#d91a1a}-0.33\%$
test_collector_preallocated_write[copy_at-cuda-32-8] 1.4201ms 1.1999ms 833.4279 Ops/s 836.4630 Ops/s $\color{#d91a1a}-0.36\%$
test_collector_preallocated_write[copy_at-cuda-32-32] 4.8017ms 4.6806ms 213.6491 Ops/s 213.2014 Ops/s $\color{#35bf28}+0.21\%$
test_collector_preallocated_write[copy_at-cuda-4096-2] 0.4033ms 0.3235ms 3.0914 KOps/s 3.0970 KOps/s $\color{#d91a1a}-0.18\%$
test_collector_preallocated_write[copy_at-cuda-4096-8] 1.3244ms 1.2027ms 831.4769 Ops/s 827.8345 Ops/s $\color{#35bf28}+0.44\%$
test_collector_preallocated_write[copy_at-cuda-4096-32] 4.8589ms 4.7187ms 211.9235 Ops/s 211.6000 Ops/s $\color{#35bf28}+0.15\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-2] 0.1711ms 0.1206ms 8.2924 KOps/s 8.2833 KOps/s $\color{#35bf28}+0.11\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-8] 0.7188ms 0.4708ms 2.1241 KOps/s 2.1226 KOps/s $\color{#35bf28}+0.07\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-32] 1.9431ms 1.8765ms 532.8968 Ops/s 533.7890 Ops/s $\color{#d91a1a}-0.17\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-2] 0.3111ms 0.2524ms 3.9622 KOps/s 3.9816 KOps/s $\color{#d91a1a}-0.49\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-8] 1.6434ms 1.3799ms 724.7064 Ops/s 799.8571 Ops/s $\textbf{\color{#d91a1a}-9.40\%}$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-32] 9.3952ms 8.8906ms 112.4789 Ops/s 113.4260 Ops/s $\color{#d91a1a}-0.83\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-2] 0.3306ms 0.2705ms 3.6967 KOps/s 3.7240 KOps/s $\color{#d91a1a}-0.73\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-8] 1.1562ms 1.0077ms 992.3458 Ops/s 1.0072 KOps/s $\color{#d91a1a}-1.48\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-32] 4.1431ms 3.9422ms 253.6657 Ops/s 259.0538 Ops/s $\color{#d91a1a}-2.08\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-2] 0.3288ms 0.2707ms 3.6947 KOps/s 3.7077 KOps/s $\color{#d91a1a}-0.35\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-8] 1.0825ms 1.0024ms 997.6418 Ops/s 999.7955 Ops/s $\color{#d91a1a}-0.22\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-32] 4.1309ms 3.9590ms 252.5859 Ops/s 255.2440 Ops/s $\color{#d91a1a}-1.04\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-128] 18.2595ms 16.4367ms 60.8394 Ops/s 61.1609 Ops/s $\color{#d91a1a}-0.53\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-256] 33.8165ms 33.1569ms 30.1596 Ops/s 30.4646 Ops/s $\color{#d91a1a}-1.00\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-128] 89.5227ms 88.1909ms 11.3390 Ops/s 11.3678 Ops/s $\color{#d91a1a}-0.25\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-256] 0.2061s 0.2050s 4.8777 Ops/s 4.9075 Ops/s $\color{#d91a1a}-0.61\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-128] 14.0191ms 13.8902ms 71.9931 Ops/s 72.4839 Ops/s $\color{#d91a1a}-0.68\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-256] 27.4038ms 27.1666ms 36.8099 Ops/s 37.1167 Ops/s $\color{#d91a1a}-0.83\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-128] 14.1931ms 13.9937ms 71.4606 Ops/s 71.3816 Ops/s $\color{#35bf28}+0.11\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-256] 27.6078ms 27.4405ms 36.4425 Ops/s 36.3591 Ops/s $\color{#35bf28}+0.23\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-128] 52.3645ms 52.1472ms 19.1765 Ops/s 19.1281 Ops/s $\color{#35bf28}+0.25\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-256] 0.1062s 0.1054s 9.4903 Ops/s 9.5163 Ops/s $\color{#d91a1a}-0.27\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-128] 0.1499s 0.1492s 6.7011 Ops/s 6.6589 Ops/s $\color{#35bf28}+0.63\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-256] 0.3367s 0.3344s 2.9908 Ops/s 3.0377 Ops/s $\color{#d91a1a}-1.54\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-128] 75.3526ms 73.6243ms 13.5825 Ops/s 13.7094 Ops/s $\color{#d91a1a}-0.93\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-256] 0.1500s 0.1477s 6.7684 Ops/s 6.5058 Ops/s $\color{#35bf28}+4.04\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-128] 75.5910ms 74.5399ms 13.4156 Ops/s 12.6520 Ops/s $\textbf{\color{#35bf28}+6.04\%}$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-256] 0.1499s 0.1497s 6.6812 Ops/s 6.7768 Ops/s $\color{#d91a1a}-1.41\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-128] 30.7952ms 30.6127ms 32.6662 Ops/s 32.9793 Ops/s $\color{#d91a1a}-0.95\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-256] 62.7098ms 62.3077ms 16.0494 Ops/s 16.2152 Ops/s $\color{#d91a1a}-1.02\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-128] 0.1254s 0.1243s 8.0457 Ops/s 8.1907 Ops/s $\color{#d91a1a}-1.77\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-256] 0.2763s 0.2746s 3.6421 Ops/s 3.6026 Ops/s $\color{#35bf28}+1.10\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-128] 43.5130ms 43.0054ms 23.2529 Ops/s 23.3390 Ops/s $\color{#d91a1a}-0.37\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-256] 87.5177ms 86.2380ms 11.5958 Ops/s 11.6731 Ops/s $\color{#d91a1a}-0.66\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-128] 43.9811ms 43.4429ms 23.0187 Ops/s 23.1744 Ops/s $\color{#d91a1a}-0.67\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-256] 87.2416ms 86.6806ms 11.5366 Ops/s 11.5804 Ops/s $\color{#d91a1a}-0.38\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-128] 20.4474ms 20.3427ms 49.1577 Ops/s 48.9890 Ops/s $\color{#35bf28}+0.34\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-256] 42.0011ms 41.6738ms 23.9959 Ops/s 23.8979 Ops/s $\color{#35bf28}+0.41\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-128] 0.1140s 0.1123s 8.9032 Ops/s 9.1404 Ops/s $\color{#d91a1a}-2.59\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-256] 0.2520s 0.2498s 4.0039 Ops/s 3.9748 Ops/s $\color{#35bf28}+0.73\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-128] 38.8408ms 37.7457ms 26.4931 Ops/s 28.2864 Ops/s $\textbf{\color{#d91a1a}-6.34\%}$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-256] 77.3986ms 76.0099ms 13.1562 Ops/s 14.1016 Ops/s $\textbf{\color{#d91a1a}-6.70\%}$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-128] 38.6902ms 36.2141ms 27.6135 Ops/s 28.2965 Ops/s $\color{#d91a1a}-2.41\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-256] 77.0708ms 74.9040ms 13.3504 Ops/s 14.0676 Ops/s $\textbf{\color{#d91a1a}-5.10\%}$
test_plain_set_nested 79.2720μs 15.5878μs 64.1528 KOps/s 64.6816 KOps/s $\color{#d91a1a}-0.82\%$
test_plain_set_stack_nested 30.6010μs 15.3773μs 65.0310 KOps/s 65.3961 KOps/s $\color{#d91a1a}-0.56\%$
test_plain_set_nested_inplace 51.3210μs 17.1515μs 58.3041 KOps/s 59.6748 KOps/s $\color{#d91a1a}-2.30\%$
test_plain_set_stack_nested_inplace 48.8510μs 16.7105μs 59.8426 KOps/s 60.7860 KOps/s $\color{#d91a1a}-1.55\%$
test_items 32.9210μs 6.0749μs 164.6118 KOps/s 166.9159 KOps/s $\color{#d91a1a}-1.38\%$
test_items_nested 0.6527ms 0.4695ms 2.1298 KOps/s 2.1767 KOps/s $\color{#d91a1a}-2.16\%$
test_items_nested_locked 0.5318ms 0.4722ms 2.1177 KOps/s 2.1519 KOps/s $\color{#d91a1a}-1.59\%$
test_items_nested_leaf 0.1373ms 96.2595μs 10.3886 KOps/s 10.4169 KOps/s $\color{#d91a1a}-0.27\%$
test_items_stack_nested 0.5227ms 0.4724ms 2.1168 KOps/s 2.1676 KOps/s $\color{#d91a1a}-2.34\%$
test_items_stack_nested_leaf 0.1297ms 97.8788μs 10.2167 KOps/s 10.3495 KOps/s $\color{#d91a1a}-1.28\%$
test_items_stack_nested_locked 0.5415ms 0.4709ms 2.1235 KOps/s 2.1637 KOps/s $\color{#d91a1a}-1.86\%$
test_keys 32.3410μs 4.2395μs 235.8775 KOps/s 236.2153 KOps/s $\color{#d91a1a}-0.14\%$
test_keys_nested 0.2005ms 0.1301ms 7.6860 KOps/s 7.6409 KOps/s $\color{#35bf28}+0.59\%$
test_keys_nested_locked 0.7441ms 0.1403ms 7.1280 KOps/s 7.2058 KOps/s $\color{#d91a1a}-1.08\%$
test_keys_nested_leaf 0.1707ms 0.1221ms 8.1922 KOps/s 8.2878 KOps/s $\color{#d91a1a}-1.15\%$
test_keys_stack_nested 0.1994ms 0.1313ms 7.6173 KOps/s 7.6416 KOps/s $\color{#d91a1a}-0.32\%$
test_keys_stack_nested_leaf 0.1795ms 0.1209ms 8.2733 KOps/s 8.3130 KOps/s $\color{#d91a1a}-0.48\%$
test_keys_stack_nested_locked 0.1925ms 0.1403ms 7.1271 KOps/s 7.2241 KOps/s $\color{#d91a1a}-1.34\%$
test_values 6.5242μs 1.0060μs 994.0292 KOps/s 976.6347 KOps/s $\color{#35bf28}+1.78\%$
test_values_nested 76.2310μs 53.9453μs 18.5373 KOps/s 19.0749 KOps/s $\color{#d91a1a}-2.82\%$
test_values_nested_locked 0.1303ms 57.2450μs 17.4688 KOps/s 17.9153 KOps/s $\color{#d91a1a}-2.49\%$
test_values_nested_leaf 95.8730μs 61.5433μs 16.2487 KOps/s 16.6820 KOps/s $\color{#d91a1a}-2.60\%$
test_values_stack_nested 93.3720μs 53.5457μs 18.6756 KOps/s 19.1651 KOps/s $\color{#d91a1a}-2.55\%$
test_values_stack_nested_leaf 85.8420μs 61.0668μs 16.3755 KOps/s 16.6425 KOps/s $\color{#d91a1a}-1.60\%$
test_values_stack_nested_locked 0.1502ms 57.4215μs 17.4151 KOps/s 18.0632 KOps/s $\color{#d91a1a}-3.59\%$
test_membership 5.1518μs 0.8552μs 1.1693 MOps/s 1.2005 MOps/s $\color{#d91a1a}-2.59\%$
test_membership_nested 35.5610μs 2.9860μs 334.8956 KOps/s 337.8665 KOps/s $\color{#d91a1a}-0.88\%$
test_membership_nested_leaf 30.3710μs 2.9990μs 333.4406 KOps/s 336.8154 KOps/s $\color{#d91a1a}-1.00\%$
test_membership_stacked_nested 30.7010μs 2.9018μs 344.6178 KOps/s 348.2526 KOps/s $\color{#d91a1a}-1.04\%$
test_membership_stacked_nested_leaf 30.7210μs 2.8762μs 347.6858 KOps/s 347.8159 KOps/s $\color{#d91a1a}-0.04\%$
test_membership_nested_last 37.7310μs 4.4645μs 223.9881 KOps/s 224.4620 KOps/s $\color{#d91a1a}-0.21\%$
test_membership_nested_leaf_last 37.5310μs 4.4952μs 222.4594 KOps/s 223.6306 KOps/s $\color{#d91a1a}-0.52\%$
test_membership_stacked_nested_last 46.0810μs 4.3636μs 229.1662 KOps/s 228.2199 KOps/s $\color{#35bf28}+0.41\%$
test_membership_stacked_nested_leaf_last 40.2910μs 4.3517μs 229.7954 KOps/s 228.9653 KOps/s $\color{#35bf28}+0.36\%$
test_nested_getleaf 52.9010μs 21.9928μs 45.4694 KOps/s 45.7837 KOps/s $\color{#d91a1a}-0.69\%$
test_nested_get 51.7320μs 20.6460μs 48.4355 KOps/s 48.3038 KOps/s $\color{#35bf28}+0.27\%$
test_stacked_getleaf 80.1420μs 22.0651μs 45.3205 KOps/s 46.1300 KOps/s $\color{#d91a1a}-1.75\%$
test_stacked_get 49.2310μs 20.6954μs 48.3199 KOps/s 49.9243 KOps/s $\color{#d91a1a}-3.21\%$
test_nested_getitemleaf 50.2510μs 22.4211μs 44.6009 KOps/s 44.7647 KOps/s $\color{#d91a1a}-0.37\%$
test_nested_getitem 53.5610μs 21.3544μs 46.8287 KOps/s 47.3700 KOps/s $\color{#d91a1a}-1.14\%$
test_stacked_getitemleaf 52.7010μs 22.3293μs 44.7841 KOps/s 45.1333 KOps/s $\color{#d91a1a}-0.77\%$
test_stacked_getitem 57.9120μs 21.0413μs 47.5255 KOps/s 47.2486 KOps/s $\color{#35bf28}+0.59\%$
test_lock_nested 0.5838ms 0.5003ms 1.9987 KOps/s 1.9956 KOps/s $\color{#35bf28}+0.15\%$
test_lock_stack_nested 0.5443ms 0.5068ms 1.9731 KOps/s 1.9850 KOps/s $\color{#d91a1a}-0.60\%$
test_unlock_nested 0.4687ms 0.3981ms 2.5120 KOps/s 2.5297 KOps/s $\color{#d91a1a}-0.70\%$
test_unlock_stack_nested 0.4652ms 0.4000ms 2.4999 KOps/s 2.5040 KOps/s $\color{#d91a1a}-0.16\%$
test_flatten_speed 0.1687ms 0.1214ms 8.2380 KOps/s 8.1423 KOps/s $\color{#35bf28}+1.18\%$
test_unflatten_speed 0.6541ms 0.5769ms 1.7334 KOps/s 1.7325 KOps/s $\color{#35bf28}+0.05\%$
test_common_ops 0.1040s 1.8924ms 528.4403 Ops/s 243.3726 Ops/s $\textbf{\color{#35bf28}+117.13\%}$
test_creation 0.1033ms 3.1707μs 315.3862 KOps/s 318.7641 KOps/s $\color{#d91a1a}-1.06\%$
test_creation_empty 26.9710μs 7.0079μs 142.6961 KOps/s 142.9990 KOps/s $\color{#d91a1a}-0.21\%$
test_creation_nested_1 43.6010μs 11.6496μs 85.8397 KOps/s 87.1022 KOps/s $\color{#d91a1a}-1.45\%$
test_creation_nested_2 42.9810μs 13.6852μs 73.0715 KOps/s 74.0157 KOps/s $\color{#d91a1a}-1.28\%$
test_creation_many_keys[10] 47.3310μs 21.0649μs 47.4724 KOps/s 47.7819 KOps/s $\color{#d91a1a}-0.65\%$
test_creation_many_keys[50] 0.1251ms 89.1803μs 11.2132 KOps/s 11.0549 KOps/s $\color{#35bf28}+1.43\%$
test_creation_many_keys[100] 0.2340ms 0.1738ms 5.7532 KOps/s 5.6589 KOps/s $\color{#35bf28}+1.67\%$
test_creation_nested_many_keys[10] 83.5320μs 45.5496μs 21.9541 KOps/s 21.9564 KOps/s $\color{#d91a1a}-0.01\%$
test_creation_nested_many_keys[50] 0.2359ms 0.1820ms 5.4934 KOps/s 5.3870 KOps/s $\color{#35bf28}+1.97\%$
test_clone 33.0910μs 13.6247μs 73.3963 KOps/s 74.5579 KOps/s $\color{#d91a1a}-1.56\%$
test_getitem[int] 1.5227ms 15.2569μs 65.5442 KOps/s 66.3399 KOps/s $\color{#d91a1a}-1.20\%$
test_getitem[slice_int] 0.1437ms 24.7040μs 40.4792 KOps/s 41.3984 KOps/s $\color{#d91a1a}-2.22\%$
test_getitem[range] 0.1936ms 68.9100μs 14.5117 KOps/s 15.5440 KOps/s $\textbf{\color{#d91a1a}-6.64\%}$
test_getitem[tuple] 0.1486ms 24.6581μs 40.5547 KOps/s 41.2228 KOps/s $\color{#d91a1a}-1.62\%$
test_getitem[list] 0.1824ms 61.1472μs 16.3540 KOps/s 16.6932 KOps/s $\color{#d91a1a}-2.03\%$
test_setitem_dim[int] 40.2800μs 27.0963μs 36.9054 KOps/s 39.0909 KOps/s $\textbf{\color{#d91a1a}-5.59\%}$
test_setitem_dim[slice_int] 82.7620μs 44.9472μs 22.2483 KOps/s 23.2060 KOps/s $\color{#d91a1a}-4.13\%$
test_setitem_dim[range] 0.1463ms 0.1001ms 9.9903 KOps/s 10.4048 KOps/s $\color{#d91a1a}-3.98\%$
test_setitem_dim[tuple] 74.9620μs 39.1928μs 25.5149 KOps/s 25.0103 KOps/s $\color{#35bf28}+2.02\%$
test_setitem 52.2510μs 17.8600μs 55.9911 KOps/s 56.2241 KOps/s $\color{#d91a1a}-0.41\%$
test_set 48.0410μs 16.9837μs 58.8801 KOps/s 58.8247 KOps/s $\color{#35bf28}+0.09\%$
test_set_shared 0.5616ms 0.2119ms 4.7197 KOps/s 4.7208 KOps/s $\color{#d91a1a}-0.02\%$
test_update 0.2147ms 22.0497μs 45.3520 KOps/s 45.2025 KOps/s $\color{#35bf28}+0.33\%$
test_update_nested 67.8020μs 33.8714μs 29.5234 KOps/s 29.4077 KOps/s $\color{#35bf28}+0.39\%$
test_update__nested 0.5350ms 33.3713μs 29.9658 KOps/s 30.1632 KOps/s $\color{#d91a1a}-0.65\%$
test_set_nested 6.8663ms 19.4185μs 51.4973 KOps/s 52.1849 KOps/s $\color{#d91a1a}-1.32\%$
test_set_nested_new 50.0710μs 23.6876μs 42.2163 KOps/s 42.1350 KOps/s $\color{#35bf28}+0.19\%$
test_select 72.4420μs 40.7042μs 24.5675 KOps/s 24.4554 KOps/s $\color{#35bf28}+0.46\%$
test_select_nested 0.1367ms 73.4599μs 13.6129 KOps/s 13.4149 KOps/s $\color{#35bf28}+1.48\%$
test_exclude_nested 0.1236ms 91.3069μs 10.9521 KOps/s 10.9003 KOps/s $\color{#35bf28}+0.48\%$
test_empty[True] 0.5213ms 0.4017ms 2.4892 KOps/s 2.4793 KOps/s $\color{#35bf28}+0.40\%$
test_empty[False] 7.0678μs 1.3971μs 715.7439 KOps/s 723.6402 KOps/s $\color{#d91a1a}-1.09\%$
test_to 0.1135ms 69.3234μs 14.4251 KOps/s 13.8073 KOps/s $\color{#35bf28}+4.47\%$
test_to_nonblocking 0.1063ms 68.3783μs 14.6245 KOps/s 14.5646 KOps/s $\color{#35bf28}+0.41\%$
test_unbind_speed 0.3820ms 0.3428ms 2.9174 KOps/s 2.9429 KOps/s $\color{#d91a1a}-0.87\%$
test_unbind_speed_stack0 0.4401ms 0.3355ms 2.9808 KOps/s 3.0098 KOps/s $\color{#d91a1a}-0.96\%$
test_unbind_speed_stack1 0.1161s 0.8615ms 1.1607 KOps/s 1.1652 KOps/s $\color{#d91a1a}-0.39\%$
test_split 1.2047ms 1.1543ms 866.3296 Ops/s 870.2814 Ops/s $\color{#d91a1a}-0.45\%$
test_chunk 0.1154s 1.2307ms 812.5684 Ops/s 658.4911 Ops/s $\textbf{\color{#35bf28}+23.40\%}$
test_to_cpu_blocking 19.4238ms 19.1397ms 52.2474 Ops/s 52.2460 Ops/s $+0.00\%$
test_to_cpu_global_sync 13.1380ms 11.8264ms 84.5565 Ops/s 85.3797 Ops/s $\color{#d91a1a}-0.96\%$
test_to_cpu_event_sync 12.9848ms 12.5965ms 79.3873 Ops/s 80.0183 Ops/s $\color{#d91a1a}-0.79\%$
test_to_cpu_default 12.9305ms 12.6071ms 79.3202 Ops/s 71.3527 Ops/s $\textbf{\color{#35bf28}+11.17\%}$
test_consolidate[False-None] 0.1439s 4.7938ms 208.6044 Ops/s 239.1357 Ops/s $\textbf{\color{#d91a1a}-12.77\%}$
test_consolidate[default-None] 3.5156ms 2.1600ms 462.9647 Ops/s 456.5913 Ops/s $\color{#35bf28}+1.40\%$
test_consolidate[reduce-overhead-None] 3.4192ms 2.0621ms 484.9353 Ops/s 468.0637 Ops/s $\color{#35bf28}+3.60\%$
test_consolidate_njt[False-None] 8.8342ms 8.5913ms 116.3964 Ops/s 115.4164 Ops/s $\color{#35bf28}+0.85\%$
test_to[False-False-None] 2.3233ms 2.1800ms 458.7221 Ops/s 458.5403 Ops/s $\color{#35bf28}+0.04\%$
test_to[True-False-None] 0.1781s 2.2487ms 444.6937 Ops/s 514.7280 Ops/s $\textbf{\color{#d91a1a}-13.61\%}$
test_to[within-False-None] 6.5320ms 6.1900ms 161.5522 Ops/s 160.7493 Ops/s $\color{#35bf28}+0.50\%$
test_to[True-default-None] 10.9849ms 10.7609ms 92.9293 Ops/s 93.7607 Ops/s $\color{#d91a1a}-0.89\%$
test_to_njt[False-False-None] 8.7391ms 8.5970ms 116.3198 Ops/s 115.0284 Ops/s $\color{#35bf28}+1.12\%$
test_to_njt[True-False-None] 7.1366ms 6.9380ms 144.1330 Ops/s 143.8579 Ops/s $\color{#35bf28}+0.19\%$
test_to_njt[within-False-None] 15.7944ms 15.4734ms 64.6271 Ops/s 63.4309 Ops/s $\color{#35bf28}+1.89\%$
test_creation[device0] 0.3967ms 0.1168ms 8.5618 KOps/s 8.5749 KOps/s $\color{#d91a1a}-0.15\%$
test_creation_from_tensor 0.4418ms 0.1147ms 8.7175 KOps/s 8.8031 KOps/s $\color{#d91a1a}-0.97\%$
test_add_one[memmap_tensor0] 0.2052ms 6.8511μs 145.9611 KOps/s 147.3176 KOps/s $\color{#d91a1a}-0.92\%$
test_contiguous[memmap_tensor0] 23.9310μs 0.6711μs 1.4902 MOps/s 2.0426 MOps/s $\textbf{\color{#d91a1a}-27.04\%}$
test_stack[memmap_tensor0] 28.3100μs 4.1732μs 239.6253 KOps/s 240.4501 KOps/s $\color{#d91a1a}-0.34\%$
test_memmaptd_index 1.2349ms 0.2750ms 3.6362 KOps/s 3.6125 KOps/s $\color{#35bf28}+0.65\%$
test_memmaptd_index_astensor 0.5504ms 0.3831ms 2.6102 KOps/s 2.6398 KOps/s $\color{#d91a1a}-1.12\%$
test_memmaptd_index_op 0.8492ms 0.6411ms 1.5598 KOps/s 1.5519 KOps/s $\color{#35bf28}+0.51\%$
test_serialize_model 0.3204s 0.1612s 6.2028 Ops/s 7.3746 Ops/s $\textbf{\color{#d91a1a}-15.89\%}$
test_serialize_model_pickle 1.3673s 1.2131s 0.8244 Ops/s 0.8220 Ops/s $\color{#35bf28}+0.29\%$
test_serialize_weights 0.1377s 0.1339s 7.4666 Ops/s 7.4219 Ops/s $\color{#35bf28}+0.60\%$
test_serialize_weights_returnearly 0.4751s 88.2095ms 11.3367 Ops/s 15.0983 Ops/s $\textbf{\color{#d91a1a}-24.91\%}$
test_serialize_weights_pickle 1.3698s 1.2128s 0.8245 Ops/s 0.8237 Ops/s $\color{#35bf28}+0.11\%$
test_reshape_pytree 0.2014ms 32.6719μs 30.6074 KOps/s 30.1431 KOps/s $\color{#35bf28}+1.54\%$
test_reshape_td 78.3620μs 45.5526μs 21.9527 KOps/s 22.0836 KOps/s $\color{#d91a1a}-0.59\%$
test_view_pytree 0.2239ms 32.1672μs 31.0876 KOps/s 30.6697 KOps/s $\color{#35bf28}+1.36\%$
test_view_td 0.1236ms 54.0421μs 18.5041 KOps/s 18.5379 KOps/s $\color{#d91a1a}-0.18\%$
test_unbind_pytree 0.2902ms 37.5935μs 26.6003 KOps/s 26.6430 KOps/s $\color{#d91a1a}-0.16\%$
test_unbind_td 0.1741ms 50.1148μs 19.9542 KOps/s 19.7584 KOps/s $\color{#35bf28}+0.99\%$
test_split_pytree 0.1904ms 43.1199μs 23.1911 KOps/s 23.3330 KOps/s $\color{#d91a1a}-0.61\%$
test_split_td 0.1382ms 64.6610μs 15.4653 KOps/s 15.5382 KOps/s $\color{#d91a1a}-0.47\%$
test_add_pytree 0.2315ms 41.9722μs 23.8253 KOps/s 23.0627 KOps/s $\color{#35bf28}+3.31\%$
test_add_td 0.1109ms 56.4355μs 17.7193 KOps/s 18.2762 KOps/s $\color{#d91a1a}-3.05\%$
test_compile_add_one_nested[tensordict-compile] 0.4278ms 0.2289ms 4.3678 KOps/s 4.2632 KOps/s $\color{#35bf28}+2.45\%$
test_compile_add_one_nested[tensordict-eager] 0.3131ms 0.2027ms 4.9330 KOps/s 4.9191 KOps/s $\color{#35bf28}+0.28\%$
test_compile_add_one_nested[pytree-compile] 0.3389ms 0.1363ms 7.3386 KOps/s 7.5124 KOps/s $\color{#d91a1a}-2.31\%$
test_compile_add_one_nested[pytree-eager] 0.4237ms 0.1738ms 5.7535 KOps/s 5.7218 KOps/s $\color{#35bf28}+0.55\%$
test_compile_copy_nested[tensordict-compile] 0.2051ms 17.1570μs 58.2853 KOps/s 63.0686 KOps/s $\textbf{\color{#d91a1a}-7.58\%}$
test_compile_copy_nested[tensordict-eager] 0.1077ms 53.6980μs 18.6227 KOps/s 18.4815 KOps/s $\color{#35bf28}+0.76\%$
test_compile_copy_nested[pytree-compile] 0.1495ms 16.7121μs 59.8368 KOps/s 62.4093 KOps/s $\color{#d91a1a}-4.12\%$
test_compile_copy_nested[pytree-eager] 0.3585ms 67.1663μs 14.8884 KOps/s 14.4639 KOps/s $\color{#35bf28}+2.94\%$
test_compile_add_one_flat[tensordict-compile] 0.3185ms 0.2637ms 3.7919 KOps/s 3.7870 KOps/s $\color{#35bf28}+0.13\%$
test_compile_add_one_flat[tensordict-eager] 0.3806ms 0.2827ms 3.5368 KOps/s 3.5542 KOps/s $\color{#d91a1a}-0.49\%$
test_compile_add_one_flat[tensorclass-compile] 0.3139ms 0.1941ms 5.1518 KOps/s 4.9803 KOps/s $\color{#35bf28}+3.44\%$
test_compile_add_one_flat[tensorclass-eager] 0.1175ms 75.6516μs 13.2185 KOps/s 12.8953 KOps/s $\color{#35bf28}+2.51\%$
test_compile_add_one_flat[pytree-compile] 0.5067ms 0.2007ms 4.9836 KOps/s 5.0083 KOps/s $\color{#d91a1a}-0.49\%$
test_compile_add_one_flat[pytree-eager] 0.7848ms 0.5045ms 1.9822 KOps/s 1.9841 KOps/s $\color{#d91a1a}-0.10\%$
test_compile_add_self_flat[tensordict-eager] 0.4145ms 0.3302ms 3.0280 KOps/s 3.0131 KOps/s $\color{#35bf28}+0.49\%$
test_compile_add_self_flat[tensordict-compile] 0.3132ms 0.2621ms 3.8154 KOps/s 3.6361 KOps/s $\color{#35bf28}+4.93\%$
test_compile_add_self_flat[tensorclass-eager] 0.1381ms 91.5712μs 10.9205 KOps/s 10.6595 KOps/s $\color{#35bf28}+2.45\%$
test_compile_add_self_flat[tensorclass-compile] 0.3411ms 0.1956ms 5.1120 KOps/s 5.0142 KOps/s $\color{#35bf28}+1.95\%$
test_compile_add_self_flat[pytree-eager] 0.6412ms 0.4188ms 2.3876 KOps/s 2.4034 KOps/s $\color{#d91a1a}-0.66\%$
test_compile_add_self_flat[pytree-compile] 0.2919ms 0.1967ms 5.0846 KOps/s 5.0531 KOps/s $\color{#35bf28}+0.62\%$
test_compile_copy_flat[tensordict-compile] 60.2510μs 19.4803μs 51.3338 KOps/s 49.0648 KOps/s $\color{#35bf28}+4.62\%$
test_compile_copy_flat[tensordict-eager] 74.4910μs 42.2177μs 23.6868 KOps/s 24.3890 KOps/s $\color{#d91a1a}-2.88\%$
test_compile_copy_flat[pytree-compile] 0.2064ms 22.5576μs 44.3309 KOps/s 44.5666 KOps/s $\color{#d91a1a}-0.53\%$
test_compile_copy_flat[pytree-eager] 0.3295ms 52.2233μs 19.1485 KOps/s 19.0604 KOps/s $\color{#35bf28}+0.46\%$
test_compile_assign_and_add[tensordict-compile] 2.2265ms 0.2409ms 4.1509 KOps/s 3.8685 KOps/s $\textbf{\color{#35bf28}+7.30\%}$
test_compile_assign_and_add[tensordict-eager] 3.4711ms 3.2575ms 306.9858 Ops/s 310.7987 Ops/s $\color{#d91a1a}-1.23\%$
test_compile_assign_and_add[pytree-compile] 2.1364ms 0.1827ms 5.4741 KOps/s 5.4263 KOps/s $\color{#35bf28}+0.88\%$
test_compile_assign_and_add[pytree-eager] 2.8804ms 2.6810ms 372.9952 Ops/s 370.4841 Ops/s $\color{#35bf28}+0.68\%$
test_compile_indexing[tensor-tensordict-compile] 0.2454ms 0.1365ms 7.3264 KOps/s 7.3166 KOps/s $\color{#35bf28}+0.13\%$
test_compile_indexing[tensor-tensordict-eager] 0.3077ms 78.0188μs 12.8174 KOps/s 13.5454 KOps/s $\textbf{\color{#d91a1a}-5.37\%}$
test_compile_indexing[tensor-tensorclass-compile] 0.2531ms 0.1213ms 8.2413 KOps/s 8.4221 KOps/s $\color{#d91a1a}-2.15\%$
test_compile_indexing[tensor-tensorclass-eager] 0.2502ms 44.3403μs 22.5528 KOps/s 21.2429 KOps/s $\textbf{\color{#35bf28}+6.17\%}$
test_compile_indexing[tensor-pytree-compile] 0.1980ms 0.1213ms 8.2432 KOps/s 8.3224 KOps/s $\color{#d91a1a}-0.95\%$
test_compile_indexing[tensor-pytree-eager] 0.2626ms 46.2699μs 21.6123 KOps/s 21.6099 KOps/s $\color{#35bf28}+0.01\%$
test_compile_indexing[slice-tensordict-compile] 0.2358ms 85.4118μs 11.7080 KOps/s 11.5971 KOps/s $\color{#35bf28}+0.96\%$
test_compile_indexing[slice-tensordict-eager] 0.2023ms 31.5912μs 31.6544 KOps/s 36.1993 KOps/s $\textbf{\color{#d91a1a}-12.56\%}$
test_compile_indexing[slice-tensorclass-compile] 0.1693ms 71.5157μs 13.9829 KOps/s 14.2144 KOps/s $\color{#d91a1a}-1.63\%$
test_compile_indexing[slice-tensorclass-eager] 0.2362ms 21.8086μs 45.8534 KOps/s 44.5472 KOps/s $\color{#35bf28}+2.93\%$
test_compile_indexing[slice-pytree-compile] 0.1144ms 73.8554μs 13.5400 KOps/s 14.0603 KOps/s $\color{#d91a1a}-3.70\%$
test_compile_indexing[slice-pytree-eager] 0.2955ms 22.1817μs 45.0822 KOps/s 45.1674 KOps/s $\color{#d91a1a}-0.19\%$
test_compile_indexing[int-tensordict-compile] 0.1336ms 85.6349μs 11.6775 KOps/s 11.4149 KOps/s $\color{#35bf28}+2.30\%$
test_compile_indexing[int-tensordict-eager] 0.2393ms 27.5268μs 36.3283 KOps/s 36.5226 KOps/s $\color{#d91a1a}-0.53\%$
test_compile_indexing[int-tensorclass-compile] 0.1188ms 71.6672μs 13.9534 KOps/s 14.1579 KOps/s $\color{#d91a1a}-1.44\%$
test_compile_indexing[int-tensorclass-eager] 0.2411ms 22.2572μs 44.9292 KOps/s 44.8048 KOps/s $\color{#35bf28}+0.28\%$
test_compile_indexing[int-pytree-compile] 0.1260ms 71.4394μs 13.9979 KOps/s 14.1942 KOps/s $\color{#d91a1a}-1.38\%$
test_compile_indexing[int-pytree-eager] 0.2797ms 22.0949μs 45.2593 KOps/s 44.8825 KOps/s $\color{#35bf28}+0.84\%$
test_compile_replace[single-eager] 0.1190ms 49.6614μs 20.1364 KOps/s 21.3159 KOps/s $\textbf{\color{#d91a1a}-5.53\%}$
test_compile_replace[single-compile] 0.3087ms 0.1379ms 7.2512 KOps/s 7.5542 KOps/s $\color{#d91a1a}-4.01\%$
test_compile_replace[multi-eager] 0.6399ms 0.5836ms 1.7135 KOps/s 1.8021 KOps/s $\color{#d91a1a}-4.92\%$
test_compile_replace[multi-compile] 0.2746ms 0.1458ms 6.8603 KOps/s 6.8630 KOps/s $\color{#d91a1a}-0.04\%$
test_compile_tc_getattr_20[eager] 0.2297ms 0.1606ms 6.2264 KOps/s 6.3362 KOps/s $\color{#d91a1a}-1.73\%$
test_compile_tc_getattr_20[compile] 0.4006ms 0.1522ms 6.5683 KOps/s 6.5689 KOps/s $-0.01\%$
test_compile_clone_shallow[20-eager] 48.0810μs 19.7028μs 50.7543 KOps/s 52.8777 KOps/s $\color{#d91a1a}-4.02\%$
test_compile_clone_shallow[20-compile] 79.4220μs 17.4965μs 57.1543 KOps/s 58.5677 KOps/s $\color{#d91a1a}-2.41\%$
test_compile_clone_shallow[40-eager] 69.6610μs 34.8016μs 28.7343 KOps/s 29.4401 KOps/s $\color{#d91a1a}-2.40\%$
test_compile_clone_shallow[40-compile] 77.7420μs 19.0230μs 52.5679 KOps/s 53.9353 KOps/s $\color{#d91a1a}-2.54\%$
test_compile_clone_shallow[80-eager] 0.1029ms 63.0312μs 15.8652 KOps/s 16.1425 KOps/s $\color{#d91a1a}-1.72\%$
test_compile_clone_shallow[80-compile] 80.5610μs 23.2636μs 42.9857 KOps/s 43.7976 KOps/s $\color{#d91a1a}-1.85\%$
test_compile_update_inplace[eager] 0.2169ms 62.0512μs 16.1157 KOps/s 16.4581 KOps/s $\color{#d91a1a}-2.08\%$
test_compile_update_inplace[compile] 0.4290ms 0.1511ms 6.6171 KOps/s 6.7329 KOps/s $\color{#d91a1a}-1.72\%$
test_mod_add[eager] 0.3088ms 0.2289ms 4.3678 KOps/s 4.4205 KOps/s $\color{#d91a1a}-1.19\%$
test_mod_add[compile] 0.3337ms 0.1362ms 7.3447 KOps/s 7.5156 KOps/s $\color{#d91a1a}-2.27\%$
test_mod_add[compile-overhead] 0.2756ms 0.1809ms 5.5281 KOps/s 5.6089 KOps/s $\color{#d91a1a}-1.44\%$
test_mod_wrap[eager] 0.6897ms 0.4699ms 2.1280 KOps/s 2.1469 KOps/s $\color{#d91a1a}-0.88\%$
test_mod_wrap[compile] 0.4761ms 0.3958ms 2.5267 KOps/s 2.5207 KOps/s $\color{#35bf28}+0.24\%$
test_mod_wrap[compile-overhead] 9.6307ms 5.1054ms 195.8715 Ops/s 215.6722 Ops/s $\textbf{\color{#d91a1a}-9.18\%}$
test_mod_wrap_and_backward[eager] 1.9460ms 1.8157ms 550.7533 Ops/s 597.4596 Ops/s $\textbf{\color{#d91a1a}-7.82\%}$
test_mod_wrap_and_backward[compile] 2.4410ms 1.5961ms 626.5179 Ops/s 655.1600 Ops/s $\color{#d91a1a}-4.37\%$
test_mod_wrap_and_backward[compile-overhead] 1.3723ms 0.9468ms 1.0562 KOps/s 1.0380 KOps/s $\color{#35bf28}+1.75\%$
test_seq_add[eager] 0.6359ms 0.5090ms 1.9646 KOps/s 1.9575 KOps/s $\color{#35bf28}+0.36\%$
test_seq_add[compile] 0.2688ms 0.1453ms 6.8827 KOps/s 6.9373 KOps/s $\color{#d91a1a}-0.79\%$
test_seq_add[compile-overhead] 0.3120ms 0.1943ms 5.1470 KOps/s 5.3044 KOps/s $\color{#d91a1a}-2.97\%$
test_seq_wrap[eager] 1.5175ms 1.4232ms 702.6655 Ops/s 707.9171 Ops/s $\color{#d91a1a}-0.74\%$
test_seq_wrap[compile] 0.5163ms 0.4236ms 2.3606 KOps/s 2.3966 KOps/s $\color{#d91a1a}-1.50\%$
test_seq_wrap[compile-overhead] 0.3816ms 0.3079ms 3.2474 KOps/s 3.2147 KOps/s $\color{#35bf28}+1.02\%$
test_func_call_runtime[False-eager] 0.8921ms 0.7927ms 1.2615 KOps/s 1.2780 KOps/s $\color{#d91a1a}-1.29\%$
test_func_call_runtime[False-compile] 1.1177ms 0.9847ms 1.0156 KOps/s 1.0248 KOps/s $\color{#d91a1a}-0.90\%$
test_func_call_runtime[False-compile-overhead] 0.6279ms 0.5169ms 1.9347 KOps/s 1.9388 KOps/s $\color{#d91a1a}-0.21\%$
test_func_call_runtime[True-eager] 1.1316ms 1.0386ms 962.8504 Ops/s 981.8843 Ops/s $\color{#d91a1a}-1.94\%$
test_func_call_runtime[True-compile] 1.1418ms 1.0020ms 997.9888 Ops/s 1.0108 KOps/s $\color{#d91a1a}-1.27\%$
test_func_call_runtime[True-compile-overhead] 0.7367ms 0.5363ms 1.8648 KOps/s 1.8745 KOps/s $\color{#d91a1a}-0.52\%$
test_func_call_cm_runtime[False-eager] 1.0507ms 0.8447ms 1.1839 KOps/s 1.2784 KOps/s $\textbf{\color{#d91a1a}-7.39\%}$
test_func_call_cm_runtime[False-compile] 1.0635ms 0.9860ms 1.0142 KOps/s 1.0381 KOps/s $\color{#d91a1a}-2.31\%$
test_func_call_cm_runtime[False-compile-overhead] 0.6407ms 0.4951ms 2.0198 KOps/s 2.0129 KOps/s $\color{#35bf28}+0.34\%$
test_func_call_cm_runtime[True-eager] 1.4458ms 1.1859ms 843.2242 Ops/s 852.8765 Ops/s $\color{#d91a1a}-1.13\%$
test_func_call_cm_runtime[True-compile] 1.1583ms 1.0153ms 984.9780 Ops/s 981.5922 Ops/s $\color{#35bf28}+0.34\%$
test_func_call_cm_runtime[True-compile-overhead] 0.7052ms 0.5530ms 1.8084 KOps/s 1.8021 KOps/s $\color{#35bf28}+0.34\%$
test_vmap_func_call_cm_runtime[eager] 2.8084ms 2.3606ms 423.6289 Ops/s 424.5988 Ops/s $\color{#d91a1a}-0.23\%$
test_vmap_func_call_cm_runtime[compile] 1.1006ms 1.0237ms 976.8788 Ops/s 980.2977 Ops/s $\color{#d91a1a}-0.35\%$
test_vmap_func_call_cm_runtime[compile-overhead] 0.5995ms 0.5394ms 1.8540 KOps/s 1.8401 KOps/s $\color{#35bf28}+0.76\%$
test_distributed 0.5592ms 0.1481ms 6.7514 KOps/s 6.6128 KOps/s $\color{#35bf28}+2.10\%$
test_tdmodule 0.7506ms 0.1945ms 5.1418 KOps/s 5.0155 KOps/s $\color{#35bf28}+2.52\%$
test_tdmodule_dispatch 0.4538ms 0.3739ms 2.6743 KOps/s 2.6468 KOps/s $\color{#35bf28}+1.04\%$
test_tdseq 44.9910μs 26.6640μs 37.5038 KOps/s 37.2418 KOps/s $\color{#35bf28}+0.70\%$
test_tdseq_dispatch 0.2538ms 0.2167ms 4.6157 KOps/s 4.6202 KOps/s $\color{#d91a1a}-0.10\%$
test_instantiation_functorch 2.1773ms 2.0761ms 481.6836 Ops/s 486.7160 Ops/s $\color{#d91a1a}-1.03\%$
test_exec_functorch 0.2466ms 0.1808ms 5.5309 KOps/s 5.5628 KOps/s $\color{#d91a1a}-0.57\%$
test_exec_functional_call 0.2225ms 0.1622ms 6.1634 KOps/s 6.3277 KOps/s $\color{#d91a1a}-2.60\%$
test_exec_td_decorator 0.4542ms 0.2386ms 4.1907 KOps/s 4.2569 KOps/s $\color{#d91a1a}-1.56\%$
test_vmap_mlp_speed_decorator[True-True] 1.2284ms 1.0244ms 976.2277 Ops/s 985.8799 Ops/s $\color{#d91a1a}-0.98\%$
test_vmap_mlp_speed_decorator[True-False] 1.1786ms 1.0135ms 986.6833 Ops/s 984.3184 Ops/s $\color{#35bf28}+0.24\%$
test_vmap_mlp_speed_decorator[False-True] 0.9160ms 0.7308ms 1.3683 KOps/s 1.3948 KOps/s $\color{#d91a1a}-1.90\%$
test_vmap_mlp_speed_decorator[False-False] 0.9172ms 0.7213ms 1.3864 KOps/s 1.3956 KOps/s $\color{#d91a1a}-0.66\%$
test_vmap_transformer_speed_decorator[True-True] 22.0289ms 20.8929ms 47.8631 Ops/s 48.1640 Ops/s $\color{#d91a1a}-0.62\%$
test_vmap_transformer_speed_decorator[True-False] 21.5125ms 20.8253ms 48.0185 Ops/s 48.2605 Ops/s $\color{#d91a1a}-0.50\%$
test_vmap_transformer_speed_decorator[False-True] 21.1601ms 20.4643ms 48.8657 Ops/s 49.1778 Ops/s $\color{#d91a1a}-0.63\%$
test_vmap_transformer_speed_decorator[False-False] 21.1594ms 20.4278ms 48.9528 Ops/s 49.2990 Ops/s $\color{#d91a1a}-0.70\%$
test_to_module_speed[True] 1.5795ms 1.4882ms 671.9734 Ops/s 668.3950 Ops/s $\color{#35bf28}+0.54\%$
test_to_module_speed[False] 1.5694ms 1.4723ms 679.2191 Ops/s 677.6983 Ops/s $\color{#35bf28}+0.22\%$
test_tc_init 70.6820μs 43.0723μs 23.2168 KOps/s 23.0861 KOps/s $\color{#35bf28}+0.57\%$
test_tc_init_tensor_only 38.8510μs 9.0181μs 110.8885 KOps/s 110.7164 KOps/s $\color{#35bf28}+0.16\%$
test_tc_init_nested 0.1374ms 84.5961μs 11.8209 KOps/s 11.7014 KOps/s $\color{#35bf28}+1.02\%$
test_tc_init_many_fields 31.4510μs 14.9165μs 67.0397 KOps/s 66.4448 KOps/s $\color{#35bf28}+0.90\%$
test_tc_first_layer_tensor 36.3110μs 1.7987μs 555.9545 KOps/s 554.4295 KOps/s $\color{#35bf28}+0.28\%$
test_tc_first_layer_tensor_only 3.2631μs 0.3913μs 2.5554 MOps/s 2.5474 MOps/s $\color{#35bf28}+0.31\%$
test_tc_first_layer_tensor_set 31.4110μs 3.8820μs 257.5977 KOps/s 251.8602 KOps/s $\color{#35bf28}+2.28\%$
test_tc_first_layer_tensor_only_set 17.6200μs 3.3724μs 296.5267 KOps/s 300.7361 KOps/s $\color{#d91a1a}-1.40\%$
test_tc_first_layer_nontensor 26.9910μs 6.1599μs 162.3390 KOps/s 155.0355 KOps/s $\color{#35bf28}+4.71\%$
test_tc_second_layer_tensor 32.5300μs 4.3752μs 228.5619 KOps/s 225.2564 KOps/s $\color{#35bf28}+1.47\%$
test_tc_second_layer_nontensor 34.6610μs 8.5787μs 116.5678 KOps/s 110.9658 KOps/s $\textbf{\color{#35bf28}+5.05\%}$
test_unbind 0.2813s 13.1507ms 76.0418 Ops/s 63.9897 Ops/s $\textbf{\color{#35bf28}+18.83\%}$
test_full_like 4.8136ms 4.4357ms 225.4411 Ops/s 229.0290 Ops/s $\color{#d91a1a}-1.57\%$
test_zeros_like 4.6938ms 4.3384ms 230.5013 Ops/s 228.1907 Ops/s $\color{#35bf28}+1.01\%$
test_ones_like 4.6212ms 4.3833ms 228.1383 Ops/s 231.3710 Ops/s $\color{#d91a1a}-1.40\%$
test_clone 7.4059ms 6.7639ms 147.8445 Ops/s 148.9420 Ops/s $\color{#d91a1a}-0.74\%$
test_squeeze 0.1816ms 14.5976μs 68.5045 KOps/s 69.5700 KOps/s $\color{#d91a1a}-1.53\%$
test_unsqueeze 0.1642ms 0.1120ms 8.9307 KOps/s 9.0663 KOps/s $\color{#d91a1a}-1.50\%$
test_split 0.2615ms 0.1815ms 5.5087 KOps/s 5.5792 KOps/s $\color{#d91a1a}-1.26\%$
test_permute 0.2733ms 0.2146ms 4.6604 KOps/s 4.8824 KOps/s $\color{#d91a1a}-4.55\%$
test_stack 52.4784ms 51.8724ms 19.2781 Ops/s 19.2067 Ops/s $\color{#35bf28}+0.37\%$
test_cat 52.3366ms 51.9396ms 19.2531 Ops/s 19.2638 Ops/s $\color{#d91a1a}-0.06\%$
test_sequential_tensordict 0.6825ms 0.5704ms 1.7532 KOps/s 1.7376 KOps/s $\color{#35bf28}+0.90\%$
test_sequential_graph_module 0.2421ms 0.1192ms 8.3874 KOps/s 8.3864 KOps/s $\color{#35bf28}+0.01\%$
test_nested_tensordict 0.9096ms 0.8111ms 1.2328 KOps/s 1.2300 KOps/s $\color{#35bf28}+0.23\%$
test_nested_graph_module 0.1844ms 0.1269ms 7.8829 KOps/s 7.8912 KOps/s $\color{#d91a1a}-0.11\%$

@github-actions

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 341. Improved: $\large\color{#35bf28}12$. Worsened: $\large\color{#d91a1a}20$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_collector_preallocated_write[stack_out-cpu-32-2] 0.2211ms 0.1722ms 5.8071 KOps/s 5.8836 KOps/s $\color{#d91a1a}-1.30\%$
test_collector_preallocated_write[stack_out-cpu-32-8] 0.3716ms 0.3020ms 3.3114 KOps/s 3.3287 KOps/s $\color{#d91a1a}-0.52\%$
test_collector_preallocated_write[stack_out-cpu-32-32] 0.8841ms 0.7783ms 1.2848 KOps/s 1.2686 KOps/s $\color{#35bf28}+1.27\%$
test_collector_preallocated_write[stack_out-cpu-4096-2] 0.4955ms 0.3828ms 2.6126 KOps/s 2.8964 KOps/s $\textbf{\color{#d91a1a}-9.80\%}$
test_collector_preallocated_write[stack_out-cpu-4096-8] 1.3989ms 1.1690ms 855.4325 Ops/s 894.3058 Ops/s $\color{#d91a1a}-4.35\%$
test_collector_preallocated_write[stack_out-cpu-4096-32] 7.9208ms 7.6373ms 130.9364 Ops/s 130.0977 Ops/s $\color{#35bf28}+0.64\%$
test_collector_preallocated_write[stack_out-cuda-32-2] 0.2917ms 0.2527ms 3.9569 KOps/s 3.9897 KOps/s $\color{#d91a1a}-0.82\%$
test_collector_preallocated_write[stack_out-cuda-32-8] 0.5439ms 0.3787ms 2.6408 KOps/s 2.6510 KOps/s $\color{#d91a1a}-0.38\%$
test_collector_preallocated_write[stack_out-cuda-32-32] 0.9280ms 0.8347ms 1.1981 KOps/s 1.2090 KOps/s $\color{#d91a1a}-0.90\%$
test_collector_preallocated_write[stack_out-cuda-4096-2] 0.3277ms 0.2588ms 3.8635 KOps/s 3.9240 KOps/s $\color{#d91a1a}-1.54\%$
test_collector_preallocated_write[stack_out-cuda-4096-8] 0.4629ms 0.3816ms 2.6206 KOps/s 2.6558 KOps/s $\color{#d91a1a}-1.33\%$
test_collector_preallocated_write[stack_out-cuda-4096-32] 1.0385ms 0.8917ms 1.1215 KOps/s 1.1222 KOps/s $\color{#d91a1a}-0.06\%$
test_collector_preallocated_write[set_at_loop-cpu-32-2] 0.3091ms 0.2206ms 4.5322 KOps/s 4.6026 KOps/s $\color{#d91a1a}-1.53\%$
test_collector_preallocated_write[set_at_loop-cpu-32-8] 0.8994ms 0.8372ms 1.1945 KOps/s 1.1955 KOps/s $\color{#d91a1a}-0.08\%$
test_collector_preallocated_write[set_at_loop-cpu-32-32] 3.6787ms 3.3637ms 297.2934 Ops/s 301.6723 Ops/s $\color{#d91a1a}-1.45\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-2] 0.4947ms 0.3768ms 2.6537 KOps/s 2.6605 KOps/s $\color{#d91a1a}-0.25\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-8] 2.1606ms 1.8378ms 544.1435 Ops/s 598.4219 Ops/s $\textbf{\color{#d91a1a}-9.07\%}$
test_collector_preallocated_write[set_at_loop-cpu-4096-32] 11.0495ms 10.6913ms 93.5339 Ops/s 93.9789 Ops/s $\color{#d91a1a}-0.47\%$
test_collector_preallocated_write[set_at_loop-cuda-32-2] 0.4978ms 0.4090ms 2.4450 KOps/s 2.5224 KOps/s $\color{#d91a1a}-3.07\%$
test_collector_preallocated_write[set_at_loop-cuda-32-8] 1.8931ms 1.5151ms 660.0081 Ops/s 680.3170 Ops/s $\color{#d91a1a}-2.99\%$
test_collector_preallocated_write[set_at_loop-cuda-32-32] 6.4165ms 5.9060ms 169.3192 Ops/s 173.4285 Ops/s $\color{#d91a1a}-2.37\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-2] 0.5649ms 0.4064ms 2.4604 KOps/s 2.4869 KOps/s $\color{#d91a1a}-1.07\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-8] 1.8872ms 1.5300ms 653.5919 Ops/s 679.8762 Ops/s $\color{#d91a1a}-3.87\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-32] 6.1199ms 5.9246ms 168.7872 Ops/s 172.2338 Ops/s $\color{#d91a1a}-2.00\%$
test_collector_preallocated_write[copy_at-cpu-32-2] 0.2201ms 0.1755ms 5.6976 KOps/s 5.7403 KOps/s $\color{#d91a1a}-0.74\%$
test_collector_preallocated_write[copy_at-cpu-32-8] 0.8386ms 0.6832ms 1.4637 KOps/s 1.4660 KOps/s $\color{#d91a1a}-0.16\%$
test_collector_preallocated_write[copy_at-cpu-32-32] 2.9205ms 2.7079ms 369.2894 Ops/s 371.6605 Ops/s $\color{#d91a1a}-0.64\%$
test_collector_preallocated_write[copy_at-cpu-4096-2] 0.4691ms 0.3155ms 3.1692 KOps/s 3.0774 KOps/s $\color{#35bf28}+2.98\%$
test_collector_preallocated_write[copy_at-cpu-4096-8] 1.7817ms 1.5959ms 626.5972 Ops/s 679.6622 Ops/s $\textbf{\color{#d91a1a}-7.81\%}$
test_collector_preallocated_write[copy_at-cpu-4096-32] 10.3676ms 10.0047ms 99.9528 Ops/s 101.7016 Ops/s $\color{#d91a1a}-1.72\%$
test_collector_preallocated_write[copy_at-cuda-32-2] 0.4440ms 0.3306ms 3.0249 KOps/s 3.0687 KOps/s $\color{#d91a1a}-1.43\%$
test_collector_preallocated_write[copy_at-cuda-32-8] 1.4185ms 1.2346ms 809.9871 Ops/s 822.2355 Ops/s $\color{#d91a1a}-1.49\%$
test_collector_preallocated_write[copy_at-cuda-32-32] 4.9824ms 4.8482ms 206.2605 Ops/s 210.2706 Ops/s $\color{#d91a1a}-1.91\%$
test_collector_preallocated_write[copy_at-cuda-4096-2] 0.4020ms 0.3319ms 3.0133 KOps/s 3.0616 KOps/s $\color{#d91a1a}-1.58\%$
test_collector_preallocated_write[copy_at-cuda-4096-8] 1.3575ms 1.2359ms 809.1354 Ops/s 820.7556 Ops/s $\color{#d91a1a}-1.42\%$
test_collector_preallocated_write[copy_at-cuda-4096-32] 4.9814ms 4.8552ms 205.9646 Ops/s 209.5538 Ops/s $\color{#d91a1a}-1.71\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-2] 0.1653ms 0.1214ms 8.2349 KOps/s 8.2392 KOps/s $\color{#d91a1a}-0.05\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-8] 0.5251ms 0.4767ms 2.0976 KOps/s 2.1102 KOps/s $\color{#d91a1a}-0.60\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-32] 2.0428ms 1.8992ms 526.5499 Ops/s 528.7546 Ops/s $\color{#d91a1a}-0.42\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-2] 0.3763ms 0.2547ms 3.9255 KOps/s 3.8608 KOps/s $\color{#35bf28}+1.68\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-8] 1.7916ms 1.3561ms 737.4286 Ops/s 784.4180 Ops/s $\textbf{\color{#d91a1a}-5.99\%}$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-32] 9.2821ms 9.0112ms 110.9726 Ops/s 111.8204 Ops/s $\color{#d91a1a}-0.76\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-2] 0.3915ms 0.2809ms 3.5597 KOps/s 3.6220 KOps/s $\color{#d91a1a}-1.72\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-8] 1.1868ms 1.0484ms 953.8269 Ops/s 969.4960 Ops/s $\color{#d91a1a}-1.62\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-32] 4.2541ms 4.0930ms 244.3220 Ops/s 248.6705 Ops/s $\color{#d91a1a}-1.75\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-2] 0.4336ms 0.2833ms 3.5304 KOps/s 3.6274 KOps/s $\color{#d91a1a}-2.67\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-8] 1.1403ms 1.0466ms 955.4520 Ops/s 970.0014 Ops/s $\color{#d91a1a}-1.50\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-32] 4.3400ms 4.1128ms 243.1439 Ops/s 247.2524 Ops/s $\color{#d91a1a}-1.66\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-128] 16.9219ms 16.6066ms 60.2170 Ops/s 60.8397 Ops/s $\color{#d91a1a}-1.02\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-256] 36.4779ms 33.5189ms 29.8339 Ops/s 30.1030 Ops/s $\color{#d91a1a}-0.89\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-128] 91.3438ms 90.3578ms 11.0671 Ops/s 11.2508 Ops/s $\color{#d91a1a}-1.63\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-256] 0.2113s 0.2100s 4.7622 Ops/s 4.8453 Ops/s $\color{#d91a1a}-1.71\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-128] 14.0256ms 13.8975ms 71.9554 Ops/s 72.2038 Ops/s $\color{#d91a1a}-0.34\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-256] 27.2492ms 27.0844ms 36.9217 Ops/s 36.8389 Ops/s $\color{#35bf28}+0.22\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-128] 14.1859ms 14.0238ms 71.3073 Ops/s 71.3317 Ops/s $\color{#d91a1a}-0.03\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-256] 27.6718ms 27.4534ms 36.4253 Ops/s 36.2708 Ops/s $\color{#35bf28}+0.43\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-128] 55.8339ms 54.9846ms 18.1869 Ops/s 19.1331 Ops/s $\color{#d91a1a}-4.95\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-256] 0.1072s 0.1066s 9.3766 Ops/s 9.4636 Ops/s $\color{#d91a1a}-0.92\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-128] 0.1547s 0.1533s 6.5232 Ops/s 6.6429 Ops/s $\color{#d91a1a}-1.80\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-256] 0.3421s 0.3406s 2.9363 Ops/s 2.9973 Ops/s $\color{#d91a1a}-2.03\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-128] 78.4655ms 76.4077ms 13.0877 Ops/s 13.3712 Ops/s $\color{#d91a1a}-2.12\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-256] 0.1603s 0.1573s 6.3566 Ops/s 6.7221 Ops/s $\textbf{\color{#d91a1a}-5.44\%}$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-128] 77.9586ms 77.1771ms 12.9572 Ops/s 13.4216 Ops/s $\color{#d91a1a}-3.46\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-256] 0.1545s 0.1533s 6.5217 Ops/s 6.6766 Ops/s $\color{#d91a1a}-2.32\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-128] 30.9527ms 30.7264ms 32.5453 Ops/s 32.7213 Ops/s $\color{#d91a1a}-0.54\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-256] 62.5955ms 62.4861ms 16.0036 Ops/s 16.1709 Ops/s $\color{#d91a1a}-1.03\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-128] 0.1293s 0.1273s 7.8562 Ops/s 7.8389 Ops/s $\color{#35bf28}+0.22\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-256] 0.2884s 0.2871s 3.4837 Ops/s 3.5792 Ops/s $\color{#d91a1a}-2.67\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-128] 44.6744ms 44.0198ms 22.7170 Ops/s 23.1694 Ops/s $\color{#d91a1a}-1.95\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-256] 88.6093ms 88.1136ms 11.3490 Ops/s 11.6304 Ops/s $\color{#d91a1a}-2.42\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-128] 44.7549ms 44.3617ms 22.5420 Ops/s 23.0683 Ops/s $\color{#d91a1a}-2.28\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-256] 89.5087ms 88.6910ms 11.2751 Ops/s 11.5557 Ops/s $\color{#d91a1a}-2.43\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-128] 20.9750ms 20.7271ms 48.2460 Ops/s 48.4223 Ops/s $\color{#d91a1a}-0.36\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-256] 42.7156ms 42.4893ms 23.5354 Ops/s 23.7335 Ops/s $\color{#d91a1a}-0.83\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-128] 0.1132s 0.1121s 8.9217 Ops/s 8.9610 Ops/s $\color{#d91a1a}-0.44\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-256] 0.2648s 0.2628s 3.8058 Ops/s 3.9267 Ops/s $\color{#d91a1a}-3.08\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-128] 37.8632ms 37.3948ms 26.7417 Ops/s 27.2430 Ops/s $\color{#d91a1a}-1.84\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-256] 75.1934ms 74.6161ms 13.4019 Ops/s 13.6936 Ops/s $\color{#d91a1a}-2.13\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-128] 38.0637ms 37.4495ms 26.7026 Ops/s 27.3279 Ops/s $\color{#d91a1a}-2.29\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-256] 75.6281ms 74.9663ms 13.3393 Ops/s 13.6850 Ops/s $\color{#d91a1a}-2.53\%$
test_plain_set_nested 33.4720μs 15.7071μs 63.6655 KOps/s 65.2793 KOps/s $\color{#d91a1a}-2.47\%$
test_plain_set_stack_nested 56.9230μs 15.5295μs 64.3935 KOps/s 66.2864 KOps/s $\color{#d91a1a}-2.86\%$
test_plain_set_nested_inplace 38.3320μs 17.1776μs 58.2155 KOps/s 58.7513 KOps/s $\color{#d91a1a}-0.91\%$
test_plain_set_stack_nested_inplace 43.7330μs 16.9317μs 59.0606 KOps/s 60.3631 KOps/s $\color{#d91a1a}-2.16\%$
test_items 35.9310μs 6.0838μs 164.3700 KOps/s 166.1807 KOps/s $\color{#d91a1a}-1.09\%$
test_items_nested 0.4979ms 0.4706ms 2.1250 KOps/s 2.1322 KOps/s $\color{#d91a1a}-0.34\%$
test_items_nested_locked 0.5179ms 0.4782ms 2.0912 KOps/s 2.1051 KOps/s $\color{#d91a1a}-0.66\%$
test_items_nested_leaf 0.1389ms 97.7604μs 10.2291 KOps/s 10.2689 KOps/s $\color{#d91a1a}-0.39\%$
test_items_stack_nested 0.5272ms 0.4686ms 2.1338 KOps/s 2.1264 KOps/s $\color{#35bf28}+0.35\%$
test_items_stack_nested_leaf 0.1554ms 97.3004μs 10.2774 KOps/s 10.2699 KOps/s $\color{#35bf28}+0.07\%$
test_items_stack_nested_locked 0.5826ms 0.4747ms 2.1067 KOps/s 2.1184 KOps/s $\color{#d91a1a}-0.55\%$
test_keys 28.0110μs 4.2329μs 236.2446 KOps/s 236.5515 KOps/s $\color{#d91a1a}-0.13\%$
test_keys_nested 0.1604ms 0.1326ms 7.5439 KOps/s 7.6684 KOps/s $\color{#d91a1a}-1.62\%$
test_keys_nested_locked 0.8081ms 0.1404ms 7.1224 KOps/s 7.1881 KOps/s $\color{#d91a1a}-0.91\%$
test_keys_nested_leaf 0.1519ms 0.1233ms 8.1080 KOps/s 8.2915 KOps/s $\color{#d91a1a}-2.21\%$
test_keys_stack_nested 0.1633ms 0.1316ms 7.5975 KOps/s 7.6969 KOps/s $\color{#d91a1a}-1.29\%$
test_keys_stack_nested_leaf 0.1634ms 0.1211ms 8.2545 KOps/s 8.2287 KOps/s $\color{#35bf28}+0.31\%$
test_keys_stack_nested_locked 0.1912ms 0.1408ms 7.1030 KOps/s 7.2047 KOps/s $\color{#d91a1a}-1.41\%$
test_values 13.9426μs 1.0200μs 980.4024 KOps/s 983.6814 KOps/s $\color{#d91a1a}-0.33\%$
test_values_nested 76.8140μs 53.4129μs 18.7221 KOps/s 19.0136 KOps/s $\color{#d91a1a}-1.53\%$
test_values_nested_locked 0.1020ms 56.8780μs 17.5815 KOps/s 17.8888 KOps/s $\color{#d91a1a}-1.72\%$
test_values_nested_leaf 82.9240μs 60.9334μs 16.4114 KOps/s 16.6567 KOps/s $\color{#d91a1a}-1.47\%$
test_values_stack_nested 94.4650μs 53.5407μs 18.6774 KOps/s 19.0497 KOps/s $\color{#d91a1a}-1.95\%$
test_values_stack_nested_leaf 83.6740μs 60.8799μs 16.4258 KOps/s 16.5840 KOps/s $\color{#d91a1a}-0.95\%$
test_values_stack_nested_locked 99.5850μs 56.9567μs 17.5572 KOps/s 17.7616 KOps/s $\color{#d91a1a}-1.15\%$
test_membership 3.9418μs 0.8545μs 1.1703 MOps/s 1.1834 MOps/s $\color{#d91a1a}-1.11\%$
test_membership_nested 43.5820μs 3.0042μs 332.8684 KOps/s 333.5835 KOps/s $\color{#d91a1a}-0.21\%$
test_membership_nested_leaf 35.8210μs 2.9955μs 333.8330 KOps/s 333.1616 KOps/s $\color{#35bf28}+0.20\%$
test_membership_stacked_nested 21.6710μs 2.9141μs 343.1587 KOps/s 341.8684 KOps/s $\color{#35bf28}+0.38\%$
test_membership_stacked_nested_leaf 28.2310μs 2.9141μs 343.1603 KOps/s 343.0144 KOps/s $\color{#35bf28}+0.04\%$
test_membership_nested_last 24.1710μs 4.5371μs 220.4036 KOps/s 223.2007 KOps/s $\color{#d91a1a}-1.25\%$
test_membership_nested_leaf_last 42.0820μs 4.5218μs 221.1517 KOps/s 224.8556 KOps/s $\color{#d91a1a}-1.65\%$
test_membership_stacked_nested_last 23.6410μs 4.3657μs 229.0563 KOps/s 228.7686 KOps/s $\color{#35bf28}+0.13\%$
test_membership_stacked_nested_leaf_last 44.4120μs 4.3929μs 227.6417 KOps/s 228.9725 KOps/s $\color{#d91a1a}-0.58\%$
test_nested_getleaf 50.6720μs 22.0722μs 45.3058 KOps/s 45.6150 KOps/s $\color{#d91a1a}-0.68\%$
test_nested_get 47.2520μs 20.6976μs 48.3149 KOps/s 47.8005 KOps/s $\color{#35bf28}+1.08\%$
test_stacked_getleaf 44.7120μs 21.7615μs 45.9527 KOps/s 45.8480 KOps/s $\color{#35bf28}+0.23\%$
test_stacked_get 46.8020μs 20.8461μs 47.9707 KOps/s 48.4803 KOps/s $\color{#d91a1a}-1.05\%$
test_nested_getitemleaf 45.8120μs 22.2234μs 44.9976 KOps/s 44.9426 KOps/s $\color{#35bf28}+0.12\%$
test_nested_getitem 49.6730μs 21.1720μs 47.2323 KOps/s 47.0608 KOps/s $\color{#35bf28}+0.36\%$
test_stacked_getitemleaf 62.2230μs 22.0717μs 45.3070 KOps/s 45.2179 KOps/s $\color{#35bf28}+0.20\%$
test_stacked_getitem 50.0620μs 21.1753μs 47.2249 KOps/s 46.9629 KOps/s $\color{#35bf28}+0.56\%$
test_lock_nested 0.6707ms 0.5103ms 1.9596 KOps/s 1.9971 KOps/s $\color{#d91a1a}-1.88\%$
test_lock_stack_nested 0.5716ms 0.5163ms 1.9369 KOps/s 1.9768 KOps/s $\color{#d91a1a}-2.02\%$
test_unlock_nested 0.5047ms 0.4067ms 2.4587 KOps/s 2.5340 KOps/s $\color{#d91a1a}-2.97\%$
test_unlock_stack_nested 0.4685ms 0.4089ms 2.4455 KOps/s 2.4758 KOps/s $\color{#d91a1a}-1.23\%$
test_flatten_speed 0.1753ms 0.1200ms 8.3317 KOps/s 8.2117 KOps/s $\color{#35bf28}+1.46\%$
test_unflatten_speed 0.6497ms 0.5701ms 1.7541 KOps/s 1.7584 KOps/s $\color{#d91a1a}-0.25\%$
test_common_ops 0.1003s 1.8961ms 527.3866 Ops/s 720.8199 Ops/s $\textbf{\color{#d91a1a}-26.84\%}$
test_creation 0.1256ms 3.1878μs 313.6954 KOps/s 319.9730 KOps/s $\color{#d91a1a}-1.96\%$
test_creation_empty 31.4610μs 7.0820μs 141.2025 KOps/s 143.7007 KOps/s $\color{#d91a1a}-1.74\%$
test_creation_nested_1 34.7620μs 11.5598μs 86.5069 KOps/s 86.5948 KOps/s $\color{#d91a1a}-0.10\%$
test_creation_nested_2 39.8920μs 13.6879μs 73.0573 KOps/s 72.2878 KOps/s $\color{#35bf28}+1.06\%$
test_creation_many_keys[10] 55.5330μs 21.0638μs 47.4749 KOps/s 47.1818 KOps/s $\color{#35bf28}+0.62\%$
test_creation_many_keys[50] 0.1291ms 90.4718μs 11.0532 KOps/s 10.8711 KOps/s $\color{#35bf28}+1.67\%$
test_creation_many_keys[100] 0.2328ms 0.1773ms 5.6393 KOps/s 5.5625 KOps/s $\color{#35bf28}+1.38\%$
test_creation_nested_many_keys[10] 73.0430μs 45.4149μs 22.0192 KOps/s 21.9328 KOps/s $\color{#35bf28}+0.39\%$
test_creation_nested_many_keys[50] 0.2120ms 0.1864ms 5.3645 KOps/s 5.3204 KOps/s $\color{#35bf28}+0.83\%$
test_clone 35.7910μs 13.8206μs 72.3555 KOps/s 73.9568 KOps/s $\color{#d91a1a}-2.17\%$
test_getitem[int] 1.5943ms 15.5537μs 64.2935 KOps/s 66.2384 KOps/s $\color{#d91a1a}-2.94\%$
test_getitem[slice_int] 0.1415ms 25.0572μs 39.9087 KOps/s 40.4598 KOps/s $\color{#d91a1a}-1.36\%$
test_getitem[range] 0.1808ms 64.5978μs 15.4804 KOps/s 14.9122 KOps/s $\color{#35bf28}+3.81\%$
test_getitem[tuple] 0.1387ms 24.7319μs 40.4337 KOps/s 41.6094 KOps/s $\color{#d91a1a}-2.83\%$
test_getitem[list] 0.1817ms 59.5775μs 16.7848 KOps/s 16.6641 KOps/s $\color{#35bf28}+0.72\%$
test_setitem_dim[int] 45.0120μs 25.4716μs 39.2594 KOps/s 38.3584 KOps/s $\color{#35bf28}+2.35\%$
test_setitem_dim[slice_int] 65.7730μs 43.8620μs 22.7988 KOps/s 22.8869 KOps/s $\color{#d91a1a}-0.38\%$
test_setitem_dim[range] 0.1195ms 95.7700μs 10.4417 KOps/s 10.1708 KOps/s $\color{#35bf28}+2.66\%$
test_setitem_dim[tuple] 59.4820μs 39.4222μs 25.3664 KOps/s 25.5186 KOps/s $\color{#d91a1a}-0.60\%$
test_setitem 50.4230μs 17.9846μs 55.6031 KOps/s 55.9092 KOps/s $\color{#d91a1a}-0.55\%$
test_set 53.9530μs 17.2801μs 57.8702 KOps/s 58.5297 KOps/s $\color{#d91a1a}-1.13\%$
test_set_shared 0.5105ms 0.2122ms 4.7134 KOps/s 4.7881 KOps/s $\color{#d91a1a}-1.56\%$
test_update 0.2052ms 22.3159μs 44.8112 KOps/s 44.9923 KOps/s $\color{#d91a1a}-0.40\%$
test_update_nested 71.3340μs 33.7518μs 29.6281 KOps/s 29.5457 KOps/s $\color{#35bf28}+0.28\%$
test_update__nested 0.4719ms 33.9486μs 29.4563 KOps/s 29.8880 KOps/s $\color{#d91a1a}-1.44\%$
test_set_nested 51.1830μs 19.1862μs 52.1209 KOps/s 52.5939 KOps/s $\color{#d91a1a}-0.90\%$
test_set_nested_new 57.5730μs 24.4131μs 40.9616 KOps/s 42.4251 KOps/s $\color{#d91a1a}-3.45\%$
test_select 82.5840μs 41.4817μs 24.1070 KOps/s 24.5327 KOps/s $\color{#d91a1a}-1.74\%$
test_select_nested 0.1066ms 74.5276μs 13.4178 KOps/s 13.3567 KOps/s $\color{#35bf28}+0.46\%$
test_exclude_nested 0.1276ms 91.8517μs 10.8871 KOps/s 10.8888 KOps/s $\color{#d91a1a}-0.02\%$
test_empty[True] 0.4357ms 0.4033ms 2.4795 KOps/s 2.4881 KOps/s $\color{#d91a1a}-0.35\%$
test_empty[False] 9.7673μs 1.4084μs 710.0308 KOps/s 714.8515 KOps/s $\color{#d91a1a}-0.67\%$
test_to 99.3550μs 70.6951μs 14.1453 KOps/s 14.4323 KOps/s $\color{#d91a1a}-1.99\%$
test_to_nonblocking 0.1115ms 69.7133μs 14.3445 KOps/s 14.1003 KOps/s $\color{#35bf28}+1.73\%$
test_unbind_speed 0.3983ms 0.3503ms 2.8543 KOps/s 2.9656 KOps/s $\color{#d91a1a}-3.75\%$
test_unbind_speed_stack0 0.4176ms 0.3443ms 2.9046 KOps/s 3.0181 KOps/s $\color{#d91a1a}-3.76\%$
test_unbind_speed_stack1 0.1180s 0.8813ms 1.1347 KOps/s 1.1689 KOps/s $\color{#d91a1a}-2.93\%$
test_split 1.2097ms 1.1466ms 872.1116 Ops/s 720.6737 Ops/s $\textbf{\color{#35bf28}+21.01\%}$
test_chunk 0.1179s 1.2323ms 811.4984 Ops/s 924.2067 Ops/s $\textbf{\color{#d91a1a}-12.20\%}$
test_to_cpu_blocking 20.3073ms 19.9043ms 50.2403 Ops/s 51.2455 Ops/s $\color{#d91a1a}-1.96\%$
test_to_cpu_global_sync 12.2613ms 12.1108ms 82.5706 Ops/s 84.0623 Ops/s $\color{#d91a1a}-1.77\%$
test_to_cpu_event_sync 13.1542ms 12.9047ms 77.4912 Ops/s 78.3942 Ops/s $\color{#d91a1a}-1.15\%$
test_to_cpu_default 13.2460ms 12.9429ms 77.2627 Ops/s 69.8135 Ops/s $\textbf{\color{#35bf28}+10.67\%}$
test_consolidate[False-None] 0.1472s 4.8112ms 207.8499 Ops/s 239.6695 Ops/s $\textbf{\color{#d91a1a}-13.28\%}$
test_consolidate[default-None] 3.5628ms 2.2327ms 447.8927 Ops/s 459.4652 Ops/s $\color{#d91a1a}-2.52\%$
test_consolidate[reduce-overhead-None] 3.5377ms 2.1293ms 469.6281 Ops/s 471.6533 Ops/s $\color{#d91a1a}-0.43\%$
test_consolidate_njt[False-None] 0.1852s 10.0849ms 99.1578 Ops/s 114.9567 Ops/s $\textbf{\color{#d91a1a}-13.74\%}$
test_to[False-False-None] 2.4469ms 2.2236ms 449.7154 Ops/s 453.0720 Ops/s $\color{#d91a1a}-0.74\%$
test_to[True-False-None] 2.1836ms 1.9543ms 511.6802 Ops/s 516.7483 Ops/s $\color{#d91a1a}-0.98\%$
test_to[within-False-None] 6.4108ms 6.2490ms 160.0253 Ops/s 158.5452 Ops/s $\color{#35bf28}+0.93\%$
test_to[True-default-None] 10.9015ms 10.7026ms 93.4350 Ops/s 46.5614 Ops/s $\textbf{\color{#35bf28}+100.67\%}$
test_to_njt[False-False-None] 8.8945ms 8.6641ms 115.4194 Ops/s 114.7099 Ops/s $\color{#35bf28}+0.62\%$
test_to_njt[True-False-None] 7.2319ms 6.9661ms 143.5520 Ops/s 142.3673 Ops/s $\color{#35bf28}+0.83\%$
test_to_njt[within-False-None] 15.9148ms 15.4408ms 64.7636 Ops/s 62.7650 Ops/s $\color{#35bf28}+3.18\%$
test_creation[device0] 0.3963ms 0.1182ms 8.4583 KOps/s 8.5363 KOps/s $\color{#d91a1a}-0.91\%$
test_creation_from_tensor 0.4432ms 0.1144ms 8.7395 KOps/s 8.3500 KOps/s $\color{#35bf28}+4.66\%$
test_add_one[memmap_tensor0] 0.1981ms 7.0004μs 142.8482 KOps/s 146.2484 KOps/s $\color{#d91a1a}-2.32\%$
test_contiguous[memmap_tensor0] 27.9110μs 0.6718μs 1.4886 MOps/s 2.2089 MOps/s $\textbf{\color{#d91a1a}-32.61\%}$
test_stack[memmap_tensor0] 27.6410μs 4.3468μs 230.0546 KOps/s 234.8806 KOps/s $\color{#d91a1a}-2.05\%$
test_memmaptd_index 1.3125ms 0.2808ms 3.5614 KOps/s 3.6101 KOps/s $\color{#d91a1a}-1.35\%$
test_memmaptd_index_astensor 0.5468ms 0.3878ms 2.5789 KOps/s 2.6358 KOps/s $\color{#d91a1a}-2.16\%$
test_memmaptd_index_op 0.1859s 0.7802ms 1.2817 KOps/s 1.5551 KOps/s $\textbf{\color{#d91a1a}-17.58\%}$
test_serialize_model 0.1373s 0.1349s 7.4108 Ops/s 7.4553 Ops/s $\color{#d91a1a}-0.60\%$
test_serialize_model_pickle 1.3465s 1.2098s 0.8266 Ops/s 0.8224 Ops/s $\color{#35bf28}+0.51\%$
test_serialize_weights 0.1362s 0.1345s 7.4343 Ops/s 7.4689 Ops/s $\color{#d91a1a}-0.46\%$
test_serialize_weights_returnearly 0.4550s 92.4523ms 10.8164 Ops/s 10.5870 Ops/s $\color{#35bf28}+2.17\%$
test_serialize_weights_pickle 1.3457s 1.2108s 0.8259 Ops/s 0.8214 Ops/s $\color{#35bf28}+0.55\%$
test_reshape_pytree 0.2101ms 33.2316μs 30.0918 KOps/s 30.4860 KOps/s $\color{#d91a1a}-1.29\%$
test_reshape_td 83.6440μs 45.4565μs 21.9991 KOps/s 22.1819 KOps/s $\color{#d91a1a}-0.82\%$
test_view_pytree 0.2200ms 32.6770μs 30.6025 KOps/s 30.8630 KOps/s $\color{#d91a1a}-0.84\%$
test_view_td 0.2597ms 54.1151μs 18.4791 KOps/s 18.3346 KOps/s $\color{#35bf28}+0.79\%$
test_unbind_pytree 0.2416ms 37.2403μs 26.8527 KOps/s 26.8600 KOps/s $\color{#d91a1a}-0.03\%$
test_unbind_td 0.2529ms 52.3913μs 19.0871 KOps/s 19.8004 KOps/s $\color{#d91a1a}-3.60\%$
test_split_pytree 0.2449ms 43.5707μs 22.9512 KOps/s 23.2222 KOps/s $\color{#d91a1a}-1.17\%$
test_split_td 0.1250ms 65.9362μs 15.1662 KOps/s 15.5026 KOps/s $\color{#d91a1a}-2.17\%$
test_add_pytree 0.2278ms 42.7251μs 23.4054 KOps/s 23.2229 KOps/s $\color{#35bf28}+0.79\%$
test_add_td 92.4140μs 55.6686μs 17.9635 KOps/s 16.6857 KOps/s $\textbf{\color{#35bf28}+7.66\%}$
test_compile_add_one_nested[tensordict-compile] 0.3544ms 0.2306ms 4.3367 KOps/s 4.2148 KOps/s $\color{#35bf28}+2.89\%$
test_compile_add_one_nested[tensordict-eager] 0.3061ms 0.2027ms 4.9343 KOps/s 4.9843 KOps/s $\color{#d91a1a}-1.00\%$
test_compile_add_one_nested[pytree-compile] 0.2639ms 0.1394ms 7.1726 KOps/s 7.3547 KOps/s $\color{#d91a1a}-2.48\%$
test_compile_add_one_nested[pytree-eager] 0.4325ms 0.1806ms 5.5360 KOps/s 5.5785 KOps/s $\color{#d91a1a}-0.76\%$
test_compile_copy_nested[tensordict-compile] 62.7030μs 16.4311μs 60.8601 KOps/s 64.8183 KOps/s $\textbf{\color{#d91a1a}-6.11\%}$
test_compile_copy_nested[tensordict-eager] 0.3597ms 52.9327μs 18.8919 KOps/s 18.4362 KOps/s $\color{#35bf28}+2.47\%$
test_compile_copy_nested[pytree-compile] 0.1442ms 15.8563μs 63.0665 KOps/s 62.0061 KOps/s $\color{#35bf28}+1.71\%$
test_compile_copy_nested[pytree-eager] 0.3572ms 68.8970μs 14.5144 KOps/s 14.3558 KOps/s $\color{#35bf28}+1.11\%$
test_compile_add_one_flat[tensordict-compile] 0.2970ms 0.2482ms 4.0297 KOps/s 3.7549 KOps/s $\textbf{\color{#35bf28}+7.32\%}$
test_compile_add_one_flat[tensordict-eager] 0.3675ms 0.2827ms 3.5378 KOps/s 3.4777 KOps/s $\color{#35bf28}+1.73\%$
test_compile_add_one_flat[tensorclass-compile] 0.3145ms 0.1835ms 5.4497 KOps/s 4.9686 KOps/s $\textbf{\color{#35bf28}+9.68\%}$
test_compile_add_one_flat[tensorclass-eager] 0.1276ms 75.8648μs 13.1813 KOps/s 12.9628 KOps/s $\color{#35bf28}+1.69\%$
test_compile_add_one_flat[pytree-compile] 0.4903ms 0.1925ms 5.1938 KOps/s 5.0290 KOps/s $\color{#35bf28}+3.28\%$
test_compile_add_one_flat[pytree-eager] 0.9129ms 0.5544ms 1.8037 KOps/s 1.9093 KOps/s $\textbf{\color{#d91a1a}-5.53\%}$
test_compile_add_self_flat[tensordict-eager] 0.4951ms 0.3306ms 3.0252 KOps/s 2.9869 KOps/s $\color{#35bf28}+1.28\%$
test_compile_add_self_flat[tensordict-compile] 0.3364ms 0.2494ms 4.0091 KOps/s 3.7473 KOps/s $\textbf{\color{#35bf28}+6.99\%}$
test_compile_add_self_flat[tensorclass-eager] 0.1414ms 92.4379μs 10.8181 KOps/s 10.9918 KOps/s $\color{#d91a1a}-1.58\%$
test_compile_add_self_flat[tensorclass-compile] 0.4550ms 0.1907ms 5.2434 KOps/s 5.0863 KOps/s $\color{#35bf28}+3.09\%$
test_compile_add_self_flat[pytree-eager] 0.6491ms 0.4366ms 2.2904 KOps/s 2.3329 KOps/s $\color{#d91a1a}-1.82\%$
test_compile_add_self_flat[pytree-compile] 0.4410ms 0.1911ms 5.2326 KOps/s 5.0332 KOps/s $\color{#35bf28}+3.96\%$
test_compile_copy_flat[tensordict-compile] 59.5020μs 19.6860μs 50.7976 KOps/s 50.1956 KOps/s $\color{#35bf28}+1.20\%$
test_compile_copy_flat[tensordict-eager] 0.1359ms 42.0336μs 23.7905 KOps/s 24.0431 KOps/s $\color{#d91a1a}-1.05\%$
test_compile_copy_flat[pytree-compile] 0.2404ms 21.2120μs 47.1431 KOps/s 46.9634 KOps/s $\color{#35bf28}+0.38\%$
test_compile_copy_flat[pytree-eager] 0.3396ms 52.7118μs 18.9711 KOps/s 19.1926 KOps/s $\color{#d91a1a}-1.15\%$
test_compile_assign_and_add[tensordict-compile] 2.1794ms 0.2357ms 4.2427 KOps/s 3.8361 KOps/s $\textbf{\color{#35bf28}+10.60\%}$
test_compile_assign_and_add[tensordict-eager] 3.5066ms 3.3379ms 299.5908 Ops/s 296.4523 Ops/s $\color{#35bf28}+1.06\%$
test_compile_assign_and_add[pytree-compile] 2.1156ms 0.1794ms 5.5756 KOps/s 5.4509 KOps/s $\color{#35bf28}+2.29\%$
test_compile_assign_and_add[pytree-eager] 3.0656ms 2.8082ms 356.0975 Ops/s 355.1796 Ops/s $\color{#35bf28}+0.26\%$
test_compile_indexing[tensor-tensordict-compile] 0.2890ms 0.1352ms 7.3952 KOps/s 6.8442 KOps/s $\textbf{\color{#35bf28}+8.05\%}$
test_compile_indexing[tensor-tensordict-eager] 0.3153ms 78.7494μs 12.6985 KOps/s 13.4472 KOps/s $\textbf{\color{#d91a1a}-5.57\%}$
test_compile_indexing[tensor-tensorclass-compile] 0.2172ms 0.1184ms 8.4439 KOps/s 8.3635 KOps/s $\color{#35bf28}+0.96\%$
test_compile_indexing[tensor-tensorclass-eager] 0.2702ms 49.0659μs 20.3808 KOps/s 22.0153 KOps/s $\textbf{\color{#d91a1a}-7.42\%}$
test_compile_indexing[tensor-pytree-compile] 0.1685ms 0.1235ms 8.0968 KOps/s 8.2838 KOps/s $\color{#d91a1a}-2.26\%$
test_compile_indexing[tensor-pytree-eager] 0.2660ms 48.6511μs 20.5545 KOps/s 22.0736 KOps/s $\textbf{\color{#d91a1a}-6.88\%}$
test_compile_indexing[slice-tensordict-compile] 0.2476ms 84.5968μs 11.8208 KOps/s 11.5106 KOps/s $\color{#35bf28}+2.69\%$
test_compile_indexing[slice-tensordict-eager] 0.2018ms 28.8217μs 34.6961 KOps/s 36.1111 KOps/s $\color{#d91a1a}-3.92\%$
test_compile_indexing[slice-tensorclass-compile] 0.1617ms 70.9813μs 14.0882 KOps/s 14.1994 KOps/s $\color{#d91a1a}-0.78\%$
test_compile_indexing[slice-tensorclass-eager] 0.2301ms 22.5187μs 44.4075 KOps/s 44.3448 KOps/s $\color{#35bf28}+0.14\%$
test_compile_indexing[slice-pytree-compile] 0.1109ms 72.1947μs 13.8514 KOps/s 13.9104 KOps/s $\color{#d91a1a}-0.42\%$
test_compile_indexing[slice-pytree-eager] 0.2081ms 22.6136μs 44.2213 KOps/s 44.3190 KOps/s $\color{#d91a1a}-0.22\%$
test_compile_indexing[int-tensordict-compile] 0.1195ms 84.9585μs 11.7704 KOps/s 11.5195 KOps/s $\color{#35bf28}+2.18\%$
test_compile_indexing[int-tensordict-eager] 0.2341ms 28.6449μs 34.9103 KOps/s 36.2586 KOps/s $\color{#d91a1a}-3.72\%$
test_compile_indexing[int-tensorclass-compile] 0.1662ms 71.2904μs 14.0271 KOps/s 14.0666 KOps/s $\color{#d91a1a}-0.28\%$
test_compile_indexing[int-tensorclass-eager] 0.2545ms 22.5628μs 44.3208 KOps/s 44.4609 KOps/s $\color{#d91a1a}-0.32\%$
test_compile_indexing[int-pytree-compile] 0.1110ms 71.6791μs 13.9511 KOps/s 14.0628 KOps/s $\color{#d91a1a}-0.79\%$
test_compile_indexing[int-pytree-eager] 0.2877ms 22.8025μs 43.8549 KOps/s 44.7120 KOps/s $\color{#d91a1a}-1.92\%$
test_compile_replace[single-eager] 88.3540μs 48.2891μs 20.7086 KOps/s 20.8408 KOps/s $\color{#d91a1a}-0.63\%$
test_compile_replace[single-compile] 0.2887ms 0.1305ms 7.6637 KOps/s 7.2027 KOps/s $\textbf{\color{#35bf28}+6.40\%}$
test_compile_replace[multi-eager] 0.7878ms 0.5984ms 1.6712 KOps/s 1.6779 KOps/s $\color{#d91a1a}-0.40\%$
test_compile_replace[multi-compile] 0.3053ms 0.1421ms 7.0368 KOps/s 7.1136 KOps/s $\color{#d91a1a}-1.08\%$
test_compile_tc_getattr_20[eager] 0.2291ms 0.1790ms 5.5863 KOps/s 6.1622 KOps/s $\textbf{\color{#d91a1a}-9.35\%}$
test_compile_tc_getattr_20[compile] 0.2601ms 0.1489ms 6.7146 KOps/s 6.6833 KOps/s $\color{#35bf28}+0.47\%$
test_compile_clone_shallow[20-eager] 0.2157ms 19.6179μs 50.9738 KOps/s 52.2741 KOps/s $\color{#d91a1a}-2.49\%$
test_compile_clone_shallow[20-compile] 0.1004ms 16.9196μs 59.1031 KOps/s 58.6391 KOps/s $\color{#35bf28}+0.79\%$
test_compile_clone_shallow[40-eager] 0.2309ms 34.6470μs 28.8625 KOps/s 29.5864 KOps/s $\color{#d91a1a}-2.45\%$
test_compile_clone_shallow[40-compile] 83.1640μs 19.0981μs 52.3612 KOps/s 53.6734 KOps/s $\color{#d91a1a}-2.44\%$
test_compile_clone_shallow[80-eager] 0.1029ms 63.1759μs 15.8288 KOps/s 15.9673 KOps/s $\color{#d91a1a}-0.87\%$
test_compile_clone_shallow[80-compile] 86.7350μs 22.1614μs 45.1235 KOps/s 45.3056 KOps/s $\color{#d91a1a}-0.40\%$
test_compile_update_inplace[eager] 0.2169ms 61.2726μs 16.3205 KOps/s 16.4972 KOps/s $\color{#d91a1a}-1.07\%$
test_compile_update_inplace[compile] 0.3584ms 0.1480ms 6.7584 KOps/s 6.7830 KOps/s $\color{#d91a1a}-0.36\%$
test_mod_add[eager] 0.3254ms 0.2281ms 4.3841 KOps/s 4.3789 KOps/s $\color{#35bf28}+0.12\%$
test_mod_add[compile] 0.3201ms 0.1365ms 7.3264 KOps/s 7.3546 KOps/s $\color{#d91a1a}-0.38\%$
test_mod_add[compile-overhead] 0.3182ms 0.1835ms 5.4508 KOps/s 5.5815 KOps/s $\color{#d91a1a}-2.34\%$
test_mod_wrap[eager] 0.5571ms 0.4727ms 2.1155 KOps/s 2.1161 KOps/s $\color{#d91a1a}-0.03\%$
test_mod_wrap[compile] 0.5644ms 0.3988ms 2.5074 KOps/s 2.3723 KOps/s $\textbf{\color{#35bf28}+5.69\%}$
test_mod_wrap[compile-overhead] 8.6018ms 4.7193ms 211.8964 Ops/s 214.2118 Ops/s $\color{#d91a1a}-1.08\%$
test_mod_wrap_and_backward[eager] 1.8200ms 1.6946ms 590.1152 Ops/s 585.5085 Ops/s $\color{#35bf28}+0.79\%$
test_mod_wrap_and_backward[compile] 3.0942ms 1.6553ms 604.1260 Ops/s 647.0580 Ops/s $\textbf{\color{#d91a1a}-6.63\%}$
test_mod_wrap_and_backward[compile-overhead] 1.5317ms 1.0604ms 942.9972 Ops/s 1.0337 KOps/s $\textbf{\color{#d91a1a}-8.77\%}$
test_seq_add[eager] 0.6710ms 0.5126ms 1.9508 KOps/s 1.9507 KOps/s $+0.01\%$
test_seq_add[compile] 0.2723ms 0.1440ms 6.9445 KOps/s 6.6679 KOps/s $\color{#35bf28}+4.15\%$
test_seq_add[compile-overhead] 0.2673ms 0.1874ms 5.3355 KOps/s 5.2350 KOps/s $\color{#35bf28}+1.92\%$
test_seq_wrap[eager] 1.6029ms 1.4133ms 707.5475 Ops/s 703.2452 Ops/s $\color{#35bf28}+0.61\%$
test_seq_wrap[compile] 0.6007ms 0.4280ms 2.3367 KOps/s 2.3536 KOps/s $\color{#d91a1a}-0.72\%$
test_seq_wrap[compile-overhead] 0.3870ms 0.3030ms 3.3002 KOps/s 3.2219 KOps/s $\color{#35bf28}+2.43\%$
test_func_call_runtime[False-eager] 0.9791ms 0.7985ms 1.2523 KOps/s 1.1889 KOps/s $\textbf{\color{#35bf28}+5.34\%}$
test_func_call_runtime[False-compile] 1.1571ms 0.9942ms 1.0058 KOps/s 1.0151 KOps/s $\color{#d91a1a}-0.92\%$
test_func_call_runtime[False-compile-overhead] 0.6627ms 0.5132ms 1.9485 KOps/s 1.9292 KOps/s $\color{#35bf28}+1.00\%$
test_func_call_runtime[True-eager] 1.1312ms 1.0456ms 956.3873 Ops/s 944.2304 Ops/s $\color{#35bf28}+1.29\%$
test_func_call_runtime[True-compile] 1.1073ms 1.0093ms 990.8073 Ops/s 992.3712 Ops/s $\color{#d91a1a}-0.16\%$
test_func_call_runtime[True-compile-overhead] 0.6159ms 0.5288ms 1.8911 KOps/s 1.8704 KOps/s $\color{#35bf28}+1.11\%$
test_func_call_cm_runtime[False-eager] 0.9809ms 0.8040ms 1.2438 KOps/s 1.1895 KOps/s $\color{#35bf28}+4.57\%$
test_func_call_cm_runtime[False-compile] 1.1645ms 0.9781ms 1.0224 KOps/s 1.0212 KOps/s $\color{#35bf28}+0.11\%$
test_func_call_cm_runtime[False-compile-overhead] 0.6784ms 0.4937ms 2.0256 KOps/s 1.9989 KOps/s $\color{#35bf28}+1.34\%$
test_func_call_cm_runtime[True-eager] 1.3730ms 1.1935ms 837.8985 Ops/s 831.4420 Ops/s $\color{#35bf28}+0.78\%$
test_func_call_cm_runtime[True-compile] 1.0830ms 1.0329ms 968.1084 Ops/s 975.5721 Ops/s $\color{#d91a1a}-0.77\%$
test_func_call_cm_runtime[True-compile-overhead] 0.7097ms 0.5509ms 1.8153 KOps/s 1.7864 KOps/s $\color{#35bf28}+1.62\%$
test_vmap_func_call_cm_runtime[eager] 2.8610ms 2.3940ms 417.7058 Ops/s 419.3652 Ops/s $\color{#d91a1a}-0.40\%$
test_vmap_func_call_cm_runtime[compile] 1.2005ms 1.0378ms 963.5617 Ops/s 969.3118 Ops/s $\color{#d91a1a}-0.59\%$
test_vmap_func_call_cm_runtime[compile-overhead] 0.7009ms 0.5372ms 1.8616 KOps/s 1.8272 KOps/s $\color{#35bf28}+1.88\%$
test_distributed 2.6793ms 0.1648ms 6.0688 KOps/s 6.5820 KOps/s $\textbf{\color{#d91a1a}-7.80\%}$
test_tdmodule 0.4915ms 0.1942ms 5.1498 KOps/s 5.0501 KOps/s $\color{#35bf28}+1.97\%$
test_tdmodule_dispatch 0.4280ms 0.3719ms 2.6892 KOps/s 2.6816 KOps/s $\color{#35bf28}+0.28\%$
test_tdseq 47.1320μs 26.6804μs 37.4806 KOps/s 37.3409 KOps/s $\color{#35bf28}+0.37\%$
test_tdseq_dispatch 0.2644ms 0.2179ms 4.5891 KOps/s 4.6066 KOps/s $\color{#d91a1a}-0.38\%$
test_instantiation_functorch 2.2015ms 2.0750ms 481.9168 Ops/s 482.6034 Ops/s $\color{#d91a1a}-0.14\%$
test_exec_functorch 0.2302ms 0.1837ms 5.4448 KOps/s 5.5202 KOps/s $\color{#d91a1a}-1.37\%$
test_exec_functional_call 0.2965ms 0.1627ms 6.1462 KOps/s 6.2262 KOps/s $\color{#d91a1a}-1.28\%$
test_exec_td_decorator 0.4716ms 0.2426ms 4.1226 KOps/s 4.1663 KOps/s $\color{#d91a1a}-1.05\%$
test_vmap_mlp_speed_decorator[True-True] 1.2213ms 1.0237ms 976.8754 Ops/s 978.1613 Ops/s $\color{#d91a1a}-0.13\%$
test_vmap_mlp_speed_decorator[True-False] 1.2276ms 1.0230ms 977.5438 Ops/s 978.4009 Ops/s $\color{#d91a1a}-0.09\%$
test_vmap_mlp_speed_decorator[False-True] 0.9374ms 0.7258ms 1.3778 KOps/s 1.3868 KOps/s $\color{#d91a1a}-0.65\%$
test_vmap_mlp_speed_decorator[False-False] 0.9072ms 0.7235ms 1.3821 KOps/s 1.3846 KOps/s $\color{#d91a1a}-0.17\%$
test_vmap_transformer_speed_decorator[True-True] 21.8379ms 20.9931ms 47.6348 Ops/s 47.6509 Ops/s $\color{#d91a1a}-0.03\%$
test_vmap_transformer_speed_decorator[True-False] 21.9263ms 20.9805ms 47.6633 Ops/s 47.6666 Ops/s $-0.01\%$
test_vmap_transformer_speed_decorator[False-True] 20.8369ms 20.5926ms 48.5610 Ops/s 48.6879 Ops/s $\color{#d91a1a}-0.26\%$
test_vmap_transformer_speed_decorator[False-False] 20.7790ms 20.5703ms 48.6139 Ops/s 48.6429 Ops/s $\color{#d91a1a}-0.06\%$
test_to_module_speed[True] 1.6002ms 1.5112ms 661.7188 Ops/s 666.8713 Ops/s $\color{#d91a1a}-0.77\%$
test_to_module_speed[False] 1.5860ms 1.4941ms 669.2839 Ops/s 679.8182 Ops/s $\color{#d91a1a}-1.55\%$
test_tc_init 84.8340μs 42.8590μs 23.3323 KOps/s 22.8636 KOps/s $\color{#35bf28}+2.05\%$
test_tc_init_tensor_only 34.4520μs 9.0489μs 110.5106 KOps/s 110.1548 KOps/s $\color{#35bf28}+0.32\%$
test_tc_init_nested 0.1388ms 84.1303μs 11.8863 KOps/s 11.4061 KOps/s $\color{#35bf28}+4.21\%$
test_tc_init_many_fields 45.7220μs 14.7640μs 67.7323 KOps/s 66.4468 KOps/s $\color{#35bf28}+1.93\%$
test_tc_first_layer_tensor 19.9410μs 1.8142μs 551.2044 KOps/s 550.9824 KOps/s $\color{#35bf28}+0.04\%$
test_tc_first_layer_tensor_only 5.7036μs 0.4065μs 2.4602 MOps/s 2.5095 MOps/s $\color{#d91a1a}-1.96\%$
test_tc_first_layer_tensor_set 29.8310μs 3.9508μs 253.1144 KOps/s 252.9918 KOps/s $\color{#35bf28}+0.05\%$
test_tc_first_layer_tensor_only_set 24.7820μs 3.2457μs 308.1036 KOps/s 302.4806 KOps/s $\color{#35bf28}+1.86\%$
test_tc_first_layer_nontensor 45.3020μs 6.3869μs 156.5697 KOps/s 162.5903 KOps/s $\color{#d91a1a}-3.70\%$
test_tc_second_layer_tensor 34.6120μs 4.3746μs 228.5916 KOps/s 225.9126 KOps/s $\color{#35bf28}+1.19\%$
test_tc_second_layer_nontensor 32.5910μs 9.0304μs 110.7366 KOps/s 114.2948 KOps/s $\color{#d91a1a}-3.11\%$
test_unbind 0.2853s 14.3501ms 69.6861 Ops/s 68.5450 Ops/s $\color{#35bf28}+1.66\%$
test_full_like 4.5957ms 4.3684ms 228.9179 Ops/s 225.8037 Ops/s $\color{#35bf28}+1.38\%$
test_zeros_like 4.6967ms 4.4222ms 226.1332 Ops/s 227.6701 Ops/s $\color{#d91a1a}-0.68\%$
test_ones_like 4.6613ms 4.3611ms 229.2991 Ops/s 228.9950 Ops/s $\color{#35bf28}+0.13\%$
test_clone 7.1220ms 6.8536ms 145.9082 Ops/s 146.4600 Ops/s $\color{#d91a1a}-0.38\%$
test_squeeze 0.1803ms 14.4959μs 68.9848 KOps/s 68.7472 KOps/s $\color{#35bf28}+0.35\%$
test_unsqueeze 0.2471ms 0.1173ms 8.5263 KOps/s 8.7555 KOps/s $\color{#d91a1a}-2.62\%$
test_split 0.3035ms 0.1798ms 5.5609 KOps/s 5.5263 KOps/s $\color{#35bf28}+0.63\%$
test_permute 0.3757ms 0.2071ms 4.8289 KOps/s 4.8062 KOps/s $\color{#35bf28}+0.47\%$
test_stack 53.0976ms 52.4250ms 19.0749 Ops/s 19.1031 Ops/s $\color{#d91a1a}-0.15\%$
test_cat 52.5050ms 52.2936ms 19.1228 Ops/s 19.1181 Ops/s $\color{#35bf28}+0.02\%$
test_sequential_tensordict 0.7406ms 0.5718ms 1.7488 KOps/s 1.7439 KOps/s $\color{#35bf28}+0.28\%$
test_sequential_graph_module 0.1864ms 0.1219ms 8.2054 KOps/s 8.1941 KOps/s $\color{#35bf28}+0.14\%$
test_nested_tensordict 1.2221ms 0.8201ms 1.2194 KOps/s 1.2245 KOps/s $\color{#d91a1a}-0.42\%$
test_nested_graph_module 0.3198ms 0.1350ms 7.4100 KOps/s 7.6414 KOps/s $\color{#d91a1a}-3.03\%$

@vmoens
vmoens merged commit 7036009 into main May 24, 2026
72 of 73 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Deprecation Announces or enacts a deprecation persistent PersistentTensorDict / HDF5 store tensordict.store module tensorclass Test

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant