[Deprecation] Warn on to_module state replacement

[vmoens]

Summary

• add preserve_module_state to TensorDict.to_module with the 0.13 transition behavior: warn on unsafe plain-tensor replacement by default, allow explicit legacy behavior, and opt into the 0.14 state-preserving behavior now
• preserve destination parameter/buffer registrations in the opt-in path, including parameter requires_grad and registered buffers
• avoid extra hot-path overhead by using a sentinel pop in the fast module-write path and short-circuiting custom setattr cases where no preservation work is needed
• make legacy functional tests pass preserve_module_state=False explicitly and add coverage for warnings, opt-in preservation, explicit legacy behavior, in-place syncs, custom __setattr__, and buffers
• extend benchmarks/nn/functional_benchmarks_test.py with plain-tensor to_module variants for default, explicit legacy, and state-preserving modes

Fixes #1719

Tests

• .venv/bin/python -m pytest test/test_nn.py::TestToModule -q
• .venv/bin/python -m pytest test/test_tensordict.py::TestGeneric::test_from_modules test/test_tensordict.py::TestGeneric::test_from_modules_expand test/test_tensordict.py::TestGeneric::test_from_modules_lazy test/test_tensordict.py::TestGeneric::test_to_module_state_dict test/test_tensordict.py::TestFCD::test_modules -q
• .venv/bin/python -m pytest test/test_compile.py::TestFunctional::test_functional_error test/test_compile.py::TestFunctional::test_functional test/test_compile.py::TestFunctional::test_vmap_functional test/test_compile.py::TestExport::test_export_with_td_params -q
• .venv/bin/python -m pytest benchmarks/nn/functional_benchmarks_test.py::test_to_module_speed benchmarks/nn/functional_benchmarks_test.py::test_to_module_plain_tensor_speed --benchmark-only --benchmark-disable-gc -q
• .venv/bin/pre-commit run --files tensordict/_td.py benchmarks/nn/functional_benchmarks_test.py
• .venv/bin/pre-commit run --files tensordict/_td.py tensordict/_tensorcollection.pyi tensordict/base.py tensordict/nn/params.py tensordict/tensorclass.pyi tensordict/typedtensordict.py test/test_compile.py test/test_nn.py test/test_tensordict.py

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 341. Improved: $\large\color{#35bf28}25$. Worsened: $\large\color{#d91a1a}11$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_collector_preallocated_write[stack_out-cpu-32-2]	0.2275ms	0.1724ms	5.7996 KOps/s	5.8565 KOps/s	$\color{#d91a1a}-0.97\%$
test_collector_preallocated_write[stack_out-cpu-32-8]	0.3433ms	0.2989ms	3.3451 KOps/s	3.3509 KOps/s	$\color{#d91a1a}-0.17\%$
test_collector_preallocated_write[stack_out-cpu-32-32]	0.8353ms	0.7800ms	1.2821 KOps/s	1.2701 KOps/s	$\color{#35bf28}+0.94\%$
test_collector_preallocated_write[stack_out-cpu-4096-2]	0.4392ms	0.3476ms	2.8771 KOps/s	2.4233 KOps/s	$\textbf{\color{#35bf28}+18.73\%}$
test_collector_preallocated_write[stack_out-cpu-4096-8]	1.3112ms	1.1164ms	895.7292 Ops/s	846.4182 Ops/s	$\textbf{\color{#35bf28}+5.83\%}$
test_collector_preallocated_write[stack_out-cpu-4096-32]	7.6216ms	7.3991ms	135.1517 Ops/s	135.0636 Ops/s	$\color{#35bf28}+0.07\%$
test_collector_preallocated_write[stack_out-cuda-32-2]	0.3044ms	0.2551ms	3.9204 KOps/s	3.9343 KOps/s	$\color{#d91a1a}-0.35\%$
test_collector_preallocated_write[stack_out-cuda-32-8]	1.2862ms	0.3772ms	2.6509 KOps/s	2.6616 KOps/s	$\color{#d91a1a}-0.40\%$
test_collector_preallocated_write[stack_out-cuda-32-32]	0.9610ms	0.8298ms	1.2051 KOps/s	1.2052 KOps/s	$\color{#d91a1a}-0.01\%$
test_collector_preallocated_write[stack_out-cuda-4096-2]	0.3049ms	0.2545ms	3.9290 KOps/s	3.9315 KOps/s	$\color{#d91a1a}-0.06\%$
test_collector_preallocated_write[stack_out-cuda-4096-8]	0.4610ms	0.3783ms	2.6431 KOps/s	2.6347 KOps/s	$\color{#35bf28}+0.32\%$
test_collector_preallocated_write[stack_out-cuda-4096-32]	0.9337ms	0.8883ms	1.1258 KOps/s	1.1213 KOps/s	$\color{#35bf28}+0.39\%$
test_collector_preallocated_write[set_at_loop-cpu-32-2]	0.2960ms	0.2169ms	4.6110 KOps/s	4.6342 KOps/s	$\color{#d91a1a}-0.50\%$
test_collector_preallocated_write[set_at_loop-cpu-32-8]	0.9372ms	0.8391ms	1.1917 KOps/s	1.1917 KOps/s	$+0.01\%$
test_collector_preallocated_write[set_at_loop-cpu-32-32]	3.8313ms	3.3415ms	299.2653 Ops/s	301.3081 Ops/s	$\color{#d91a1a}-0.68\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-2]	0.4459ms	0.3674ms	2.7219 KOps/s	2.6708 KOps/s	$\color{#35bf28}+1.91\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-8]	1.9752ms	1.7166ms	582.5337 Ops/s	606.4947 Ops/s	$\color{#d91a1a}-3.95\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-32]	10.7072ms	10.4204ms	95.9655 Ops/s	96.8623 Ops/s	$\color{#d91a1a}-0.93\%$
test_collector_preallocated_write[set_at_loop-cuda-32-2]	0.4911ms	0.4052ms	2.4676 KOps/s	2.5098 KOps/s	$\color{#d91a1a}-1.68\%$
test_collector_preallocated_write[set_at_loop-cuda-32-8]	1.6881ms	1.5035ms	665.1106 Ops/s	672.2575 Ops/s	$\color{#d91a1a}-1.06\%$
test_collector_preallocated_write[set_at_loop-cuda-32-32]	6.0488ms	5.8908ms	169.7550 Ops/s	171.6006 Ops/s	$\color{#d91a1a}-1.08\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-2]	0.4864ms	0.4026ms	2.4836 KOps/s	2.4988 KOps/s	$\color{#d91a1a}-0.61\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-8]	1.5926ms	1.5079ms	663.1624 Ops/s	670.4633 Ops/s	$\color{#d91a1a}-1.09\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-32]	6.0788ms	5.9376ms	168.4175 Ops/s	171.4921 Ops/s	$\color{#d91a1a}-1.79\%$
test_collector_preallocated_write[copy_at-cpu-32-2]	0.2321ms	0.1758ms	5.6885 KOps/s	5.7026 KOps/s	$\color{#d91a1a}-0.25\%$
test_collector_preallocated_write[copy_at-cpu-32-8]	0.7480ms	0.6840ms	1.4620 KOps/s	1.4814 KOps/s	$\color{#d91a1a}-1.31\%$
test_collector_preallocated_write[copy_at-cpu-32-32]	2.9400ms	2.7013ms	370.1928 Ops/s	368.9975 Ops/s	$\color{#35bf28}+0.32\%$
test_collector_preallocated_write[copy_at-cpu-4096-2]	0.3899ms	0.3146ms	3.1782 KOps/s	3.1169 KOps/s	$\color{#35bf28}+1.97\%$
test_collector_preallocated_write[copy_at-cpu-4096-8]	1.9615ms	1.5423ms	648.3667 Ops/s	676.0974 Ops/s	$\color{#d91a1a}-4.10\%$
test_collector_preallocated_write[copy_at-cpu-4096-32]	10.9982ms	9.8142ms	101.8932 Ops/s	104.6597 Ops/s	$\color{#d91a1a}-2.64\%$
test_collector_preallocated_write[copy_at-cuda-32-2]	0.4213ms	0.3320ms	3.0117 KOps/s	3.0421 KOps/s	$\color{#d91a1a}-1.00\%$
test_collector_preallocated_write[copy_at-cuda-32-8]	1.3121ms	1.2418ms	805.2707 Ops/s	816.8787 Ops/s	$\color{#d91a1a}-1.42\%$
test_collector_preallocated_write[copy_at-cuda-32-32]	4.9669ms	4.8712ms	205.2865 Ops/s	208.9085 Ops/s	$\color{#d91a1a}-1.73\%$
test_collector_preallocated_write[copy_at-cuda-4096-2]	0.4242ms	0.3336ms	2.9981 KOps/s	3.0229 KOps/s	$\color{#d91a1a}-0.82\%$
test_collector_preallocated_write[copy_at-cuda-4096-8]	1.5907ms	1.2493ms	800.4639 Ops/s	812.0872 Ops/s	$\color{#d91a1a}-1.43\%$
test_collector_preallocated_write[copy_at-cuda-4096-32]	4.9721ms	4.8801ms	204.9135 Ops/s	207.6605 Ops/s	$\color{#d91a1a}-1.32\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-2]	0.1629ms	0.1261ms	7.9275 KOps/s	8.2516 KOps/s	$\color{#d91a1a}-3.93\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-8]	0.5440ms	0.4955ms	2.0181 KOps/s	2.0965 KOps/s	$\color{#d91a1a}-3.74\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-32]	2.0378ms	1.9739ms	506.5993 Ops/s	529.7735 Ops/s	$\color{#d91a1a}-4.37\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-2]	0.6423ms	0.2573ms	3.8858 KOps/s	3.8481 KOps/s	$\color{#35bf28}+0.98\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-8]	1.3887ms	1.2546ms	797.0354 Ops/s	831.2828 Ops/s	$\color{#d91a1a}-4.12\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-32]	9.0596ms	8.6304ms	115.8691 Ops/s	116.5691 Ops/s	$\color{#d91a1a}-0.60\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-2]	0.3415ms	0.2938ms	3.4035 KOps/s	3.5430 KOps/s	$\color{#d91a1a}-3.94\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-8]	1.1471ms	1.0961ms	912.3569 Ops/s	956.7148 Ops/s	$\color{#d91a1a}-4.64\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-32]	4.4460ms	4.2921ms	232.9886 Ops/s	243.9280 Ops/s	$\color{#d91a1a}-4.48\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-2]	0.3592ms	0.2921ms	3.4237 KOps/s	3.5443 KOps/s	$\color{#d91a1a}-3.40\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-8]	1.1903ms	1.0916ms	916.1083 Ops/s	952.6563 Ops/s	$\color{#d91a1a}-3.84\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-32]	4.3828ms	4.2922ms	232.9825 Ops/s	242.2447 Ops/s	$\color{#d91a1a}-3.82\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-128]	16.5214ms	16.3374ms	61.2092 Ops/s	61.1058 Ops/s	$\color{#35bf28}+0.17\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-256]	33.2231ms	33.0108ms	30.2931 Ops/s	30.3054 Ops/s	$\color{#d91a1a}-0.04\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-128]	86.1964ms	84.5584ms	11.8261 Ops/s	11.8517 Ops/s	$\color{#d91a1a}-0.22\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-256]	0.1994s	0.1992s	5.0201 Ops/s	5.0316 Ops/s	$\color{#d91a1a}-0.23\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-128]	13.9495ms	13.8578ms	72.1616 Ops/s	72.5097 Ops/s	$\color{#d91a1a}-0.48\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-256]	27.1585ms	26.9081ms	37.1635 Ops/s	37.0622 Ops/s	$\color{#35bf28}+0.27\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-128]	14.0546ms	13.9493ms	71.6881 Ops/s	71.5997 Ops/s	$\color{#35bf28}+0.12\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-256]	27.6981ms	27.4464ms	36.4347 Ops/s	36.4740 Ops/s	$\color{#d91a1a}-0.11\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-128]	53.0386ms	52.8280ms	18.9294 Ops/s	19.1918 Ops/s	$\color{#d91a1a}-1.37\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-256]	0.1074s	0.1067s	9.3688 Ops/s	9.5113 Ops/s	$\color{#d91a1a}-1.50\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-128]	0.1470s	0.1460s	6.8514 Ops/s	6.7275 Ops/s	$\color{#35bf28}+1.84\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-256]	0.3191s	0.3185s	3.1399 Ops/s	3.0967 Ops/s	$\color{#35bf28}+1.40\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-128]	76.3870ms	75.9309ms	13.1699 Ops/s	12.9248 Ops/s	$\color{#35bf28}+1.90\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-256]	0.1524s	0.1518s	6.5894 Ops/s	6.6287 Ops/s	$\color{#d91a1a}-0.59\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-128]	80.4800ms	77.4510ms	12.9114 Ops/s	13.1331 Ops/s	$\color{#d91a1a}-1.69\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-256]	0.1538s	0.1533s	6.5248 Ops/s	6.5461 Ops/s	$\color{#d91a1a}-0.33\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-128]	31.0900ms	30.9353ms	32.3255 Ops/s	32.5865 Ops/s	$\color{#d91a1a}-0.80\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-256]	62.9323ms	62.5948ms	15.9758 Ops/s	16.2037 Ops/s	$\color{#d91a1a}-1.41\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-128]	0.1189s	0.1187s	8.4243 Ops/s	8.4343 Ops/s	$\color{#d91a1a}-0.12\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-256]	0.2672s	0.2665s	3.7524 Ops/s	3.7423 Ops/s	$\color{#35bf28}+0.27\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-128]	44.6175ms	44.4245ms	22.5101 Ops/s	22.8291 Ops/s	$\color{#d91a1a}-1.40\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-256]	89.4689ms	88.7311ms	11.2700 Ops/s	11.4629 Ops/s	$\color{#d91a1a}-1.68\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-128]	44.7891ms	44.5033ms	22.4702 Ops/s	22.6795 Ops/s	$\color{#d91a1a}-0.92\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-256]	89.3911ms	89.2633ms	11.2028 Ops/s	11.3479 Ops/s	$\color{#d91a1a}-1.28\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-128]	21.4848ms	21.3073ms	46.9324 Ops/s	48.3896 Ops/s	$\color{#d91a1a}-3.01\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-256]	43.8112ms	43.4973ms	22.9899 Ops/s	23.5554 Ops/s	$\color{#d91a1a}-2.40\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-128]	0.1096s	0.1083s	9.2337 Ops/s	9.1327 Ops/s	$\color{#35bf28}+1.11\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-256]	0.2436s	0.2429s	4.1165 Ops/s	4.1652 Ops/s	$\color{#d91a1a}-1.17\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-128]	38.9338ms	38.6457ms	25.8761 Ops/s	26.5796 Ops/s	$\color{#d91a1a}-2.65\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-256]	78.2636ms	77.7674ms	12.8589 Ops/s	13.3121 Ops/s	$\color{#d91a1a}-3.40\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-128]	39.1131ms	38.6914ms	25.8456 Ops/s	26.4626 Ops/s	$\color{#d91a1a}-2.33\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-256]	78.1875ms	77.8119ms	12.8515 Ops/s	13.3133 Ops/s	$\color{#d91a1a}-3.47\%$
test_plain_set_nested	51.7530μs	15.6946μs	63.7160 KOps/s	64.9905 KOps/s	$\color{#d91a1a}-1.96\%$
test_plain_set_stack_nested	33.9520μs	15.3427μs	65.1775 KOps/s	65.6149 KOps/s	$\color{#d91a1a}-0.67\%$
test_plain_set_nested_inplace	51.5430μs	17.1288μs	58.3811 KOps/s	58.3597 KOps/s	$\color{#35bf28}+0.04\%$
test_plain_set_stack_nested_inplace	38.6820μs	16.8794μs	59.2439 KOps/s	59.6561 KOps/s	$\color{#d91a1a}-0.69\%$
test_items	31.7710μs	6.0440μs	165.4540 KOps/s	165.6669 KOps/s	$\color{#d91a1a}-0.13\%$
test_items_nested	0.5169ms	0.4621ms	2.1642 KOps/s	2.1212 KOps/s	$\color{#35bf28}+2.03\%$
test_items_nested_locked	0.5167ms	0.4625ms	2.1623 KOps/s	2.1218 KOps/s	$\color{#35bf28}+1.90\%$
test_items_nested_leaf	0.1221ms	97.2077μs	10.2872 KOps/s	10.2887 KOps/s	$\color{#d91a1a}-0.01\%$
test_items_stack_nested	0.5470ms	0.4605ms	2.1716 KOps/s	2.1255 KOps/s	$\color{#35bf28}+2.17\%$
test_items_stack_nested_leaf	0.1257ms	97.4310μs	10.2637 KOps/s	10.3316 KOps/s	$\color{#d91a1a}-0.66\%$
test_items_stack_nested_locked	0.5056ms	0.4682ms	2.1359 KOps/s	2.0910 KOps/s	$\color{#35bf28}+2.15\%$
test_keys	27.5010μs	4.2376μs	235.9828 KOps/s	233.9049 KOps/s	$\color{#35bf28}+0.89\%$
test_keys_nested	0.1806ms	0.1302ms	7.6819 KOps/s	7.6608 KOps/s	$\color{#35bf28}+0.28\%$
test_keys_nested_locked	0.7434ms	0.1377ms	7.2601 KOps/s	7.1822 KOps/s	$\color{#35bf28}+1.08\%$
test_keys_nested_leaf	0.1618ms	0.1204ms	8.3089 KOps/s	8.2035 KOps/s	$\color{#35bf28}+1.29\%$
test_keys_stack_nested	0.1590ms	0.1293ms	7.7333 KOps/s	7.6623 KOps/s	$\color{#35bf28}+0.93\%$
test_keys_stack_nested_leaf	0.1781ms	0.1204ms	8.3023 KOps/s	8.2956 KOps/s	$\color{#35bf28}+0.08\%$
test_keys_stack_nested_locked	0.1906ms	0.1389ms	7.1997 KOps/s	7.2049 KOps/s	$\color{#d91a1a}-0.07\%$
test_values	6.1404μs	1.0246μs	976.0319 KOps/s	972.8238 KOps/s	$\color{#35bf28}+0.33\%$
test_values_nested	85.6650μs	52.7351μs	18.9627 KOps/s	18.8119 KOps/s	$\color{#35bf28}+0.80\%$
test_values_nested_locked	95.5160μs	56.5933μs	17.6699 KOps/s	17.6843 KOps/s	$\color{#d91a1a}-0.08\%$
test_values_nested_leaf	83.0650μs	60.6980μs	16.4750 KOps/s	16.4784 KOps/s	$\color{#d91a1a}-0.02\%$
test_values_stack_nested	91.3950μs	52.3599μs	19.0986 KOps/s	19.1062 KOps/s	$\color{#d91a1a}-0.04\%$
test_values_stack_nested_leaf	88.8660μs	59.8507μs	16.7082 KOps/s	16.5690 KOps/s	$\color{#35bf28}+0.84\%$
test_values_stack_nested_locked	95.8560μs	55.4825μs	18.0237 KOps/s	17.9219 KOps/s	$\color{#35bf28}+0.57\%$
test_membership	4.7687μs	0.8450μs	1.1834 MOps/s	1.1652 MOps/s	$\color{#35bf28}+1.56\%$
test_membership_nested	35.0420μs	2.9872μs	334.7608 KOps/s	328.5635 KOps/s	$\color{#35bf28}+1.89\%$
test_membership_nested_leaf	26.2920μs	3.0004μs	333.2940 KOps/s	327.9931 KOps/s	$\color{#35bf28}+1.62\%$
test_membership_stacked_nested	44.5730μs	2.8924μs	345.7287 KOps/s	347.0135 KOps/s	$\color{#d91a1a}-0.37\%$
test_membership_stacked_nested_leaf	18.9510μs	2.8599μs	349.6642 KOps/s	344.1554 KOps/s	$\color{#35bf28}+1.60\%$
test_membership_nested_last	31.5220μs	4.4678μs	223.8249 KOps/s	221.2908 KOps/s	$\color{#35bf28}+1.15\%$
test_membership_nested_leaf_last	23.8920μs	4.4789μs	223.2713 KOps/s	222.1428 KOps/s	$\color{#35bf28}+0.51\%$
test_membership_stacked_nested_last	50.8430μs	4.3786μs	228.3814 KOps/s	228.2648 KOps/s	$\color{#35bf28}+0.05\%$
test_membership_stacked_nested_leaf_last	35.4720μs	4.3294μs	230.9778 KOps/s	228.5833 KOps/s	$\color{#35bf28}+1.05\%$
test_nested_getleaf	47.2730μs	21.6437μs	46.2028 KOps/s	45.8274 KOps/s	$\color{#35bf28}+0.82\%$
test_nested_get	47.7220μs	20.6342μs	48.4632 KOps/s	48.2735 KOps/s	$\color{#35bf28}+0.39\%$
test_stacked_getleaf	53.5730μs	21.5244μs	46.4588 KOps/s	45.7652 KOps/s	$\color{#35bf28}+1.52\%$
test_stacked_get	46.6620μs	20.3676μs	49.0976 KOps/s	48.6116 KOps/s	$\color{#35bf28}+1.00\%$
test_nested_getitemleaf	67.2340μs	22.1616μs	45.1230 KOps/s	44.7232 KOps/s	$\color{#35bf28}+0.89\%$
test_nested_getitem	48.5620μs	20.7771μs	48.1299 KOps/s	47.2382 KOps/s	$\color{#35bf28}+1.89\%$
test_stacked_getitemleaf	52.9030μs	21.8287μs	45.8113 KOps/s	45.1917 KOps/s	$\color{#35bf28}+1.37\%$
test_stacked_getitem	55.0730μs	20.6063μs	48.5289 KOps/s	47.1870 KOps/s	$\color{#35bf28}+2.84\%$
test_lock_nested	0.6097ms	0.5101ms	1.9604 KOps/s	1.9745 KOps/s	$\color{#d91a1a}-0.72\%$
test_lock_stack_nested	0.5902ms	0.5166ms	1.9357 KOps/s	1.9723 KOps/s	$\color{#d91a1a}-1.86\%$
test_unlock_nested	0.4826ms	0.4058ms	2.4642 KOps/s	2.5400 KOps/s	$\color{#d91a1a}-2.98\%$
test_unlock_stack_nested	0.4681ms	0.4086ms	2.4474 KOps/s	2.5102 KOps/s	$\color{#d91a1a}-2.50\%$
test_flatten_speed	0.1830ms	0.1228ms	8.1431 KOps/s	8.0500 KOps/s	$\color{#35bf28}+1.16\%$
test_unflatten_speed	0.6833ms	0.5749ms	1.7395 KOps/s	1.7380 KOps/s	$\color{#35bf28}+0.09\%$
test_common_ops	0.1001s	1.8004ms	555.4268 Ops/s	253.9100 Ops/s	$\textbf{\color{#35bf28}+118.75\%}$
test_creation	66.4740μs	3.1925μs	313.2360 KOps/s	322.7796 KOps/s	$\color{#d91a1a}-2.96\%$
test_creation_empty	34.9520μs	7.0435μs	141.9754 KOps/s	142.1318 KOps/s	$\color{#d91a1a}-0.11\%$
test_creation_nested_1	34.7620μs	11.5190μs	86.8130 KOps/s	85.7559 KOps/s	$\color{#35bf28}+1.23\%$
test_creation_nested_2	39.6320μs	13.6100μs	73.4751 KOps/s	73.0003 KOps/s	$\color{#35bf28}+0.65\%$
test_creation_many_keys[10]	45.0230μs	21.1613μs	47.2562 KOps/s	46.8334 KOps/s	$\color{#35bf28}+0.90\%$
test_creation_many_keys[50]	0.1666ms	91.3016μs	10.9527 KOps/s	10.8990 KOps/s	$\color{#35bf28}+0.49\%$
test_creation_many_keys[100]	0.2179ms	0.1806ms	5.5366 KOps/s	5.5533 KOps/s	$\color{#d91a1a}-0.30\%$
test_creation_nested_many_keys[10]	69.2350μs	45.4482μs	22.0031 KOps/s	21.8101 KOps/s	$\color{#35bf28}+0.88\%$
test_creation_nested_many_keys[50]	0.2304ms	0.1878ms	5.3258 KOps/s	5.3336 KOps/s	$\color{#d91a1a}-0.15\%$
test_clone	31.7810μs	13.7355μs	72.8042 KOps/s	73.4643 KOps/s	$\color{#d91a1a}-0.90\%$
test_getitem[int]	1.4886ms	15.6634μs	63.8430 KOps/s	65.3058 KOps/s	$\color{#d91a1a}-2.24\%$
test_getitem[slice_int]	0.1460ms	24.9011μs	40.1588 KOps/s	40.9075 KOps/s	$\color{#d91a1a}-1.83\%$
test_getitem[range]	0.1981ms	66.1659μs	15.1135 KOps/s	15.2954 KOps/s	$\color{#d91a1a}-1.19\%$
test_getitem[tuple]	0.1450ms	24.9043μs	40.1537 KOps/s	41.0743 KOps/s	$\color{#d91a1a}-2.24\%$
test_getitem[list]	0.1845ms	60.0142μs	16.6627 KOps/s	16.7327 KOps/s	$\color{#d91a1a}-0.42\%$
test_setitem_dim[int]	44.8120μs	25.8652μs	38.6620 KOps/s	38.9964 KOps/s	$\color{#d91a1a}-0.86\%$
test_setitem_dim[slice_int]	64.8440μs	42.2513μs	23.6679 KOps/s	22.9131 KOps/s	$\color{#35bf28}+3.29\%$
test_setitem_dim[range]	0.1223ms	96.1141μs	10.4043 KOps/s	10.4375 KOps/s	$\color{#d91a1a}-0.32\%$
test_setitem_dim[tuple]	70.6640μs	39.9054μs	25.0593 KOps/s	24.5229 KOps/s	$\color{#35bf28}+2.19\%$
test_setitem	51.5830μs	18.1655μs	55.0493 KOps/s	55.3987 KOps/s	$\color{#d91a1a}-0.63\%$
test_set	55.2130μs	17.7752μs	56.2581 KOps/s	58.8540 KOps/s	$\color{#d91a1a}-4.41\%$
test_set_shared	0.4976ms	0.2138ms	4.6766 KOps/s	4.7823 KOps/s	$\color{#d91a1a}-2.21\%$
test_update	0.2008ms	22.8511μs	43.7616 KOps/s	44.9249 KOps/s	$\color{#d91a1a}-2.59\%$
test_update_nested	88.3750μs	34.4365μs	29.0389 KOps/s	29.6866 KOps/s	$\color{#d91a1a}-2.18\%$
test_update__nested	0.4733ms	33.9638μs	29.4431 KOps/s	29.7889 KOps/s	$\color{#d91a1a}-1.16\%$
test_set_nested	44.9530μs	19.1640μs	52.1811 KOps/s	51.7807 KOps/s	$\color{#35bf28}+0.77\%$
test_set_nested_new	55.4130μs	24.5222μs	40.7793 KOps/s	41.6047 KOps/s	$\color{#d91a1a}-1.98\%$
test_select	0.1129ms	40.8301μs	24.4917 KOps/s	24.4420 KOps/s	$\color{#35bf28}+0.20\%$
test_select_nested	0.1128ms	75.1428μs	13.3080 KOps/s	13.3467 KOps/s	$\color{#d91a1a}-0.29\%$
test_exclude_nested	0.1200ms	92.4335μs	10.8186 KOps/s	10.8563 KOps/s	$\color{#d91a1a}-0.35\%$
test_empty[True]	0.4724ms	0.3990ms	2.5063 KOps/s	2.4862 KOps/s	$\color{#35bf28}+0.81\%$
test_empty[False]	9.4807μs	1.4269μs	700.7960 KOps/s	712.1166 KOps/s	$\color{#d91a1a}-1.59\%$
test_to	0.1004ms	69.2526μs	14.4399 KOps/s	14.0979 KOps/s	$\color{#35bf28}+2.43\%$
test_to_nonblocking	0.1222ms	69.1584μs	14.4596 KOps/s	14.2980 KOps/s	$\color{#35bf28}+1.13\%$
test_unbind_speed	2.1913ms	0.3485ms	2.8694 KOps/s	2.9718 KOps/s	$\color{#d91a1a}-3.45\%$
test_unbind_speed_stack0	0.4557ms	0.3404ms	2.9378 KOps/s	3.0386 KOps/s	$\color{#d91a1a}-3.32\%$
test_unbind_speed_stack1	0.1157s	0.8709ms	1.1482 KOps/s	1.1664 KOps/s	$\color{#d91a1a}-1.56\%$
test_split	1.2153ms	1.1558ms	865.1654 Ops/s	696.9599 Ops/s	$\textbf{\color{#35bf28}+24.13\%}$
test_chunk	0.1154s	1.2388ms	807.2209 Ops/s	917.9819 Ops/s	$\textbf{\color{#d91a1a}-12.07\%}$
test_to_cpu_blocking	20.4536ms	20.3416ms	49.1603 Ops/s	48.5502 Ops/s	$\color{#35bf28}+1.26\%$
test_to_cpu_global_sync	12.2192ms	12.1015ms	82.6346 Ops/s	83.1352 Ops/s	$\color{#d91a1a}-0.60\%$
test_to_cpu_event_sync	13.5260ms	13.1770ms	75.8896 Ops/s	76.8999 Ops/s	$\color{#d91a1a}-1.31\%$
test_to_cpu_default	13.5119ms	13.1731ms	75.9121 Ops/s	68.4708 Ops/s	$\textbf{\color{#35bf28}+10.87\%}$
test_consolidate[False-None]	0.1453s	4.8707ms	205.3088 Ops/s	238.4381 Ops/s	$\textbf{\color{#d91a1a}-13.89\%}$
test_consolidate[default-None]	3.6320ms	2.2701ms	440.5168 Ops/s	451.6383 Ops/s	$\color{#d91a1a}-2.46\%$
test_consolidate[reduce-overhead-None]	3.6555ms	2.1726ms	460.2763 Ops/s	468.9568 Ops/s	$\color{#d91a1a}-1.85\%$
test_consolidate_njt[False-None]	0.2085s	10.3472ms	96.6443 Ops/s	114.0989 Ops/s	$\textbf{\color{#d91a1a}-15.30\%}$
test_to[False-False-None]	2.6478ms	2.2223ms	449.9920 Ops/s	453.6994 Ops/s	$\color{#d91a1a}-0.82\%$
test_to[True-False-None]	2.4350ms	2.0020ms	499.5009 Ops/s	521.0309 Ops/s	$\color{#d91a1a}-4.13\%$
test_to[within-False-None]	6.8128ms	6.3856ms	156.6034 Ops/s	160.4458 Ops/s	$\color{#d91a1a}-2.39\%$
test_to[True-default-None]	11.7664ms	10.8759ms	91.9460 Ops/s	90.8866 Ops/s	$\color{#35bf28}+1.17\%$
test_to_njt[False-False-None]	9.1702ms	8.9558ms	111.6599 Ops/s	112.6133 Ops/s	$\color{#d91a1a}-0.85\%$
test_to_njt[True-False-None]	7.4144ms	6.9980ms	142.8986 Ops/s	139.7775 Ops/s	$\color{#35bf28}+2.23\%$
test_to_njt[within-False-None]	16.2896ms	15.7523ms	63.4829 Ops/s	62.4255 Ops/s	$\color{#35bf28}+1.69\%$
test_creation[device0]	0.6742ms	0.1185ms	8.4384 KOps/s	8.5305 KOps/s	$\color{#d91a1a}-1.08\%$
test_creation_from_tensor	0.4117ms	0.1197ms	8.3562 KOps/s	8.7597 KOps/s	$\color{#d91a1a}-4.61\%$
test_add_one[memmap_tensor0]	0.1938ms	7.0149μs	142.5544 KOps/s	143.7661 KOps/s	$\color{#d91a1a}-0.84\%$
test_contiguous[memmap_tensor0]	25.6120μs	0.6616μs	1.5116 MOps/s	2.2176 MOps/s	$\textbf{\color{#d91a1a}-31.84\%}$
test_stack[memmap_tensor0]	32.9320μs	4.5075μs	221.8541 KOps/s	233.0996 KOps/s	$\color{#d91a1a}-4.82\%$
test_memmaptd_index	1.1632ms	0.2909ms	3.4381 KOps/s	3.5867 KOps/s	$\color{#d91a1a}-4.14\%$
test_memmaptd_index_astensor	0.5513ms	0.3984ms	2.5099 KOps/s	2.6012 KOps/s	$\color{#d91a1a}-3.51\%$
test_memmaptd_index_op	0.8456ms	0.6622ms	1.5101 KOps/s	1.5326 KOps/s	$\color{#d91a1a}-1.47\%$
test_serialize_model	0.1367s	0.1355s	7.3799 Ops/s	7.3494 Ops/s	$\color{#35bf28}+0.41\%$
test_serialize_model_pickle	1.3532s	1.2106s	0.8261 Ops/s	0.8268 Ops/s	$\color{#d91a1a}-0.09\%$
test_serialize_weights	0.1370s	0.1343s	7.4471 Ops/s	7.4734 Ops/s	$\color{#d91a1a}-0.35\%$
test_serialize_weights_returnearly	0.4564s	91.8318ms	10.8895 Ops/s	15.1224 Ops/s	$\textbf{\color{#d91a1a}-27.99\%}$
test_serialize_weights_pickle	1.3595s	1.2118s	0.8252 Ops/s	0.8260 Ops/s	$\color{#d91a1a}-0.09\%$
test_reshape_pytree	0.2125ms	33.3787μs	29.9592 KOps/s	30.4584 KOps/s	$\color{#d91a1a}-1.64\%$
test_reshape_td	77.2150μs	46.5713μs	21.4725 KOps/s	22.0100 KOps/s	$\color{#d91a1a}-2.44\%$
test_view_pytree	0.2058ms	32.8428μs	30.4480 KOps/s	30.9430 KOps/s	$\color{#d91a1a}-1.60\%$
test_view_td	85.5750μs	55.3141μs	18.0786 KOps/s	17.9475 KOps/s	$\color{#35bf28}+0.73\%$
test_unbind_pytree	0.2431ms	37.0437μs	26.9952 KOps/s	26.9328 KOps/s	$\color{#35bf28}+0.23\%$
test_unbind_td	87.0360μs	51.4113μs	19.4510 KOps/s	19.2545 KOps/s	$\color{#35bf28}+1.02\%$
test_split_pytree	0.1887ms	43.6614μs	22.9035 KOps/s	22.1107 KOps/s	$\color{#35bf28}+3.59\%$
test_split_td	0.2102ms	65.2399μs	15.3280 KOps/s	14.8597 KOps/s	$\color{#35bf28}+3.15\%$
test_add_pytree	0.1931ms	42.0261μs	23.7947 KOps/s	22.5496 KOps/s	$\textbf{\color{#35bf28}+5.52\%}$
test_add_td	83.7150μs	55.6199μs	17.9792 KOps/s	16.3166 KOps/s	$\textbf{\color{#35bf28}+10.19\%}$
test_compile_add_one_nested[tensordict-compile]	0.4284ms	0.2235ms	4.4752 KOps/s	4.1879 KOps/s	$\textbf{\color{#35bf28}+6.86\%}$
test_compile_add_one_nested[tensordict-eager]	0.3198ms	0.2065ms	4.8437 KOps/s	4.8612 KOps/s	$\color{#d91a1a}-0.36\%$
test_compile_add_one_nested[pytree-compile]	0.3210ms	0.1351ms	7.4030 KOps/s	6.9404 KOps/s	$\textbf{\color{#35bf28}+6.67\%}$
test_compile_add_one_nested[pytree-eager]	0.4254ms	0.1799ms	5.5581 KOps/s	5.4870 KOps/s	$\color{#35bf28}+1.30\%$
test_compile_copy_nested[tensordict-compile]	83.3050μs	15.5142μs	64.4569 KOps/s	64.0526 KOps/s	$\color{#35bf28}+0.63\%$
test_compile_copy_nested[tensordict-eager]	0.2940ms	53.2294μs	18.7866 KOps/s	18.5422 KOps/s	$\color{#35bf28}+1.32\%$
test_compile_copy_nested[pytree-compile]	0.1170ms	15.6276μs	63.9893 KOps/s	63.4895 KOps/s	$\color{#35bf28}+0.79\%$
test_compile_copy_nested[pytree-eager]	0.3790ms	67.4914μs	14.8167 KOps/s	14.7019 KOps/s	$\color{#35bf28}+0.78\%$
test_compile_add_one_flat[tensordict-compile]	0.3573ms	0.2496ms	4.0061 KOps/s	3.6480 KOps/s	$\textbf{\color{#35bf28}+9.82\%}$
test_compile_add_one_flat[tensordict-eager]	0.3422ms	0.2853ms	3.5050 KOps/s	3.4724 KOps/s	$\color{#35bf28}+0.94\%$
test_compile_add_one_flat[tensorclass-compile]	0.3852ms	0.1849ms	5.4089 KOps/s	4.8285 KOps/s	$\textbf{\color{#35bf28}+12.02\%}$
test_compile_add_one_flat[tensorclass-eager]	0.1159ms	76.2154μs	13.1207 KOps/s	13.1723 KOps/s	$\color{#d91a1a}-0.39\%$
test_compile_add_one_flat[pytree-compile]	0.4544ms	0.1922ms	5.2041 KOps/s	4.7281 KOps/s	$\textbf{\color{#35bf28}+10.07\%}$
test_compile_add_one_flat[pytree-eager]	0.8921ms	0.5343ms	1.8715 KOps/s	1.8400 KOps/s	$\color{#35bf28}+1.71\%$
test_compile_add_self_flat[tensordict-eager]	0.4929ms	0.3341ms	2.9931 KOps/s	2.9903 KOps/s	$\color{#35bf28}+0.09\%$
test_compile_add_self_flat[tensordict-compile]	0.5802ms	0.2500ms	3.9995 KOps/s	3.6563 KOps/s	$\textbf{\color{#35bf28}+9.39\%}$
test_compile_add_self_flat[tensorclass-eager]	0.1544ms	92.4311μs	10.8189 KOps/s	10.5243 KOps/s	$\color{#35bf28}+2.80\%$
test_compile_add_self_flat[tensorclass-compile]	0.3617ms	0.1868ms	5.3530 KOps/s	4.8578 KOps/s	$\textbf{\color{#35bf28}+10.19\%}$
test_compile_add_self_flat[pytree-eager]	0.6505ms	0.4401ms	2.2725 KOps/s	2.2517 KOps/s	$\color{#35bf28}+0.92\%$
test_compile_add_self_flat[pytree-compile]	0.5497ms	0.1928ms	5.1869 KOps/s	4.9568 KOps/s	$\color{#35bf28}+4.64\%$
test_compile_copy_flat[tensordict-compile]	53.8230μs	19.6909μs	50.7850 KOps/s	46.8197 KOps/s	$\textbf{\color{#35bf28}+8.47\%}$
test_compile_copy_flat[tensordict-eager]	77.0440μs	42.2393μs	23.6746 KOps/s	24.0045 KOps/s	$\color{#d91a1a}-1.37\%$
test_compile_copy_flat[pytree-compile]	0.2360ms	21.4032μs	46.7220 KOps/s	43.8471 KOps/s	$\textbf{\color{#35bf28}+6.56\%}$
test_compile_copy_flat[pytree-eager]	0.3357ms	52.0908μs	19.1972 KOps/s	19.0730 KOps/s	$\color{#35bf28}+0.65\%$
test_compile_assign_and_add[tensordict-compile]	2.1990ms	0.2383ms	4.1967 KOps/s	3.8980 KOps/s	$\textbf{\color{#35bf28}+7.66\%}$
test_compile_assign_and_add[tensordict-eager]	3.5019ms	3.3587ms	297.7355 Ops/s	298.6422 Ops/s	$\color{#d91a1a}-0.30\%$
test_compile_assign_and_add[pytree-compile]	2.0928ms	0.1795ms	5.5709 KOps/s	5.4194 KOps/s	$\color{#35bf28}+2.80\%$
test_compile_assign_and_add[pytree-eager]	2.9875ms	2.8655ms	348.9848 Ops/s	351.1604 Ops/s	$\color{#d91a1a}-0.62\%$
test_compile_indexing[tensor-tensordict-compile]	0.3260ms	0.1343ms	7.4478 KOps/s	7.0837 KOps/s	$\textbf{\color{#35bf28}+5.14\%}$
test_compile_indexing[tensor-tensordict-eager]	0.3246ms	79.4756μs	12.5825 KOps/s	13.2036 KOps/s	$\color{#d91a1a}-4.70\%$
test_compile_indexing[tensor-tensorclass-compile]	0.2583ms	0.1190ms	8.4001 KOps/s	8.2910 KOps/s	$\color{#35bf28}+1.32\%$
test_compile_indexing[tensor-tensorclass-eager]	0.2560ms	48.0335μs	20.8188 KOps/s	20.8229 KOps/s	$\color{#d91a1a}-0.02\%$
test_compile_indexing[tensor-pytree-compile]	0.2778ms	0.1258ms	7.9482 KOps/s	8.1633 KOps/s	$\color{#d91a1a}-2.63\%$
test_compile_indexing[tensor-pytree-eager]	0.3101ms	47.8950μs	20.8790 KOps/s	21.8947 KOps/s	$\color{#d91a1a}-4.64\%$
test_compile_indexing[slice-tensordict-compile]	0.2076ms	84.8923μs	11.7796 KOps/s	11.4734 KOps/s	$\color{#35bf28}+2.67\%$
test_compile_indexing[slice-tensordict-eager]	0.2149ms	29.6320μs	33.7473 KOps/s	35.5057 KOps/s	$\color{#d91a1a}-4.95\%$
test_compile_indexing[slice-tensorclass-compile]	0.1829ms	73.6796μs	13.5723 KOps/s	14.1227 KOps/s	$\color{#d91a1a}-3.90\%$
test_compile_indexing[slice-tensorclass-eager]	0.2310ms	22.4722μs	44.4994 KOps/s	44.0979 KOps/s	$\color{#35bf28}+0.91\%$
test_compile_indexing[slice-pytree-compile]	0.1464ms	74.1950μs	13.4780 KOps/s	14.1280 KOps/s	$\color{#d91a1a}-4.60\%$
test_compile_indexing[slice-pytree-eager]	0.2318ms	22.3904μs	44.6621 KOps/s	44.4514 KOps/s	$\color{#35bf28}+0.47\%$
test_compile_indexing[int-tensordict-compile]	0.1228ms	86.8024μs	11.5204 KOps/s	11.1141 KOps/s	$\color{#35bf28}+3.66\%$
test_compile_indexing[int-tensordict-eager]	0.2493ms	27.5392μs	36.3119 KOps/s	36.1448 KOps/s	$\color{#35bf28}+0.46\%$
test_compile_indexing[int-tensorclass-compile]	0.1290ms	71.4860μs	13.9887 KOps/s	13.7946 KOps/s	$\color{#35bf28}+1.41\%$
test_compile_indexing[int-tensorclass-eager]	0.2406ms	22.3295μs	44.7838 KOps/s	44.4741 KOps/s	$\color{#35bf28}+0.70\%$
test_compile_indexing[int-pytree-compile]	0.1864ms	73.6844μs	13.5714 KOps/s	14.0554 KOps/s	$\color{#d91a1a}-3.44\%$
test_compile_indexing[int-pytree-eager]	0.2394ms	22.1254μs	45.1970 KOps/s	44.7565 KOps/s	$\color{#35bf28}+0.98\%$
test_compile_replace[single-eager]	0.1012ms	50.0241μs	19.9904 KOps/s	20.5954 KOps/s	$\color{#d91a1a}-2.94\%$
test_compile_replace[single-compile]	0.2352ms	0.1362ms	7.3412 KOps/s	7.5405 KOps/s	$\color{#d91a1a}-2.64\%$
test_compile_replace[multi-eager]	0.7213ms	0.5937ms	1.6843 KOps/s	1.7472 KOps/s	$\color{#d91a1a}-3.60\%$
test_compile_replace[multi-compile]	0.2727ms	0.1410ms	7.0918 KOps/s	6.8297 KOps/s	$\color{#35bf28}+3.84\%$
test_compile_tc_getattr_20[eager]	0.3222ms	0.1723ms	5.8029 KOps/s	5.9825 KOps/s	$\color{#d91a1a}-3.00\%$
test_compile_tc_getattr_20[compile]	0.3512ms	0.1478ms	6.7636 KOps/s	6.2829 KOps/s	$\textbf{\color{#35bf28}+7.65\%}$
test_compile_clone_shallow[20-eager]	48.3630μs	19.2292μs	52.0043 KOps/s	52.4362 KOps/s	$\color{#d91a1a}-0.82\%$
test_compile_clone_shallow[20-compile]	79.4140μs	17.1904μs	58.1719 KOps/s	58.3446 KOps/s	$\color{#d91a1a}-0.30\%$
test_compile_clone_shallow[40-eager]	0.1059ms	34.0187μs	29.3956 KOps/s	29.5420 KOps/s	$\color{#d91a1a}-0.50\%$
test_compile_clone_shallow[40-compile]	0.1549ms	18.3074μs	54.6228 KOps/s	50.3070 KOps/s	$\textbf{\color{#35bf28}+8.58\%}$
test_compile_clone_shallow[80-eager]	96.4760μs	63.0648μs	15.8567 KOps/s	15.7305 KOps/s	$\color{#35bf28}+0.80\%$
test_compile_clone_shallow[80-compile]	0.1155ms	21.6453μs	46.1995 KOps/s	40.0104 KOps/s	$\textbf{\color{#35bf28}+15.47\%}$
test_compile_update_inplace[eager]	0.2093ms	61.1590μs	16.3508 KOps/s	16.3359 KOps/s	$\color{#35bf28}+0.09\%$
test_compile_update_inplace[compile]	0.3845ms	0.1464ms	6.8302 KOps/s	6.5480 KOps/s	$\color{#35bf28}+4.31\%$
test_mod_add[eager]	0.2932ms	0.2294ms	4.3589 KOps/s	4.3330 KOps/s	$\color{#35bf28}+0.60\%$
test_mod_add[compile]	0.3429ms	0.1321ms	7.5687 KOps/s	7.3582 KOps/s	$\color{#35bf28}+2.86\%$
test_mod_add[compile-overhead]	0.3460ms	0.1855ms	5.3903 KOps/s	5.4967 KOps/s	$\color{#d91a1a}-1.94\%$
test_mod_wrap[eager]	0.5514ms	0.4738ms	2.1107 KOps/s	2.0932 KOps/s	$\color{#35bf28}+0.84\%$
test_mod_wrap[compile]	0.8356ms	0.3965ms	2.5220 KOps/s	2.4261 KOps/s	$\color{#35bf28}+3.95\%$
test_mod_wrap[compile-overhead]	8.5466ms	4.6930ms	213.0826 Ops/s	215.9523 Ops/s	$\color{#d91a1a}-1.33\%$
test_mod_wrap_and_backward[eager]	2.2792ms	1.8532ms	539.6143 Ops/s	581.5008 Ops/s	$\textbf{\color{#d91a1a}-7.20\%}$
test_mod_wrap_and_backward[compile]	2.2683ms	1.6028ms	623.9102 Ops/s	636.5600 Ops/s	$\color{#d91a1a}-1.99\%$
test_mod_wrap_and_backward[compile-overhead]	1.3509ms	0.9458ms	1.0573 KOps/s	1.0283 KOps/s	$\color{#35bf28}+2.82\%$
test_seq_add[eager]	0.6046ms	0.5139ms	1.9461 KOps/s	1.9210 KOps/s	$\color{#35bf28}+1.30\%$
test_seq_add[compile]	0.2419ms	0.1424ms	7.0227 KOps/s	6.4461 KOps/s	$\textbf{\color{#35bf28}+8.95\%}$
test_seq_add[compile-overhead]	0.2908ms	0.1839ms	5.4380 KOps/s	5.0059 KOps/s	$\textbf{\color{#35bf28}+8.63\%}$
test_seq_wrap[eager]	1.6133ms	1.4452ms	691.9391 Ops/s	700.9611 Ops/s	$\color{#d91a1a}-1.29\%$
test_seq_wrap[compile]	0.5834ms	0.4163ms	2.4022 KOps/s	2.3364 KOps/s	$\color{#35bf28}+2.82\%$
test_seq_wrap[compile-overhead]	0.7557ms	0.3050ms	3.2787 KOps/s	3.1401 KOps/s	$\color{#35bf28}+4.41\%$
test_func_call_runtime[False-eager]	1.2545ms	0.8079ms	1.2377 KOps/s	1.2337 KOps/s	$\color{#35bf28}+0.32\%$
test_func_call_runtime[False-compile]	1.5371ms	0.9895ms	1.0106 KOps/s	997.4710 Ops/s	$\color{#35bf28}+1.32\%$
test_func_call_runtime[False-compile-overhead]	0.5733ms	0.5114ms	1.9552 KOps/s	1.9136 KOps/s	$\color{#35bf28}+2.18\%$
test_func_call_runtime[True-eager]	1.5459ms	1.0862ms	920.6358 Ops/s	945.3784 Ops/s	$\color{#d91a1a}-2.62\%$
test_func_call_runtime[True-compile]	1.4716ms	1.0068ms	993.2118 Ops/s	973.4315 Ops/s	$\color{#35bf28}+2.03\%$
test_func_call_runtime[True-compile-overhead]	0.6177ms	0.5284ms	1.8926 KOps/s	1.8537 KOps/s	$\color{#35bf28}+2.10\%$
test_func_call_cm_runtime[False-eager]	1.3204ms	0.8440ms	1.1849 KOps/s	1.2311 KOps/s	$\color{#d91a1a}-3.75\%$
test_func_call_cm_runtime[False-compile]	1.1525ms	0.9858ms	1.0144 KOps/s	1.0155 KOps/s	$\color{#d91a1a}-0.10\%$
test_func_call_cm_runtime[False-compile-overhead]	0.6242ms	0.4961ms	2.0158 KOps/s	1.9919 KOps/s	$\color{#35bf28}+1.20\%$
test_func_call_cm_runtime[True-eager]	1.6637ms	1.2207ms	819.2171 Ops/s	818.1202 Ops/s	$\color{#35bf28}+0.13\%$
test_func_call_cm_runtime[True-compile]	1.4610ms	1.0264ms	974.2354 Ops/s	960.0852 Ops/s	$\color{#35bf28}+1.47\%$
test_func_call_cm_runtime[True-compile-overhead]	1.0048ms	0.5521ms	1.8112 KOps/s	1.7817 KOps/s	$\color{#35bf28}+1.66\%$
test_vmap_func_call_cm_runtime[eager]	2.9020ms	2.4295ms	411.6031 Ops/s	414.1818 Ops/s	$\color{#d91a1a}-0.62\%$
test_vmap_func_call_cm_runtime[compile]	3.0831ms	2.6095ms	383.2141 Ops/s	952.6887 Ops/s	$\textbf{\color{#d91a1a}-59.78\%}$
test_vmap_func_call_cm_runtime[compile-overhead]	3.1150ms	2.6048ms	383.9048 Ops/s	1.8160 KOps/s	$\textbf{\color{#d91a1a}-78.86\%}$
test_distributed	2.3596ms	0.1663ms	6.0119 KOps/s	6.0454 KOps/s	$\color{#d91a1a}-0.55\%$
test_tdmodule	0.4503ms	0.2018ms	4.9546 KOps/s	5.1344 KOps/s	$\color{#d91a1a}-3.50\%$
test_tdmodule_dispatch	0.4488ms	0.3894ms	2.5683 KOps/s	2.6574 KOps/s	$\color{#d91a1a}-3.35\%$
test_tdseq	56.1430μs	26.6549μs	37.5166 KOps/s	37.1820 KOps/s	$\color{#35bf28}+0.90\%$
test_tdseq_dispatch	0.2541ms	0.2179ms	4.5885 KOps/s	4.5534 KOps/s	$\color{#35bf28}+0.77\%$
test_instantiation_functorch	2.3366ms	2.1096ms	474.0194 Ops/s	478.4187 Ops/s	$\color{#d91a1a}-0.92\%$
test_exec_functorch	0.2214ms	0.1844ms	5.4218 KOps/s	5.3584 KOps/s	$\color{#35bf28}+1.18\%$
test_exec_functional_call	0.2419ms	0.1678ms	5.9608 KOps/s	6.0712 KOps/s	$\color{#d91a1a}-1.82\%$
test_exec_td_decorator	0.4951ms	0.2563ms	3.9010 KOps/s	4.1422 KOps/s	$\textbf{\color{#d91a1a}-5.82\%}$
test_vmap_mlp_speed_decorator[True-True]	1.4769ms	1.0457ms	956.2554 Ops/s	959.7984 Ops/s	$\color{#d91a1a}-0.37\%$
test_vmap_mlp_speed_decorator[True-False]	1.4758ms	1.0462ms	955.8291 Ops/s	972.4794 Ops/s	$\color{#d91a1a}-1.71\%$
test_vmap_mlp_speed_decorator[False-True]	1.2009ms	0.7452ms	1.3419 KOps/s	1.3699 KOps/s	$\color{#d91a1a}-2.05\%$
test_vmap_mlp_speed_decorator[False-False]	1.1956ms	0.7427ms	1.3465 KOps/s	1.3699 KOps/s	$\color{#d91a1a}-1.71\%$
test_vmap_transformer_speed_decorator[True-True]	21.7612ms	21.3257ms	46.8919 Ops/s	47.0422 Ops/s	$\color{#d91a1a}-0.32\%$
test_vmap_transformer_speed_decorator[True-False]	22.1300ms	21.3290ms	46.8845 Ops/s	47.1054 Ops/s	$\color{#d91a1a}-0.47\%$
test_vmap_transformer_speed_decorator[False-True]	21.6479ms	20.9486ms	47.7358 Ops/s	47.7567 Ops/s	$\color{#d91a1a}-0.04\%$
test_vmap_transformer_speed_decorator[False-False]	21.3597ms	20.9427ms	47.7494 Ops/s	47.9400 Ops/s	$\color{#d91a1a}-0.40\%$
test_to_module_speed[True]	1.7540ms	1.6649ms	600.6446 Ops/s	665.0028 Ops/s	$\textbf{\color{#d91a1a}-9.68\%}$
test_to_module_speed[False]	1.7305ms	1.6445ms	608.1059 Ops/s	683.4945 Ops/s	$\textbf{\color{#d91a1a}-11.03\%}$
test_tc_init	82.6350μs	42.6891μs	23.4252 KOps/s	22.3304 KOps/s	$\color{#35bf28}+4.90\%$
test_tc_init_tensor_only	35.8520μs	8.9758μs	111.4106 KOps/s	109.5222 KOps/s	$\color{#35bf28}+1.72\%$
test_tc_init_nested	0.5168ms	84.5100μs	11.8329 KOps/s	11.5272 KOps/s	$\color{#35bf28}+2.65\%$
test_tc_init_many_fields	42.0320μs	14.9201μs	67.0239 KOps/s	67.2609 KOps/s	$\color{#d91a1a}-0.35\%$
test_tc_first_layer_tensor	21.4620μs	1.8262μs	547.5714 KOps/s	546.2766 KOps/s	$\color{#35bf28}+0.24\%$
test_tc_first_layer_tensor_only	35.9596μs	0.3979μs	2.5132 MOps/s	2.4630 MOps/s	$\color{#35bf28}+2.04\%$
test_tc_first_layer_tensor_set	24.4710μs	3.9378μs	253.9465 KOps/s	250.1098 KOps/s	$\color{#35bf28}+1.53\%$
test_tc_first_layer_tensor_only_set	19.1410μs	3.2923μs	303.7423 KOps/s	304.4801 KOps/s	$\color{#d91a1a}-0.24\%$
test_tc_first_layer_nontensor	28.2110μs	6.1907μs	161.5316 KOps/s	155.7874 KOps/s	$\color{#35bf28}+3.69\%$
test_tc_second_layer_tensor	0.4455ms	4.4477μs	224.8374 KOps/s	225.2956 KOps/s	$\color{#d91a1a}-0.20\%$
test_tc_second_layer_nontensor	23.9710μs	8.7998μs	113.6392 KOps/s	110.7464 KOps/s	$\color{#35bf28}+2.61\%$
test_unbind	0.2697s	13.8773ms	72.0600 Ops/s	70.1108 Ops/s	$\color{#35bf28}+2.78\%$
test_full_like	4.5138ms	4.3438ms	230.2158 Ops/s	227.6818 Ops/s	$\color{#35bf28}+1.11\%$
test_zeros_like	4.7725ms	4.3837ms	228.1161 Ops/s	228.1504 Ops/s	$\color{#d91a1a}-0.02\%$
test_ones_like	4.7485ms	4.3911ms	227.7346 Ops/s	227.8416 Ops/s	$\color{#d91a1a}-0.05\%$
test_clone	6.9426ms	6.5361ms	152.9964 Ops/s	154.3757 Ops/s	$\color{#d91a1a}-0.89\%$
test_squeeze	0.4399ms	14.5556μs	68.7021 KOps/s	67.6728 KOps/s	$\color{#35bf28}+1.52\%$
test_unsqueeze	0.2862ms	0.1127ms	8.8730 KOps/s	8.9509 KOps/s	$\color{#d91a1a}-0.87\%$
test_split	0.6095ms	0.1844ms	5.4226 KOps/s	5.5182 KOps/s	$\color{#d91a1a}-1.73\%$
test_permute	0.2616ms	0.2076ms	4.8164 KOps/s	4.8428 KOps/s	$\color{#d91a1a}-0.55\%$
test_stack	18.4744ms	18.2292ms	54.8570 Ops/s	19.6271 Ops/s	$\textbf{\color{#35bf28}+179.50\%}$
test_cat	18.9682ms	18.3743ms	54.4237 Ops/s	22.8282 Ops/s	$\textbf{\color{#35bf28}+138.41\%}$
test_sequential_tensordict	1.0210ms	0.5792ms	1.7266 KOps/s	1.7170 KOps/s	$\color{#35bf28}+0.56\%$
test_sequential_graph_module	0.3156ms	0.1219ms	8.2019 KOps/s	8.3524 KOps/s	$\color{#d91a1a}-1.80\%$
test_nested_tensordict	1.0059ms	0.8313ms	1.2030 KOps/s	1.2071 KOps/s	$\color{#d91a1a}-0.34\%$
test_nested_graph_module	0.5797ms	0.1361ms	7.3475 KOps/s	7.5033 KOps/s	$\color{#d91a1a}-2.08\%$

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 341. Improved: $\large\color{#35bf28}21$. Worsened: $\large\color{#d91a1a}22$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_collector_preallocated_write[stack_out-cpu-32-2]	0.2507ms	0.1685ms	5.9341 KOps/s	5.9289 KOps/s	$\color{#35bf28}+0.09\%$
test_collector_preallocated_write[stack_out-cpu-32-8]	0.3672ms	0.2976ms	3.3605 KOps/s	3.3733 KOps/s	$\color{#d91a1a}-0.38\%$
test_collector_preallocated_write[stack_out-cpu-32-32]	0.8596ms	0.7831ms	1.2770 KOps/s	1.2791 KOps/s	$\color{#d91a1a}-0.16\%$
test_collector_preallocated_write[stack_out-cpu-4096-2]	0.4377ms	0.3460ms	2.8904 KOps/s	2.9373 KOps/s	$\color{#d91a1a}-1.60\%$
test_collector_preallocated_write[stack_out-cpu-4096-8]	1.3359ms	1.1423ms	875.4166 Ops/s	920.8044 Ops/s	$\color{#d91a1a}-4.93\%$
test_collector_preallocated_write[stack_out-cpu-4096-32]	7.7631ms	7.2684ms	137.5813 Ops/s	137.5256 Ops/s	$\color{#35bf28}+0.04\%$
test_collector_preallocated_write[stack_out-cuda-32-2]	0.2916ms	0.2522ms	3.9649 KOps/s	3.9834 KOps/s	$\color{#d91a1a}-0.47\%$
test_collector_preallocated_write[stack_out-cuda-32-8]	0.4632ms	0.3762ms	2.6583 KOps/s	2.6904 KOps/s	$\color{#d91a1a}-1.19\%$
test_collector_preallocated_write[stack_out-cuda-32-32]	0.9176ms	0.8286ms	1.2068 KOps/s	1.2219 KOps/s	$\color{#d91a1a}-1.23\%$
test_collector_preallocated_write[stack_out-cuda-4096-2]	0.3253ms	0.2529ms	3.9546 KOps/s	4.0124 KOps/s	$\color{#d91a1a}-1.44\%$
test_collector_preallocated_write[stack_out-cuda-4096-8]	0.4698ms	0.3774ms	2.6499 KOps/s	2.6780 KOps/s	$\color{#d91a1a}-1.05\%$
test_collector_preallocated_write[stack_out-cuda-4096-32]	0.9735ms	0.8891ms	1.1248 KOps/s	1.1272 KOps/s	$\color{#d91a1a}-0.22\%$
test_collector_preallocated_write[set_at_loop-cpu-32-2]	0.2913ms	0.2200ms	4.5459 KOps/s	4.6102 KOps/s	$\color{#d91a1a}-1.39\%$
test_collector_preallocated_write[set_at_loop-cpu-32-8]	0.9517ms	0.8525ms	1.1730 KOps/s	1.1891 KOps/s	$\color{#d91a1a}-1.36\%$
test_collector_preallocated_write[set_at_loop-cpu-32-32]	3.5655ms	3.3928ms	294.7415 Ops/s	302.5426 Ops/s	$\color{#d91a1a}-2.58\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-2]	0.5057ms	0.3644ms	2.7443 KOps/s	2.6891 KOps/s	$\color{#35bf28}+2.05\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-8]	1.8571ms	1.7063ms	586.0503 Ops/s	603.4064 Ops/s	$\color{#d91a1a}-2.88\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-32]	10.6926ms	10.3622ms	96.5050 Ops/s	97.1622 Ops/s	$\color{#d91a1a}-0.68\%$
test_collector_preallocated_write[set_at_loop-cuda-32-2]	0.4417ms	0.3990ms	2.5060 KOps/s	2.5140 KOps/s	$\color{#d91a1a}-0.32\%$
test_collector_preallocated_write[set_at_loop-cuda-32-8]	1.5725ms	1.4818ms	674.8410 Ops/s	672.9188 Ops/s	$\color{#35bf28}+0.29\%$
test_collector_preallocated_write[set_at_loop-cuda-32-32]	5.9324ms	5.8278ms	171.5927 Ops/s	170.8350 Ops/s	$\color{#35bf28}+0.44\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-2]	0.4509ms	0.3984ms	2.5102 KOps/s	2.5069 KOps/s	$\color{#35bf28}+0.13\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-8]	1.6248ms	1.4941ms	669.3161 Ops/s	676.0699 Ops/s	$\color{#d91a1a}-1.00\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-32]	5.9862ms	5.8545ms	170.8080 Ops/s	171.7645 Ops/s	$\color{#d91a1a}-0.56\%$
test_collector_preallocated_write[copy_at-cpu-32-2]	0.2422ms	0.1760ms	5.6816 KOps/s	5.7571 KOps/s	$\color{#d91a1a}-1.31\%$
test_collector_preallocated_write[copy_at-cpu-32-8]	0.7790ms	0.6876ms	1.4542 KOps/s	1.4703 KOps/s	$\color{#d91a1a}-1.09\%$
test_collector_preallocated_write[copy_at-cpu-32-32]	2.8182ms	2.7216ms	367.4269 Ops/s	369.0888 Ops/s	$\color{#d91a1a}-0.45\%$
test_collector_preallocated_write[copy_at-cpu-4096-2]	0.3966ms	0.3151ms	3.1732 KOps/s	3.1886 KOps/s	$\color{#d91a1a}-0.48\%$
test_collector_preallocated_write[copy_at-cpu-4096-8]	2.0302ms	1.5386ms	649.9414 Ops/s	673.0455 Ops/s	$\color{#d91a1a}-3.43\%$
test_collector_preallocated_write[copy_at-cpu-4096-32]	9.6727ms	9.4752ms	105.5392 Ops/s	106.4603 Ops/s	$\color{#d91a1a}-0.87\%$
test_collector_preallocated_write[copy_at-cuda-32-2]	0.4861ms	0.3332ms	3.0010 KOps/s	3.0264 KOps/s	$\color{#d91a1a}-0.84\%$
test_collector_preallocated_write[copy_at-cuda-32-8]	1.3281ms	1.2429ms	804.5580 Ops/s	825.3079 Ops/s	$\color{#d91a1a}-2.51\%$
test_collector_preallocated_write[copy_at-cuda-32-32]	4.9399ms	4.8745ms	205.1493 Ops/s	210.7064 Ops/s	$\color{#d91a1a}-2.64\%$
test_collector_preallocated_write[copy_at-cuda-4096-2]	0.3901ms	0.3346ms	2.9889 KOps/s	3.0483 KOps/s	$\color{#d91a1a}-1.95\%$
test_collector_preallocated_write[copy_at-cuda-4096-8]	1.3389ms	1.2555ms	796.4751 Ops/s	818.8709 Ops/s	$\color{#d91a1a}-2.73\%$
test_collector_preallocated_write[copy_at-cuda-4096-32]	4.9738ms	4.8959ms	204.2506 Ops/s	209.7155 Ops/s	$\color{#d91a1a}-2.61\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-2]	0.1771ms	0.1269ms	7.8830 KOps/s	8.4146 KOps/s	$\textbf{\color{#d91a1a}-6.32\%}$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-8]	0.5641ms	0.4971ms	2.0115 KOps/s	2.1389 KOps/s	$\textbf{\color{#d91a1a}-5.95\%}$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-32]	2.0795ms	1.9627ms	509.5105 Ops/s	536.6271 Ops/s	$\textbf{\color{#d91a1a}-5.05\%}$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-2]	0.3583ms	0.2663ms	3.7545 KOps/s	3.8995 KOps/s	$\color{#d91a1a}-3.72\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-8]	1.4296ms	1.2506ms	799.5959 Ops/s	827.0522 Ops/s	$\color{#d91a1a}-3.32\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-32]	8.8489ms	8.6809ms	115.1961 Ops/s	117.9152 Ops/s	$\color{#d91a1a}-2.31\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-2]	0.3474ms	0.2896ms	3.4525 KOps/s	3.5931 KOps/s	$\color{#d91a1a}-3.91\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-8]	1.1801ms	1.0810ms	925.0856 Ops/s	966.4990 Ops/s	$\color{#d91a1a}-4.28\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-32]	4.2963ms	4.2142ms	237.2948 Ops/s	247.5479 Ops/s	$\color{#d91a1a}-4.14\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-2]	0.3649ms	0.2897ms	3.4520 KOps/s	3.6095 KOps/s	$\color{#d91a1a}-4.36\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-8]	1.1527ms	1.0804ms	925.6115 Ops/s	963.6006 Ops/s	$\color{#d91a1a}-3.94\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-32]	4.3126ms	4.2165ms	237.1644 Ops/s	246.1216 Ops/s	$\color{#d91a1a}-3.64\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-128]	16.5820ms	16.4126ms	60.9289 Ops/s	61.4418 Ops/s	$\color{#d91a1a}-0.83\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-256]	33.1497ms	32.9905ms	30.3118 Ops/s	30.4113 Ops/s	$\color{#d91a1a}-0.33\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-128]	84.4281ms	83.6826ms	11.9499 Ops/s	12.0001 Ops/s	$\color{#d91a1a}-0.42\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-256]	0.1992s	0.1986s	5.0363 Ops/s	5.0810 Ops/s	$\color{#d91a1a}-0.88\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-128]	14.0129ms	13.8757ms	72.0685 Ops/s	72.7816 Ops/s	$\color{#d91a1a}-0.98\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-256]	27.1993ms	27.0316ms	36.9937 Ops/s	37.2058 Ops/s	$\color{#d91a1a}-0.57\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-128]	14.1184ms	13.9798ms	71.5318 Ops/s	71.9959 Ops/s	$\color{#d91a1a}-0.64\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-256]	28.3347ms	27.3466ms	36.5676 Ops/s	36.5681 Ops/s	$-0.00\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-128]	53.5661ms	53.0564ms	18.8479 Ops/s	19.0866 Ops/s	$\color{#d91a1a}-1.25\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-256]	0.1069s	0.1065s	9.3895 Ops/s	9.4723 Ops/s	$\color{#d91a1a}-0.87\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-128]	0.1464s	0.1459s	6.8562 Ops/s	6.9230 Ops/s	$\color{#d91a1a}-0.97\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-256]	0.3208s	0.3203s	3.1220 Ops/s	3.1099 Ops/s	$\color{#35bf28}+0.39\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-128]	76.0822ms	75.2563ms	13.2879 Ops/s	13.3035 Ops/s	$\color{#d91a1a}-0.12\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-256]	0.1517s	0.1506s	6.6395 Ops/s	6.5913 Ops/s	$\color{#35bf28}+0.73\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-128]	76.4685ms	75.7585ms	13.1998 Ops/s	13.2989 Ops/s	$\color{#d91a1a}-0.75\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-256]	0.1521s	0.1514s	6.6028 Ops/s	6.6520 Ops/s	$\color{#d91a1a}-0.74\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-128]	30.9681ms	30.7668ms	32.5025 Ops/s	32.9175 Ops/s	$\color{#d91a1a}-1.26\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-256]	62.3294ms	62.1375ms	16.0933 Ops/s	16.2746 Ops/s	$\color{#d91a1a}-1.11\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-128]	0.1212s	0.1203s	8.3107 Ops/s	8.2989 Ops/s	$\color{#35bf28}+0.14\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-256]	0.2697s	0.2692s	3.7154 Ops/s	3.7209 Ops/s	$\color{#d91a1a}-0.15\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-128]	44.6310ms	44.4429ms	22.5008 Ops/s	23.1498 Ops/s	$\color{#d91a1a}-2.80\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-256]	89.5186ms	89.1212ms	11.2207 Ops/s	11.5859 Ops/s	$\color{#d91a1a}-3.15\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-128]	44.9442ms	44.7941ms	22.3244 Ops/s	23.0029 Ops/s	$\color{#d91a1a}-2.95\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-256]	90.0259ms	89.7170ms	11.1462 Ops/s	11.5252 Ops/s	$\color{#d91a1a}-3.29\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-128]	21.5369ms	21.3627ms	46.8106 Ops/s	48.9195 Ops/s	$\color{#d91a1a}-4.31\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-256]	44.1068ms	43.5175ms	22.9793 Ops/s	24.0067 Ops/s	$\color{#d91a1a}-4.28\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-128]	0.1104s	0.1090s	9.1770 Ops/s	9.3179 Ops/s	$\color{#d91a1a}-1.51\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-256]	0.2433s	0.2423s	4.1275 Ops/s	4.0325 Ops/s	$\color{#35bf28}+2.36\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-128]	38.9500ms	38.4932ms	25.9786 Ops/s	27.2707 Ops/s	$\color{#d91a1a}-4.74\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-256]	77.2617ms	77.0859ms	12.9725 Ops/s	13.6017 Ops/s	$\color{#d91a1a}-4.63\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-128]	38.7513ms	38.5214ms	25.9596 Ops/s	26.9583 Ops/s	$\color{#d91a1a}-3.70\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-256]	77.7343ms	77.0522ms	12.9782 Ops/s	13.5696 Ops/s	$\color{#d91a1a}-4.36\%$
test_plain_set_nested	57.0600μs	15.6524μs	63.8882 KOps/s	65.3582 KOps/s	$\color{#d91a1a}-2.25\%$
test_plain_set_stack_nested	31.1800μs	15.2268μs	65.6735 KOps/s	65.9311 KOps/s	$\color{#d91a1a}-0.39\%$
test_plain_set_nested_inplace	43.7910μs	16.8388μs	59.3868 KOps/s	59.2964 KOps/s	$\color{#35bf28}+0.15\%$
test_plain_set_stack_nested_inplace	47.7610μs	16.7255μs	59.7888 KOps/s	60.0829 KOps/s	$\color{#d91a1a}-0.49\%$
test_items	31.5600μs	6.0874μs	164.2750 KOps/s	167.7353 KOps/s	$\color{#d91a1a}-2.06\%$
test_items_nested	0.5585ms	0.4693ms	2.1308 KOps/s	2.1577 KOps/s	$\color{#d91a1a}-1.25\%$
test_items_nested_locked	0.5310ms	0.4698ms	2.1284 KOps/s	2.1627 KOps/s	$\color{#d91a1a}-1.59\%$
test_items_nested_leaf	0.1364ms	97.1933μs	10.2888 KOps/s	10.3610 KOps/s	$\color{#d91a1a}-0.70\%$
test_items_stack_nested	0.4920ms	0.4632ms	2.1589 KOps/s	2.1580 KOps/s	$\color{#35bf28}+0.04\%$
test_items_stack_nested_leaf	0.1532ms	98.5581μs	10.1463 KOps/s	10.2607 KOps/s	$\color{#d91a1a}-1.12\%$
test_items_stack_nested_locked	0.5686ms	0.4690ms	2.1323 KOps/s	2.1495 KOps/s	$\color{#d91a1a}-0.80\%$
test_keys	33.7800μs	4.2204μs	236.9469 KOps/s	239.7391 KOps/s	$\color{#d91a1a}-1.16\%$
test_keys_nested	0.1812ms	0.1292ms	7.7406 KOps/s	7.6634 KOps/s	$\color{#35bf28}+1.01\%$
test_keys_nested_locked	0.7424ms	0.1378ms	7.2583 KOps/s	7.2089 KOps/s	$\color{#35bf28}+0.69\%$
test_keys_nested_leaf	0.1581ms	0.1217ms	8.2183 KOps/s	8.2533 KOps/s	$\color{#d91a1a}-0.42\%$
test_keys_stack_nested	0.1805ms	0.1304ms	7.6659 KOps/s	7.6304 KOps/s	$\color{#35bf28}+0.47\%$
test_keys_stack_nested_leaf	0.1611ms	0.1198ms	8.3461 KOps/s	8.2271 KOps/s	$\color{#35bf28}+1.45\%$
test_keys_stack_nested_locked	0.1866ms	0.1387ms	7.2108 KOps/s	7.2195 KOps/s	$\color{#d91a1a}-0.12\%$
test_values	13.6562μs	1.0100μs	990.1109 KOps/s	941.4542 KOps/s	$\textbf{\color{#35bf28}+5.17\%}$
test_values_nested	81.7310μs	52.8506μs	18.9213 KOps/s	18.6925 KOps/s	$\color{#35bf28}+1.22\%$
test_values_nested_locked	96.7220μs	56.3814μs	17.7363 KOps/s	17.5927 KOps/s	$\color{#35bf28}+0.82\%$
test_values_nested_leaf	0.1011ms	60.1952μs	16.6126 KOps/s	16.5527 KOps/s	$\color{#35bf28}+0.36\%$
test_values_stack_nested	0.1232ms	52.7382μs	18.9616 KOps/s	18.8510 KOps/s	$\color{#35bf28}+0.59\%$
test_values_stack_nested_leaf	91.6920μs	60.0277μs	16.6590 KOps/s	16.5420 KOps/s	$\color{#35bf28}+0.71\%$
test_values_stack_nested_locked	86.5810μs	56.2089μs	17.7908 KOps/s	17.7653 KOps/s	$\color{#35bf28}+0.14\%$
test_membership	6.1868μs	0.8414μs	1.1886 MOps/s	1.2132 MOps/s	$\color{#d91a1a}-2.03\%$
test_membership_nested	30.9510μs	2.9989μs	333.4526 KOps/s	337.9204 KOps/s	$\color{#d91a1a}-1.32\%$
test_membership_nested_leaf	64.3010μs	2.9929μs	334.1190 KOps/s	350.6675 KOps/s	$\color{#d91a1a}-4.72\%$
test_membership_stacked_nested	28.4010μs	2.8990μs	344.9502 KOps/s	349.3644 KOps/s	$\color{#d91a1a}-1.26\%$
test_membership_stacked_nested_leaf	30.4600μs	2.8961μs	345.2886 KOps/s	348.3454 KOps/s	$\color{#d91a1a}-0.88\%$
test_membership_nested_last	44.7500μs	4.4917μs	222.6351 KOps/s	223.3099 KOps/s	$\color{#d91a1a}-0.30\%$
test_membership_nested_leaf_last	35.9710μs	4.4914μs	222.6466 KOps/s	225.8161 KOps/s	$\color{#d91a1a}-1.40\%$
test_membership_stacked_nested_last	53.4610μs	4.4134μs	226.5810 KOps/s	229.9006 KOps/s	$\color{#d91a1a}-1.44\%$
test_membership_stacked_nested_leaf_last	36.5910μs	4.3629μs	229.2056 KOps/s	234.8100 KOps/s	$\color{#d91a1a}-2.39\%$
test_nested_getleaf	49.8110μs	21.7769μs	45.9201 KOps/s	46.5552 KOps/s	$\color{#d91a1a}-1.36\%$
test_nested_get	88.9910μs	20.5923μs	48.5619 KOps/s	49.5858 KOps/s	$\color{#d91a1a}-2.06\%$
test_stacked_getleaf	54.2910μs	21.6177μs	46.2583 KOps/s	46.9264 KOps/s	$\color{#d91a1a}-1.42\%$
test_stacked_get	51.0010μs	20.5280μs	48.7140 KOps/s	49.7453 KOps/s	$\color{#d91a1a}-2.07\%$
test_nested_getitemleaf	50.9500μs	22.2225μs	44.9995 KOps/s	46.1658 KOps/s	$\color{#d91a1a}-2.53\%$
test_nested_getitem	51.6910μs	20.9938μs	47.6332 KOps/s	48.0909 KOps/s	$\color{#d91a1a}-0.95\%$
test_stacked_getitemleaf	48.6010μs	22.0235μs	45.4060 KOps/s	46.0234 KOps/s	$\color{#d91a1a}-1.34\%$
test_stacked_getitem	59.2810μs	20.9817μs	47.6605 KOps/s	48.4712 KOps/s	$\color{#d91a1a}-1.67\%$
test_lock_nested	0.6041ms	0.5130ms	1.9495 KOps/s	1.9579 KOps/s	$\color{#d91a1a}-0.43\%$
test_lock_stack_nested	0.5768ms	0.5184ms	1.9290 KOps/s	1.9496 KOps/s	$\color{#d91a1a}-1.06\%$
test_unlock_nested	0.4777ms	0.4077ms	2.4529 KOps/s	2.4931 KOps/s	$\color{#d91a1a}-1.61\%$
test_unlock_stack_nested	0.4561ms	0.4122ms	2.4260 KOps/s	2.4533 KOps/s	$\color{#d91a1a}-1.11\%$
test_flatten_speed	0.1757ms	0.1224ms	8.1724 KOps/s	8.1765 KOps/s	$\color{#d91a1a}-0.05\%$
test_unflatten_speed	0.6610ms	0.5760ms	1.7360 KOps/s	1.7683 KOps/s	$\color{#d91a1a}-1.83\%$
test_common_ops	0.1001s	1.7893ms	558.8770 Ops/s	271.9672 Ops/s	$\textbf{\color{#35bf28}+105.49\%}$
test_creation	98.9410μs	3.1494μs	317.5257 KOps/s	319.0036 KOps/s	$\color{#d91a1a}-0.46\%$
test_creation_empty	38.2010μs	7.0617μs	141.6083 KOps/s	142.1840 KOps/s	$\color{#d91a1a}-0.40\%$
test_creation_nested_1	38.8910μs	11.5788μs	86.3646 KOps/s	86.6674 KOps/s	$\color{#d91a1a}-0.35\%$
test_creation_nested_2	35.7300μs	13.6844μs	73.0758 KOps/s	74.0211 KOps/s	$\color{#d91a1a}-1.28\%$
test_creation_many_keys[10]	47.4300μs	21.1910μs	47.1898 KOps/s	47.5583 KOps/s	$\color{#d91a1a}-0.78\%$
test_creation_many_keys[50]	0.1223ms	91.7769μs	10.8960 KOps/s	10.9528 KOps/s	$\color{#d91a1a}-0.52\%$
test_creation_many_keys[100]	0.2356ms	0.1783ms	5.6079 KOps/s	5.6307 KOps/s	$\color{#d91a1a}-0.41\%$
test_creation_nested_many_keys[10]	72.3120μs	45.5462μs	21.9557 KOps/s	21.9767 KOps/s	$\color{#d91a1a}-0.10\%$
test_creation_nested_many_keys[50]	0.2584ms	0.1888ms	5.2977 KOps/s	5.4742 KOps/s	$\color{#d91a1a}-3.22\%$
test_clone	36.4000μs	13.7516μs	72.7186 KOps/s	75.1393 KOps/s	$\color{#d91a1a}-3.22\%$
test_getitem[int]	1.5006ms	15.8552μs	63.0709 KOps/s	66.0053 KOps/s	$\color{#d91a1a}-4.45\%$
test_getitem[slice_int]	0.1390ms	24.8280μs	40.2771 KOps/s	40.7119 KOps/s	$\color{#d91a1a}-1.07\%$
test_getitem[range]	0.1753ms	65.8769μs	15.1798 KOps/s	14.7096 KOps/s	$\color{#35bf28}+3.20\%$
test_getitem[tuple]	0.1435ms	24.9010μs	40.1590 KOps/s	40.7949 KOps/s	$\color{#d91a1a}-1.56\%$
test_getitem[list]	0.1941ms	60.5446μs	16.5167 KOps/s	16.8447 KOps/s	$\color{#d91a1a}-1.95\%$
test_setitem_dim[int]	46.9510μs	26.1924μs	38.1789 KOps/s	37.8362 KOps/s	$\color{#35bf28}+0.91\%$
test_setitem_dim[slice_int]	70.2510μs	43.7915μs	22.8355 KOps/s	22.6523 KOps/s	$\color{#35bf28}+0.81\%$
test_setitem_dim[range]	0.1384ms	98.6328μs	10.1386 KOps/s	10.3009 KOps/s	$\color{#d91a1a}-1.58\%$
test_setitem_dim[tuple]	60.0210μs	40.4152μs	24.7432 KOps/s	25.2922 KOps/s	$\color{#d91a1a}-2.17\%$
test_setitem	52.9610μs	18.0668μs	55.3503 KOps/s	55.9624 KOps/s	$\color{#d91a1a}-1.09\%$
test_set	44.9310μs	17.2704μs	57.9027 KOps/s	59.0044 KOps/s	$\color{#d91a1a}-1.87\%$
test_set_shared	0.4897ms	0.2114ms	4.7300 KOps/s	4.5926 KOps/s	$\color{#35bf28}+2.99\%$
test_update	0.3017ms	22.2217μs	45.0011 KOps/s	45.0008 KOps/s	$+0.00\%$
test_update_nested	71.1310μs	34.3901μs	29.0782 KOps/s	30.0529 KOps/s	$\color{#d91a1a}-3.24\%$
test_update__nested	0.5177ms	34.1651μs	29.2697 KOps/s	29.5566 KOps/s	$\color{#d91a1a}-0.97\%$
test_set_nested	45.1810μs	19.3724μs	51.6198 KOps/s	53.3858 KOps/s	$\color{#d91a1a}-3.31\%$
test_set_nested_new	61.9410μs	24.2846μs	41.1784 KOps/s	41.9513 KOps/s	$\color{#d91a1a}-1.84\%$
test_select	76.3910μs	40.9233μs	24.4360 KOps/s	25.0377 KOps/s	$\color{#d91a1a}-2.40\%$
test_select_nested	0.1008ms	75.1085μs	13.3141 KOps/s	13.4844 KOps/s	$\color{#d91a1a}-1.26\%$
test_exclude_nested	0.1373ms	92.5418μs	10.8059 KOps/s	10.9203 KOps/s	$\color{#d91a1a}-1.05\%$
test_empty[True]	0.5096ms	0.3989ms	2.5069 KOps/s	2.5032 KOps/s	$\color{#35bf28}+0.15\%$
test_empty[False]	8.0202μs	1.4063μs	711.0929 KOps/s	735.2755 KOps/s	$\color{#d91a1a}-3.29\%$
test_to	0.1003ms	70.0776μs	14.2699 KOps/s	14.4462 KOps/s	$\color{#d91a1a}-1.22\%$
test_to_nonblocking	0.1284ms	70.0252μs	14.2806 KOps/s	14.8012 KOps/s	$\color{#d91a1a}-3.52\%$
test_unbind_speed	2.0169ms	0.3549ms	2.8175 KOps/s	2.9062 KOps/s	$\color{#d91a1a}-3.05\%$
test_unbind_speed_stack0	0.4418ms	0.3455ms	2.8940 KOps/s	2.9654 KOps/s	$\color{#d91a1a}-2.41\%$
test_unbind_speed_stack1	0.1149s	0.8787ms	1.1381 KOps/s	1.1587 KOps/s	$\color{#d91a1a}-1.78\%$
test_split	1.2451ms	1.1438ms	874.3122 Ops/s	700.3599 Ops/s	$\textbf{\color{#35bf28}+24.84\%}$
test_chunk	0.1150s	1.2419ms	805.1864 Ops/s	918.7705 Ops/s	$\textbf{\color{#d91a1a}-12.36\%}$
test_to_cpu_blocking	20.2363ms	20.1733ms	49.5705 Ops/s	49.5293 Ops/s	$\color{#35bf28}+0.08\%$
test_to_cpu_global_sync	12.1534ms	12.0435ms	83.0326 Ops/s	84.5876 Ops/s	$\color{#d91a1a}-1.84\%$
test_to_cpu_event_sync	13.4494ms	13.0919ms	76.3829 Ops/s	77.6424 Ops/s	$\color{#d91a1a}-1.62\%$
test_to_cpu_default	13.5722ms	13.1158ms	76.2439 Ops/s	69.3163 Ops/s	$\textbf{\color{#35bf28}+9.99\%}$
test_consolidate[False-None]	0.1445s	4.9113ms	203.6123 Ops/s	239.5712 Ops/s	$\textbf{\color{#d91a1a}-15.01\%}$
test_consolidate[default-None]	3.5634ms	2.1987ms	454.8116 Ops/s	448.7644 Ops/s	$\color{#35bf28}+1.35\%$
test_consolidate[reduce-overhead-None]	3.5571ms	2.1208ms	471.5126 Ops/s	463.9885 Ops/s	$\color{#35bf28}+1.62\%$
test_consolidate_njt[False-None]	0.2085s	10.4898ms	95.3310 Ops/s	116.0183 Ops/s	$\textbf{\color{#d91a1a}-17.83\%}$
test_to[False-False-None]	2.6687ms	2.2186ms	450.7318 Ops/s	457.0768 Ops/s	$\color{#d91a1a}-1.39\%$
test_to[True-False-None]	2.4245ms	1.9873ms	503.1840 Ops/s	513.8085 Ops/s	$\color{#d91a1a}-2.07\%$
test_to[within-False-None]	6.7836ms	6.4277ms	155.5773 Ops/s	159.3218 Ops/s	$\color{#d91a1a}-2.35\%$
test_to[True-default-None]	11.2344ms	10.7389ms	93.1195 Ops/s	91.6673 Ops/s	$\color{#35bf28}+1.58\%$
test_to_njt[False-False-None]	9.0108ms	8.6578ms	115.5023 Ops/s	113.6235 Ops/s	$\color{#35bf28}+1.65\%$
test_to_njt[True-False-None]	7.4686ms	7.0324ms	142.1980 Ops/s	141.0592 Ops/s	$\color{#35bf28}+0.81\%$
test_to_njt[within-False-None]	15.9900ms	15.7167ms	63.6264 Ops/s	62.8651 Ops/s	$\color{#35bf28}+1.21\%$
test_creation[device0]	0.3442ms	0.1222ms	8.1804 KOps/s	8.4228 KOps/s	$\color{#d91a1a}-2.88\%$
test_creation_from_tensor	0.4408ms	0.1184ms	8.4438 KOps/s	8.6496 KOps/s	$\color{#d91a1a}-2.38\%$
test_add_one[memmap_tensor0]	0.1029ms	6.8492μs	146.0030 KOps/s	141.7120 KOps/s	$\color{#35bf28}+3.03\%$
test_contiguous[memmap_tensor0]	25.1010μs	0.6590μs	1.5173 MOps/s	2.2061 MOps/s	$\textbf{\color{#d91a1a}-31.22\%}$
test_stack[memmap_tensor0]	38.2210μs	4.4060μs	226.9651 KOps/s	236.9325 KOps/s	$\color{#d91a1a}-4.21\%$
test_memmaptd_index	1.1839ms	0.2919ms	3.4255 KOps/s	3.6359 KOps/s	$\textbf{\color{#d91a1a}-5.79\%}$
test_memmaptd_index_astensor	0.5609ms	0.4077ms	2.4530 KOps/s	2.5856 KOps/s	$\textbf{\color{#d91a1a}-5.13\%}$
test_memmaptd_index_op	0.8684ms	0.7108ms	1.4069 KOps/s	1.5159 KOps/s	$\textbf{\color{#d91a1a}-7.19\%}$
test_serialize_model	0.3239s	0.1630s	6.1334 Ops/s	7.3901 Ops/s	$\textbf{\color{#d91a1a}-17.00\%}$
test_serialize_model_pickle	1.3488s	1.2105s	0.8261 Ops/s	0.8250 Ops/s	$\color{#35bf28}+0.13\%$
test_serialize_weights	0.1376s	0.1344s	7.4421 Ops/s	7.5062 Ops/s	$\color{#d91a1a}-0.85\%$
test_serialize_weights_returnearly	0.4768s	90.8366ms	11.0088 Ops/s	6.4361 Ops/s	$\textbf{\color{#35bf28}+71.05\%}$
test_serialize_weights_pickle	1.3640s	1.2119s	0.8251 Ops/s	0.8217 Ops/s	$\color{#35bf28}+0.42\%$
test_reshape_pytree	0.2210ms	32.9660μs	30.3343 KOps/s	30.9018 KOps/s	$\color{#d91a1a}-1.84\%$
test_reshape_td	71.3010μs	46.3604μs	21.5702 KOps/s	22.3557 KOps/s	$\color{#d91a1a}-3.51\%$
test_view_pytree	0.2281ms	32.4299μs	30.8357 KOps/s	31.3420 KOps/s	$\color{#d91a1a}-1.62\%$
test_view_td	81.3810μs	54.8193μs	18.2418 KOps/s	18.5605 KOps/s	$\color{#d91a1a}-1.72\%$
test_unbind_pytree	0.2334ms	37.3943μs	26.7421 KOps/s	27.1542 KOps/s	$\color{#d91a1a}-1.52\%$
test_unbind_td	0.1757ms	52.0462μs	19.2137 KOps/s	19.5853 KOps/s	$\color{#d91a1a}-1.90\%$
test_split_pytree	0.2594ms	43.3894μs	23.0471 KOps/s	23.6031 KOps/s	$\color{#d91a1a}-2.36\%$
test_split_td	0.1941ms	67.6185μs	14.7889 KOps/s	15.4795 KOps/s	$\color{#d91a1a}-4.46\%$
test_add_pytree	0.2403ms	42.5853μs	23.4823 KOps/s	23.6758 KOps/s	$\color{#d91a1a}-0.82\%$
test_add_td	0.1003ms	56.5122μs	17.6953 KOps/s	18.1064 KOps/s	$\color{#d91a1a}-2.27\%$
test_compile_add_one_nested[tensordict-compile]	0.3317ms	0.2246ms	4.4529 KOps/s	4.1372 KOps/s	$\textbf{\color{#35bf28}+7.63\%}$
test_compile_add_one_nested[tensordict-eager]	0.3161ms	0.2037ms	4.9096 KOps/s	4.9793 KOps/s	$\color{#d91a1a}-1.40\%$
test_compile_add_one_nested[pytree-compile]	0.3025ms	0.1338ms	7.4753 KOps/s	7.1534 KOps/s	$\color{#35bf28}+4.50\%$
test_compile_add_one_nested[pytree-eager]	0.4366ms	0.1805ms	5.5392 KOps/s	5.6540 KOps/s	$\color{#d91a1a}-2.03\%$
test_compile_copy_nested[tensordict-compile]	66.1810μs	15.5861μs	64.1597 KOps/s	63.7823 KOps/s	$\color{#35bf28}+0.59\%$
test_compile_copy_nested[tensordict-eager]	0.3572ms	53.3647μs	18.7390 KOps/s	19.1390 KOps/s	$\color{#d91a1a}-2.09\%$
test_compile_copy_nested[pytree-compile]	0.1641ms	15.7334μs	63.5592 KOps/s	62.3781 KOps/s	$\color{#35bf28}+1.89\%$
test_compile_copy_nested[pytree-eager]	0.3859ms	67.4437μs	14.8272 KOps/s	14.9266 KOps/s	$\color{#d91a1a}-0.67\%$
test_compile_add_one_flat[tensordict-compile]	0.3918ms	0.2458ms	4.0687 KOps/s	3.8269 KOps/s	$\textbf{\color{#35bf28}+6.32\%}$
test_compile_add_one_flat[tensordict-eager]	0.3492ms	0.2809ms	3.5603 KOps/s	3.5030 KOps/s	$\color{#35bf28}+1.64\%$
test_compile_add_one_flat[tensorclass-compile]	0.2787ms	0.1825ms	5.4801 KOps/s	4.9927 KOps/s	$\textbf{\color{#35bf28}+9.76\%}$
test_compile_add_one_flat[tensorclass-eager]	0.1209ms	76.3460μs	13.0983 KOps/s	13.2921 KOps/s	$\color{#d91a1a}-1.46\%$
test_compile_add_one_flat[pytree-compile]	0.5188ms	0.1909ms	5.2375 KOps/s	4.9863 KOps/s	$\textbf{\color{#35bf28}+5.04\%}$
test_compile_add_one_flat[pytree-eager]	0.8249ms	0.5384ms	1.8575 KOps/s	1.9051 KOps/s	$\color{#d91a1a}-2.50\%$
test_compile_add_self_flat[tensordict-eager]	0.4687ms	0.3292ms	3.0377 KOps/s	2.9788 KOps/s	$\color{#35bf28}+1.97\%$
test_compile_add_self_flat[tensordict-compile]	0.3305ms	0.2459ms	4.0661 KOps/s	3.7158 KOps/s	$\textbf{\color{#35bf28}+9.43\%}$
test_compile_add_self_flat[tensorclass-eager]	0.1448ms	92.2648μs	10.8384 KOps/s	10.9749 KOps/s	$\color{#d91a1a}-1.24\%$
test_compile_add_self_flat[tensorclass-compile]	0.3429ms	0.1846ms	5.4178 KOps/s	5.0069 KOps/s	$\textbf{\color{#35bf28}+8.21\%}$
test_compile_add_self_flat[pytree-eager]	0.6590ms	0.4459ms	2.2426 KOps/s	2.2736 KOps/s	$\color{#d91a1a}-1.36\%$
test_compile_add_self_flat[pytree-compile]	0.4899ms	0.1913ms	5.2281 KOps/s	5.0170 KOps/s	$\color{#35bf28}+4.21\%$
test_compile_copy_flat[tensordict-compile]	64.2710μs	19.5947μs	51.0343 KOps/s	47.6599 KOps/s	$\textbf{\color{#35bf28}+7.08\%}$
test_compile_copy_flat[tensordict-eager]	76.6720μs	41.5546μs	24.0647 KOps/s	24.0347 KOps/s	$\color{#35bf28}+0.12\%$
test_compile_copy_flat[pytree-compile]	0.2762ms	21.1228μs	47.3423 KOps/s	45.0583 KOps/s	$\textbf{\color{#35bf28}+5.07\%}$
test_compile_copy_flat[pytree-eager]	0.3312ms	52.1368μs	19.1803 KOps/s	19.1320 KOps/s	$\color{#35bf28}+0.25\%$
test_compile_assign_and_add[tensordict-compile]	2.1809ms	0.2368ms	4.2233 KOps/s	3.9074 KOps/s	$\textbf{\color{#35bf28}+8.09\%}$
test_compile_assign_and_add[tensordict-eager]	3.4922ms	3.3513ms	298.3894 Ops/s	303.2611 Ops/s	$\color{#d91a1a}-1.61\%$
test_compile_assign_and_add[pytree-compile]	2.1522ms	0.1802ms	5.5504 KOps/s	5.3556 KOps/s	$\color{#35bf28}+3.64\%$
test_compile_assign_and_add[pytree-eager]	2.9971ms	2.8510ms	350.7494 Ops/s	355.8705 Ops/s	$\color{#d91a1a}-1.44\%$
test_compile_indexing[tensor-tensordict-compile]	0.2507ms	0.1338ms	7.4729 KOps/s	7.1128 KOps/s	$\textbf{\color{#35bf28}+5.06\%}$
test_compile_indexing[tensor-tensordict-eager]	0.2957ms	75.2458μs	13.2898 KOps/s	13.0709 KOps/s	$\color{#35bf28}+1.67\%$
test_compile_indexing[tensor-tensorclass-compile]	0.2611ms	0.1186ms	8.4330 KOps/s	8.3183 KOps/s	$\color{#35bf28}+1.38\%$
test_compile_indexing[tensor-tensorclass-eager]	0.2550ms	45.9738μs	21.7515 KOps/s	22.5374 KOps/s	$\color{#d91a1a}-3.49\%$
test_compile_indexing[tensor-pytree-compile]	0.1637ms	0.1191ms	8.3974 KOps/s	8.2502 KOps/s	$\color{#35bf28}+1.78\%$
test_compile_indexing[tensor-pytree-eager]	0.2332ms	45.5348μs	21.9612 KOps/s	21.9105 KOps/s	$\color{#35bf28}+0.23\%$
test_compile_indexing[slice-tensordict-compile]	0.3124ms	83.7631μs	11.9384 KOps/s	11.4395 KOps/s	$\color{#35bf28}+4.36\%$
test_compile_indexing[slice-tensordict-eager]	0.2034ms	29.1360μs	34.3218 KOps/s	35.7728 KOps/s	$\color{#d91a1a}-4.06\%$
test_compile_indexing[slice-tensorclass-compile]	0.1927ms	70.0404μs	14.2775 KOps/s	13.7416 KOps/s	$\color{#35bf28}+3.90\%$
test_compile_indexing[slice-tensorclass-eager]	0.2428ms	22.4953μs	44.4538 KOps/s	45.1375 KOps/s	$\color{#d91a1a}-1.51\%$
test_compile_indexing[slice-pytree-compile]	0.1155ms	71.3681μs	14.0119 KOps/s	13.7472 KOps/s	$\color{#35bf28}+1.93\%$
test_compile_indexing[slice-pytree-eager]	0.2430ms	22.3255μs	44.7919 KOps/s	45.1702 KOps/s	$\color{#d91a1a}-0.84\%$
test_compile_indexing[int-tensordict-compile]	0.1211ms	84.1477μs	11.8839 KOps/s	11.2591 KOps/s	$\textbf{\color{#35bf28}+5.55\%}$
test_compile_indexing[int-tensordict-eager]	0.2606ms	27.7203μs	36.0746 KOps/s	36.0010 KOps/s	$\color{#35bf28}+0.20\%$
test_compile_indexing[int-tensorclass-compile]	0.1087ms	70.8660μs	14.1111 KOps/s	13.8769 KOps/s	$\color{#35bf28}+1.69\%$
test_compile_indexing[int-tensorclass-eager]	0.2459ms	22.2790μs	44.8853 KOps/s	46.0219 KOps/s	$\color{#d91a1a}-2.47\%$
test_compile_indexing[int-pytree-compile]	0.1122ms	70.1459μs	14.2560 KOps/s	13.8115 KOps/s	$\color{#35bf28}+3.22\%$
test_compile_indexing[int-pytree-eager]	0.2412ms	22.1699μs	45.1063 KOps/s	45.9165 KOps/s	$\color{#d91a1a}-1.76\%$
test_compile_replace[single-eager]	84.2820μs	47.6229μs	20.9983 KOps/s	20.6179 KOps/s	$\color{#35bf28}+1.84\%$
test_compile_replace[single-compile]	0.2229ms	0.1296ms	7.7173 KOps/s	7.5089 KOps/s	$\color{#35bf28}+2.78\%$
test_compile_replace[multi-eager]	0.6779ms	0.5720ms	1.7481 KOps/s	1.7566 KOps/s	$\color{#d91a1a}-0.48\%$
test_compile_replace[multi-compile]	0.2857ms	0.1376ms	7.2655 KOps/s	7.0867 KOps/s	$\color{#35bf28}+2.52\%$
test_compile_tc_getattr_20[eager]	0.2242ms	0.1843ms	5.4259 KOps/s	5.9736 KOps/s	$\textbf{\color{#d91a1a}-9.17\%}$
test_compile_tc_getattr_20[compile]	0.3871ms	0.1532ms	6.5260 KOps/s	6.5531 KOps/s	$\color{#d91a1a}-0.41\%$
test_compile_clone_shallow[20-eager]	52.2210μs	19.0993μs	52.3580 KOps/s	52.2724 KOps/s	$\color{#35bf28}+0.16\%$
test_compile_clone_shallow[20-compile]	78.3910μs	16.8243μs	59.4379 KOps/s	56.5235 KOps/s	$\textbf{\color{#35bf28}+5.16\%}$
test_compile_clone_shallow[40-eager]	98.6510μs	33.4423μs	29.9022 KOps/s	29.8112 KOps/s	$\color{#35bf28}+0.31\%$
test_compile_clone_shallow[40-compile]	74.5510μs	19.3395μs	51.7077 KOps/s	51.8692 KOps/s	$\color{#d91a1a}-0.31\%$
test_compile_clone_shallow[80-eager]	91.5710μs	61.5888μs	16.2367 KOps/s	15.9721 KOps/s	$\color{#35bf28}+1.66\%$
test_compile_clone_shallow[80-compile]	92.5920μs	23.2213μs	43.0639 KOps/s	45.5404 KOps/s	$\textbf{\color{#d91a1a}-5.44\%}$
test_compile_update_inplace[eager]	0.1026ms	59.9195μs	16.6891 KOps/s	16.5654 KOps/s	$\color{#35bf28}+0.75\%$
test_compile_update_inplace[compile]	0.3553ms	0.1496ms	6.6823 KOps/s	6.6625 KOps/s	$\color{#35bf28}+0.30\%$
test_mod_add[eager]	0.2916ms	0.2324ms	4.3022 KOps/s	4.4145 KOps/s	$\color{#d91a1a}-2.55\%$
test_mod_add[compile]	0.2044ms	0.1395ms	7.1707 KOps/s	7.1419 KOps/s	$\color{#35bf28}+0.40\%$
test_mod_add[compile-overhead]	0.2608ms	0.1837ms	5.4443 KOps/s	5.4821 KOps/s	$\color{#d91a1a}-0.69\%$
test_mod_wrap[eager]	0.5819ms	0.4936ms	2.0258 KOps/s	2.1029 KOps/s	$\color{#d91a1a}-3.67\%$
test_mod_wrap[compile]	0.5425ms	0.4020ms	2.4878 KOps/s	2.4777 KOps/s	$\color{#35bf28}+0.41\%$
test_mod_wrap[compile-overhead]	8.4934ms	4.6977ms	212.8690 Ops/s	214.5185 Ops/s	$\color{#d91a1a}-0.77\%$
test_mod_wrap_and_backward[eager]	2.3026ms	1.8525ms	539.8092 Ops/s	586.5857 Ops/s	$\textbf{\color{#d91a1a}-7.97\%}$
test_mod_wrap_and_backward[compile]	2.3585ms	1.6154ms	619.0326 Ops/s	644.5972 Ops/s	$\color{#d91a1a}-3.97\%$
test_mod_wrap_and_backward[compile-overhead]	1.3328ms	0.9486ms	1.0542 KOps/s	1.0312 KOps/s	$\color{#35bf28}+2.23\%$
test_seq_add[eager]	0.5930ms	0.5094ms	1.9629 KOps/s	1.9676 KOps/s	$\color{#d91a1a}-0.24\%$
test_seq_add[compile]	0.2449ms	0.1431ms	6.9862 KOps/s	6.8227 KOps/s	$\color{#35bf28}+2.40\%$
test_seq_add[compile-overhead]	0.2512ms	0.1880ms	5.3189 KOps/s	5.2981 KOps/s	$\color{#35bf28}+0.39\%$
test_seq_wrap[eager]	1.4867ms	1.4145ms	706.9784 Ops/s	702.6108 Ops/s	$\color{#35bf28}+0.62\%$
test_seq_wrap[compile]	0.4729ms	0.4138ms	2.4164 KOps/s	2.3592 KOps/s	$\color{#35bf28}+2.43\%$
test_seq_wrap[compile-overhead]	0.3927ms	0.3042ms	3.2869 KOps/s	3.1792 KOps/s	$\color{#35bf28}+3.39\%$
test_func_call_runtime[False-eager]	0.9396ms	0.8576ms	1.1661 KOps/s	1.2562 KOps/s	$\textbf{\color{#d91a1a}-7.17\%}$
test_func_call_runtime[False-compile]	1.2078ms	1.0053ms	994.6932 Ops/s	1.0108 KOps/s	$\color{#d91a1a}-1.59\%$
test_func_call_runtime[False-compile-overhead]	0.6222ms	0.5148ms	1.9425 KOps/s	1.9199 KOps/s	$\color{#35bf28}+1.18\%$
test_func_call_runtime[True-eager]	1.1834ms	1.0736ms	931.4143 Ops/s	959.1018 Ops/s	$\color{#d91a1a}-2.89\%$
test_func_call_runtime[True-compile]	1.1280ms	1.0325ms	968.5269 Ops/s	992.4038 Ops/s	$\color{#d91a1a}-2.41\%$
test_func_call_runtime[True-compile-overhead]	0.6027ms	0.5304ms	1.8854 KOps/s	1.8613 KOps/s	$\color{#35bf28}+1.29\%$
test_func_call_cm_runtime[False-eager]	0.9572ms	0.8501ms	1.1763 KOps/s	1.2512 KOps/s	$\textbf{\color{#d91a1a}-5.99\%}$
test_func_call_cm_runtime[False-compile]	1.1438ms	0.9914ms	1.0087 KOps/s	1.0294 KOps/s	$\color{#d91a1a}-2.01\%$
test_func_call_cm_runtime[False-compile-overhead]	0.6413ms	0.4968ms	2.0131 KOps/s	2.0034 KOps/s	$\color{#35bf28}+0.48\%$
test_func_call_cm_runtime[True-eager]	1.3583ms	1.2256ms	815.9408 Ops/s	834.2120 Ops/s	$\color{#d91a1a}-2.19\%$
test_func_call_cm_runtime[True-compile]	1.1328ms	1.0648ms	939.1806 Ops/s	969.2377 Ops/s	$\color{#d91a1a}-3.10\%$
test_func_call_cm_runtime[True-compile-overhead]	0.7061ms	0.5504ms	1.8168 KOps/s	1.7753 KOps/s	$\color{#35bf28}+2.34\%$
test_vmap_func_call_cm_runtime[eager]	2.9696ms	2.4337ms	410.8907 Ops/s	413.1554 Ops/s	$\color{#d91a1a}-0.55\%$
test_vmap_func_call_cm_runtime[compile]	3.0731ms	2.6117ms	382.8925 Ops/s	968.8707 Ops/s	$\textbf{\color{#d91a1a}-60.48\%}$
test_vmap_func_call_cm_runtime[compile-overhead]	3.0885ms	2.6052ms	383.8496 Ops/s	1.8327 KOps/s	$\textbf{\color{#d91a1a}-79.06\%}$
test_distributed	0.6850ms	0.1507ms	6.6370 KOps/s	6.6323 KOps/s	$\color{#35bf28}+0.07\%$
test_tdmodule	0.6833ms	0.1940ms	5.1547 KOps/s	5.0961 KOps/s	$\color{#35bf28}+1.15\%$
test_tdmodule_dispatch	0.4488ms	0.3727ms	2.6829 KOps/s	2.6823 KOps/s	$\color{#35bf28}+0.02\%$
test_tdseq	45.4610μs	26.5862μs	37.6135 KOps/s	37.6910 KOps/s	$\color{#d91a1a}-0.21\%$
test_tdseq_dispatch	0.2571ms	0.2172ms	4.6049 KOps/s	4.6234 KOps/s	$\color{#d91a1a}-0.40\%$
test_instantiation_functorch	2.1863ms	2.0915ms	478.1301 Ops/s	480.3527 Ops/s	$\color{#d91a1a}-0.46\%$
test_exec_functorch	0.2412ms	0.1874ms	5.3366 KOps/s	5.4671 KOps/s	$\color{#d91a1a}-2.39\%$
test_exec_functional_call	0.2270ms	0.1669ms	5.9906 KOps/s	6.1814 KOps/s	$\color{#d91a1a}-3.09\%$
test_exec_td_decorator	0.4951ms	0.2544ms	3.9306 KOps/s	4.1426 KOps/s	$\textbf{\color{#d91a1a}-5.12\%}$
test_vmap_mlp_speed_decorator[True-True]	1.2244ms	1.0427ms	959.0437 Ops/s	974.2971 Ops/s	$\color{#d91a1a}-1.57\%$
test_vmap_mlp_speed_decorator[True-False]	1.2383ms	1.0406ms	960.9730 Ops/s	979.3657 Ops/s	$\color{#d91a1a}-1.88\%$
test_vmap_mlp_speed_decorator[False-True]	0.9472ms	0.7433ms	1.3453 KOps/s	1.3798 KOps/s	$\color{#d91a1a}-2.50\%$
test_vmap_mlp_speed_decorator[False-False]	0.9195ms	0.7423ms	1.3472 KOps/s	1.3819 KOps/s	$\color{#d91a1a}-2.51\%$
test_vmap_transformer_speed_decorator[True-True]	21.5677ms	21.3476ms	46.8437 Ops/s	47.3023 Ops/s	$\color{#d91a1a}-0.97\%$
test_vmap_transformer_speed_decorator[True-False]	21.4360ms	21.3152ms	46.9149 Ops/s	47.4091 Ops/s	$\color{#d91a1a}-1.04\%$
test_vmap_transformer_speed_decorator[False-True]	21.5927ms	20.9354ms	47.7660 Ops/s	48.3923 Ops/s	$\color{#d91a1a}-1.29\%$
test_vmap_transformer_speed_decorator[False-False]	21.6351ms	20.9333ms	47.7707 Ops/s	48.3104 Ops/s	$\color{#d91a1a}-1.12\%$
test_to_module_speed[True]	2.1963ms	1.6493ms	606.3221 Ops/s	665.5868 Ops/s	$\textbf{\color{#d91a1a}-8.90\%}$
test_to_module_speed[False]	2.1729ms	1.6266ms	614.7752 Ops/s	676.5385 Ops/s	$\textbf{\color{#d91a1a}-9.13\%}$
test_tc_init	70.1810μs	43.0396μs	23.2344 KOps/s	22.9631 KOps/s	$\color{#35bf28}+1.18\%$
test_tc_init_tensor_only	38.2000μs	9.0692μs	110.2638 KOps/s	111.6571 KOps/s	$\color{#d91a1a}-1.25\%$
test_tc_init_nested	0.1298ms	85.1435μs	11.7449 KOps/s	11.7672 KOps/s	$\color{#d91a1a}-0.19\%$
test_tc_init_many_fields	86.3010μs	14.8599μs	67.2952 KOps/s	67.5605 KOps/s	$\color{#d91a1a}-0.39\%$
test_tc_first_layer_tensor	15.4600μs	1.8418μs	542.9428 KOps/s	549.0746 KOps/s	$\color{#d91a1a}-1.12\%$
test_tc_first_layer_tensor_only	1.7671μs	0.4059μs	2.4639 MOps/s	2.5432 MOps/s	$\color{#d91a1a}-3.12\%$
test_tc_first_layer_tensor_set	29.0500μs	3.9894μs	250.6667 KOps/s	255.0557 KOps/s	$\color{#d91a1a}-1.72\%$
test_tc_first_layer_tensor_only_set	35.2000μs	3.3295μs	300.3486 KOps/s	305.4080 KOps/s	$\color{#d91a1a}-1.66\%$
test_tc_first_layer_nontensor	28.6810μs	6.2644μs	159.6328 KOps/s	155.8571 KOps/s	$\color{#35bf28}+2.42\%$
test_tc_second_layer_tensor	20.9510μs	4.4856μs	222.9355 KOps/s	225.1500 KOps/s	$\color{#d91a1a}-0.98\%$
test_tc_second_layer_nontensor	35.3710μs	8.5650μs	116.7539 KOps/s	110.8471 KOps/s	$\textbf{\color{#35bf28}+5.33\%}$
test_unbind	0.2693s	13.7852ms	72.5416 Ops/s	65.1455 Ops/s	$\textbf{\color{#35bf28}+11.35\%}$
test_full_like	4.4757ms	4.3684ms	228.9148 Ops/s	228.9190 Ops/s	$-0.00\%$
test_zeros_like	4.4865ms	4.3669ms	228.9967 Ops/s	229.3079 Ops/s	$\color{#d91a1a}-0.14\%$
test_ones_like	4.5053ms	4.3759ms	228.5222 Ops/s	229.0114 Ops/s	$\color{#d91a1a}-0.21\%$
test_clone	6.6944ms	6.4876ms	154.1402 Ops/s	155.4725 Ops/s	$\color{#d91a1a}-0.86\%$
test_squeeze	61.5910μs	14.4531μs	69.1894 KOps/s	69.2230 KOps/s	$\color{#d91a1a}-0.05\%$
test_unsqueeze	0.1732ms	0.1172ms	8.5346 KOps/s	8.8850 KOps/s	$\color{#d91a1a}-3.94\%$
test_split	0.3690ms	0.1828ms	5.4703 KOps/s	5.6159 KOps/s	$\color{#d91a1a}-2.59\%$
test_permute	0.2777ms	0.2211ms	4.5226 KOps/s	4.8387 KOps/s	$\textbf{\color{#d91a1a}-6.53\%}$
test_stack	18.2870ms	18.1023ms	55.2416 Ops/s	19.4424 Ops/s	$\textbf{\color{#35bf28}+184.13\%}$
test_cat	18.2116ms	18.0207ms	55.4919 Ops/s	19.4753 Ops/s	$\textbf{\color{#35bf28}+184.93\%}$
test_sequential_tensordict	0.6198ms	0.5725ms	1.7468 KOps/s	1.7016 KOps/s	$\color{#35bf28}+2.66\%$
test_sequential_graph_module	0.5194ms	0.1186ms	8.4321 KOps/s	8.1879 KOps/s	$\color{#35bf28}+2.98\%$
test_nested_tensordict	0.8953ms	0.8137ms	1.2289 KOps/s	1.2075 KOps/s	$\color{#35bf28}+1.77\%$
test_nested_graph_module	0.5356ms	0.1300ms	7.6896 KOps/s	7.4867 KOps/s	$\color{#35bf28}+2.71\%$