[BugFix] Fix UnbatchedTensor stack metadata

[vmoens]

Summary

• update UnbatchedTensor stack handling to carry TensorDict-facing batch-size metadata
• set UnbatchedTensor.batch_size in TensorDict stack/cat paths, including out=
• add regression tests for stack/cat metadata while preserving payload storage sharing

Tests

• uv run --with pytest python -m pytest test/tensordict/test_nontensor.py::TestUnbatchedTensor -q
• uv run --with pytest python -m pytest test/tensordict/test_nontensor.py -q
• uv run --with pytest python -m pytest test/compile/test_compile.py::test_vmap_compile test/compile/test_compile.py::TestGuardCount::test_unbatched_clone_no_recompile test/compile/test_compile.py::TestGuardCount::test_unbatched_clone_preserves_semantics -q
• uv run --with ruff ruff check --ignore E402 tensordict/_unbatched.py tensordict/_torch_func.py tensordict/_td.py test/tensordict/test_nontensor.py
• git diff --check -- tensordict/_unbatched.py tensordict/_torch_func.py tensordict/_td.py test/tensordict/test_nontensor.py

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 344. Improved: $\large\color{#35bf28}19$. Worsened: $\large\color{#d91a1a}11$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_collector_preallocated_write[stack_out-cpu-32-2]	0.5423ms	0.1673ms	5.9788 KOps/s	5.9608 KOps/s	$\color{#35bf28}+0.30\%$
test_collector_preallocated_write[stack_out-cpu-32-8]	0.3729ms	0.2842ms	3.5184 KOps/s	3.4826 KOps/s	$\color{#35bf28}+1.03\%$
test_collector_preallocated_write[stack_out-cpu-32-32]	0.8415ms	0.7478ms	1.3372 KOps/s	1.3230 KOps/s	$\color{#35bf28}+1.07\%$
test_collector_preallocated_write[stack_out-cpu-4096-2]	0.3701ms	0.3297ms	3.0330 KOps/s	3.0198 KOps/s	$\color{#35bf28}+0.44\%$
test_collector_preallocated_write[stack_out-cpu-4096-8]	1.2799ms	1.1018ms	907.6128 Ops/s	925.9357 Ops/s	$\color{#d91a1a}-1.98\%$
test_collector_preallocated_write[stack_out-cpu-4096-32]	7.7079ms	7.5230ms	132.9251 Ops/s	136.1551 Ops/s	$\color{#d91a1a}-2.37\%$
test_collector_preallocated_write[stack_out-cuda-32-2]	0.3503ms	0.2561ms	3.9046 KOps/s	4.1091 KOps/s	$\color{#d91a1a}-4.98\%$
test_collector_preallocated_write[stack_out-cuda-32-8]	0.4608ms	0.3688ms	2.7119 KOps/s	2.7059 KOps/s	$\color{#35bf28}+0.22\%$
test_collector_preallocated_write[stack_out-cuda-32-32]	0.8982ms	0.7965ms	1.2554 KOps/s	1.2574 KOps/s	$\color{#d91a1a}-0.16\%$
test_collector_preallocated_write[stack_out-cuda-4096-2]	0.3239ms	0.2452ms	4.0784 KOps/s	4.0668 KOps/s	$\color{#35bf28}+0.29\%$
test_collector_preallocated_write[stack_out-cuda-4096-8]	0.4219ms	0.3645ms	2.7433 KOps/s	2.6207 KOps/s	$\color{#35bf28}+4.68\%$
test_collector_preallocated_write[stack_out-cuda-4096-32]	1.0259ms	0.8619ms	1.1602 KOps/s	1.1511 KOps/s	$\color{#35bf28}+0.80\%$
test_collector_preallocated_write[set_at_loop-cpu-32-2]	0.2832ms	0.2086ms	4.7950 KOps/s	4.6270 KOps/s	$\color{#35bf28}+3.63\%$
test_collector_preallocated_write[set_at_loop-cpu-32-8]	0.9196ms	0.8206ms	1.2186 KOps/s	1.2409 KOps/s	$\color{#d91a1a}-1.80\%$
test_collector_preallocated_write[set_at_loop-cpu-32-32]	3.4429ms	3.2182ms	310.7323 Ops/s	311.1384 Ops/s	$\color{#d91a1a}-0.13\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-2]	0.4318ms	0.3761ms	2.6589 KOps/s	2.6735 KOps/s	$\color{#d91a1a}-0.55\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-8]	1.9066ms	1.6443ms	608.1779 Ops/s	622.2252 Ops/s	$\color{#d91a1a}-2.26\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-32]	10.4004ms	10.2193ms	97.8538 Ops/s	99.2938 Ops/s	$\color{#d91a1a}-1.45\%$
test_collector_preallocated_write[set_at_loop-cuda-32-2]	0.4209ms	0.3857ms	2.5929 KOps/s	2.6444 KOps/s	$\color{#d91a1a}-1.95\%$
test_collector_preallocated_write[set_at_loop-cuda-32-8]	1.6759ms	1.4349ms	696.9120 Ops/s	665.0754 Ops/s	$\color{#35bf28}+4.79\%$
test_collector_preallocated_write[set_at_loop-cuda-32-32]	5.7879ms	5.6242ms	177.8021 Ops/s	170.7628 Ops/s	$\color{#35bf28}+4.12\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-2]	0.4633ms	0.3865ms	2.5876 KOps/s	2.4764 KOps/s	$\color{#35bf28}+4.49\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-8]	1.5157ms	1.4475ms	690.8545 Ops/s	664.4009 Ops/s	$\color{#35bf28}+3.98\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-32]	5.7360ms	5.6669ms	176.4630 Ops/s	169.8482 Ops/s	$\color{#35bf28}+3.89\%$
test_collector_preallocated_write[copy_at-cpu-32-2]	0.2741ms	0.1683ms	5.9430 KOps/s	5.7847 KOps/s	$\color{#35bf28}+2.74\%$
test_collector_preallocated_write[copy_at-cpu-32-8]	0.7240ms	0.6549ms	1.5269 KOps/s	1.5373 KOps/s	$\color{#d91a1a}-0.68\%$
test_collector_preallocated_write[copy_at-cpu-32-32]	2.6533ms	2.5812ms	387.4195 Ops/s	385.7946 Ops/s	$\color{#35bf28}+0.42\%$
test_collector_preallocated_write[copy_at-cpu-4096-2]	0.4612ms	0.3055ms	3.2738 KOps/s	3.2773 KOps/s	$\color{#d91a1a}-0.11\%$
test_collector_preallocated_write[copy_at-cpu-4096-8]	1.5818ms	1.4690ms	680.7379 Ops/s	703.6390 Ops/s	$\color{#d91a1a}-3.25\%$
test_collector_preallocated_write[copy_at-cpu-4096-32]	9.7214ms	9.4447ms	105.8799 Ops/s	106.6821 Ops/s	$\color{#d91a1a}-0.75\%$
test_collector_preallocated_write[copy_at-cuda-32-2]	0.4070ms	0.3212ms	3.1136 KOps/s	3.0962 KOps/s	$\color{#35bf28}+0.56\%$
test_collector_preallocated_write[copy_at-cuda-32-8]	1.2969ms	1.1930ms	838.2226 Ops/s	844.5313 Ops/s	$\color{#d91a1a}-0.75\%$
test_collector_preallocated_write[copy_at-cuda-32-32]	4.8624ms	4.6588ms	214.6492 Ops/s	216.4438 Ops/s	$\color{#d91a1a}-0.83\%$
test_collector_preallocated_write[copy_at-cuda-4096-2]	0.3804ms	0.3224ms	3.1021 KOps/s	3.1000 KOps/s	$\color{#35bf28}+0.07\%$
test_collector_preallocated_write[copy_at-cuda-4096-8]	1.3060ms	1.1974ms	835.1466 Ops/s	837.8140 Ops/s	$\color{#d91a1a}-0.32\%$
test_collector_preallocated_write[copy_at-cuda-4096-32]	4.7772ms	4.6886ms	213.2837 Ops/s	213.9646 Ops/s	$\color{#d91a1a}-0.32\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-2]	0.1662ms	0.1186ms	8.4285 KOps/s	8.6666 KOps/s	$\color{#d91a1a}-2.75\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-8]	0.5355ms	0.4665ms	2.1436 KOps/s	2.2159 KOps/s	$\color{#d91a1a}-3.26\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-32]	1.9319ms	1.8571ms	538.4690 Ops/s	555.8997 Ops/s	$\color{#d91a1a}-3.14\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-2]	0.3084ms	0.2498ms	4.0032 KOps/s	3.9610 KOps/s	$\color{#35bf28}+1.06\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-8]	1.4183ms	1.2785ms	782.1840 Ops/s	814.5466 Ops/s	$\color{#d91a1a}-3.97\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-32]	8.8562ms	8.5762ms	116.6023 Ops/s	117.5912 Ops/s	$\color{#d91a1a}-0.84\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-2]	0.3312ms	0.2772ms	3.6076 KOps/s	3.6927 KOps/s	$\color{#d91a1a}-2.30\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-8]	1.1008ms	1.0294ms	971.4665 Ops/s	1.0172 KOps/s	$\color{#d91a1a}-4.50\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-32]	4.0843ms	4.0182ms	248.8683 Ops/s	260.7875 Ops/s	$\color{#d91a1a}-4.57\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-2]	0.3699ms	0.2762ms	3.6202 KOps/s	3.7492 KOps/s	$\color{#d91a1a}-3.44\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-8]	1.1412ms	1.0265ms	974.2218 Ops/s	1.0154 KOps/s	$\color{#d91a1a}-4.06\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-32]	4.4924ms	4.0305ms	248.1063 Ops/s	260.3656 Ops/s	$\color{#d91a1a}-4.71\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-128]	16.1341ms	15.8052ms	63.2703 Ops/s	62.9856 Ops/s	$\color{#35bf28}+0.45\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-256]	32.1136ms	31.9320ms	31.3166 Ops/s	31.3809 Ops/s	$\color{#d91a1a}-0.21\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-128]	84.2260ms	83.6268ms	11.9579 Ops/s	11.9778 Ops/s	$\color{#d91a1a}-0.17\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-256]	0.1971s	0.1963s	5.0954 Ops/s	5.0433 Ops/s	$\color{#35bf28}+1.03\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-128]	14.4585ms	13.1952ms	75.7848 Ops/s	75.5737 Ops/s	$\color{#35bf28}+0.28\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-256]	25.9850ms	25.7995ms	38.7604 Ops/s	38.7567 Ops/s	$+0.01\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-128]	13.6274ms	13.3437ms	74.9420 Ops/s	75.0582 Ops/s	$\color{#d91a1a}-0.15\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-256]	26.3133ms	26.1180ms	38.2878 Ops/s	38.2373 Ops/s	$\color{#35bf28}+0.13\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-128]	50.1958ms	49.9386ms	20.0246 Ops/s	20.1695 Ops/s	$\color{#d91a1a}-0.72\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-256]	0.1006s	0.1004s	9.9629 Ops/s	9.9901 Ops/s	$\color{#d91a1a}-0.27\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-128]	0.1461s	0.1441s	6.9376 Ops/s	7.0424 Ops/s	$\color{#d91a1a}-1.49\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-256]	0.3178s	0.3161s	3.1639 Ops/s	3.1492 Ops/s	$\color{#35bf28}+0.47\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-128]	76.1370ms	74.4704ms	13.4282 Ops/s	14.0909 Ops/s	$\color{#d91a1a}-4.70\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-256]	0.1529s	0.1506s	6.6406 Ops/s	6.5319 Ops/s	$\color{#35bf28}+1.66\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-128]	77.3444ms	76.5344ms	13.0660 Ops/s	13.1220 Ops/s	$\color{#d91a1a}-0.43\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-256]	0.1539s	0.1510s	6.6205 Ops/s	6.6192 Ops/s	$\color{#35bf28}+0.02\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-128]	29.6497ms	29.5384ms	33.8542 Ops/s	33.8334 Ops/s	$\color{#35bf28}+0.06\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-256]	60.0463ms	59.6120ms	16.7751 Ops/s	16.6594 Ops/s	$\color{#35bf28}+0.69\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-128]	0.1202s	0.1190s	8.4036 Ops/s	8.6792 Ops/s	$\color{#d91a1a}-3.18\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-256]	0.2626s	0.2622s	3.8146 Ops/s	3.8317 Ops/s	$\color{#d91a1a}-0.45\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-128]	43.1853ms	42.8401ms	23.3426 Ops/s	23.8036 Ops/s	$\color{#d91a1a}-1.94\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-256]	86.0420ms	85.5088ms	11.6947 Ops/s	11.8189 Ops/s	$\color{#d91a1a}-1.05\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-128]	43.4116ms	43.1376ms	23.1816 Ops/s	23.6259 Ops/s	$\color{#d91a1a}-1.88\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-256]	86.3048ms	86.0330ms	11.6235 Ops/s	11.7874 Ops/s	$\color{#d91a1a}-1.39\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-128]	20.5712ms	20.2725ms	49.3280 Ops/s	50.0732 Ops/s	$\color{#d91a1a}-1.49\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-256]	41.7314ms	41.4913ms	24.1015 Ops/s	24.6693 Ops/s	$\color{#d91a1a}-2.30\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-128]	0.1128s	0.1074s	9.3082 Ops/s	9.6135 Ops/s	$\color{#d91a1a}-3.18\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-256]	0.2404s	0.2400s	4.1666 Ops/s	4.2108 Ops/s	$\color{#d91a1a}-1.05\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-128]	37.0557ms	36.7301ms	27.2256 Ops/s	28.7083 Ops/s	$\textbf{\color{#d91a1a}-5.16\%}$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-256]	74.0359ms	73.6331ms	13.5809 Ops/s	14.2282 Ops/s	$\color{#d91a1a}-4.55\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-128]	37.2207ms	36.9519ms	27.0622 Ops/s	28.5409 Ops/s	$\textbf{\color{#d91a1a}-5.18\%}$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-256]	74.1667ms	73.7165ms	13.5655 Ops/s	14.3905 Ops/s	$\textbf{\color{#d91a1a}-5.73\%}$
test_plain_set_nested	37.8110μs	14.7621μs	67.7410 KOps/s	68.5886 KOps/s	$\color{#d91a1a}-1.24\%$
test_plain_set_stack_nested	57.9410μs	14.4653μs	69.1311 KOps/s	70.4439 KOps/s	$\color{#d91a1a}-1.86\%$
test_plain_set_nested_inplace	37.7810μs	15.7945μs	63.3133 KOps/s	62.9349 KOps/s	$\color{#35bf28}+0.60\%$
test_plain_set_stack_nested_inplace	69.0220μs	15.5965μs	64.1168 KOps/s	64.1728 KOps/s	$\color{#d91a1a}-0.09\%$
test_items	27.8210μs	5.4323μs	184.0826 KOps/s	185.3922 KOps/s	$\color{#d91a1a}-0.71\%$
test_items_nested	0.5725ms	0.4418ms	2.2633 KOps/s	2.2235 KOps/s	$\color{#35bf28}+1.79\%$
test_items_nested_locked	0.4882ms	0.4451ms	2.2466 KOps/s	2.2042 KOps/s	$\color{#35bf28}+1.92\%$
test_items_nested_leaf	0.1381ms	92.1885μs	10.8473 KOps/s	10.7136 KOps/s	$\color{#35bf28}+1.25\%$
test_items_stack_nested	0.5572ms	0.4424ms	2.2602 KOps/s	2.2485 KOps/s	$\color{#35bf28}+0.52\%$
test_items_stack_nested_leaf	0.1430ms	91.9328μs	10.8775 KOps/s	10.8570 KOps/s	$\color{#35bf28}+0.19\%$
test_items_stack_nested_locked	0.5195ms	0.4464ms	2.2399 KOps/s	2.2168 KOps/s	$\color{#35bf28}+1.04\%$
test_keys	25.0610μs	4.1437μs	241.3324 KOps/s	243.5159 KOps/s	$\color{#d91a1a}-0.90\%$
test_keys_nested	0.1765ms	0.1270ms	7.8762 KOps/s	7.9025 KOps/s	$\color{#d91a1a}-0.33\%$
test_keys_nested_locked	0.7880ms	0.1359ms	7.3567 KOps/s	7.4372 KOps/s	$\color{#d91a1a}-1.08\%$
test_keys_nested_leaf	0.1706ms	0.1180ms	8.4738 KOps/s	8.4852 KOps/s	$\color{#d91a1a}-0.13\%$
test_keys_stack_nested	0.1792ms	0.1270ms	7.8744 KOps/s	7.9648 KOps/s	$\color{#d91a1a}-1.13\%$
test_keys_stack_nested_leaf	0.1840ms	0.1177ms	8.4943 KOps/s	8.5185 KOps/s	$\color{#d91a1a}-0.28\%$
test_keys_stack_nested_locked	0.1948ms	0.1351ms	7.3999 KOps/s	7.4755 KOps/s	$\color{#d91a1a}-1.01\%$
test_values	6.1420μs	1.0062μs	993.8764 KOps/s	996.3070 KOps/s	$\color{#d91a1a}-0.24\%$
test_values_nested	86.3720μs	50.9096μs	19.6427 KOps/s	19.5129 KOps/s	$\color{#35bf28}+0.66\%$
test_values_nested_locked	79.2020μs	53.8632μs	18.5655 KOps/s	18.4429 KOps/s	$\color{#35bf28}+0.67\%$
test_values_nested_leaf	95.6720μs	58.6336μs	17.0551 KOps/s	16.9711 KOps/s	$\color{#35bf28}+0.49\%$
test_values_stack_nested	85.5820μs	50.5832μs	19.7694 KOps/s	19.6263 KOps/s	$\color{#35bf28}+0.73\%$
test_values_stack_nested_leaf	90.2520μs	58.1887μs	17.1855 KOps/s	17.1673 KOps/s	$\color{#35bf28}+0.11\%$
test_values_stack_nested_locked	95.0520μs	53.8403μs	18.5735 KOps/s	18.3147 KOps/s	$\color{#35bf28}+1.41\%$
test_membership	4.9302μs	0.8014μs	1.2478 MOps/s	1.2390 MOps/s	$\color{#35bf28}+0.71\%$
test_membership_nested	28.9600μs	2.7931μs	358.0234 KOps/s	350.9875 KOps/s	$\color{#35bf28}+2.00\%$
test_membership_nested_leaf	32.8710μs	2.7843μs	359.1623 KOps/s	350.3420 KOps/s	$\color{#35bf28}+2.52\%$
test_membership_stacked_nested	53.7220μs	2.7127μs	368.6356 KOps/s	362.3444 KOps/s	$\color{#35bf28}+1.74\%$
test_membership_stacked_nested_leaf	35.9510μs	2.7194μs	367.7288 KOps/s	366.0804 KOps/s	$\color{#35bf28}+0.45\%$
test_membership_nested_last	41.5010μs	4.2079μs	237.6462 KOps/s	233.3804 KOps/s	$\color{#35bf28}+1.83\%$
test_membership_nested_leaf_last	32.2310μs	4.2096μs	237.5539 KOps/s	235.1364 KOps/s	$\color{#35bf28}+1.03\%$
test_membership_stacked_nested_last	47.7920μs	4.0565μs	246.5210 KOps/s	241.0524 KOps/s	$\color{#35bf28}+2.27\%$
test_membership_stacked_nested_leaf_last	30.5210μs	4.0591μs	246.3573 KOps/s	241.7287 KOps/s	$\color{#35bf28}+1.91\%$
test_nested_getleaf	52.9410μs	20.3819μs	49.0631 KOps/s	49.7725 KOps/s	$\color{#d91a1a}-1.43\%$
test_nested_get	51.8210μs	19.1555μs	52.2044 KOps/s	51.5761 KOps/s	$\color{#35bf28}+1.22\%$
test_stacked_getleaf	64.2920μs	20.0512μs	49.8724 KOps/s	49.4165 KOps/s	$\color{#35bf28}+0.92\%$
test_stacked_get	57.0910μs	19.0321μs	52.5428 KOps/s	51.3042 KOps/s	$\color{#35bf28}+2.41\%$
test_nested_getitemleaf	46.6520μs	21.0056μs	47.6065 KOps/s	47.4708 KOps/s	$\color{#35bf28}+0.29\%$
test_nested_getitem	49.6610μs	20.0080μs	49.9800 KOps/s	50.0082 KOps/s	$\color{#d91a1a}-0.06\%$
test_stacked_getitemleaf	59.0320μs	20.5088μs	48.7595 KOps/s	48.0510 KOps/s	$\color{#35bf28}+1.47\%$
test_stacked_getitem	60.8010μs	19.8420μs	50.3982 KOps/s	50.7336 KOps/s	$\color{#d91a1a}-0.66\%$
test_lock_nested	8.2675ms	0.4952ms	2.0195 KOps/s	2.0529 KOps/s	$\color{#d91a1a}-1.63\%$
test_lock_stack_nested	0.6157ms	0.4912ms	2.0356 KOps/s	2.0659 KOps/s	$\color{#d91a1a}-1.46\%$
test_unlock_nested	0.4757ms	0.3874ms	2.5814 KOps/s	2.6362 KOps/s	$\color{#d91a1a}-2.08\%$
test_unlock_stack_nested	0.5679ms	0.3927ms	2.5463 KOps/s	2.5880 KOps/s	$\color{#d91a1a}-1.61\%$
test_flatten_speed	0.2978ms	0.1176ms	8.5046 KOps/s	8.6052 KOps/s	$\color{#d91a1a}-1.17\%$
test_unflatten_speed	0.6685ms	0.5397ms	1.8530 KOps/s	1.8208 KOps/s	$\color{#35bf28}+1.76\%$
test_common_ops	0.8086ms	0.7013ms	1.4259 KOps/s	1.4084 KOps/s	$\color{#35bf28}+1.25\%$
test_creation	74.5320μs	2.9699μs	336.7151 KOps/s	338.9259 KOps/s	$\color{#d91a1a}-0.65\%$
test_creation_empty	39.6610μs	6.6881μs	149.5191 KOps/s	152.9951 KOps/s	$\color{#d91a1a}-2.27\%$
test_creation_nested_1	41.6310μs	11.0992μs	90.0968 KOps/s	90.6547 KOps/s	$\color{#d91a1a}-0.62\%$
test_creation_nested_2	41.3010μs	12.8618μs	77.7499 KOps/s	79.9235 KOps/s	$\color{#d91a1a}-2.72\%$
test_creation_many_keys[10]	50.2110μs	19.8655μs	50.3385 KOps/s	51.8136 KOps/s	$\color{#d91a1a}-2.85\%$
test_creation_many_keys[50]	0.1186ms	85.1057μs	11.7501 KOps/s	11.9858 KOps/s	$\color{#d91a1a}-1.97\%$
test_creation_many_keys[100]	0.1991ms	0.1668ms	5.9965 KOps/s	6.0758 KOps/s	$\color{#d91a1a}-1.30\%$
test_creation_nested_many_keys[10]	80.1720μs	42.8216μs	23.3527 KOps/s	23.6652 KOps/s	$\color{#d91a1a}-1.32\%$
test_creation_nested_many_keys[50]	0.2698ms	0.1729ms	5.7831 KOps/s	5.8558 KOps/s	$\color{#d91a1a}-1.24\%$
test_clone	48.9310μs	13.1719μs	75.9194 KOps/s	77.1869 KOps/s	$\color{#d91a1a}-1.64\%$
test_getitem[int]	1.5421ms	14.9432μs	66.9199 KOps/s	67.6442 KOps/s	$\color{#d91a1a}-1.07\%$
test_getitem[slice_int]	0.1392ms	23.9197μs	41.8066 KOps/s	41.7323 KOps/s	$\color{#35bf28}+0.18\%$
test_getitem[range]	0.1730ms	60.9838μs	16.3978 KOps/s	15.5379 KOps/s	$\textbf{\color{#35bf28}+5.53\%}$
test_getitem[tuple]	0.1420ms	23.4361μs	42.6692 KOps/s	41.6592 KOps/s	$\color{#35bf28}+2.42\%$
test_getitem[list]	0.1751ms	56.5840μs	17.6728 KOps/s	17.6170 KOps/s	$\color{#35bf28}+0.32\%$
test_setitem_dim[int]	45.5110μs	24.9488μs	40.0821 KOps/s	40.7481 KOps/s	$\color{#d91a1a}-1.63\%$
test_setitem_dim[slice_int]	79.0920μs	41.2568μs	24.2384 KOps/s	22.8631 KOps/s	$\textbf{\color{#35bf28}+6.02\%}$
test_setitem_dim[range]	0.1138ms	90.2506μs	11.0803 KOps/s	10.2410 KOps/s	$\textbf{\color{#35bf28}+8.19\%}$
test_setitem_dim[tuple]	60.7210μs	38.6819μs	25.8519 KOps/s	26.6300 KOps/s	$\color{#d91a1a}-2.92\%$
test_setitem	68.4110μs	17.5824μs	56.8752 KOps/s	55.7586 KOps/s	$\color{#35bf28}+2.00\%$
test_set	56.7410μs	16.6823μs	59.9438 KOps/s	58.5741 KOps/s	$\color{#35bf28}+2.34\%$
test_set_shared	0.5065ms	0.2048ms	4.8825 KOps/s	4.7820 KOps/s	$\color{#35bf28}+2.10\%$
test_update	0.1956ms	21.4564μs	46.6062 KOps/s	46.3963 KOps/s	$\color{#35bf28}+0.45\%$
test_update_nested	72.1720μs	33.4512μs	29.8943 KOps/s	30.4721 KOps/s	$\color{#d91a1a}-1.90\%$
test_update__nested	0.5050ms	32.5880μs	30.6861 KOps/s	30.7055 KOps/s	$\color{#d91a1a}-0.06\%$
test_set_nested	56.4610μs	18.4382μs	54.2352 KOps/s	52.8165 KOps/s	$\color{#35bf28}+2.69\%$
test_set_nested_new	56.7920μs	23.0807μs	43.3262 KOps/s	41.3792 KOps/s	$\color{#35bf28}+4.71\%$
test_select	83.0320μs	39.7487μs	25.1581 KOps/s	24.7599 KOps/s	$\color{#35bf28}+1.61\%$
test_select_nested	0.1086ms	70.5833μs	14.1677 KOps/s	14.0922 KOps/s	$\color{#35bf28}+0.54\%$
test_exclude_nested	0.1247ms	86.0518μs	11.6209 KOps/s	11.4957 KOps/s	$\color{#35bf28}+1.09\%$
test_empty[True]	0.5105ms	0.3814ms	2.6217 KOps/s	2.6109 KOps/s	$\color{#35bf28}+0.41\%$
test_empty[False]	9.4927μs	1.3184μs	758.4939 KOps/s	751.4821 KOps/s	$\color{#35bf28}+0.93\%$
test_to	94.8220μs	68.2888μs	14.6437 KOps/s	13.9515 KOps/s	$\color{#35bf28}+4.96\%$
test_to_nonblocking	0.1215ms	68.0459μs	14.6960 KOps/s	14.0483 KOps/s	$\color{#35bf28}+4.61\%$
test_unbind_speed	0.3545ms	0.3256ms	3.0710 KOps/s	3.0890 KOps/s	$\color{#d91a1a}-0.58\%$
test_unbind_speed_stack0	0.4480ms	0.3217ms	3.1086 KOps/s	3.1342 KOps/s	$\color{#d91a1a}-0.82\%$
test_unbind_speed_stack1	0.1137s	0.9096ms	1.0994 KOps/s	928.1305 Ops/s	$\textbf{\color{#35bf28}+18.46\%}$
test_split	1.2124ms	1.0963ms	912.1475 Ops/s	918.4320 Ops/s	$\color{#d91a1a}-0.68\%$
test_chunk	0.1134s	1.1795ms	847.8230 Ops/s	959.7698 Ops/s	$\textbf{\color{#d91a1a}-11.66\%}$
test_to_cpu_blocking	20.0219ms	19.9176ms	50.2070 Ops/s	49.6441 Ops/s	$\color{#35bf28}+1.13\%$
test_to_cpu_global_sync	12.4607ms	11.7572ms	85.0545 Ops/s	75.9458 Ops/s	$\textbf{\color{#35bf28}+11.99\%}$
test_to_cpu_event_sync	13.0109ms	12.7232ms	78.5969 Ops/s	78.5255 Ops/s	$\color{#35bf28}+0.09\%$
test_to_cpu_default	13.1887ms	12.7544ms	78.4045 Ops/s	78.4874 Ops/s	$\color{#d91a1a}-0.11\%$
test_consolidate[False-None]	0.1422s	4.5883ms	217.9453 Ops/s	251.4184 Ops/s	$\textbf{\color{#d91a1a}-13.31\%}$
test_consolidate[default-None]	0.1878s	2.4798ms	403.2652 Ops/s	475.3565 Ops/s	$\textbf{\color{#d91a1a}-15.17\%}$
test_consolidate[reduce-overhead-None]	3.4751ms	2.0077ms	498.0759 Ops/s	490.2025 Ops/s	$\color{#35bf28}+1.61\%$
test_consolidate_njt[False-None]	9.3518ms	8.5402ms	117.0927 Ops/s	122.6092 Ops/s	$\color{#d91a1a}-4.50\%$
test_to[False-False-None]	2.2523ms	2.1394ms	467.4208 Ops/s	461.0065 Ops/s	$\color{#35bf28}+1.39\%$
test_to[True-False-None]	2.1118ms	1.8796ms	532.0164 Ops/s	529.3181 Ops/s	$\color{#35bf28}+0.51\%$
test_to[within-False-None]	6.3515ms	6.0368ms	165.6511 Ops/s	165.7667 Ops/s	$\color{#d91a1a}-0.07\%$
test_to[True-default-None]	10.6673ms	10.5220ms	95.0393 Ops/s	91.1669 Ops/s	$\color{#35bf28}+4.25\%$
test_to_njt[False-False-None]	8.5355ms	8.3501ms	119.7595 Ops/s	112.8691 Ops/s	$\textbf{\color{#35bf28}+6.10\%}$
test_to_njt[True-False-None]	6.8419ms	6.6586ms	150.1826 Ops/s	143.7924 Ops/s	$\color{#35bf28}+4.44\%$
test_to_njt[within-False-None]	15.0468ms	14.9551ms	66.8666 Ops/s	65.2326 Ops/s	$\color{#35bf28}+2.50\%$
test_creation[device0]	0.4080ms	0.1159ms	8.6259 KOps/s	8.4795 KOps/s	$\color{#35bf28}+1.73\%$
test_creation_from_tensor	0.4780ms	0.1126ms	8.8774 KOps/s	8.9967 KOps/s	$\color{#d91a1a}-1.33\%$
test_add_one[memmap_tensor0]	0.4193ms	6.6313μs	150.8000 KOps/s	153.2223 KOps/s	$\color{#d91a1a}-1.58\%$
test_contiguous[memmap_tensor0]	15.0310μs	0.5943μs	1.6827 MOps/s	2.1314 MOps/s	$\textbf{\color{#d91a1a}-21.05\%}$
test_stack[memmap_tensor0]	0.1519ms	4.0945μs	244.2300 KOps/s	245.7553 KOps/s	$\color{#d91a1a}-0.62\%$
test_memmaptd_index	1.2674ms	0.2681ms	3.7298 KOps/s	3.7931 KOps/s	$\color{#d91a1a}-1.67\%$
test_memmaptd_index_astensor	0.4819ms	0.3655ms	2.7359 KOps/s	2.7281 KOps/s	$\color{#35bf28}+0.28\%$
test_memmaptd_index_op	0.8102ms	0.6185ms	1.6168 KOps/s	1.6053 KOps/s	$\color{#35bf28}+0.72\%$
test_serialize_model	0.1367s	0.1347s	7.4258 Ops/s	7.3681 Ops/s	$\color{#35bf28}+0.78\%$
test_serialize_model_pickle	1.3702s	1.2136s	0.8240 Ops/s	0.8267 Ops/s	$\color{#d91a1a}-0.33\%$
test_serialize_weights	0.1365s	0.1338s	7.4738 Ops/s	7.4220 Ops/s	$\color{#35bf28}+0.70\%$
test_serialize_weights_returnearly	0.4739s	87.7175ms	11.4002 Ops/s	15.4124 Ops/s	$\textbf{\color{#d91a1a}-26.03\%}$
test_serialize_weights_pickle	1.3667s	1.2135s	0.8241 Ops/s	0.8233 Ops/s	$\color{#35bf28}+0.10\%$
test_reshape_pytree	0.2053ms	31.4127μs	31.8342 KOps/s	31.8248 KOps/s	$\color{#35bf28}+0.03\%$
test_reshape_td	85.7420μs	43.2187μs	23.1381 KOps/s	22.3527 KOps/s	$\color{#35bf28}+3.51\%$
test_view_pytree	0.2191ms	30.7237μs	32.5482 KOps/s	32.8938 KOps/s	$\color{#d91a1a}-1.05\%$
test_view_td	0.1141ms	52.0328μs	19.2186 KOps/s	18.9523 KOps/s	$\color{#35bf28}+1.41\%$
test_unbind_pytree	0.2405ms	35.6454μs	28.0541 KOps/s	28.0115 KOps/s	$\color{#35bf28}+0.15\%$
test_unbind_td	0.1617ms	48.7104μs	20.5295 KOps/s	20.1930 KOps/s	$\color{#35bf28}+1.67\%$
test_split_pytree	0.1931ms	40.4839μs	24.7012 KOps/s	24.4818 KOps/s	$\color{#35bf28}+0.90\%$
test_split_td	0.2058ms	62.3223μs	16.0456 KOps/s	15.4672 KOps/s	$\color{#35bf28}+3.74\%$
test_add_pytree	0.2240ms	40.3259μs	24.7979 KOps/s	22.7180 KOps/s	$\textbf{\color{#35bf28}+9.16\%}$
test_add_td	98.4020μs	52.7525μs	18.9564 KOps/s	17.0186 KOps/s	$\textbf{\color{#35bf28}+11.39\%}$
test_compile_add_one_nested[tensordict-compile]	0.3278ms	0.2268ms	4.4091 KOps/s	4.4213 KOps/s	$\color{#d91a1a}-0.27\%$
test_compile_add_one_nested[tensordict-eager]	0.2976ms	0.1934ms	5.1707 KOps/s	5.1607 KOps/s	$\color{#35bf28}+0.20\%$
test_compile_add_one_nested[pytree-compile]	0.3092ms	0.1318ms	7.5860 KOps/s	7.4644 KOps/s	$\color{#35bf28}+1.63\%$
test_compile_add_one_nested[pytree-eager]	0.4652ms	0.1739ms	5.7499 KOps/s	5.5576 KOps/s	$\color{#35bf28}+3.46\%$
test_compile_copy_nested[tensordict-compile]	59.3720μs	15.0825μs	66.3021 KOps/s	70.0978 KOps/s	$\textbf{\color{#d91a1a}-5.41\%}$
test_compile_copy_nested[tensordict-eager]	0.4324ms	50.7003μs	19.7237 KOps/s	19.5268 KOps/s	$\color{#35bf28}+1.01\%$
test_compile_copy_nested[pytree-compile]	0.1169ms	15.3600μs	65.1043 KOps/s	68.6135 KOps/s	$\textbf{\color{#d91a1a}-5.11\%}$
test_compile_copy_nested[pytree-eager]	0.3916ms	63.9815μs	15.6295 KOps/s	15.5236 KOps/s	$\color{#35bf28}+0.68\%$
test_compile_add_one_flat[tensordict-compile]	0.2963ms	0.2527ms	3.9573 KOps/s	3.6801 KOps/s	$\textbf{\color{#35bf28}+7.53\%}$
test_compile_add_one_flat[tensordict-eager]	0.3593ms	0.2767ms	3.6136 KOps/s	3.5339 KOps/s	$\color{#35bf28}+2.26\%$
test_compile_add_one_flat[tensorclass-compile]	0.3779ms	0.1878ms	5.3254 KOps/s	5.0407 KOps/s	$\textbf{\color{#35bf28}+5.65\%}$
test_compile_add_one_flat[tensorclass-eager]	0.1216ms	72.5990μs	13.7743 KOps/s	13.7421 KOps/s	$\color{#35bf28}+0.23\%$
test_compile_add_one_flat[pytree-compile]	0.5854ms	0.1900ms	5.2629 KOps/s	5.0389 KOps/s	$\color{#35bf28}+4.45\%$
test_compile_add_one_flat[pytree-eager]	0.7966ms	0.5284ms	1.8926 KOps/s	1.9767 KOps/s	$\color{#d91a1a}-4.25\%$
test_compile_add_self_flat[tensordict-eager]	0.3740ms	0.3258ms	3.0698 KOps/s	3.0609 KOps/s	$\color{#35bf28}+0.29\%$
test_compile_add_self_flat[tensordict-compile]	0.3932ms	0.2480ms	4.0319 KOps/s	3.6551 KOps/s	$\textbf{\color{#35bf28}+10.31\%}$
test_compile_add_self_flat[tensorclass-eager]	0.1492ms	88.2179μs	11.3356 KOps/s	11.3017 KOps/s	$\color{#35bf28}+0.30\%$
test_compile_add_self_flat[tensorclass-compile]	0.4081ms	0.1883ms	5.3117 KOps/s	4.9864 KOps/s	$\textbf{\color{#35bf28}+6.52\%}$
test_compile_add_self_flat[pytree-eager]	0.6747ms	0.4342ms	2.3029 KOps/s	2.3537 KOps/s	$\color{#d91a1a}-2.16\%$
test_compile_add_self_flat[pytree-compile]	0.5286ms	0.1900ms	5.2621 KOps/s	5.0601 KOps/s	$\color{#35bf28}+3.99\%$
test_compile_copy_flat[tensordict-compile]	78.2520μs	19.3383μs	51.7108 KOps/s	51.6951 KOps/s	$\color{#35bf28}+0.03\%$
test_compile_copy_flat[tensordict-eager]	71.5210μs	39.4981μs	25.3177 KOps/s	25.4102 KOps/s	$\color{#d91a1a}-0.36\%$
test_compile_copy_flat[pytree-compile]	53.8220μs	21.1655μs	47.2467 KOps/s	46.8968 KOps/s	$\color{#35bf28}+0.75\%$
test_compile_copy_flat[pytree-eager]	0.3579ms	50.5384μs	19.7869 KOps/s	15.2574 KOps/s	$\textbf{\color{#35bf28}+29.69\%}$
test_compile_assign_and_add[tensordict-compile]	2.1603ms	0.2375ms	4.2109 KOps/s	3.7521 KOps/s	$\textbf{\color{#35bf28}+12.23\%}$
test_compile_assign_and_add[tensordict-eager]	3.5370ms	3.2379ms	308.8410 Ops/s	304.7946 Ops/s	$\color{#35bf28}+1.33\%$
test_compile_assign_and_add[pytree-compile]	2.0909ms	0.1777ms	5.6288 KOps/s	5.4295 KOps/s	$\color{#35bf28}+3.67\%$
test_compile_assign_and_add[pytree-eager]	2.9022ms	2.7615ms	362.1215 Ops/s	358.4156 Ops/s	$\color{#35bf28}+1.03\%$
test_compile_indexing[tensor-tensordict-compile]	0.3016ms	0.1331ms	7.5111 KOps/s	7.3596 KOps/s	$\color{#35bf28}+2.06\%$
test_compile_indexing[tensor-tensordict-eager]	0.3959ms	72.5011μs	13.7929 KOps/s	13.9608 KOps/s	$\color{#d91a1a}-1.20\%$
test_compile_indexing[tensor-tensorclass-compile]	0.2537ms	0.1185ms	8.4386 KOps/s	8.5866 KOps/s	$\color{#d91a1a}-1.72\%$
test_compile_indexing[tensor-tensorclass-eager]	0.3090ms	42.6123μs	23.4674 KOps/s	22.1284 KOps/s	$\textbf{\color{#35bf28}+6.05\%}$
test_compile_indexing[tensor-pytree-compile]	0.1680ms	0.1179ms	8.4813 KOps/s	8.4683 KOps/s	$\color{#35bf28}+0.15\%$
test_compile_indexing[tensor-pytree-eager]	0.2598ms	42.6455μs	23.4491 KOps/s	23.4453 KOps/s	$\color{#35bf28}+0.02\%$
test_compile_indexing[slice-tensordict-compile]	0.2454ms	83.3900μs	11.9919 KOps/s	11.9151 KOps/s	$\color{#35bf28}+0.64\%$
test_compile_indexing[slice-tensordict-eager]	0.2179ms	26.0808μs	38.3424 KOps/s	38.3426 KOps/s	$-0.00\%$
test_compile_indexing[slice-tensorclass-compile]	0.2118ms	69.3837μs	14.4126 KOps/s	14.5729 KOps/s	$\color{#d91a1a}-1.10\%$
test_compile_indexing[slice-tensorclass-eager]	0.2550ms	21.1629μs	47.2525 KOps/s	47.6976 KOps/s	$\color{#d91a1a}-0.93\%$
test_compile_indexing[slice-pytree-compile]	0.1116ms	69.1533μs	14.4606 KOps/s	14.2107 KOps/s	$\color{#35bf28}+1.76\%$
test_compile_indexing[slice-pytree-eager]	0.2707ms	21.2420μs	47.0766 KOps/s	47.1077 KOps/s	$\color{#d91a1a}-0.07\%$
test_compile_indexing[int-tensordict-compile]	0.1215ms	82.6374μs	12.1011 KOps/s	11.6309 KOps/s	$\color{#35bf28}+4.04\%$
test_compile_indexing[int-tensordict-eager]	0.2380ms	26.4201μs	37.8500 KOps/s	38.5938 KOps/s	$\color{#d91a1a}-1.93\%$
test_compile_indexing[int-tensorclass-compile]	0.1093ms	69.3085μs	14.4282 KOps/s	14.3619 KOps/s	$\color{#35bf28}+0.46\%$
test_compile_indexing[int-tensorclass-eager]	0.2448ms	21.3296μs	46.8833 KOps/s	47.2461 KOps/s	$\color{#d91a1a}-0.77\%$
test_compile_indexing[int-pytree-compile]	0.1084ms	69.4296μs	14.4031 KOps/s	14.4658 KOps/s	$\color{#d91a1a}-0.43\%$
test_compile_indexing[int-pytree-eager]	0.2905ms	21.2463μs	47.0670 KOps/s	47.4403 KOps/s	$\color{#d91a1a}-0.79\%$
test_compile_replace[single-eager]	89.0720μs	45.7848μs	21.8413 KOps/s	21.6002 KOps/s	$\color{#35bf28}+1.12\%$
test_compile_replace[single-compile]	0.2520ms	0.1270ms	7.8739 KOps/s	7.7659 KOps/s	$\color{#35bf28}+1.39\%$
test_compile_replace[multi-eager]	0.8536ms	0.5641ms	1.7729 KOps/s	1.8629 KOps/s	$\color{#d91a1a}-4.84\%$
test_compile_replace[multi-compile]	0.3394ms	0.1373ms	7.2844 KOps/s	7.1761 KOps/s	$\color{#35bf28}+1.51\%$
test_compile_tc_getattr_20[eager]	0.2356ms	0.1645ms	6.0775 KOps/s	5.9209 KOps/s	$\color{#35bf28}+2.65\%$
test_compile_tc_getattr_20[compile]	0.3795ms	0.1485ms	6.7329 KOps/s	6.6436 KOps/s	$\color{#35bf28}+1.34\%$
test_compile_clone_shallow[20-eager]	49.3110μs	18.2571μs	54.7732 KOps/s	54.3926 KOps/s	$\color{#35bf28}+0.70\%$
test_compile_clone_shallow[20-compile]	79.1020μs	16.4216μs	60.8952 KOps/s	61.1162 KOps/s	$\color{#d91a1a}-0.36\%$
test_compile_clone_shallow[40-eager]	66.3110μs	32.4478μs	30.8187 KOps/s	30.7041 KOps/s	$\color{#35bf28}+0.37\%$
test_compile_clone_shallow[40-compile]	75.7910μs	18.3743μs	54.4239 KOps/s	56.7161 KOps/s	$\color{#d91a1a}-4.04\%$
test_compile_clone_shallow[80-eager]	97.7720μs	59.9422μs	16.6828 KOps/s	16.5858 KOps/s	$\color{#35bf28}+0.58\%$
test_compile_clone_shallow[80-compile]	88.2520μs	21.3743μs	46.7851 KOps/s	46.2370 KOps/s	$\color{#35bf28}+1.19\%$
test_compile_update_inplace[eager]	96.6220μs	59.5768μs	16.7851 KOps/s	16.9415 KOps/s	$\color{#d91a1a}-0.92\%$
test_compile_update_inplace[compile]	0.2128ms	0.1413ms	7.0752 KOps/s	6.7791 KOps/s	$\color{#35bf28}+4.37\%$
test_mod_add[eager]	0.3006ms	0.2184ms	4.5787 KOps/s	4.5827 KOps/s	$\color{#d91a1a}-0.09\%$
test_mod_add[compile]	0.3215ms	0.1299ms	7.6972 KOps/s	7.5428 KOps/s	$\color{#35bf28}+2.05\%$
test_mod_add[compile-overhead]	0.2825ms	0.1743ms	5.7361 KOps/s	5.6683 KOps/s	$\color{#35bf28}+1.20\%$
test_mod_wrap[eager]	0.5914ms	0.4590ms	2.1787 KOps/s	2.1841 KOps/s	$\color{#d91a1a}-0.25\%$
test_mod_wrap[compile]	0.5207ms	0.3964ms	2.5227 KOps/s	2.5066 KOps/s	$\color{#35bf28}+0.64\%$
test_mod_wrap[compile-overhead]	8.2051ms	4.5309ms	220.7068 Ops/s	220.8792 Ops/s	$\color{#d91a1a}-0.08\%$
test_mod_wrap_and_backward[eager]	1.9332ms	1.6709ms	598.4910 Ops/s	607.9512 Ops/s	$\color{#d91a1a}-1.56\%$
test_mod_wrap_and_backward[compile]	2.0742ms	1.5488ms	645.6560 Ops/s	661.7113 Ops/s	$\color{#d91a1a}-2.43\%$
test_mod_wrap_and_backward[compile-overhead]	1.3132ms	0.9216ms	1.0851 KOps/s	1.0718 KOps/s	$\color{#35bf28}+1.24\%$
test_seq_add[eager]	0.5747ms	0.4956ms	2.0178 KOps/s	2.0305 KOps/s	$\color{#d91a1a}-0.63\%$
test_seq_add[compile]	0.2562ms	0.1396ms	7.1647 KOps/s	6.7645 KOps/s	$\textbf{\color{#35bf28}+5.92\%}$
test_seq_add[compile-overhead]	0.3454ms	0.1875ms	5.3343 KOps/s	5.3590 KOps/s	$\color{#d91a1a}-0.46\%$
test_seq_wrap[eager]	1.4753ms	1.3750ms	727.2819 Ops/s	721.0607 Ops/s	$\color{#35bf28}+0.86\%$
test_seq_wrap[compile]	0.5463ms	0.4228ms	2.3651 KOps/s	2.3618 KOps/s	$\color{#35bf28}+0.14\%$
test_seq_wrap[compile-overhead]	0.4343ms	0.3091ms	3.2353 KOps/s	3.2395 KOps/s	$\color{#d91a1a}-0.13\%$
test_func_call_runtime[False-eager]	0.9159ms	0.8380ms	1.1933 KOps/s	1.2953 KOps/s	$\textbf{\color{#d91a1a}-7.87\%}$
test_func_call_runtime[False-compile]	1.1119ms	0.9944ms	1.0056 KOps/s	1.0221 KOps/s	$\color{#d91a1a}-1.62\%$
test_func_call_runtime[False-compile-overhead]	0.6171ms	0.4971ms	2.0118 KOps/s	2.0002 KOps/s	$\color{#35bf28}+0.58\%$
test_func_call_runtime[True-eager]	1.1816ms	1.0767ms	928.7375 Ops/s	963.0924 Ops/s	$\color{#d91a1a}-3.57\%$
test_func_call_runtime[True-compile]	1.0976ms	1.0130ms	987.1471 Ops/s	1.0101 KOps/s	$\color{#d91a1a}-2.27\%$
test_func_call_runtime[True-compile-overhead]	0.6132ms	0.5069ms	1.9729 KOps/s	1.9361 KOps/s	$\color{#35bf28}+1.90\%$
test_func_call_cm_runtime[False-eager]	0.9042ms	0.7898ms	1.2662 KOps/s	1.2912 KOps/s	$\color{#d91a1a}-1.94\%$
test_func_call_cm_runtime[False-compile]	1.0082ms	0.9423ms	1.0613 KOps/s	1.0470 KOps/s	$\color{#35bf28}+1.37\%$
test_func_call_cm_runtime[False-compile-overhead]	0.6614ms	0.4745ms	2.1076 KOps/s	2.0800 KOps/s	$\color{#35bf28}+1.33\%$
test_func_call_cm_runtime[True-eager]	1.2772ms	1.1790ms	848.1608 Ops/s	847.6832 Ops/s	$\color{#35bf28}+0.06\%$
test_func_call_cm_runtime[True-compile]	1.1078ms	1.0389ms	962.5620 Ops/s	991.3175 Ops/s	$\color{#d91a1a}-2.90\%$
test_func_call_cm_runtime[True-compile-overhead]	0.6181ms	0.5377ms	1.8599 KOps/s	1.8497 KOps/s	$\color{#35bf28}+0.55\%$
test_vmap_func_call_cm_runtime[eager]	2.9219ms	2.3844ms	419.3891 Ops/s	423.3806 Ops/s	$\color{#d91a1a}-0.94\%$
test_vmap_func_call_cm_runtime[compile]	3.0589ms	2.5585ms	390.8584 Ops/s	393.9932 Ops/s	$\color{#d91a1a}-0.80\%$
test_vmap_func_call_cm_runtime[compile-overhead]	3.0147ms	2.5379ms	394.0242 Ops/s	393.0609 Ops/s	$\color{#35bf28}+0.25\%$
test_distributed	0.5883ms	0.1440ms	6.9442 KOps/s	7.0113 KOps/s	$\color{#d91a1a}-0.96\%$
test_tdmodule	0.7353ms	0.1867ms	5.3569 KOps/s	5.3310 KOps/s	$\color{#35bf28}+0.49\%$
test_tdmodule_dispatch	0.4289ms	0.3610ms	2.7700 KOps/s	2.7804 KOps/s	$\color{#d91a1a}-0.37\%$
test_tdseq	45.9610μs	26.3323μs	37.9762 KOps/s	37.3341 KOps/s	$\color{#35bf28}+1.72\%$
test_tdseq_dispatch	0.2493ms	0.2107ms	4.7458 KOps/s	4.7420 KOps/s	$\color{#35bf28}+0.08\%$
test_instantiation_functorch	2.0952ms	1.9551ms	511.4743 Ops/s	506.7854 Ops/s	$\color{#35bf28}+0.93\%$
test_exec_functorch	0.2461ms	0.1773ms	5.6398 KOps/s	5.7961 KOps/s	$\color{#d91a1a}-2.70\%$
test_exec_functional_call	0.1935ms	0.1542ms	6.4863 KOps/s	6.5252 KOps/s	$\color{#d91a1a}-0.60\%$
test_exec_td_decorator	0.5037ms	0.2405ms	4.1588 KOps/s	4.1640 KOps/s	$\color{#d91a1a}-0.12\%$
test_vmap_mlp_speed_decorator[True-True]	1.2159ms	1.0191ms	981.2949 Ops/s	986.0375 Ops/s	$\color{#d91a1a}-0.48\%$
test_vmap_mlp_speed_decorator[True-False]	1.2286ms	1.0157ms	984.5093 Ops/s	989.4378 Ops/s	$\color{#d91a1a}-0.50\%$
test_vmap_mlp_speed_decorator[False-True]	0.9147ms	0.7271ms	1.3753 KOps/s	1.3874 KOps/s	$\color{#d91a1a}-0.87\%$
test_vmap_mlp_speed_decorator[False-False]	0.9213ms	0.7306ms	1.3688 KOps/s	1.3910 KOps/s	$\color{#d91a1a}-1.60\%$
test_vmap_transformer_speed_decorator[True-True]	20.9783ms	20.8074ms	48.0599 Ops/s	48.3796 Ops/s	$\color{#d91a1a}-0.66\%$
test_vmap_transformer_speed_decorator[True-False]	22.0007ms	20.8412ms	47.9820 Ops/s	48.4738 Ops/s	$\color{#d91a1a}-1.01\%$
test_vmap_transformer_speed_decorator[False-True]	20.5917ms	20.4414ms	48.9203 Ops/s	49.4461 Ops/s	$\color{#d91a1a}-1.06\%$
test_vmap_transformer_speed_decorator[False-False]	21.0736ms	20.3683ms	49.0959 Ops/s	49.3597 Ops/s	$\color{#d91a1a}-0.53\%$
test_to_module_speed[True]	1.7074ms	1.5659ms	638.6304 Ops/s	632.6423 Ops/s	$\color{#35bf28}+0.95\%$
test_to_module_speed[False]	1.7170ms	1.5548ms	643.1597 Ops/s	641.6352 Ops/s	$\color{#35bf28}+0.24\%$
test_to_module_plain_tensor_speed[None]	1.7597ms	1.6375ms	610.6901 Ops/s	590.9112 Ops/s	$\color{#35bf28}+3.35\%$
test_to_module_plain_tensor_speed[False]	1.6318ms	1.4987ms	667.2343 Ops/s	654.0268 Ops/s	$\color{#35bf28}+2.02\%$
test_to_module_plain_tensor_speed[True]	3.4276ms	3.2190ms	310.6568 Ops/s	305.4789 Ops/s	$\color{#35bf28}+1.70\%$
test_tc_init	77.4710μs	41.5754μs	24.0527 KOps/s	23.9877 KOps/s	$\color{#35bf28}+0.27\%$
test_tc_init_tensor_only	33.9110μs	8.5464μs	117.0083 KOps/s	116.6825 KOps/s	$\color{#35bf28}+0.28\%$
test_tc_init_nested	0.1200ms	81.8394μs	12.2190 KOps/s	11.9320 KOps/s	$\color{#35bf28}+2.41\%$
test_tc_init_many_fields	38.6810μs	13.8556μs	72.1731 KOps/s	70.3140 KOps/s	$\color{#35bf28}+2.64\%$
test_tc_first_layer_tensor	23.5110μs	1.6845μs	593.6468 KOps/s	575.8294 KOps/s	$\color{#35bf28}+3.09\%$
test_tc_first_layer_tensor_only	2.3906μs	0.3808μs	2.6263 MOps/s	2.5598 MOps/s	$\color{#35bf28}+2.60\%$
test_tc_first_layer_tensor_set	28.4300μs	3.6533μs	273.7248 KOps/s	267.4463 KOps/s	$\color{#35bf28}+2.35\%$
test_tc_first_layer_tensor_only_set	28.0210μs	3.0485μs	328.0255 KOps/s	328.4407 KOps/s	$\color{#d91a1a}-0.13\%$
test_tc_first_layer_nontensor	28.4510μs	5.7654μs	173.4491 KOps/s	169.9768 KOps/s	$\color{#35bf28}+2.04\%$
test_tc_second_layer_tensor	22.0500μs	4.1050μs	243.6025 KOps/s	239.9945 KOps/s	$\color{#35bf28}+1.50\%$
test_tc_second_layer_nontensor	30.5110μs	8.0510μs	124.2089 KOps/s	121.9752 KOps/s	$\color{#35bf28}+1.83\%$
test_unbind	0.2707s	13.5197ms	73.9661 Ops/s	68.8744 Ops/s	$\textbf{\color{#35bf28}+7.39\%}$
test_full_like	4.4880ms	4.3374ms	230.5512 Ops/s	228.7619 Ops/s	$\color{#35bf28}+0.78\%$
test_zeros_like	4.5244ms	4.3664ms	229.0234 Ops/s	230.1380 Ops/s	$\color{#d91a1a}-0.48\%$
test_ones_like	4.5368ms	4.3704ms	228.8122 Ops/s	229.8571 Ops/s	$\color{#d91a1a}-0.45\%$
test_clone	6.6597ms	6.4518ms	154.9949 Ops/s	156.0911 Ops/s	$\color{#d91a1a}-0.70\%$
test_squeeze	76.5020μs	14.2386μs	70.2317 KOps/s	71.3188 KOps/s	$\color{#d91a1a}-1.52\%$
test_unsqueeze	0.1676ms	0.1122ms	8.9129 KOps/s	9.2329 KOps/s	$\color{#d91a1a}-3.47\%$
test_split	0.3167ms	0.1776ms	5.6313 KOps/s	5.7124 KOps/s	$\color{#d91a1a}-1.42\%$
test_permute	0.2346ms	0.1864ms	5.3641 KOps/s	5.3015 KOps/s	$\color{#35bf28}+1.18\%$
test_stack	35.1605ms	34.9327ms	28.6264 Ops/s	19.4131 Ops/s	$\textbf{\color{#35bf28}+47.46\%}$
test_cat	35.4679ms	34.9152ms	28.6408 Ops/s	19.4113 Ops/s	$\textbf{\color{#35bf28}+47.55\%}$
test_sequential_tensordict	0.6554ms	0.5494ms	1.8200 KOps/s	1.7994 KOps/s	$\color{#35bf28}+1.15\%$
test_sequential_graph_module	0.1809ms	0.1137ms	8.7919 KOps/s	8.8583 KOps/s	$\color{#d91a1a}-0.75\%$
test_nested_tensordict	0.8834ms	0.7890ms	1.2674 KOps/s	1.2586 KOps/s	$\color{#35bf28}+0.70\%$
test_nested_graph_module	0.1918ms	0.1249ms	8.0091 KOps/s	8.0628 KOps/s	$\color{#d91a1a}-0.67\%$

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 344. Improved: $\large\color{#35bf28}32$. Worsened: $\large\color{#d91a1a}6$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_collector_preallocated_write[stack_out-cpu-32-2]	0.5842ms	0.1700ms	5.8812 KOps/s	6.0229 KOps/s	$\color{#d91a1a}-2.35\%$
test_collector_preallocated_write[stack_out-cpu-32-8]	0.7336ms	0.2993ms	3.3412 KOps/s	3.3742 KOps/s	$\color{#d91a1a}-0.98\%$
test_collector_preallocated_write[stack_out-cpu-32-32]	0.8519ms	0.7879ms	1.2692 KOps/s	1.2637 KOps/s	$\color{#35bf28}+0.44\%$
test_collector_preallocated_write[stack_out-cpu-4096-2]	0.3911ms	0.3448ms	2.9002 KOps/s	2.9213 KOps/s	$\color{#d91a1a}-0.72\%$
test_collector_preallocated_write[stack_out-cpu-4096-8]	1.6261ms	1.1114ms	899.7330 Ops/s	916.6335 Ops/s	$\color{#d91a1a}-1.84\%$
test_collector_preallocated_write[stack_out-cpu-4096-32]	7.9830ms	7.4870ms	133.5655 Ops/s	133.4839 Ops/s	$\color{#35bf28}+0.06\%$
test_collector_preallocated_write[stack_out-cuda-32-2]	0.3686ms	0.2486ms	4.0229 KOps/s	3.8279 KOps/s	$\textbf{\color{#35bf28}+5.09\%}$
test_collector_preallocated_write[stack_out-cuda-32-8]	0.8256ms	0.3756ms	2.6626 KOps/s	2.6736 KOps/s	$\color{#d91a1a}-0.41\%$
test_collector_preallocated_write[stack_out-cuda-32-32]	1.2633ms	0.8322ms	1.2017 KOps/s	1.2072 KOps/s	$\color{#d91a1a}-0.46\%$
test_collector_preallocated_write[stack_out-cuda-4096-2]	0.6837ms	0.2508ms	3.9876 KOps/s	3.9505 KOps/s	$\color{#35bf28}+0.94\%$
test_collector_preallocated_write[stack_out-cuda-4096-8]	0.8038ms	0.3769ms	2.6530 KOps/s	2.6767 KOps/s	$\color{#d91a1a}-0.89\%$
test_collector_preallocated_write[stack_out-cuda-4096-32]	1.2606ms	0.8909ms	1.1225 KOps/s	1.1240 KOps/s	$\color{#d91a1a}-0.13\%$
test_collector_preallocated_write[set_at_loop-cpu-32-2]	0.2654ms	0.2115ms	4.7273 KOps/s	4.6599 KOps/s	$\color{#35bf28}+1.44\%$
test_collector_preallocated_write[set_at_loop-cpu-32-8]	1.2687ms	0.8224ms	1.2160 KOps/s	1.1969 KOps/s	$\color{#35bf28}+1.60\%$
test_collector_preallocated_write[set_at_loop-cpu-32-32]	3.6854ms	3.2514ms	307.5582 Ops/s	301.1870 Ops/s	$\color{#35bf28}+2.12\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-2]	0.8012ms	0.3652ms	2.7379 KOps/s	2.7098 KOps/s	$\color{#35bf28}+1.04\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-8]	1.8236ms	1.6674ms	599.7520 Ops/s	571.5453 Ops/s	$\color{#35bf28}+4.94\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-32]	10.8341ms	10.3032ms	97.0577 Ops/s	95.6820 Ops/s	$\color{#35bf28}+1.44\%$
test_collector_preallocated_write[set_at_loop-cuda-32-2]	0.4320ms	0.3831ms	2.6100 KOps/s	2.5655 KOps/s	$\color{#35bf28}+1.74\%$
test_collector_preallocated_write[set_at_loop-cuda-32-8]	1.8893ms	1.4315ms	698.5864 Ops/s	635.5927 Ops/s	$\textbf{\color{#35bf28}+9.91\%}$
test_collector_preallocated_write[set_at_loop-cuda-32-32]	6.0473ms	5.6197ms	177.9460 Ops/s	161.5766 Ops/s	$\textbf{\color{#35bf28}+10.13\%}$
test_collector_preallocated_write[set_at_loop-cuda-4096-2]	0.8314ms	0.3848ms	2.5990 KOps/s	2.3740 KOps/s	$\textbf{\color{#35bf28}+9.48\%}$
test_collector_preallocated_write[set_at_loop-cuda-4096-8]	1.9212ms	1.4391ms	694.8913 Ops/s	634.7225 Ops/s	$\textbf{\color{#35bf28}+9.48\%}$
test_collector_preallocated_write[set_at_loop-cuda-4096-32]	6.0792ms	5.6205ms	177.9208 Ops/s	161.6012 Ops/s	$\textbf{\color{#35bf28}+10.10\%}$
test_collector_preallocated_write[copy_at-cpu-32-2]	0.6059ms	0.1694ms	5.9028 KOps/s	5.6621 KOps/s	$\color{#35bf28}+4.25\%$
test_collector_preallocated_write[copy_at-cpu-32-8]	1.0945ms	0.6646ms	1.5047 KOps/s	1.4533 KOps/s	$\color{#35bf28}+3.54\%$
test_collector_preallocated_write[copy_at-cpu-32-32]	3.0544ms	2.6278ms	380.5441 Ops/s	370.4798 Ops/s	$\color{#35bf28}+2.72\%$
test_collector_preallocated_write[copy_at-cpu-4096-2]	0.4545ms	0.3096ms	3.2299 KOps/s	3.1221 KOps/s	$\color{#35bf28}+3.45\%$
test_collector_preallocated_write[copy_at-cpu-4096-8]	1.7297ms	1.4852ms	673.2930 Ops/s	696.1277 Ops/s	$\color{#d91a1a}-3.28\%$
test_collector_preallocated_write[copy_at-cpu-4096-32]	9.9559ms	9.7092ms	102.9946 Ops/s	104.3793 Ops/s	$\color{#d91a1a}-1.33\%$
test_collector_preallocated_write[copy_at-cuda-32-2]	0.4323ms	0.3222ms	3.1041 KOps/s	3.0946 KOps/s	$\color{#35bf28}+0.31\%$
test_collector_preallocated_write[copy_at-cuda-32-8]	1.3656ms	1.1935ms	837.8593 Ops/s	834.1781 Ops/s	$\color{#35bf28}+0.44\%$
test_collector_preallocated_write[copy_at-cuda-32-32]	4.9040ms	4.6607ms	214.5585 Ops/s	212.9094 Ops/s	$\color{#35bf28}+0.77\%$
test_collector_preallocated_write[copy_at-cuda-4096-2]	0.4395ms	0.3230ms	3.0960 KOps/s	3.0759 KOps/s	$\color{#35bf28}+0.65\%$
test_collector_preallocated_write[copy_at-cuda-4096-8]	1.3339ms	1.1976ms	835.0006 Ops/s	831.9027 Ops/s	$\color{#35bf28}+0.37\%$
test_collector_preallocated_write[copy_at-cuda-4096-32]	4.8686ms	4.6825ms	213.5591 Ops/s	212.5041 Ops/s	$\color{#35bf28}+0.50\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-2]	0.1690ms	0.1183ms	8.4521 KOps/s	8.3993 KOps/s	$\color{#35bf28}+0.63\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-8]	0.5107ms	0.4657ms	2.1471 KOps/s	2.1244 KOps/s	$\color{#35bf28}+1.07\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-32]	2.0010ms	1.8516ms	540.0729 Ops/s	541.7809 Ops/s	$\color{#d91a1a}-0.32\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-2]	0.3836ms	0.2622ms	3.8133 KOps/s	4.0373 KOps/s	$\textbf{\color{#d91a1a}-5.55\%}$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-8]	1.4355ms	1.2371ms	808.3322 Ops/s	800.6858 Ops/s	$\color{#35bf28}+0.95\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-32]	9.2272ms	8.7141ms	114.7567 Ops/s	115.0844 Ops/s	$\color{#d91a1a}-0.28\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-2]	0.7143ms	0.2721ms	3.6745 KOps/s	3.6948 KOps/s	$\color{#d91a1a}-0.55\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-8]	1.4682ms	1.0111ms	988.9791 Ops/s	1.0010 KOps/s	$\color{#d91a1a}-1.20\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-32]	4.3696ms	3.9514ms	253.0725 Ops/s	255.2045 Ops/s	$\color{#d91a1a}-0.84\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-2]	0.7014ms	0.2711ms	3.6880 KOps/s	3.7040 KOps/s	$\color{#d91a1a}-0.43\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-8]	1.4641ms	1.0147ms	985.5479 Ops/s	998.2494 Ops/s	$\color{#d91a1a}-1.27\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-32]	4.3675ms	3.9613ms	252.4418 Ops/s	253.4097 Ops/s	$\color{#d91a1a}-0.38\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-128]	16.9985ms	16.5415ms	60.4540 Ops/s	60.2687 Ops/s	$\color{#35bf28}+0.31\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-256]	33.7058ms	33.2228ms	30.0998 Ops/s	30.0335 Ops/s	$\color{#35bf28}+0.22\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-128]	88.4471ms	87.1829ms	11.4701 Ops/s	11.6344 Ops/s	$\color{#d91a1a}-1.41\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-256]	0.2067s	0.2056s	4.8636 Ops/s	4.9601 Ops/s	$\color{#d91a1a}-1.95\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-128]	14.3996ms	13.8733ms	72.0808 Ops/s	72.1644 Ops/s	$\color{#d91a1a}-0.12\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-256]	27.5339ms	27.1052ms	36.8933 Ops/s	37.0122 Ops/s	$\color{#d91a1a}-0.32\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-128]	14.7670ms	14.0228ms	71.3126 Ops/s	71.2933 Ops/s	$\color{#35bf28}+0.03\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-256]	27.8808ms	27.4494ms	36.4307 Ops/s	36.5804 Ops/s	$\color{#d91a1a}-0.41\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-128]	51.3967ms	50.9339ms	19.6333 Ops/s	19.4737 Ops/s	$\color{#35bf28}+0.82\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-256]	0.1038s	0.1032s	9.6937 Ops/s	9.7091 Ops/s	$\color{#d91a1a}-0.16\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-128]	0.1457s	0.1451s	6.8907 Ops/s	6.4934 Ops/s	$\textbf{\color{#35bf28}+6.12\%}$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-256]	0.3199s	0.3195s	3.1300 Ops/s	2.8583 Ops/s	$\textbf{\color{#35bf28}+9.51\%}$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-128]	76.3687ms	73.3018ms	13.6422 Ops/s	12.5325 Ops/s	$\textbf{\color{#35bf28}+8.85\%}$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-256]	0.1466s	0.1461s	6.8466 Ops/s	6.2326 Ops/s	$\textbf{\color{#35bf28}+9.85\%}$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-128]	74.4900ms	73.8445ms	13.5420 Ops/s	12.4967 Ops/s	$\textbf{\color{#35bf28}+8.36\%}$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-256]	0.1473s	0.1467s	6.8175 Ops/s	6.2039 Ops/s	$\textbf{\color{#35bf28}+9.89\%}$
test_wide_nested_preallocated_write[copy_at-cpu-128-128]	30.4035ms	30.2136ms	33.0977 Ops/s	33.3706 Ops/s	$\color{#d91a1a}-0.82\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-256]	61.4207ms	61.1037ms	16.3656 Ops/s	16.2656 Ops/s	$\color{#35bf28}+0.61\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-128]	0.1292s	0.1207s	8.2840 Ops/s	8.2717 Ops/s	$\color{#35bf28}+0.15\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-256]	0.2705s	0.2686s	3.7225 Ops/s	3.6212 Ops/s	$\color{#35bf28}+2.79\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-128]	43.2647ms	42.8677ms	23.3276 Ops/s	23.2528 Ops/s	$\color{#35bf28}+0.32\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-256]	86.5926ms	85.9814ms	11.6304 Ops/s	11.6023 Ops/s	$\color{#35bf28}+0.24\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-128]	43.7255ms	43.1932ms	23.1518 Ops/s	23.1182 Ops/s	$\color{#35bf28}+0.15\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-256]	86.7174ms	86.2292ms	11.5970 Ops/s	11.5325 Ops/s	$\color{#35bf28}+0.56\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-128]	20.8857ms	20.2731ms	49.3263 Ops/s	48.9058 Ops/s	$\color{#35bf28}+0.86\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-256]	41.7336ms	41.2079ms	24.2672 Ops/s	23.6541 Ops/s	$\color{#35bf28}+2.59\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-128]	0.1113s	0.1092s	9.1608 Ops/s	9.0786 Ops/s	$\color{#35bf28}+0.91\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-256]	0.2487s	0.2472s	4.0448 Ops/s	4.0619 Ops/s	$\color{#d91a1a}-0.42\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-128]	36.4439ms	36.0844ms	27.7128 Ops/s	27.4938 Ops/s	$\color{#35bf28}+0.80\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-256]	73.2581ms	72.0951ms	13.8706 Ops/s	13.4635 Ops/s	$\color{#35bf28}+3.02\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-128]	36.3896ms	36.1219ms	27.6840 Ops/s	26.8808 Ops/s	$\color{#35bf28}+2.99\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-256]	72.6084ms	72.1989ms	13.8506 Ops/s	13.5090 Ops/s	$\color{#35bf28}+2.53\%$
test_plain_set_nested	33.0420μs	15.2208μs	65.6995 KOps/s	67.0364 KOps/s	$\color{#d91a1a}-1.99\%$
test_plain_set_stack_nested	32.9510μs	14.6855μs	68.0943 KOps/s	68.0543 KOps/s	$\color{#35bf28}+0.06\%$
test_plain_set_nested_inplace	0.4353ms	16.3511μs	61.1580 KOps/s	61.3359 KOps/s	$\color{#d91a1a}-0.29\%$
test_plain_set_stack_nested_inplace	41.6320μs	16.2055μs	61.7075 KOps/s	60.4253 KOps/s	$\color{#35bf28}+2.12\%$
test_items	0.4288ms	6.0928μs	164.1278 KOps/s	162.6786 KOps/s	$\color{#35bf28}+0.89\%$
test_items_nested	0.8831ms	0.4615ms	2.1667 KOps/s	2.1564 KOps/s	$\color{#35bf28}+0.48\%$
test_items_nested_locked	0.9027ms	0.4652ms	2.1498 KOps/s	2.1484 KOps/s	$\color{#35bf28}+0.07\%$
test_items_nested_leaf	0.5126ms	97.8431μs	10.2204 KOps/s	10.3099 KOps/s	$\color{#d91a1a}-0.87\%$
test_items_stack_nested	0.8862ms	0.4595ms	2.1765 KOps/s	2.1801 KOps/s	$\color{#d91a1a}-0.16\%$
test_items_stack_nested_leaf	0.5242ms	97.8074μs	10.2242 KOps/s	10.3114 KOps/s	$\color{#d91a1a}-0.85\%$
test_items_stack_nested_locked	0.8977ms	0.4651ms	2.1499 KOps/s	2.1586 KOps/s	$\color{#d91a1a}-0.40\%$
test_keys	20.2010μs	4.2392μs	235.8929 KOps/s	239.9375 KOps/s	$\color{#d91a1a}-1.69\%$
test_keys_nested	0.5549ms	0.1292ms	7.7375 KOps/s	7.7361 KOps/s	$\color{#35bf28}+0.02\%$
test_keys_nested_locked	0.7639ms	0.1378ms	7.2567 KOps/s	7.2766 KOps/s	$\color{#d91a1a}-0.27\%$
test_keys_nested_leaf	0.5487ms	0.1206ms	8.2920 KOps/s	8.3425 KOps/s	$\color{#d91a1a}-0.61\%$
test_keys_stack_nested	0.5592ms	0.1293ms	7.7344 KOps/s	7.7183 KOps/s	$\color{#35bf28}+0.21\%$
test_keys_stack_nested_leaf	0.5395ms	0.1186ms	8.4287 KOps/s	8.3866 KOps/s	$\color{#35bf28}+0.50\%$
test_keys_stack_nested_locked	0.2385ms	0.1369ms	7.3059 KOps/s	7.2787 KOps/s	$\color{#35bf28}+0.37\%$
test_values	5.6864μs	1.0074μs	992.6753 KOps/s	977.5474 KOps/s	$\color{#35bf28}+1.55\%$
test_values_nested	88.4250μs	52.6489μs	18.9937 KOps/s	19.2571 KOps/s	$\color{#d91a1a}-1.37\%$
test_values_nested_locked	0.1016ms	55.6168μs	17.9802 KOps/s	18.0955 KOps/s	$\color{#d91a1a}-0.64\%$
test_values_nested_leaf	95.7150μs	60.2799μs	16.5893 KOps/s	16.6866 KOps/s	$\color{#d91a1a}-0.58\%$
test_values_stack_nested	96.6550μs	51.9387μs	19.2535 KOps/s	19.3442 KOps/s	$\color{#d91a1a}-0.47\%$
test_values_stack_nested_leaf	97.2050μs	59.7390μs	16.7395 KOps/s	16.9062 KOps/s	$\color{#d91a1a}-0.99\%$
test_values_stack_nested_locked	94.9250μs	55.5584μs	17.9991 KOps/s	18.2824 KOps/s	$\color{#d91a1a}-1.55\%$
test_membership	4.4285μs	0.8421μs	1.1875 MOps/s	1.1856 MOps/s	$\color{#35bf28}+0.16\%$
test_membership_nested	28.7010μs	2.9239μs	342.0073 KOps/s	341.0948 KOps/s	$\color{#35bf28}+0.27\%$
test_membership_nested_leaf	23.5510μs	2.9440μs	339.6776 KOps/s	340.1053 KOps/s	$\color{#d91a1a}-0.13\%$
test_membership_stacked_nested	34.7320μs	2.8345μs	352.8007 KOps/s	353.2747 KOps/s	$\color{#d91a1a}-0.13\%$
test_membership_stacked_nested_leaf	31.8510μs	2.8470μs	351.2477 KOps/s	351.9767 KOps/s	$\color{#d91a1a}-0.21\%$
test_membership_nested_last	27.9720μs	4.4284μs	225.8154 KOps/s	224.5366 KOps/s	$\color{#35bf28}+0.57\%$
test_membership_nested_leaf_last	28.7310μs	4.4330μs	225.5798 KOps/s	225.6859 KOps/s	$\color{#d91a1a}-0.05\%$
test_membership_stacked_nested_last	39.3120μs	4.2819μs	233.5391 KOps/s	235.8142 KOps/s	$\color{#d91a1a}-0.96\%$
test_membership_stacked_nested_leaf_last	27.2710μs	4.2700μs	234.1917 KOps/s	233.6963 KOps/s	$\color{#35bf28}+0.21\%$
test_nested_getleaf	44.2420μs	21.4715μs	46.5734 KOps/s	48.4018 KOps/s	$\color{#d91a1a}-3.78\%$
test_nested_get	46.9730μs	20.2916μs	49.2815 KOps/s	49.4130 KOps/s	$\color{#d91a1a}-0.27\%$
test_stacked_getleaf	51.8730μs	21.2345μs	47.0933 KOps/s	47.9221 KOps/s	$\color{#d91a1a}-1.73\%$
test_stacked_get	43.4120μs	20.0901μs	49.7758 KOps/s	49.6448 KOps/s	$\color{#35bf28}+0.26\%$
test_nested_getitemleaf	53.9330μs	22.1226μs	45.2026 KOps/s	45.4503 KOps/s	$\color{#d91a1a}-0.54\%$
test_nested_getitem	50.5430μs	20.9551μs	47.7211 KOps/s	48.8241 KOps/s	$\color{#d91a1a}-2.26\%$
test_stacked_getitemleaf	91.6450μs	21.6255μs	46.2418 KOps/s	46.8831 KOps/s	$\color{#d91a1a}-1.37\%$
test_stacked_getitem	43.3230μs	20.6316μs	48.4694 KOps/s	49.7384 KOps/s	$\color{#d91a1a}-2.55\%$
test_lock_nested	8.0038ms	0.5134ms	1.9480 KOps/s	1.9405 KOps/s	$\color{#35bf28}+0.39\%$
test_lock_stack_nested	0.6273ms	0.5081ms	1.9681 KOps/s	1.9523 KOps/s	$\color{#35bf28}+0.81\%$
test_unlock_nested	0.4791ms	0.4004ms	2.4978 KOps/s	2.4716 KOps/s	$\color{#35bf28}+1.06\%$
test_unlock_stack_nested	0.5549ms	0.4028ms	2.4825 KOps/s	2.4520 KOps/s	$\color{#35bf28}+1.24\%$
test_flatten_speed	0.1902ms	0.1227ms	8.1508 KOps/s	8.1065 KOps/s	$\color{#35bf28}+0.55\%$
test_unflatten_speed	0.7253ms	0.5693ms	1.7565 KOps/s	1.7861 KOps/s	$\color{#d91a1a}-1.66\%$
test_common_ops	0.8295ms	0.7132ms	1.4021 KOps/s	1.3988 KOps/s	$\color{#35bf28}+0.24\%$
test_creation	71.6940μs	3.1617μs	316.2870 KOps/s	311.6985 KOps/s	$\color{#35bf28}+1.47\%$
test_creation_empty	31.5020μs	6.9513μs	143.8587 KOps/s	142.0272 KOps/s	$\color{#35bf28}+1.29\%$
test_creation_nested_1	39.0520μs	11.4693μs	87.1890 KOps/s	87.2607 KOps/s	$\color{#d91a1a}-0.08\%$
test_creation_nested_2	36.8020μs	13.3921μs	74.6712 KOps/s	74.5673 KOps/s	$\color{#35bf28}+0.14\%$
test_creation_many_keys[10]	54.6330μs	20.7205μs	48.2614 KOps/s	47.7081 KOps/s	$\color{#35bf28}+1.16\%$
test_creation_many_keys[50]	0.1346ms	88.2556μs	11.3307 KOps/s	11.1752 KOps/s	$\color{#35bf28}+1.39\%$
test_creation_many_keys[100]	0.2516ms	0.1750ms	5.7134 KOps/s	5.6054 KOps/s	$\color{#35bf28}+1.93\%$
test_creation_nested_many_keys[10]	82.8950μs	44.9443μs	22.2498 KOps/s	22.4432 KOps/s	$\color{#d91a1a}-0.86\%$
test_creation_nested_many_keys[50]	0.2623ms	0.1822ms	5.4873 KOps/s	5.4735 KOps/s	$\color{#35bf28}+0.25\%$
test_clone	42.8120μs	13.5317μs	73.9004 KOps/s	74.3130 KOps/s	$\color{#d91a1a}-0.56\%$
test_getitem[int]	1.4957ms	15.2509μs	65.5700 KOps/s	65.9257 KOps/s	$\color{#d91a1a}-0.54\%$
test_getitem[slice_int]	0.1414ms	23.9739μs	41.7121 KOps/s	40.5355 KOps/s	$\color{#35bf28}+2.90\%$
test_getitem[range]	0.1612ms	62.5283μs	15.9928 KOps/s	15.8390 KOps/s	$\color{#35bf28}+0.97\%$
test_getitem[tuple]	0.1449ms	24.3206μs	41.1174 KOps/s	40.7001 KOps/s	$\color{#35bf28}+1.03\%$
test_getitem[list]	0.1876ms	59.1817μs	16.8971 KOps/s	16.9651 KOps/s	$\color{#d91a1a}-0.40\%$
test_setitem_dim[int]	46.0020μs	25.8728μs	38.6506 KOps/s	38.8261 KOps/s	$\color{#d91a1a}-0.45\%$
test_setitem_dim[slice_int]	64.6930μs	43.1186μs	23.1919 KOps/s	23.2587 KOps/s	$\color{#d91a1a}-0.29\%$
test_setitem_dim[range]	0.1222ms	95.7908μs	10.4394 KOps/s	10.5291 KOps/s	$\color{#d91a1a}-0.85\%$
test_setitem_dim[tuple]	67.4430μs	39.7832μs	25.1362 KOps/s	25.1604 KOps/s	$\color{#d91a1a}-0.10\%$
test_setitem	46.7420μs	17.8204μs	56.1153 KOps/s	55.0865 KOps/s	$\color{#35bf28}+1.87\%$
test_set	44.7230μs	17.1556μs	58.2899 KOps/s	58.0607 KOps/s	$\color{#35bf28}+0.39\%$
test_set_shared	0.6214ms	0.2070ms	4.8310 KOps/s	4.7853 KOps/s	$\color{#35bf28}+0.96\%$
test_update	0.4981ms	21.7279μs	46.0237 KOps/s	44.9046 KOps/s	$\color{#35bf28}+2.49\%$
test_update_nested	63.5430μs	34.6871μs	28.8292 KOps/s	28.8641 KOps/s	$\color{#d91a1a}-0.12\%$
test_update__nested	0.4690ms	33.6837μs	29.6879 KOps/s	29.9782 KOps/s	$\color{#d91a1a}-0.97\%$
test_set_nested	53.6030μs	18.9478μs	52.7765 KOps/s	51.9933 KOps/s	$\color{#35bf28}+1.51\%$
test_set_nested_new	72.9240μs	23.8962μs	41.8476 KOps/s	41.6959 KOps/s	$\color{#35bf28}+0.36\%$
test_select	76.3540μs	40.4025μs	24.7510 KOps/s	24.3375 KOps/s	$\color{#35bf28}+1.70\%$
test_select_nested	0.1342ms	74.2256μs	13.4724 KOps/s	13.5064 KOps/s	$\color{#d91a1a}-0.25\%$
test_exclude_nested	0.1371ms	91.3262μs	10.9498 KOps/s	10.9291 KOps/s	$\color{#35bf28}+0.19\%$
test_empty[True]	0.5797ms	0.3994ms	2.5035 KOps/s	2.5158 KOps/s	$\color{#d91a1a}-0.49\%$
test_empty[False]	11.1830μs	1.4043μs	712.1061 KOps/s	708.6078 KOps/s	$\color{#35bf28}+0.49\%$
test_to	0.1146ms	69.2879μs	14.4325 KOps/s	14.2112 KOps/s	$\color{#35bf28}+1.56\%$
test_to_nonblocking	0.1135ms	69.7237μs	14.3423 KOps/s	14.5004 KOps/s	$\color{#d91a1a}-1.09\%$
test_unbind_speed	0.3799ms	0.3373ms	2.9644 KOps/s	2.9522 KOps/s	$\color{#35bf28}+0.41\%$
test_unbind_speed_stack0	0.4727ms	0.3363ms	2.9735 KOps/s	2.9781 KOps/s	$\color{#d91a1a}-0.16\%$
test_unbind_speed_stack1	0.1151s	0.8628ms	1.1590 KOps/s	1.1595 KOps/s	$\color{#d91a1a}-0.04\%$
test_split	0.1146s	1.2866ms	777.2466 Ops/s	712.7594 Ops/s	$\textbf{\color{#35bf28}+9.05\%}$
test_chunk	1.2818ms	1.0919ms	915.8698 Ops/s	912.6093 Ops/s	$\color{#35bf28}+0.36\%$
test_to_cpu_blocking	0.1336s	22.0225ms	45.4082 Ops/s	51.1831 Ops/s	$\textbf{\color{#d91a1a}-11.28\%}$
test_to_cpu_global_sync	11.9988ms	11.8440ms	84.4307 Ops/s	84.0123 Ops/s	$\color{#35bf28}+0.50\%$
test_to_cpu_event_sync	13.2600ms	12.8071ms	78.0814 Ops/s	69.9811 Ops/s	$\textbf{\color{#35bf28}+11.58\%}$
test_to_cpu_default	13.1318ms	12.7907ms	78.1820 Ops/s	78.3276 Ops/s	$\color{#d91a1a}-0.19\%$
test_consolidate[False-None]	4.4952ms	4.1389ms	241.6096 Ops/s	238.9040 Ops/s	$\color{#35bf28}+1.13\%$
test_consolidate[default-None]	3.4831ms	2.1462ms	465.9479 Ops/s	457.8175 Ops/s	$\color{#35bf28}+1.78\%$
test_consolidate[reduce-overhead-None]	3.4930ms	2.0754ms	481.8304 Ops/s	468.5744 Ops/s	$\color{#35bf28}+2.83\%$
test_consolidate_njt[False-None]	8.5933ms	8.4770ms	117.9663 Ops/s	115.7948 Ops/s	$\color{#35bf28}+1.88\%$
test_to[False-False-None]	2.4322ms	2.1592ms	463.1349 Ops/s	454.7499 Ops/s	$\color{#35bf28}+1.84\%$
test_to[True-False-None]	2.1678ms	1.9177ms	521.4662 Ops/s	519.1949 Ops/s	$\color{#35bf28}+0.44\%$
test_to[within-False-None]	6.4506ms	6.2280ms	160.5654 Ops/s	160.4177 Ops/s	$\color{#35bf28}+0.09\%$
test_to[True-default-None]	11.0675ms	10.8839ms	91.8791 Ops/s	90.6249 Ops/s	$\color{#35bf28}+1.38\%$
test_to_njt[False-False-None]	8.9668ms	8.6223ms	115.9779 Ops/s	113.4279 Ops/s	$\color{#35bf28}+2.25\%$
test_to_njt[True-False-None]	7.4727ms	7.2245ms	138.4171 Ops/s	142.1347 Ops/s	$\color{#d91a1a}-2.62\%$
test_to_njt[within-False-None]	16.8382ms	15.8822ms	62.9634 Ops/s	63.4888 Ops/s	$\color{#d91a1a}-0.83\%$
test_creation[device0]	0.4309ms	0.1192ms	8.3897 KOps/s	8.4193 KOps/s	$\color{#d91a1a}-0.35\%$
test_creation_from_tensor	0.4409ms	0.1165ms	8.5838 KOps/s	8.7032 KOps/s	$\color{#d91a1a}-1.37\%$
test_add_one[memmap_tensor0]	0.3382ms	6.8208μs	146.6109 KOps/s	147.2911 KOps/s	$\color{#d91a1a}-0.46\%$
test_contiguous[memmap_tensor0]	28.6920μs	0.6622μs	1.5101 MOps/s	2.2339 MOps/s	$\textbf{\color{#d91a1a}-32.40\%}$
test_stack[memmap_tensor0]	94.3250μs	4.2289μs	236.4677 KOps/s	238.8863 KOps/s	$\color{#d91a1a}-1.01\%$
test_memmaptd_index	1.3544ms	0.2707ms	3.6943 KOps/s	3.6645 KOps/s	$\color{#35bf28}+0.81\%$
test_memmaptd_index_astensor	0.5719ms	0.3872ms	2.5824 KOps/s	2.6529 KOps/s	$\color{#d91a1a}-2.66\%$
test_memmaptd_index_op	0.7829ms	0.6418ms	1.5582 KOps/s	1.5519 KOps/s	$\color{#35bf28}+0.40\%$
test_serialize_model	0.1360s	0.1348s	7.4199 Ops/s	7.3932 Ops/s	$\color{#35bf28}+0.36\%$
test_serialize_model_pickle	1.3510s	1.2106s	0.8260 Ops/s	0.8263 Ops/s	$\color{#d91a1a}-0.03\%$
test_serialize_weights	0.1343s	0.1328s	7.5300 Ops/s	7.4749 Ops/s	$\color{#35bf28}+0.74\%$
test_serialize_weights_returnearly	81.0045ms	64.0572ms	15.6110 Ops/s	15.4394 Ops/s	$\color{#35bf28}+1.11\%$
test_serialize_weights_pickle	1.3646s	1.2130s	0.8244 Ops/s	0.8233 Ops/s	$\color{#35bf28}+0.14\%$
test_reshape_pytree	0.2131ms	32.7063μs	30.5752 KOps/s	30.7272 KOps/s	$\color{#d91a1a}-0.49\%$
test_reshape_td	81.3650μs	45.1677μs	22.1397 KOps/s	22.3118 KOps/s	$\color{#d91a1a}-0.77\%$
test_view_pytree	0.2238ms	32.2654μs	30.9929 KOps/s	31.0394 KOps/s	$\color{#d91a1a}-0.15\%$
test_view_td	75.6940μs	53.9878μs	18.5227 KOps/s	18.4590 KOps/s	$\color{#35bf28}+0.35\%$
test_unbind_pytree	0.2401ms	36.6018μs	27.3210 KOps/s	26.9610 KOps/s	$\color{#35bf28}+1.34\%$
test_unbind_td	0.1273ms	50.8727μs	19.6569 KOps/s	19.7894 KOps/s	$\color{#d91a1a}-0.67\%$
test_split_pytree	0.2517ms	42.0733μs	23.7680 KOps/s	23.5520 KOps/s	$\color{#35bf28}+0.92\%$
test_split_td	0.1349ms	65.8554μs	15.1848 KOps/s	15.1587 KOps/s	$\color{#35bf28}+0.17\%$
test_add_pytree	0.2351ms	42.8308μs	23.3477 KOps/s	23.4355 KOps/s	$\color{#d91a1a}-0.37\%$
test_add_td	0.1079ms	54.8319μs	18.2376 KOps/s	17.8760 KOps/s	$\color{#35bf28}+2.02\%$
test_compile_add_one_nested[tensordict-compile]	0.3484ms	0.2299ms	4.3503 KOps/s	4.2035 KOps/s	$\color{#35bf28}+3.49\%$
test_compile_add_one_nested[tensordict-eager]	0.4391ms	0.1992ms	5.0200 KOps/s	5.0571 KOps/s	$\color{#d91a1a}-0.73\%$
test_compile_add_one_nested[pytree-compile]	0.2629ms	0.1364ms	7.3289 KOps/s	7.1579 KOps/s	$\color{#35bf28}+2.39\%$
test_compile_add_one_nested[pytree-eager]	0.4577ms	0.1793ms	5.5787 KOps/s	5.4607 KOps/s	$\color{#35bf28}+2.16\%$
test_compile_copy_nested[tensordict-compile]	68.2740μs	15.4418μs	64.7592 KOps/s	68.2097 KOps/s	$\textbf{\color{#d91a1a}-5.06\%}$
test_compile_copy_nested[tensordict-eager]	0.3462ms	51.8574μs	19.2836 KOps/s	18.4073 KOps/s	$\color{#35bf28}+4.76\%$
test_compile_copy_nested[pytree-compile]	0.1374ms	15.6187μs	64.0257 KOps/s	63.3331 KOps/s	$\color{#35bf28}+1.09\%$
test_compile_copy_nested[pytree-eager]	0.4248ms	68.2347μs	14.6553 KOps/s	14.4782 KOps/s	$\color{#35bf28}+1.22\%$
test_compile_add_one_flat[tensordict-compile]	0.3193ms	0.2664ms	3.7532 KOps/s	3.7865 KOps/s	$\color{#d91a1a}-0.88\%$
test_compile_add_one_flat[tensordict-eager]	0.3652ms	0.2798ms	3.5735 KOps/s	3.5406 KOps/s	$\color{#35bf28}+0.93\%$
test_compile_add_one_flat[tensorclass-compile]	0.2607ms	0.1965ms	5.0891 KOps/s	5.0618 KOps/s	$\color{#35bf28}+0.54\%$
test_compile_add_one_flat[tensorclass-eager]	0.1212ms	77.4260μs	12.9156 KOps/s	13.4863 KOps/s	$\color{#d91a1a}-4.23\%$
test_compile_add_one_flat[pytree-compile]	0.2615ms	0.1938ms	5.1600 KOps/s	5.0154 KOps/s	$\color{#35bf28}+2.88\%$
test_compile_add_one_flat[pytree-eager]	0.8105ms	0.5285ms	1.8921 KOps/s	1.9165 KOps/s	$\color{#d91a1a}-1.27\%$
test_compile_add_self_flat[tensordict-eager]	0.3796ms	0.3271ms	3.0573 KOps/s	2.9946 KOps/s	$\color{#35bf28}+2.09\%$
test_compile_add_self_flat[tensordict-compile]	0.3264ms	0.2667ms	3.7496 KOps/s	3.6123 KOps/s	$\color{#35bf28}+3.80\%$
test_compile_add_self_flat[tensorclass-eager]	0.1504ms	93.8535μs	10.6549 KOps/s	11.0475 KOps/s	$\color{#d91a1a}-3.55\%$
test_compile_add_self_flat[tensorclass-compile]	0.3369ms	0.1916ms	5.2189 KOps/s	4.8922 KOps/s	$\textbf{\color{#35bf28}+6.68\%}$
test_compile_add_self_flat[pytree-eager]	0.6831ms	0.4300ms	2.3257 KOps/s	2.3214 KOps/s	$\color{#35bf28}+0.19\%$
test_compile_add_self_flat[pytree-compile]	0.2701ms	0.1977ms	5.0588 KOps/s	4.9175 KOps/s	$\color{#35bf28}+2.87\%$
test_compile_copy_flat[tensordict-compile]	78.3840μs	20.3419μs	49.1595 KOps/s	49.6755 KOps/s	$\color{#d91a1a}-1.04\%$
test_compile_copy_flat[tensordict-eager]	0.1082ms	40.9695μs	24.4084 KOps/s	24.5559 KOps/s	$\color{#d91a1a}-0.60\%$
test_compile_copy_flat[pytree-compile]	0.2290ms	21.5272μs	46.4528 KOps/s	44.7421 KOps/s	$\color{#35bf28}+3.82\%$
test_compile_copy_flat[pytree-eager]	0.3549ms	51.3441μs	19.4764 KOps/s	19.2709 KOps/s	$\color{#35bf28}+1.07\%$
test_compile_assign_and_add[tensordict-compile]	2.2109ms	0.2452ms	4.0784 KOps/s	3.7798 KOps/s	$\textbf{\color{#35bf28}+7.90\%}$
test_compile_assign_and_add[tensordict-eager]	3.3333ms	3.1949ms	313.0009 Ops/s	304.1950 Ops/s	$\color{#35bf28}+2.89\%$
test_compile_assign_and_add[pytree-compile]	2.1012ms	0.1822ms	5.4870 KOps/s	5.2735 KOps/s	$\color{#35bf28}+4.05\%$
test_compile_assign_and_add[pytree-eager]	2.9924ms	2.7729ms	360.6372 Ops/s	353.4114 Ops/s	$\color{#35bf28}+2.04\%$
test_compile_indexing[tensor-tensordict-compile]	0.2721ms	0.1369ms	7.3071 KOps/s	6.8918 KOps/s	$\textbf{\color{#35bf28}+6.03\%}$
test_compile_indexing[tensor-tensordict-eager]	0.5543ms	73.7952μs	13.5510 KOps/s	12.8578 KOps/s	$\textbf{\color{#35bf28}+5.39\%}$
test_compile_indexing[tensor-tensorclass-compile]	0.2984ms	0.1207ms	8.2874 KOps/s	8.3314 KOps/s	$\color{#d91a1a}-0.53\%$
test_compile_indexing[tensor-tensorclass-eager]	0.3038ms	43.6117μs	22.9296 KOps/s	22.7559 KOps/s	$\color{#35bf28}+0.76\%$
test_compile_indexing[tensor-pytree-compile]	0.1764ms	0.1239ms	8.0722 KOps/s	8.2471 KOps/s	$\color{#d91a1a}-2.12\%$
test_compile_indexing[tensor-pytree-eager]	0.2659ms	43.7117μs	22.8771 KOps/s	21.6281 KOps/s	$\textbf{\color{#35bf28}+5.78\%}$
test_compile_indexing[slice-tensordict-compile]	0.1374ms	83.2975μs	12.0052 KOps/s	11.4751 KOps/s	$\color{#35bf28}+4.62\%$
test_compile_indexing[slice-tensordict-eager]	0.2245ms	26.6858μs	37.4731 KOps/s	36.7751 KOps/s	$\color{#35bf28}+1.90\%$
test_compile_indexing[slice-tensorclass-compile]	0.1881ms	70.4350μs	14.1975 KOps/s	13.9104 KOps/s	$\color{#35bf28}+2.06\%$
test_compile_indexing[slice-tensorclass-eager]	0.2503ms	21.8993μs	45.6637 KOps/s	44.9389 KOps/s	$\color{#35bf28}+1.61\%$
test_compile_indexing[slice-pytree-compile]	0.1174ms	71.2275μs	14.0395 KOps/s	14.1242 KOps/s	$\color{#d91a1a}-0.60\%$
test_compile_indexing[slice-pytree-eager]	0.2431ms	21.8565μs	45.7531 KOps/s	45.5693 KOps/s	$\color{#35bf28}+0.40\%$
test_compile_indexing[int-tensordict-compile]	0.1327ms	84.3696μs	11.8526 KOps/s	11.3652 KOps/s	$\color{#35bf28}+4.29\%$
test_compile_indexing[int-tensordict-eager]	0.2275ms	26.5772μs	37.6262 KOps/s	35.6861 KOps/s	$\textbf{\color{#35bf28}+5.44\%}$
test_compile_indexing[int-tensorclass-compile]	0.1120ms	71.1539μs	14.0540 KOps/s	13.3321 KOps/s	$\textbf{\color{#35bf28}+5.42\%}$
test_compile_indexing[int-tensorclass-eager]	0.2422ms	21.9447μs	45.5691 KOps/s	45.5937 KOps/s	$\color{#d91a1a}-0.05\%$
test_compile_indexing[int-pytree-compile]	0.1094ms	71.6167μs	13.9632 KOps/s	13.8330 KOps/s	$\color{#35bf28}+0.94\%$
test_compile_indexing[int-pytree-eager]	0.2111ms	21.8975μs	45.6672 KOps/s	45.2422 KOps/s	$\color{#35bf28}+0.94\%$
test_compile_replace[single-eager]	89.6350μs	46.5713μs	21.4725 KOps/s	21.3356 KOps/s	$\color{#35bf28}+0.64\%$
test_compile_replace[single-compile]	0.2523ms	0.1357ms	7.3703 KOps/s	7.4044 KOps/s	$\color{#d91a1a}-0.46\%$
test_compile_replace[multi-eager]	0.6503ms	0.5630ms	1.7763 KOps/s	1.7101 KOps/s	$\color{#35bf28}+3.88\%$
test_compile_replace[multi-compile]	0.2016ms	0.1409ms	7.0966 KOps/s	6.7995 KOps/s	$\color{#35bf28}+4.37\%$
test_compile_tc_getattr_20[eager]	0.2021ms	0.1661ms	6.0192 KOps/s	6.0671 KOps/s	$\color{#d91a1a}-0.79\%$
test_compile_tc_getattr_20[compile]	0.2556ms	0.1522ms	6.5687 KOps/s	6.5714 KOps/s	$\color{#d91a1a}-0.04\%$
test_compile_clone_shallow[20-eager]	61.6540μs	19.0616μs	52.4616 KOps/s	52.4198 KOps/s	$\color{#35bf28}+0.08\%$
test_compile_clone_shallow[20-compile]	91.4550μs	16.5233μs	60.5205 KOps/s	59.7762 KOps/s	$\color{#35bf28}+1.25\%$
test_compile_clone_shallow[40-eager]	82.8440μs	33.4179μs	29.9241 KOps/s	29.9872 KOps/s	$\color{#d91a1a}-0.21\%$
test_compile_clone_shallow[40-compile]	0.1093ms	18.2880μs	54.6807 KOps/s	53.0693 KOps/s	$\color{#35bf28}+3.04\%$
test_compile_clone_shallow[80-eager]	0.1019ms	61.6010μs	16.2335 KOps/s	16.0380 KOps/s	$\color{#35bf28}+1.22\%$
test_compile_clone_shallow[80-compile]	89.9240μs	21.7945μs	45.8832 KOps/s	43.5032 KOps/s	$\textbf{\color{#35bf28}+5.47\%}$
test_compile_update_inplace[eager]	0.2395ms	61.7674μs	16.1898 KOps/s	16.4047 KOps/s	$\color{#d91a1a}-1.31\%$
test_compile_update_inplace[compile]	0.3474ms	0.1469ms	6.8062 KOps/s	6.6523 KOps/s	$\color{#35bf28}+2.31\%$
test_mod_add[eager]	0.2861ms	0.2269ms	4.4067 KOps/s	4.3297 KOps/s	$\color{#35bf28}+1.78\%$
test_mod_add[compile]	0.2558ms	0.1332ms	7.5067 KOps/s	7.3333 KOps/s	$\color{#35bf28}+2.36\%$
test_mod_add[compile-overhead]	0.2644ms	0.1767ms	5.6588 KOps/s	5.5338 KOps/s	$\color{#35bf28}+2.26\%$
test_mod_wrap[eager]	0.5833ms	0.4682ms	2.1358 KOps/s	2.1139 KOps/s	$\color{#35bf28}+1.04\%$
test_mod_wrap[compile]	0.4746ms	0.3966ms	2.5213 KOps/s	2.3539 KOps/s	$\textbf{\color{#35bf28}+7.12\%}$
test_mod_wrap[compile-overhead]	8.2688ms	4.5940ms	217.6772 Ops/s	223.6397 Ops/s	$\color{#d91a1a}-2.67\%$
test_mod_wrap_and_backward[eager]	2.3915ms	1.7002ms	588.1631 Ops/s	587.3212 Ops/s	$\color{#35bf28}+0.14\%$
test_mod_wrap_and_backward[compile]	2.1340ms	1.5223ms	656.8842 Ops/s	637.8643 Ops/s	$\color{#35bf28}+2.98\%$
test_mod_wrap_and_backward[compile-overhead]	1.3370ms	0.9314ms	1.0736 KOps/s	1.0386 KOps/s	$\color{#35bf28}+3.37\%$
test_seq_add[eager]	0.5931ms	0.5114ms	1.9556 KOps/s	1.8859 KOps/s	$\color{#35bf28}+3.70\%$
test_seq_add[compile]	0.2432ms	0.1398ms	7.1537 KOps/s	6.3909 KOps/s	$\textbf{\color{#35bf28}+11.94\%}$
test_seq_add[compile-overhead]	0.3645ms	0.1927ms	5.1908 KOps/s	5.0587 KOps/s	$\color{#35bf28}+2.61\%$
test_seq_wrap[eager]	1.5149ms	1.4098ms	709.3212 Ops/s	680.9158 Ops/s	$\color{#35bf28}+4.17\%$
test_seq_wrap[compile]	0.4763ms	0.4126ms	2.4237 KOps/s	2.2288 KOps/s	$\textbf{\color{#35bf28}+8.74\%}$
test_seq_wrap[compile-overhead]	0.4265ms	0.3044ms	3.2848 KOps/s	3.0815 KOps/s	$\textbf{\color{#35bf28}+6.60\%}$
test_func_call_runtime[False-eager]	0.9225ms	0.8443ms	1.1844 KOps/s	1.1524 KOps/s	$\color{#35bf28}+2.77\%$
test_func_call_runtime[False-compile]	1.1020ms	1.0128ms	987.4007 Ops/s	956.6754 Ops/s	$\color{#35bf28}+3.21\%$
test_func_call_runtime[False-compile-overhead]	0.6893ms	0.5081ms	1.9681 KOps/s	1.9348 KOps/s	$\color{#35bf28}+1.72\%$
test_func_call_runtime[True-eager]	1.1659ms	1.0675ms	936.7595 Ops/s	881.6820 Ops/s	$\textbf{\color{#35bf28}+6.25\%}$
test_func_call_runtime[True-compile]	1.1460ms	1.0309ms	970.0714 Ops/s	966.9243 Ops/s	$\color{#35bf28}+0.33\%$
test_func_call_runtime[True-compile-overhead]	0.5916ms	0.5236ms	1.9100 KOps/s	1.8653 KOps/s	$\color{#35bf28}+2.40\%$
test_func_call_cm_runtime[False-eager]	0.8562ms	0.7950ms	1.2579 KOps/s	1.1600 KOps/s	$\textbf{\color{#35bf28}+8.44\%}$
test_func_call_cm_runtime[False-compile]	1.1379ms	0.9834ms	1.0169 KOps/s	989.0176 Ops/s	$\color{#35bf28}+2.82\%$
test_func_call_cm_runtime[False-compile-overhead]	0.6866ms	0.4880ms	2.0490 KOps/s	2.0099 KOps/s	$\color{#35bf28}+1.95\%$
test_func_call_cm_runtime[True-eager]	1.3951ms	1.2133ms	824.1697 Ops/s	778.4875 Ops/s	$\textbf{\color{#35bf28}+5.87\%}$
test_func_call_cm_runtime[True-compile]	1.1242ms	1.0389ms	962.5488 Ops/s	931.3704 Ops/s	$\color{#35bf28}+3.35\%$
test_func_call_cm_runtime[True-compile-overhead]	0.6335ms	0.5456ms	1.8328 KOps/s	1.7971 KOps/s	$\color{#35bf28}+1.99\%$
test_vmap_func_call_cm_runtime[eager]	2.9460ms	2.4183ms	413.5191 Ops/s	408.9774 Ops/s	$\color{#35bf28}+1.11\%$
test_vmap_func_call_cm_runtime[compile]	3.1030ms	2.6012ms	384.4318 Ops/s	380.7526 Ops/s	$\color{#35bf28}+0.97\%$
test_vmap_func_call_cm_runtime[compile-overhead]	3.0699ms	2.6071ms	383.5716 Ops/s	380.8123 Ops/s	$\color{#35bf28}+0.72\%$
test_distributed	0.6206ms	0.1428ms	7.0038 KOps/s	6.8795 KOps/s	$\color{#35bf28}+1.81\%$
test_tdmodule	0.7353ms	0.1934ms	5.1700 KOps/s	5.0336 KOps/s	$\color{#35bf28}+2.71\%$
test_tdmodule_dispatch	0.4354ms	0.3745ms	2.6700 KOps/s	2.6058 KOps/s	$\color{#35bf28}+2.46\%$
test_tdseq	52.7530μs	26.8618μs	37.2275 KOps/s	36.3580 KOps/s	$\color{#35bf28}+2.39\%$
test_tdseq_dispatch	0.2446ms	0.2175ms	4.5975 KOps/s	4.5489 KOps/s	$\color{#35bf28}+1.07\%$
test_instantiation_functorch	2.1260ms	2.0473ms	488.4375 Ops/s	483.2491 Ops/s	$\color{#35bf28}+1.07\%$
test_exec_functorch	0.2328ms	0.1817ms	5.5046 KOps/s	5.3508 KOps/s	$\color{#35bf28}+2.87\%$
test_exec_functional_call	0.2485ms	0.1607ms	6.2233 KOps/s	6.1594 KOps/s	$\color{#35bf28}+1.04\%$
test_exec_td_decorator	0.5010ms	0.2524ms	3.9625 KOps/s	3.9735 KOps/s	$\color{#d91a1a}-0.28\%$
test_vmap_mlp_speed_decorator[True-True]	1.2562ms	1.0448ms	957.1470 Ops/s	913.5751 Ops/s	$\color{#35bf28}+4.77\%$
test_vmap_mlp_speed_decorator[True-False]	1.2445ms	1.0411ms	960.5579 Ops/s	929.8946 Ops/s	$\color{#35bf28}+3.30\%$
test_vmap_mlp_speed_decorator[False-True]	0.9117ms	0.7441ms	1.3438 KOps/s	1.3370 KOps/s	$\color{#35bf28}+0.51\%$
test_vmap_mlp_speed_decorator[False-False]	0.9515ms	0.7426ms	1.3466 KOps/s	1.3412 KOps/s	$\color{#35bf28}+0.41\%$
test_vmap_transformer_speed_decorator[True-True]	21.2507ms	21.0507ms	47.5045 Ops/s	47.0415 Ops/s	$\color{#35bf28}+0.98\%$
test_vmap_transformer_speed_decorator[True-False]	21.2077ms	21.0732ms	47.4537 Ops/s	46.8188 Ops/s	$\color{#35bf28}+1.36\%$
test_vmap_transformer_speed_decorator[False-True]	21.4492ms	20.6933ms	48.3249 Ops/s	47.7854 Ops/s	$\color{#35bf28}+1.13\%$
test_vmap_transformer_speed_decorator[False-False]	21.5254ms	20.7063ms	48.2945 Ops/s	47.8418 Ops/s	$\color{#35bf28}+0.95\%$
test_to_module_speed[True]	2.2797ms	1.6529ms	604.9810 Ops/s	597.5246 Ops/s	$\color{#35bf28}+1.25\%$
test_to_module_speed[False]	2.1998ms	1.6307ms	613.2495 Ops/s	605.8859 Ops/s	$\color{#35bf28}+1.22\%$
test_to_module_plain_tensor_speed[None]	2.4036ms	1.7516ms	570.9107 Ops/s	571.5458 Ops/s	$\color{#d91a1a}-0.11\%$
test_to_module_plain_tensor_speed[False]	1.6890ms	1.5958ms	626.6580 Ops/s	628.3543 Ops/s	$\color{#d91a1a}-0.27\%$
test_to_module_plain_tensor_speed[True]	3.4750ms	3.3825ms	295.6376 Ops/s	294.9778 Ops/s	$\color{#35bf28}+0.22\%$
test_tc_init	64.0230μs	42.5110μs	23.5233 KOps/s	23.0249 KOps/s	$\color{#35bf28}+2.16\%$
test_tc_init_tensor_only	44.7720μs	9.1089μs	109.7833 KOps/s	110.0436 KOps/s	$\color{#d91a1a}-0.24\%$
test_tc_init_nested	0.1145ms	84.2916μs	11.8636 KOps/s	11.5913 KOps/s	$\color{#35bf28}+2.35\%$
test_tc_init_many_fields	34.9810μs	14.9194μs	67.0269 KOps/s	66.4271 KOps/s	$\color{#35bf28}+0.90\%$
test_tc_first_layer_tensor	22.8620μs	1.8154μs	550.8556 KOps/s	551.8716 KOps/s	$\color{#d91a1a}-0.18\%$
test_tc_first_layer_tensor_only	3.5062μs	0.4052μs	2.4681 MOps/s	2.4818 MOps/s	$\color{#d91a1a}-0.55\%$
test_tc_first_layer_tensor_set	27.9720μs	3.9798μs	251.2715 KOps/s	250.7710 KOps/s	$\color{#35bf28}+0.20\%$
test_tc_first_layer_tensor_only_set	22.6310μs	3.2374μs	308.8858 KOps/s	306.8691 KOps/s	$\color{#35bf28}+0.66\%$
test_tc_first_layer_nontensor	36.0720μs	6.1617μs	162.2931 KOps/s	162.9274 KOps/s	$\color{#d91a1a}-0.39\%$
test_tc_second_layer_tensor	20.7510μs	4.3884μs	227.8754 KOps/s	229.0145 KOps/s	$\color{#d91a1a}-0.50\%$
test_tc_second_layer_nontensor	43.8420μs	8.6803μs	115.2034 KOps/s	116.2437 KOps/s	$\color{#d91a1a}-0.89\%$
test_unbind	0.2748s	14.0360ms	71.2454 Ops/s	67.4816 Ops/s	$\textbf{\color{#35bf28}+5.58\%}$
test_full_like	4.6226ms	4.4070ms	226.9138 Ops/s	227.3631 Ops/s	$\color{#d91a1a}-0.20\%$
test_zeros_like	4.5916ms	4.3727ms	228.6901 Ops/s	228.4641 Ops/s	$\color{#35bf28}+0.10\%$
test_ones_like	4.8411ms	4.4053ms	226.9989 Ops/s	227.8220 Ops/s	$\color{#d91a1a}-0.36\%$
test_clone	7.0292ms	6.6382ms	150.6438 Ops/s	151.4522 Ops/s	$\color{#d91a1a}-0.53\%$
test_squeeze	70.8540μs	14.3597μs	69.6394 KOps/s	69.2218 KOps/s	$\color{#35bf28}+0.60\%$
test_unsqueeze	0.1656ms	0.1148ms	8.7121 KOps/s	8.9781 KOps/s	$\color{#d91a1a}-2.96\%$
test_split	0.4335ms	0.1811ms	5.5205 KOps/s	5.4927 KOps/s	$\color{#35bf28}+0.51\%$
test_permute	0.2500ms	0.1940ms	5.1541 KOps/s	5.2019 KOps/s	$\color{#d91a1a}-0.92\%$
test_stack	52.4028ms	51.3231ms	19.4844 Ops/s	53.7306 Ops/s	$\textbf{\color{#d91a1a}-63.74\%}$
test_cat	53.1827ms	52.1089ms	19.1906 Ops/s	53.8852 Ops/s	$\textbf{\color{#d91a1a}-64.39\%}$
test_sequential_tensordict	0.6451ms	0.5730ms	1.7453 KOps/s	1.6892 KOps/s	$\color{#35bf28}+3.32\%$
test_sequential_graph_module	0.5119ms	0.1188ms	8.4161 KOps/s	7.9823 KOps/s	$\textbf{\color{#35bf28}+5.43\%}$
test_nested_tensordict	0.9238ms	0.8202ms	1.2192 KOps/s	1.2061 KOps/s	$\color{#35bf28}+1.08\%$
test_nested_graph_module	0.2517ms	0.1299ms	7.6972 KOps/s	7.2678 KOps/s	$\textbf{\color{#35bf28}+5.91\%}$