Skip to content

[Feature] Delegate UnbatchedTensor scalar conversions - #1728

Merged
vmoens merged 1 commit into
mainfrom
codex/unbatched-tensor-conversions
Jun 28, 2026
Merged

[Feature] Delegate UnbatchedTensor scalar conversions#1728
vmoens merged 1 commit into
mainfrom
codex/unbatched-tensor-conversions

Conversation

@vmoens

@vmoens vmoens commented Jun 28, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Delegate Python scalar/display conversions on UnbatchedTensor to the wrapped tensor.
  • Add coverage for string formatting, bool/int/float/complex/index conversions, math helpers, item, and NumPy array conversion.
  • Document scalar conversion behavior and correct the UnbatchedTensor access examples.

Tests

  • uv run --with pytest --with pytest-rerunfailures --with pyyaml --with pytest-instafail python -m pytest test/tensordict/test_nontensor.py::TestUnbatchedTensor -q
  • uv run --with pytest --with pytest-rerunfailures --with pyyaml --with pytest-instafail python -m pytest test/compile/test_compile.py::TestGuardCount::test_unbatched_clone_no_recompile test/compile/test_compile.py::TestGuardCount::test_unbatched_clone_preserves_semantics -q
  • uv run --with flake8==7.1.0 --with flake8-bugbear==22.10.27 --with flake8-comprehensions==3.10.1 --with torchfix==0.5.0 --with flake8-print==5.0.0 flake8 --config=setup.cfg tensordict/_unbatched.py test/tensordict/test_nontensor.py
  • uv run --with black black --check tensordict/_unbatched.py test/tensordict/test_nontensor.py
  • uv run --with pydocstyle pydocstyle tensordict/_unbatched.py
  • python3 scripts/check_rst_titles.py docs/source/overview.rst

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jun 28, 2026
@github-actions github-actions Bot added Feature New feature documentation Improvements or additions to documentation Test labels Jun 28, 2026
@github-actions

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 344. Improved: $\large\color{#35bf28}12$. Worsened: $\large\color{#d91a1a}17$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_collector_preallocated_write[stack_out-cpu-32-2] 0.1924ms 0.1602ms 6.2419 KOps/s 6.0309 KOps/s $\color{#35bf28}+3.50\%$
test_collector_preallocated_write[stack_out-cpu-32-8] 0.3731ms 0.2846ms 3.5139 KOps/s 3.4611 KOps/s $\color{#35bf28}+1.53\%$
test_collector_preallocated_write[stack_out-cpu-32-32] 0.8126ms 0.7536ms 1.3269 KOps/s 1.3096 KOps/s $\color{#35bf28}+1.32\%$
test_collector_preallocated_write[stack_out-cpu-4096-2] 0.3906ms 0.3346ms 2.9886 KOps/s 2.9268 KOps/s $\color{#35bf28}+2.11\%$
test_collector_preallocated_write[stack_out-cpu-4096-8] 1.3836ms 1.1026ms 906.9524 Ops/s 877.1085 Ops/s $\color{#35bf28}+3.40\%$
test_collector_preallocated_write[stack_out-cpu-4096-32] 7.5948ms 7.3657ms 135.7646 Ops/s 134.9245 Ops/s $\color{#35bf28}+0.62\%$
test_collector_preallocated_write[stack_out-cuda-32-2] 0.2865ms 0.2423ms 4.1274 KOps/s 3.9673 KOps/s $\color{#35bf28}+4.04\%$
test_collector_preallocated_write[stack_out-cuda-32-8] 0.4453ms 0.3637ms 2.7493 KOps/s 2.7150 KOps/s $\color{#35bf28}+1.26\%$
test_collector_preallocated_write[stack_out-cuda-32-32] 1.0384ms 0.7971ms 1.2545 KOps/s 1.2426 KOps/s $\color{#35bf28}+0.96\%$
test_collector_preallocated_write[stack_out-cuda-4096-2] 0.3174ms 0.2512ms 3.9810 KOps/s 4.0611 KOps/s $\color{#d91a1a}-1.97\%$
test_collector_preallocated_write[stack_out-cuda-4096-8] 0.4509ms 0.3711ms 2.6950 KOps/s 2.7674 KOps/s $\color{#d91a1a}-2.62\%$
test_collector_preallocated_write[stack_out-cuda-4096-32] 0.9574ms 0.8593ms 1.1637 KOps/s 1.1594 KOps/s $\color{#35bf28}+0.37\%$
test_collector_preallocated_write[set_at_loop-cpu-32-2] 0.2880ms 0.2184ms 4.5795 KOps/s 4.8404 KOps/s $\textbf{\color{#d91a1a}-5.39\%}$
test_collector_preallocated_write[set_at_loop-cpu-32-8] 0.9627ms 0.8017ms 1.2474 KOps/s 1.2486 KOps/s $\color{#d91a1a}-0.09\%$
test_collector_preallocated_write[set_at_loop-cpu-32-32] 3.2807ms 3.1859ms 313.8871 Ops/s 308.9315 Ops/s $\color{#35bf28}+1.60\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-2] 0.7194ms 0.3705ms 2.6992 KOps/s 2.7419 KOps/s $\color{#d91a1a}-1.56\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-8] 2.0680ms 1.7901ms 558.6154 Ops/s 609.4919 Ops/s $\textbf{\color{#d91a1a}-8.35\%}$
test_collector_preallocated_write[set_at_loop-cpu-4096-32] 10.4643ms 10.2087ms 97.9554 Ops/s 97.6637 Ops/s $\color{#35bf28}+0.30\%$
test_collector_preallocated_write[set_at_loop-cuda-32-2] 0.4123ms 0.3834ms 2.6083 KOps/s 2.4711 KOps/s $\textbf{\color{#35bf28}+5.55\%}$
test_collector_preallocated_write[set_at_loop-cuda-32-8] 1.5309ms 1.4351ms 696.7944 Ops/s 672.3415 Ops/s $\color{#35bf28}+3.64\%$
test_collector_preallocated_write[set_at_loop-cuda-32-32] 5.7476ms 5.6008ms 178.5461 Ops/s 170.0981 Ops/s $\color{#35bf28}+4.97\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-2] 0.4787ms 0.3835ms 2.6076 KOps/s 2.4703 KOps/s $\textbf{\color{#35bf28}+5.55\%}$
test_collector_preallocated_write[set_at_loop-cuda-4096-8] 1.7106ms 1.4384ms 695.2265 Ops/s 661.8712 Ops/s $\textbf{\color{#35bf28}+5.04\%}$
test_collector_preallocated_write[set_at_loop-cuda-4096-32] 5.8908ms 5.6402ms 177.2973 Ops/s 169.0115 Ops/s $\color{#35bf28}+4.90\%$
test_collector_preallocated_write[copy_at-cpu-32-2] 0.5458ms 0.1684ms 5.9394 KOps/s 5.9057 KOps/s $\color{#35bf28}+0.57\%$
test_collector_preallocated_write[copy_at-cpu-32-8] 0.7108ms 0.6510ms 1.5362 KOps/s 1.5242 KOps/s $\color{#35bf28}+0.78\%$
test_collector_preallocated_write[copy_at-cpu-32-32] 2.6967ms 2.5848ms 386.8748 Ops/s 385.4535 Ops/s $\color{#35bf28}+0.37\%$
test_collector_preallocated_write[copy_at-cpu-4096-2] 0.4228ms 0.3127ms 3.1977 KOps/s 3.2329 KOps/s $\color{#d91a1a}-1.09\%$
test_collector_preallocated_write[copy_at-cpu-4096-8] 2.4347ms 1.6092ms 621.4459 Ops/s 701.6915 Ops/s $\textbf{\color{#d91a1a}-11.44\%}$
test_collector_preallocated_write[copy_at-cpu-4096-32] 9.7954ms 9.5370ms 104.8549 Ops/s 105.5811 Ops/s $\color{#d91a1a}-0.69\%$
test_collector_preallocated_write[copy_at-cuda-32-2] 0.4054ms 0.3223ms 3.1023 KOps/s 3.1669 KOps/s $\color{#d91a1a}-2.04\%$
test_collector_preallocated_write[copy_at-cuda-32-8] 1.3588ms 1.1942ms 837.3525 Ops/s 848.6995 Ops/s $\color{#d91a1a}-1.34\%$
test_collector_preallocated_write[copy_at-cuda-32-32] 4.8776ms 4.6437ms 215.3463 Ops/s 217.9835 Ops/s $\color{#d91a1a}-1.21\%$
test_collector_preallocated_write[copy_at-cuda-4096-2] 0.4431ms 0.3220ms 3.1060 KOps/s 3.1445 KOps/s $\color{#d91a1a}-1.23\%$
test_collector_preallocated_write[copy_at-cuda-4096-8] 1.2815ms 1.1837ms 844.8087 Ops/s 845.8585 Ops/s $\color{#d91a1a}-0.12\%$
test_collector_preallocated_write[copy_at-cuda-4096-32] 4.9067ms 4.6273ms 216.1099 Ops/s 215.6274 Ops/s $\color{#35bf28}+0.22\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-2] 0.1566ms 0.1207ms 8.2860 KOps/s 8.5404 KOps/s $\color{#d91a1a}-2.98\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-8] 0.5417ms 0.4736ms 2.1117 KOps/s 2.1860 KOps/s $\color{#d91a1a}-3.40\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-32] 1.9714ms 1.8849ms 530.5368 Ops/s 548.3939 Ops/s $\color{#d91a1a}-3.26\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-2] 0.6680ms 0.2546ms 3.9280 KOps/s 4.0338 KOps/s $\color{#d91a1a}-2.62\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-8] 1.4557ms 1.3140ms 761.0639 Ops/s 835.2101 Ops/s $\textbf{\color{#d91a1a}-8.88\%}$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-32] 8.9839ms 8.6239ms 115.9568 Ops/s 116.5752 Ops/s $\color{#d91a1a}-0.53\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-2] 0.3789ms 0.2850ms 3.5084 KOps/s 3.7502 KOps/s $\textbf{\color{#d91a1a}-6.45\%}$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-8] 1.1919ms 1.0366ms 964.7078 Ops/s 1.0132 KOps/s $\color{#d91a1a}-4.79\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-32] 4.3489ms 4.1274ms 242.2833 Ops/s 259.1449 Ops/s $\textbf{\color{#d91a1a}-6.51\%}$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-2] 0.3554ms 0.2734ms 3.6571 KOps/s 3.7842 KOps/s $\color{#d91a1a}-3.36\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-8] 1.1375ms 1.0382ms 963.1752 Ops/s 1.0116 KOps/s $\color{#d91a1a}-4.79\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-32] 4.2979ms 4.1343ms 241.8813 Ops/s 257.8749 Ops/s $\textbf{\color{#d91a1a}-6.20\%}$
test_wide_nested_preallocated_write[stack_out-cpu-128-128] 16.0442ms 15.7465ms 63.5061 Ops/s 63.1933 Ops/s $\color{#35bf28}+0.49\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-256] 32.0591ms 31.8295ms 31.4174 Ops/s 31.3078 Ops/s $\color{#35bf28}+0.35\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-128] 87.1465ms 85.1877ms 11.7388 Ops/s 11.7467 Ops/s $\color{#d91a1a}-0.07\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-256] 0.2019s 0.2005s 4.9876 Ops/s 5.0071 Ops/s $\color{#d91a1a}-0.39\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-128] 13.3654ms 13.1808ms 75.8681 Ops/s 76.0720 Ops/s $\color{#d91a1a}-0.27\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-256] 25.8129ms 25.6149ms 39.0398 Ops/s 38.8275 Ops/s $\color{#35bf28}+0.55\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-128] 13.4472ms 13.2995ms 75.1907 Ops/s 74.8318 Ops/s $\color{#35bf28}+0.48\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-256] 26.2416ms 26.0541ms 38.3817 Ops/s 38.1365 Ops/s $\color{#35bf28}+0.64\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-128] 54.3662ms 52.9812ms 18.8746 Ops/s 20.4969 Ops/s $\textbf{\color{#d91a1a}-7.91\%}$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-256] 0.1092s 0.1065s 9.3883 Ops/s 10.1257 Ops/s $\textbf{\color{#d91a1a}-7.28\%}$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-128] 0.1442s 0.1437s 6.9605 Ops/s 7.0923 Ops/s $\color{#d91a1a}-1.86\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-256] 0.3225s 0.3204s 3.1209 Ops/s 3.1121 Ops/s $\color{#35bf28}+0.28\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-128] 73.8353ms 73.1442ms 13.6716 Ops/s 13.8851 Ops/s $\color{#d91a1a}-1.54\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-256] 0.1478s 0.1472s 6.7923 Ops/s 6.5351 Ops/s $\color{#35bf28}+3.94\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-128] 74.2196ms 73.7342ms 13.5622 Ops/s 13.0734 Ops/s $\color{#35bf28}+3.74\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-256] 0.1485s 0.1474s 6.7830 Ops/s 6.4855 Ops/s $\color{#35bf28}+4.59\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-128] 29.8409ms 29.7843ms 33.5747 Ops/s 33.6860 Ops/s $\color{#d91a1a}-0.33\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-256] 60.5365ms 60.3930ms 16.5582 Ops/s 16.8056 Ops/s $\color{#d91a1a}-1.47\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-128] 0.1226s 0.1198s 8.3442 Ops/s 8.4467 Ops/s $\color{#d91a1a}-1.21\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-256] 0.2680s 0.2667s 3.7500 Ops/s 3.7240 Ops/s $\color{#35bf28}+0.70\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-128] 42.6245ms 42.2062ms 23.6932 Ops/s 23.7859 Ops/s $\color{#d91a1a}-0.39\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-256] 84.9274ms 84.4371ms 11.8431 Ops/s 11.9153 Ops/s $\color{#d91a1a}-0.61\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-128] 42.5614ms 42.2516ms 23.6678 Ops/s 23.5960 Ops/s $\color{#35bf28}+0.30\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-256] 85.2184ms 84.8318ms 11.7880 Ops/s 11.8444 Ops/s $\color{#d91a1a}-0.48\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-128] 20.6100ms 20.4859ms 48.8142 Ops/s 50.0311 Ops/s $\color{#d91a1a}-2.43\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-256] 41.8882ms 41.7543ms 23.9496 Ops/s 24.5101 Ops/s $\color{#d91a1a}-2.29\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-128] 0.1086s 0.1076s 9.2923 Ops/s 9.3623 Ops/s $\color{#d91a1a}-0.75\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-256] 0.2534s 0.2520s 3.9687 Ops/s 4.1547 Ops/s $\color{#d91a1a}-4.48\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-128] 36.6537ms 36.2055ms 27.6201 Ops/s 28.1488 Ops/s $\color{#d91a1a}-1.88\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-256] 73.0914ms 72.6448ms 13.7656 Ops/s 14.0837 Ops/s $\color{#d91a1a}-2.26\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-128] 36.6218ms 36.0709ms 27.7232 Ops/s 28.2294 Ops/s $\color{#d91a1a}-1.79\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-256] 73.6012ms 72.2894ms 13.8333 Ops/s 14.1694 Ops/s $\color{#d91a1a}-2.37\%$
test_plain_set_nested 35.4010μs 14.6671μs 68.1798 KOps/s 68.6687 KOps/s $\color{#d91a1a}-0.71\%$
test_plain_set_stack_nested 34.1620μs 14.3447μs 69.7124 KOps/s 69.7057 KOps/s $+0.01\%$
test_plain_set_nested_inplace 50.2120μs 16.0341μs 62.3670 KOps/s 63.0803 KOps/s $\color{#d91a1a}-1.13\%$
test_plain_set_stack_nested_inplace 45.0120μs 15.6087μs 64.0670 KOps/s 64.0598 KOps/s $\color{#35bf28}+0.01\%$
test_items 25.4310μs 5.6345μs 177.4777 KOps/s 178.6819 KOps/s $\color{#d91a1a}-0.67\%$
test_items_nested 0.4962ms 0.4490ms 2.2274 KOps/s 2.2531 KOps/s $\color{#d91a1a}-1.14\%$
test_items_nested_locked 0.5457ms 0.4493ms 2.2259 KOps/s 2.2271 KOps/s $\color{#d91a1a}-0.05\%$
test_items_nested_leaf 0.1259ms 92.9856μs 10.7543 KOps/s 10.8758 KOps/s $\color{#d91a1a}-1.12\%$
test_items_stack_nested 0.5374ms 0.4394ms 2.2757 KOps/s 2.2570 KOps/s $\color{#35bf28}+0.83\%$
test_items_stack_nested_leaf 0.1291ms 92.2702μs 10.8377 KOps/s 10.7550 KOps/s $\color{#35bf28}+0.77\%$
test_items_stack_nested_locked 0.4993ms 0.4492ms 2.2261 KOps/s 2.2358 KOps/s $\color{#d91a1a}-0.43\%$
test_keys 29.0310μs 4.0606μs 246.2695 KOps/s 241.5111 KOps/s $\color{#35bf28}+1.97\%$
test_keys_nested 0.1780ms 0.1265ms 7.9076 KOps/s 8.0182 KOps/s $\color{#d91a1a}-1.38\%$
test_keys_nested_locked 2.3475ms 0.1332ms 7.5092 KOps/s 7.5615 KOps/s $\color{#d91a1a}-0.69\%$
test_keys_nested_leaf 0.1838ms 0.1159ms 8.6259 KOps/s 8.6484 KOps/s $\color{#d91a1a}-0.26\%$
test_keys_stack_nested 0.1691ms 0.1253ms 7.9820 KOps/s 8.0594 KOps/s $\color{#d91a1a}-0.96\%$
test_keys_stack_nested_leaf 0.1637ms 0.1153ms 8.6722 KOps/s 8.6543 KOps/s $\color{#35bf28}+0.21\%$
test_keys_stack_nested_locked 0.1680ms 0.1325ms 7.5447 KOps/s 7.5845 KOps/s $\color{#d91a1a}-0.52\%$
test_values 17.6957μs 1.4882μs 671.9723 KOps/s 990.1569 KOps/s $\textbf{\color{#d91a1a}-32.13\%}$
test_values_nested 84.0240μs 51.1452μs 19.5522 KOps/s 19.6395 KOps/s $\color{#d91a1a}-0.44\%$
test_values_nested_locked 97.4040μs 53.4944μs 18.6935 KOps/s 18.6398 KOps/s $\color{#35bf28}+0.29\%$
test_values_nested_leaf 94.2840μs 58.2481μs 17.1679 KOps/s 17.3967 KOps/s $\color{#d91a1a}-1.32\%$
test_values_stack_nested 90.4630μs 50.5303μs 19.7901 KOps/s 19.8234 KOps/s $\color{#d91a1a}-0.17\%$
test_values_stack_nested_leaf 87.1140μs 57.7031μs 17.3301 KOps/s 17.2296 KOps/s $\color{#35bf28}+0.58\%$
test_values_stack_nested_locked 87.1530μs 53.4993μs 18.6918 KOps/s 18.6292 KOps/s $\color{#35bf28}+0.34\%$
test_membership 5.6835μs 0.7895μs 1.2667 MOps/s 1.2768 MOps/s $\color{#d91a1a}-0.79\%$
test_membership_nested 33.0810μs 2.8010μs 357.0128 KOps/s 353.0511 KOps/s $\color{#35bf28}+1.12\%$
test_membership_nested_leaf 18.2155μs 2.7099μs 369.0195 KOps/s 376.0563 KOps/s $\color{#d91a1a}-1.87\%$
test_membership_stacked_nested 30.0510μs 2.7307μs 366.2090 KOps/s 374.5494 KOps/s $\color{#d91a1a}-2.23\%$
test_membership_stacked_nested_leaf 36.3320μs 2.7031μs 369.9507 KOps/s 365.6764 KOps/s $\color{#35bf28}+1.17\%$
test_membership_nested_last 30.5910μs 4.2160μs 237.1930 KOps/s 233.7503 KOps/s $\color{#35bf28}+1.47\%$
test_membership_nested_leaf_last 38.3520μs 4.1663μs 240.0197 KOps/s 235.0936 KOps/s $\color{#35bf28}+2.10\%$
test_membership_stacked_nested_last 56.0220μs 4.0716μs 245.6046 KOps/s 242.5694 KOps/s $\color{#35bf28}+1.25\%$
test_membership_stacked_nested_leaf_last 40.0020μs 4.0700μs 245.6986 KOps/s 242.7829 KOps/s $\color{#35bf28}+1.20\%$
test_nested_getleaf 45.6920μs 20.3768μs 49.0755 KOps/s 48.5497 KOps/s $\color{#35bf28}+1.08\%$
test_nested_get 89.1040μs 19.1857μs 52.1222 KOps/s 52.3669 KOps/s $\color{#d91a1a}-0.47\%$
test_stacked_getleaf 49.3420μs 20.1955μs 49.5160 KOps/s 50.2037 KOps/s $\color{#d91a1a}-1.37\%$
test_stacked_get 48.7520μs 19.4192μs 51.4954 KOps/s 52.8958 KOps/s $\color{#d91a1a}-2.65\%$
test_nested_getitemleaf 47.4920μs 20.8954μs 47.8573 KOps/s 47.7845 KOps/s $\color{#35bf28}+0.15\%$
test_nested_getitem 53.3720μs 20.1569μs 49.6108 KOps/s 50.3964 KOps/s $\color{#d91a1a}-1.56\%$
test_stacked_getitemleaf 53.6930μs 20.7405μs 48.2147 KOps/s 48.5361 KOps/s $\color{#d91a1a}-0.66\%$
test_stacked_getitem 56.3720μs 19.7500μs 50.6328 KOps/s 50.7765 KOps/s $\color{#d91a1a}-0.28\%$
test_lock_nested 4.6267ms 0.4822ms 2.0737 KOps/s 2.0445 KOps/s $\color{#35bf28}+1.43\%$
test_lock_stack_nested 0.5522ms 0.4839ms 2.0666 KOps/s 2.0598 KOps/s $\color{#35bf28}+0.33\%$
test_unlock_nested 0.4597ms 0.3815ms 2.6210 KOps/s 2.6153 KOps/s $\color{#35bf28}+0.22\%$
test_unlock_stack_nested 0.5735ms 0.3843ms 2.6022 KOps/s 2.6080 KOps/s $\color{#d91a1a}-0.22\%$
test_flatten_speed 0.1873ms 0.1160ms 8.6233 KOps/s 8.5592 KOps/s $\color{#35bf28}+0.75\%$
test_unflatten_speed 0.6419ms 0.5345ms 1.8710 KOps/s 1.8323 KOps/s $\color{#35bf28}+2.11\%$
test_common_ops 0.8316ms 0.6918ms 1.4456 KOps/s 1.4379 KOps/s $\color{#35bf28}+0.53\%$
test_creation 0.1157ms 2.9914μs 334.2878 KOps/s 333.5490 KOps/s $\color{#35bf28}+0.22\%$
test_creation_empty 31.1110μs 6.5949μs 151.6314 KOps/s 152.6790 KOps/s $\color{#d91a1a}-0.69\%$
test_creation_nested_1 31.2210μs 10.8715μs 91.9835 KOps/s 91.7673 KOps/s $\color{#35bf28}+0.24\%$
test_creation_nested_2 34.3220μs 12.5968μs 79.3856 KOps/s 78.9318 KOps/s $\color{#35bf28}+0.57\%$
test_creation_many_keys[10] 62.8620μs 19.7782μs 50.5608 KOps/s 50.0544 KOps/s $\color{#35bf28}+1.01\%$
test_creation_many_keys[50] 0.1247ms 85.4862μs 11.6978 KOps/s 11.7847 KOps/s $\color{#d91a1a}-0.74\%$
test_creation_many_keys[100] 0.1963ms 0.1671ms 5.9828 KOps/s 6.0401 KOps/s $\color{#d91a1a}-0.95\%$
test_creation_nested_many_keys[10] 72.5630μs 42.4485μs 23.5580 KOps/s 23.3166 KOps/s $\color{#35bf28}+1.04\%$
test_creation_nested_many_keys[50] 0.2332ms 0.1716ms 5.8272 KOps/s 5.7981 KOps/s $\color{#35bf28}+0.50\%$
test_clone 31.2320μs 13.0542μs 76.6037 KOps/s 76.8118 KOps/s $\color{#d91a1a}-0.27\%$
test_getitem[int] 1.5051ms 14.8388μs 67.3909 KOps/s 68.4221 KOps/s $\color{#d91a1a}-1.51\%$
test_getitem[slice_int] 0.1432ms 23.4692μs 42.6091 KOps/s 42.2699 KOps/s $\color{#35bf28}+0.80\%$
test_getitem[range] 0.1745ms 61.6726μs 16.2146 KOps/s 16.3394 KOps/s $\color{#d91a1a}-0.76\%$
test_getitem[tuple] 0.1557ms 23.5341μs 42.4915 KOps/s 42.3854 KOps/s $\color{#35bf28}+0.25\%$
test_getitem[list] 0.2033ms 56.8500μs 17.5901 KOps/s 17.4451 KOps/s $\color{#35bf28}+0.83\%$
test_setitem_dim[int] 47.7320μs 25.8094μs 38.7455 KOps/s 39.3461 KOps/s $\color{#d91a1a}-1.53\%$
test_setitem_dim[slice_int] 65.8630μs 42.4219μs 23.5727 KOps/s 24.0107 KOps/s $\color{#d91a1a}-1.82\%$
test_setitem_dim[range] 0.1179ms 91.7720μs 10.8966 KOps/s 10.8496 KOps/s $\color{#35bf28}+0.43\%$
test_setitem_dim[tuple] 61.6220μs 38.5173μs 25.9624 KOps/s 26.4782 KOps/s $\color{#d91a1a}-1.95\%$
test_setitem 57.4520μs 17.2608μs 57.9347 KOps/s 58.2963 KOps/s $\color{#d91a1a}-0.62\%$
test_set 49.5620μs 16.4873μs 60.6528 KOps/s 61.0594 KOps/s $\color{#d91a1a}-0.67\%$
test_set_shared 0.5638ms 0.2087ms 4.7924 KOps/s 4.8223 KOps/s $\color{#d91a1a}-0.62\%$
test_update 0.2590ms 21.5998μs 46.2967 KOps/s 47.3825 KOps/s $\color{#d91a1a}-2.29\%$
test_update_nested 62.4020μs 32.6794μs 30.6003 KOps/s 30.8248 KOps/s $\color{#d91a1a}-0.73\%$
test_update__nested 0.5147ms 33.3023μs 30.0280 KOps/s 30.7768 KOps/s $\color{#d91a1a}-2.43\%$
test_set_nested 47.5220μs 18.1831μs 54.9963 KOps/s 55.5896 KOps/s $\color{#d91a1a}-1.07\%$
test_set_nested_new 60.0720μs 22.8512μs 43.7614 KOps/s 43.7791 KOps/s $\color{#d91a1a}-0.04\%$
test_select 81.0930μs 39.4576μs 25.3436 KOps/s 25.6152 KOps/s $\color{#d91a1a}-1.06\%$
test_select_nested 0.1062ms 69.8221μs 14.3221 KOps/s 14.2460 KOps/s $\color{#35bf28}+0.53\%$
test_exclude_nested 0.1250ms 85.7516μs 11.6616 KOps/s 11.6793 KOps/s $\color{#d91a1a}-0.15\%$
test_empty[True] 0.4885ms 0.3787ms 2.6406 KOps/s 2.6370 KOps/s $\color{#35bf28}+0.14\%$
test_empty[False] 7.3430μs 1.3086μs 764.1901 KOps/s 758.6907 KOps/s $\color{#35bf28}+0.72\%$
test_to 0.1026ms 67.9105μs 14.7253 KOps/s 14.4116 KOps/s $\color{#35bf28}+2.18\%$
test_to_nonblocking 0.1102ms 66.1620μs 15.1144 KOps/s 14.9811 KOps/s $\color{#35bf28}+0.89\%$
test_unbind_speed 0.3705ms 0.3272ms 3.0561 KOps/s 3.0842 KOps/s $\color{#d91a1a}-0.91\%$
test_unbind_speed_stack0 0.4042ms 0.3181ms 3.1436 KOps/s 3.1442 KOps/s $\color{#d91a1a}-0.02\%$
test_unbind_speed_stack1 0.1144s 0.8290ms 1.2063 KOps/s 1.2031 KOps/s $\color{#35bf28}+0.26\%$
test_split 1.2061ms 1.0869ms 920.0423 Ops/s 910.7465 Ops/s $\color{#35bf28}+1.02\%$
test_chunk 0.1141s 1.1640ms 859.1029 Ops/s 960.0605 Ops/s $\textbf{\color{#d91a1a}-10.52\%}$
test_to_cpu_blocking 20.0189ms 19.3630ms 51.6449 Ops/s 51.7404 Ops/s $\color{#d91a1a}-0.18\%$
test_to_cpu_global_sync 11.8757ms 11.6596ms 85.7659 Ops/s 85.7638 Ops/s $+0.00\%$
test_to_cpu_event_sync 12.9107ms 12.5057ms 79.9635 Ops/s 71.4624 Ops/s $\textbf{\color{#35bf28}+11.90\%}$
test_to_cpu_default 12.9261ms 12.5002ms 79.9990 Ops/s 80.1550 Ops/s $\color{#d91a1a}-0.19\%$
test_consolidate[False-None] 0.1433s 4.6257ms 216.1819 Ops/s 251.9349 Ops/s $\textbf{\color{#d91a1a}-14.19\%}$
test_consolidate[default-None] 3.3948ms 2.0858ms 479.4387 Ops/s 471.3736 Ops/s $\color{#35bf28}+1.71\%$
test_consolidate[reduce-overhead-None] 0.1997s 2.4002ms 416.6367 Ops/s 480.5887 Ops/s $\textbf{\color{#d91a1a}-13.31\%}$
test_consolidate_njt[False-None] 8.3855ms 8.1296ms 123.0079 Ops/s 121.0816 Ops/s $\color{#35bf28}+1.59\%$
test_to[False-False-None] 2.2419ms 2.1068ms 474.6522 Ops/s 470.4210 Ops/s $\color{#35bf28}+0.90\%$
test_to[True-False-None] 1.9760ms 1.8260ms 547.6561 Ops/s 539.3816 Ops/s $\color{#35bf28}+1.53\%$
test_to[within-False-None] 6.4110ms 5.9745ms 167.3787 Ops/s 167.9095 Ops/s $\color{#d91a1a}-0.32\%$
test_to[True-default-None] 10.9633ms 10.4735ms 95.4795 Ops/s 95.5220 Ops/s $\color{#d91a1a}-0.04\%$
test_to_njt[False-False-None] 8.7550ms 8.3375ms 119.9396 Ops/s 119.5746 Ops/s $\color{#35bf28}+0.31\%$
test_to_njt[True-False-None] 7.0726ms 6.6868ms 149.5477 Ops/s 149.4433 Ops/s $\color{#35bf28}+0.07\%$
test_to_njt[within-False-None] 15.1471ms 14.9728ms 66.7880 Ops/s 66.9555 Ops/s $\color{#d91a1a}-0.25\%$
test_creation[device0] 0.3960ms 0.1131ms 8.8428 KOps/s 8.8967 KOps/s $\color{#d91a1a}-0.61\%$
test_creation_from_tensor 0.4480ms 0.1106ms 9.0425 KOps/s 9.0372 KOps/s $\color{#35bf28}+0.06\%$
test_add_one[memmap_tensor0] 0.1963ms 6.7815μs 147.4596 KOps/s 151.9711 KOps/s $\color{#d91a1a}-2.97\%$
test_contiguous[memmap_tensor0] 27.6520μs 0.5819μs 1.7186 MOps/s 2.3648 MOps/s $\textbf{\color{#d91a1a}-27.33\%}$
test_stack[memmap_tensor0] 0.1357ms 4.1674μs 239.9584 KOps/s 243.7329 KOps/s $\color{#d91a1a}-1.55\%$
test_memmaptd_index 1.2562ms 0.2654ms 3.7684 KOps/s 3.7456 KOps/s $\color{#35bf28}+0.61\%$
test_memmaptd_index_astensor 0.5147ms 0.3648ms 2.7416 KOps/s 2.7727 KOps/s $\color{#d91a1a}-1.12\%$
test_memmaptd_index_op 0.7767ms 0.6278ms 1.5928 KOps/s 1.6249 KOps/s $\color{#d91a1a}-1.97\%$
test_serialize_model 0.1377s 0.1352s 7.3990 Ops/s 7.4210 Ops/s $\color{#d91a1a}-0.30\%$
test_serialize_model_pickle 1.3553s 1.2115s 0.8254 Ops/s 0.8228 Ops/s $\color{#35bf28}+0.32\%$
test_serialize_weights 0.1358s 0.1338s 7.4722 Ops/s 7.4726 Ops/s $-0.01\%$
test_serialize_weights_returnearly 0.4670s 90.6934ms 11.0262 Ops/s 10.7037 Ops/s $\color{#35bf28}+3.01\%$
test_serialize_weights_pickle 1.3474s 1.2135s 0.8241 Ops/s 0.8223 Ops/s $\color{#35bf28}+0.21\%$
test_reshape_pytree 0.2125ms 31.5441μs 31.7016 KOps/s 32.5007 KOps/s $\color{#d91a1a}-2.46\%$
test_reshape_td 84.1240μs 43.4538μs 23.0129 KOps/s 23.1627 KOps/s $\color{#d91a1a}-0.65\%$
test_view_pytree 0.2629ms 30.6783μs 32.5963 KOps/s 32.6428 KOps/s $\color{#d91a1a}-0.14\%$
test_view_td 96.2440μs 51.9897μs 19.2346 KOps/s 19.6168 KOps/s $\color{#d91a1a}-1.95\%$
test_unbind_pytree 0.2086ms 35.1420μs 28.4560 KOps/s 28.4984 KOps/s $\color{#d91a1a}-0.15\%$
test_unbind_td 0.1964ms 47.9533μs 20.8536 KOps/s 20.7619 KOps/s $\color{#35bf28}+0.44\%$
test_split_pytree 0.2098ms 39.8662μs 25.0839 KOps/s 25.0150 KOps/s $\color{#35bf28}+0.28\%$
test_split_td 0.1440ms 62.2838μs 16.0555 KOps/s 15.8778 KOps/s $\color{#35bf28}+1.12\%$
test_add_pytree 0.2413ms 39.8372μs 25.1022 KOps/s 24.7195 KOps/s $\color{#35bf28}+1.55\%$
test_add_td 0.2056ms 53.6964μs 18.6232 KOps/s 19.2827 KOps/s $\color{#d91a1a}-3.42\%$
test_compile_add_one_nested[tensordict-compile] 0.3352ms 0.2251ms 4.4417 KOps/s 4.4564 KOps/s $\color{#d91a1a}-0.33\%$
test_compile_add_one_nested[tensordict-eager] 0.3295ms 0.1939ms 5.1574 KOps/s 5.3208 KOps/s $\color{#d91a1a}-3.07\%$
test_compile_add_one_nested[pytree-compile] 0.2902ms 0.1340ms 7.4604 KOps/s 7.5293 KOps/s $\color{#d91a1a}-0.92\%$
test_compile_add_one_nested[pytree-eager] 0.4747ms 0.1808ms 5.5313 KOps/s 5.8083 KOps/s $\color{#d91a1a}-4.77\%$
test_compile_copy_nested[tensordict-compile] 67.7730μs 15.2630μs 65.5179 KOps/s 67.8639 KOps/s $\color{#d91a1a}-3.46\%$
test_compile_copy_nested[tensordict-eager] 0.3167ms 49.4934μs 20.2047 KOps/s 19.5457 KOps/s $\color{#35bf28}+3.37\%$
test_compile_copy_nested[pytree-compile] 0.1564ms 14.9199μs 67.0245 KOps/s 66.1174 KOps/s $\color{#35bf28}+1.37\%$
test_compile_copy_nested[pytree-eager] 0.3880ms 64.0387μs 15.6156 KOps/s 15.4644 KOps/s $\color{#35bf28}+0.98\%$
test_compile_add_one_flat[tensordict-compile] 0.3000ms 0.2513ms 3.9795 KOps/s 3.8818 KOps/s $\color{#35bf28}+2.52\%$
test_compile_add_one_flat[tensordict-eager] 0.3705ms 0.2734ms 3.6581 KOps/s 3.6466 KOps/s $\color{#35bf28}+0.32\%$
test_compile_add_one_flat[tensorclass-compile] 0.3433ms 0.1860ms 5.3777 KOps/s 5.2441 KOps/s $\color{#35bf28}+2.55\%$
test_compile_add_one_flat[tensorclass-eager] 0.1148ms 74.6044μs 13.4040 KOps/s 13.9824 KOps/s $\color{#d91a1a}-4.14\%$
test_compile_add_one_flat[pytree-compile] 0.3180ms 0.1880ms 5.3186 KOps/s 5.1675 KOps/s $\color{#35bf28}+2.92\%$
test_compile_add_one_flat[pytree-eager] 0.8610ms 0.5225ms 1.9139 KOps/s 1.9759 KOps/s $\color{#d91a1a}-3.14\%$
test_compile_add_self_flat[tensordict-eager] 0.4242ms 0.3219ms 3.1070 KOps/s 3.1043 KOps/s $\color{#35bf28}+0.09\%$
test_compile_add_self_flat[tensordict-compile] 0.3271ms 0.2472ms 4.0452 KOps/s 3.7638 KOps/s $\textbf{\color{#35bf28}+7.48\%}$
test_compile_add_self_flat[tensorclass-eager] 0.1397ms 89.3897μs 11.1870 KOps/s 11.5073 KOps/s $\color{#d91a1a}-2.78\%$
test_compile_add_self_flat[tensorclass-compile] 0.3563ms 0.1895ms 5.2762 KOps/s 5.0698 KOps/s $\color{#35bf28}+4.07\%$
test_compile_add_self_flat[pytree-eager] 0.6644ms 0.4232ms 2.3630 KOps/s 2.3887 KOps/s $\color{#d91a1a}-1.08\%$
test_compile_add_self_flat[pytree-compile] 0.2497ms 0.1883ms 5.3098 KOps/s 5.0810 KOps/s $\color{#35bf28}+4.50\%$
test_compile_copy_flat[tensordict-compile] 0.1112ms 19.5719μs 51.0936 KOps/s 53.4656 KOps/s $\color{#d91a1a}-4.44\%$
test_compile_copy_flat[tensordict-eager] 69.4730μs 39.2203μs 25.4970 KOps/s 25.2618 KOps/s $\color{#35bf28}+0.93\%$
test_compile_copy_flat[pytree-compile] 0.2381ms 21.3913μs 46.7479 KOps/s 46.1567 KOps/s $\color{#35bf28}+1.28\%$
test_compile_copy_flat[pytree-eager] 0.3511ms 50.1900μs 19.9243 KOps/s 19.7481 KOps/s $\color{#35bf28}+0.89\%$
test_compile_assign_and_add[tensordict-compile] 2.1389ms 0.2356ms 4.2446 KOps/s 3.8720 KOps/s $\textbf{\color{#35bf28}+9.62\%}$
test_compile_assign_and_add[tensordict-eager] 3.3877ms 3.1863ms 313.8427 Ops/s 313.5758 Ops/s $\color{#35bf28}+0.09\%$
test_compile_assign_and_add[pytree-compile] 2.0284ms 0.1780ms 5.6167 KOps/s 5.4898 KOps/s $\color{#35bf28}+2.31\%$
test_compile_assign_and_add[pytree-eager] 3.0983ms 2.7992ms 357.2513 Ops/s 374.2225 Ops/s $\color{#d91a1a}-4.54\%$
test_compile_indexing[tensor-tensordict-compile] 0.3024ms 0.1366ms 7.3184 KOps/s 7.1302 KOps/s $\color{#35bf28}+2.64\%$
test_compile_indexing[tensor-tensordict-eager] 0.3994ms 75.8451μs 13.1848 KOps/s 13.5768 KOps/s $\color{#d91a1a}-2.89\%$
test_compile_indexing[tensor-tensorclass-compile] 0.2520ms 0.1197ms 8.3553 KOps/s 8.4653 KOps/s $\color{#d91a1a}-1.30\%$
test_compile_indexing[tensor-tensorclass-eager] 0.3146ms 45.0921μs 22.1769 KOps/s 22.7792 KOps/s $\color{#d91a1a}-2.64\%$
test_compile_indexing[tensor-pytree-compile] 0.1718ms 0.1210ms 8.2628 KOps/s 8.2302 KOps/s $\color{#35bf28}+0.40\%$
test_compile_indexing[tensor-pytree-eager] 0.2861ms 45.5386μs 21.9594 KOps/s 22.9348 KOps/s $\color{#d91a1a}-4.25\%$
test_compile_indexing[slice-tensordict-compile] 0.2035ms 82.1857μs 12.1676 KOps/s 11.8686 KOps/s $\color{#35bf28}+2.52\%$
test_compile_indexing[slice-tensordict-eager] 0.2182ms 27.4878μs 36.3798 KOps/s 38.9715 KOps/s $\textbf{\color{#d91a1a}-6.65\%}$
test_compile_indexing[slice-tensorclass-compile] 0.1960ms 69.5188μs 14.3846 KOps/s 14.5773 KOps/s $\color{#d91a1a}-1.32\%$
test_compile_indexing[slice-tensorclass-eager] 0.2469ms 21.4284μs 46.6671 KOps/s 47.1634 KOps/s $\color{#d91a1a}-1.05\%$
test_compile_indexing[slice-pytree-compile] 0.1956ms 70.1679μs 14.2515 KOps/s 14.3725 KOps/s $\color{#d91a1a}-0.84\%$
test_compile_indexing[slice-pytree-eager] 0.2845ms 21.3064μs 46.9342 KOps/s 47.3513 KOps/s $\color{#d91a1a}-0.88\%$
test_compile_indexing[int-tensordict-compile] 0.1257ms 81.1896μs 12.3168 KOps/s 11.8358 KOps/s $\color{#35bf28}+4.06\%$
test_compile_indexing[int-tensordict-eager] 0.3001ms 24.7081μs 40.4726 KOps/s 39.5486 KOps/s $\color{#35bf28}+2.34\%$
test_compile_indexing[int-tensorclass-compile] 0.1182ms 68.1383μs 14.6760 KOps/s 14.4319 KOps/s $\color{#35bf28}+1.69\%$
test_compile_indexing[int-tensorclass-eager] 0.2474ms 21.0797μs 47.4390 KOps/s 47.5833 KOps/s $\color{#d91a1a}-0.30\%$
test_compile_indexing[int-pytree-compile] 0.1140ms 68.4300μs 14.6135 KOps/s 14.5056 KOps/s $\color{#35bf28}+0.74\%$
test_compile_indexing[int-pytree-eager] 0.2706ms 21.0621μs 47.4785 KOps/s 47.5063 KOps/s $\color{#d91a1a}-0.06\%$
test_compile_replace[single-eager] 0.1084ms 47.3024μs 21.1406 KOps/s 22.2646 KOps/s $\textbf{\color{#d91a1a}-5.05\%}$
test_compile_replace[single-compile] 0.2706ms 0.1300ms 7.6926 KOps/s 7.5376 KOps/s $\color{#35bf28}+2.06\%$
test_compile_replace[multi-eager] 0.7143ms 0.5467ms 1.8290 KOps/s 1.8378 KOps/s $\color{#d91a1a}-0.48\%$
test_compile_replace[multi-compile] 0.1815ms 0.1356ms 7.3765 KOps/s 7.0170 KOps/s $\textbf{\color{#35bf28}+5.12\%}$
test_compile_tc_getattr_20[eager] 0.2321ms 0.1683ms 5.9419 KOps/s 6.3083 KOps/s $\textbf{\color{#d91a1a}-5.81\%}$
test_compile_tc_getattr_20[compile] 0.3291ms 0.1447ms 6.9124 KOps/s 6.5983 KOps/s $\color{#35bf28}+4.76\%$
test_compile_clone_shallow[20-eager] 49.5220μs 18.5440μs 53.9258 KOps/s 55.1343 KOps/s $\color{#d91a1a}-2.19\%$
test_compile_clone_shallow[20-compile] 80.7540μs 16.5969μs 60.2521 KOps/s 62.4762 KOps/s $\color{#d91a1a}-3.56\%$
test_compile_clone_shallow[40-eager] 62.1230μs 32.4850μs 30.7834 KOps/s 31.2468 KOps/s $\color{#d91a1a}-1.48\%$
test_compile_clone_shallow[40-compile] 97.3040μs 17.7680μs 56.2808 KOps/s 54.7514 KOps/s $\color{#35bf28}+2.79\%$
test_compile_clone_shallow[80-eager] 95.5940μs 59.9625μs 16.6771 KOps/s 16.7215 KOps/s $\color{#d91a1a}-0.27\%$
test_compile_clone_shallow[80-compile] 93.0840μs 20.9197μs 47.8019 KOps/s 45.8896 KOps/s $\color{#35bf28}+4.17\%$
test_compile_update_inplace[eager] 0.1007ms 59.2446μs 16.8792 KOps/s 16.8894 KOps/s $\color{#d91a1a}-0.06\%$
test_compile_update_inplace[compile] 0.3618ms 0.1406ms 7.1125 KOps/s 6.8244 KOps/s $\color{#35bf28}+4.22\%$
test_mod_add[eager] 0.2893ms 0.2171ms 4.6061 KOps/s 4.5125 KOps/s $\color{#35bf28}+2.07\%$
test_mod_add[compile] 0.2084ms 0.1331ms 7.5124 KOps/s 7.6189 KOps/s $\color{#d91a1a}-1.40\%$
test_mod_add[compile-overhead] 0.3192ms 0.1738ms 5.7544 KOps/s 5.6879 KOps/s $\color{#35bf28}+1.17\%$
test_mod_wrap[eager] 0.5354ms 0.4533ms 2.2060 KOps/s 2.1595 KOps/s $\color{#35bf28}+2.15\%$
test_mod_wrap[compile] 0.5470ms 0.3857ms 2.5926 KOps/s 2.5412 KOps/s $\color{#35bf28}+2.02\%$
test_mod_wrap[compile-overhead] 8.2047ms 4.5220ms 221.1387 Ops/s 232.0634 Ops/s $\color{#d91a1a}-4.71\%$
test_mod_wrap_and_backward[eager] 1.8132ms 1.6596ms 602.5451 Ops/s 595.2524 Ops/s $\color{#35bf28}+1.23\%$
test_mod_wrap_and_backward[compile] 1.9904ms 1.5194ms 658.1388 Ops/s 662.1271 Ops/s $\color{#d91a1a}-0.60\%$
test_mod_wrap_and_backward[compile-overhead] 1.3135ms 0.9209ms 1.0859 KOps/s 1.0678 KOps/s $\color{#35bf28}+1.70\%$
test_seq_add[eager] 0.5475ms 0.4948ms 2.0210 KOps/s 2.0137 KOps/s $\color{#35bf28}+0.36\%$
test_seq_add[compile] 0.2513ms 0.1372ms 7.2912 KOps/s 6.7603 KOps/s $\textbf{\color{#35bf28}+7.85\%}$
test_seq_add[compile-overhead] 0.3065ms 0.1765ms 5.6663 KOps/s 5.4410 KOps/s $\color{#35bf28}+4.14\%$
test_seq_wrap[eager] 1.4885ms 1.3555ms 737.7462 Ops/s 727.4737 Ops/s $\color{#35bf28}+1.41\%$
test_seq_wrap[compile] 0.4967ms 0.3990ms 2.5061 KOps/s 2.3840 KOps/s $\textbf{\color{#35bf28}+5.12\%}$
test_seq_wrap[compile-overhead] 0.4159ms 0.2956ms 3.3834 KOps/s 3.3173 KOps/s $\color{#35bf28}+1.99\%$
test_func_call_runtime[False-eager] 0.8954ms 0.7794ms 1.2831 KOps/s 1.2812 KOps/s $\color{#35bf28}+0.15\%$
test_func_call_runtime[False-compile] 1.0526ms 0.9555ms 1.0466 KOps/s 1.0168 KOps/s $\color{#35bf28}+2.93\%$
test_func_call_runtime[False-compile-overhead] 0.6556ms 0.4866ms 2.0552 KOps/s 2.0117 KOps/s $\color{#35bf28}+2.17\%$
test_func_call_runtime[True-eager] 1.0845ms 1.0297ms 971.1139 Ops/s 956.7138 Ops/s $\color{#35bf28}+1.51\%$
test_func_call_runtime[True-compile] 1.0995ms 0.9650ms 1.0363 KOps/s 1.0147 KOps/s $\color{#35bf28}+2.13\%$
test_func_call_runtime[True-compile-overhead] 0.6141ms 0.5033ms 1.9869 KOps/s 1.9564 KOps/s $\color{#35bf28}+1.56\%$
test_func_call_cm_runtime[False-eager] 0.8979ms 0.7770ms 1.2871 KOps/s 1.2298 KOps/s $\color{#35bf28}+4.66\%$
test_func_call_cm_runtime[False-compile] 1.0040ms 0.9388ms 1.0652 KOps/s 1.0500 KOps/s $\color{#35bf28}+1.45\%$
test_func_call_cm_runtime[False-compile-overhead] 0.7788ms 0.4717ms 2.1201 KOps/s 2.1042 KOps/s $\color{#35bf28}+0.76\%$
test_func_call_cm_runtime[True-eager] 1.2906ms 1.1718ms 853.3538 Ops/s 849.9123 Ops/s $\color{#35bf28}+0.40\%$
test_func_call_cm_runtime[True-compile] 1.1217ms 0.9951ms 1.0049 KOps/s 1.0043 KOps/s $\color{#35bf28}+0.06\%$
test_func_call_cm_runtime[True-compile-overhead] 0.6112ms 0.5309ms 1.8837 KOps/s 1.8653 KOps/s $\color{#35bf28}+0.99\%$
test_vmap_func_call_cm_runtime[eager] 2.8509ms 2.3461ms 426.2484 Ops/s 420.8463 Ops/s $\color{#35bf28}+1.28\%$
test_vmap_func_call_cm_runtime[compile] 2.9672ms 2.5186ms 397.0409 Ops/s 391.1150 Ops/s $\color{#35bf28}+1.52\%$
test_vmap_func_call_cm_runtime[compile-overhead] 3.0036ms 2.5177ms 397.1945 Ops/s 391.3518 Ops/s $\color{#35bf28}+1.49\%$
test_distributed 0.5743ms 0.1435ms 6.9710 KOps/s 6.9880 KOps/s $\color{#d91a1a}-0.24\%$
test_tdmodule 0.7100ms 0.1872ms 5.3411 KOps/s 5.3314 KOps/s $\color{#35bf28}+0.18\%$
test_tdmodule_dispatch 0.4086ms 0.3612ms 2.7684 KOps/s 2.7617 KOps/s $\color{#35bf28}+0.24\%$
test_tdseq 45.3320μs 25.9217μs 38.5777 KOps/s 37.6602 KOps/s $\color{#35bf28}+2.44\%$
test_tdseq_dispatch 0.2374ms 0.2109ms 4.7424 KOps/s 4.7207 KOps/s $\color{#35bf28}+0.46\%$
test_instantiation_functorch 2.0522ms 1.9567ms 511.0765 Ops/s 508.9068 Ops/s $\color{#35bf28}+0.43\%$
test_exec_functorch 0.2128ms 0.1755ms 5.6982 KOps/s 5.7275 KOps/s $\color{#d91a1a}-0.51\%$
test_exec_functional_call 0.1981ms 0.1571ms 6.3651 KOps/s 6.3607 KOps/s $\color{#35bf28}+0.07\%$
test_exec_td_decorator 0.4988ms 0.2410ms 4.1488 KOps/s 4.1515 KOps/s $\color{#d91a1a}-0.07\%$
test_vmap_mlp_speed_decorator[True-True] 1.2228ms 1.0059ms 994.1765 Ops/s 980.7977 Ops/s $\color{#35bf28}+1.36\%$
test_vmap_mlp_speed_decorator[True-False] 1.2194ms 1.0062ms 993.8243 Ops/s 979.7948 Ops/s $\color{#35bf28}+1.43\%$
test_vmap_mlp_speed_decorator[False-True] 0.9314ms 0.7148ms 1.3990 KOps/s 1.3789 KOps/s $\color{#35bf28}+1.46\%$
test_vmap_mlp_speed_decorator[False-False] 0.9219ms 0.7149ms 1.3989 KOps/s 1.3774 KOps/s $\color{#35bf28}+1.56\%$
test_vmap_transformer_speed_decorator[True-True] 21.4270ms 20.6556ms 48.4130 Ops/s 48.2131 Ops/s $\color{#35bf28}+0.41\%$
test_vmap_transformer_speed_decorator[True-False] 21.4246ms 20.6272ms 48.4796 Ops/s 48.2227 Ops/s $\color{#35bf28}+0.53\%$
test_vmap_transformer_speed_decorator[False-True] 20.3461ms 20.2258ms 49.4417 Ops/s 49.1804 Ops/s $\color{#35bf28}+0.53\%$
test_vmap_transformer_speed_decorator[False-False] 20.4225ms 20.2454ms 49.3939 Ops/s 49.1266 Ops/s $\color{#35bf28}+0.54\%$
test_to_module_speed[True] 1.6519ms 1.5649ms 639.0275 Ops/s 640.4114 Ops/s $\color{#d91a1a}-0.22\%$
test_to_module_speed[False] 1.6314ms 1.5438ms 647.7508 Ops/s 648.9736 Ops/s $\color{#d91a1a}-0.19\%$
test_to_module_plain_tensor_speed[None] 2.1540ms 1.6601ms 602.3879 Ops/s 600.3357 Ops/s $\color{#35bf28}+0.34\%$
test_to_module_plain_tensor_speed[False] 3.0983ms 1.5141ms 660.4558 Ops/s 659.5568 Ops/s $\color{#35bf28}+0.14\%$
test_to_module_plain_tensor_speed[True] 3.9088ms 3.2327ms 309.3365 Ops/s 309.6274 Ops/s $\color{#d91a1a}-0.09\%$
test_tc_init 70.9730μs 42.0543μs 23.7788 KOps/s 24.0740 KOps/s $\color{#d91a1a}-1.23\%$
test_tc_init_tensor_only 37.8110μs 8.5807μs 116.5405 KOps/s 119.2771 KOps/s $\color{#d91a1a}-2.29\%$
test_tc_init_nested 0.1170ms 83.8002μs 11.9331 KOps/s 12.4148 KOps/s $\color{#d91a1a}-3.88\%$
test_tc_init_many_fields 42.4420μs 14.2871μs 69.9933 KOps/s 72.2686 KOps/s $\color{#d91a1a}-3.15\%$
test_tc_first_layer_tensor 25.3510μs 1.7099μs 584.8297 KOps/s 597.6228 KOps/s $\color{#d91a1a}-2.14\%$
test_tc_first_layer_tensor_only 2.5301μs 0.3867μs 2.5860 MOps/s 2.6524 MOps/s $\color{#d91a1a}-2.51\%$
test_tc_first_layer_tensor_set 27.6710μs 3.7724μs 265.0824 KOps/s 270.9143 KOps/s $\color{#d91a1a}-2.15\%$
test_tc_first_layer_tensor_only_set 25.1510μs 3.1235μs 320.1577 KOps/s 322.3201 KOps/s $\color{#d91a1a}-0.67\%$
test_tc_first_layer_nontensor 29.4710μs 5.8645μs 170.5187 KOps/s 176.0623 KOps/s $\color{#d91a1a}-3.15\%$
test_tc_second_layer_tensor 25.0110μs 4.1796μs 239.2582 KOps/s 245.3109 KOps/s $\color{#d91a1a}-2.47\%$
test_tc_second_layer_nontensor 32.4310μs 8.2799μs 120.7742 KOps/s 125.1706 KOps/s $\color{#d91a1a}-3.51\%$
test_unbind 0.2719s 13.4046ms 74.6011 Ops/s 68.3069 Ops/s $\textbf{\color{#35bf28}+9.21\%}$
test_full_like 4.5369ms 4.3577ms 229.4774 Ops/s 227.5818 Ops/s $\color{#35bf28}+0.83\%$
test_zeros_like 4.5267ms 4.3477ms 230.0092 Ops/s 231.7961 Ops/s $\color{#d91a1a}-0.77\%$
test_ones_like 4.8166ms 4.3617ms 229.2668 Ops/s 228.2162 Ops/s $\color{#35bf28}+0.46\%$
test_clone 6.6968ms 6.5074ms 153.6703 Ops/s 153.0174 Ops/s $\color{#35bf28}+0.43\%$
test_squeeze 82.3430μs 13.9193μs 71.8424 KOps/s 73.2635 KOps/s $\color{#d91a1a}-1.94\%$
test_unsqueeze 0.1671ms 0.1088ms 9.1904 KOps/s 9.3036 KOps/s $\color{#d91a1a}-1.22\%$
test_split 0.2392ms 0.1722ms 5.8068 KOps/s 5.7583 KOps/s $\color{#35bf28}+0.84\%$
test_permute 0.2395ms 0.1880ms 5.3202 KOps/s 5.3361 KOps/s $\color{#d91a1a}-0.30\%$
test_stack 18.8263ms 18.3966ms 54.3578 Ops/s 19.2963 Ops/s $\textbf{\color{#35bf28}+181.70\%}$
test_cat 18.6305ms 18.3129ms 54.6062 Ops/s 19.3042 Ops/s $\textbf{\color{#35bf28}+182.87\%}$
test_sequential_tensordict 0.7561ms 0.5465ms 1.8299 KOps/s 1.7894 KOps/s $\color{#35bf28}+2.27\%$
test_sequential_graph_module 0.2320ms 0.1145ms 8.7317 KOps/s 8.4280 KOps/s $\color{#35bf28}+3.60\%$
test_nested_tensordict 1.1113ms 0.7871ms 1.2705 KOps/s 1.2539 KOps/s $\color{#35bf28}+1.32\%$
test_nested_graph_module 0.5403ms 0.1276ms 7.8346 KOps/s 8.0896 KOps/s $\color{#d91a1a}-3.15\%$

@github-actions

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 344. Improved: $\large\color{#35bf28}13$. Worsened: $\large\color{#d91a1a}11$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_collector_preallocated_write[stack_out-cpu-32-2] 0.2120ms 0.1706ms 5.8624 KOps/s 5.8580 KOps/s $\color{#35bf28}+0.08\%$
test_collector_preallocated_write[stack_out-cpu-32-8] 0.3812ms 0.3013ms 3.3189 KOps/s 3.3589 KOps/s $\color{#d91a1a}-1.19\%$
test_collector_preallocated_write[stack_out-cpu-32-32] 0.8792ms 0.7929ms 1.2612 KOps/s 1.2610 KOps/s $\color{#35bf28}+0.02\%$
test_collector_preallocated_write[stack_out-cpu-4096-2] 0.4036ms 0.3445ms 2.9026 KOps/s 2.8907 KOps/s $\color{#35bf28}+0.41\%$
test_collector_preallocated_write[stack_out-cpu-4096-8] 1.5932ms 1.1684ms 855.8917 Ops/s 912.7741 Ops/s $\textbf{\color{#d91a1a}-6.23\%}$
test_collector_preallocated_write[stack_out-cpu-4096-32] 7.4182ms 7.2530ms 137.8735 Ops/s 137.2335 Ops/s $\color{#35bf28}+0.47\%$
test_collector_preallocated_write[stack_out-cuda-32-2] 0.2869ms 0.2509ms 3.9853 KOps/s 3.9790 KOps/s $\color{#35bf28}+0.16\%$
test_collector_preallocated_write[stack_out-cuda-32-8] 0.4563ms 0.3749ms 2.6673 KOps/s 2.6696 KOps/s $\color{#d91a1a}-0.09\%$
test_collector_preallocated_write[stack_out-cuda-32-32] 0.9067ms 0.8326ms 1.2011 KOps/s 1.2047 KOps/s $\color{#d91a1a}-0.30\%$
test_collector_preallocated_write[stack_out-cuda-4096-2] 0.3229ms 0.2521ms 3.9664 KOps/s 4.0040 KOps/s $\color{#d91a1a}-0.94\%$
test_collector_preallocated_write[stack_out-cuda-4096-8] 0.4386ms 0.3764ms 2.6571 KOps/s 2.6748 KOps/s $\color{#d91a1a}-0.66\%$
test_collector_preallocated_write[stack_out-cuda-4096-32] 0.9540ms 0.8919ms 1.1212 KOps/s 1.1198 KOps/s $\color{#35bf28}+0.13\%$
test_collector_preallocated_write[set_at_loop-cpu-32-2] 0.2715ms 0.2127ms 4.7018 KOps/s 4.6174 KOps/s $\color{#35bf28}+1.83\%$
test_collector_preallocated_write[set_at_loop-cpu-32-8] 0.8964ms 0.8157ms 1.2259 KOps/s 1.1850 KOps/s $\color{#35bf28}+3.45\%$
test_collector_preallocated_write[set_at_loop-cpu-32-32] 3.3717ms 3.2377ms 308.8651 Ops/s 300.5790 Ops/s $\color{#35bf28}+2.76\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-2] 0.7546ms 0.3662ms 2.7304 KOps/s 2.6077 KOps/s $\color{#35bf28}+4.71\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-8] 1.8619ms 1.6863ms 593.0143 Ops/s 593.5662 Ops/s $\color{#d91a1a}-0.09\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-32] 10.6202ms 10.1822ms 98.2103 Ops/s 98.3369 Ops/s $\color{#d91a1a}-0.13\%$
test_collector_preallocated_write[set_at_loop-cuda-32-2] 0.4304ms 0.3967ms 2.5207 KOps/s 2.5413 KOps/s $\color{#d91a1a}-0.81\%$
test_collector_preallocated_write[set_at_loop-cuda-32-8] 1.5161ms 1.4752ms 677.8943 Ops/s 677.3331 Ops/s $\color{#35bf28}+0.08\%$
test_collector_preallocated_write[set_at_loop-cuda-32-32] 6.1859ms 5.8064ms 172.2228 Ops/s 174.3600 Ops/s $\color{#d91a1a}-1.23\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-2] 0.4817ms 0.3967ms 2.5209 KOps/s 2.5203 KOps/s $\color{#35bf28}+0.02\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-8] 1.6102ms 1.4902ms 671.0505 Ops/s 677.7452 Ops/s $\color{#d91a1a}-0.99\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-32] 5.9068ms 5.8531ms 170.8501 Ops/s 169.0513 Ops/s $\color{#35bf28}+1.06\%$
test_collector_preallocated_write[copy_at-cpu-32-2] 0.5499ms 0.1745ms 5.7302 KOps/s 5.8363 KOps/s $\color{#d91a1a}-1.82\%$
test_collector_preallocated_write[copy_at-cpu-32-8] 0.7213ms 0.6817ms 1.4669 KOps/s 1.4885 KOps/s $\color{#d91a1a}-1.45\%$
test_collector_preallocated_write[copy_at-cpu-32-32] 2.7798ms 2.6794ms 373.2210 Ops/s 375.0141 Ops/s $\color{#d91a1a}-0.48\%$
test_collector_preallocated_write[copy_at-cpu-4096-2] 0.3906ms 0.3218ms 3.1072 KOps/s 3.1329 KOps/s $\color{#d91a1a}-0.82\%$
test_collector_preallocated_write[copy_at-cpu-4096-8] 2.0157ms 1.6007ms 624.7396 Ops/s 693.4632 Ops/s $\textbf{\color{#d91a1a}-9.91\%}$
test_collector_preallocated_write[copy_at-cpu-4096-32] 9.8721ms 9.4480ms 105.8427 Ops/s 105.9007 Ops/s $\color{#d91a1a}-0.05\%$
test_collector_preallocated_write[copy_at-cuda-32-2] 0.4096ms 0.3284ms 3.0455 KOps/s 3.0910 KOps/s $\color{#d91a1a}-1.47\%$
test_collector_preallocated_write[copy_at-cuda-32-8] 1.3214ms 1.2224ms 818.0420 Ops/s 829.7908 Ops/s $\color{#d91a1a}-1.42\%$
test_collector_preallocated_write[copy_at-cuda-32-32] 4.8676ms 4.7770ms 209.3357 Ops/s 212.8142 Ops/s $\color{#d91a1a}-1.63\%$
test_collector_preallocated_write[copy_at-cuda-4096-2] 0.3755ms 0.3293ms 3.0364 KOps/s 3.0596 KOps/s $\color{#d91a1a}-0.76\%$
test_collector_preallocated_write[copy_at-cuda-4096-8] 1.2871ms 1.2261ms 815.5625 Ops/s 825.9302 Ops/s $\color{#d91a1a}-1.26\%$
test_collector_preallocated_write[copy_at-cuda-4096-32] 4.8378ms 4.7999ms 208.3393 Ops/s 211.2471 Ops/s $\color{#d91a1a}-1.38\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-2] 0.1692ms 0.1228ms 8.1433 KOps/s 8.2228 KOps/s $\color{#d91a1a}-0.97\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-8] 0.5399ms 0.4810ms 2.0789 KOps/s 2.0946 KOps/s $\color{#d91a1a}-0.75\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-32] 1.9676ms 1.9148ms 522.2610 Ops/s 525.7019 Ops/s $\color{#d91a1a}-0.65\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-2] 0.3403ms 0.2535ms 3.9453 KOps/s 3.8238 KOps/s $\color{#35bf28}+3.18\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-8] 1.7675ms 1.3030ms 767.4414 Ops/s 806.3492 Ops/s $\color{#d91a1a}-4.83\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-32] 8.7396ms 8.5192ms 117.3813 Ops/s 117.7381 Ops/s $\color{#d91a1a}-0.30\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-2] 0.3581ms 0.2846ms 3.5136 KOps/s 3.6296 KOps/s $\color{#d91a1a}-3.20\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-8] 1.1159ms 1.0584ms 944.8657 Ops/s 977.8719 Ops/s $\color{#d91a1a}-3.38\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-32] 4.2584ms 4.1358ms 241.7927 Ops/s 250.8317 Ops/s $\color{#d91a1a}-3.60\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-2] 0.3662ms 0.2847ms 3.5123 KOps/s 3.6164 KOps/s $\color{#d91a1a}-2.88\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-8] 1.1321ms 1.0536ms 949.1286 Ops/s 974.1044 Ops/s $\color{#d91a1a}-2.56\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-32] 4.2382ms 4.1530ms 240.7871 Ops/s 248.3275 Ops/s $\color{#d91a1a}-3.04\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-128] 16.8021ms 16.6180ms 60.1759 Ops/s 60.3966 Ops/s $\color{#d91a1a}-0.37\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-256] 33.8056ms 33.6909ms 29.6816 Ops/s 29.9865 Ops/s $\color{#d91a1a}-1.02\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-128] 83.6792ms 83.3364ms 11.9996 Ops/s 11.9365 Ops/s $\color{#35bf28}+0.53\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-256] 0.1987s 0.1982s 5.0457 Ops/s 5.1243 Ops/s $\color{#d91a1a}-1.53\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-128] 15.9663ms 14.2077ms 70.3845 Ops/s 72.2602 Ops/s $\color{#d91a1a}-2.60\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-256] 27.7469ms 27.6329ms 36.1888 Ops/s 36.6513 Ops/s $\color{#d91a1a}-1.26\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-128] 14.3817ms 14.3236ms 69.8147 Ops/s 70.9991 Ops/s $\color{#d91a1a}-1.67\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-256] 28.1512ms 28.0169ms 35.6928 Ops/s 36.1474 Ops/s $\color{#d91a1a}-1.26\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-128] 51.8252ms 51.5778ms 19.3882 Ops/s 18.7936 Ops/s $\color{#35bf28}+3.16\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-256] 0.1055s 0.1043s 9.5868 Ops/s 9.1334 Ops/s $\color{#35bf28}+4.96\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-128] 0.1451s 0.1442s 6.9334 Ops/s 7.0012 Ops/s $\color{#d91a1a}-0.97\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-256] 0.3220s 0.3211s 3.1143 Ops/s 3.1001 Ops/s $\color{#35bf28}+0.46\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-128] 74.5080ms 74.3611ms 13.4479 Ops/s 13.2343 Ops/s $\color{#35bf28}+1.61\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-256] 0.1502s 0.1493s 6.7001 Ops/s 6.8270 Ops/s $\color{#d91a1a}-1.86\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-128] 76.1062ms 75.6824ms 13.2131 Ops/s 13.2444 Ops/s $\color{#d91a1a}-0.24\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-256] 0.1507s 0.1506s 6.6395 Ops/s 6.3401 Ops/s $\color{#35bf28}+4.72\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-128] 30.8838ms 30.7121ms 32.5604 Ops/s 33.1298 Ops/s $\color{#d91a1a}-1.72\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-256] 62.3169ms 62.2109ms 16.0743 Ops/s 16.3556 Ops/s $\color{#d91a1a}-1.72\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-128] 0.1191s 0.1189s 8.4089 Ops/s 8.5389 Ops/s $\color{#d91a1a}-1.52\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-256] 0.2695s 0.2693s 3.7127 Ops/s 3.8486 Ops/s $\color{#d91a1a}-3.53\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-128] 44.2360ms 44.1677ms 22.6410 Ops/s 23.1607 Ops/s $\color{#d91a1a}-2.24\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-256] 88.5927ms 88.3798ms 11.3148 Ops/s 11.6014 Ops/s $\color{#d91a1a}-2.47\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-128] 44.4966ms 44.3687ms 22.5384 Ops/s 22.9441 Ops/s $\color{#d91a1a}-1.77\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-256] 89.1194ms 88.8726ms 11.2521 Ops/s 11.5187 Ops/s $\color{#d91a1a}-2.32\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-128] 20.8651ms 20.7404ms 48.2152 Ops/s 48.5085 Ops/s $\color{#d91a1a}-0.60\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-256] 42.4706ms 42.2943ms 23.6438 Ops/s 23.8449 Ops/s $\color{#d91a1a}-0.84\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-128] 0.1075s 0.1069s 9.3558 Ops/s 9.4291 Ops/s $\color{#d91a1a}-0.78\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-256] 0.2461s 0.2457s 4.0706 Ops/s 4.2369 Ops/s $\color{#d91a1a}-3.93\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-128] 38.1247ms 37.9663ms 26.3391 Ops/s 25.7531 Ops/s $\color{#35bf28}+2.28\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-256] 76.3881ms 75.8634ms 13.1816 Ops/s 12.7942 Ops/s $\color{#35bf28}+3.03\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-128] 38.3629ms 37.9968ms 26.3180 Ops/s 25.7866 Ops/s $\color{#35bf28}+2.06\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-256] 76.2466ms 76.0127ms 13.1557 Ops/s 12.7521 Ops/s $\color{#35bf28}+3.17\%$
test_plain_set_nested 34.8000μs 15.0208μs 66.5745 KOps/s 66.3174 KOps/s $\color{#35bf28}+0.39\%$
test_plain_set_stack_nested 54.3500μs 14.4322μs 69.2897 KOps/s 66.6381 KOps/s $\color{#35bf28}+3.98\%$
test_plain_set_nested_inplace 47.3400μs 16.4574μs 60.7630 KOps/s 60.5224 KOps/s $\color{#35bf28}+0.40\%$
test_plain_set_stack_nested_inplace 68.2010μs 16.0097μs 62.4620 KOps/s 61.4705 KOps/s $\color{#35bf28}+1.61\%$
test_items 26.3300μs 5.9953μs 166.7962 KOps/s 165.3557 KOps/s $\color{#35bf28}+0.87\%$
test_items_nested 0.5184ms 0.4631ms 2.1594 KOps/s 2.1309 KOps/s $\color{#35bf28}+1.34\%$
test_items_nested_locked 0.5129ms 0.4641ms 2.1547 KOps/s 2.1622 KOps/s $\color{#d91a1a}-0.34\%$
test_items_nested_leaf 0.1320ms 98.9963μs 10.1014 KOps/s 10.0665 KOps/s $\color{#35bf28}+0.35\%$
test_items_stack_nested 0.5168ms 0.4624ms 2.1625 KOps/s 2.1690 KOps/s $\color{#d91a1a}-0.30\%$
test_items_stack_nested_leaf 0.1368ms 97.1609μs 10.2922 KOps/s 10.1984 KOps/s $\color{#35bf28}+0.92\%$
test_items_stack_nested_locked 0.5021ms 0.4662ms 2.1449 KOps/s 2.1235 KOps/s $\color{#35bf28}+1.01\%$
test_keys 32.0200μs 4.1991μs 238.1460 KOps/s 237.5605 KOps/s $\color{#35bf28}+0.25\%$
test_keys_nested 0.1632ms 0.1299ms 7.6988 KOps/s 7.6180 KOps/s $\color{#35bf28}+1.06\%$
test_keys_nested_locked 2.0690ms 0.1381ms 7.2410 KOps/s 7.1177 KOps/s $\color{#35bf28}+1.73\%$
test_keys_nested_leaf 0.1570ms 0.1212ms 8.2520 KOps/s 8.1149 KOps/s $\color{#35bf28}+1.69\%$
test_keys_stack_nested 0.1571ms 0.1300ms 7.6919 KOps/s 7.5755 KOps/s $\color{#35bf28}+1.54\%$
test_keys_stack_nested_leaf 0.1777ms 0.1202ms 8.3195 KOps/s 8.2469 KOps/s $\color{#35bf28}+0.88\%$
test_keys_stack_nested_locked 0.1870ms 0.1374ms 7.2797 KOps/s 7.2155 KOps/s $\color{#35bf28}+0.89\%$
test_values 3.6440μs 1.0029μs 997.1513 KOps/s 991.0112 KOps/s $\color{#35bf28}+0.62\%$
test_values_nested 75.1010μs 52.9279μs 18.8936 KOps/s 18.6128 KOps/s $\color{#35bf28}+1.51\%$
test_values_nested_locked 0.1019ms 56.5150μs 17.6944 KOps/s 17.6439 KOps/s $\color{#35bf28}+0.29\%$
test_values_nested_leaf 82.4310μs 60.5871μs 16.5052 KOps/s 16.0995 KOps/s $\color{#35bf28}+2.52\%$
test_values_stack_nested 81.7120μs 52.5459μs 19.0310 KOps/s 18.6620 KOps/s $\color{#35bf28}+1.98\%$
test_values_stack_nested_leaf 0.1044ms 60.4649μs 16.5385 KOps/s 16.3414 KOps/s $\color{#35bf28}+1.21\%$
test_values_stack_nested_locked 93.2110μs 56.1316μs 17.8153 KOps/s 17.6094 KOps/s $\color{#35bf28}+1.17\%$
test_membership 4.7952μs 0.8421μs 1.1875 MOps/s 1.2120 MOps/s $\color{#d91a1a}-2.02\%$
test_membership_nested 46.9210μs 3.0060μs 332.6668 KOps/s 337.5210 KOps/s $\color{#d91a1a}-1.44\%$
test_membership_nested_leaf 16.1900μs 2.9496μs 339.0248 KOps/s 349.8200 KOps/s $\color{#d91a1a}-3.09\%$
test_membership_stacked_nested 35.8310μs 2.8554μs 350.2181 KOps/s 344.6828 KOps/s $\color{#35bf28}+1.61\%$
test_membership_stacked_nested_leaf 40.7500μs 2.8736μs 347.9992 KOps/s 346.5653 KOps/s $\color{#35bf28}+0.41\%$
test_membership_nested_last 41.5500μs 4.5112μs 221.6700 KOps/s 224.6798 KOps/s $\color{#d91a1a}-1.34\%$
test_membership_nested_leaf_last 36.3500μs 4.5033μs 222.0603 KOps/s 226.2510 KOps/s $\color{#d91a1a}-1.85\%$
test_membership_stacked_nested_last 25.4100μs 4.3101μs 232.0107 KOps/s 230.1926 KOps/s $\color{#35bf28}+0.79\%$
test_membership_stacked_nested_leaf_last 36.2300μs 4.2983μs 232.6495 KOps/s 232.5503 KOps/s $\color{#35bf28}+0.04\%$
test_nested_getleaf 50.5510μs 21.5733μs 46.3535 KOps/s 47.8393 KOps/s $\color{#d91a1a}-3.11\%$
test_nested_get 49.2710μs 20.4295μs 48.9488 KOps/s 50.1149 KOps/s $\color{#d91a1a}-2.33\%$
test_stacked_getleaf 51.9700μs 21.3486μs 46.8415 KOps/s 47.2590 KOps/s $\color{#d91a1a}-0.88\%$
test_stacked_get 79.0320μs 20.1940μs 49.5197 KOps/s 49.8232 KOps/s $\color{#d91a1a}-0.61\%$
test_nested_getitemleaf 61.0600μs 22.3049μs 44.8331 KOps/s 45.2641 KOps/s $\color{#d91a1a}-0.95\%$
test_nested_getitem 81.8210μs 21.2789μs 46.9948 KOps/s 48.0726 KOps/s $\color{#d91a1a}-2.24\%$
test_stacked_getitemleaf 0.1139ms 21.8569μs 45.7522 KOps/s 46.1931 KOps/s $\color{#d91a1a}-0.95\%$
test_stacked_getitem 48.6000μs 20.7591μs 48.1716 KOps/s 48.5422 KOps/s $\color{#d91a1a}-0.76\%$
test_lock_nested 4.7030ms 0.5182ms 1.9299 KOps/s 1.9477 KOps/s $\color{#d91a1a}-0.92\%$
test_lock_stack_nested 0.5851ms 0.5174ms 1.9329 KOps/s 1.9580 KOps/s $\color{#d91a1a}-1.28\%$
test_unlock_nested 0.4818ms 0.4060ms 2.4628 KOps/s 2.4896 KOps/s $\color{#d91a1a}-1.08\%$
test_unlock_stack_nested 0.5434ms 0.4085ms 2.4482 KOps/s 2.4756 KOps/s $\color{#d91a1a}-1.11\%$
test_flatten_speed 0.2555ms 0.1227ms 8.1531 KOps/s 8.1153 KOps/s $\color{#35bf28}+0.47\%$
test_unflatten_speed 0.6573ms 0.5624ms 1.7781 KOps/s 1.7674 KOps/s $\color{#35bf28}+0.60\%$
test_common_ops 0.8495ms 0.7202ms 1.3885 KOps/s 1.4151 KOps/s $\color{#d91a1a}-1.88\%$
test_creation 73.9610μs 3.1729μs 315.1674 KOps/s 315.3046 KOps/s $\color{#d91a1a}-0.04\%$
test_creation_empty 45.9610μs 6.9942μs 142.9747 KOps/s 142.9332 KOps/s $\color{#35bf28}+0.03\%$
test_creation_nested_1 34.2410μs 11.5391μs 86.6618 KOps/s 87.2394 KOps/s $\color{#d91a1a}-0.66\%$
test_creation_nested_2 35.7500μs 13.5283μs 73.9191 KOps/s 74.2158 KOps/s $\color{#d91a1a}-0.40\%$
test_creation_many_keys[10] 51.5710μs 21.0955μs 47.4035 KOps/s 48.0342 KOps/s $\color{#d91a1a}-1.31\%$
test_creation_many_keys[50] 0.1364ms 91.4650μs 10.9331 KOps/s 11.0872 KOps/s $\color{#d91a1a}-1.39\%$
test_creation_many_keys[100] 0.2482ms 0.1794ms 5.5744 KOps/s 5.6932 KOps/s $\color{#d91a1a}-2.09\%$
test_creation_nested_many_keys[10] 88.2910μs 45.6269μs 21.9169 KOps/s 22.3034 KOps/s $\color{#d91a1a}-1.73\%$
test_creation_nested_many_keys[50] 0.2451ms 0.1873ms 5.3394 KOps/s 5.4466 KOps/s $\color{#d91a1a}-1.97\%$
test_clone 0.2836ms 13.6971μs 73.0081 KOps/s 74.4073 KOps/s $\color{#d91a1a}-1.88\%$
test_getitem[int] 1.4304ms 15.5674μs 64.2367 KOps/s 65.1188 KOps/s $\color{#d91a1a}-1.35\%$
test_getitem[slice_int] 0.1617ms 24.7321μs 40.4334 KOps/s 40.4256 KOps/s $\color{#35bf28}+0.02\%$
test_getitem[range] 0.1774ms 64.5113μs 15.5012 KOps/s 15.7099 KOps/s $\color{#d91a1a}-1.33\%$
test_getitem[tuple] 0.1462ms 24.7616μs 40.3851 KOps/s 41.6422 KOps/s $\color{#d91a1a}-3.02\%$
test_getitem[list] 0.1987ms 60.0112μs 16.6636 KOps/s 16.9653 KOps/s $\color{#d91a1a}-1.78\%$
test_setitem_dim[int] 47.4510μs 26.1985μs 38.1701 KOps/s 38.3997 KOps/s $\color{#d91a1a}-0.60\%$
test_setitem_dim[slice_int] 69.8510μs 43.7010μs 22.8828 KOps/s 22.0309 KOps/s $\color{#35bf28}+3.87\%$
test_setitem_dim[range] 0.1257ms 96.8523μs 10.3250 KOps/s 9.9574 KOps/s $\color{#35bf28}+3.69\%$
test_setitem_dim[tuple] 61.0010μs 40.3742μs 24.7683 KOps/s 25.4600 KOps/s $\color{#d91a1a}-2.72\%$
test_setitem 60.6600μs 18.1006μs 55.2468 KOps/s 56.3803 KOps/s $\color{#d91a1a}-2.01\%$
test_set 52.4610μs 17.2879μs 57.8438 KOps/s 57.8929 KOps/s $\color{#d91a1a}-0.08\%$
test_set_shared 0.5460ms 0.2134ms 4.6851 KOps/s 4.7777 KOps/s $\color{#d91a1a}-1.94\%$
test_update 0.1930ms 22.0716μs 45.3072 KOps/s 45.6624 KOps/s $\color{#d91a1a}-0.78\%$
test_update_nested 73.3510μs 34.2408μs 29.2049 KOps/s 28.2980 KOps/s $\color{#35bf28}+3.20\%$
test_update__nested 0.4780ms 33.5569μs 29.8001 KOps/s 28.0664 KOps/s $\textbf{\color{#35bf28}+6.18\%}$
test_set_nested 54.7500μs 18.8786μs 52.9700 KOps/s 49.0186 KOps/s $\textbf{\color{#35bf28}+8.06\%}$
test_set_nested_new 64.9510μs 23.6581μs 42.2689 KOps/s 41.9607 KOps/s $\color{#35bf28}+0.73\%$
test_select 75.0310μs 40.2854μs 24.8229 KOps/s 24.5744 KOps/s $\color{#35bf28}+1.01\%$
test_select_nested 0.1062ms 73.6230μs 13.5827 KOps/s 13.3857 KOps/s $\color{#35bf28}+1.47\%$
test_exclude_nested 0.1345ms 89.2759μs 11.2012 KOps/s 10.9615 KOps/s $\color{#35bf28}+2.19\%$
test_empty[True] 0.4887ms 0.3948ms 2.5327 KOps/s 2.4939 KOps/s $\color{#35bf28}+1.56\%$
test_empty[False] 9.5700μs 1.3781μs 725.6500 KOps/s 714.7355 KOps/s $\color{#35bf28}+1.53\%$
test_to 0.1102ms 70.3645μs 14.2117 KOps/s 14.2492 KOps/s $\color{#d91a1a}-0.26\%$
test_to_nonblocking 0.1086ms 72.7350μs 13.7485 KOps/s 14.3135 KOps/s $\color{#d91a1a}-3.95\%$
test_unbind_speed 0.3982ms 0.3466ms 2.8855 KOps/s 2.9524 KOps/s $\color{#d91a1a}-2.27\%$
test_unbind_speed_stack0 0.4242ms 0.3429ms 2.9160 KOps/s 2.9835 KOps/s $\color{#d91a1a}-2.26\%$
test_unbind_speed_stack1 0.8177ms 0.7770ms 1.2870 KOps/s 1.0457 KOps/s $\textbf{\color{#35bf28}+23.08\%}$
test_split 1.2262ms 1.1491ms 870.2700 Ops/s 869.1757 Ops/s $\color{#35bf28}+0.13\%$
test_chunk 0.1139s 1.2227ms 817.8429 Ops/s 911.4879 Ops/s $\textbf{\color{#d91a1a}-10.27\%}$
test_to_cpu_blocking 20.2238ms 20.1239ms 49.6921 Ops/s 49.5832 Ops/s $\color{#35bf28}+0.22\%$
test_to_cpu_global_sync 12.0148ms 11.9240ms 83.8642 Ops/s 85.4511 Ops/s $\color{#d91a1a}-1.86\%$
test_to_cpu_event_sync 15.1112ms 12.9884ms 76.9915 Ops/s 70.3052 Ops/s $\textbf{\color{#35bf28}+9.51\%}$
test_to_cpu_default 0.1269s 14.4787ms 69.0671 Ops/s 78.4840 Ops/s $\textbf{\color{#d91a1a}-12.00\%}$
test_consolidate[False-None] 4.6492ms 4.2161ms 237.1865 Ops/s 241.1273 Ops/s $\color{#d91a1a}-1.63\%$
test_consolidate[default-None] 3.4828ms 2.2031ms 453.9083 Ops/s 460.8513 Ops/s $\color{#d91a1a}-1.51\%$
test_consolidate[reduce-overhead-None] 3.4633ms 2.1265ms 470.2652 Ops/s 474.8541 Ops/s $\color{#d91a1a}-0.97\%$
test_consolidate_njt[False-None] 8.8756ms 8.5818ms 116.5250 Ops/s 117.5238 Ops/s $\color{#d91a1a}-0.85\%$
test_to[False-False-None] 2.2850ms 2.1967ms 455.2243 Ops/s 462.4451 Ops/s $\color{#d91a1a}-1.56\%$
test_to[True-False-None] 2.2306ms 1.9395ms 515.5896 Ops/s 523.8157 Ops/s $\color{#d91a1a}-1.57\%$
test_to[within-False-None] 6.3396ms 6.3006ms 158.7151 Ops/s 161.3084 Ops/s $\color{#d91a1a}-1.61\%$
test_to[True-default-None] 10.9175ms 10.8090ms 92.5155 Ops/s 92.4697 Ops/s $\color{#35bf28}+0.05\%$
test_to_njt[False-False-None] 8.8057ms 8.6348ms 115.8102 Ops/s 115.2021 Ops/s $\color{#35bf28}+0.53\%$
test_to_njt[True-False-None] 7.2443ms 6.9917ms 143.0265 Ops/s 145.1407 Ops/s $\color{#d91a1a}-1.46\%$
test_to_njt[within-False-None] 15.7723ms 15.5363ms 64.3656 Ops/s 64.5994 Ops/s $\color{#d91a1a}-0.36\%$
test_creation[device0] 0.5060ms 0.1173ms 8.5253 KOps/s 8.6309 KOps/s $\color{#d91a1a}-1.22\%$
test_creation_from_tensor 0.4487ms 0.1171ms 8.5387 KOps/s 8.8689 KOps/s $\color{#d91a1a}-3.72\%$
test_add_one[memmap_tensor0] 0.3304ms 6.9657μs 143.5602 KOps/s 146.8423 KOps/s $\color{#d91a1a}-2.24\%$
test_contiguous[memmap_tensor0] 17.8000μs 0.6501μs 1.5383 MOps/s 2.2098 MOps/s $\textbf{\color{#d91a1a}-30.39\%}$
test_stack[memmap_tensor0] 36.2710μs 4.4144μs 226.5315 KOps/s 235.1209 KOps/s $\color{#d91a1a}-3.65\%$
test_memmaptd_index 1.2848ms 0.2809ms 3.5603 KOps/s 3.6669 KOps/s $\color{#d91a1a}-2.91\%$
test_memmaptd_index_astensor 0.5388ms 0.3829ms 2.6115 KOps/s 2.6290 KOps/s $\color{#d91a1a}-0.67\%$
test_memmaptd_index_op 0.8028ms 0.6492ms 1.5404 KOps/s 1.5593 KOps/s $\color{#d91a1a}-1.21\%$
test_serialize_model 0.1380s 0.1349s 7.4142 Ops/s 7.3735 Ops/s $\color{#35bf28}+0.55\%$
test_serialize_model_pickle 1.3476s 1.2103s 0.8263 Ops/s 0.8264 Ops/s $\color{#d91a1a}-0.02\%$
test_serialize_weights 0.1360s 0.1338s 7.4759 Ops/s 7.4920 Ops/s $\color{#d91a1a}-0.21\%$
test_serialize_weights_returnearly 0.4782s 90.3003ms 11.0742 Ops/s 10.8098 Ops/s $\color{#35bf28}+2.45\%$
test_serialize_weights_pickle 1.3478s 1.2138s 0.8238 Ops/s 0.8230 Ops/s $\color{#35bf28}+0.10\%$
test_reshape_pytree 0.2095ms 33.2099μs 30.1115 KOps/s 30.4345 KOps/s $\color{#d91a1a}-1.06\%$
test_reshape_td 71.6910μs 45.3436μs 22.0538 KOps/s 21.9047 KOps/s $\color{#35bf28}+0.68\%$
test_view_pytree 0.2330ms 32.7054μs 30.5760 KOps/s 30.6824 KOps/s $\color{#d91a1a}-0.35\%$
test_view_td 0.1056ms 54.1987μs 18.4506 KOps/s 18.1768 KOps/s $\color{#35bf28}+1.51\%$
test_unbind_pytree 0.2335ms 37.3659μs 26.7624 KOps/s 26.9836 KOps/s $\color{#d91a1a}-0.82\%$
test_unbind_td 84.6910μs 52.7866μs 18.9442 KOps/s 19.7850 KOps/s $\color{#d91a1a}-4.25\%$
test_split_pytree 0.2302ms 42.8962μs 23.3121 KOps/s 23.8261 KOps/s $\color{#d91a1a}-2.16\%$
test_split_td 0.1255ms 67.2117μs 14.8784 KOps/s 15.0900 KOps/s $\color{#d91a1a}-1.40\%$
test_add_pytree 0.2506ms 43.0619μs 23.2224 KOps/s 23.3690 KOps/s $\color{#d91a1a}-0.63\%$
test_add_td 0.1087ms 55.0038μs 18.1806 KOps/s 18.1313 KOps/s $\color{#35bf28}+0.27\%$
test_compile_add_one_nested[tensordict-compile] 0.3176ms 0.2333ms 4.2865 KOps/s 4.2628 KOps/s $\color{#35bf28}+0.56\%$
test_compile_add_one_nested[tensordict-eager] 0.3245ms 0.2028ms 4.9314 KOps/s 4.9837 KOps/s $\color{#d91a1a}-1.05\%$
test_compile_add_one_nested[pytree-compile] 0.2959ms 0.1349ms 7.4103 KOps/s 7.2138 KOps/s $\color{#35bf28}+2.72\%$
test_compile_add_one_nested[pytree-eager] 0.4826ms 0.1821ms 5.4916 KOps/s 5.5147 KOps/s $\color{#d91a1a}-0.42\%$
test_compile_copy_nested[tensordict-compile] 69.8910μs 15.8707μs 63.0093 KOps/s 67.7466 KOps/s $\textbf{\color{#d91a1a}-6.99\%}$
test_compile_copy_nested[tensordict-eager] 0.3424ms 53.8080μs 18.5846 KOps/s 18.6400 KOps/s $\color{#d91a1a}-0.30\%$
test_compile_copy_nested[pytree-compile] 0.1620ms 15.6790μs 63.7796 KOps/s 65.0856 KOps/s $\color{#d91a1a}-2.01\%$
test_compile_copy_nested[pytree-eager] 0.4185ms 68.8552μs 14.5232 KOps/s 14.5100 KOps/s $\color{#35bf28}+0.09\%$
test_compile_add_one_flat[tensordict-compile] 0.4991ms 0.2575ms 3.8840 KOps/s 3.7734 KOps/s $\color{#35bf28}+2.93\%$
test_compile_add_one_flat[tensordict-eager] 0.3312ms 0.2863ms 3.4927 KOps/s 3.4888 KOps/s $\color{#35bf28}+0.11\%$
test_compile_add_one_flat[tensorclass-compile] 0.3152ms 0.1899ms 5.2664 KOps/s 5.0810 KOps/s $\color{#35bf28}+3.65\%$
test_compile_add_one_flat[tensorclass-eager] 0.1354ms 74.7454μs 13.3787 KOps/s 13.4374 KOps/s $\color{#d91a1a}-0.44\%$
test_compile_add_one_flat[pytree-compile] 0.2617ms 0.1942ms 5.1503 KOps/s 4.9693 KOps/s $\color{#35bf28}+3.64\%$
test_compile_add_one_flat[pytree-eager] 0.8169ms 0.5459ms 1.8318 KOps/s 1.9070 KOps/s $\color{#d91a1a}-3.95\%$
test_compile_add_self_flat[tensordict-eager] 0.3894ms 0.3364ms 2.9729 KOps/s 2.9122 KOps/s $\color{#35bf28}+2.08\%$
test_compile_add_self_flat[tensordict-compile] 0.3982ms 0.2525ms 3.9611 KOps/s 3.6012 KOps/s $\textbf{\color{#35bf28}+9.99\%}$
test_compile_add_self_flat[tensorclass-eager] 0.1357ms 90.8207μs 11.0107 KOps/s 11.0766 KOps/s $\color{#d91a1a}-0.59\%$
test_compile_add_self_flat[tensorclass-compile] 0.3740ms 0.1909ms 5.2395 KOps/s 4.8575 KOps/s $\textbf{\color{#35bf28}+7.87\%}$
test_compile_add_self_flat[pytree-eager] 0.7046ms 0.4395ms 2.2751 KOps/s 2.3108 KOps/s $\color{#d91a1a}-1.54\%$
test_compile_add_self_flat[pytree-compile] 0.2723ms 0.1932ms 5.1762 KOps/s 4.9737 KOps/s $\color{#35bf28}+4.07\%$
test_compile_copy_flat[tensordict-compile] 57.1410μs 19.2957μs 51.8250 KOps/s 50.1438 KOps/s $\color{#35bf28}+3.35\%$
test_compile_copy_flat[tensordict-eager] 79.1210μs 41.4058μs 24.1512 KOps/s 24.2454 KOps/s $\color{#d91a1a}-0.39\%$
test_compile_copy_flat[pytree-compile] 0.2135ms 21.4722μs 46.5718 KOps/s 45.7515 KOps/s $\color{#35bf28}+1.79\%$
test_compile_copy_flat[pytree-eager] 0.3471ms 52.4489μs 19.0662 KOps/s 19.1096 KOps/s $\color{#d91a1a}-0.23\%$
test_compile_assign_and_add[tensordict-compile] 2.1926ms 0.2423ms 4.1268 KOps/s 3.8468 KOps/s $\textbf{\color{#35bf28}+7.28\%}$
test_compile_assign_and_add[tensordict-eager] 3.5371ms 3.3721ms 296.5472 Ops/s 302.3202 Ops/s $\color{#d91a1a}-1.91\%$
test_compile_assign_and_add[pytree-compile] 2.1027ms 0.1824ms 5.4834 KOps/s 5.3334 KOps/s $\color{#35bf28}+2.81\%$
test_compile_assign_and_add[pytree-eager] 3.0712ms 2.8649ms 349.0572 Ops/s 357.2708 Ops/s $\color{#d91a1a}-2.30\%$
test_compile_indexing[tensor-tensordict-compile] 0.2890ms 0.1347ms 7.4239 KOps/s 6.8596 KOps/s $\textbf{\color{#35bf28}+8.23\%}$
test_compile_indexing[tensor-tensordict-eager] 0.3838ms 76.0421μs 13.1506 KOps/s 12.8451 KOps/s $\color{#35bf28}+2.38\%$
test_compile_indexing[tensor-tensorclass-compile] 0.2738ms 0.1195ms 8.3685 KOps/s 7.8964 KOps/s $\textbf{\color{#35bf28}+5.98\%}$
test_compile_indexing[tensor-tensorclass-eager] 0.3066ms 45.3974μs 22.0277 KOps/s 21.3533 KOps/s $\color{#35bf28}+3.16\%$
test_compile_indexing[tensor-pytree-compile] 0.1632ms 0.1207ms 8.2854 KOps/s 7.8754 KOps/s $\textbf{\color{#35bf28}+5.21\%}$
test_compile_indexing[tensor-pytree-eager] 0.2779ms 45.4620μs 21.9964 KOps/s 21.4173 KOps/s $\color{#35bf28}+2.70\%$
test_compile_indexing[slice-tensordict-compile] 0.2320ms 84.2358μs 11.8714 KOps/s 11.4374 KOps/s $\color{#35bf28}+3.79\%$
test_compile_indexing[slice-tensordict-eager] 0.2161ms 27.1292μs 36.8607 KOps/s 36.3531 KOps/s $\color{#35bf28}+1.40\%$
test_compile_indexing[slice-tensorclass-compile] 0.2089ms 70.5845μs 14.1674 KOps/s 14.0897 KOps/s $\color{#35bf28}+0.55\%$
test_compile_indexing[slice-tensorclass-eager] 0.2720ms 22.8102μs 43.8400 KOps/s 44.8410 KOps/s $\color{#d91a1a}-2.23\%$
test_compile_indexing[slice-pytree-compile] 0.1245ms 71.9974μs 13.8894 KOps/s 13.5674 KOps/s $\color{#35bf28}+2.37\%$
test_compile_indexing[slice-pytree-eager] 0.2707ms 22.6933μs 44.0658 KOps/s 45.0308 KOps/s $\color{#d91a1a}-2.14\%$
test_compile_indexing[int-tensordict-compile] 0.2845ms 85.0903μs 11.7522 KOps/s 11.5391 KOps/s $\color{#35bf28}+1.85\%$
test_compile_indexing[int-tensordict-eager] 0.2084ms 27.6738μs 36.1353 KOps/s 36.9401 KOps/s $\color{#d91a1a}-2.18\%$
test_compile_indexing[int-tensorclass-compile] 0.1374ms 71.7013μs 13.9467 KOps/s 13.9834 KOps/s $\color{#d91a1a}-0.26\%$
test_compile_indexing[int-tensorclass-eager] 0.2582ms 22.6250μs 44.1989 KOps/s 44.9309 KOps/s $\color{#d91a1a}-1.63\%$
test_compile_indexing[int-pytree-compile] 0.1213ms 72.0669μs 13.8760 KOps/s 14.0152 KOps/s $\color{#d91a1a}-0.99\%$
test_compile_indexing[int-pytree-eager] 0.2692ms 22.6958μs 44.0610 KOps/s 45.3213 KOps/s $\color{#d91a1a}-2.78\%$
test_compile_replace[single-eager] 88.3310μs 47.6886μs 20.9694 KOps/s 21.3040 KOps/s $\color{#d91a1a}-1.57\%$
test_compile_replace[single-compile] 0.2508ms 0.1306ms 7.6543 KOps/s 7.2309 KOps/s $\textbf{\color{#35bf28}+5.86\%}$
test_compile_replace[multi-eager] 0.6636ms 0.5742ms 1.7415 KOps/s 1.7797 KOps/s $\color{#d91a1a}-2.15\%$
test_compile_replace[multi-compile] 0.2918ms 0.1389ms 7.1993 KOps/s 7.0375 KOps/s $\color{#35bf28}+2.30\%$
test_compile_tc_getattr_20[eager] 0.2386ms 0.1760ms 5.6830 KOps/s 6.0060 KOps/s $\textbf{\color{#d91a1a}-5.38\%}$
test_compile_tc_getattr_20[compile] 0.3357ms 0.1486ms 6.7275 KOps/s 6.4720 KOps/s $\color{#35bf28}+3.95\%$
test_compile_clone_shallow[20-eager] 47.9100μs 19.3916μs 51.5687 KOps/s 52.5009 KOps/s $\color{#d91a1a}-1.78\%$
test_compile_clone_shallow[20-compile] 86.8910μs 17.0165μs 58.7666 KOps/s 59.6080 KOps/s $\color{#d91a1a}-1.41\%$
test_compile_clone_shallow[40-eager] 78.1310μs 33.4707μs 29.8768 KOps/s 29.5281 KOps/s $\color{#35bf28}+1.18\%$
test_compile_clone_shallow[40-compile] 87.4910μs 18.7112μs 53.4440 KOps/s 53.9590 KOps/s $\color{#d91a1a}-0.95\%$
test_compile_clone_shallow[80-eager] 96.5910μs 62.1503μs 16.0900 KOps/s 15.9453 KOps/s $\color{#35bf28}+0.91\%$
test_compile_clone_shallow[80-compile] 83.2410μs 22.5723μs 44.3021 KOps/s 45.5780 KOps/s $\color{#d91a1a}-2.80\%$
test_compile_update_inplace[eager] 0.1095ms 63.2485μs 15.8106 KOps/s 16.2602 KOps/s $\color{#d91a1a}-2.77\%$
test_compile_update_inplace[compile] 0.3327ms 0.1471ms 6.7961 KOps/s 6.6579 KOps/s $\color{#35bf28}+2.08\%$
test_mod_add[eager] 0.2756ms 0.2282ms 4.3815 KOps/s 4.4461 KOps/s $\color{#d91a1a}-1.45\%$
test_mod_add[compile] 0.3522ms 0.1338ms 7.4727 KOps/s 7.4964 KOps/s $\color{#d91a1a}-0.32\%$
test_mod_add[compile-overhead] 0.4376ms 0.1783ms 5.6089 KOps/s 5.5691 KOps/s $\color{#35bf28}+0.71\%$
test_mod_wrap[eager] 0.5546ms 0.4725ms 2.1166 KOps/s 2.0435 KOps/s $\color{#35bf28}+3.58\%$
test_mod_wrap[compile] 0.4959ms 0.4106ms 2.4355 KOps/s 2.4976 KOps/s $\color{#d91a1a}-2.48\%$
test_mod_wrap[compile-overhead] 8.1826ms 4.5538ms 219.5955 Ops/s 216.7850 Ops/s $\color{#35bf28}+1.30\%$
test_mod_wrap_and_backward[eager] 2.2912ms 1.7123ms 584.0146 Ops/s 589.3963 Ops/s $\color{#d91a1a}-0.91\%$
test_mod_wrap_and_backward[compile] 2.2595ms 1.5761ms 634.4764 Ops/s 652.3537 Ops/s $\color{#d91a1a}-2.74\%$
test_mod_wrap_and_backward[compile-overhead] 1.3960ms 0.9465ms 1.0566 KOps/s 1.0453 KOps/s $\color{#35bf28}+1.07\%$
test_seq_add[eager] 0.5761ms 0.5120ms 1.9533 KOps/s 1.9555 KOps/s $\color{#d91a1a}-0.11\%$
test_seq_add[compile] 0.2236ms 0.1479ms 6.7627 KOps/s 6.8514 KOps/s $\color{#d91a1a}-1.29\%$
test_seq_add[compile-overhead] 0.3095ms 0.1884ms 5.3070 KOps/s 5.2491 KOps/s $\color{#35bf28}+1.10\%$
test_seq_wrap[eager] 1.5043ms 1.4105ms 708.9726 Ops/s 707.5115 Ops/s $\color{#35bf28}+0.21\%$
test_seq_wrap[compile] 0.5413ms 0.4158ms 2.4049 KOps/s 2.3875 KOps/s $\color{#35bf28}+0.73\%$
test_seq_wrap[compile-overhead] 0.4531ms 0.3124ms 3.2008 KOps/s 3.2516 KOps/s $\color{#d91a1a}-1.56\%$
test_func_call_runtime[False-eager] 0.9124ms 0.8609ms 1.1616 KOps/s 1.1862 KOps/s $\color{#d91a1a}-2.08\%$
test_func_call_runtime[False-compile] 1.2277ms 1.0397ms 961.8460 Ops/s 1.0128 KOps/s $\textbf{\color{#d91a1a}-5.03\%}$
test_func_call_runtime[False-compile-overhead] 0.6945ms 0.5083ms 1.9674 KOps/s 1.9478 KOps/s $\color{#35bf28}+1.00\%$
test_func_call_runtime[True-eager] 1.1751ms 1.0789ms 926.8403 Ops/s 939.9789 Ops/s $\color{#d91a1a}-1.40\%$
test_func_call_runtime[True-compile] 1.1047ms 1.0161ms 984.1361 Ops/s 997.0203 Ops/s $\color{#d91a1a}-1.29\%$
test_func_call_runtime[True-compile-overhead] 0.5760ms 0.5226ms 1.9136 KOps/s 1.8931 KOps/s $\color{#35bf28}+1.08\%$
test_func_call_cm_runtime[False-eager] 0.9180ms 0.8313ms 1.2029 KOps/s 1.2480 KOps/s $\color{#d91a1a}-3.62\%$
test_func_call_cm_runtime[False-compile] 1.1477ms 0.9784ms 1.0221 KOps/s 1.0262 KOps/s $\color{#d91a1a}-0.40\%$
test_func_call_cm_runtime[False-compile-overhead] 0.6892ms 0.4897ms 2.0420 KOps/s 2.0184 KOps/s $\color{#35bf28}+1.17\%$
test_func_call_cm_runtime[True-eager] 1.3376ms 1.2308ms 812.4884 Ops/s 820.4765 Ops/s $\color{#d91a1a}-0.97\%$
test_func_call_cm_runtime[True-compile] 1.1201ms 1.0376ms 963.7411 Ops/s 968.3004 Ops/s $\color{#d91a1a}-0.47\%$
test_func_call_cm_runtime[True-compile-overhead] 0.6274ms 0.5519ms 1.8119 KOps/s 1.8011 KOps/s $\color{#35bf28}+0.60\%$
test_vmap_func_call_cm_runtime[eager] 2.9229ms 2.4196ms 413.2942 Ops/s 414.6568 Ops/s $\color{#d91a1a}-0.33\%$
test_vmap_func_call_cm_runtime[compile] 3.1378ms 2.5981ms 384.9012 Ops/s 384.8074 Ops/s $\color{#35bf28}+0.02\%$
test_vmap_func_call_cm_runtime[compile-overhead] 3.0903ms 2.5970ms 385.0562 Ops/s 384.3363 Ops/s $\color{#35bf28}+0.19\%$
test_distributed 0.5715ms 0.1451ms 6.8928 KOps/s 6.7899 KOps/s $\color{#35bf28}+1.52\%$
test_tdmodule 0.3897ms 0.1930ms 5.1822 KOps/s 5.1149 KOps/s $\color{#35bf28}+1.32\%$
test_tdmodule_dispatch 0.4233ms 0.3761ms 2.6585 KOps/s 2.6435 KOps/s $\color{#35bf28}+0.57\%$
test_tdseq 49.5210μs 26.8279μs 37.2747 KOps/s 36.5850 KOps/s $\color{#35bf28}+1.89\%$
test_tdseq_dispatch 0.2727ms 0.2179ms 4.5894 KOps/s 4.5268 KOps/s $\color{#35bf28}+1.38\%$
test_instantiation_functorch 2.1567ms 2.0766ms 481.5468 Ops/s 484.6572 Ops/s $\color{#d91a1a}-0.64\%$
test_exec_functorch 0.2338ms 0.1845ms 5.4198 KOps/s 5.5053 KOps/s $\color{#d91a1a}-1.55\%$
test_exec_functional_call 0.2236ms 0.1653ms 6.0498 KOps/s 6.2733 KOps/s $\color{#d91a1a}-3.56\%$
test_exec_td_decorator 2.1042ms 0.2530ms 3.9528 KOps/s 3.9549 KOps/s $\color{#d91a1a}-0.05\%$
test_vmap_mlp_speed_decorator[True-True] 1.2543ms 1.0461ms 955.9416 Ops/s 960.5561 Ops/s $\color{#d91a1a}-0.48\%$
test_vmap_mlp_speed_decorator[True-False] 1.2628ms 1.0435ms 958.2856 Ops/s 963.9164 Ops/s $\color{#d91a1a}-0.58\%$
test_vmap_mlp_speed_decorator[False-True] 0.9618ms 0.7432ms 1.3456 KOps/s 1.3564 KOps/s $\color{#d91a1a}-0.80\%$
test_vmap_mlp_speed_decorator[False-False] 0.9542ms 0.7481ms 1.3367 KOps/s 1.3561 KOps/s $\color{#d91a1a}-1.43\%$
test_vmap_transformer_speed_decorator[True-True] 22.0526ms 21.2578ms 47.0416 Ops/s 47.3294 Ops/s $\color{#d91a1a}-0.61\%$
test_vmap_transformer_speed_decorator[True-False] 21.8792ms 21.2543ms 47.0493 Ops/s 47.3463 Ops/s $\color{#d91a1a}-0.63\%$
test_vmap_transformer_speed_decorator[False-True] 21.6317ms 20.9467ms 47.7403 Ops/s 48.2730 Ops/s $\color{#d91a1a}-1.10\%$
test_vmap_transformer_speed_decorator[False-False] 21.6783ms 20.9231ms 47.7941 Ops/s 48.2697 Ops/s $\color{#d91a1a}-0.99\%$
test_to_module_speed[True] 2.2663ms 1.6557ms 603.9611 Ops/s 596.7702 Ops/s $\color{#35bf28}+1.20\%$
test_to_module_speed[False] 2.2248ms 1.6366ms 611.0228 Ops/s 619.1458 Ops/s $\color{#d91a1a}-1.31\%$
test_to_module_plain_tensor_speed[None] 2.3782ms 1.7376ms 575.5119 Ops/s 571.4377 Ops/s $\color{#35bf28}+0.71\%$
test_to_module_plain_tensor_speed[False] 2.1657ms 1.5743ms 635.1945 Ops/s 626.8046 Ops/s $\color{#35bf28}+1.34\%$
test_to_module_plain_tensor_speed[True] 3.5089ms 3.3822ms 295.6680 Ops/s 296.6928 Ops/s $\color{#d91a1a}-0.35\%$
test_tc_init 76.2310μs 42.6157μs 23.4655 KOps/s 22.8263 KOps/s $\color{#35bf28}+2.80\%$
test_tc_init_tensor_only 46.7210μs 8.9558μs 111.6589 KOps/s 109.6920 KOps/s $\color{#35bf28}+1.79\%$
test_tc_init_nested 0.1140ms 84.3036μs 11.8619 KOps/s 11.6141 KOps/s $\color{#35bf28}+2.13\%$
test_tc_init_many_fields 44.0610μs 14.7405μs 67.8403 KOps/s 67.0601 KOps/s $\color{#35bf28}+1.16\%$
test_tc_first_layer_tensor 20.0900μs 1.7865μs 559.7402 KOps/s 545.5487 KOps/s $\color{#35bf28}+2.60\%$
test_tc_first_layer_tensor_only 2.1875μs 0.3962μs 2.5243 MOps/s 2.4374 MOps/s $\color{#35bf28}+3.56\%$
test_tc_first_layer_tensor_set 33.9900μs 3.9310μs 254.3910 KOps/s 252.7652 KOps/s $\color{#35bf28}+0.64\%$
test_tc_first_layer_tensor_only_set 27.1010μs 3.2525μs 307.4533 KOps/s 305.4925 KOps/s $\color{#35bf28}+0.64\%$
test_tc_first_layer_nontensor 32.3400μs 6.0446μs 165.4356 KOps/s 162.1261 KOps/s $\color{#35bf28}+2.04\%$
test_tc_second_layer_tensor 31.4500μs 4.3077μs 232.1420 KOps/s 225.7635 KOps/s $\color{#35bf28}+2.83\%$
test_tc_second_layer_nontensor 43.7410μs 8.3641μs 119.5590 KOps/s 115.6870 KOps/s $\color{#35bf28}+3.35\%$
test_unbind 0.2756s 13.6881ms 73.0561 Ops/s 66.7238 Ops/s $\textbf{\color{#35bf28}+9.49\%}$
test_full_like 4.4876ms 3.9617ms 252.4171 Ops/s 228.9630 Ops/s $\textbf{\color{#35bf28}+10.24\%}$
test_zeros_like 4.4901ms 4.3594ms 229.3874 Ops/s 229.4329 Ops/s $\color{#d91a1a}-0.02\%$
test_ones_like 4.7129ms 4.3657ms 229.0569 Ops/s 229.1403 Ops/s $\color{#d91a1a}-0.04\%$
test_clone 6.6284ms 6.4184ms 155.8010 Ops/s 156.9434 Ops/s $\color{#d91a1a}-0.73\%$
test_squeeze 73.9110μs 14.3738μs 69.5713 KOps/s 68.6443 KOps/s $\color{#35bf28}+1.35\%$
test_unsqueeze 0.1704ms 0.1167ms 8.5693 KOps/s 9.0622 KOps/s $\textbf{\color{#d91a1a}-5.44\%}$
test_split 0.4007ms 0.1882ms 5.3146 KOps/s 5.4905 KOps/s $\color{#d91a1a}-3.20\%$
test_permute 0.2492ms 0.1970ms 5.0759 KOps/s 5.1736 KOps/s $\color{#d91a1a}-1.89\%$
test_stack 26.8115ms 26.1933ms 38.1778 Ops/s 55.8084 Ops/s $\textbf{\color{#d91a1a}-31.59\%}$
test_cat 26.7924ms 26.4895ms 37.7509 Ops/s 56.0736 Ops/s $\textbf{\color{#d91a1a}-32.68\%}$
test_sequential_tensordict 0.8974ms 0.5749ms 1.7395 KOps/s 1.7440 KOps/s $\color{#d91a1a}-0.26\%$
test_sequential_graph_module 0.1700ms 0.1197ms 8.3576 KOps/s 8.1534 KOps/s $\color{#35bf28}+2.50\%$
test_nested_tensordict 1.1803ms 0.8160ms 1.2255 KOps/s 1.2275 KOps/s $\color{#d91a1a}-0.16\%$
test_nested_graph_module 0.1872ms 0.1294ms 7.7273 KOps/s 7.7414 KOps/s $\color{#d91a1a}-0.18\%$

@vmoens
vmoens merged commit 8f62cd5 into main Jun 28, 2026
72 of 73 checks passed
@vmoens
vmoens deleted the codex/unbatched-tensor-conversions branch June 28, 2026 22:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. documentation Improvements or additions to documentation Feature New feature Test

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant