[Feature] Add tensordict.llm with History moved from torchrl - #1724
Open
vmoens wants to merge 2 commits into
Open
[Feature] Add tensordict.llm with History moved from torchrl#1724vmoens wants to merge 2 commits into
vmoens wants to merge 2 commits into
Conversation
Move History, ContentBase, add_chat_template and the base chat templates from torchrl (torchrl/data/llm/history.py at 13c7eca6) into a new tensordict.llm module, making tensordict the canonical home. History is tensordict-native: consumers that only need conversation parsing/formatting can now depend on released tensordict wheels instead of torchrl. torchrl will re-export from here for backward compatibility. Changes relative to the torchrl source: - torchrl._utils.logger replaced with tensordict.utils.logger. - History.default_spec keeps returning a torchrl Composite spec; the torchrl import is gated behind importlib.util.find_spec with an informative ImportError when torchrl is not installed. - Local json/re/lazy_stack imports hoisted to module top. - Docstrings re-pointed at tensordict.llm import paths. - tensordict.llm resolves lazily from the top-level package (PEP 562) so `import tensordict` stays light. Tests are ported from torchrl test/llm/test_data.py with skipif guards for transformers/torchrl/pillow so the suite degrades gracefully in minimal environments. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Contributor
|
| Name | Max | Mean | Ops | Ops on Repo HEAD
|
Change |
|---|---|---|---|---|---|
| test_collector_preallocated_write[stack_out-cpu-32-2] | 0.2002ms | 0.1734ms | 5.7667 KOps/s | 5.8902 KOps/s | |
| test_collector_preallocated_write[stack_out-cpu-32-8] | 0.4034ms | 0.2969ms | 3.3682 KOps/s | 3.3599 KOps/s | |
| test_collector_preallocated_write[stack_out-cpu-32-32] | 0.8770ms | 0.7779ms | 1.2854 KOps/s | 1.2725 KOps/s | |
| test_collector_preallocated_write[stack_out-cpu-4096-2] | 0.3998ms | 0.3401ms | 2.9404 KOps/s | 2.9486 KOps/s | |
| test_collector_preallocated_write[stack_out-cpu-4096-8] | 1.4097ms | 1.1834ms | 845.0211 Ops/s | 899.6131 Ops/s | |
| test_collector_preallocated_write[stack_out-cpu-4096-32] | 7.4147ms | 7.2851ms | 137.2666 Ops/s | 135.2286 Ops/s | |
| test_collector_preallocated_write[stack_out-cuda-32-2] | 0.2831ms | 0.2521ms | 3.9666 KOps/s | 3.9230 KOps/s | |
| test_collector_preallocated_write[stack_out-cuda-32-8] | 0.5134ms | 0.3751ms | 2.6661 KOps/s | 2.7008 KOps/s | |
| test_collector_preallocated_write[stack_out-cuda-32-32] | 0.9850ms | 0.8276ms | 1.2083 KOps/s | 1.2129 KOps/s | |
| test_collector_preallocated_write[stack_out-cuda-4096-2] | 0.3298ms | 0.2529ms | 3.9546 KOps/s | 3.9760 KOps/s | |
| test_collector_preallocated_write[stack_out-cuda-4096-8] | 0.4447ms | 0.3763ms | 2.6574 KOps/s | 2.6791 KOps/s | |
| test_collector_preallocated_write[stack_out-cuda-4096-32] | 1.0236ms | 0.8871ms | 1.1273 KOps/s | 1.1271 KOps/s | |
| test_collector_preallocated_write[set_at_loop-cpu-32-2] | 0.3077ms | 0.2163ms | 4.6221 KOps/s | 4.6925 KOps/s | |
| test_collector_preallocated_write[set_at_loop-cpu-32-8] | 1.2610ms | 0.8435ms | 1.1855 KOps/s | 1.2011 KOps/s | |
| test_collector_preallocated_write[set_at_loop-cpu-32-32] | 3.7963ms | 3.3933ms | 294.6993 Ops/s | 304.4380 Ops/s | |
| test_collector_preallocated_write[set_at_loop-cpu-4096-2] | 0.5773ms | 0.3756ms | 2.6624 KOps/s | 2.6695 KOps/s | |
| test_collector_preallocated_write[set_at_loop-cpu-4096-8] | 2.3284ms | 1.8249ms | 547.9781 Ops/s | 593.3145 Ops/s | |
| test_collector_preallocated_write[set_at_loop-cpu-4096-32] | 10.7401ms | 10.3796ms | 96.3427 Ops/s | 96.0007 Ops/s | |
| test_collector_preallocated_write[set_at_loop-cuda-32-2] | 0.4509ms | 0.4019ms | 2.4883 KOps/s | 2.5562 KOps/s | |
| test_collector_preallocated_write[set_at_loop-cuda-32-8] | 1.9481ms | 1.5273ms | 654.7453 Ops/s | 651.8655 Ops/s | |
| test_collector_preallocated_write[set_at_loop-cuda-32-32] | 6.6670ms | 6.1835ms | 161.7200 Ops/s | 168.0353 Ops/s | |
| test_collector_preallocated_write[set_at_loop-cuda-4096-2] | 0.8436ms | 0.4216ms | 2.3722 KOps/s | 2.4313 KOps/s | |
| test_collector_preallocated_write[set_at_loop-cuda-4096-8] | 2.0502ms | 1.5870ms | 630.1132 Ops/s | 648.5770 Ops/s | |
| test_collector_preallocated_write[set_at_loop-cuda-4096-32] | 6.6951ms | 6.2418ms | 160.2107 Ops/s | 167.8174 Ops/s | |
| test_collector_preallocated_write[copy_at-cpu-32-2] | 0.6135ms | 0.1771ms | 5.6479 KOps/s | 5.6722 KOps/s | |
| test_collector_preallocated_write[copy_at-cpu-32-8] | 1.1217ms | 0.6905ms | 1.4483 KOps/s | 1.4732 KOps/s | |
| test_collector_preallocated_write[copy_at-cpu-32-32] | 3.1486ms | 2.7543ms | 363.0723 Ops/s | 373.2877 Ops/s | |
| test_collector_preallocated_write[copy_at-cpu-4096-2] | 0.3804ms | 0.3215ms | 3.1108 KOps/s | 3.0846 KOps/s | |
| test_collector_preallocated_write[copy_at-cpu-4096-8] | 1.9848ms | 1.5377ms | 650.3326 Ops/s | 689.6556 Ops/s | |
| test_collector_preallocated_write[copy_at-cpu-4096-32] | 9.8458ms | 9.6562ms | 103.5608 Ops/s | 105.2751 Ops/s | |
| test_collector_preallocated_write[copy_at-cuda-32-2] | 0.7910ms | 0.3311ms | 3.0199 KOps/s | 3.0829 KOps/s | |
| test_collector_preallocated_write[copy_at-cuda-32-8] | 1.6673ms | 1.2263ms | 815.4453 Ops/s | 825.5779 Ops/s | |
| test_collector_preallocated_write[copy_at-cuda-32-32] | 5.3502ms | 4.8458ms | 206.3656 Ops/s | 210.4912 Ops/s | |
| test_collector_preallocated_write[copy_at-cuda-4096-2] | 0.7710ms | 0.3312ms | 3.0196 KOps/s | 3.0589 KOps/s | |
| test_collector_preallocated_write[copy_at-cuda-4096-8] | 1.6809ms | 1.2305ms | 812.6968 Ops/s | 821.7485 Ops/s | |
| test_collector_preallocated_write[copy_at-cuda-4096-32] | 4.9431ms | 4.8301ms | 207.0351 Ops/s | 209.6415 Ops/s | |
| test_collector_preallocated_write[manual_leaf_copy-cpu-32-2] | 0.5547ms | 0.1268ms | 7.8855 KOps/s | 8.3800 KOps/s | |
| test_collector_preallocated_write[manual_leaf_copy-cpu-32-8] | 0.9653ms | 0.4953ms | 2.0188 KOps/s | 2.1411 KOps/s | |
| test_collector_preallocated_write[manual_leaf_copy-cpu-32-32] | 2.3855ms | 1.9624ms | 509.5716 Ops/s | 537.9210 Ops/s | |
| test_collector_preallocated_write[manual_leaf_copy-cpu-4096-2] | 0.3250ms | 0.2668ms | 3.7485 KOps/s | 4.0035 KOps/s | |
| test_collector_preallocated_write[manual_leaf_copy-cpu-4096-8] | 1.8267ms | 1.3074ms | 764.8886 Ops/s | 841.2998 Ops/s | |
| test_collector_preallocated_write[manual_leaf_copy-cpu-4096-32] | 9.0138ms | 8.6212ms | 115.9935 Ops/s | 118.5686 Ops/s | |
| test_collector_preallocated_write[manual_leaf_copy-cuda-32-2] | 0.7879ms | 0.3063ms | 3.2651 KOps/s | 3.6339 KOps/s | |
| test_collector_preallocated_write[manual_leaf_copy-cuda-32-8] | 1.2669ms | 1.1394ms | 877.6664 Ops/s | 977.5989 Ops/s | |
| test_collector_preallocated_write[manual_leaf_copy-cuda-32-32] | 4.5382ms | 4.4112ms | 226.6943 Ops/s | 249.0277 Ops/s | |
| test_collector_preallocated_write[manual_leaf_copy-cuda-4096-2] | 0.7493ms | 0.3037ms | 3.2928 KOps/s | 3.6391 KOps/s | |
| test_collector_preallocated_write[manual_leaf_copy-cuda-4096-8] | 1.5673ms | 1.1321ms | 883.3358 Ops/s | 969.7746 Ops/s | |
| test_collector_preallocated_write[manual_leaf_copy-cuda-4096-32] | 4.8842ms | 4.4141ms | 226.5466 Ops/s | 248.0320 Ops/s | |
| test_wide_nested_preallocated_write[stack_out-cpu-128-128] | 16.7403ms | 16.3213ms | 61.2698 Ops/s | 61.1260 Ops/s | |
| test_wide_nested_preallocated_write[stack_out-cpu-128-256] | 33.3154ms | 32.8234ms | 30.4660 Ops/s | 30.2198 Ops/s | |
| test_wide_nested_preallocated_write[stack_out-cpu-4096-128] | 85.4229ms | 83.9382ms | 11.9135 Ops/s | 12.0665 Ops/s | |
| test_wide_nested_preallocated_write[stack_out-cpu-4096-256] | 0.2014s | 0.2007s | 4.9815 Ops/s | 5.0767 Ops/s | |
| test_wide_nested_preallocated_write[stack_out-cuda-128-128] | 14.4050ms | 13.8690ms | 72.1032 Ops/s | 71.8459 Ops/s | |
| test_wide_nested_preallocated_write[stack_out-cuda-128-256] | 28.0363ms | 27.3351ms | 36.5830 Ops/s | 36.4795 Ops/s | |
| test_wide_nested_preallocated_write[stack_out-cuda-4096-128] | 14.4343ms | 14.0532ms | 71.1584 Ops/s | 70.6315 Ops/s | |
| test_wide_nested_preallocated_write[stack_out-cuda-4096-256] | 28.0172ms | 27.5207ms | 36.3362 Ops/s | 35.9682 Ops/s | |
| test_wide_nested_preallocated_write[set_at_loop-cpu-128-128] | 53.6972ms | 53.1832ms | 18.8029 Ops/s | 19.2016 Ops/s | |
| test_wide_nested_preallocated_write[set_at_loop-cpu-128-256] | 0.1076s | 0.1070s | 9.3432 Ops/s | 9.5049 Ops/s | |
| test_wide_nested_preallocated_write[set_at_loop-cpu-4096-128] | 0.1478s | 0.1466s | 6.8204 Ops/s | 6.9487 Ops/s | |
| test_wide_nested_preallocated_write[set_at_loop-cpu-4096-256] | 0.3284s | 0.3262s | 3.0654 Ops/s | 3.1791 Ops/s | |
| test_wide_nested_preallocated_write[set_at_loop-cuda-128-128] | 76.5545ms | 75.5737ms | 13.2321 Ops/s | 13.5021 Ops/s | |
| test_wide_nested_preallocated_write[set_at_loop-cuda-128-256] | 0.1520s | 0.1509s | 6.6273 Ops/s | 6.7400 Ops/s | |
| test_wide_nested_preallocated_write[set_at_loop-cuda-4096-128] | 76.6113ms | 76.1334ms | 13.1348 Ops/s | 13.3827 Ops/s | |
| test_wide_nested_preallocated_write[set_at_loop-cuda-4096-256] | 0.1539s | 0.1526s | 6.5537 Ops/s | 6.6927 Ops/s | |
| test_wide_nested_preallocated_write[copy_at-cpu-128-128] | 31.3361ms | 30.9746ms | 32.2845 Ops/s | 32.8777 Ops/s | |
| test_wide_nested_preallocated_write[copy_at-cpu-128-256] | 63.5567ms | 63.0634ms | 15.8571 Ops/s | 16.3251 Ops/s | |
| test_wide_nested_preallocated_write[copy_at-cpu-4096-128] | 0.1223s | 0.1219s | 8.2062 Ops/s | 8.5350 Ops/s | |
| test_wide_nested_preallocated_write[copy_at-cpu-4096-256] | 0.2688s | 0.2655s | 3.7667 Ops/s | 3.8411 Ops/s | |
| test_wide_nested_preallocated_write[copy_at-cuda-128-128] | 44.5715ms | 44.1372ms | 22.6566 Ops/s | 22.9991 Ops/s | |
| test_wide_nested_preallocated_write[copy_at-cuda-128-256] | 89.8739ms | 89.0550ms | 11.2290 Ops/s | 11.5401 Ops/s | |
| test_wide_nested_preallocated_write[copy_at-cuda-4096-128] | 45.3776ms | 44.7542ms | 22.3443 Ops/s | 22.9972 Ops/s | |
| test_wide_nested_preallocated_write[copy_at-cuda-4096-256] | 91.2840ms | 89.1751ms | 11.2139 Ops/s | 11.5251 Ops/s | |
| test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-128] | 22.1140ms | 21.5071ms | 46.4964 Ops/s | 49.0093 Ops/s | |
| test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-256] | 44.2875ms | 43.6837ms | 22.8918 Ops/s | 24.0334 Ops/s | |
| test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-128] | 0.1091s | 0.1078s | 9.2743 Ops/s | 9.4140 Ops/s | |
| test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-256] | 0.2418s | 0.2412s | 4.1468 Ops/s | 4.2066 Ops/s | |
| test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-128] | 41.1126ms | 39.1181ms | 25.5636 Ops/s | 27.3686 Ops/s | |
| test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-256] | 81.7365ms | 78.0247ms | 12.8164 Ops/s | 13.6399 Ops/s | |
| test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-128] | 41.2963ms | 40.0198ms | 24.9876 Ops/s | 27.3083 Ops/s | |
| test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-256] | 82.2491ms | 80.0419ms | 12.4935 Ops/s | 13.5665 Ops/s | |
| test_plain_set_nested | 36.2310μs | 15.4884μs | 64.5646 KOps/s | 64.1847 KOps/s | |
| test_plain_set_stack_nested | 34.3410μs | 15.3665μs | 65.0768 KOps/s | 65.5820 KOps/s | |
| test_plain_set_nested_inplace | 0.4338ms | 16.9484μs | 59.0025 KOps/s | 59.1215 KOps/s | |
| test_plain_set_stack_nested_inplace | 0.4491ms | 16.5486μs | 60.4281 KOps/s | 59.7808 KOps/s | |
| test_items | 40.7010μs | 6.0227μs | 166.0378 KOps/s | 165.6321 KOps/s | |
| test_items_nested | 0.9016ms | 0.4706ms | 2.1252 KOps/s | 2.1502 KOps/s | |
| test_items_nested_locked | 0.9038ms | 0.4750ms | 2.1053 KOps/s | 2.1257 KOps/s | |
| test_items_nested_leaf | 0.5130ms | 97.8268μs | 10.2221 KOps/s | 10.2170 KOps/s | |
| test_items_stack_nested | 0.9058ms | 0.4713ms | 2.1216 KOps/s | 2.1494 KOps/s | |
| test_items_stack_nested_leaf | 0.5388ms | 96.5646μs | 10.3558 KOps/s | 10.2405 KOps/s | |
| test_items_stack_nested_locked | 0.8981ms | 0.4712ms | 2.1223 KOps/s | 2.1162 KOps/s | |
| test_keys | 25.4110μs | 4.1794μs | 239.2702 KOps/s | 234.1660 KOps/s | |
| test_keys_nested | 0.5672ms | 0.1309ms | 7.6395 KOps/s | 7.7139 KOps/s | |
| test_keys_nested_locked | 1.9454ms | 0.1393ms | 7.1809 KOps/s | 7.3023 KOps/s | |
| test_keys_nested_leaf | 0.5434ms | 0.1214ms | 8.2382 KOps/s | 8.3526 KOps/s | |
| test_keys_stack_nested | 0.5807ms | 0.1305ms | 7.6615 KOps/s | 7.6904 KOps/s | |
| test_keys_stack_nested_leaf | 0.5489ms | 0.1212ms | 8.2497 KOps/s | 8.3946 KOps/s | |
| test_keys_stack_nested_locked | 0.5943ms | 0.1380ms | 7.2477 KOps/s | 7.2759 KOps/s | |
| test_values | 85.2102μs | 1.0210μs | 979.4198 KOps/s | 856.8078 KOps/s | |
| test_values_nested | 0.4895ms | 53.3678μs | 18.7379 KOps/s | 18.9538 KOps/s | |
| test_values_nested_locked | 0.4839ms | 56.7273μs | 17.6282 KOps/s | 17.5206 KOps/s | |
| test_values_nested_leaf | 91.9130μs | 60.5451μs | 16.5166 KOps/s | 16.5350 KOps/s | |
| test_values_stack_nested | 0.4857ms | 53.0792μs | 18.8398 KOps/s | 18.8835 KOps/s | |
| test_values_stack_nested_leaf | 0.4889ms | 60.1771μs | 16.6176 KOps/s | 16.6112 KOps/s | |
| test_values_stack_nested_locked | 0.5153ms | 56.4780μs | 17.7060 KOps/s | 17.8545 KOps/s | |
| test_membership | 72.1917μs | 0.8377μs | 1.1938 MOps/s | 1.1850 MOps/s | |
| test_membership_nested | 0.4325ms | 3.0138μs | 331.8021 KOps/s | 330.7099 KOps/s | |
| test_membership_nested_leaf | 30.3700μs | 2.9859μs | 334.9081 KOps/s | 327.4078 KOps/s | |
| test_membership_stacked_nested | 0.4481ms | 2.8817μs | 347.0181 KOps/s | 340.6329 KOps/s | |
| test_membership_stacked_nested_leaf | 18.4310μs | 2.8743μs | 347.9128 KOps/s | 342.2491 KOps/s | |
| test_membership_nested_last | 0.4388ms | 4.4678μs | 223.8225 KOps/s | 221.3611 KOps/s | |
| test_membership_nested_leaf_last | 26.1110μs | 4.4898μs | 222.7246 KOps/s | 222.1844 KOps/s | |
| test_membership_stacked_nested_last | 0.4563ms | 4.3894μs | 227.8198 KOps/s | 229.9493 KOps/s | |
| test_membership_stacked_nested_leaf_last | 22.5910μs | 4.3474μs | 230.0237 KOps/s | 226.8050 KOps/s | |
| test_nested_getleaf | 0.4501ms | 21.6210μs | 46.2513 KOps/s | 45.8761 KOps/s | |
| test_nested_get | 0.4412ms | 20.1512μs | 49.6248 KOps/s | 49.1785 KOps/s | |
| test_stacked_getleaf | 50.3410μs | 21.3607μs | 46.8148 KOps/s | 46.3377 KOps/s | |
| test_stacked_get | 0.4431ms | 20.1537μs | 49.6186 KOps/s | 49.2996 KOps/s | |
| test_nested_getitemleaf | 0.4418ms | 22.0173μs | 45.4188 KOps/s | 45.2979 KOps/s | |
| test_nested_getitem | 0.4450ms | 20.6281μs | 48.4777 KOps/s | 47.7566 KOps/s | |
| test_stacked_getitemleaf | 0.4429ms | 21.6717μs | 46.1432 KOps/s | 44.8230 KOps/s | |
| test_stacked_getitem | 49.0610μs | 20.5744μs | 48.6042 KOps/s | 47.1857 KOps/s | |
| test_lock_nested | 0.9346ms | 0.5056ms | 1.9778 KOps/s | 1.9737 KOps/s | |
| test_lock_stack_nested | 0.9477ms | 0.5139ms | 1.9457 KOps/s | 1.9713 KOps/s | |
| test_unlock_nested | 0.8364ms | 0.4013ms | 2.4917 KOps/s | 2.4973 KOps/s | |
| test_unlock_stack_nested | 0.8185ms | 0.4082ms | 2.4496 KOps/s | 2.4862 KOps/s | |
| test_flatten_speed | 0.1797ms | 0.1230ms | 8.1270 KOps/s | 8.2053 KOps/s | |
| test_unflatten_speed | 0.7093ms | 0.5702ms | 1.7539 KOps/s | 1.7391 KOps/s | |
| test_common_ops | 0.1014s | 1.9844ms | 503.9279 Ops/s | 305.9327 Ops/s | |
| test_creation | 70.1320μs | 3.2170μs | 310.8524 KOps/s | 316.7754 KOps/s | |
| test_creation_empty | 48.7710μs | 7.0531μs | 141.7826 KOps/s | 140.6612 KOps/s | |
| test_creation_nested_1 | 38.1810μs | 11.4797μs | 87.1104 KOps/s | 85.5545 KOps/s | |
| test_creation_nested_2 | 37.9210μs | 13.6272μs | 73.3828 KOps/s | 72.6668 KOps/s | |
| test_creation_many_keys[10] | 73.7920μs | 21.1004μs | 47.3924 KOps/s | 47.2593 KOps/s | |
| test_creation_many_keys[50] | 0.1371ms | 90.2817μs | 11.0764 KOps/s | 10.9391 KOps/s | |
| test_creation_many_keys[100] | 0.2311ms | 0.1785ms | 5.6016 KOps/s | 5.5998 KOps/s | |
| test_creation_nested_many_keys[10] | 0.1228ms | 46.0787μs | 21.7020 KOps/s | 22.1218 KOps/s | |
| test_creation_nested_many_keys[50] | 0.2470ms | 0.1858ms | 5.3831 KOps/s | 5.3972 KOps/s | |
| test_clone | 32.2710μs | 13.7655μs | 72.6455 KOps/s | 74.5837 KOps/s | |
| test_getitem[int] | 1.4671ms | 15.6486μs | 63.9035 KOps/s | 66.1499 KOps/s | |
| test_getitem[slice_int] | 0.1374ms | 24.7893μs | 40.3399 KOps/s | 40.9522 KOps/s | |
| test_getitem[range] | 0.1959ms | 64.3932μs | 15.5296 KOps/s | 15.5607 KOps/s | |
| test_getitem[tuple] | 0.1641ms | 24.8638μs | 40.2191 KOps/s | 41.2004 KOps/s | |
| test_getitem[list] | 0.1865ms | 59.2296μs | 16.8834 KOps/s | 16.9495 KOps/s | |
| test_setitem_dim[int] | 48.2320μs | 26.3646μs | 37.9297 KOps/s | 39.9248 KOps/s | |
| test_setitem_dim[slice_int] | 72.7620μs | 42.4395μs | 23.5629 KOps/s | 24.0623 KOps/s | |
| test_setitem_dim[range] | 0.1385ms | 95.2355μs | 10.5003 KOps/s | 10.5874 KOps/s | |
| test_setitem_dim[tuple] | 61.0710μs | 39.3504μs | 25.4127 KOps/s | 26.0255 KOps/s | |
| test_setitem | 65.1520μs | 17.7711μs | 56.2710 KOps/s | 56.9287 KOps/s | |
| test_set | 41.6310μs | 17.1608μs | 58.2724 KOps/s | 59.3968 KOps/s | |
| test_set_shared | 0.6191ms | 0.2121ms | 4.7144 KOps/s | 4.5443 KOps/s | |
| test_update | 0.3273ms | 22.4161μs | 44.6107 KOps/s | 45.8385 KOps/s | |
| test_update_nested | 84.0220μs | 34.1421μs | 29.2894 KOps/s | 29.9356 KOps/s | |
| test_update__nested | 0.4504ms | 33.6013μs | 29.7607 KOps/s | 30.5835 KOps/s | |
| test_set_nested | 46.3020μs | 18.8968μs | 52.9191 KOps/s | 52.1722 KOps/s | |
| test_set_nested_new | 60.7820μs | 23.5774μs | 42.4134 KOps/s | 41.8691 KOps/s | |
| test_select | 79.8920μs | 40.4043μs | 24.7498 KOps/s | 24.8049 KOps/s | |
| test_select_nested | 0.1124ms | 74.9684μs | 13.3389 KOps/s | 13.4324 KOps/s | |
| test_exclude_nested | 0.1425ms | 93.0052μs | 10.7521 KOps/s | 10.8764 KOps/s | |
| test_empty[True] | 0.4824ms | 0.4036ms | 2.4777 KOps/s | 2.5314 KOps/s | |
| test_empty[False] | 18.7330μs | 1.3979μs | 715.3727 KOps/s | 720.7425 KOps/s | |
| test_to | 0.1217ms | 69.8419μs | 14.3181 KOps/s | 13.6978 KOps/s | |
| test_to_nonblocking | 0.1080ms | 69.9039μs | 14.3054 KOps/s | 14.0342 KOps/s | |
| test_unbind_speed | 0.3940ms | 0.3472ms | 2.8800 KOps/s | 2.9130 KOps/s | |
| test_unbind_speed_stack0 | 0.3948ms | 0.3386ms | 2.9537 KOps/s | 3.0375 KOps/s | |
| test_unbind_speed_stack1 | 0.1136s | 0.8619ms | 1.1602 KOps/s | 1.1584 KOps/s | |
| test_split | 0.1131s | 1.2983ms | 770.2612 Ops/s | 725.0292 Ops/s | |
| test_chunk | 1.1456ms | 1.0949ms | 913.3291 Ops/s | 914.2392 Ops/s | |
| test_to_cpu_blocking | 20.2552ms | 20.0102ms | 49.9744 Ops/s | 50.1844 Ops/s | |
| test_to_cpu_global_sync | 0.1259s | 13.1486ms | 76.0539 Ops/s | 85.7569 Ops/s | |
| test_to_cpu_event_sync | 13.1402ms | 12.8687ms | 77.7080 Ops/s | 70.4616 Ops/s | |
| test_to_cpu_default | 13.2807ms | 12.9659ms | 77.1256 Ops/s | 79.1160 Ops/s | |
| test_consolidate[False-None] | 4.3863ms | 4.2349ms | 236.1311 Ops/s | 240.0714 Ops/s | |
| test_consolidate[default-None] | 3.5680ms | 2.2138ms | 451.7127 Ops/s | 460.1826 Ops/s | |
| test_consolidate[reduce-overhead-None] | 3.5288ms | 2.1280ms | 469.9192 Ops/s | 465.2341 Ops/s | |
| test_consolidate_njt[False-None] | 8.9634ms | 8.6959ms | 114.9965 Ops/s | 114.0171 Ops/s | |
| test_to[False-False-None] | 2.2645ms | 2.1815ms | 458.3927 Ops/s | 458.2404 Ops/s | |
| test_to[True-False-None] | 2.2261ms | 1.9342ms | 517.0204 Ops/s | 526.2731 Ops/s | |
| test_to[within-False-None] | 6.6456ms | 6.2988ms | 158.7599 Ops/s | 159.8623 Ops/s | |
| test_to[True-default-None] | 10.9660ms | 10.7674ms | 92.8727 Ops/s | 93.4349 Ops/s | |
| test_to_njt[False-False-None] | 9.3293ms | 8.6884ms | 115.0954 Ops/s | 112.7407 Ops/s | |
| test_to_njt[True-False-None] | 7.1297ms | 6.9721ms | 143.4297 Ops/s | 140.9157 Ops/s | |
| test_to_njt[within-False-None] | 16.3458ms | 15.7319ms | 63.5653 Ops/s | 62.1853 Ops/s | |
| test_creation[device0] | 0.4688ms | 0.1185ms | 8.4379 KOps/s | 9.0636 KOps/s | |
| test_creation_from_tensor | 0.4688ms | 0.1160ms | 8.6200 KOps/s | 9.4499 KOps/s | |
| test_add_one[memmap_tensor0] | 0.3147ms | 6.9205μs | 144.4978 KOps/s | 143.2002 KOps/s | |
| test_contiguous[memmap_tensor0] | 27.0200μs | 0.6616μs | 1.5116 MOps/s | 2.2006 MOps/s | |
| test_stack[memmap_tensor0] | 38.8710μs | 4.4517μs | 224.6338 KOps/s | 237.2962 KOps/s | |
| test_memmaptd_index | 1.2805ms | 0.2937ms | 3.4051 KOps/s | 3.6027 KOps/s | |
| test_memmaptd_index_astensor | 0.5417ms | 0.4026ms | 2.4836 KOps/s | 2.5697 KOps/s | |
| test_memmaptd_index_op | 0.9443ms | 0.6692ms | 1.4943 KOps/s | 1.5172 KOps/s | |
| test_serialize_model | 0.1368s | 0.1342s | 7.4517 Ops/s | 7.3719 Ops/s | |
| test_serialize_model_pickle | 1.3489s | 1.2101s | 0.8264 Ops/s | 0.8260 Ops/s | |
| test_serialize_weights | 0.1348s | 0.1331s | 7.5147 Ops/s | 3.3781 Ops/s | |
| test_serialize_weights_returnearly | 0.2949s | 79.0821ms | 12.6451 Ops/s | 15.3399 Ops/s | |
| test_serialize_weights_pickle | 1.3635s | 1.2150s | 0.8231 Ops/s | 0.8260 Ops/s | |
| test_reshape_pytree | 0.2067ms | 33.0686μs | 30.2401 KOps/s | 30.3856 KOps/s | |
| test_reshape_td | 79.4220μs | 46.7950μs | 21.3698 KOps/s | 22.6950 KOps/s | |
| test_view_pytree | 0.2271ms | 32.7652μs | 30.5201 KOps/s | 30.8881 KOps/s | |
| test_view_td | 93.0320μs | 56.0480μs | 17.8418 KOps/s | 18.7427 KOps/s | |
| test_unbind_pytree | 0.2305ms | 37.5831μs | 26.6077 KOps/s | 26.6723 KOps/s | |
| test_unbind_td | 0.1883ms | 51.7568μs | 19.3211 KOps/s | 19.7307 KOps/s | |
| test_split_pytree | 0.2128ms | 43.6054μs | 22.9329 KOps/s | 23.1265 KOps/s | |
| test_split_td | 0.1875ms | 66.6175μs | 15.0111 KOps/s | 15.4088 KOps/s | |
| test_add_pytree | 0.1924ms | 42.6154μs | 23.4657 KOps/s | 23.1453 KOps/s | |
| test_add_td | 0.2080ms | 54.9065μs | 18.2128 KOps/s | 17.3389 KOps/s | |
| test_compile_add_one_nested[tensordict-compile] | 0.3549ms | 0.2350ms | 4.2559 KOps/s | 4.2788 KOps/s | |
| test_compile_add_one_nested[tensordict-eager] | 0.6435ms | 0.2032ms | 4.9206 KOps/s | 4.0187 KOps/s | |
| test_compile_add_one_nested[pytree-compile] | 0.3526ms | 0.1353ms | 7.3911 KOps/s | 7.3082 KOps/s | |
| test_compile_add_one_nested[pytree-eager] | 0.6257ms | 0.1805ms | 5.5388 KOps/s | 5.6405 KOps/s | |
| test_compile_copy_nested[tensordict-compile] | 0.4609ms | 15.6326μs | 63.9689 KOps/s | 65.3691 KOps/s | |
| test_compile_copy_nested[tensordict-eager] | 0.3073ms | 53.4170μs | 18.7206 KOps/s | 18.4856 KOps/s | |
| test_compile_copy_nested[pytree-compile] | 0.1513ms | 15.7247μs | 63.5943 KOps/s | 63.4052 KOps/s | |
| test_compile_copy_nested[pytree-eager] | 0.3788ms | 67.4219μs | 14.8320 KOps/s | 14.5212 KOps/s | |
| test_compile_add_one_flat[tensordict-compile] | 0.2921ms | 0.2460ms | 4.0644 KOps/s | 3.7673 KOps/s | |
| test_compile_add_one_flat[tensordict-eager] | 0.3440ms | 0.2808ms | 3.5611 KOps/s | 3.5243 KOps/s | |
| test_compile_add_one_flat[tensorclass-compile] | 0.3140ms | 0.1833ms | 5.4561 KOps/s | 5.0710 KOps/s | |
| test_compile_add_one_flat[tensorclass-eager] | 0.1148ms | 75.5673μs | 13.2332 KOps/s | 13.4854 KOps/s | |
| test_compile_add_one_flat[pytree-compile] | 0.2983ms | 0.1932ms | 5.1766 KOps/s | 5.0540 KOps/s | |
| test_compile_add_one_flat[pytree-eager] | 0.8055ms | 0.5332ms | 1.8753 KOps/s | 1.9280 KOps/s | |
| test_compile_add_self_flat[tensordict-eager] | 0.3718ms | 0.3305ms | 3.0260 KOps/s | 3.0032 KOps/s | |
| test_compile_add_self_flat[tensordict-compile] | 0.4191ms | 0.2493ms | 4.0115 KOps/s | 3.7562 KOps/s | |
| test_compile_add_self_flat[tensorclass-eager] | 0.1799ms | 91.8525μs | 10.8870 KOps/s | 11.0721 KOps/s | |
| test_compile_add_self_flat[tensorclass-compile] | 0.2487ms | 0.1861ms | 5.3735 KOps/s | 5.0767 KOps/s | |
| test_compile_add_self_flat[pytree-eager] | 0.6642ms | 0.4429ms | 2.2578 KOps/s | 2.3300 KOps/s | |
| test_compile_add_self_flat[pytree-compile] | 0.2934ms | 0.1916ms | 5.2188 KOps/s | 4.9829 KOps/s | |
| test_compile_copy_flat[tensordict-compile] | 59.3310μs | 19.5097μs | 51.2565 KOps/s | 50.1941 KOps/s | |
| test_compile_copy_flat[tensordict-eager] | 71.4610μs | 41.8398μs | 23.9007 KOps/s | 24.3416 KOps/s | |
| test_compile_copy_flat[pytree-compile] | 0.8966ms | 21.6898μs | 46.1046 KOps/s | 46.7958 KOps/s | |
| test_compile_copy_flat[pytree-eager] | 0.3292ms | 52.2844μs | 19.1262 KOps/s | 19.0526 KOps/s | |
| test_compile_assign_and_add[tensordict-compile] | 2.2179ms | 0.2364ms | 4.2299 KOps/s | 3.8457 KOps/s | |
| test_compile_assign_and_add[tensordict-eager] | 3.4594ms | 3.2991ms | 303.1129 Ops/s | 302.1986 Ops/s | |
| test_compile_assign_and_add[pytree-compile] | 2.1478ms | 0.1813ms | 5.5148 KOps/s | 5.3655 KOps/s | |
| test_compile_assign_and_add[pytree-eager] | 2.9872ms | 2.8158ms | 355.1427 Ops/s | 357.8413 Ops/s | |
| test_compile_indexing[tensor-tensordict-compile] | 0.2643ms | 0.1339ms | 7.4688 KOps/s | 7.2029 KOps/s | |
| test_compile_indexing[tensor-tensordict-eager] | 0.3125ms | 76.5054μs | 13.0710 KOps/s | 12.7943 KOps/s | |
| test_compile_indexing[tensor-tensorclass-compile] | 0.2619ms | 0.1189ms | 8.4080 KOps/s | 8.3342 KOps/s | |
| test_compile_indexing[tensor-tensorclass-eager] | 0.2529ms | 45.2267μs | 22.1108 KOps/s | 20.7238 KOps/s | |
| test_compile_indexing[tensor-pytree-compile] | 0.2855ms | 0.1249ms | 8.0044 KOps/s | 7.8990 KOps/s | |
| test_compile_indexing[tensor-pytree-eager] | 0.2536ms | 47.7026μs | 20.9632 KOps/s | 21.1799 KOps/s | |
| test_compile_indexing[slice-tensordict-compile] | 0.2141ms | 85.7789μs | 11.6579 KOps/s | 11.9208 KOps/s | |
| test_compile_indexing[slice-tensordict-eager] | 0.2078ms | 34.8961μs | 28.6565 KOps/s | 36.0672 KOps/s | |
| test_compile_indexing[slice-tensorclass-compile] | 0.1542ms | 71.5541μs | 13.9754 KOps/s | 14.1358 KOps/s | |
| test_compile_indexing[slice-tensorclass-eager] | 0.2375ms | 22.3037μs | 44.8356 KOps/s | 44.7587 KOps/s | |
| test_compile_indexing[slice-pytree-compile] | 0.1242ms | 71.5505μs | 13.9761 KOps/s | 14.0093 KOps/s | |
| test_compile_indexing[slice-pytree-eager] | 0.2372ms | 22.3190μs | 44.8050 KOps/s | 44.9992 KOps/s | |
| test_compile_indexing[int-tensordict-compile] | 0.1307ms | 86.7333μs | 11.5296 KOps/s | 11.8908 KOps/s | |
| test_compile_indexing[int-tensordict-eager] | 0.2097ms | 27.8079μs | 35.9610 KOps/s | 35.0286 KOps/s | |
| test_compile_indexing[int-tensorclass-compile] | 0.1246ms | 73.1142μs | 13.6772 KOps/s | 14.0031 KOps/s | |
| test_compile_indexing[int-tensorclass-eager] | 0.2382ms | 22.1507μs | 45.1452 KOps/s | 44.9955 KOps/s | |
| test_compile_indexing[int-pytree-compile] | 0.1185ms | 72.7503μs | 13.7456 KOps/s | 14.1609 KOps/s | |
| test_compile_indexing[int-pytree-eager] | 0.2762ms | 22.1087μs | 45.2312 KOps/s | 44.9635 KOps/s | |
| test_compile_replace[single-eager] | 89.7120μs | 48.1565μs | 20.7656 KOps/s | 21.0218 KOps/s | |
| test_compile_replace[single-compile] | 0.3096ms | 0.1353ms | 7.3898 KOps/s | 7.4850 KOps/s | |
| test_compile_replace[multi-eager] | 0.8338ms | 0.5868ms | 1.7041 KOps/s | 1.7761 KOps/s | |
| test_compile_replace[multi-compile] | 0.2962ms | 0.1386ms | 7.2175 KOps/s | 6.9379 KOps/s | |
| test_compile_tc_getattr_20[eager] | 0.2285ms | 0.1713ms | 5.8394 KOps/s | 6.0270 KOps/s | |
| test_compile_tc_getattr_20[compile] | 0.3778ms | 0.1507ms | 6.6351 KOps/s | 6.4739 KOps/s | |
| test_compile_clone_shallow[20-eager] | 48.6210μs | 19.0861μs | 52.3942 KOps/s | 52.1593 KOps/s | |
| test_compile_clone_shallow[20-compile] | 98.9020μs | 17.4375μs | 57.3475 KOps/s | 58.1649 KOps/s | |
| test_compile_clone_shallow[40-eager] | 61.4820μs | 33.4219μs | 29.9205 KOps/s | 29.5892 KOps/s | |
| test_compile_clone_shallow[40-compile] | 74.4420μs | 18.7754μs | 53.2612 KOps/s | 52.4883 KOps/s | |
| test_compile_clone_shallow[80-eager] | 0.1099ms | 62.9743μs | 15.8795 KOps/s | 16.0014 KOps/s | |
| test_compile_clone_shallow[80-compile] | 0.1125ms | 21.5458μs | 46.4128 KOps/s | 44.7627 KOps/s | |
| test_compile_update_inplace[eager] | 0.1057ms | 59.8064μs | 16.7206 KOps/s | 16.2903 KOps/s | |
| test_compile_update_inplace[compile] | 0.2231ms | 0.1476ms | 6.7750 KOps/s | 6.6055 KOps/s | |
| test_mod_add[eager] | 0.2894ms | 0.2274ms | 4.3968 KOps/s | 4.3921 KOps/s | |
| test_mod_add[compile] | 0.1921ms | 0.1332ms | 7.5080 KOps/s | 7.3915 KOps/s | |
| test_mod_add[compile-overhead] | 0.3162ms | 0.1790ms | 5.5864 KOps/s | 5.4976 KOps/s | |
| test_mod_wrap[eager] | 0.5610ms | 0.4712ms | 2.1224 KOps/s | 2.1146 KOps/s | |
| test_mod_wrap[compile] | 0.4610ms | 0.3966ms | 2.5212 KOps/s | 2.4945 KOps/s | |
| test_mod_wrap[compile-overhead] | 8.4977ms | 4.7157ms | 212.0569 Ops/s | 213.6230 Ops/s | |
| test_mod_wrap_and_backward[eager] | 1.8424ms | 1.7006ms | 588.0404 Ops/s | 589.4770 Ops/s | |
| test_mod_wrap_and_backward[compile] | 2.3847ms | 1.5891ms | 629.2698 Ops/s | 645.9416 Ops/s | |
| test_mod_wrap_and_backward[compile-overhead] | 1.3456ms | 0.9462ms | 1.0568 KOps/s | 1.0223 KOps/s | |
| test_seq_add[eager] | 0.5702ms | 0.5152ms | 1.9408 KOps/s | 1.9725 KOps/s | |
| test_seq_add[compile] | 0.2514ms | 0.1390ms | 7.1935 KOps/s | 6.8650 KOps/s | |
| test_seq_add[compile-overhead] | 0.3276ms | 0.1833ms | 5.4562 KOps/s | 5.2851 KOps/s | |
| test_seq_wrap[eager] | 1.5272ms | 1.4204ms | 704.0359 Ops/s | 697.6449 Ops/s | |
| test_seq_wrap[compile] | 0.4994ms | 0.4108ms | 2.4340 KOps/s | 2.3107 KOps/s | |
| test_seq_wrap[compile-overhead] | 0.4028ms | 0.3053ms | 3.2753 KOps/s | 3.1725 KOps/s | |
| test_func_call_runtime[False-eager] | 1.0960ms | 0.8403ms | 1.1900 KOps/s | 1.2540 KOps/s | |
| test_func_call_runtime[False-compile] | 1.0911ms | 0.9939ms | 1.0061 KOps/s | 1.0103 KOps/s | |
| test_func_call_runtime[False-compile-overhead] | 0.6539ms | 0.5113ms | 1.9557 KOps/s | 1.9333 KOps/s | |
| test_func_call_runtime[True-eager] | 1.1515ms | 1.0620ms | 941.6279 Ops/s | 934.3149 Ops/s | |
| test_func_call_runtime[True-compile] | 1.1154ms | 1.0049ms | 995.1338 Ops/s | 1.0003 KOps/s | |
| test_func_call_runtime[True-compile-overhead] | 0.5835ms | 0.5265ms | 1.8992 KOps/s | 1.8635 KOps/s | |
| test_func_call_cm_runtime[False-eager] | 0.9771ms | 0.7964ms | 1.2556 KOps/s | 1.2488 KOps/s | |
| test_func_call_cm_runtime[False-compile] | 1.0518ms | 0.9709ms | 1.0300 KOps/s | 1.0321 KOps/s | |
| test_func_call_cm_runtime[False-compile-overhead] | 0.6202ms | 0.4918ms | 2.0333 KOps/s | 2.0056 KOps/s | |
| test_func_call_cm_runtime[True-eager] | 1.3843ms | 1.2128ms | 824.5578 Ops/s | 814.7545 Ops/s | |
| test_func_call_cm_runtime[True-compile] | 1.1233ms | 1.0319ms | 969.0575 Ops/s | 972.3973 Ops/s | |
| test_func_call_cm_runtime[True-compile-overhead] | 0.7025ms | 0.5489ms | 1.8218 KOps/s | 1.7936 KOps/s | |
| test_vmap_func_call_cm_runtime[eager] | 2.8533ms | 2.4168ms | 413.7635 Ops/s | 409.4447 Ops/s | |
| test_vmap_func_call_cm_runtime[compile] | 3.0545ms | 2.5939ms | 385.5140 Ops/s | 378.2428 Ops/s | |
| test_vmap_func_call_cm_runtime[compile-overhead] | 3.0789ms | 2.5921ms | 385.7807 Ops/s | 382.2438 Ops/s | |
| test_distributed | 0.5902ms | 0.1491ms | 6.7052 KOps/s | 6.6056 KOps/s | |
| test_tdmodule | 0.4976ms | 0.1910ms | 5.2368 KOps/s | 5.1005 KOps/s | |
| test_tdmodule_dispatch | 0.4029ms | 0.3715ms | 2.6919 KOps/s | 2.6501 KOps/s | |
| test_tdseq | 45.1310μs | 26.2470μs | 38.0996 KOps/s | 36.7326 KOps/s | |
| test_tdseq_dispatch | 0.2535ms | 0.2150ms | 4.6515 KOps/s | 4.6040 KOps/s | |
| test_instantiation_functorch | 2.1658ms | 2.0923ms | 477.9517 Ops/s | 480.4845 Ops/s | |
| test_exec_functorch | 0.2304ms | 0.1859ms | 5.3805 KOps/s | 5.4269 KOps/s | |
| test_exec_functional_call | 0.2128ms | 0.1639ms | 6.1022 KOps/s | 6.0681 KOps/s | |
| test_exec_td_decorator | 0.4938ms | 0.2560ms | 3.9058 KOps/s | 3.9553 KOps/s | |
| test_vmap_mlp_speed_decorator[True-True] | 1.2248ms | 1.0429ms | 958.9030 Ops/s | 956.1893 Ops/s | |
| test_vmap_mlp_speed_decorator[True-False] | 1.2663ms | 1.0344ms | 966.7727 Ops/s | 957.2658 Ops/s | |
| test_vmap_mlp_speed_decorator[False-True] | 0.9421ms | 0.7334ms | 1.3635 KOps/s | 1.3477 KOps/s | |
| test_vmap_mlp_speed_decorator[False-False] | 0.9291ms | 0.7321ms | 1.3660 KOps/s | 1.3463 KOps/s | |
| test_vmap_transformer_speed_decorator[True-True] | 21.4514ms | 21.2095ms | 47.1487 Ops/s | 46.8983 Ops/s | |
| test_vmap_transformer_speed_decorator[True-False] | 21.3806ms | 21.2130ms | 47.1409 Ops/s | 46.9760 Ops/s | |
| test_vmap_transformer_speed_decorator[False-True] | 21.1302ms | 20.8697ms | 47.9164 Ops/s | 47.8000 Ops/s | |
| test_vmap_transformer_speed_decorator[False-False] | 21.3440ms | 20.8048ms | 48.0657 Ops/s | 47.5841 Ops/s | |
| test_to_module_speed[True] | 2.2737ms | 1.6504ms | 605.9123 Ops/s | 601.1162 Ops/s | |
| test_to_module_speed[False] | 1.7218ms | 1.6178ms | 618.1102 Ops/s | 615.4556 Ops/s | |
| test_to_module_plain_tensor_speed[None] | 1.8730ms | 1.7472ms | 572.3509 Ops/s | 571.4089 Ops/s | |
| test_to_module_plain_tensor_speed[False] | 1.7008ms | 1.5716ms | 636.3036 Ops/s | 628.9784 Ops/s | |
| test_to_module_plain_tensor_speed[True] | 3.5595ms | 3.4289ms | 291.6406 Ops/s | 288.1026 Ops/s | |
| test_tc_init | 67.2810μs | 43.3428μs | 23.0719 KOps/s | 23.8430 KOps/s | |
| test_tc_init_tensor_only | 31.4910μs | 9.1503μs | 109.2855 KOps/s | 111.7154 KOps/s | |
| test_tc_init_nested | 0.1251ms | 85.4068μs | 11.7087 KOps/s | 11.6985 KOps/s | |
| test_tc_init_many_fields | 34.1010μs | 14.7464μs | 67.8131 KOps/s | 67.1077 KOps/s | |
| test_tc_first_layer_tensor | 29.2810μs | 1.8089μs | 552.8321 KOps/s | 552.5979 KOps/s | |
| test_tc_first_layer_tensor_only | 1.9730μs | 0.3845μs | 2.6006 MOps/s | 2.5271 MOps/s | |
| test_tc_first_layer_tensor_set | 42.4110μs | 3.9120μs | 255.6270 KOps/s | 254.3660 KOps/s | |
| test_tc_first_layer_tensor_only_set | 22.4710μs | 3.2773μs | 305.1271 KOps/s | 306.3097 KOps/s | |
| test_tc_first_layer_nontensor | 31.0010μs | 6.0772μs | 164.5495 KOps/s | 155.1904 KOps/s | |
| test_tc_second_layer_tensor | 34.7910μs | 4.3930μs | 227.6337 KOps/s | 226.7028 KOps/s | |
| test_tc_second_layer_nontensor | 53.2410μs | 8.6178μs | 116.0392 KOps/s | 111.9169 KOps/s | |
| test_unbind | 0.2662s | 13.7134ms | 72.9213 Ops/s | 65.5144 Ops/s | |
| test_full_like | 4.5109ms | 4.3808ms | 228.2670 Ops/s | 227.4863 Ops/s | |
| test_zeros_like | 4.6147ms | 4.3713ms | 228.7644 Ops/s | 227.5704 Ops/s | |
| test_ones_like | 4.5902ms | 4.3778ms | 228.4226 Ops/s | 227.4328 Ops/s | |
| test_clone | 6.7549ms | 6.4627ms | 154.7331 Ops/s | 155.1949 Ops/s | |
| test_squeeze | 62.2720μs | 14.4880μs | 69.0226 KOps/s | 69.0020 KOps/s | |
| test_unsqueeze | 0.1721ms | 0.1144ms | 8.7397 KOps/s | 8.9222 KOps/s | |
| test_split | 0.2624ms | 0.1843ms | 5.4248 KOps/s | 5.4576 KOps/s | |
| test_permute | 0.2802ms | 0.2133ms | 4.6887 KOps/s | 4.7955 KOps/s | |
| test_stack | 51.5683ms | 51.3728ms | 19.4656 Ops/s | 19.5771 Ops/s | |
| test_cat | 52.3582ms | 51.8947ms | 19.2698 Ops/s | 19.4326 Ops/s | |
| test_sequential_tensordict | 0.7057ms | 0.5891ms | 1.6974 KOps/s | 1.7321 KOps/s | |
| test_sequential_graph_module | 0.2281ms | 0.1298ms | 7.7047 KOps/s | 8.3598 KOps/s | |
| test_nested_tensordict | 1.2322ms | 0.8239ms | 1.2138 KOps/s | 1.2178 KOps/s | |
| test_nested_graph_module | 0.5310ms | 0.1345ms | 7.4373 KOps/s | 7.6672 KOps/s |
Contributor
|
| Name | Max | Mean | Ops | Ops on Repo HEAD
|
Change |
|---|---|---|---|---|---|
| test_collector_preallocated_write[stack_out-cpu-32-2] | 0.2372ms | 0.1722ms | 5.8082 KOps/s | 5.9150 KOps/s | |
| test_collector_preallocated_write[stack_out-cpu-32-8] | 0.3662ms | 0.2950ms | 3.3903 KOps/s | 3.3679 KOps/s | |
| test_collector_preallocated_write[stack_out-cpu-32-32] | 0.8806ms | 0.7762ms | 1.2883 KOps/s | 1.2748 KOps/s | |
| test_collector_preallocated_write[stack_out-cpu-4096-2] | 0.3906ms | 0.3447ms | 2.9009 KOps/s | 2.9013 KOps/s | |
| test_collector_preallocated_write[stack_out-cpu-4096-8] | 1.2632ms | 1.1232ms | 890.3013 Ops/s | 846.7009 Ops/s | |
| test_collector_preallocated_write[stack_out-cpu-4096-32] | 7.6591ms | 7.4129ms | 134.9008 Ops/s | 133.5198 Ops/s | |
| test_collector_preallocated_write[stack_out-cuda-32-2] | 0.2946ms | 0.2544ms | 3.9314 KOps/s | 3.8207 KOps/s | |
| test_collector_preallocated_write[stack_out-cuda-32-8] | 0.4544ms | 0.3781ms | 2.6447 KOps/s | 2.6621 KOps/s | |
| test_collector_preallocated_write[stack_out-cuda-32-32] | 0.9804ms | 0.8271ms | 1.2090 KOps/s | 1.2075 KOps/s | |
| test_collector_preallocated_write[stack_out-cuda-4096-2] | 0.3536ms | 0.2614ms | 3.8250 KOps/s | 3.9628 KOps/s | |
| test_collector_preallocated_write[stack_out-cuda-4096-8] | 0.4352ms | 0.3749ms | 2.6675 KOps/s | 2.6603 KOps/s | |
| test_collector_preallocated_write[stack_out-cuda-4096-32] | 0.9507ms | 0.8869ms | 1.1276 KOps/s | 1.1224 KOps/s | |
| test_collector_preallocated_write[set_at_loop-cpu-32-2] | 0.2726ms | 0.2146ms | 4.6609 KOps/s | 4.7044 KOps/s | |
| test_collector_preallocated_write[set_at_loop-cpu-32-8] | 0.9088ms | 0.8283ms | 1.2073 KOps/s | 1.1959 KOps/s | |
| test_collector_preallocated_write[set_at_loop-cpu-32-32] | 3.4410ms | 3.3272ms | 300.5487 Ops/s | 304.1281 Ops/s | |
| test_collector_preallocated_write[set_at_loop-cpu-4096-2] | 0.4450ms | 0.3717ms | 2.6905 KOps/s | 2.6545 KOps/s | |
| test_collector_preallocated_write[set_at_loop-cpu-4096-8] | 1.9833ms | 1.8158ms | 550.7338 Ops/s | 593.8378 Ops/s | |
| test_collector_preallocated_write[set_at_loop-cpu-4096-32] | 13.1811ms | 10.9011ms | 91.7340 Ops/s | 96.6741 Ops/s | |
| test_collector_preallocated_write[set_at_loop-cuda-32-2] | 0.5139ms | 0.4161ms | 2.4033 KOps/s | 2.5053 KOps/s | |
| test_collector_preallocated_write[set_at_loop-cuda-32-8] | 1.6316ms | 1.5439ms | 647.6945 Ops/s | 679.1663 Ops/s | |
| test_collector_preallocated_write[set_at_loop-cuda-32-32] | 6.2047ms | 5.9203ms | 168.9116 Ops/s | 170.8161 Ops/s | |
| test_collector_preallocated_write[set_at_loop-cuda-4096-2] | 0.5261ms | 0.4167ms | 2.3995 KOps/s | 2.5243 KOps/s | |
| test_collector_preallocated_write[set_at_loop-cuda-4096-8] | 1.9028ms | 1.5647ms | 639.0812 Ops/s | 673.5317 Ops/s | |
| test_collector_preallocated_write[set_at_loop-cuda-4096-32] | 6.3211ms | 6.0364ms | 165.6605 Ops/s | 171.1688 Ops/s | |
| test_collector_preallocated_write[copy_at-cpu-32-2] | 0.5749ms | 0.1744ms | 5.7324 KOps/s | 5.7684 KOps/s | |
| test_collector_preallocated_write[copy_at-cpu-32-8] | 0.7577ms | 0.6727ms | 1.4867 KOps/s | 1.4794 KOps/s | |
| test_collector_preallocated_write[copy_at-cpu-32-32] | 2.8072ms | 2.6908ms | 371.6356 Ops/s | 373.0834 Ops/s | |
| test_collector_preallocated_write[copy_at-cpu-4096-2] | 0.3793ms | 0.3227ms | 3.0988 KOps/s | 3.1330 KOps/s | |
| test_collector_preallocated_write[copy_at-cpu-4096-8] | 1.7793ms | 1.5621ms | 640.1561 Ops/s | 693.1312 Ops/s | |
| test_collector_preallocated_write[copy_at-cpu-4096-32] | 9.8249ms | 9.6307ms | 103.8346 Ops/s | 103.8697 Ops/s | |
| test_collector_preallocated_write[copy_at-cuda-32-2] | 0.3963ms | 0.3272ms | 3.0558 KOps/s | 3.0922 KOps/s | |
| test_collector_preallocated_write[copy_at-cuda-32-8] | 1.2919ms | 1.2189ms | 820.4421 Ops/s | 828.0378 Ops/s | |
| test_collector_preallocated_write[copy_at-cuda-32-32] | 4.9404ms | 4.7671ms | 209.7698 Ops/s | 211.9018 Ops/s | |
| test_collector_preallocated_write[copy_at-cuda-4096-2] | 0.3964ms | 0.3296ms | 3.0341 KOps/s | 3.0402 KOps/s | |
| test_collector_preallocated_write[copy_at-cuda-4096-8] | 1.3476ms | 1.2254ms | 816.0897 Ops/s | 823.6311 Ops/s | |
| test_collector_preallocated_write[copy_at-cuda-4096-32] | 5.1572ms | 4.8053ms | 208.1039 Ops/s | 209.7517 Ops/s | |
| test_collector_preallocated_write[manual_leaf_copy-cpu-32-2] | 0.1779ms | 0.1213ms | 8.2422 KOps/s | 8.3379 KOps/s | |
| test_collector_preallocated_write[manual_leaf_copy-cpu-32-8] | 0.5429ms | 0.4762ms | 2.1001 KOps/s | 2.1061 KOps/s | |
| test_collector_preallocated_write[manual_leaf_copy-cpu-32-32] | 1.9596ms | 1.8889ms | 529.3974 Ops/s | 529.7549 Ops/s | |
| test_collector_preallocated_write[manual_leaf_copy-cpu-4096-2] | 0.4038ms | 0.2584ms | 3.8694 KOps/s | 3.8873 KOps/s | |
| test_collector_preallocated_write[manual_leaf_copy-cpu-4096-8] | 1.3911ms | 1.2275ms | 814.6415 Ops/s | 824.8903 Ops/s | |
| test_collector_preallocated_write[manual_leaf_copy-cpu-4096-32] | 8.8085ms | 8.6574ms | 115.5075 Ops/s | 116.3282 Ops/s | |
| test_collector_preallocated_write[manual_leaf_copy-cuda-32-2] | 0.3512ms | 0.2806ms | 3.5637 KOps/s | 3.4298 KOps/s | |
| test_collector_preallocated_write[manual_leaf_copy-cuda-32-8] | 1.1243ms | 1.0348ms | 966.3845 Ops/s | 926.1169 Ops/s | |
| test_collector_preallocated_write[manual_leaf_copy-cuda-32-32] | 4.2255ms | 4.0213ms | 248.6775 Ops/s | 247.2509 Ops/s | |
| test_collector_preallocated_write[manual_leaf_copy-cuda-4096-2] | 0.3362ms | 0.2769ms | 3.6111 KOps/s | 3.5960 KOps/s | |
| test_collector_preallocated_write[manual_leaf_copy-cuda-4096-8] | 1.1160ms | 1.0292ms | 971.6318 Ops/s | 957.0046 Ops/s | |
| test_collector_preallocated_write[manual_leaf_copy-cuda-4096-32] | 4.2074ms | 4.0654ms | 245.9790 Ops/s | 245.6544 Ops/s | |
| test_wide_nested_preallocated_write[stack_out-cpu-128-128] | 16.7645ms | 16.3036ms | 61.3361 Ops/s | 60.9004 Ops/s | |
| test_wide_nested_preallocated_write[stack_out-cpu-128-256] | 33.0849ms | 32.8915ms | 30.4029 Ops/s | 30.3494 Ops/s | |
| test_wide_nested_preallocated_write[stack_out-cpu-4096-128] | 86.6886ms | 86.2732ms | 11.5911 Ops/s | 11.5879 Ops/s | |
| test_wide_nested_preallocated_write[stack_out-cpu-4096-256] | 0.2062s | 0.2042s | 4.8963 Ops/s | 4.9503 Ops/s | |
| test_wide_nested_preallocated_write[stack_out-cuda-128-128] | 13.9239ms | 13.7554ms | 72.6987 Ops/s | 72.0872 Ops/s | |
| test_wide_nested_preallocated_write[stack_out-cuda-128-256] | 27.2381ms | 27.0999ms | 36.9004 Ops/s | 37.0149 Ops/s | |
| test_wide_nested_preallocated_write[stack_out-cuda-4096-128] | 14.1725ms | 13.9766ms | 71.5483 Ops/s | 71.5051 Ops/s | |
| test_wide_nested_preallocated_write[stack_out-cuda-4096-256] | 27.6664ms | 27.4568ms | 36.4209 Ops/s | 36.1692 Ops/s | |
| test_wide_nested_preallocated_write[set_at_loop-cpu-128-128] | 52.5431ms | 52.1191ms | 19.1868 Ops/s | 19.4756 Ops/s | |
| test_wide_nested_preallocated_write[set_at_loop-cpu-128-256] | 0.1060s | 0.1054s | 9.4910 Ops/s | 9.5761 Ops/s | |
| test_wide_nested_preallocated_write[set_at_loop-cpu-4096-128] | 0.1492s | 0.1487s | 6.7262 Ops/s | 6.8793 Ops/s | |
| test_wide_nested_preallocated_write[set_at_loop-cpu-4096-256] | 0.3411s | 0.3340s | 2.9942 Ops/s | 3.0731 Ops/s | |
| test_wide_nested_preallocated_write[set_at_loop-cuda-128-128] | 74.4085ms | 74.0354ms | 13.5070 Ops/s | 12.7397 Ops/s | |
| test_wide_nested_preallocated_write[set_at_loop-cuda-128-256] | 0.1495s | 0.1488s | 6.7213 Ops/s | 6.7011 Ops/s | |
| test_wide_nested_preallocated_write[set_at_loop-cuda-4096-128] | 74.9595ms | 74.2923ms | 13.4603 Ops/s | 12.8131 Ops/s | |
| test_wide_nested_preallocated_write[set_at_loop-cuda-4096-256] | 0.1492s | 0.1485s | 6.7348 Ops/s | 6.6976 Ops/s | |
| test_wide_nested_preallocated_write[copy_at-cpu-128-128] | 32.6420ms | 30.1794ms | 33.1352 Ops/s | 32.7610 Ops/s | |
| test_wide_nested_preallocated_write[copy_at-cpu-128-256] | 61.8524ms | 61.6195ms | 16.2286 Ops/s | 16.3372 Ops/s | |
| test_wide_nested_preallocated_write[copy_at-cpu-4096-128] | 0.1222s | 0.1210s | 8.2657 Ops/s | 8.2328 Ops/s | |
| test_wide_nested_preallocated_write[copy_at-cpu-4096-256] | 0.2736s | 0.2715s | 3.6831 Ops/s | 3.7597 Ops/s | |
| test_wide_nested_preallocated_write[copy_at-cuda-128-128] | 43.6636ms | 43.2632ms | 23.1143 Ops/s | 23.0574 Ops/s | |
| test_wide_nested_preallocated_write[copy_at-cuda-128-256] | 87.6667ms | 87.0443ms | 11.4884 Ops/s | 11.6390 Ops/s | |
| test_wide_nested_preallocated_write[copy_at-cuda-4096-128] | 44.1738ms | 43.7401ms | 22.8623 Ops/s | 22.9874 Ops/s | |
| test_wide_nested_preallocated_write[copy_at-cuda-4096-256] | 88.2407ms | 87.7448ms | 11.3967 Ops/s | 11.5037 Ops/s | |
| test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-128] | 20.8328ms | 20.5017ms | 48.7763 Ops/s | 49.2462 Ops/s | |
| test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-256] | 42.1146ms | 41.8181ms | 23.9131 Ops/s | 24.0260 Ops/s | |
| test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-128] | 0.1109s | 0.1095s | 9.1340 Ops/s | 9.3396 Ops/s | |
| test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-256] | 0.2476s | 0.2447s | 4.0873 Ops/s | 4.1226 Ops/s | |
| test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-128] | 37.2434ms | 36.6835ms | 27.2602 Ops/s | 26.9307 Ops/s | |
| test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-256] | 73.9279ms | 73.2249ms | 13.6565 Ops/s | 13.5044 Ops/s | |
| test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-128] | 37.4641ms | 36.7030ms | 27.2458 Ops/s | 27.1308 Ops/s | |
| test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-256] | 73.2211ms | 72.7341ms | 13.7487 Ops/s | 13.5132 Ops/s | |
| test_plain_set_nested | 31.1520μs | 15.5476μs | 64.3185 KOps/s | 65.5284 KOps/s | |
| test_plain_set_stack_nested | 38.5120μs | 15.3273μs | 65.2429 KOps/s | 66.0927 KOps/s | |
| test_plain_set_nested_inplace | 40.1820μs | 16.8660μs | 59.2907 KOps/s | 59.1873 KOps/s | |
| test_plain_set_stack_nested_inplace | 46.9920μs | 16.7893μs | 59.5616 KOps/s | 60.0935 KOps/s | |
| test_items | 32.0520μs | 5.9963μs | 166.7706 KOps/s | 165.2279 KOps/s | |
| test_items_nested | 0.5040ms | 0.4655ms | 2.1483 KOps/s | 2.1249 KOps/s | |
| test_items_nested_locked | 0.4979ms | 0.4655ms | 2.1482 KOps/s | 2.1270 KOps/s | |
| test_items_nested_leaf | 0.1562ms | 96.8845μs | 10.3216 KOps/s | 10.2662 KOps/s | |
| test_items_stack_nested | 0.5244ms | 0.4625ms | 2.1622 KOps/s | 2.1383 KOps/s | |
| test_items_stack_nested_leaf | 0.1381ms | 96.8606μs | 10.3241 KOps/s | 10.3009 KOps/s | |
| test_items_stack_nested_locked | 0.5596ms | 0.4657ms | 2.1471 KOps/s | 2.1156 KOps/s | |
| test_keys | 31.6110μs | 4.2061μs | 237.7478 KOps/s | 233.6301 KOps/s | |
| test_keys_nested | 0.1669ms | 0.1311ms | 7.6294 KOps/s | 7.6650 KOps/s | |
| test_keys_nested_locked | 2.0215ms | 0.1393ms | 7.1794 KOps/s | 7.1372 KOps/s | |
| test_keys_nested_leaf | 0.1692ms | 0.1220ms | 8.1941 KOps/s | 8.2242 KOps/s | |
| test_keys_stack_nested | 0.1814ms | 0.1303ms | 7.6740 KOps/s | 7.7070 KOps/s | |
| test_keys_stack_nested_leaf | 0.1627ms | 0.1199ms | 8.3425 KOps/s | 8.2844 KOps/s | |
| test_keys_stack_nested_locked | 0.1772ms | 0.1380ms | 7.2440 KOps/s | 7.2263 KOps/s | |
| test_values | 5.7202μs | 1.0319μs | 969.1145 KOps/s | 970.3700 KOps/s | |
| test_values_nested | 92.8350μs | 52.5725μs | 19.0214 KOps/s | 18.9429 KOps/s | |
| test_values_nested_locked | 97.7350μs | 56.2700μs | 17.7715 KOps/s | 17.7657 KOps/s | |
| test_values_nested_leaf | 92.7850μs | 60.0777μs | 16.6451 KOps/s | 16.5015 KOps/s | |
| test_values_stack_nested | 98.0150μs | 52.2450μs | 19.1406 KOps/s | 19.1052 KOps/s | |
| test_values_stack_nested_leaf | 0.1070ms | 60.1086μs | 16.6366 KOps/s | 16.7003 KOps/s | |
| test_values_stack_nested_locked | 0.1010ms | 55.6821μs | 17.9591 KOps/s | 17.7941 KOps/s | |
| test_membership | 5.2170μs | 0.8345μs | 1.1983 MOps/s | 1.1630 MOps/s | |
| test_membership_nested | 29.5820μs | 2.9819μs | 335.3605 KOps/s | 326.0032 KOps/s | |
| test_membership_nested_leaf | 11.9255μs | 2.8811μs | 347.0924 KOps/s | 333.6979 KOps/s | |
| test_membership_stacked_nested | 33.3520μs | 2.8876μs | 346.3095 KOps/s | 342.7227 KOps/s | |
| test_membership_stacked_nested_leaf | 30.0920μs | 2.8789μs | 347.3504 KOps/s | 345.0580 KOps/s | |
| test_membership_nested_last | 33.0620μs | 4.5008μs | 222.1819 KOps/s | 222.5844 KOps/s | |
| test_membership_nested_leaf_last | 20.3210μs | 4.4757μs | 223.4288 KOps/s | 221.9434 KOps/s | |
| test_membership_stacked_nested_last | 34.9020μs | 4.3475μs | 230.0170 KOps/s | 229.3944 KOps/s | |
| test_membership_stacked_nested_leaf_last | 44.5920μs | 4.3045μs | 232.3144 KOps/s | 228.2653 KOps/s | |
| test_nested_getleaf | 47.9620μs | 21.5882μs | 46.3217 KOps/s | 45.4400 KOps/s | |
| test_nested_get | 51.7220μs | 20.2403μs | 49.4065 KOps/s | 48.2429 KOps/s | |
| test_stacked_getleaf | 56.7230μs | 21.5845μs | 46.3295 KOps/s | 45.9803 KOps/s | |
| test_stacked_get | 53.2330μs | 20.2740μs | 49.3244 KOps/s | 48.1039 KOps/s | |
| test_nested_getitemleaf | 50.7230μs | 22.1202μs | 45.2075 KOps/s | 44.5717 KOps/s | |
| test_nested_getitem | 53.2630μs | 20.9376μs | 47.7609 KOps/s | 47.3588 KOps/s | |
| test_stacked_getitemleaf | 57.8330μs | 21.9448μs | 45.5689 KOps/s | 45.2185 KOps/s | |
| test_stacked_getitem | 57.4430μs | 21.0694μs | 47.4622 KOps/s | 47.1571 KOps/s | |
| test_lock_nested | 0.5809ms | 0.5078ms | 1.9694 KOps/s | 1.9718 KOps/s | |
| test_lock_stack_nested | 0.5849ms | 0.5172ms | 1.9334 KOps/s | 1.9712 KOps/s | |
| test_unlock_nested | 0.4743ms | 0.4037ms | 2.4769 KOps/s | 2.5262 KOps/s | |
| test_unlock_stack_nested | 0.5733ms | 0.4108ms | 2.4342 KOps/s | 2.4953 KOps/s | |
| test_flatten_speed | 0.2650ms | 0.1222ms | 8.1847 KOps/s | 8.1649 KOps/s | |
| test_unflatten_speed | 0.6435ms | 0.5725ms | 1.7467 KOps/s | 1.7427 KOps/s | |
| test_common_ops | 0.1046s | 1.4493ms | 689.9773 Ops/s | 252.1273 Ops/s | |
| test_creation | 0.1554ms | 3.1870μs | 313.7740 KOps/s | 311.2065 KOps/s | |
| test_creation_empty | 26.6810μs | 7.0867μs | 141.1098 KOps/s | 140.7614 KOps/s | |
| test_creation_nested_1 | 38.7420μs | 11.5930μs | 86.2586 KOps/s | 86.2258 KOps/s | |
| test_creation_nested_2 | 77.3940μs | 13.6498μs | 73.2609 KOps/s | 73.1332 KOps/s | |
| test_creation_many_keys[10] | 47.5530μs | 21.1614μs | 47.2559 KOps/s | 46.6593 KOps/s | |
| test_creation_many_keys[50] | 0.1230ms | 90.6987μs | 11.0255 KOps/s | 10.9533 KOps/s | |
| test_creation_many_keys[100] | 0.2183ms | 0.1773ms | 5.6400 KOps/s | 5.6009 KOps/s | |
| test_creation_nested_many_keys[10] | 83.6440μs | 45.4055μs | 22.0238 KOps/s | 21.5389 KOps/s | |
| test_creation_nested_many_keys[50] | 0.2645ms | 0.1867ms | 5.3558 KOps/s | 5.3081 KOps/s | |
| test_clone | 44.9720μs | 13.5839μs | 73.6167 KOps/s | 74.2375 KOps/s | |
| test_getitem[int] | 1.4387ms | 15.2177μs | 65.7129 KOps/s | 65.1729 KOps/s | |
| test_getitem[slice_int] | 0.1346ms | 24.9383μs | 40.0989 KOps/s | 40.6627 KOps/s | |
| test_getitem[range] | 0.1771ms | 65.2427μs | 15.3274 KOps/s | 15.2808 KOps/s | |
| test_getitem[tuple] | 0.1465ms | 24.4340μs | 40.9266 KOps/s | 41.8394 KOps/s | |
| test_getitem[list] | 0.1861ms | 60.5434μs | 16.5171 KOps/s | 16.7191 KOps/s | |
| test_setitem_dim[int] | 58.9930μs | 26.2056μs | 38.1598 KOps/s | 38.3143 KOps/s | |
| test_setitem_dim[slice_int] | 64.3840μs | 42.9742μs | 23.2698 KOps/s | 23.2547 KOps/s | |
| test_setitem_dim[range] | 0.1433ms | 95.0385μs | 10.5221 KOps/s | 9.8201 KOps/s | |
| test_setitem_dim[tuple] | 67.4940μs | 40.0024μs | 24.9985 KOps/s | 25.6077 KOps/s | |
| test_setitem | 55.0730μs | 18.1172μs | 55.1963 KOps/s | 55.4164 KOps/s | |
| test_set | 52.6620μs | 17.1088μs | 58.4493 KOps/s | 59.1249 KOps/s | |
| test_set_shared | 0.6250ms | 0.2198ms | 4.5486 KOps/s | 4.7753 KOps/s | |
| test_update | 0.2582ms | 22.1138μs | 45.2206 KOps/s | 45.1259 KOps/s | |
| test_update_nested | 76.6040μs | 34.5317μs | 28.9589 KOps/s | 29.9417 KOps/s | |
| test_update__nested | 0.4466ms | 33.8903μs | 29.5069 KOps/s | 29.5791 KOps/s | |
| test_set_nested | 48.8130μs | 19.4183μs | 51.4979 KOps/s | 53.0008 KOps/s | |
| test_set_nested_new | 65.4140μs | 23.9963μs | 41.6730 KOps/s | 41.8427 KOps/s | |
| test_select | 87.5650μs | 40.7747μs | 24.5250 KOps/s | 24.5355 KOps/s | |
| test_select_nested | 0.1176ms | 75.8631μs | 13.1816 KOps/s | 13.4131 KOps/s | |
| test_exclude_nested | 0.1392ms | 91.6249μs | 10.9141 KOps/s | 10.8744 KOps/s | |
| test_empty[True] | 0.4808ms | 0.4011ms | 2.4931 KOps/s | 2.4982 KOps/s | |
| test_empty[False] | 8.1637μs | 1.4111μs | 708.6868 KOps/s | 706.5651 KOps/s | |
| test_to | 0.1298ms | 71.5793μs | 13.9705 KOps/s | 14.2127 KOps/s | |
| test_to_nonblocking | 0.1428ms | 72.4419μs | 13.8042 KOps/s | 14.4970 KOps/s | |
| test_unbind_speed | 0.3958ms | 0.3499ms | 2.8584 KOps/s | 2.9302 KOps/s | |
| test_unbind_speed_stack0 | 0.4240ms | 0.3399ms | 2.9422 KOps/s | 2.9810 KOps/s | |
| test_unbind_speed_stack1 | 0.1139s | 0.8654ms | 1.1556 KOps/s | 1.1576 KOps/s | |
| test_split | 0.1141s | 1.2837ms | 779.0083 Ops/s | 713.6891 Ops/s | |
| test_chunk | 1.1988ms | 1.0990ms | 909.9094 Ops/s | 915.4472 Ops/s | |
| test_to_cpu_blocking | 0.1327s | 21.7304ms | 46.0185 Ops/s | 51.5201 Ops/s | |
| test_to_cpu_global_sync | 12.0710ms | 11.9315ms | 83.8115 Ops/s | 84.5154 Ops/s | |
| test_to_cpu_event_sync | 13.2160ms | 12.8297ms | 77.9444 Ops/s | 78.7868 Ops/s | |
| test_to_cpu_default | 13.3405ms | 12.8055ms | 78.0912 Ops/s | 70.2123 Ops/s | |
| test_consolidate[False-None] | 4.2778ms | 4.2320ms | 236.2955 Ops/s | 238.5417 Ops/s | |
| test_consolidate[default-None] | 3.4558ms | 2.1655ms | 461.7919 Ops/s | 455.3875 Ops/s | |
| test_consolidate[reduce-overhead-None] | 3.5227ms | 2.1136ms | 473.1191 Ops/s | 471.7323 Ops/s | |
| test_consolidate_njt[False-None] | 9.3870ms | 8.6474ms | 115.6418 Ops/s | 115.0297 Ops/s | |
| test_to[False-False-None] | 2.4061ms | 2.2242ms | 449.5960 Ops/s | 457.7792 Ops/s | |
| test_to[True-False-None] | 2.2915ms | 1.9916ms | 502.1117 Ops/s | 524.8645 Ops/s | |
| test_to[within-False-None] | 6.6769ms | 6.3968ms | 156.3291 Ops/s | 159.6008 Ops/s | |
| test_to[True-default-None] | 10.9489ms | 10.7198ms | 93.2851 Ops/s | 91.7652 Ops/s | |
| test_to_njt[False-False-None] | 8.7224ms | 8.5965ms | 116.3263 Ops/s | 115.4092 Ops/s | |
| test_to_njt[True-False-None] | 7.1107ms | 6.9292ms | 144.3171 Ops/s | 142.7944 Ops/s | |
| test_to_njt[within-False-None] | 15.8080ms | 15.6689ms | 63.8205 Ops/s | 64.1663 Ops/s | |
| test_creation[device0] | 0.4740ms | 0.1230ms | 8.1272 KOps/s | 8.5149 KOps/s | |
| test_creation_from_tensor | 0.5394ms | 0.1190ms | 8.4006 KOps/s | 8.7091 KOps/s | |
| test_add_one[memmap_tensor0] | 0.6345ms | 6.9729μs | 143.4114 KOps/s | 148.7907 KOps/s | |
| test_contiguous[memmap_tensor0] | 23.7310μs | 0.6806μs | 1.4693 MOps/s | 2.2521 MOps/s | |
| test_stack[memmap_tensor0] | 29.2610μs | 4.4898μs | 222.7284 KOps/s | 236.9143 KOps/s | |
| test_memmaptd_index | 1.2332ms | 0.2808ms | 3.5619 KOps/s | 3.6816 KOps/s | |
| test_memmaptd_index_astensor | 0.5531ms | 0.3876ms | 2.5803 KOps/s | 2.6523 KOps/s | |
| test_memmaptd_index_op | 0.8413ms | 0.6491ms | 1.5406 KOps/s | 1.5721 KOps/s | |
| test_serialize_model | 0.1376s | 0.1350s | 7.4072 Ops/s | 7.4423 Ops/s | |
| test_serialize_model_pickle | 1.3488s | 1.2101s | 0.8264 Ops/s | 0.8226 Ops/s | |
| test_serialize_weights | 0.1361s | 0.1340s | 7.4622 Ops/s | 7.4108 Ops/s | |
| test_serialize_weights_returnearly | 0.3070s | 79.2696ms | 12.6152 Ops/s | 10.7645 Ops/s | |
| test_serialize_weights_pickle | 1.3649s | 1.2129s | 0.8245 Ops/s | 0.8180 Ops/s | |
| test_reshape_pytree | 0.2072ms | 32.9539μs | 30.3454 KOps/s | 30.8680 KOps/s | |
| test_reshape_td | 74.2340μs | 45.0755μs | 22.1850 KOps/s | 22.0253 KOps/s | |
| test_view_pytree | 0.2141ms | 32.6684μs | 30.6106 KOps/s | 30.9714 KOps/s | |
| test_view_td | 98.7650μs | 54.6191μs | 18.3086 KOps/s | 18.3876 KOps/s | |
| test_unbind_pytree | 0.2458ms | 37.2288μs | 26.8609 KOps/s | 27.1881 KOps/s | |
| test_unbind_td | 81.3340μs | 51.8243μs | 19.2960 KOps/s | 19.8128 KOps/s | |
| test_split_pytree | 0.2228ms | 43.2078μs | 23.1440 KOps/s | 23.4106 KOps/s | |
| test_split_td | 0.1382ms | 66.1481μs | 15.1176 KOps/s | 15.1625 KOps/s | |
| test_add_pytree | 0.2300ms | 42.7325μs | 23.4014 KOps/s | 23.6229 KOps/s | |
| test_add_td | 0.1027ms | 55.2391μs | 18.1031 KOps/s | 18.1189 KOps/s | |
| test_compile_add_one_nested[tensordict-compile] | 0.3411ms | 0.2359ms | 4.2399 KOps/s | 4.4059 KOps/s | |
| test_compile_add_one_nested[tensordict-eager] | 0.3151ms | 0.2076ms | 4.8159 KOps/s | 4.9783 KOps/s | |
| test_compile_add_one_nested[pytree-compile] | 0.2976ms | 0.1334ms | 7.4980 KOps/s | 7.3792 KOps/s | |
| test_compile_add_one_nested[pytree-eager] | 0.4318ms | 0.1825ms | 5.4803 KOps/s | 5.7035 KOps/s | |
| test_compile_copy_nested[tensordict-compile] | 77.3540μs | 15.8182μs | 63.2182 KOps/s | 63.5538 KOps/s | |
| test_compile_copy_nested[tensordict-eager] | 0.2089ms | 58.2873μs | 17.1564 KOps/s | 18.2905 KOps/s | |
| test_compile_copy_nested[pytree-compile] | 0.1430ms | 16.0026μs | 62.4897 KOps/s | 62.3067 KOps/s | |
| test_compile_copy_nested[pytree-eager] | 0.3964ms | 67.8496μs | 14.7385 KOps/s | 15.0223 KOps/s | |
| test_compile_add_one_flat[tensordict-compile] | 0.2983ms | 0.2502ms | 3.9974 KOps/s | 3.7941 KOps/s | |
| test_compile_add_one_flat[tensordict-eager] | 0.3977ms | 0.2852ms | 3.5068 KOps/s | 3.5414 KOps/s | |
| test_compile_add_one_flat[tensorclass-compile] | 0.3530ms | 0.1853ms | 5.3961 KOps/s | 5.1212 KOps/s | |
| test_compile_add_one_flat[tensorclass-eager] | 0.1282ms | 74.8127μs | 13.3667 KOps/s | 13.1934 KOps/s | |
| test_compile_add_one_flat[pytree-compile] | 0.4956ms | 0.1913ms | 5.2276 KOps/s | 5.0831 KOps/s | |
| test_compile_add_one_flat[pytree-eager] | 0.8243ms | 0.5294ms | 1.8889 KOps/s | 1.9511 KOps/s | |
| test_compile_add_self_flat[tensordict-eager] | 0.4010ms | 0.3309ms | 3.0222 KOps/s | 3.0232 KOps/s | |
| test_compile_add_self_flat[tensordict-compile] | 0.3113ms | 0.2573ms | 3.8872 KOps/s | 3.7698 KOps/s | |
| test_compile_add_self_flat[tensorclass-eager] | 0.2001ms | 94.2957μs | 10.6049 KOps/s | 10.5612 KOps/s | |
| test_compile_add_self_flat[tensorclass-compile] | 0.3326ms | 0.1963ms | 5.0947 KOps/s | 5.0467 KOps/s | |
| test_compile_add_self_flat[pytree-eager] | 0.7110ms | 0.4392ms | 2.2769 KOps/s | 2.3457 KOps/s | |
| test_compile_add_self_flat[pytree-compile] | 0.5468ms | 0.1989ms | 5.0278 KOps/s | 5.0591 KOps/s | |
| test_compile_copy_flat[tensordict-compile] | 68.2640μs | 21.2292μs | 47.1048 KOps/s | 49.8698 KOps/s | |
| test_compile_copy_flat[tensordict-eager] | 0.1258ms | 42.0035μs | 23.8075 KOps/s | 23.6219 KOps/s | |
| test_compile_copy_flat[pytree-compile] | 0.2047ms | 22.1746μs | 45.0966 KOps/s | 45.6427 KOps/s | |
| test_compile_copy_flat[pytree-eager] | 0.3456ms | 51.8440μs | 19.2887 KOps/s | 18.9148 KOps/s | |
| test_compile_assign_and_add[tensordict-compile] | 2.2175ms | 0.2406ms | 4.1570 KOps/s | 3.8841 KOps/s | |
| test_compile_assign_and_add[tensordict-eager] | 3.6619ms | 3.2906ms | 303.9000 Ops/s | 297.2209 Ops/s | |
| test_compile_assign_and_add[pytree-compile] | 2.5666ms | 0.1861ms | 5.3734 KOps/s | 5.2996 KOps/s | |
| test_compile_assign_and_add[pytree-eager] | 3.1560ms | 2.8412ms | 351.9611 Ops/s | 358.4667 Ops/s | |
| test_compile_indexing[tensor-tensordict-compile] | 0.2570ms | 0.1350ms | 7.4097 KOps/s | 6.9357 KOps/s | |
| test_compile_indexing[tensor-tensordict-eager] | 0.3136ms | 76.0931μs | 13.1418 KOps/s | 12.7107 KOps/s | |
| test_compile_indexing[tensor-tensorclass-compile] | 0.2184ms | 0.1172ms | 8.5318 KOps/s | 8.3321 KOps/s | |
| test_compile_indexing[tensor-tensorclass-eager] | 0.2524ms | 45.2202μs | 22.1140 KOps/s | 21.1161 KOps/s | |
| test_compile_indexing[tensor-pytree-compile] | 0.1644ms | 0.1178ms | 8.4903 KOps/s | 8.2077 KOps/s | |
| test_compile_indexing[tensor-pytree-eager] | 0.2740ms | 44.9260μs | 22.2588 KOps/s | 20.9556 KOps/s | |
| test_compile_indexing[slice-tensordict-compile] | 0.2176ms | 84.5340μs | 11.8296 KOps/s | 11.2172 KOps/s | |
| test_compile_indexing[slice-tensordict-eager] | 0.2063ms | 29.0786μs | 34.3896 KOps/s | 35.6530 KOps/s | |
| test_compile_indexing[slice-tensorclass-compile] | 0.1586ms | 69.9089μs | 14.3043 KOps/s | 14.1373 KOps/s | |
| test_compile_indexing[slice-tensorclass-eager] | 0.2357ms | 22.2600μs | 44.9236 KOps/s | 44.9401 KOps/s | |
| test_compile_indexing[slice-pytree-compile] | 0.1162ms | 71.2602μs | 14.0331 KOps/s | 13.8288 KOps/s | |
| test_compile_indexing[slice-pytree-eager] | 0.2404ms | 22.2880μs | 44.8672 KOps/s | 44.8228 KOps/s | |
| test_compile_indexing[int-tensordict-compile] | 0.1342ms | 85.8370μs | 11.6500 KOps/s | 11.1552 KOps/s | |
| test_compile_indexing[int-tensordict-eager] | 0.2702ms | 29.2002μs | 34.2464 KOps/s | 35.7580 KOps/s | |
| test_compile_indexing[int-tensorclass-compile] | 0.1179ms | 70.8321μs | 14.1179 KOps/s | 13.7636 KOps/s | |
| test_compile_indexing[int-tensorclass-eager] | 0.2362ms | 22.3259μs | 44.7911 KOps/s | 45.0870 KOps/s | |
| test_compile_indexing[int-pytree-compile] | 0.1140ms | 71.1760μs | 14.0497 KOps/s | 13.6625 KOps/s | |
| test_compile_indexing[int-pytree-eager] | 0.2507ms | 22.1625μs | 45.1212 KOps/s | 45.4005 KOps/s | |
| test_compile_replace[single-eager] | 98.1950μs | 48.7799μs | 20.5002 KOps/s | 20.0769 KOps/s | |
| test_compile_replace[single-compile] | 0.2323ms | 0.1306ms | 7.6578 KOps/s | 7.6191 KOps/s | |
| test_compile_replace[multi-eager] | 0.6570ms | 0.5737ms | 1.7431 KOps/s | 1.7572 KOps/s | |
| test_compile_replace[multi-compile] | 0.2561ms | 0.1383ms | 7.2317 KOps/s | 7.0790 KOps/s | |
| test_compile_tc_getattr_20[eager] | 0.2129ms | 0.1712ms | 5.8404 KOps/s | 6.2219 KOps/s | |
| test_compile_tc_getattr_20[compile] | 0.4017ms | 0.1457ms | 6.8633 KOps/s | 6.7179 KOps/s | |
| test_compile_clone_shallow[20-eager] | 54.0930μs | 19.6326μs | 50.9358 KOps/s | 52.0426 KOps/s | |
| test_compile_clone_shallow[20-compile] | 0.1150ms | 17.5555μs | 56.9623 KOps/s | 58.3419 KOps/s | |
| test_compile_clone_shallow[40-eager] | 71.2330μs | 34.8778μs | 28.6715 KOps/s | 30.3408 KOps/s | |
| test_compile_clone_shallow[40-compile] | 75.9040μs | 19.5060μs | 51.2664 KOps/s | 52.7295 KOps/s | |
| test_compile_clone_shallow[80-eager] | 99.6050μs | 63.8077μs | 15.6721 KOps/s | 15.7406 KOps/s | |
| test_compile_clone_shallow[80-compile] | 78.3540μs | 23.1917μs | 43.1189 KOps/s | 45.5083 KOps/s | |
| test_compile_update_inplace[eager] | 0.1042ms | 60.8153μs | 16.4432 KOps/s | 16.4539 KOps/s | |
| test_compile_update_inplace[compile] | 0.4276ms | 0.1474ms | 6.7829 KOps/s | 6.7170 KOps/s | |
| test_mod_add[eager] | 0.2843ms | 0.2263ms | 4.4183 KOps/s | 4.3964 KOps/s | |
| test_mod_add[compile] | 0.3459ms | 0.1313ms | 7.6189 KOps/s | 7.3668 KOps/s | |
| test_mod_add[compile-overhead] | 0.3523ms | 0.1772ms | 5.6447 KOps/s | 5.5859 KOps/s | |
| test_mod_wrap[eager] | 0.5456ms | 0.4684ms | 2.1348 KOps/s | 2.1301 KOps/s | |
| test_mod_wrap[compile] | 0.4966ms | 0.4137ms | 2.4173 KOps/s | 2.4958 KOps/s | |
| test_mod_wrap[compile-overhead] | 8.5136ms | 4.7147ms | 212.1011 Ops/s | 211.8031 Ops/s | |
| test_mod_wrap_and_backward[eager] | 1.8294ms | 1.7042ms | 586.7991 Ops/s | 588.5470 Ops/s | |
| test_mod_wrap_and_backward[compile] | 1.8170ms | 1.5322ms | 652.6658 Ops/s | 646.2545 Ops/s | |
| test_mod_wrap_and_backward[compile-overhead] | 1.3572ms | 0.9473ms | 1.0556 KOps/s | 1.0378 KOps/s | |
| test_seq_add[eager] | 0.5974ms | 0.5268ms | 1.8981 KOps/s | 1.9492 KOps/s | |
| test_seq_add[compile] | 0.2547ms | 0.1476ms | 6.7764 KOps/s | 6.6292 KOps/s | |
| test_seq_add[compile-overhead] | 0.3366ms | 0.1856ms | 5.3888 KOps/s | 5.0959 KOps/s | |
| test_seq_wrap[eager] | 1.5304ms | 1.4177ms | 705.3546 Ops/s | 700.4840 Ops/s | |
| test_seq_wrap[compile] | 0.4911ms | 0.4268ms | 2.3430 KOps/s | 2.3971 KOps/s | |
| test_seq_wrap[compile-overhead] | 0.3904ms | 0.3135ms | 3.1896 KOps/s | 3.2234 KOps/s | |
| test_func_call_runtime[False-eager] | 0.9163ms | 0.8462ms | 1.1817 KOps/s | 1.2488 KOps/s | |
| test_func_call_runtime[False-compile] | 1.1034ms | 0.9990ms | 1.0010 KOps/s | 1.0075 KOps/s | |
| test_func_call_runtime[False-compile-overhead] | 0.5656ms | 0.5106ms | 1.9585 KOps/s | 1.9276 KOps/s | |
| test_func_call_runtime[True-eager] | 1.2414ms | 1.0629ms | 940.7832 Ops/s | 943.1375 Ops/s | |
| test_func_call_runtime[True-compile] | 1.1053ms | 1.0007ms | 999.2667 Ops/s | 993.2367 Ops/s | |
| test_func_call_runtime[True-compile-overhead] | 0.6260ms | 0.5249ms | 1.9053 KOps/s | 1.8738 KOps/s | |
| test_func_call_cm_runtime[False-eager] | 0.9416ms | 0.8356ms | 1.1968 KOps/s | 1.2499 KOps/s | |
| test_func_call_cm_runtime[False-compile] | 1.6340ms | 1.0159ms | 984.3888 Ops/s | 1.0217 KOps/s | |
| test_func_call_cm_runtime[False-compile-overhead] | 0.6083ms | 0.4915ms | 2.0347 KOps/s | 2.0094 KOps/s | |
| test_func_call_cm_runtime[True-eager] | 1.3155ms | 1.2116ms | 825.3696 Ops/s | 818.7462 Ops/s | |
| test_func_call_cm_runtime[True-compile] | 1.1506ms | 1.0178ms | 982.5018 Ops/s | 967.5389 Ops/s | |
| test_func_call_cm_runtime[True-compile-overhead] | 0.7047ms | 0.5467ms | 1.8292 KOps/s | 1.7759 KOps/s | |
| test_vmap_func_call_cm_runtime[eager] | 2.8881ms | 2.3981ms | 416.9927 Ops/s | 414.7597 Ops/s | |
| test_vmap_func_call_cm_runtime[compile] | 3.0629ms | 2.5812ms | 387.4238 Ops/s | 384.9311 Ops/s | |
| test_vmap_func_call_cm_runtime[compile-overhead] | 3.0383ms | 2.5801ms | 387.5865 Ops/s | 384.9640 Ops/s | |
| test_distributed | 1.6491ms | 0.1523ms | 6.5672 KOps/s | 6.6857 KOps/s | |
| test_tdmodule | 0.6875ms | 0.1927ms | 5.1887 KOps/s | 5.1807 KOps/s | |
| test_tdmodule_dispatch | 0.4081ms | 0.3731ms | 2.6801 KOps/s | 2.6683 KOps/s | |
| test_tdseq | 44.9630μs | 26.7268μs | 37.4156 KOps/s | 37.1595 KOps/s | |
| test_tdseq_dispatch | 0.2817ms | 0.2156ms | 4.6383 KOps/s | 4.6011 KOps/s | |
| test_instantiation_functorch | 2.4778ms | 2.1120ms | 473.4850 Ops/s | 488.7182 Ops/s | |
| test_exec_functorch | 0.2382ms | 0.1861ms | 5.3726 KOps/s | 5.2677 KOps/s | |
| test_exec_functional_call | 0.2176ms | 0.1641ms | 6.0943 KOps/s | 5.9431 KOps/s | |
| test_exec_td_decorator | 0.4849ms | 0.2527ms | 3.9576 KOps/s | 3.9173 KOps/s | |
| test_vmap_mlp_speed_decorator[True-True] | 1.2269ms | 1.0363ms | 964.9730 Ops/s | 956.9787 Ops/s | |
| test_vmap_mlp_speed_decorator[True-False] | 1.2320ms | 1.0355ms | 965.7620 Ops/s | 958.0732 Ops/s | |
| test_vmap_mlp_speed_decorator[False-True] | 0.9383ms | 0.7337ms | 1.3630 KOps/s | 1.3467 KOps/s | |
| test_vmap_mlp_speed_decorator[False-False] | 0.8909ms | 0.7340ms | 1.3624 KOps/s | 1.3529 KOps/s | |
| test_vmap_transformer_speed_decorator[True-True] | 21.2768ms | 21.0882ms | 47.4199 Ops/s | 47.3699 Ops/s | |
| test_vmap_transformer_speed_decorator[True-False] | 21.3201ms | 21.0958ms | 47.4029 Ops/s | 47.2689 Ops/s | |
| test_vmap_transformer_speed_decorator[False-True] | 21.4230ms | 20.7039ms | 48.3002 Ops/s | 48.0171 Ops/s | |
| test_vmap_transformer_speed_decorator[False-False] | 21.5269ms | 20.7413ms | 48.2129 Ops/s | 47.9026 Ops/s | |
| test_to_module_speed[True] | 2.2192ms | 1.6460ms | 607.5286 Ops/s | 603.9509 Ops/s | |
| test_to_module_speed[False] | 2.1864ms | 1.6303ms | 613.3782 Ops/s | 614.9241 Ops/s | |
| test_to_module_plain_tensor_speed[None] | 1.8597ms | 1.7433ms | 573.6302 Ops/s | 572.6118 Ops/s | |
| test_to_module_plain_tensor_speed[False] | 1.7043ms | 1.5865ms | 630.3275 Ops/s | 634.5391 Ops/s | |
| test_to_module_plain_tensor_speed[True] | 3.5591ms | 3.4419ms | 290.5337 Ops/s | 292.7429 Ops/s | |
| test_tc_init | 76.7640μs | 42.8213μs | 23.3529 KOps/s | 23.3942 KOps/s | |
| test_tc_init_tensor_only | 80.1640μs | 9.0426μs | 110.5876 KOps/s | 111.8742 KOps/s | |
| test_tc_init_nested | 0.1200ms | 85.2807μs | 11.7260 KOps/s | 11.8859 KOps/s | |
| test_tc_init_many_fields | 48.2730μs | 14.9354μs | 66.9550 KOps/s | 67.2168 KOps/s | |
| test_tc_first_layer_tensor | 30.5420μs | 1.8333μs | 545.4689 KOps/s | 547.6247 KOps/s | |
| test_tc_first_layer_tensor_only | 1.6356μs | 0.4037μs | 2.4772 MOps/s | 2.5673 MOps/s | |
| test_tc_first_layer_tensor_set | 30.9510μs | 3.9823μs | 251.1103 KOps/s | 256.7747 KOps/s | |
| test_tc_first_layer_tensor_only_set | 22.8610μs | 3.3232μs | 300.9171 KOps/s | 305.7417 KOps/s | |
| test_tc_first_layer_nontensor | 34.0320μs | 6.2090μs | 161.0565 KOps/s | 155.4198 KOps/s | |
| test_tc_second_layer_tensor | 26.9620μs | 4.4339μs | 225.5371 KOps/s | 228.3556 KOps/s | |
| test_tc_second_layer_nontensor | 85.5640μs | 8.7719μs | 114.0008 KOps/s | 111.6920 KOps/s | |
| test_unbind | 0.2660s | 12.9258ms | 77.3647 Ops/s | 66.6419 Ops/s | |
| test_full_like | 4.4464ms | 4.2661ms | 234.4038 Ops/s | 227.5196 Ops/s | |
| test_zeros_like | 4.5124ms | 4.3801ms | 228.3058 Ops/s | 228.0180 Ops/s | |
| test_ones_like | 4.4856ms | 4.3991ms | 227.3168 Ops/s | 227.7381 Ops/s | |
| test_clone | 6.8371ms | 6.5835ms | 151.8948 Ops/s | 152.0640 Ops/s | |
| test_squeeze | 0.1964ms | 14.4468μs | 69.2194 KOps/s | 68.5767 KOps/s | |
| test_unsqueeze | 0.1695ms | 0.1131ms | 8.8380 KOps/s | 8.8523 KOps/s | |
| test_split | 0.2379ms | 0.1816ms | 5.5054 KOps/s | 5.4811 KOps/s | |
| test_permute | 0.2854ms | 0.2149ms | 4.6540 KOps/s | 4.9322 KOps/s | |
| test_stack | 51.7607ms | 51.5201ms | 19.4099 Ops/s | 54.1469 Ops/s | |
| test_cat | 51.8748ms | 51.4498ms | 19.4364 Ops/s | 54.3713 Ops/s | |
| test_sequential_tensordict | 0.6196ms | 0.5712ms | 1.7506 KOps/s | 1.7402 KOps/s | |
| test_sequential_graph_module | 0.1998ms | 0.1205ms | 8.3018 KOps/s | 8.1589 KOps/s | |
| test_nested_tensordict | 0.8996ms | 0.8179ms | 1.2226 KOps/s | 1.2248 KOps/s | |
| test_nested_graph_module | 0.2128ms | 0.1275ms | 7.8407 KOps/s | 7.4137 KOps/s |
vmoens
commented
Jun 12, 2026
- Remove History.default_spec from tensordict: it returned a torchrl Composite spec, which made tensordict reference its own consumer. The classmethod moves to the torchrl re-export shim (attached there, with a history_default_spec free function), so torchrl users keep the History.default_spec() API and tensordict carries zero torchrl references. - Remove the torchrl-gated test accordingly; it stays in torchrl's suite where it belongs. - Install transformers and pillow in the CI test environment so the chat-template tests actually run in CI instead of being skipped. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Moves
History,ContentBase,add_chat_templateand the base chat templates from torchrl (torchrl/data/llm/history.pyat13c7eca6) into a newtensordict.llmmodule, making tensordict the canonical home.Historyis already tensordict-native (aTensorClasswhose only torchrl-internal dependencies were the logger and thedefault_spechelper). Moving it down the stack lets consumers that only need conversation parsing/formatting depend on released tensordict wheels instead of torchrl. A follow-up torchrl PR will re-exporttorchrl.data.llm.Historyfrom here so existing import paths keep working.Changes relative to the torchrl source
torchrl._utils.loggerreplaced withtensordict.utils.logger.History.default_specstill returns a torchrlCompositespec; the torchrl import is gated behindimportlib.util.find_spec("torchrl")with an informativeImportErrorwhen torchrl is not installed.json/re/lazy_stackimports hoisted to module top.tensordict.llmimport paths; torchrl-specific integration prose condensed into a note.tensordict.llmresolves lazily from the top-level package (PEP 562__getattr__) soimport tensordictstays light.Tests
test/test_llm.pyportsTestHistoryfrom torchrltest/llm/test_data.py, withskipifguards on transformers/torchrl/pillow so the suite degrades gracefully in minimal environments (torchrl runs these in a dedicated LLM CI where those deps are guaranteed). The torchrl-modules-dependent test (_extract_responses_from_full_histories) stays in torchrl.Local run: 59 passed, 2 skipped (torchrl, pillow not installed), 11 xfailed (same as torchrl).
Docs
New reference page
docs/source/reference/llm.rstwired into the API reference toctree.🤖 Generated with Claude Code