Skip to content

[Distributed] Add all_gather collective - #1590

Merged
vmoens merged 4 commits into
gh/vmoens/73/basefrom
gh/vmoens/73/head
Feb 19, 2026
Merged

[Distributed] Add all_gather collective#1590
vmoens merged 4 commits into
gh/vmoens/73/basefrom
gh/vmoens/73/head

Conversation

@vmoens

@vmoens vmoens commented Feb 18, 2026 •
edited
Loading

Copy link
Copy Markdown
Collaborator

Stack from ghstack (oldest at bottom):

New TensorDictBase.all_gather() method that gathers tensordicts from
all ranks. Each rank consolidates its TD, metadata is gathered via
all_gather_object, storage via dist.all_gather (with padding to max
size). Returns a list of tensordicts, one per rank.

Co-authored-by: Cursor cursoragent@cursor.com

@vmoens
Update
2d6e1e7 
[ghstack-poisoned]
This was referenced Feb 18, 2026
Merged
Merged
Merged
Merged
Merged
Merged
@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Feb 18, 2026
@github-actions

github-actions Bot commented Feb 18, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 243. Improved: $\large\color{#35bf28}22$. Worsened: $\large\color{#d91a1a}13$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_plain_set_nested 47.1000μs 14.0448μs 71.2008 KOps/s 71.2544 KOps/s $\color{#d91a1a}-0.08\%$
test_plain_set_stack_nested 36.0010μs 14.3366μs 69.7516 KOps/s 68.2682 KOps/s $\color{#35bf28}+2.17\%$
test_plain_set_nested_inplace 45.3900μs 15.6424μs 63.9286 KOps/s 63.7471 KOps/s $\color{#35bf28}+0.28\%$
test_plain_set_stack_nested_inplace 48.3510μs 15.5317μs 64.3844 KOps/s 63.7123 KOps/s $\color{#35bf28}+1.05\%$
test_items 35.5600μs 5.4953μs 181.9752 KOps/s 182.6512 KOps/s $\color{#d91a1a}-0.37\%$
test_items_nested 0.4955ms 0.4377ms 2.2846 KOps/s 2.2939 KOps/s $\color{#d91a1a}-0.41\%$
test_items_nested_locked 0.5024ms 0.4452ms 2.2464 KOps/s 2.2696 KOps/s $\color{#d91a1a}-1.02\%$
test_items_nested_leaf 0.1330ms 91.5239μs 10.9261 KOps/s 10.9400 KOps/s $\color{#d91a1a}-0.13\%$
test_items_stack_nested 0.4859ms 0.4408ms 2.2688 KOps/s 2.2994 KOps/s $\color{#d91a1a}-1.33\%$
test_items_stack_nested_leaf 0.1297ms 91.0173μs 10.9869 KOps/s 10.9849 KOps/s $\color{#35bf28}+0.02\%$
test_items_stack_nested_locked 0.5065ms 0.4462ms 2.2413 KOps/s 2.2628 KOps/s $\color{#d91a1a}-0.95\%$
test_keys 28.1210μs 4.1105μs 243.2781 KOps/s 242.7640 KOps/s $\color{#35bf28}+0.21\%$
test_keys_nested 0.1883ms 0.1185ms 8.4380 KOps/s 8.5203 KOps/s $\color{#d91a1a}-0.97\%$
test_keys_nested_locked 0.7542ms 0.1269ms 7.8808 KOps/s 7.9280 KOps/s $\color{#d91a1a}-0.60\%$
test_keys_nested_leaf 0.1561ms 0.1084ms 9.2279 KOps/s 9.2840 KOps/s $\color{#d91a1a}-0.60\%$
test_keys_stack_nested 0.1890ms 0.1190ms 8.4008 KOps/s 8.5193 KOps/s $\color{#d91a1a}-1.39\%$
test_keys_stack_nested_leaf 0.1534ms 0.1093ms 9.1460 KOps/s 9.3025 KOps/s $\color{#d91a1a}-1.68\%$
test_keys_stack_nested_locked 0.2128ms 0.1261ms 7.9301 KOps/s 7.9463 KOps/s $\color{#d91a1a}-0.20\%$
test_values 6.4342μs 0.9931μs 1.0069 MOps/s 1.0133 MOps/s $\color{#d91a1a}-0.63\%$
test_values_nested 74.8910μs 46.4170μs 21.5438 KOps/s 21.5642 KOps/s $\color{#d91a1a}-0.09\%$
test_values_nested_locked 93.1620μs 49.4246μs 20.2329 KOps/s 20.0843 KOps/s $\color{#35bf28}+0.74\%$
test_values_nested_leaf 82.5820μs 52.7342μs 18.9630 KOps/s 18.9275 KOps/s $\color{#35bf28}+0.19\%$
test_values_stack_nested 83.7510μs 46.4711μs 21.5187 KOps/s 21.6918 KOps/s $\color{#d91a1a}-0.80\%$
test_values_stack_nested_leaf 80.9610μs 52.5677μs 19.0231 KOps/s 18.9669 KOps/s $\color{#35bf28}+0.30\%$
test_values_stack_nested_locked 91.6110μs 49.8896μs 20.0443 KOps/s 19.9201 KOps/s $\color{#35bf28}+0.62\%$
test_membership 5.6002μs 0.8045μs 1.2430 MOps/s 1.0661 MOps/s $\textbf{\color{#35bf28}+16.59\%}$
test_membership_nested 35.4000μs 2.7556μs 362.8984 KOps/s 365.8788 KOps/s $\color{#d91a1a}-0.81\%$
test_membership_nested_leaf 33.2010μs 2.7746μs 360.4148 KOps/s 374.9182 KOps/s $\color{#d91a1a}-3.87\%$
test_membership_stacked_nested 19.6210μs 2.7796μs 359.7596 KOps/s 361.6019 KOps/s $\color{#d91a1a}-0.51\%$
test_membership_stacked_nested_leaf 34.8510μs 2.7727μs 360.6606 KOps/s 363.3371 KOps/s $\color{#d91a1a}-0.74\%$
test_membership_nested_last 36.7200μs 4.1398μs 241.5581 KOps/s 243.8029 KOps/s $\color{#d91a1a}-0.92\%$
test_membership_nested_leaf_last 35.9600μs 4.1320μs 242.0113 KOps/s 242.3043 KOps/s $\color{#d91a1a}-0.12\%$
test_membership_stacked_nested_last 32.5600μs 4.1382μs 241.6510 KOps/s 243.6186 KOps/s $\color{#d91a1a}-0.81\%$
test_membership_stacked_nested_leaf_last 43.4610μs 4.1069μs 243.4936 KOps/s 242.0184 KOps/s $\color{#35bf28}+0.61\%$
test_nested_getleaf 51.0410μs 20.2825μs 49.3035 KOps/s 48.1484 KOps/s $\color{#35bf28}+2.40\%$
test_nested_get 53.4010μs 19.4268μs 51.4754 KOps/s 52.9046 KOps/s $\color{#d91a1a}-2.70\%$
test_stacked_getleaf 56.6910μs 20.1540μs 49.6180 KOps/s 48.5042 KOps/s $\color{#35bf28}+2.30\%$
test_stacked_get 57.5810μs 19.4983μs 51.2866 KOps/s 50.7564 KOps/s $\color{#35bf28}+1.04\%$
test_nested_getitemleaf 51.4510μs 20.9809μs 47.6623 KOps/s 47.8522 KOps/s $\color{#d91a1a}-0.40\%$
test_nested_getitem 51.7310μs 19.8142μs 50.4688 KOps/s 50.2499 KOps/s $\color{#35bf28}+0.44\%$
test_stacked_getitemleaf 65.3610μs 21.0189μs 47.5761 KOps/s 47.2008 KOps/s $\color{#35bf28}+0.80\%$
test_stacked_getitem 49.5410μs 20.0075μs 49.9814 KOps/s 49.5122 KOps/s $\color{#35bf28}+0.95\%$
test_lock_nested 8.3012ms 0.4567ms 2.1898 KOps/s 2.1880 KOps/s $\color{#35bf28}+0.09\%$
test_lock_stack_nested 0.5130ms 0.4544ms 2.2007 KOps/s 2.1745 KOps/s $\color{#35bf28}+1.21\%$
test_unlock_nested 0.4869ms 0.3642ms 2.7455 KOps/s 2.7322 KOps/s $\color{#35bf28}+0.49\%$
test_unlock_stack_nested 0.4316ms 0.3654ms 2.7364 KOps/s 2.7009 KOps/s $\color{#35bf28}+1.31\%$
test_flatten_speed 0.1653ms 0.1171ms 8.5424 KOps/s 8.5915 KOps/s $\color{#d91a1a}-0.57\%$
test_unflatten_speed 0.6121ms 0.5502ms 1.8174 KOps/s 1.8370 KOps/s $\color{#d91a1a}-1.07\%$
test_common_ops 0.8146ms 0.6942ms 1.4404 KOps/s 1.4706 KOps/s $\color{#d91a1a}-2.05\%$
test_creation 74.0710μs 2.7305μs 366.2366 KOps/s 368.0782 KOps/s $\color{#d91a1a}-0.50\%$
test_creation_empty 38.2710μs 5.7600μs 173.6123 KOps/s 173.8951 KOps/s $\color{#d91a1a}-0.16\%$
test_creation_nested_1 39.5210μs 9.9274μs 100.7311 KOps/s 100.6236 KOps/s $\color{#35bf28}+0.11\%$
test_creation_nested_2 36.0700μs 11.2897μs 88.5765 KOps/s 89.2491 KOps/s $\color{#d91a1a}-0.75\%$
test_creation_many_keys[10] 74.8910μs 16.8550μs 59.3294 KOps/s 59.1390 KOps/s $\color{#35bf28}+0.32\%$
test_creation_many_keys[50] 0.1109ms 72.4960μs 13.7939 KOps/s 14.1864 KOps/s $\color{#d91a1a}-2.77\%$
test_creation_many_keys[100] 0.1890ms 0.1415ms 7.0664 KOps/s 7.1290 KOps/s $\color{#d91a1a}-0.88\%$
test_creation_nested_many_keys[10] 63.6310μs 36.3841μs 27.4845 KOps/s 27.5429 KOps/s $\color{#d91a1a}-0.21\%$
test_creation_nested_many_keys[50] 0.1914ms 0.1489ms 6.7146 KOps/s 6.8360 KOps/s $\color{#d91a1a}-1.78\%$
test_clone 52.7200μs 12.9136μs 77.4379 KOps/s 75.3221 KOps/s $\color{#35bf28}+2.81\%$
test_getitem[int] 1.6200ms 14.6796μs 68.1218 KOps/s 57.7203 KOps/s $\textbf{\color{#35bf28}+18.02\%}$
test_getitem[slice_int] 0.1552ms 24.3238μs 41.1121 KOps/s 41.0999 KOps/s $\color{#35bf28}+0.03\%$
test_getitem[range] 0.1786ms 61.5023μs 16.2596 KOps/s 16.3906 KOps/s $\color{#d91a1a}-0.80\%$
test_getitem[tuple] 0.1383ms 23.4541μs 42.6365 KOps/s 43.6622 KOps/s $\color{#d91a1a}-2.35\%$
test_getitem[list] 0.1856ms 55.4212μs 18.0436 KOps/s 17.7057 KOps/s $\color{#35bf28}+1.91\%$
test_setitem_dim[int] 43.0600μs 25.0320μs 39.9489 KOps/s 39.4134 KOps/s $\color{#35bf28}+1.36\%$
test_setitem_dim[slice_int] 65.3310μs 41.8903μs 23.8719 KOps/s 23.8315 KOps/s $\color{#35bf28}+0.17\%$
test_setitem_dim[range] 0.1175ms 90.3559μs 11.0673 KOps/s 11.0582 KOps/s $\color{#35bf28}+0.08\%$
test_setitem_dim[tuple] 59.0000μs 39.0920μs 25.5807 KOps/s 25.2428 KOps/s $\color{#35bf28}+1.34\%$
test_setitem 55.6700μs 17.7868μs 56.2215 KOps/s 56.9791 KOps/s $\color{#d91a1a}-1.33\%$
test_set 49.7400μs 16.2729μs 61.4518 KOps/s 58.9011 KOps/s $\color{#35bf28}+4.33\%$
test_set_shared 0.5164ms 0.2049ms 4.8799 KOps/s 4.8717 KOps/s $\color{#35bf28}+0.17\%$
test_update 0.2367ms 20.7287μs 48.2423 KOps/s 46.5392 KOps/s $\color{#35bf28}+3.66\%$
test_update_nested 70.5810μs 32.6317μs 30.6450 KOps/s 29.6484 KOps/s $\color{#35bf28}+3.36\%$
test_update__nested 0.4837ms 33.4409μs 29.9035 KOps/s 29.2389 KOps/s $\color{#35bf28}+2.27\%$
test_set_nested 54.4310μs 18.1938μs 54.9638 KOps/s 53.4869 KOps/s $\color{#35bf28}+2.76\%$
test_set_nested_new 60.7410μs 24.3908μs 40.9990 KOps/s 39.4428 KOps/s $\color{#35bf28}+3.95\%$
test_select 80.9810μs 40.3689μs 24.7716 KOps/s 23.2465 KOps/s $\textbf{\color{#35bf28}+6.56\%}$
test_select_nested 0.1036ms 70.6205μs 14.1602 KOps/s 14.1250 KOps/s $\color{#35bf28}+0.25\%$
test_exclude_nested 0.1291ms 86.3541μs 11.5802 KOps/s 11.4481 KOps/s $\color{#35bf28}+1.15\%$
test_empty[True] 0.4258ms 0.3726ms 2.6841 KOps/s 2.6560 KOps/s $\color{#35bf28}+1.06\%$
test_empty[False] 8.2503μs 1.2550μs 796.8407 KOps/s 790.6614 KOps/s $\color{#35bf28}+0.78\%$
test_to 99.6220μs 68.9924μs 14.4944 KOps/s 14.0169 KOps/s $\color{#35bf28}+3.41\%$
test_to_nonblocking 0.1061ms 62.6610μs 15.9589 KOps/s 15.9586 KOps/s $+0.00\%$
test_unbind_speed 0.3532ms 0.3106ms 3.2199 KOps/s 3.2015 KOps/s $\color{#35bf28}+0.57\%$
test_unbind_speed_stack0 0.3719ms 0.3076ms 3.2512 KOps/s 3.2269 KOps/s $\color{#35bf28}+0.75\%$
test_unbind_speed_stack1 0.1034s 0.8854ms 1.1294 KOps/s 1.2184 KOps/s $\textbf{\color{#d91a1a}-7.31\%}$
test_split 1.1761ms 1.0988ms 910.0930 Ops/s 816.6989 Ops/s $\textbf{\color{#35bf28}+11.44\%}$
test_chunk 0.1030s 1.1639ms 859.1847 Ops/s 958.2915 Ops/s $\textbf{\color{#d91a1a}-10.34\%}$
test_to_cpu_blocking 28.4443ms 28.2892ms 35.3491 Ops/s 47.4810 Ops/s $\textbf{\color{#d91a1a}-25.55\%}$
test_to_cpu_global_sync 11.3130ms 10.9732ms 91.1308 Ops/s 91.6931 Ops/s $\color{#d91a1a}-0.61\%$
test_to_cpu_event_sync 12.1903ms 11.9401ms 83.7512 Ops/s 84.3946 Ops/s $\color{#d91a1a}-0.76\%$
test_to_cpu_default 0.1149s 13.1358ms 76.1280 Ops/s 84.1911 Ops/s $\textbf{\color{#d91a1a}-9.58\%}$
test_consolidate[False-None] 4.0996ms 3.9462ms 253.4073 Ops/s 227.4819 Ops/s $\textbf{\color{#35bf28}+11.40\%}$
test_consolidate[default-None] 2.1267ms 1.9124ms 522.8916 Ops/s 498.6824 Ops/s $\color{#35bf28}+4.85\%$
test_consolidate[reduce-overhead-None] 1.9411ms 1.8282ms 546.9968 Ops/s 520.3258 Ops/s $\textbf{\color{#35bf28}+5.13\%}$
test_consolidate_njt[False-None] 8.4768ms 8.1280ms 123.0322 Ops/s 122.1162 Ops/s $\color{#35bf28}+0.75\%$
test_to[False-False-None] 2.1315ms 2.0221ms 494.5437 Ops/s 498.2034 Ops/s $\color{#d91a1a}-0.73\%$
test_to[True-False-None] 2.1613ms 1.8748ms 533.3775 Ops/s 538.6613 Ops/s $\color{#d91a1a}-0.98\%$
test_to[within-False-None] 6.1651ms 5.8991ms 169.5186 Ops/s 168.4304 Ops/s $\color{#35bf28}+0.65\%$
test_to[True-default-None] 7.4467ms 7.3204ms 136.6040 Ops/s 129.5087 Ops/s $\textbf{\color{#35bf28}+5.48\%}$
test_to_njt[False-False-None] 8.5843ms 8.2699ms 120.9204 Ops/s 120.1724 Ops/s $\color{#35bf28}+0.62\%$
test_to_njt[True-False-None] 7.0618ms 6.6761ms 149.7884 Ops/s 145.9032 Ops/s $\color{#35bf28}+2.66\%$
test_to_njt[within-False-None] 14.8931ms 14.7854ms 67.6342 Ops/s 66.2595 Ops/s $\color{#35bf28}+2.07\%$
test_creation[device0] 0.4011ms 0.1145ms 8.7315 KOps/s 8.7430 KOps/s $\color{#d91a1a}-0.13\%$
test_creation_from_tensor 0.4771ms 0.1136ms 8.8047 KOps/s 8.9118 KOps/s $\color{#d91a1a}-1.20\%$
test_add_one[memmap_tensor0] 0.3841ms 6.1260μs 163.2385 KOps/s 158.4729 KOps/s $\color{#35bf28}+3.01\%$
test_contiguous[memmap_tensor0] 15.6510μs 0.6044μs 1.6545 MOps/s 2.3257 MOps/s $\textbf{\color{#d91a1a}-28.86\%}$
test_stack[memmap_tensor0] 35.3110μs 4.4146μs 226.5197 KOps/s 219.6543 KOps/s $\color{#35bf28}+3.13\%$
test_memmaptd_index 1.0328ms 0.2503ms 3.9951 KOps/s 3.9562 KOps/s $\color{#35bf28}+0.98\%$
test_memmaptd_index_astensor 0.5062ms 0.3414ms 2.9291 KOps/s 2.9287 KOps/s $\color{#35bf28}+0.01\%$
test_memmaptd_index_op 0.8802ms 0.5722ms 1.7476 KOps/s 1.7169 KOps/s $\color{#35bf28}+1.79\%$
test_serialize_model 0.1384s 0.1370s 7.2993 Ops/s 7.3479 Ops/s $\color{#d91a1a}-0.66\%$
test_serialize_model_pickle 1.3495s 1.1848s 0.8440 Ops/s 0.8390 Ops/s $\color{#35bf28}+0.59\%$
test_serialize_weights 0.1380s 0.1352s 7.3941 Ops/s 7.3591 Ops/s $\color{#35bf28}+0.48\%$
test_serialize_weights_returnearly 0.2956s 81.7445ms 12.2332 Ops/s 6.7549 Ops/s $\textbf{\color{#35bf28}+81.10\%}$
test_serialize_weights_pickle 1.3642s 1.2127s 0.8246 Ops/s 0.8240 Ops/s $\color{#35bf28}+0.07\%$
test_reshape_pytree 0.2176ms 31.6202μs 31.6253 KOps/s 30.0002 KOps/s $\textbf{\color{#35bf28}+5.42\%}$
test_reshape_td 71.1510μs 42.3891μs 23.5910 KOps/s 23.6610 KOps/s $\color{#d91a1a}-0.30\%$
test_view_pytree 0.2177ms 31.4313μs 31.8154 KOps/s 30.0185 KOps/s $\textbf{\color{#35bf28}+5.99\%}$
test_view_td 85.5610μs 50.2277μs 19.9093 KOps/s 19.3513 KOps/s $\color{#35bf28}+2.88\%$
test_unbind_pytree 0.2496ms 35.1122μs 28.4801 KOps/s 27.6686 KOps/s $\color{#35bf28}+2.93\%$
test_unbind_td 0.1146ms 46.3067μs 21.5951 KOps/s 21.2807 KOps/s $\color{#35bf28}+1.48\%$
test_split_pytree 0.2616ms 40.6463μs 24.6025 KOps/s 24.3546 KOps/s $\color{#35bf28}+1.02\%$
test_split_td 0.1899ms 62.7003μs 15.9489 KOps/s 15.6361 KOps/s $\color{#35bf28}+2.00\%$
test_add_pytree 0.2311ms 40.2708μs 24.8319 KOps/s 24.8123 KOps/s $\color{#35bf28}+0.08\%$
test_add_td 91.6120μs 50.6413μs 19.7467 KOps/s 18.4156 KOps/s $\textbf{\color{#35bf28}+7.23\%}$
test_compile_add_one_nested[tensordict-compile] 0.1881ms 0.1365ms 7.3277 KOps/s 6.9293 KOps/s $\textbf{\color{#35bf28}+5.75\%}$
test_compile_add_one_nested[tensordict-eager] 0.3460ms 0.1853ms 5.3956 KOps/s 5.4675 KOps/s $\color{#d91a1a}-1.32\%$
test_compile_add_one_nested[pytree-compile] 0.1698ms 0.1050ms 9.5224 KOps/s 9.2904 KOps/s $\color{#35bf28}+2.50\%$
test_compile_add_one_nested[pytree-eager] 0.4215ms 0.1714ms 5.8355 KOps/s 5.7598 KOps/s $\color{#35bf28}+1.31\%$
test_compile_copy_nested[tensordict-compile] 81.2920μs 29.9124μs 33.4309 KOps/s 29.3801 KOps/s $\textbf{\color{#35bf28}+13.79\%}$
test_compile_copy_nested[tensordict-eager] 93.4220μs 49.0511μs 20.3869 KOps/s 19.8727 KOps/s $\color{#35bf28}+2.59\%$
test_compile_copy_nested[pytree-compile] 0.1403ms 9.4943μs 105.3263 KOps/s 105.3462 KOps/s $\color{#d91a1a}-0.02\%$
test_compile_copy_nested[pytree-eager] 0.4474ms 64.1814μs 15.5808 KOps/s 15.3331 KOps/s $\color{#35bf28}+1.62\%$
test_compile_add_one_flat[tensordict-compile] 0.2186ms 0.1729ms 5.7846 KOps/s 5.5485 KOps/s $\color{#35bf28}+4.25\%$
test_compile_add_one_flat[tensordict-eager] 0.3197ms 0.2459ms 4.0669 KOps/s 4.0274 KOps/s $\color{#35bf28}+0.98\%$
test_compile_add_one_flat[tensorclass-compile] 0.1990ms 0.1140ms 8.7718 KOps/s 8.6017 KOps/s $\color{#35bf28}+1.98\%$
test_compile_add_one_flat[tensorclass-eager] 0.1119ms 67.6937μs 14.7724 KOps/s 14.9457 KOps/s $\color{#d91a1a}-1.16\%$
test_compile_add_one_flat[pytree-compile] 0.1904ms 0.1548ms 6.4586 KOps/s 6.3425 KOps/s $\color{#35bf28}+1.83\%$
test_compile_add_one_flat[pytree-eager] 0.7874ms 0.5091ms 1.9644 KOps/s 1.9360 KOps/s $\color{#35bf28}+1.47\%$
test_compile_add_self_flat[tensordict-eager] 0.3635ms 0.2989ms 3.3451 KOps/s 3.3178 KOps/s $\color{#35bf28}+0.82\%$
test_compile_add_self_flat[tensordict-compile] 0.2183ms 0.1751ms 5.7100 KOps/s 3.4017 KOps/s $\textbf{\color{#35bf28}+67.86\%}$
test_compile_add_self_flat[tensorclass-eager] 0.1240ms 82.4704μs 12.1256 KOps/s 12.0395 KOps/s $\color{#35bf28}+0.71\%$
test_compile_add_self_flat[tensorclass-compile] 0.1875ms 0.1218ms 8.2106 KOps/s 8.1619 KOps/s $\color{#35bf28}+0.60\%$
test_compile_add_self_flat[pytree-eager] 0.6363ms 0.4205ms 2.3779 KOps/s 2.3198 KOps/s $\color{#35bf28}+2.51\%$
test_compile_add_self_flat[pytree-compile] 0.2148ms 0.1553ms 6.4393 KOps/s 6.2488 KOps/s $\color{#35bf28}+3.05\%$
test_compile_copy_flat[tensordict-compile] 0.1126ms 23.6299μs 42.3193 KOps/s 39.6408 KOps/s $\textbf{\color{#35bf28}+6.76\%}$
test_compile_copy_flat[tensordict-eager] 70.4910μs 39.5396μs 25.2911 KOps/s 25.1709 KOps/s $\color{#35bf28}+0.48\%$
test_compile_copy_flat[pytree-compile] 82.2410μs 10.4140μs 96.0249 KOps/s 96.3397 KOps/s $\color{#d91a1a}-0.33\%$
test_compile_copy_flat[pytree-eager] 0.4086ms 50.8627μs 19.6608 KOps/s 19.7672 KOps/s $\color{#d91a1a}-0.54\%$
test_compile_assign_and_add[tensordict-compile] 1.9328ms 0.1699ms 5.8864 KOps/s 5.4825 KOps/s $\textbf{\color{#35bf28}+7.37\%}$
test_compile_assign_and_add[tensordict-eager] 3.4374ms 3.2034ms 312.1723 Ops/s 309.4265 Ops/s $\color{#35bf28}+0.89\%$
test_compile_assign_and_add[pytree-compile] 1.9084ms 0.1581ms 6.3242 KOps/s 6.3280 KOps/s $\color{#d91a1a}-0.06\%$
test_compile_assign_and_add[pytree-eager] 2.8659ms 2.6952ms 371.0339 Ops/s 365.0698 Ops/s $\color{#35bf28}+1.63\%$
test_compile_indexing[tensor-tensordict-compile] 0.1690ms 0.1066ms 9.3821 KOps/s 9.1017 KOps/s $\color{#35bf28}+3.08\%$
test_compile_indexing[tensor-tensordict-eager] 0.3083ms 69.7760μs 14.3316 KOps/s 14.1792 KOps/s $\color{#35bf28}+1.08\%$
test_compile_indexing[tensor-tensorclass-compile] 0.2665ms 93.6350μs 10.6798 KOps/s 10.5689 KOps/s $\color{#35bf28}+1.05\%$
test_compile_indexing[tensor-tensorclass-eager] 0.2531ms 43.1440μs 23.1782 KOps/s 21.5262 KOps/s $\textbf{\color{#35bf28}+7.67\%}$
test_compile_indexing[tensor-pytree-compile] 0.1413ms 93.9809μs 10.6405 KOps/s 10.6300 KOps/s $\color{#35bf28}+0.10\%$
test_compile_indexing[tensor-pytree-eager] 0.2365ms 44.7969μs 22.3230 KOps/s 22.8629 KOps/s $\color{#d91a1a}-2.36\%$
test_compile_indexing[slice-tensordict-compile] 0.1519ms 54.2068μs 18.4479 KOps/s 17.5283 KOps/s $\textbf{\color{#35bf28}+5.25\%}$
test_compile_indexing[slice-tensordict-eager] 0.2262ms 26.5618μs 37.6480 KOps/s 37.9121 KOps/s $\color{#d91a1a}-0.70\%$
test_compile_indexing[slice-tensorclass-compile] 0.1216ms 43.8401μs 22.8101 KOps/s 22.2744 KOps/s $\color{#35bf28}+2.41\%$
test_compile_indexing[slice-tensorclass-eager] 0.2531ms 21.3513μs 46.8356 KOps/s 45.8181 KOps/s $\color{#35bf28}+2.22\%$
test_compile_indexing[slice-pytree-compile] 82.2210μs 44.1506μs 22.6497 KOps/s 22.1537 KOps/s $\color{#35bf28}+2.24\%$
test_compile_indexing[slice-pytree-eager] 0.2650ms 21.5291μs 46.4487 KOps/s 45.8842 KOps/s $\color{#35bf28}+1.23\%$
test_compile_indexing[int-tensordict-compile] 0.1002ms 57.4435μs 17.4084 KOps/s 17.3529 KOps/s $\color{#35bf28}+0.32\%$
test_compile_indexing[int-tensordict-eager] 0.2021s 32.7110μs 30.5708 KOps/s 37.9354 KOps/s $\textbf{\color{#d91a1a}-19.41\%}$
test_compile_indexing[int-tensorclass-compile] 86.3810μs 44.8047μs 22.3191 KOps/s 22.0566 KOps/s $\color{#35bf28}+1.19\%$
test_compile_indexing[int-tensorclass-eager] 0.2084ms 21.2110μs 47.1453 KOps/s 46.1798 KOps/s $\color{#35bf28}+2.09\%$
test_compile_indexing[int-pytree-compile] 89.1510μs 44.7945μs 22.3242 KOps/s 21.9153 KOps/s $\color{#35bf28}+1.87\%$
test_compile_indexing[int-pytree-eager] 0.3023ms 21.3955μs 46.7389 KOps/s 46.4137 KOps/s $\color{#35bf28}+0.70\%$
test_mod_add[eager] 93.6310μs 47.6537μs 20.9847 KOps/s 20.6720 KOps/s $\color{#35bf28}+1.51\%$
test_mod_add[compile] 0.5260ms 0.1013ms 9.8675 KOps/s 9.6908 KOps/s $\color{#35bf28}+1.82\%$
test_mod_add[compile-overhead] 0.4149ms 0.1452ms 6.8889 KOps/s 6.8174 KOps/s $\color{#35bf28}+1.05\%$
test_mod_wrap[eager] 0.3633ms 0.2819ms 3.5475 KOps/s 3.5148 KOps/s $\color{#35bf28}+0.93\%$
test_mod_wrap[compile] 0.4351ms 0.3373ms 2.9644 KOps/s 2.7729 KOps/s $\textbf{\color{#35bf28}+6.90\%}$
test_mod_wrap[compile-overhead] 7.3854ms 4.0230ms 248.5700 Ops/s 247.6957 Ops/s $\color{#35bf28}+0.35\%$
test_mod_wrap_and_backward[eager] 1.9746ms 1.5445ms 647.4751 Ops/s 675.4309 Ops/s $\color{#d91a1a}-4.14\%$
test_mod_wrap_and_backward[compile] 1.7855ms 1.5084ms 662.9552 Ops/s 702.9313 Ops/s $\textbf{\color{#d91a1a}-5.69\%}$
test_mod_wrap_and_backward[compile-overhead] 1.7995ms 0.9622ms 1.0393 KOps/s 1.1417 KOps/s $\textbf{\color{#d91a1a}-8.97\%}$
test_seq_add[eager] 0.1971ms 0.1496ms 6.6851 KOps/s 6.5914 KOps/s $\color{#35bf28}+1.42\%$
test_seq_add[compile] 0.5550ms 0.1151ms 8.6862 KOps/s 8.6063 KOps/s $\color{#35bf28}+0.93\%$
test_seq_add[compile-overhead] 0.4295ms 0.1498ms 6.6741 KOps/s 6.5087 KOps/s $\color{#35bf28}+2.54\%$
test_seq_wrap[eager] 0.7673ms 0.5174ms 1.9328 KOps/s 1.9655 KOps/s $\color{#d91a1a}-1.66\%$
test_seq_wrap[compile] 0.4093ms 0.3561ms 2.8083 KOps/s 2.7667 KOps/s $\color{#35bf28}+1.50\%$
test_seq_wrap[compile-overhead] 0.3189ms 0.2569ms 3.8925 KOps/s 3.8594 KOps/s $\color{#35bf28}+0.86\%$
test_func_call_runtime[False-eager] 0.8867ms 0.8063ms 1.2402 KOps/s 1.1527 KOps/s $\textbf{\color{#35bf28}+7.59\%}$
test_func_call_runtime[False-compile] 0.9271ms 0.8770ms 1.1402 KOps/s 1.1284 KOps/s $\color{#35bf28}+1.05\%$
test_func_call_runtime[False-compile-overhead] 0.5659ms 0.4397ms 2.2745 KOps/s 2.2549 KOps/s $\color{#35bf28}+0.87\%$
test_func_call_runtime[True-eager] 1.1334ms 1.0388ms 962.6122 Ops/s 939.1354 Ops/s $\color{#35bf28}+2.50\%$
test_func_call_runtime[True-compile] 0.9553ms 0.8828ms 1.1328 KOps/s 1.1138 KOps/s $\color{#35bf28}+1.70\%$
test_func_call_runtime[True-compile-overhead] 0.5037ms 0.4506ms 2.2191 KOps/s 2.1669 KOps/s $\color{#35bf28}+2.41\%$
test_func_call_cm_runtime[False-eager] 0.8967ms 0.8099ms 1.2347 KOps/s 1.2149 KOps/s $\color{#35bf28}+1.63\%$
test_func_call_cm_runtime[False-compile] 0.9725ms 0.8802ms 1.1361 KOps/s 1.1202 KOps/s $\color{#35bf28}+1.41\%$
test_func_call_cm_runtime[False-compile-overhead] 0.4838ms 0.4416ms 2.2647 KOps/s 2.2409 KOps/s $\color{#35bf28}+1.06\%$
test_func_call_cm_runtime[True-eager] 1.2984ms 1.1817ms 846.2102 Ops/s 823.6662 Ops/s $\color{#35bf28}+2.74\%$
test_func_call_cm_runtime[True-compile] 0.9896ms 0.9175ms 1.0899 KOps/s 1.0730 KOps/s $\color{#35bf28}+1.57\%$
test_func_call_cm_runtime[True-compile-overhead] 0.5620ms 0.4833ms 2.0690 KOps/s 2.0234 KOps/s $\color{#35bf28}+2.25\%$
test_vmap_func_call_cm_runtime[eager] 2.7622ms 2.2891ms 436.8613 Ops/s 430.0997 Ops/s $\color{#35bf28}+1.57\%$
test_vmap_func_call_cm_runtime[compile] 1.0118ms 0.9375ms 1.0667 KOps/s 1.0479 KOps/s $\color{#35bf28}+1.79\%$
test_vmap_func_call_cm_runtime[compile-overhead] 0.5779ms 0.4881ms 2.0489 KOps/s 2.0048 KOps/s $\color{#35bf28}+2.20\%$
test_distributed 2.7532ms 0.1703ms 5.8703 KOps/s 6.3920 KOps/s $\textbf{\color{#d91a1a}-8.16\%}$
test_tdmodule 0.2588ms 27.2931μs 36.6394 KOps/s 36.2377 KOps/s $\color{#35bf28}+1.11\%$
test_tdmodule_dispatch 74.7010μs 44.3140μs 22.5662 KOps/s 22.4719 KOps/s $\color{#35bf28}+0.42\%$
test_tdseq 45.7600μs 26.4088μs 37.8662 KOps/s 38.2078 KOps/s $\color{#d91a1a}-0.89\%$
test_tdseq_dispatch 65.3910μs 46.2197μs 21.6358 KOps/s 21.5415 KOps/s $\color{#35bf28}+0.44\%$
test_instantiation_functorch 2.0502ms 1.9647ms 508.9931 Ops/s 506.1707 Ops/s $\color{#35bf28}+0.56\%$
test_exec_functorch 0.2770ms 0.1717ms 5.8246 KOps/s 5.6853 KOps/s $\color{#35bf28}+2.45\%$
test_exec_functional_call 0.2153ms 0.1561ms 6.4055 KOps/s 6.2932 KOps/s $\color{#35bf28}+1.78\%$
test_exec_td_decorator 0.4343ms 0.2250ms 4.4437 KOps/s 4.3370 KOps/s $\color{#35bf28}+2.46\%$
test_vmap_mlp_speed_decorator[True-True] 0.9628ms 0.7921ms 1.2625 KOps/s 1.2391 KOps/s $\color{#35bf28}+1.89\%$
test_vmap_mlp_speed_decorator[True-False] 0.9790ms 0.7925ms 1.2618 KOps/s 1.2165 KOps/s $\color{#35bf28}+3.72\%$
test_vmap_mlp_speed_decorator[False-True] 0.8579ms 0.6880ms 1.4535 KOps/s 1.4314 KOps/s $\color{#35bf28}+1.54\%$
test_vmap_mlp_speed_decorator[False-False] 0.8525ms 0.6877ms 1.4542 KOps/s 1.4330 KOps/s $\color{#35bf28}+1.48\%$
test_vmap_transformer_speed_decorator[True-True] 20.0643ms 19.9354ms 50.1619 Ops/s 49.6563 Ops/s $\color{#35bf28}+1.02\%$
test_vmap_transformer_speed_decorator[True-False] 20.5306ms 19.9619ms 50.0956 Ops/s 49.7314 Ops/s $\color{#35bf28}+0.73\%$
test_vmap_transformer_speed_decorator[False-True] 20.3847ms 19.7560ms 50.6175 Ops/s 50.0915 Ops/s $\color{#35bf28}+1.05\%$
test_vmap_transformer_speed_decorator[False-False] 20.3260ms 19.7581ms 50.6122 Ops/s 50.1979 Ops/s $\color{#35bf28}+0.83\%$
test_to_module_speed[True] 2.0324ms 1.4118ms 708.3373 Ops/s 709.0684 Ops/s $\color{#d91a1a}-0.10\%$
test_to_module_speed[False] 1.9113ms 1.3907ms 719.0463 Ops/s 716.8013 Ops/s $\color{#35bf28}+0.31\%$
test_tc_init 77.3510μs 43.8094μs 22.8261 KOps/s 22.7760 KOps/s $\color{#35bf28}+0.22\%$
test_tc_init_tensor_only 47.6800μs 9.4236μs 106.1161 KOps/s 106.2918 KOps/s $\color{#d91a1a}-0.17\%$
test_tc_init_nested 0.1303ms 88.1607μs 11.3429 KOps/s 11.4670 KOps/s $\color{#d91a1a}-1.08\%$
test_tc_init_many_fields 44.3510μs 15.3470μs 65.1594 KOps/s 62.7559 KOps/s $\color{#35bf28}+3.83\%$
test_tc_first_layer_tensor 22.4900μs 1.7081μs 585.4368 KOps/s 541.6441 KOps/s $\textbf{\color{#35bf28}+8.09\%}$
test_tc_first_layer_tensor_only 6.6644μs 0.7097μs 1.4090 MOps/s 1.3892 MOps/s $\color{#35bf28}+1.42\%$
test_tc_first_layer_tensor_set 32.3600μs 3.6865μs 271.2586 KOps/s 266.9883 KOps/s $\color{#35bf28}+1.60\%$
test_tc_first_layer_tensor_only_set 13.2900μs 3.0597μs 326.8259 KOps/s 331.9930 KOps/s $\color{#d91a1a}-1.56\%$
test_tc_first_layer_nontensor 38.0800μs 5.7505μs 173.8975 KOps/s 170.7826 KOps/s $\color{#35bf28}+1.82\%$
test_tc_second_layer_tensor 32.0000μs 4.1616μs 240.2938 KOps/s 237.8155 KOps/s $\color{#35bf28}+1.04\%$
test_tc_second_layer_nontensor 76.3510μs 8.1963μs 122.0064 KOps/s 120.0740 KOps/s $\color{#35bf28}+1.61\%$
test_unbind 0.2640s 15.6146ms 64.0427 Ops/s 69.6287 Ops/s $\textbf{\color{#d91a1a}-8.02\%}$
test_full_like 4.4772ms 4.3571ms 229.5085 Ops/s 228.2121 Ops/s $\color{#35bf28}+0.57\%$
test_zeros_like 17.1576ms 16.6932ms 59.9046 Ops/s 229.4137 Ops/s $\textbf{\color{#d91a1a}-73.89\%}$
test_ones_like 16.8538ms 16.7028ms 59.8702 Ops/s 228.9781 Ops/s $\textbf{\color{#d91a1a}-73.85\%}$
test_clone 18.4487ms 17.6447ms 56.6744 Ops/s 156.0328 Ops/s $\textbf{\color{#d91a1a}-63.68\%}$
test_squeeze 0.1196ms 13.5347μs 73.8840 KOps/s 69.4447 KOps/s $\textbf{\color{#35bf28}+6.39\%}$
test_unsqueeze 0.1644ms 0.1069ms 9.3574 KOps/s 9.2732 KOps/s $\color{#35bf28}+0.91\%$
test_split 0.3530ms 0.1750ms 5.7150 KOps/s 5.4876 KOps/s $\color{#35bf28}+4.14\%$
test_permute 0.2899ms 0.2028ms 4.9311 KOps/s 4.9941 KOps/s $\color{#d91a1a}-1.26\%$
test_stack 51.3946ms 51.1656ms 19.5444 Ops/s 19.6213 Ops/s $\color{#d91a1a}-0.39\%$
test_cat 51.5961ms 51.2052ms 19.5293 Ops/s 19.6261 Ops/s $\color{#d91a1a}-0.49\%$

@github-actions

github-actions Bot commented Feb 18, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 243. Improved: $\large\color{#35bf28}12$. Worsened: $\large\color{#d91a1a}7$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_plain_set_nested 29.4110μs 14.8307μs 67.4278 KOps/s 68.0878 KOps/s $\color{#d91a1a}-0.97\%$
test_plain_set_stack_nested 0.4182ms 15.1423μs 66.0401 KOps/s 67.2591 KOps/s $\color{#d91a1a}-1.81\%$
test_plain_set_nested_inplace 44.2000μs 16.6244μs 60.1524 KOps/s 60.0990 KOps/s $\color{#35bf28}+0.09\%$
test_plain_set_stack_nested_inplace 0.4321ms 16.4569μs 60.7648 KOps/s 60.7172 KOps/s $\color{#35bf28}+0.08\%$
test_items 31.3010μs 6.3398μs 157.7339 KOps/s 174.4583 KOps/s $\textbf{\color{#d91a1a}-9.59\%}$
test_items_nested 0.8658ms 0.4562ms 2.1918 KOps/s 2.1775 KOps/s $\color{#35bf28}+0.66\%$
test_items_nested_locked 0.8782ms 0.4581ms 2.1829 KOps/s 2.1628 KOps/s $\color{#35bf28}+0.93\%$
test_items_nested_leaf 0.5126ms 96.8991μs 10.3200 KOps/s 10.3026 KOps/s $\color{#35bf28}+0.17\%$
test_items_stack_nested 0.8736ms 0.4587ms 2.1799 KOps/s 2.1606 KOps/s $\color{#35bf28}+0.89\%$
test_items_stack_nested_leaf 0.1423ms 96.8989μs 10.3200 KOps/s 10.3806 KOps/s $\color{#d91a1a}-0.58\%$
test_items_stack_nested_locked 0.8874ms 0.4633ms 2.1584 KOps/s 2.1570 KOps/s $\color{#35bf28}+0.07\%$
test_keys 24.4510μs 4.4567μs 224.3836 KOps/s 237.4777 KOps/s $\textbf{\color{#d91a1a}-5.51\%}$
test_keys_nested 0.5377ms 0.1207ms 8.2870 KOps/s 8.3034 KOps/s $\color{#d91a1a}-0.20\%$
test_keys_nested_locked 0.7430ms 0.1301ms 7.6850 KOps/s 7.7414 KOps/s $\color{#d91a1a}-0.73\%$
test_keys_nested_leaf 0.5273ms 0.1113ms 8.9885 KOps/s 9.0405 KOps/s $\color{#d91a1a}-0.58\%$
test_keys_stack_nested 0.5430ms 0.1209ms 8.2710 KOps/s 8.2968 KOps/s $\color{#d91a1a}-0.31\%$
test_keys_stack_nested_leaf 0.5325ms 0.1107ms 9.0327 KOps/s 8.9693 KOps/s $\color{#35bf28}+0.71\%$
test_keys_stack_nested_locked 0.5382ms 0.1292ms 7.7392 KOps/s 7.7122 KOps/s $\color{#35bf28}+0.35\%$
test_values 83.9214μs 1.0193μs 981.0716 KOps/s 970.6077 KOps/s $\color{#35bf28}+1.08\%$
test_values_nested 79.5520μs 48.4277μs 20.6493 KOps/s 20.9493 KOps/s $\color{#d91a1a}-1.43\%$
test_values_nested_locked 0.4664ms 51.0593μs 19.5851 KOps/s 19.6064 KOps/s $\color{#d91a1a}-0.11\%$
test_values_nested_leaf 87.3410μs 54.3754μs 18.3907 KOps/s 18.3820 KOps/s $\color{#35bf28}+0.05\%$
test_values_stack_nested 0.4659ms 48.2029μs 20.7456 KOps/s 20.9109 KOps/s $\color{#d91a1a}-0.79\%$
test_values_stack_nested_leaf 0.4672ms 54.3349μs 18.4044 KOps/s 18.4710 KOps/s $\color{#d91a1a}-0.36\%$
test_values_stack_nested_locked 0.4713ms 51.0230μs 19.5990 KOps/s 19.5729 KOps/s $\color{#35bf28}+0.13\%$
test_membership 70.7210μs 0.8517μs 1.1741 MOps/s 1.1508 MOps/s $\color{#35bf28}+2.03\%$
test_membership_nested 31.1500μs 2.9193μs 342.5451 KOps/s 354.2679 KOps/s $\color{#d91a1a}-3.31\%$
test_membership_nested_leaf 0.4236ms 2.9280μs 341.5347 KOps/s 342.9485 KOps/s $\color{#d91a1a}-0.41\%$
test_membership_stacked_nested 47.6310μs 2.9077μs 343.9187 KOps/s 341.8926 KOps/s $\color{#35bf28}+0.59\%$
test_membership_stacked_nested_leaf 0.4210ms 2.9300μs 341.2919 KOps/s 344.5326 KOps/s $\color{#d91a1a}-0.94\%$
test_membership_nested_last 27.0600μs 4.3791μs 228.3574 KOps/s 230.1969 KOps/s $\color{#d91a1a}-0.80\%$
test_membership_nested_leaf_last 32.9800μs 4.3769μs 228.4722 KOps/s 230.9846 KOps/s $\color{#d91a1a}-1.09\%$
test_membership_stacked_nested_last 0.4242ms 4.4004μs 227.2531 KOps/s 231.3049 KOps/s $\color{#d91a1a}-1.75\%$
test_membership_stacked_nested_leaf_last 41.1910μs 4.3900μs 227.7929 KOps/s 229.2246 KOps/s $\color{#d91a1a}-0.62\%$
test_nested_getleaf 0.4377ms 21.1232μs 47.3412 KOps/s 46.5941 KOps/s $\color{#35bf28}+1.60\%$
test_nested_get 0.4312ms 20.5601μs 48.6378 KOps/s 49.2147 KOps/s $\color{#d91a1a}-1.17\%$
test_stacked_getleaf 57.0510μs 21.4283μs 46.6672 KOps/s 46.9122 KOps/s $\color{#d91a1a}-0.52\%$
test_stacked_get 92.9610μs 20.5055μs 48.7673 KOps/s 50.1707 KOps/s $\color{#d91a1a}-2.80\%$
test_nested_getitemleaf 0.4385ms 22.3650μs 44.7126 KOps/s 45.6691 KOps/s $\color{#d91a1a}-2.09\%$
test_nested_getitem 0.4339ms 21.0148μs 47.5856 KOps/s 48.9378 KOps/s $\color{#d91a1a}-2.76\%$
test_stacked_getitemleaf 0.4400ms 22.2484μs 44.9470 KOps/s 45.5593 KOps/s $\color{#d91a1a}-1.34\%$
test_stacked_getitem 50.7510μs 21.0846μs 47.4280 KOps/s 48.3539 KOps/s $\color{#d91a1a}-1.91\%$
test_lock_nested 7.9007ms 0.4839ms 2.0663 KOps/s 2.0841 KOps/s $\color{#d91a1a}-0.85\%$
test_lock_stack_nested 0.5439ms 0.4834ms 2.0685 KOps/s 2.0620 KOps/s $\color{#35bf28}+0.31\%$
test_unlock_nested 0.4815ms 0.3862ms 2.5896 KOps/s 2.5928 KOps/s $\color{#d91a1a}-0.13\%$
test_unlock_stack_nested 0.5261ms 0.3885ms 2.5741 KOps/s 2.5568 KOps/s $\color{#35bf28}+0.68\%$
test_flatten_speed 0.2826ms 0.1215ms 8.2331 KOps/s 8.2059 KOps/s $\color{#35bf28}+0.33\%$
test_unflatten_speed 0.7101ms 0.5681ms 1.7602 KOps/s 1.7279 KOps/s $\color{#35bf28}+1.87\%$
test_common_ops 0.9007ms 0.6884ms 1.4526 KOps/s 1.4466 KOps/s $\color{#35bf28}+0.42\%$
test_creation 75.5510μs 2.9323μs 341.0248 KOps/s 338.7085 KOps/s $\color{#35bf28}+0.68\%$
test_creation_empty 0.4237ms 6.2220μs 160.7195 KOps/s 161.9929 KOps/s $\color{#d91a1a}-0.79\%$
test_creation_nested_1 36.0510μs 10.5276μs 94.9880 KOps/s 94.3416 KOps/s $\color{#35bf28}+0.69\%$
test_creation_nested_2 0.4223ms 11.8601μs 84.3164 KOps/s 83.4672 KOps/s $\color{#35bf28}+1.02\%$
test_creation_many_keys[10] 40.3800μs 18.1585μs 55.0708 KOps/s 54.4096 KOps/s $\color{#35bf28}+1.22\%$
test_creation_many_keys[50] 0.4852ms 78.1064μs 12.8031 KOps/s 12.7023 KOps/s $\color{#35bf28}+0.79\%$
test_creation_many_keys[100] 0.5626ms 0.1528ms 6.5459 KOps/s 6.4841 KOps/s $\color{#35bf28}+0.95\%$
test_creation_nested_many_keys[10] 0.4501ms 39.2351μs 25.4874 KOps/s 25.4765 KOps/s $\color{#35bf28}+0.04\%$
test_creation_nested_many_keys[50] 0.5669ms 0.1596ms 6.2656 KOps/s 6.2448 KOps/s $\color{#35bf28}+0.33\%$
test_clone 37.5900μs 13.5470μs 73.8171 KOps/s 73.9404 KOps/s $\color{#d91a1a}-0.17\%$
test_getitem[int] 1.7235ms 14.6634μs 68.1972 KOps/s 55.2856 KOps/s $\textbf{\color{#35bf28}+23.35\%}$
test_getitem[slice_int] 0.4374ms 24.5273μs 40.7710 KOps/s 40.4795 KOps/s $\color{#35bf28}+0.72\%$
test_getitem[range] 0.1735ms 62.5801μs 15.9795 KOps/s 15.8433 KOps/s $\color{#35bf28}+0.86\%$
test_getitem[tuple] 0.1468ms 23.7031μs 42.1886 KOps/s 41.4427 KOps/s $\color{#35bf28}+1.80\%$
test_getitem[list] 0.2095ms 57.8789μs 17.2774 KOps/s 17.0265 KOps/s $\color{#35bf28}+1.47\%$
test_setitem_dim[int] 46.8910μs 26.4972μs 37.7399 KOps/s 37.9210 KOps/s $\color{#d91a1a}-0.48\%$
test_setitem_dim[slice_int] 76.3510μs 44.3741μs 22.5357 KOps/s 22.7686 KOps/s $\color{#d91a1a}-1.02\%$
test_setitem_dim[range] 0.1189ms 95.1996μs 10.5043 KOps/s 10.4975 KOps/s $\color{#35bf28}+0.06\%$
test_setitem_dim[tuple] 81.1220μs 40.8830μs 24.4601 KOps/s 24.1655 KOps/s $\color{#35bf28}+1.22\%$
test_setitem 52.8700μs 17.7955μs 56.1941 KOps/s 55.5578 KOps/s $\color{#35bf28}+1.15\%$
test_set 46.1010μs 17.1670μs 58.2513 KOps/s 58.2500 KOps/s $+0.00\%$
test_set_shared 0.5155ms 0.2065ms 4.8434 KOps/s 4.7129 KOps/s $\color{#35bf28}+2.77\%$
test_update 0.3544ms 21.6672μs 46.1526 KOps/s 46.3155 KOps/s $\color{#d91a1a}-0.35\%$
test_update_nested 70.9720μs 33.9083μs 29.4913 KOps/s 29.8242 KOps/s $\color{#d91a1a}-1.12\%$
test_update__nested 0.5322ms 34.6035μs 28.8989 KOps/s 27.4029 KOps/s $\textbf{\color{#35bf28}+5.46\%}$
test_set_nested 57.1210μs 19.0624μs 52.4593 KOps/s 52.5591 KOps/s $\color{#d91a1a}-0.19\%$
test_set_nested_new 57.7510μs 23.5440μs 42.4737 KOps/s 40.8910 KOps/s $\color{#35bf28}+3.87\%$
test_select 89.0210μs 43.8138μs 22.8239 KOps/s 23.4236 KOps/s $\color{#d91a1a}-2.56\%$
test_select_nested 0.1268ms 74.0432μs 13.5056 KOps/s 13.3717 KOps/s $\color{#35bf28}+1.00\%$
test_exclude_nested 0.1372ms 92.5508μs 10.8049 KOps/s 10.8171 KOps/s $\color{#d91a1a}-0.11\%$
test_empty[True] 0.7686ms 0.3913ms 2.5555 KOps/s 2.5466 KOps/s $\color{#35bf28}+0.35\%$
test_empty[False] 8.5253μs 1.3316μs 750.9558 KOps/s 757.3927 KOps/s $\color{#d91a1a}-0.85\%$
test_to 0.1048ms 75.0975μs 13.3160 KOps/s 13.9185 KOps/s $\color{#d91a1a}-4.33\%$
test_to_nonblocking 0.1051ms 65.1594μs 15.3470 KOps/s 15.2090 KOps/s $\color{#35bf28}+0.91\%$
test_unbind_speed 0.4417ms 0.3272ms 3.0558 KOps/s 3.0207 KOps/s $\color{#35bf28}+1.16\%$
test_unbind_speed_stack0 0.4470ms 0.3284ms 3.0454 KOps/s 3.0314 KOps/s $\color{#35bf28}+0.46\%$
test_unbind_speed_stack1 0.1025s 0.8384ms 1.1928 KOps/s 1.1818 KOps/s $\color{#35bf28}+0.93\%$
test_split 0.1026s 1.2785ms 782.1687 Ops/s 773.0712 Ops/s $\color{#35bf28}+1.18\%$
test_chunk 0.1029s 1.2238ms 817.1407 Ops/s 910.3318 Ops/s $\textbf{\color{#d91a1a}-10.24\%}$
test_to_cpu_blocking 19.3013ms 19.1928ms 52.1030 Ops/s 51.6145 Ops/s $\color{#35bf28}+0.95\%$
test_to_cpu_global_sync 11.2349ms 11.1588ms 89.6153 Ops/s 89.8350 Ops/s $\color{#d91a1a}-0.24\%$
test_to_cpu_event_sync 12.4145ms 12.1439ms 82.3457 Ops/s 82.6273 Ops/s $\color{#d91a1a}-0.34\%$
test_to_cpu_default 0.1146s 13.4021ms 74.6150 Ops/s 82.6544 Ops/s $\textbf{\color{#d91a1a}-9.73\%}$
test_consolidate[False-None] 4.2732ms 4.1010ms 243.8424 Ops/s 242.8288 Ops/s $\color{#35bf28}+0.42\%$
test_consolidate[default-None] 2.1193ms 2.0257ms 493.6546 Ops/s 481.0565 Ops/s $\color{#35bf28}+2.62\%$
test_consolidate[reduce-overhead-None] 2.0093ms 1.9383ms 515.9186 Ops/s 504.1546 Ops/s $\color{#35bf28}+2.33\%$
test_consolidate_njt[False-None] 8.6192ms 8.4528ms 118.3039 Ops/s 117.3777 Ops/s $\color{#35bf28}+0.79\%$
test_to[False-False-None] 2.2072ms 2.0623ms 484.8919 Ops/s 480.6692 Ops/s $\color{#35bf28}+0.88\%$
test_to[True-False-None] 2.1939ms 1.9546ms 511.6173 Ops/s 520.6421 Ops/s $\color{#d91a1a}-1.73\%$
test_to[within-False-None] 6.3795ms 6.1502ms 162.5974 Ops/s 163.4840 Ops/s $\color{#d91a1a}-0.54\%$
test_to[True-default-None] 7.7608ms 7.5395ms 132.6346 Ops/s 132.0787 Ops/s $\color{#35bf28}+0.42\%$
test_to_njt[False-False-None] 8.6645ms 8.5792ms 116.5611 Ops/s 116.9463 Ops/s $\color{#d91a1a}-0.33\%$
test_to_njt[True-False-None] 7.1284ms 6.9899ms 143.0630 Ops/s 144.0184 Ops/s $\color{#d91a1a}-0.66\%$
test_to_njt[within-False-None] 16.8790ms 16.0446ms 62.3261 Ops/s 65.2078 Ops/s $\color{#d91a1a}-4.42\%$
test_creation[device0] 0.3847ms 0.1229ms 8.1373 KOps/s 8.4461 KOps/s $\color{#d91a1a}-3.66\%$
test_creation_from_tensor 0.4533ms 0.1221ms 8.1871 KOps/s 8.6873 KOps/s $\textbf{\color{#d91a1a}-5.76\%}$
test_add_one[memmap_tensor0] 0.1887ms 6.7557μs 148.0237 KOps/s 147.1697 KOps/s $\color{#35bf28}+0.58\%$
test_contiguous[memmap_tensor0] 24.4700μs 0.6746μs 1.4824 MOps/s 2.1396 MOps/s $\textbf{\color{#d91a1a}-30.72\%}$
test_stack[memmap_tensor0] 33.4810μs 4.6655μs 214.3407 KOps/s 217.6597 KOps/s $\color{#d91a1a}-1.52\%$
test_memmaptd_index 0.9841ms 0.2624ms 3.8111 KOps/s 3.8234 KOps/s $\color{#d91a1a}-0.32\%$
test_memmaptd_index_astensor 0.5051ms 0.3567ms 2.8034 KOps/s 2.8076 KOps/s $\color{#d91a1a}-0.15\%$
test_memmaptd_index_op 0.8345ms 0.6055ms 1.6516 KOps/s 1.6283 KOps/s $\color{#35bf28}+1.44\%$
test_serialize_model 0.1416s 0.1377s 7.2643 Ops/s 7.2035 Ops/s $\color{#35bf28}+0.84\%$
test_serialize_model_pickle 1.3488s 1.1936s 0.8378 Ops/s 0.8257 Ops/s $\color{#35bf28}+1.46\%$
test_serialize_weights 0.1384s 0.1358s 7.3648 Ops/s 7.3378 Ops/s $\color{#35bf28}+0.37\%$
test_serialize_weights_returnearly 0.3530s 92.1712ms 10.8494 Ops/s 11.4224 Ops/s $\textbf{\color{#d91a1a}-5.02\%}$
test_serialize_weights_pickle 1.3666s 1.2142s 0.8236 Ops/s 0.8247 Ops/s $\color{#d91a1a}-0.13\%$
test_reshape_pytree 0.2556ms 33.7719μs 29.6105 KOps/s 30.2984 KOps/s $\color{#d91a1a}-2.27\%$
test_reshape_td 77.9010μs 43.3523μs 23.0668 KOps/s 22.3424 KOps/s $\color{#35bf28}+3.24\%$
test_view_pytree 0.2268ms 33.0756μs 30.2338 KOps/s 29.2783 KOps/s $\color{#35bf28}+3.26\%$
test_view_td 85.8720μs 51.4483μs 19.4370 KOps/s 17.9435 KOps/s $\textbf{\color{#35bf28}+8.32\%}$
test_unbind_pytree 0.2524ms 38.5638μs 25.9311 KOps/s 26.2719 KOps/s $\color{#d91a1a}-1.30\%$
test_unbind_td 0.1987ms 51.0505μs 19.5884 KOps/s 20.1662 KOps/s $\color{#d91a1a}-2.86\%$
test_split_pytree 0.2490ms 41.7403μs 23.9577 KOps/s 23.6479 KOps/s $\color{#35bf28}+1.31\%$
test_split_td 0.1553ms 63.2565μs 15.8087 KOps/s 15.3791 KOps/s $\color{#35bf28}+2.79\%$
test_add_pytree 0.1856ms 43.3344μs 23.0763 KOps/s 23.7302 KOps/s $\color{#d91a1a}-2.76\%$
test_add_td 0.1229ms 54.2872μs 18.4205 KOps/s 18.3393 KOps/s $\color{#35bf28}+0.44\%$
test_compile_add_one_nested[tensordict-compile] 0.2797ms 0.1397ms 7.1607 KOps/s 7.0078 KOps/s $\color{#35bf28}+2.18\%$
test_compile_add_one_nested[tensordict-eager] 0.2934ms 0.1932ms 5.1751 KOps/s 5.2444 KOps/s $\color{#d91a1a}-1.32\%$
test_compile_add_one_nested[pytree-compile] 0.2553ms 0.1096ms 9.1225 KOps/s 9.1141 KOps/s $\color{#35bf28}+0.09\%$
test_compile_add_one_nested[pytree-eager] 0.4395ms 0.1801ms 5.5537 KOps/s 5.5963 KOps/s $\color{#d91a1a}-0.76\%$
test_compile_copy_nested[tensordict-compile] 0.1946ms 31.3620μs 31.8857 KOps/s 31.5416 KOps/s $\color{#35bf28}+1.09\%$
test_compile_copy_nested[tensordict-eager] 84.2320μs 52.5861μs 19.0164 KOps/s 19.1730 KOps/s $\color{#d91a1a}-0.82\%$
test_compile_copy_nested[pytree-compile] 52.8110μs 9.9255μs 100.7505 KOps/s 104.6358 KOps/s $\color{#d91a1a}-3.71\%$
test_compile_copy_nested[pytree-eager] 0.4425ms 70.4782μs 14.1888 KOps/s 14.5749 KOps/s $\color{#d91a1a}-2.65\%$
test_compile_add_one_flat[tensordict-compile] 0.3214ms 0.1771ms 5.6474 KOps/s 5.3281 KOps/s $\textbf{\color{#35bf28}+5.99\%}$
test_compile_add_one_flat[tensordict-eager] 0.3999ms 0.2551ms 3.9202 KOps/s 3.8721 KOps/s $\color{#35bf28}+1.24\%$
test_compile_add_one_flat[tensorclass-compile] 0.2155ms 0.1176ms 8.5031 KOps/s 7.9817 KOps/s $\textbf{\color{#35bf28}+6.53\%}$
test_compile_add_one_flat[tensorclass-eager] 0.2219ms 70.8723μs 14.1099 KOps/s 13.7519 KOps/s $\color{#35bf28}+2.60\%$
test_compile_add_one_flat[pytree-compile] 0.2106ms 0.1608ms 6.2206 KOps/s 6.1187 KOps/s $\color{#35bf28}+1.67\%$
test_compile_add_one_flat[pytree-eager] 0.8063ms 0.5295ms 1.8885 KOps/s 1.8915 KOps/s $\color{#d91a1a}-0.16\%$
test_compile_add_self_flat[tensordict-eager] 0.4634ms 0.3084ms 3.2422 KOps/s 3.1841 KOps/s $\color{#35bf28}+1.83\%$
test_compile_add_self_flat[tensordict-compile] 0.3468ms 0.1860ms 5.3772 KOps/s 5.3564 KOps/s $\color{#35bf28}+0.39\%$
test_compile_add_self_flat[tensorclass-eager] 0.2187ms 85.9261μs 11.6379 KOps/s 11.6745 KOps/s $\color{#d91a1a}-0.31\%$
test_compile_add_self_flat[tensorclass-compile] 0.2405ms 0.1244ms 8.0369 KOps/s 8.2275 KOps/s $\color{#d91a1a}-2.32\%$
test_compile_add_self_flat[pytree-eager] 0.6443ms 0.4324ms 2.3128 KOps/s 2.3145 KOps/s $\color{#d91a1a}-0.07\%$
test_compile_add_self_flat[pytree-compile] 0.2974ms 0.1603ms 6.2366 KOps/s 6.2129 KOps/s $\color{#35bf28}+0.38\%$
test_compile_copy_flat[tensordict-compile] 59.3010μs 25.0064μs 39.9897 KOps/s 37.6248 KOps/s $\textbf{\color{#35bf28}+6.29\%}$
test_compile_copy_flat[tensordict-eager] 88.4320μs 40.6971μs 24.5718 KOps/s 23.7460 KOps/s $\color{#35bf28}+3.48\%$
test_compile_copy_flat[pytree-compile] 0.1500ms 10.7432μs 93.0822 KOps/s 91.4870 KOps/s $\color{#35bf28}+1.74\%$
test_compile_copy_flat[pytree-eager] 0.3948ms 52.8038μs 18.9380 KOps/s 19.1565 KOps/s $\color{#d91a1a}-1.14\%$
test_compile_assign_and_add[tensordict-compile] 1.9910ms 0.1763ms 5.6726 KOps/s 5.3954 KOps/s $\textbf{\color{#35bf28}+5.14\%}$
test_compile_assign_and_add[tensordict-eager] 3.6289ms 3.3357ms 299.7845 Ops/s 301.3740 Ops/s $\color{#d91a1a}-0.53\%$
test_compile_assign_and_add[pytree-compile] 1.9527ms 0.1625ms 6.1522 KOps/s 6.0878 KOps/s $\color{#35bf28}+1.06\%$
test_compile_assign_and_add[pytree-eager] 3.0113ms 2.8200ms 354.6086 Ops/s 356.1459 Ops/s $\color{#d91a1a}-0.43\%$
test_compile_indexing[tensor-tensordict-compile] 0.3196ms 0.1103ms 9.0629 KOps/s 9.0180 KOps/s $\color{#35bf28}+0.50\%$
test_compile_indexing[tensor-tensordict-eager] 0.3182ms 74.0828μs 13.4984 KOps/s 13.1095 KOps/s $\color{#35bf28}+2.97\%$
test_compile_indexing[tensor-tensorclass-compile] 0.2715ms 0.1025ms 9.7571 KOps/s 10.2339 KOps/s $\color{#d91a1a}-4.66\%$
test_compile_indexing[tensor-tensorclass-eager] 0.2651ms 45.9285μs 21.7730 KOps/s 22.1552 KOps/s $\color{#d91a1a}-1.73\%$
test_compile_indexing[tensor-pytree-compile] 0.2702ms 0.1015ms 9.8563 KOps/s 10.1243 KOps/s $\color{#d91a1a}-2.65\%$
test_compile_indexing[tensor-pytree-eager] 0.2555ms 46.0012μs 21.7385 KOps/s 22.2334 KOps/s $\color{#d91a1a}-2.23\%$
test_compile_indexing[slice-tensordict-compile] 0.1388ms 57.1279μs 17.5046 KOps/s 17.5033 KOps/s $+0.01\%$
test_compile_indexing[slice-tensordict-eager] 0.2277ms 28.5236μs 35.0587 KOps/s 26.6951 KOps/s $\textbf{\color{#35bf28}+31.33\%}$
test_compile_indexing[slice-tensorclass-compile] 0.1934ms 46.8923μs 21.3255 KOps/s 21.6405 KOps/s $\color{#d91a1a}-1.46\%$
test_compile_indexing[slice-tensorclass-eager] 0.2680ms 22.9569μs 43.5600 KOps/s 43.9518 KOps/s $\color{#d91a1a}-0.89\%$
test_compile_indexing[slice-pytree-compile] 0.1382ms 47.1973μs 21.1877 KOps/s 21.2667 KOps/s $\color{#d91a1a}-0.37\%$
test_compile_indexing[slice-pytree-eager] 0.2745ms 23.0049μs 43.4690 KOps/s 44.0776 KOps/s $\color{#d91a1a}-1.38\%$
test_compile_indexing[int-tensordict-compile] 0.2123ms 58.6186μs 17.0594 KOps/s 17.3491 KOps/s $\color{#d91a1a}-1.67\%$
test_compile_indexing[int-tensordict-eager] 0.2301ms 28.5324μs 35.0478 KOps/s 35.7863 KOps/s $\color{#d91a1a}-2.06\%$
test_compile_indexing[int-tensorclass-compile] 0.1815ms 47.8461μs 20.9004 KOps/s 21.3465 KOps/s $\color{#d91a1a}-2.09\%$
test_compile_indexing[int-tensorclass-eager] 0.2724ms 23.2102μs 43.0845 KOps/s 44.2246 KOps/s $\color{#d91a1a}-2.58\%$
test_compile_indexing[int-pytree-compile] 99.6410μs 46.0384μs 21.7210 KOps/s 21.0829 KOps/s $\color{#35bf28}+3.03\%$
test_compile_indexing[int-pytree-eager] 0.2716ms 23.1266μs 43.2402 KOps/s 44.0682 KOps/s $\color{#d91a1a}-1.88\%$
test_mod_add[eager] 94.6710μs 50.0694μs 19.9723 KOps/s 19.9569 KOps/s $\color{#35bf28}+0.08\%$
test_mod_add[compile] 0.2038ms 0.1041ms 9.6039 KOps/s 9.3716 KOps/s $\color{#35bf28}+2.48\%$
test_mod_add[compile-overhead] 0.2317ms 0.1485ms 6.7362 KOps/s 6.6272 KOps/s $\color{#35bf28}+1.64\%$
test_mod_wrap[eager] 0.4040ms 0.2918ms 3.4275 KOps/s 3.4175 KOps/s $\color{#35bf28}+0.29\%$
test_mod_wrap[compile] 0.4440ms 0.3615ms 2.7661 KOps/s 2.6927 KOps/s $\color{#35bf28}+2.73\%$
test_mod_wrap[compile-overhead] 7.2759ms 3.9770ms 251.4429 Ops/s 249.6315 Ops/s $\color{#35bf28}+0.73\%$
test_mod_wrap_and_backward[eager] 1.6508ms 1.5006ms 666.3873 Ops/s 651.8524 Ops/s $\color{#35bf28}+2.23\%$
test_mod_wrap_and_backward[compile] 1.6134ms 1.4549ms 687.3169 Ops/s 643.8404 Ops/s $\textbf{\color{#35bf28}+6.75\%}$
test_mod_wrap_and_backward[compile-overhead] 1.2583ms 0.8936ms 1.1191 KOps/s 1.0081 KOps/s $\textbf{\color{#35bf28}+11.01\%}$
test_seq_add[eager] 0.2368ms 0.1561ms 6.4064 KOps/s 6.3662 KOps/s $\color{#35bf28}+0.63\%$
test_seq_add[compile] 0.1968ms 0.1150ms 8.6973 KOps/s 8.4404 KOps/s $\color{#35bf28}+3.04\%$
test_seq_add[compile-overhead] 0.2388ms 0.1601ms 6.2453 KOps/s 6.3428 KOps/s $\color{#d91a1a}-1.54\%$
test_seq_wrap[eager] 0.6020ms 0.5255ms 1.9029 KOps/s 1.8983 KOps/s $\color{#35bf28}+0.24\%$
test_seq_wrap[compile] 0.4180ms 0.3699ms 2.7032 KOps/s 2.5626 KOps/s $\textbf{\color{#35bf28}+5.49\%}$
test_seq_wrap[compile-overhead] 0.3404ms 0.2660ms 3.7593 KOps/s 3.6685 KOps/s $\color{#35bf28}+2.47\%$
test_func_call_runtime[False-eager] 0.9517ms 0.8534ms 1.1718 KOps/s 1.1789 KOps/s $\color{#d91a1a}-0.60\%$
test_func_call_runtime[False-compile] 0.9790ms 0.9086ms 1.1006 KOps/s 1.0665 KOps/s $\color{#35bf28}+3.20\%$
test_func_call_runtime[False-compile-overhead] 0.5381ms 0.4621ms 2.1643 KOps/s 2.1424 KOps/s $\color{#35bf28}+1.02\%$
test_func_call_runtime[True-eager] 1.1748ms 1.0888ms 918.4421 Ops/s 908.8267 Ops/s $\color{#35bf28}+1.06\%$
test_func_call_runtime[True-compile] 1.0640ms 0.9229ms 1.0835 KOps/s 1.0765 KOps/s $\color{#35bf28}+0.65\%$
test_func_call_runtime[True-compile-overhead] 0.5190ms 0.4734ms 2.1123 KOps/s 2.0843 KOps/s $\color{#35bf28}+1.34\%$
test_func_call_cm_runtime[False-eager] 0.9677ms 0.8424ms 1.1871 KOps/s 1.1838 KOps/s $\color{#35bf28}+0.28\%$
test_func_call_cm_runtime[False-compile] 1.0714ms 0.9138ms 1.0944 KOps/s 1.0818 KOps/s $\color{#35bf28}+1.16\%$
test_func_call_cm_runtime[False-compile-overhead] 0.5050ms 0.4649ms 2.1510 KOps/s 2.1434 KOps/s $\color{#35bf28}+0.35\%$
test_func_call_cm_runtime[True-eager] 1.3738ms 1.2331ms 810.9430 Ops/s 807.7716 Ops/s $\color{#35bf28}+0.39\%$
test_func_call_cm_runtime[True-compile] 1.0959ms 0.9568ms 1.0451 KOps/s 1.0374 KOps/s $\color{#35bf28}+0.74\%$
test_func_call_cm_runtime[True-compile-overhead] 0.6388ms 0.5085ms 1.9666 KOps/s 1.9500 KOps/s $\color{#35bf28}+0.85\%$
test_vmap_func_call_cm_runtime[eager] 2.8513ms 2.3655ms 422.7488 Ops/s 419.3573 Ops/s $\color{#35bf28}+0.81\%$
test_vmap_func_call_cm_runtime[compile] 1.1842ms 0.9756ms 1.0250 KOps/s 1.0166 KOps/s $\color{#35bf28}+0.82\%$
test_vmap_func_call_cm_runtime[compile-overhead] 0.6338ms 0.5138ms 1.9462 KOps/s 1.9285 KOps/s $\color{#35bf28}+0.92\%$
test_distributed 0.8078ms 0.1545ms 6.4738 KOps/s 6.3083 KOps/s $\color{#35bf28}+2.62\%$
test_tdmodule 63.1810μs 27.8048μs 35.9650 KOps/s 34.3706 KOps/s $\color{#35bf28}+4.64\%$
test_tdmodule_dispatch 75.5420μs 45.7879μs 21.8398 KOps/s 21.2730 KOps/s $\color{#35bf28}+2.66\%$
test_tdseq 47.2200μs 26.9134μs 37.1563 KOps/s 36.0448 KOps/s $\color{#35bf28}+3.08\%$
test_tdseq_dispatch 68.4910μs 47.1434μs 21.2119 KOps/s 20.5819 KOps/s $\color{#35bf28}+3.06\%$
test_instantiation_functorch 2.1771ms 2.0836ms 479.9374 Ops/s 479.7150 Ops/s $\color{#35bf28}+0.05\%$
test_exec_functorch 0.2323ms 0.1819ms 5.4962 KOps/s 5.5078 KOps/s $\color{#d91a1a}-0.21\%$
test_exec_functional_call 0.3063ms 0.1656ms 6.0369 KOps/s 5.7609 KOps/s $\color{#35bf28}+4.79\%$
test_exec_td_decorator 0.4563ms 0.2405ms 4.1573 KOps/s 4.1384 KOps/s $\color{#35bf28}+0.46\%$
test_vmap_mlp_speed_decorator[True-True] 1.0326ms 0.8251ms 1.2120 KOps/s 1.2088 KOps/s $\color{#35bf28}+0.26\%$
test_vmap_mlp_speed_decorator[True-False] 1.0080ms 0.8247ms 1.2125 KOps/s 1.2029 KOps/s $\color{#35bf28}+0.80\%$
test_vmap_mlp_speed_decorator[False-True] 0.8881ms 0.7180ms 1.3927 KOps/s 1.3933 KOps/s $\color{#d91a1a}-0.04\%$
test_vmap_mlp_speed_decorator[False-False] 0.9026ms 0.7191ms 1.3906 KOps/s 1.3958 KOps/s $\color{#d91a1a}-0.37\%$
test_vmap_transformer_speed_decorator[True-True] 21.6034ms 20.6591ms 48.4049 Ops/s 48.3954 Ops/s $\color{#35bf28}+0.02\%$
test_vmap_transformer_speed_decorator[True-False] 21.3463ms 20.6011ms 48.5410 Ops/s 48.5733 Ops/s $\color{#d91a1a}-0.07\%$
test_vmap_transformer_speed_decorator[False-True] 21.2074ms 20.4089ms 48.9983 Ops/s 49.0627 Ops/s $\color{#d91a1a}-0.13\%$
test_vmap_transformer_speed_decorator[False-False] 21.0912ms 20.4217ms 48.9676 Ops/s 49.0769 Ops/s $\color{#d91a1a}-0.22\%$
test_to_module_speed[True] 1.5914ms 1.4778ms 676.7043 Ops/s 674.2948 Ops/s $\color{#35bf28}+0.36\%$
test_to_module_speed[False] 1.5754ms 1.4624ms 683.8118 Ops/s 683.2430 Ops/s $\color{#35bf28}+0.08\%$
test_tc_init 81.1320μs 46.1482μs 21.6693 KOps/s 21.4778 KOps/s $\color{#35bf28}+0.89\%$
test_tc_init_tensor_only 32.0810μs 9.8313μs 101.7161 KOps/s 100.2529 KOps/s $\color{#35bf28}+1.46\%$
test_tc_init_nested 0.1843ms 91.3849μs 10.9427 KOps/s 10.9277 KOps/s $\color{#35bf28}+0.14\%$
test_tc_init_many_fields 61.9510μs 16.8922μs 59.1991 KOps/s 59.8154 KOps/s $\color{#d91a1a}-1.03\%$
test_tc_first_layer_tensor 24.2210μs 1.8805μs 531.7871 KOps/s 536.9976 KOps/s $\color{#d91a1a}-0.97\%$
test_tc_first_layer_tensor_only 4.0386μs 0.7655μs 1.3064 MOps/s 1.3094 MOps/s $\color{#d91a1a}-0.23\%$
test_tc_first_layer_tensor_set 28.6210μs 3.9635μs 252.3030 KOps/s 250.4068 KOps/s $\color{#35bf28}+0.76\%$
test_tc_first_layer_tensor_only_set 19.8400μs 3.2085μs 311.6702 KOps/s 312.5973 KOps/s $\color{#d91a1a}-0.30\%$
test_tc_first_layer_nontensor 37.9500μs 6.2764μs 159.3266 KOps/s 160.4311 KOps/s $\color{#d91a1a}-0.69\%$
test_tc_second_layer_tensor 77.9620μs 4.4409μs 225.1797 KOps/s 224.2506 KOps/s $\color{#35bf28}+0.41\%$
test_tc_second_layer_nontensor 36.2400μs 8.8079μs 113.5347 KOps/s 112.9793 KOps/s $\color{#35bf28}+0.49\%$
test_unbind 0.2550s 17.6268ms 56.7318 Ops/s 57.1045 Ops/s $\color{#d91a1a}-0.65\%$
test_full_like 4.5939ms 4.3965ms 227.4548 Ops/s 221.9465 Ops/s $\color{#35bf28}+2.48\%$
test_zeros_like 7.6997ms 4.4024ms 227.1512 Ops/s 229.1977 Ops/s $\color{#d91a1a}-0.89\%$
test_ones_like 5.0340ms 4.3972ms 227.4154 Ops/s 228.4898 Ops/s $\color{#d91a1a}-0.47\%$
test_clone 6.8545ms 6.6428ms 150.5394 Ops/s 126.4699 Ops/s $\textbf{\color{#35bf28}+19.03\%}$
test_squeeze 96.0620μs 14.2101μs 70.3724 KOps/s 68.4921 KOps/s $\color{#35bf28}+2.75\%$
test_unsqueeze 0.1690ms 0.1081ms 9.2489 KOps/s 8.9670 KOps/s $\color{#35bf28}+3.14\%$
test_split 0.3579ms 0.1856ms 5.3886 KOps/s 5.3907 KOps/s $\color{#d91a1a}-0.04\%$
test_permute 0.3271ms 0.2050ms 4.8791 KOps/s 4.8977 KOps/s $\color{#d91a1a}-0.38\%$
test_stack 52.3839ms 52.0031ms 19.2296 Ops/s 19.4587 Ops/s $\color{#d91a1a}-1.18\%$
test_cat 52.6568ms 51.9093ms 19.2644 Ops/s 19.5033 Ops/s $\color{#d91a1a}-1.22\%$

@vmoens
Update
43ee89c 
[ghstack-poisoned]
@vmoens vmoens mentioned this pull request Feb 18, 2026
Merged
@vmoens
Update
9f371b7 
[ghstack-poisoned]
This was referenced Feb 19, 2026
Closed
Merged
@github-actions

github-actions Bot commented Feb 19, 2026

Copy link
Copy Markdown
Contributor

PR Title Label Error

Unknown or invalid prefix [Distributed].

Current title: [Distributed] Add all_gather collective

Supported Prefixes

Your PR title must start with exactly one of these prefixes:

Prefix Label Applied Example
[BugFix] BugFix [BugFix] Fix memory leak in TensorDict
[Feature] Feature [Feature] Add new storage backend
[Doc] or [Docs] Documentation [Doc] Update installation guide
[Refactor] Refactor [Refactor] Clean up module imports
[CI] CI [CI] Fix workflow permissions
[Test] or [Tests] Test [Test] Add unit tests for nn module
[Compile] Compile [Compile] Fix torch.compile issue
[Performance] or [Perf] Perf [Perf] Optimize tensor operations
[Deprecation] Deprecation [Deprecation] Mark old function
[Setup] Setup [Setup] Update build configuration

Note: Common variations like singular/plural are supported (e.g., [Doc] or [Docs]).

@vmoens
Update
1517ba6 
[ghstack-poisoned]
@github-actions

github-actions Bot commented Feb 19, 2026

Copy link
Copy Markdown
Contributor

PR Title Label Error

Unknown or invalid prefix [Distributed].

Current title: [Distributed] Add all_gather collective

Supported Prefixes

Your PR title must start with exactly one of these prefixes:

Prefix Label Applied Example
[BugFix] BugFix [BugFix] Fix memory leak in TensorDict
[Feature] Feature [Feature] Add new storage backend
[Doc] or [Docs] Documentation [Doc] Update installation guide
[Refactor] Refactor [Refactor] Clean up module imports
[CI] CI [CI] Fix workflow permissions
[Test] or [Tests] Test [Test] Add unit tests for nn module
[Compile] Compile [Compile] Fix torch.compile issue
[Performance] or [Perf] Perf [Perf] Optimize tensor operations
[Deprecation] Deprecation [Deprecation] Mark old function
[Setup] Setup [Setup] Update build configuration

Note: Common variations like singular/plural are supported (e.g., [Doc] or [Docs]).

vmoens added a commit that referenced this pull request Feb 19, 2026
@vmoens @cursoragent
[Distributed] Add all_gather collective
0ea1814 
New TensorDictBase.all_gather() method that gathers tensordicts from
all ranks. Each rank consolidates its TD, metadata is gathered via
all_gather_object, storage via dist.all_gather (with padding to max
size). Returns a list of tensordicts, one per rank.

Co-authored-by: Cursor <cursoragent@cursor.com>
ghstack-source-id: 05381e0
Pull-Request: #1590
Co-authored-by: Cursor <cursoragent@cursor.com>
@vmoens
vmoens merged commit 1517ba6 into gh/vmoens/73/base Feb 19, 2026
35 of 52 checks passed
@vmoens
vmoens deleted the gh/vmoens/73/head branch February 19, 2026 10:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Distributed tensorclass Test

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@vmoens