Skip to content

[Distributed] Add broadcast collective - #1588

Merged
vmoens merged 4 commits into
gh/vmoens/71/basefrom
gh/vmoens/71/head
Feb 19, 2026
Merged

[Distributed] Add broadcast collective#1588
vmoens merged 4 commits into
gh/vmoens/71/basefrom
gh/vmoens/71/head

Conversation

@vmoens

@vmoens vmoens commented Feb 18, 2026 •
edited
Loading

Copy link
Copy Markdown
Collaborator

Stack from ghstack (oldest at bottom):

New TensorDictBase.broadcast(src) method that broadcasts a tensordict
from the source rank to all other ranks using consolidated transport:
metadata via broadcast_object_list + storage via dist.broadcast.

Two messages total regardless of the number of leaf tensors.

Co-authored-by: Cursor cursoragent@cursor.com

@vmoens
Update
ab94718 
[ghstack-poisoned]
This was referenced Feb 18, 2026
Merged
Merged
Merged
Merged
Merged
Merged
@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Feb 18, 2026
@github-actions

github-actions Bot commented Feb 18, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 243. Improved: $\large\color{#35bf28}21$. Worsened: $\large\color{#d91a1a}8$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_plain_set_nested 42.1610μs 14.3927μs 69.4796 KOps/s 70.7363 KOps/s $\color{#d91a1a}-1.78\%$
test_plain_set_stack_nested 40.4210μs 14.6191μs 68.4037 KOps/s 69.6451 KOps/s $\color{#d91a1a}-1.78\%$
test_plain_set_nested_inplace 82.3320μs 15.8011μs 63.2868 KOps/s 63.5083 KOps/s $\color{#d91a1a}-0.35\%$
test_plain_set_stack_nested_inplace 41.0410μs 15.9387μs 62.7405 KOps/s 63.4649 KOps/s $\color{#d91a1a}-1.14\%$
test_items 28.9500μs 5.5347μs 180.6793 KOps/s 178.2906 KOps/s $\color{#35bf28}+1.34\%$
test_items_nested 0.4976ms 0.4435ms 2.2546 KOps/s 2.3007 KOps/s $\color{#d91a1a}-2.00\%$
test_items_nested_locked 0.4791ms 0.4412ms 2.2668 KOps/s 2.2883 KOps/s $\color{#d91a1a}-0.94\%$
test_items_nested_leaf 0.1515ms 92.3089μs 10.8332 KOps/s 10.9558 KOps/s $\color{#d91a1a}-1.12\%$
test_items_stack_nested 0.4991ms 0.4411ms 2.2673 KOps/s 2.2886 KOps/s $\color{#d91a1a}-0.93\%$
test_items_stack_nested_leaf 0.1283ms 93.3455μs 10.7129 KOps/s 10.9084 KOps/s $\color{#d91a1a}-1.79\%$
test_items_stack_nested_locked 0.5010ms 0.4468ms 2.2381 KOps/s 2.2889 KOps/s $\color{#d91a1a}-2.22\%$
test_keys 33.9710μs 4.1672μs 239.9698 KOps/s 242.2322 KOps/s $\color{#d91a1a}-0.93\%$
test_keys_nested 0.1632ms 0.1178ms 8.4908 KOps/s 8.5543 KOps/s $\color{#d91a1a}-0.74\%$
test_keys_nested_locked 88.2438ms 0.1390ms 7.1954 KOps/s 8.0142 KOps/s $\textbf{\color{#d91a1a}-10.22\%}$
test_keys_nested_leaf 0.1387ms 0.1091ms 9.1620 KOps/s 9.3069 KOps/s $\color{#d91a1a}-1.56\%$
test_keys_stack_nested 0.1573ms 0.1182ms 8.4590 KOps/s 8.5807 KOps/s $\color{#d91a1a}-1.42\%$
test_keys_stack_nested_leaf 0.1617ms 0.1086ms 9.2051 KOps/s 9.2641 KOps/s $\color{#d91a1a}-0.64\%$
test_keys_stack_nested_locked 0.1635ms 0.1261ms 7.9291 KOps/s 7.9619 KOps/s $\color{#d91a1a}-0.41\%$
test_values 5.8582μs 0.9944μs 1.0057 MOps/s 995.5734 KOps/s $\color{#35bf28}+1.01\%$
test_values_nested 75.2310μs 46.8124μs 21.3619 KOps/s 21.4404 KOps/s $\color{#d91a1a}-0.37\%$
test_values_nested_locked 79.1420μs 50.4420μs 19.8248 KOps/s 20.2697 KOps/s $\color{#d91a1a}-2.20\%$
test_values_nested_leaf 84.2210μs 53.7460μs 18.6060 KOps/s 19.1228 KOps/s $\color{#d91a1a}-2.70\%$
test_values_stack_nested 90.1520μs 47.2566μs 21.1611 KOps/s 21.4113 KOps/s $\color{#d91a1a}-1.17\%$
test_values_stack_nested_leaf 0.1730ms 54.0101μs 18.5151 KOps/s 18.9300 KOps/s $\color{#d91a1a}-2.19\%$
test_values_stack_nested_locked 81.3110μs 50.2044μs 19.9186 KOps/s 20.1659 KOps/s $\color{#d91a1a}-1.23\%$
test_membership 5.3167μs 0.8157μs 1.2260 MOps/s 1.2184 MOps/s $\color{#35bf28}+0.62\%$
test_membership_nested 23.2710μs 2.7889μs 358.5626 KOps/s 359.3963 KOps/s $\color{#d91a1a}-0.23\%$
test_membership_nested_leaf 19.3505μs 2.6686μs 374.7332 KOps/s 358.5386 KOps/s $\color{#35bf28}+4.52\%$
test_membership_stacked_nested 23.4310μs 2.7799μs 359.7270 KOps/s 359.6863 KOps/s $\color{#35bf28}+0.01\%$
test_membership_stacked_nested_leaf 38.1910μs 2.7814μs 359.5260 KOps/s 366.5369 KOps/s $\color{#d91a1a}-1.91\%$
test_membership_nested_last 36.9810μs 4.1946μs 238.3997 KOps/s 242.9656 KOps/s $\color{#d91a1a}-1.88\%$
test_membership_nested_leaf_last 35.2410μs 4.1594μs 240.4194 KOps/s 243.8251 KOps/s $\color{#d91a1a}-1.40\%$
test_membership_stacked_nested_last 31.0210μs 4.1787μs 239.3113 KOps/s 243.3285 KOps/s $\color{#d91a1a}-1.65\%$
test_membership_stacked_nested_leaf_last 32.0810μs 4.1961μs 238.3180 KOps/s 242.7863 KOps/s $\color{#d91a1a}-1.84\%$
test_nested_getleaf 50.6010μs 20.3319μs 49.1837 KOps/s 50.2513 KOps/s $\color{#d91a1a}-2.12\%$
test_nested_get 55.7010μs 19.2812μs 51.8639 KOps/s 52.8907 KOps/s $\color{#d91a1a}-1.94\%$
test_stacked_getleaf 51.5110μs 20.6869μs 48.3398 KOps/s 49.4198 KOps/s $\color{#d91a1a}-2.19\%$
test_stacked_get 47.8310μs 19.8421μs 50.3980 KOps/s 52.9758 KOps/s $\color{#d91a1a}-4.87\%$
test_nested_getitemleaf 55.7410μs 21.3845μs 46.7629 KOps/s 47.6576 KOps/s $\color{#d91a1a}-1.88\%$
test_nested_getitem 47.8410μs 20.1761μs 49.5635 KOps/s 49.9215 KOps/s $\color{#d91a1a}-0.72\%$
test_stacked_getitemleaf 52.1610μs 21.1747μs 47.2262 KOps/s 47.9377 KOps/s $\color{#d91a1a}-1.48\%$
test_stacked_getitem 43.4610μs 20.2030μs 49.4976 KOps/s 49.4589 KOps/s $\color{#35bf28}+0.08\%$
test_lock_nested 8.0696ms 0.4628ms 2.1609 KOps/s 2.1754 KOps/s $\color{#d91a1a}-0.67\%$
test_lock_stack_nested 0.5029ms 0.4586ms 2.1807 KOps/s 2.1542 KOps/s $\color{#35bf28}+1.23\%$
test_unlock_nested 0.4587ms 0.3682ms 2.7157 KOps/s 2.7302 KOps/s $\color{#d91a1a}-0.53\%$
test_unlock_stack_nested 0.4070ms 0.3692ms 2.7086 KOps/s 2.6904 KOps/s $\color{#35bf28}+0.68\%$
test_flatten_speed 0.1491ms 0.1166ms 8.5744 KOps/s 8.4265 KOps/s $\color{#35bf28}+1.75\%$
test_unflatten_speed 0.6131ms 0.5530ms 1.8083 KOps/s 1.8051 KOps/s $\color{#35bf28}+0.18\%$
test_common_ops 0.7892ms 0.6627ms 1.5089 KOps/s 1.4782 KOps/s $\color{#35bf28}+2.08\%$
test_creation 72.1710μs 2.7267μs 366.7482 KOps/s 365.9780 KOps/s $\color{#35bf28}+0.21\%$
test_creation_empty 27.0010μs 5.6803μs 176.0459 KOps/s 172.1462 KOps/s $\color{#35bf28}+2.27\%$
test_creation_nested_1 45.4510μs 9.9445μs 100.5583 KOps/s 98.6360 KOps/s $\color{#35bf28}+1.95\%$
test_creation_nested_2 41.7210μs 11.1966μs 89.3129 KOps/s 88.5943 KOps/s $\color{#35bf28}+0.81\%$
test_creation_many_keys[10] 45.8210μs 17.0685μs 58.5875 KOps/s 58.5045 KOps/s $\color{#35bf28}+0.14\%$
test_creation_many_keys[50] 0.1722ms 72.0816μs 13.8732 KOps/s 13.7023 KOps/s $\color{#35bf28}+1.25\%$
test_creation_many_keys[100] 0.2185ms 0.1427ms 7.0076 KOps/s 7.0440 KOps/s $\color{#d91a1a}-0.52\%$
test_creation_nested_many_keys[10] 64.4910μs 36.3772μs 27.4897 KOps/s 27.2944 KOps/s $\color{#35bf28}+0.72\%$
test_creation_nested_many_keys[50] 0.1918ms 0.1483ms 6.7447 KOps/s 6.7694 KOps/s $\color{#d91a1a}-0.36\%$
test_clone 50.9810μs 12.9050μs 77.4891 KOps/s 73.3971 KOps/s $\textbf{\color{#35bf28}+5.58\%}$
test_getitem[int] 1.6558ms 13.8795μs 72.0488 KOps/s 59.0305 KOps/s $\textbf{\color{#35bf28}+22.05\%}$
test_getitem[slice_int] 0.1386ms 23.6405μs 42.3002 KOps/s 41.7346 KOps/s $\color{#35bf28}+1.36\%$
test_getitem[range] 0.1739ms 60.4795μs 16.5345 KOps/s 16.2640 KOps/s $\color{#35bf28}+1.66\%$
test_getitem[tuple] 0.1434ms 23.1077μs 43.2756 KOps/s 42.9616 KOps/s $\color{#35bf28}+0.73\%$
test_getitem[list] 0.1752ms 55.3493μs 18.0671 KOps/s 17.7241 KOps/s $\color{#35bf28}+1.93\%$
test_setitem_dim[int] 33.9810μs 24.8661μs 40.2154 KOps/s 38.0515 KOps/s $\textbf{\color{#35bf28}+5.69\%}$
test_setitem_dim[slice_int] 73.2320μs 42.3153μs 23.6321 KOps/s 23.1623 KOps/s $\color{#35bf28}+2.03\%$
test_setitem_dim[range] 0.1171ms 90.6720μs 11.0288 KOps/s 10.9839 KOps/s $\color{#35bf28}+0.41\%$
test_setitem_dim[tuple] 74.1710μs 39.2645μs 25.4683 KOps/s 24.9792 KOps/s $\color{#35bf28}+1.96\%$
test_setitem 49.4510μs 17.0901μs 58.5133 KOps/s 55.6719 KOps/s $\textbf{\color{#35bf28}+5.10\%}$
test_set 58.3020μs 16.2322μs 61.6060 KOps/s 58.3726 KOps/s $\textbf{\color{#35bf28}+5.54\%}$
test_set_shared 0.5453ms 0.2025ms 4.9379 KOps/s 4.8586 KOps/s $\color{#35bf28}+1.63\%$
test_update 0.2145ms 20.6660μs 48.3887 KOps/s 46.0533 KOps/s $\textbf{\color{#35bf28}+5.07\%}$
test_update_nested 65.4510μs 32.4900μs 30.7787 KOps/s 30.5124 KOps/s $\color{#35bf28}+0.87\%$
test_update__nested 0.5118ms 33.5640μs 29.7939 KOps/s 29.3484 KOps/s $\color{#35bf28}+1.52\%$
test_set_nested 54.6510μs 18.1405μs 55.1253 KOps/s 52.3778 KOps/s $\textbf{\color{#35bf28}+5.25\%}$
test_set_nested_new 69.1610μs 23.1421μs 43.2113 KOps/s 42.2225 KOps/s $\color{#35bf28}+2.34\%$
test_select 0.1187ms 39.1632μs 25.5342 KOps/s 24.8561 KOps/s $\color{#35bf28}+2.73\%$
test_select_nested 0.1100ms 69.8917μs 14.3078 KOps/s 14.2829 KOps/s $\color{#35bf28}+0.17\%$
test_exclude_nested 0.1264ms 86.3086μs 11.5863 KOps/s 11.6035 KOps/s $\color{#d91a1a}-0.15\%$
test_empty[True] 0.4304ms 0.3732ms 2.6795 KOps/s 2.6666 KOps/s $\color{#35bf28}+0.49\%$
test_empty[False] 8.3300μs 1.2487μs 800.8029 KOps/s 797.5082 KOps/s $\color{#35bf28}+0.41\%$
test_to 0.1053ms 70.7587μs 14.1325 KOps/s 14.0039 KOps/s $\color{#35bf28}+0.92\%$
test_to_nonblocking 0.1104ms 66.8836μs 14.9513 KOps/s 15.8440 KOps/s $\textbf{\color{#d91a1a}-5.63\%}$
test_unbind_speed 0.3806ms 0.3300ms 3.0299 KOps/s 3.1832 KOps/s $\color{#d91a1a}-4.81\%$
test_unbind_speed_stack0 0.4074ms 0.3124ms 3.2007 KOps/s 3.2019 KOps/s $\color{#d91a1a}-0.04\%$
test_unbind_speed_stack1 0.1026s 0.8880ms 1.1261 KOps/s 1.1223 KOps/s $\color{#35bf28}+0.34\%$
test_split 1.1848ms 1.0999ms 909.1780 Ops/s 909.0543 Ops/s $\color{#35bf28}+0.01\%$
test_chunk 0.1026s 1.1598ms 862.1919 Ops/s 956.2032 Ops/s $\textbf{\color{#d91a1a}-9.83\%}$
test_to_cpu_blocking 27.9951ms 27.7246ms 36.0690 Ops/s 35.3021 Ops/s $\color{#35bf28}+2.17\%$
test_to_cpu_global_sync 11.2499ms 11.1054ms 90.0462 Ops/s 89.0794 Ops/s $\color{#35bf28}+1.09\%$
test_to_cpu_event_sync 0.1153s 13.2505ms 75.4687 Ops/s 82.7001 Ops/s $\textbf{\color{#d91a1a}-8.74\%}$
test_to_cpu_default 12.3345ms 12.0215ms 83.1844 Ops/s 82.5823 Ops/s $\color{#35bf28}+0.73\%$
test_consolidate[False-None] 4.0730ms 3.9616ms 252.4203 Ops/s 228.7021 Ops/s $\textbf{\color{#35bf28}+10.37\%}$
test_consolidate[default-None] 2.0830ms 1.9281ms 518.6576 Ops/s 505.0531 Ops/s $\color{#35bf28}+2.69\%$
test_consolidate[reduce-overhead-None] 1.9198ms 1.8290ms 546.7389 Ops/s 524.2963 Ops/s $\color{#35bf28}+4.28\%$
test_consolidate_njt[False-None] 8.1634ms 7.9910ms 125.1415 Ops/s 121.7017 Ops/s $\color{#35bf28}+2.83\%$
test_to[False-False-None] 2.1365ms 2.0048ms 498.8119 Ops/s 484.9205 Ops/s $\color{#35bf28}+2.86\%$
test_to[True-False-None] 2.1558ms 1.8185ms 549.9135 Ops/s 534.2277 Ops/s $\color{#35bf28}+2.94\%$
test_to[within-False-None] 6.0993ms 5.8324ms 171.4550 Ops/s 169.5348 Ops/s $\color{#35bf28}+1.13\%$
test_to[True-default-None] 0.1764s 8.3611ms 119.6016 Ops/s 68.3157 Ops/s $\textbf{\color{#35bf28}+75.07\%}$
test_to_njt[False-False-None] 8.2933ms 8.1939ms 122.0418 Ops/s 120.8192 Ops/s $\color{#35bf28}+1.01\%$
test_to_njt[True-False-None] 6.7371ms 6.5889ms 151.7696 Ops/s 147.6565 Ops/s $\color{#35bf28}+2.79\%$
test_to_njt[within-False-None] 15.2107ms 14.7158ms 67.9541 Ops/s 66.0556 Ops/s $\color{#35bf28}+2.87\%$
test_creation[device0] 0.3480ms 0.1137ms 8.7980 KOps/s 8.4202 KOps/s $\color{#35bf28}+4.49\%$
test_creation_from_tensor 0.4545ms 0.1121ms 8.9245 KOps/s 8.8945 KOps/s $\color{#35bf28}+0.34\%$
test_add_one[memmap_tensor0] 0.3732ms 6.2098μs 161.0348 KOps/s 154.3245 KOps/s $\color{#35bf28}+4.35\%$
test_contiguous[memmap_tensor0] 36.3410μs 0.6187μs 1.6164 MOps/s 2.2936 MOps/s $\textbf{\color{#d91a1a}-29.53\%}$
test_stack[memmap_tensor0] 87.3420μs 4.4176μs 226.3673 KOps/s 213.0572 KOps/s $\textbf{\color{#35bf28}+6.25\%}$
test_memmaptd_index 0.9485ms 0.2487ms 4.0209 KOps/s 3.9058 KOps/s $\color{#35bf28}+2.95\%$
test_memmaptd_index_astensor 0.4831ms 0.3397ms 2.9438 KOps/s 2.8541 KOps/s $\color{#35bf28}+3.14\%$
test_memmaptd_index_op 0.8878ms 0.5705ms 1.7528 KOps/s 1.6893 KOps/s $\color{#35bf28}+3.76\%$
test_serialize_model 0.1406s 0.1376s 7.2672 Ops/s 7.3699 Ops/s $\color{#d91a1a}-1.39\%$
test_serialize_model_pickle 1.3528s 1.2107s 0.8260 Ops/s 0.8265 Ops/s $\color{#d91a1a}-0.06\%$
test_serialize_weights 0.1366s 0.1352s 7.3976 Ops/s 7.4278 Ops/s $\color{#d91a1a}-0.41\%$
test_serialize_weights_returnearly 0.4238s 90.4280ms 11.0585 Ops/s 10.9566 Ops/s $\color{#35bf28}+0.93\%$
test_serialize_weights_pickle 1.3671s 1.2137s 0.8239 Ops/s 0.8246 Ops/s $\color{#d91a1a}-0.08\%$
test_reshape_pytree 0.2000ms 31.6457μs 31.5999 KOps/s 31.4331 KOps/s $\color{#35bf28}+0.53\%$
test_reshape_td 62.7510μs 42.3271μs 23.6255 KOps/s 23.9699 KOps/s $\color{#d91a1a}-1.44\%$
test_view_pytree 0.2425ms 31.1787μs 32.0731 KOps/s 31.6037 KOps/s $\color{#35bf28}+1.49\%$
test_view_td 82.0310μs 49.7254μs 20.1105 KOps/s 20.2048 KOps/s $\color{#d91a1a}-0.47\%$
test_unbind_pytree 0.2314ms 35.4620μs 28.1992 KOps/s 27.9484 KOps/s $\color{#35bf28}+0.90\%$
test_unbind_td 0.1455ms 47.3990μs 21.0975 KOps/s 21.5872 KOps/s $\color{#d91a1a}-2.27\%$
test_split_pytree 0.2608ms 40.7721μs 24.5266 KOps/s 24.6156 KOps/s $\color{#d91a1a}-0.36\%$
test_split_td 99.7420μs 61.9861μs 16.1327 KOps/s 16.4736 KOps/s $\color{#d91a1a}-2.07\%$
test_add_pytree 0.2398ms 40.0479μs 24.9701 KOps/s 24.8533 KOps/s $\color{#35bf28}+0.47\%$
test_add_td 83.1510μs 51.2120μs 19.5267 KOps/s 19.9165 KOps/s $\color{#d91a1a}-1.96\%$
test_compile_add_one_nested[tensordict-compile] 0.1880ms 0.1351ms 7.4008 KOps/s 6.7600 KOps/s $\textbf{\color{#35bf28}+9.48\%}$
test_compile_add_one_nested[tensordict-eager] 0.4944ms 0.1883ms 5.3101 KOps/s 5.5300 KOps/s $\color{#d91a1a}-3.98\%$
test_compile_add_one_nested[pytree-compile] 0.2221ms 0.1054ms 9.4919 KOps/s 9.3642 KOps/s $\color{#35bf28}+1.36\%$
test_compile_add_one_nested[pytree-eager] 0.4270ms 0.1707ms 5.8582 KOps/s 5.7524 KOps/s $\color{#35bf28}+1.84\%$
test_compile_copy_nested[tensordict-compile] 0.2436ms 29.3103μs 34.1177 KOps/s 33.2035 KOps/s $\color{#35bf28}+2.75\%$
test_compile_copy_nested[tensordict-eager] 89.2920μs 52.6168μs 19.0053 KOps/s 20.2800 KOps/s $\textbf{\color{#d91a1a}-6.29\%}$
test_compile_copy_nested[pytree-compile] 0.1519ms 9.4251μs 106.0997 KOps/s 109.3638 KOps/s $\color{#d91a1a}-2.98\%$
test_compile_copy_nested[pytree-eager] 0.4431ms 64.6853μs 15.4595 KOps/s 15.2322 KOps/s $\color{#35bf28}+1.49\%$
test_compile_add_one_flat[tensordict-compile] 0.2239ms 0.1782ms 5.6125 KOps/s 5.3950 KOps/s $\color{#35bf28}+4.03\%$
test_compile_add_one_flat[tensordict-eager] 0.3103ms 0.2492ms 4.0122 KOps/s 3.9232 KOps/s $\color{#35bf28}+2.27\%$
test_compile_add_one_flat[tensorclass-compile] 0.3431ms 0.1136ms 8.8005 KOps/s 8.3395 KOps/s $\textbf{\color{#35bf28}+5.53\%}$
test_compile_add_one_flat[tensorclass-eager] 0.1234ms 68.4047μs 14.6189 KOps/s 14.6485 KOps/s $\color{#d91a1a}-0.20\%$
test_compile_add_one_flat[pytree-compile] 0.2077ms 0.1563ms 6.3959 KOps/s 6.1900 KOps/s $\color{#35bf28}+3.33\%$
test_compile_add_one_flat[pytree-eager] 0.7774ms 0.5168ms 1.9351 KOps/s 1.8970 KOps/s $\color{#35bf28}+2.01\%$
test_compile_add_self_flat[tensordict-eager] 0.3542ms 0.3027ms 3.3033 KOps/s 3.1944 KOps/s $\color{#35bf28}+3.41\%$
test_compile_add_self_flat[tensordict-compile] 0.2216ms 0.1765ms 5.6654 KOps/s 5.2796 KOps/s $\textbf{\color{#35bf28}+7.31\%}$
test_compile_add_self_flat[tensorclass-eager] 0.1310ms 83.9200μs 11.9161 KOps/s 11.8342 KOps/s $\color{#35bf28}+0.69\%$
test_compile_add_self_flat[tensorclass-compile] 0.1760ms 0.1162ms 8.6023 KOps/s 8.1728 KOps/s $\textbf{\color{#35bf28}+5.25\%}$
test_compile_add_self_flat[pytree-eager] 0.6260ms 0.4253ms 2.3514 KOps/s 2.2576 KOps/s $\color{#35bf28}+4.15\%$
test_compile_add_self_flat[pytree-compile] 0.4659ms 0.1563ms 6.3999 KOps/s 6.2461 KOps/s $\color{#35bf28}+2.46\%$
test_compile_copy_flat[tensordict-compile] 71.8510μs 23.8329μs 41.9588 KOps/s 42.6840 KOps/s $\color{#d91a1a}-1.70\%$
test_compile_copy_flat[tensordict-eager] 74.4820μs 40.6043μs 24.6279 KOps/s 25.0436 KOps/s $\color{#d91a1a}-1.66\%$
test_compile_copy_flat[pytree-compile] 0.1006ms 10.4665μs 95.5426 KOps/s 95.9702 KOps/s $\color{#d91a1a}-0.45\%$
test_compile_copy_flat[pytree-eager] 0.4108ms 50.9938μs 19.6102 KOps/s 19.5072 KOps/s $\color{#35bf28}+0.53\%$
test_compile_assign_and_add[tensordict-compile] 1.9301ms 0.1694ms 5.9043 KOps/s 5.6077 KOps/s $\textbf{\color{#35bf28}+5.29\%}$
test_compile_assign_and_add[tensordict-eager] 3.3436ms 3.2282ms 309.7732 Ops/s 306.8890 Ops/s $\color{#35bf28}+0.94\%$
test_compile_assign_and_add[pytree-compile] 1.8855ms 0.1566ms 6.3853 KOps/s 6.1984 KOps/s $\color{#35bf28}+3.01\%$
test_compile_assign_and_add[pytree-eager] 2.8430ms 2.7255ms 366.9089 Ops/s 367.5684 Ops/s $\color{#d91a1a}-0.18\%$
test_compile_indexing[tensor-tensordict-compile] 0.1755ms 0.1057ms 9.4651 KOps/s 9.1515 KOps/s $\color{#35bf28}+3.43\%$
test_compile_indexing[tensor-tensordict-eager] 0.3068ms 70.5386μs 14.1766 KOps/s 14.2231 KOps/s $\color{#d91a1a}-0.33\%$
test_compile_indexing[tensor-tensorclass-compile] 0.1410ms 94.4138μs 10.5917 KOps/s 10.4903 KOps/s $\color{#35bf28}+0.97\%$
test_compile_indexing[tensor-tensorclass-eager] 0.2472ms 42.9419μs 23.2873 KOps/s 22.8683 KOps/s $\color{#35bf28}+1.83\%$
test_compile_indexing[tensor-pytree-compile] 0.2596ms 94.9113μs 10.5362 KOps/s 10.3321 KOps/s $\color{#35bf28}+1.97\%$
test_compile_indexing[tensor-pytree-eager] 0.2440ms 42.8835μs 23.3190 KOps/s 21.9465 KOps/s $\textbf{\color{#35bf28}+6.25\%}$
test_compile_indexing[slice-tensordict-compile] 0.1001ms 55.5413μs 18.0046 KOps/s 18.0688 KOps/s $\color{#d91a1a}-0.36\%$
test_compile_indexing[slice-tensordict-eager] 0.2391ms 27.6664μs 36.1449 KOps/s 37.2954 KOps/s $\color{#d91a1a}-3.08\%$
test_compile_indexing[slice-tensorclass-compile] 0.1054ms 43.8650μs 22.7972 KOps/s 21.3784 KOps/s $\textbf{\color{#35bf28}+6.64\%}$
test_compile_indexing[slice-tensorclass-eager] 0.2641ms 21.3124μs 46.9212 KOps/s 45.6156 KOps/s $\color{#35bf28}+2.86\%$
test_compile_indexing[slice-pytree-compile] 86.9410μs 43.9539μs 22.7511 KOps/s 22.3110 KOps/s $\color{#35bf28}+1.97\%$
test_compile_indexing[slice-pytree-eager] 0.2816ms 21.5266μs 46.4541 KOps/s 45.9520 KOps/s $\color{#35bf28}+1.09\%$
test_compile_indexing[int-tensordict-compile] 99.2120μs 55.5228μs 18.0106 KOps/s 17.2577 KOps/s $\color{#35bf28}+4.36\%$
test_compile_indexing[int-tensordict-eager] 0.2519ms 27.4997μs 36.3641 KOps/s 37.0089 KOps/s $\color{#d91a1a}-1.74\%$
test_compile_indexing[int-tensorclass-compile] 83.9910μs 43.6277μs 22.9212 KOps/s 22.5059 KOps/s $\color{#35bf28}+1.85\%$
test_compile_indexing[int-tensorclass-eager] 0.2611ms 21.2185μs 47.1287 KOps/s 46.6085 KOps/s $\color{#35bf28}+1.12\%$
test_compile_indexing[int-pytree-compile] 87.9620μs 43.7259μs 22.8698 KOps/s 22.7748 KOps/s $\color{#35bf28}+0.42\%$
test_compile_indexing[int-pytree-eager] 0.2519ms 21.7473μs 45.9827 KOps/s 46.2073 KOps/s $\color{#d91a1a}-0.49\%$
test_mod_add[eager] 88.8420μs 48.0208μs 20.8243 KOps/s 21.0001 KOps/s $\color{#d91a1a}-0.84\%$
test_mod_add[compile] 0.1570ms 0.1023ms 9.7721 KOps/s 9.6983 KOps/s $\color{#35bf28}+0.76\%$
test_mod_add[compile-overhead] 0.2264ms 0.1445ms 6.9203 KOps/s 6.7894 KOps/s $\color{#35bf28}+1.93\%$
test_mod_wrap[eager] 0.3684ms 0.2860ms 3.4968 KOps/s 3.5494 KOps/s $\color{#d91a1a}-1.48\%$
test_mod_wrap[compile] 0.4306ms 0.3492ms 2.8638 KOps/s 2.9033 KOps/s $\color{#d91a1a}-1.36\%$
test_mod_wrap[compile-overhead] 7.2081ms 4.0111ms 249.3054 Ops/s 247.6790 Ops/s $\color{#35bf28}+0.66\%$
test_mod_wrap_and_backward[eager] 1.6119ms 1.4887ms 671.7226 Ops/s 674.6897 Ops/s $\color{#d91a1a}-0.44\%$
test_mod_wrap_and_backward[compile] 1.4971ms 1.4238ms 702.3305 Ops/s 681.8067 Ops/s $\color{#35bf28}+3.01\%$
test_mod_wrap_and_backward[compile-overhead] 1.2219ms 0.8602ms 1.1626 KOps/s 1.1395 KOps/s $\color{#35bf28}+2.02\%$
test_seq_add[eager] 0.2576ms 0.1489ms 6.7165 KOps/s 6.6048 KOps/s $\color{#35bf28}+1.69\%$
test_seq_add[compile] 0.2177ms 0.1118ms 8.9451 KOps/s 8.3070 KOps/s $\textbf{\color{#35bf28}+7.68\%}$
test_seq_add[compile-overhead] 0.3898ms 0.1512ms 6.6137 KOps/s 6.4460 KOps/s $\color{#35bf28}+2.60\%$
test_seq_wrap[eager] 0.6349ms 0.5224ms 1.9141 KOps/s 1.9585 KOps/s $\color{#d91a1a}-2.27\%$
test_seq_wrap[compile] 0.4557ms 0.3685ms 2.7140 KOps/s 2.6697 KOps/s $\color{#35bf28}+1.66\%$
test_seq_wrap[compile-overhead] 0.3714ms 0.2674ms 3.7390 KOps/s 3.8394 KOps/s $\color{#d91a1a}-2.61\%$
test_func_call_runtime[False-eager] 0.9655ms 0.8554ms 1.1691 KOps/s 1.2238 KOps/s $\color{#d91a1a}-4.47\%$
test_func_call_runtime[False-compile] 1.0110ms 0.8981ms 1.1135 KOps/s 1.0903 KOps/s $\color{#35bf28}+2.12\%$
test_func_call_runtime[False-compile-overhead] 0.5488ms 0.4426ms 2.2592 KOps/s 2.2487 KOps/s $\color{#35bf28}+0.47\%$
test_func_call_runtime[True-eager] 1.1300ms 1.0362ms 965.1010 Ops/s 945.2390 Ops/s $\color{#35bf28}+2.10\%$
test_func_call_runtime[True-compile] 0.9776ms 0.8824ms 1.1333 KOps/s 1.1076 KOps/s $\color{#35bf28}+2.31\%$
test_func_call_runtime[True-compile-overhead] 0.5688ms 0.4557ms 2.1944 KOps/s 2.1594 KOps/s $\color{#35bf28}+1.62\%$
test_func_call_cm_runtime[False-eager] 0.9148ms 0.8085ms 1.2369 KOps/s 1.2098 KOps/s $\color{#35bf28}+2.23\%$
test_func_call_cm_runtime[False-compile] 0.9789ms 0.8749ms 1.1429 KOps/s 1.1144 KOps/s $\color{#35bf28}+2.56\%$
test_func_call_cm_runtime[False-compile-overhead] 0.5441ms 0.4442ms 2.2514 KOps/s 2.2261 KOps/s $\color{#35bf28}+1.14\%$
test_func_call_cm_runtime[True-eager] 1.2844ms 1.1839ms 844.6515 Ops/s 836.6641 Ops/s $\color{#35bf28}+0.95\%$
test_func_call_cm_runtime[True-compile] 1.0216ms 0.9172ms 1.0903 KOps/s 1.0653 KOps/s $\color{#35bf28}+2.34\%$
test_func_call_cm_runtime[True-compile-overhead] 1.0395ms 0.4928ms 2.0292 KOps/s 2.0227 KOps/s $\color{#35bf28}+0.32\%$
test_vmap_func_call_cm_runtime[eager] 2.7965ms 2.3090ms 433.0805 Ops/s 430.4573 Ops/s $\color{#35bf28}+0.61\%$
test_vmap_func_call_cm_runtime[compile] 1.1056ms 0.9695ms 1.0315 KOps/s 1.0468 KOps/s $\color{#d91a1a}-1.46\%$
test_vmap_func_call_cm_runtime[compile-overhead] 0.5486ms 0.5055ms 1.9784 KOps/s 1.9952 KOps/s $\color{#d91a1a}-0.84\%$
test_distributed 2.9670ms 0.1707ms 5.8576 KOps/s 6.4737 KOps/s $\textbf{\color{#d91a1a}-9.52\%}$
test_tdmodule 47.0410μs 26.4919μs 37.7473 KOps/s 36.5624 KOps/s $\color{#35bf28}+3.24\%$
test_tdmodule_dispatch 73.8120μs 43.4144μs 23.0338 KOps/s 22.3190 KOps/s $\color{#35bf28}+3.20\%$
test_tdseq 41.3610μs 25.9313μs 38.5634 KOps/s 37.8287 KOps/s $\color{#35bf28}+1.94\%$
test_tdseq_dispatch 74.6910μs 46.1089μs 21.6878 KOps/s 21.2536 KOps/s $\color{#35bf28}+2.04\%$
test_instantiation_functorch 2.0163ms 1.9460ms 513.8873 Ops/s 504.0020 Ops/s $\color{#35bf28}+1.96\%$
test_exec_functorch 0.2705ms 0.1711ms 5.8457 KOps/s 5.7194 KOps/s $\color{#35bf28}+2.21\%$
test_exec_functional_call 0.2466ms 0.1534ms 6.5209 KOps/s 6.3864 KOps/s $\color{#35bf28}+2.11\%$
test_exec_td_decorator 1.0585ms 0.2261ms 4.4221 KOps/s 4.3395 KOps/s $\color{#35bf28}+1.90\%$
test_vmap_mlp_speed_decorator[True-True] 1.0137ms 0.7965ms 1.2555 KOps/s 1.2380 KOps/s $\color{#35bf28}+1.41\%$
test_vmap_mlp_speed_decorator[True-False] 0.9944ms 0.8097ms 1.2350 KOps/s 1.2378 KOps/s $\color{#d91a1a}-0.23\%$
test_vmap_mlp_speed_decorator[False-True] 0.8736ms 0.7079ms 1.4127 KOps/s 1.4273 KOps/s $\color{#d91a1a}-1.02\%$
test_vmap_mlp_speed_decorator[False-False] 0.8975ms 0.7076ms 1.4133 KOps/s 1.4284 KOps/s $\color{#d91a1a}-1.06\%$
test_vmap_transformer_speed_decorator[True-True] 21.3165ms 20.3589ms 49.1186 Ops/s 49.3989 Ops/s $\color{#d91a1a}-0.57\%$
test_vmap_transformer_speed_decorator[True-False] 20.4859ms 20.3466ms 49.1481 Ops/s 49.3952 Ops/s $\color{#d91a1a}-0.50\%$
test_vmap_transformer_speed_decorator[False-True] 20.2798ms 20.1654ms 49.5899 Ops/s 49.7810 Ops/s $\color{#d91a1a}-0.38\%$
test_vmap_transformer_speed_decorator[False-False] 20.3471ms 20.1795ms 49.5553 Ops/s 49.8573 Ops/s $\color{#d91a1a}-0.61\%$
test_to_module_speed[True] 1.5069ms 1.4032ms 712.6475 Ops/s 711.8625 Ops/s $\color{#35bf28}+0.11\%$
test_to_module_speed[False] 1.4984ms 1.3789ms 725.2191 Ops/s 717.5751 Ops/s $\color{#35bf28}+1.07\%$
test_tc_init 70.9010μs 42.4294μs 23.5686 KOps/s 22.7209 KOps/s $\color{#35bf28}+3.73\%$
test_tc_init_tensor_only 39.0300μs 9.1857μs 108.8648 KOps/s 105.4734 KOps/s $\color{#35bf28}+3.22\%$
test_tc_init_nested 0.1690ms 84.7673μs 11.7970 KOps/s 11.4404 KOps/s $\color{#35bf28}+3.12\%$
test_tc_init_many_fields 46.6910μs 15.5745μs 64.2075 KOps/s 62.5874 KOps/s $\color{#35bf28}+2.59\%$
test_tc_first_layer_tensor 25.2210μs 1.7115μs 584.2728 KOps/s 567.6623 KOps/s $\color{#35bf28}+2.93\%$
test_tc_first_layer_tensor_only 12.4887μs 0.7028μs 1.4229 MOps/s 1.3693 MOps/s $\color{#35bf28}+3.92\%$
test_tc_first_layer_tensor_set 29.8610μs 3.5406μs 282.4407 KOps/s 266.9821 KOps/s $\textbf{\color{#35bf28}+5.79\%}$
test_tc_first_layer_tensor_only_set 19.8610μs 2.9247μs 341.9152 KOps/s 331.2685 KOps/s $\color{#35bf28}+3.21\%$
test_tc_first_layer_nontensor 28.3100μs 5.7862μs 172.8239 KOps/s 164.9711 KOps/s $\color{#35bf28}+4.76\%$
test_tc_second_layer_tensor 43.2710μs 4.1365μs 241.7506 KOps/s 236.4110 KOps/s $\color{#35bf28}+2.26\%$
test_tc_second_layer_nontensor 83.9920μs 8.1911μs 122.0834 KOps/s 120.0048 KOps/s $\color{#35bf28}+1.73\%$
test_unbind 0.2447s 16.1549ms 61.9006 Ops/s 69.1893 Ops/s $\textbf{\color{#d91a1a}-10.53\%}$
test_full_like 5.3074ms 4.4047ms 227.0291 Ops/s 134.1242 Ops/s $\textbf{\color{#35bf28}+69.27\%}$
test_zeros_like 4.9746ms 4.3725ms 228.7030 Ops/s 228.4664 Ops/s $\color{#35bf28}+0.10\%$
test_ones_like 4.5032ms 4.3768ms 228.4767 Ops/s 136.2717 Ops/s $\textbf{\color{#35bf28}+67.66\%}$
test_clone 6.7351ms 6.5243ms 153.2725 Ops/s 152.1759 Ops/s $\color{#35bf28}+0.72\%$
test_squeeze 64.2410μs 13.4110μs 74.5655 KOps/s 73.2340 KOps/s $\color{#35bf28}+1.82\%$
test_unsqueeze 0.1765ms 0.1049ms 9.5301 KOps/s 9.2378 KOps/s $\color{#35bf28}+3.16\%$
test_split 0.3737ms 0.1785ms 5.6017 KOps/s 5.5511 KOps/s $\color{#35bf28}+0.91\%$
test_permute 0.2767ms 0.2017ms 4.9571 KOps/s 4.9770 KOps/s $\color{#d91a1a}-0.40\%$
test_stack 51.7881ms 51.4160ms 19.4492 Ops/s 19.3493 Ops/s $\color{#35bf28}+0.52\%$
test_cat 52.0565ms 51.1983ms 19.5319 Ops/s 19.2822 Ops/s $\color{#35bf28}+1.30\%$

@github-actions

github-actions Bot commented Feb 18, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 243. Improved: $\large\color{#35bf28}18$. Worsened: $\large\color{#d91a1a}12$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_plain_set_nested 37.6010μs 14.6891μs 68.0775 KOps/s 67.7536 KOps/s $\color{#35bf28}+0.48\%$
test_plain_set_stack_nested 42.7810μs 14.8625μs 67.2832 KOps/s 67.0212 KOps/s $\color{#35bf28}+0.39\%$
test_plain_set_nested_inplace 58.6510μs 16.2385μs 61.5820 KOps/s 62.5221 KOps/s $\color{#d91a1a}-1.50\%$
test_plain_set_stack_nested_inplace 62.4020μs 16.1634μs 61.8680 KOps/s 61.2445 KOps/s $\color{#35bf28}+1.02\%$
test_items 41.8900μs 5.7554μs 173.7488 KOps/s 170.9949 KOps/s $\color{#35bf28}+1.61\%$
test_items_nested 0.5511ms 0.4517ms 2.2141 KOps/s 2.2087 KOps/s $\color{#35bf28}+0.25\%$
test_items_nested_locked 0.5510ms 0.4561ms 2.1927 KOps/s 2.1756 KOps/s $\color{#35bf28}+0.79\%$
test_items_nested_leaf 0.1296ms 95.7582μs 10.4430 KOps/s 10.3059 KOps/s $\color{#35bf28}+1.33\%$
test_items_stack_nested 0.5230ms 0.4523ms 2.2108 KOps/s 2.1996 KOps/s $\color{#35bf28}+0.51\%$
test_items_stack_nested_leaf 0.1273ms 96.0785μs 10.4082 KOps/s 10.2926 KOps/s $\color{#35bf28}+1.12\%$
test_items_stack_nested_locked 0.5542ms 0.4564ms 2.1910 KOps/s 2.2011 KOps/s $\color{#d91a1a}-0.46\%$
test_keys 37.8110μs 4.3681μs 228.9337 KOps/s 238.7274 KOps/s $\color{#d91a1a}-4.10\%$
test_keys_nested 0.1945ms 0.1209ms 8.2705 KOps/s 8.2969 KOps/s $\color{#d91a1a}-0.32\%$
test_keys_nested_locked 88.7052ms 0.1424ms 7.0222 KOps/s 7.7810 KOps/s $\textbf{\color{#d91a1a}-9.75\%}$
test_keys_nested_leaf 0.1480ms 0.1112ms 8.9889 KOps/s 9.0032 KOps/s $\color{#d91a1a}-0.16\%$
test_keys_stack_nested 0.1861ms 0.1208ms 8.2787 KOps/s 8.2558 KOps/s $\color{#35bf28}+0.28\%$
test_keys_stack_nested_leaf 0.1453ms 0.1112ms 8.9939 KOps/s 8.9931 KOps/s $+0.01\%$
test_keys_stack_nested_locked 0.1813ms 0.1298ms 7.7015 KOps/s 7.7831 KOps/s $\color{#d91a1a}-1.05\%$
test_values 5.4920μs 1.0299μs 971.0005 KOps/s 972.1419 KOps/s $\color{#d91a1a}-0.12\%$
test_values_nested 89.7110μs 47.9857μs 20.8395 KOps/s 20.7885 KOps/s $\color{#35bf28}+0.25\%$
test_values_nested_locked 89.9320μs 51.3945μs 19.4573 KOps/s 19.4738 KOps/s $\color{#d91a1a}-0.08\%$
test_values_nested_leaf 0.1173ms 54.0029μs 18.5175 KOps/s 18.3460 KOps/s $\color{#35bf28}+0.93\%$
test_values_stack_nested 82.3220μs 48.0438μs 20.8144 KOps/s 20.8614 KOps/s $\color{#d91a1a}-0.23\%$
test_values_stack_nested_leaf 94.9920μs 54.5741μs 18.3237 KOps/s 18.3758 KOps/s $\color{#d91a1a}-0.28\%$
test_values_stack_nested_locked 79.8810μs 51.0887μs 19.5738 KOps/s 19.5728 KOps/s $+0.00\%$
test_membership 5.8050μs 0.8387μs 1.1923 MOps/s 1.1689 MOps/s $\color{#35bf28}+2.00\%$
test_membership_nested 53.2910μs 2.8953μs 345.3855 KOps/s 343.8435 KOps/s $\color{#35bf28}+0.45\%$
test_membership_nested_leaf 34.3500μs 2.8929μs 345.6706 KOps/s 343.6710 KOps/s $\color{#35bf28}+0.58\%$
test_membership_stacked_nested 42.8110μs 2.8971μs 345.1767 KOps/s 355.5567 KOps/s $\color{#d91a1a}-2.92\%$
test_membership_stacked_nested_leaf 36.4910μs 2.9150μs 343.0514 KOps/s 342.1678 KOps/s $\color{#35bf28}+0.26\%$
test_membership_nested_last 34.2500μs 4.3296μs 230.9688 KOps/s 229.0057 KOps/s $\color{#35bf28}+0.86\%$
test_membership_nested_leaf_last 40.5910μs 4.3154μs 231.7283 KOps/s 230.9236 KOps/s $\color{#35bf28}+0.35\%$
test_membership_stacked_nested_last 30.8800μs 4.3106μs 231.9853 KOps/s 228.7886 KOps/s $\color{#35bf28}+1.40\%$
test_membership_stacked_nested_leaf_last 46.7910μs 4.3751μs 228.5677 KOps/s 227.8985 KOps/s $\color{#35bf28}+0.29\%$
test_nested_getleaf 48.6110μs 21.2684μs 47.0180 KOps/s 47.0244 KOps/s $\color{#d91a1a}-0.01\%$
test_nested_get 52.7810μs 20.0671μs 49.8328 KOps/s 49.1074 KOps/s $\color{#35bf28}+1.48\%$
test_stacked_getleaf 54.2010μs 21.0445μs 47.5184 KOps/s 46.4583 KOps/s $\color{#35bf28}+2.28\%$
test_stacked_get 50.6210μs 19.9483μs 50.1297 KOps/s 50.7448 KOps/s $\color{#d91a1a}-1.21\%$
test_nested_getitemleaf 61.0610μs 21.7675μs 45.9401 KOps/s 46.5705 KOps/s $\color{#d91a1a}-1.35\%$
test_nested_getitem 50.4610μs 20.7244μs 48.2522 KOps/s 48.7691 KOps/s $\color{#d91a1a}-1.06\%$
test_stacked_getitemleaf 52.0110μs 21.5578μs 46.3869 KOps/s 45.6786 KOps/s $\color{#35bf28}+1.55\%$
test_stacked_getitem 48.7610μs 20.4009μs 49.0175 KOps/s 47.3360 KOps/s $\color{#35bf28}+3.55\%$
test_lock_nested 7.8648ms 0.4828ms 2.0711 KOps/s 2.0725 KOps/s $\color{#d91a1a}-0.07\%$
test_lock_stack_nested 0.5732ms 0.4807ms 2.0805 KOps/s 2.0574 KOps/s $\color{#35bf28}+1.12\%$
test_unlock_nested 0.4626ms 0.3863ms 2.5888 KOps/s 2.5839 KOps/s $\color{#35bf28}+0.19\%$
test_unlock_stack_nested 0.4381ms 0.3857ms 2.5928 KOps/s 2.5459 KOps/s $\color{#35bf28}+1.84\%$
test_flatten_speed 0.1616ms 0.1221ms 8.1896 KOps/s 8.1465 KOps/s $\color{#35bf28}+0.53\%$
test_unflatten_speed 0.6302ms 0.5713ms 1.7504 KOps/s 1.7290 KOps/s $\color{#35bf28}+1.24\%$
test_common_ops 0.8404ms 0.6932ms 1.4426 KOps/s 1.4366 KOps/s $\color{#35bf28}+0.42\%$
test_creation 0.1306ms 2.9371μs 340.4707 KOps/s 341.6776 KOps/s $\color{#d91a1a}-0.35\%$
test_creation_empty 88.3210μs 6.0609μs 164.9909 KOps/s 160.9381 KOps/s $\color{#35bf28}+2.52\%$
test_creation_nested_1 37.2910μs 10.5273μs 94.9912 KOps/s 94.6333 KOps/s $\color{#35bf28}+0.38\%$
test_creation_nested_2 0.4357ms 12.0279μs 83.1397 KOps/s 83.7674 KOps/s $\color{#d91a1a}-0.75\%$
test_creation_many_keys[10] 0.4360ms 18.3780μs 54.4130 KOps/s 54.3856 KOps/s $\color{#35bf28}+0.05\%$
test_creation_many_keys[50] 0.1027ms 78.8196μs 12.6872 KOps/s 12.8031 KOps/s $\color{#d91a1a}-0.91\%$
test_creation_many_keys[100] 0.5873ms 0.1532ms 6.5269 KOps/s 6.5508 KOps/s $\color{#d91a1a}-0.37\%$
test_creation_nested_many_keys[10] 0.4697ms 39.3577μs 25.4080 KOps/s 25.2440 KOps/s $\color{#35bf28}+0.65\%$
test_creation_nested_many_keys[50] 0.5779ms 0.1602ms 6.2420 KOps/s 6.2470 KOps/s $\color{#d91a1a}-0.08\%$
test_clone 41.4410μs 13.8856μs 72.0172 KOps/s 72.7790 KOps/s $\color{#d91a1a}-1.05\%$
test_getitem[int] 1.7342ms 14.7070μs 67.9948 KOps/s 55.7394 KOps/s $\textbf{\color{#35bf28}+21.99\%}$
test_getitem[slice_int] 0.1434ms 24.6672μs 40.5396 KOps/s 39.9558 KOps/s $\color{#35bf28}+1.46\%$
test_getitem[range] 0.1710ms 62.1324μs 16.0947 KOps/s 15.8067 KOps/s $\color{#35bf28}+1.82\%$
test_getitem[tuple] 0.5089ms 24.1739μs 41.3670 KOps/s 41.2889 KOps/s $\color{#35bf28}+0.19\%$
test_getitem[list] 0.1824ms 57.6256μs 17.3534 KOps/s 17.1714 KOps/s $\color{#35bf28}+1.06\%$
test_setitem_dim[int] 48.3600μs 25.9278μs 38.5686 KOps/s 37.3521 KOps/s $\color{#35bf28}+3.26\%$
test_setitem_dim[slice_int] 65.1810μs 44.8034μs 22.3198 KOps/s 22.5695 KOps/s $\color{#d91a1a}-1.11\%$
test_setitem_dim[range] 0.1261ms 94.7183μs 10.5576 KOps/s 10.5103 KOps/s $\color{#35bf28}+0.45\%$
test_setitem_dim[tuple] 64.0710μs 41.2266μs 24.2562 KOps/s 24.6292 KOps/s $\color{#d91a1a}-1.51\%$
test_setitem 52.2910μs 18.1745μs 55.0223 KOps/s 54.8094 KOps/s $\color{#35bf28}+0.39\%$
test_set 0.4382ms 17.4538μs 57.2941 KOps/s 57.4253 KOps/s $\color{#d91a1a}-0.23\%$
test_set_shared 0.5087ms 0.2065ms 4.8429 KOps/s 4.7683 KOps/s $\color{#35bf28}+1.56\%$
test_update 0.4431ms 21.8852μs 45.6931 KOps/s 45.4896 KOps/s $\color{#35bf28}+0.45\%$
test_update_nested 75.0410μs 33.6706μs 29.6995 KOps/s 29.1811 KOps/s $\color{#35bf28}+1.78\%$
test_update__nested 0.4674ms 34.8908μs 28.6608 KOps/s 28.4031 KOps/s $\color{#35bf28}+0.91\%$
test_set_nested 0.1059ms 19.0780μs 52.4163 KOps/s 51.7844 KOps/s $\color{#35bf28}+1.22\%$
test_set_nested_new 0.4550ms 24.1843μs 41.3491 KOps/s 41.0424 KOps/s $\color{#35bf28}+0.75\%$
test_select 82.0320μs 41.8828μs 23.8761 KOps/s 23.5445 KOps/s $\color{#35bf28}+1.41\%$
test_select_nested 0.4986ms 74.9783μs 13.3372 KOps/s 13.2479 KOps/s $\color{#35bf28}+0.67\%$
test_exclude_nested 0.5498ms 92.6820μs 10.7896 KOps/s 10.6739 KOps/s $\color{#35bf28}+1.08\%$
test_empty[True] 0.8801ms 0.3922ms 2.5496 KOps/s 2.5469 KOps/s $\color{#35bf28}+0.10\%$
test_empty[False] 0.1147ms 1.3091μs 763.9016 KOps/s 752.9465 KOps/s $\color{#35bf28}+1.45\%$
test_to 0.1043ms 71.9951μs 13.8898 KOps/s 13.8961 KOps/s $\color{#d91a1a}-0.04\%$
test_to_nonblocking 0.5076ms 65.5834μs 15.2478 KOps/s 15.3066 KOps/s $\color{#d91a1a}-0.38\%$
test_unbind_speed 0.3748ms 0.3291ms 3.0382 KOps/s 2.9844 KOps/s $\color{#35bf28}+1.80\%$
test_unbind_speed_stack0 0.7681ms 0.3264ms 3.0637 KOps/s 3.0297 KOps/s $\color{#35bf28}+1.12\%$
test_unbind_speed_stack1 0.1020s 0.8395ms 1.1911 KOps/s 1.1737 KOps/s $\color{#35bf28}+1.49\%$
test_split 0.1018s 1.2669ms 789.3212 Ops/s 777.3493 Ops/s $\color{#35bf28}+1.54\%$
test_chunk 0.1030s 1.2156ms 822.6104 Ops/s 913.0817 Ops/s $\textbf{\color{#d91a1a}-9.91\%}$
test_to_cpu_blocking 28.4574ms 28.2837ms 35.3560 Ops/s 51.4902 Ops/s $\textbf{\color{#d91a1a}-31.33\%}$
test_to_cpu_global_sync 11.3969ms 11.2541ms 88.8565 Ops/s 80.2850 Ops/s $\textbf{\color{#35bf28}+10.68\%}$
test_to_cpu_event_sync 12.4895ms 12.2401ms 81.6989 Ops/s 82.0004 Ops/s $\color{#d91a1a}-0.37\%$
test_to_cpu_default 0.1140s 13.4647ms 74.2683 Ops/s 82.0115 Ops/s $\textbf{\color{#d91a1a}-9.44\%}$
test_consolidate[False-None] 4.2675ms 4.0981ms 244.0149 Ops/s 217.7251 Ops/s $\textbf{\color{#35bf28}+12.07\%}$
test_consolidate[default-None] 2.2723ms 2.0203ms 494.9769 Ops/s 482.9150 Ops/s $\color{#35bf28}+2.50\%$
test_consolidate[reduce-overhead-None] 2.0162ms 1.9314ms 517.7502 Ops/s 505.3079 Ops/s $\color{#35bf28}+2.46\%$
test_consolidate_njt[False-None] 8.8881ms 8.4890ms 117.7999 Ops/s 117.5570 Ops/s $\color{#35bf28}+0.21\%$
test_to[False-False-None] 2.1661ms 2.0724ms 482.5417 Ops/s 479.5896 Ops/s $\color{#35bf28}+0.62\%$
test_to[True-False-None] 2.2003ms 1.9427ms 514.7417 Ops/s 522.6077 Ops/s $\color{#d91a1a}-1.51\%$
test_to[within-False-None] 6.3208ms 6.1375ms 162.9325 Ops/s 162.9979 Ops/s $\color{#d91a1a}-0.04\%$
test_to[True-default-None] 8.0521ms 7.7555ms 128.9401 Ops/s 66.9108 Ops/s $\textbf{\color{#35bf28}+92.70\%}$
test_to_njt[False-False-None] 9.0973ms 8.6510ms 115.5938 Ops/s 116.7467 Ops/s $\color{#d91a1a}-0.99\%$
test_to_njt[True-False-None] 7.4741ms 7.3153ms 136.7000 Ops/s 143.6370 Ops/s $\color{#d91a1a}-4.83\%$
test_to_njt[within-False-None] 16.4847ms 16.0530ms 62.2938 Ops/s 64.4256 Ops/s $\color{#d91a1a}-3.31\%$
test_creation[device0] 0.5136ms 0.1190ms 8.4033 KOps/s 8.5782 KOps/s $\color{#d91a1a}-2.04\%$
test_creation_from_tensor 0.5394ms 0.1164ms 8.5907 KOps/s 8.7369 KOps/s $\color{#d91a1a}-1.67\%$
test_add_one[memmap_tensor0] 0.2132ms 7.2962μs 137.0569 KOps/s 150.0197 KOps/s $\textbf{\color{#d91a1a}-8.64\%}$
test_contiguous[memmap_tensor0] 13.6300μs 0.6713μs 1.4896 MOps/s 2.1913 MOps/s $\textbf{\color{#d91a1a}-32.02\%}$
test_stack[memmap_tensor0] 33.5310μs 4.6143μs 216.7178 KOps/s 221.8250 KOps/s $\color{#d91a1a}-2.30\%$
test_memmaptd_index 0.9618ms 0.2649ms 3.7748 KOps/s 3.7801 KOps/s $\color{#d91a1a}-0.14\%$
test_memmaptd_index_astensor 0.5162ms 0.3591ms 2.7844 KOps/s 2.7889 KOps/s $\color{#d91a1a}-0.16\%$
test_memmaptd_index_op 0.7500ms 0.6199ms 1.6131 KOps/s 1.6468 KOps/s $\color{#d91a1a}-2.05\%$
test_serialize_model 0.3107s 0.1630s 6.1356 Ops/s 7.3094 Ops/s $\textbf{\color{#d91a1a}-16.06\%}$
test_serialize_model_pickle 1.3467s 1.2104s 0.8262 Ops/s 0.8244 Ops/s $\color{#35bf28}+0.21\%$
test_serialize_weights 0.1382s 0.1361s 7.3480 Ops/s 7.3786 Ops/s $\color{#d91a1a}-0.41\%$
test_serialize_weights_returnearly 0.4475s 95.4830ms 10.4731 Ops/s 10.5866 Ops/s $\color{#d91a1a}-1.07\%$
test_serialize_weights_pickle 1.3624s 1.1943s 0.8373 Ops/s 0.8362 Ops/s $\color{#35bf28}+0.14\%$
test_reshape_pytree 0.2247ms 33.5471μs 29.8088 KOps/s 30.0301 KOps/s $\color{#d91a1a}-0.74\%$
test_reshape_td 65.5810μs 44.2834μs 22.5818 KOps/s 22.5224 KOps/s $\color{#35bf28}+0.26\%$
test_view_pytree 0.4884ms 33.3179μs 30.0139 KOps/s 30.2358 KOps/s $\color{#d91a1a}-0.73\%$
test_view_td 0.4888ms 52.6853μs 18.9806 KOps/s 19.0429 KOps/s $\color{#d91a1a}-0.33\%$
test_unbind_pytree 0.2355ms 37.3502μs 26.7736 KOps/s 26.8750 KOps/s $\color{#d91a1a}-0.38\%$
test_unbind_td 0.4823ms 49.1863μs 20.3309 KOps/s 19.9857 KOps/s $\color{#35bf28}+1.73\%$
test_split_pytree 0.2527ms 43.3808μs 23.0517 KOps/s 23.3047 KOps/s $\color{#d91a1a}-1.09\%$
test_split_td 0.4939ms 65.7255μs 15.2148 KOps/s 15.1079 KOps/s $\color{#35bf28}+0.71\%$
test_add_pytree 0.2009ms 43.6300μs 22.9200 KOps/s 23.0281 KOps/s $\color{#d91a1a}-0.47\%$
test_add_td 0.4837ms 54.3805μs 18.3890 KOps/s 18.1670 KOps/s $\color{#35bf28}+1.22\%$
test_compile_add_one_nested[tensordict-compile] 0.6304ms 0.1411ms 7.0870 KOps/s 6.7263 KOps/s $\textbf{\color{#35bf28}+5.36\%}$
test_compile_add_one_nested[tensordict-eager] 0.6293ms 0.1940ms 5.1549 KOps/s 5.2642 KOps/s $\color{#d91a1a}-2.08\%$
test_compile_add_one_nested[pytree-compile] 0.1481ms 0.1084ms 9.2286 KOps/s 9.0712 KOps/s $\color{#35bf28}+1.74\%$
test_compile_add_one_nested[pytree-eager] 0.6248ms 0.1807ms 5.5350 KOps/s 5.5072 KOps/s $\color{#35bf28}+0.50\%$
test_compile_copy_nested[tensordict-compile] 0.5002ms 29.6778μs 33.6953 KOps/s 28.5182 KOps/s $\textbf{\color{#35bf28}+18.15\%}$
test_compile_copy_nested[tensordict-eager] 80.8920μs 52.2283μs 19.1467 KOps/s 19.1336 KOps/s $\color{#35bf28}+0.07\%$
test_compile_copy_nested[pytree-compile] 33.6910μs 9.8216μs 101.8162 KOps/s 100.4552 KOps/s $\color{#35bf28}+1.35\%$
test_compile_copy_nested[pytree-eager] 0.4714ms 70.3943μs 14.2057 KOps/s 14.4983 KOps/s $\color{#d91a1a}-2.02\%$
test_compile_add_one_flat[tensordict-compile] 0.2161ms 0.1779ms 5.6201 KOps/s 5.3140 KOps/s $\textbf{\color{#35bf28}+5.76\%}$
test_compile_add_one_flat[tensordict-eager] 0.3004ms 0.2545ms 3.9297 KOps/s 3.9157 KOps/s $\color{#35bf28}+0.36\%$
test_compile_add_one_flat[tensorclass-compile] 0.1712ms 0.1159ms 8.6302 KOps/s 8.2146 KOps/s $\textbf{\color{#35bf28}+5.06\%}$
test_compile_add_one_flat[tensorclass-eager] 0.1121ms 68.1006μs 14.6842 KOps/s 14.3034 KOps/s $\color{#35bf28}+2.66\%$
test_compile_add_one_flat[pytree-compile] 0.1956ms 0.1586ms 6.3036 KOps/s 6.0965 KOps/s $\color{#35bf28}+3.40\%$
test_compile_add_one_flat[pytree-eager] 0.8376ms 0.5298ms 1.8876 KOps/s 1.8741 KOps/s $\color{#35bf28}+0.72\%$
test_compile_add_self_flat[tensordict-eager] 0.4620ms 0.3069ms 3.2584 KOps/s 3.1956 KOps/s $\color{#35bf28}+1.97\%$
test_compile_add_self_flat[tensordict-compile] 0.2188ms 0.1791ms 5.5836 KOps/s 5.2605 KOps/s $\textbf{\color{#35bf28}+6.14\%}$
test_compile_add_self_flat[tensorclass-eager] 0.1722ms 84.3435μs 11.8563 KOps/s 11.5066 KOps/s $\color{#35bf28}+3.04\%$
test_compile_add_self_flat[tensorclass-compile] 0.1661ms 0.1185ms 8.4383 KOps/s 8.0913 KOps/s $\color{#35bf28}+4.29\%$
test_compile_add_self_flat[pytree-eager] 0.6541ms 0.4306ms 2.3223 KOps/s 2.3056 KOps/s $\color{#35bf28}+0.72\%$
test_compile_add_self_flat[pytree-compile] 0.2106ms 0.1591ms 6.2834 KOps/s 6.1178 KOps/s $\color{#35bf28}+2.71\%$
test_compile_copy_flat[tensordict-compile] 63.7010μs 24.2483μs 41.2400 KOps/s 40.5057 KOps/s $\color{#35bf28}+1.81\%$
test_compile_copy_flat[tensordict-eager] 76.1520μs 41.3740μs 24.1697 KOps/s 24.3251 KOps/s $\color{#d91a1a}-0.64\%$
test_compile_copy_flat[pytree-compile] 50.3610μs 10.8918μs 91.8123 KOps/s 92.2881 KOps/s $\color{#d91a1a}-0.52\%$
test_compile_copy_flat[pytree-eager] 0.4037ms 52.6375μs 18.9979 KOps/s 19.0394 KOps/s $\color{#d91a1a}-0.22\%$
test_compile_assign_and_add[tensordict-compile] 2.0034ms 0.1741ms 5.7440 KOps/s 5.4392 KOps/s $\textbf{\color{#35bf28}+5.60\%}$
test_compile_assign_and_add[tensordict-eager] 3.4951ms 3.3166ms 301.5167 Ops/s 303.4225 Ops/s $\color{#d91a1a}-0.63\%$
test_compile_assign_and_add[pytree-compile] 1.9508ms 0.1625ms 6.1557 KOps/s 6.0273 KOps/s $\color{#35bf28}+2.13\%$
test_compile_assign_and_add[pytree-eager] 2.9258ms 2.7811ms 359.5728 Ops/s 356.4611 Ops/s $\color{#35bf28}+0.87\%$
test_compile_indexing[tensor-tensordict-compile] 0.1603ms 0.1079ms 9.2712 KOps/s 8.5694 KOps/s $\textbf{\color{#35bf28}+8.19\%}$
test_compile_indexing[tensor-tensordict-eager] 0.3139ms 72.5272μs 13.7879 KOps/s 13.3267 KOps/s $\color{#35bf28}+3.46\%$
test_compile_indexing[tensor-tensorclass-compile] 0.1726ms 95.8706μs 10.4307 KOps/s 9.9229 KOps/s $\textbf{\color{#35bf28}+5.12\%}$
test_compile_indexing[tensor-tensorclass-eager] 0.2636ms 44.9581μs 22.2429 KOps/s 20.8519 KOps/s $\textbf{\color{#35bf28}+6.67\%}$
test_compile_indexing[tensor-pytree-compile] 0.1514ms 97.0862μs 10.3001 KOps/s 10.1838 KOps/s $\color{#35bf28}+1.14\%$
test_compile_indexing[tensor-pytree-eager] 0.3063ms 46.1058μs 21.6893 KOps/s 21.9943 KOps/s $\color{#d91a1a}-1.39\%$
test_compile_indexing[slice-tensordict-compile] 91.5120μs 55.8040μs 17.9199 KOps/s 16.8185 KOps/s $\textbf{\color{#35bf28}+6.55\%}$
test_compile_indexing[slice-tensordict-eager] 0.2285ms 28.5984μs 34.9670 KOps/s 33.1083 KOps/s $\textbf{\color{#35bf28}+5.61\%}$
test_compile_indexing[slice-tensorclass-compile] 81.9410μs 45.3150μs 22.0677 KOps/s 21.5130 KOps/s $\color{#35bf28}+2.58\%$
test_compile_indexing[slice-tensorclass-eager] 0.2588ms 23.1891μs 43.1237 KOps/s 43.6929 KOps/s $\color{#d91a1a}-1.30\%$
test_compile_indexing[slice-pytree-compile] 96.5010μs 45.5384μs 21.9595 KOps/s 21.0006 KOps/s $\color{#35bf28}+4.57\%$
test_compile_indexing[slice-pytree-eager] 0.3108ms 23.0817μs 43.3243 KOps/s 41.8367 KOps/s $\color{#35bf28}+3.56\%$
test_compile_indexing[int-tensordict-compile] 0.1008ms 56.8246μs 17.5980 KOps/s 16.4284 KOps/s $\textbf{\color{#35bf28}+7.12\%}$
test_compile_indexing[int-tensordict-eager] 0.2654ms 27.9975μs 35.7175 KOps/s 34.0789 KOps/s $\color{#35bf28}+4.81\%$
test_compile_indexing[int-tensorclass-compile] 85.4120μs 45.4250μs 22.0143 KOps/s 21.2838 KOps/s $\color{#35bf28}+3.43\%$
test_compile_indexing[int-tensorclass-eager] 0.2708ms 23.0774μs 43.3324 KOps/s 43.4198 KOps/s $\color{#d91a1a}-0.20\%$
test_compile_indexing[int-pytree-compile] 0.1212ms 44.7508μs 22.3460 KOps/s 21.0491 KOps/s $\textbf{\color{#35bf28}+6.16\%}$
test_compile_indexing[int-pytree-eager] 0.2884ms 23.1461μs 43.2039 KOps/s 42.0150 KOps/s $\color{#35bf28}+2.83\%$
test_mod_add[eager] 94.7420μs 51.4486μs 19.4369 KOps/s 20.1842 KOps/s $\color{#d91a1a}-3.70\%$
test_mod_add[compile] 0.2130ms 0.1055ms 9.4792 KOps/s 9.3804 KOps/s $\color{#35bf28}+1.05\%$
test_mod_add[compile-overhead] 0.2359ms 0.1484ms 6.7391 KOps/s 6.6853 KOps/s $\color{#35bf28}+0.80\%$
test_mod_wrap[eager] 0.3670ms 0.2950ms 3.3899 KOps/s 3.3491 KOps/s $\color{#35bf28}+1.22\%$
test_mod_wrap[compile] 0.4214ms 0.3500ms 2.8572 KOps/s 2.8505 KOps/s $\color{#35bf28}+0.24\%$
test_mod_wrap[compile-overhead] 7.3392ms 4.0711ms 245.6351 Ops/s 247.8773 Ops/s $\color{#d91a1a}-0.90\%$
test_mod_wrap_and_backward[eager] 1.6150ms 1.5020ms 665.7932 Ops/s 665.7471 Ops/s $+0.01\%$
test_mod_wrap_and_backward[compile] 1.5428ms 1.4417ms 693.6155 Ops/s 688.3529 Ops/s $\color{#35bf28}+0.76\%$
test_mod_wrap_and_backward[compile-overhead] 1.3609ms 0.8867ms 1.1278 KOps/s 1.1105 KOps/s $\color{#35bf28}+1.56\%$
test_seq_add[eager] 0.2035ms 0.1597ms 6.2620 KOps/s 6.4600 KOps/s $\color{#d91a1a}-3.07\%$
test_seq_add[compile] 0.1533ms 0.1156ms 8.6503 KOps/s 8.4392 KOps/s $\color{#35bf28}+2.50\%$
test_seq_add[compile-overhead] 0.2552ms 0.1541ms 6.4897 KOps/s 6.3072 KOps/s $\color{#35bf28}+2.89\%$
test_seq_wrap[eager] 0.6237ms 0.5300ms 1.8869 KOps/s 1.9187 KOps/s $\color{#d91a1a}-1.66\%$
test_seq_wrap[compile] 0.4434ms 0.3679ms 2.7185 KOps/s 2.6961 KOps/s $\color{#35bf28}+0.83\%$
test_seq_wrap[compile-overhead] 0.3278ms 0.2666ms 3.7515 KOps/s 3.7490 KOps/s $\color{#35bf28}+0.07\%$
test_func_call_runtime[False-eager] 0.9015ms 0.8478ms 1.1795 KOps/s 1.2009 KOps/s $\color{#d91a1a}-1.78\%$
test_func_call_runtime[False-compile] 0.9700ms 0.9104ms 1.0985 KOps/s 1.0939 KOps/s $\color{#35bf28}+0.42\%$
test_func_call_runtime[False-compile-overhead] 0.5379ms 0.4634ms 2.1580 KOps/s 2.1476 KOps/s $\color{#35bf28}+0.48\%$
test_func_call_runtime[True-eager] 1.1624ms 1.0868ms 920.0938 Ops/s 915.2565 Ops/s $\color{#35bf28}+0.53\%$
test_func_call_runtime[True-compile] 0.9754ms 0.9233ms 1.0830 KOps/s 1.0827 KOps/s $\color{#35bf28}+0.03\%$
test_func_call_runtime[True-compile-overhead] 0.5209ms 0.4744ms 2.1077 KOps/s 2.0907 KOps/s $\color{#35bf28}+0.81\%$
test_func_call_cm_runtime[False-eager] 0.9031ms 0.8427ms 1.1867 KOps/s 1.1922 KOps/s $\color{#d91a1a}-0.46\%$
test_func_call_cm_runtime[False-compile] 0.9627ms 0.9147ms 1.0933 KOps/s 1.0867 KOps/s $\color{#35bf28}+0.61\%$
test_func_call_cm_runtime[False-compile-overhead] 0.5103ms 0.4658ms 2.1468 KOps/s 2.1553 KOps/s $\color{#d91a1a}-0.39\%$
test_func_call_cm_runtime[True-eager] 1.3533ms 1.2354ms 809.4802 Ops/s 812.9003 Ops/s $\color{#d91a1a}-0.42\%$
test_func_call_cm_runtime[True-compile] 1.0031ms 0.9572ms 1.0447 KOps/s 1.0449 KOps/s $\color{#d91a1a}-0.02\%$
test_func_call_cm_runtime[True-compile-overhead] 0.7289ms 0.5143ms 1.9444 KOps/s 1.9466 KOps/s $\color{#d91a1a}-0.11\%$
test_vmap_func_call_cm_runtime[eager] 2.8852ms 2.3773ms 420.6526 Ops/s 420.5310 Ops/s $\color{#35bf28}+0.03\%$
test_vmap_func_call_cm_runtime[compile] 1.0316ms 0.9780ms 1.0225 KOps/s 1.0030 KOps/s $\color{#35bf28}+1.95\%$
test_vmap_func_call_cm_runtime[compile-overhead] 0.5794ms 0.5120ms 1.9532 KOps/s 1.9207 KOps/s $\color{#35bf28}+1.70\%$
test_distributed 0.6279ms 0.1550ms 6.4536 KOps/s 6.4555 KOps/s $\color{#d91a1a}-0.03\%$
test_tdmodule 0.6206ms 30.2164μs 33.0947 KOps/s 35.1655 KOps/s $\textbf{\color{#d91a1a}-5.89\%}$
test_tdmodule_dispatch 76.7420μs 46.4410μs 21.5327 KOps/s 21.7454 KOps/s $\color{#d91a1a}-0.98\%$
test_tdseq 48.4310μs 27.9399μs 35.7911 KOps/s 36.9452 KOps/s $\color{#d91a1a}-3.12\%$
test_tdseq_dispatch 77.1620μs 48.3303μs 20.6910 KOps/s 20.4384 KOps/s $\color{#35bf28}+1.24\%$
test_instantiation_functorch 2.1602ms 2.0907ms 478.3050 Ops/s 478.5380 Ops/s $\color{#d91a1a}-0.05\%$
test_exec_functorch 0.2448ms 0.1840ms 5.4340 KOps/s 5.4761 KOps/s $\color{#d91a1a}-0.77\%$
test_exec_functional_call 0.2201ms 0.1632ms 6.1269 KOps/s 6.1170 KOps/s $\color{#35bf28}+0.16\%$
test_exec_td_decorator 0.4442ms 0.2411ms 4.1469 KOps/s 4.1562 KOps/s $\color{#d91a1a}-0.22\%$
test_vmap_mlp_speed_decorator[True-True] 1.0070ms 0.8305ms 1.2042 KOps/s 1.2126 KOps/s $\color{#d91a1a}-0.70\%$
test_vmap_mlp_speed_decorator[True-False] 1.0338ms 0.8311ms 1.2032 KOps/s 1.2115 KOps/s $\color{#d91a1a}-0.69\%$
test_vmap_mlp_speed_decorator[False-True] 0.9239ms 0.7185ms 1.3918 KOps/s 1.3989 KOps/s $\color{#d91a1a}-0.51\%$
test_vmap_mlp_speed_decorator[False-False] 0.9222ms 0.7176ms 1.3936 KOps/s 1.4001 KOps/s $\color{#d91a1a}-0.46\%$
test_vmap_transformer_speed_decorator[True-True] 21.1750ms 20.5667ms 48.6222 Ops/s 48.6527 Ops/s $\color{#d91a1a}-0.06\%$
test_vmap_transformer_speed_decorator[True-False] 21.2615ms 20.5497ms 48.6626 Ops/s 48.6039 Ops/s $\color{#35bf28}+0.12\%$
test_vmap_transformer_speed_decorator[False-True] 21.0642ms 20.3837ms 49.0588 Ops/s 49.0629 Ops/s $-0.01\%$
test_vmap_transformer_speed_decorator[False-False] 20.5753ms 20.3819ms 49.0631 Ops/s 49.0930 Ops/s $\color{#d91a1a}-0.06\%$
test_to_module_speed[True] 1.5806ms 1.4985ms 667.3297 Ops/s 669.3711 Ops/s $\color{#d91a1a}-0.30\%$
test_to_module_speed[False] 1.9676ms 1.4697ms 680.4251 Ops/s 681.3427 Ops/s $\color{#d91a1a}-0.13\%$
test_tc_init 68.9620μs 45.7859μs 21.8408 KOps/s 21.6135 KOps/s $\color{#35bf28}+1.05\%$
test_tc_init_tensor_only 42.0600μs 9.9996μs 100.0038 KOps/s 101.1266 KOps/s $\color{#d91a1a}-1.11\%$
test_tc_init_nested 0.1198ms 90.0465μs 11.1054 KOps/s 10.8825 KOps/s $\color{#35bf28}+2.05\%$
test_tc_init_many_fields 53.5710μs 16.6878μs 59.9240 KOps/s 59.7005 KOps/s $\color{#35bf28}+0.37\%$
test_tc_first_layer_tensor 24.0810μs 1.8624μs 536.9333 KOps/s 542.0516 KOps/s $\color{#d91a1a}-0.94\%$
test_tc_first_layer_tensor_only 4.1687μs 0.7534μs 1.3274 MOps/s 1.3422 MOps/s $\color{#d91a1a}-1.10\%$
test_tc_first_layer_tensor_set 21.3700μs 3.9945μs 250.3432 KOps/s 248.9524 KOps/s $\color{#35bf28}+0.56\%$
test_tc_first_layer_tensor_only_set 28.3610μs 3.2035μs 312.1584 KOps/s 312.8195 KOps/s $\color{#d91a1a}-0.21\%$
test_tc_first_layer_nontensor 40.6310μs 6.2329μs 160.4384 KOps/s 159.8363 KOps/s $\color{#35bf28}+0.38\%$
test_tc_second_layer_tensor 21.8810μs 4.4396μs 225.2449 KOps/s 221.3142 KOps/s $\color{#35bf28}+1.78\%$
test_tc_second_layer_nontensor 48.9110μs 8.8686μs 112.7571 KOps/s 111.9251 KOps/s $\color{#35bf28}+0.74\%$
test_unbind 0.2656s 16.0671ms 62.2388 Ops/s 55.9474 Ops/s $\textbf{\color{#35bf28}+11.25\%}$
test_full_like 10.5918ms 10.5124ms 95.1254 Ops/s 228.8429 Ops/s $\textbf{\color{#d91a1a}-58.43\%}$
test_zeros_like 13.8800ms 13.5209ms 73.9594 Ops/s 136.2007 Ops/s $\textbf{\color{#d91a1a}-45.70\%}$
test_ones_like 16.8979ms 16.6849ms 59.9345 Ops/s 228.1975 Ops/s $\textbf{\color{#d91a1a}-73.74\%}$
test_clone 17.8171ms 17.7001ms 56.4967 Ops/s 153.9163 Ops/s $\textbf{\color{#d91a1a}-63.29\%}$
test_squeeze 0.1052ms 14.5957μs 68.5134 KOps/s 69.1995 KOps/s $\color{#d91a1a}-0.99\%$
test_unsqueeze 0.1615ms 0.1109ms 9.0200 KOps/s 9.0241 KOps/s $\color{#d91a1a}-0.05\%$
test_split 0.2423ms 0.1830ms 5.4638 KOps/s 5.3867 KOps/s $\color{#35bf28}+1.43\%$
test_permute 0.2639ms 0.2032ms 4.9223 KOps/s 4.9158 KOps/s $\color{#35bf28}+0.13\%$
test_stack 51.8262ms 51.4768ms 19.4262 Ops/s 19.4178 Ops/s $\color{#35bf28}+0.04\%$
test_cat 51.6950ms 51.3998ms 19.4553 Ops/s 19.4103 Ops/s $\color{#35bf28}+0.23\%$

@vmoens
Update
f54f9c3 
[ghstack-poisoned]
@vmoens vmoens mentioned this pull request Feb 18, 2026
Merged
@vmoens
Update
54f8ffb 
[ghstack-poisoned]
This was referenced Feb 19, 2026
Closed
Merged
@github-actions

github-actions Bot commented Feb 19, 2026

Copy link
Copy Markdown
Contributor

PR Title Label Error

Unknown or invalid prefix [Distributed].

Current title: [Distributed] Add broadcast collective

Supported Prefixes

Your PR title must start with exactly one of these prefixes:

Prefix Label Applied Example
[BugFix] BugFix [BugFix] Fix memory leak in TensorDict
[Feature] Feature [Feature] Add new storage backend
[Doc] or [Docs] Documentation [Doc] Update installation guide
[Refactor] Refactor [Refactor] Clean up module imports
[CI] CI [CI] Fix workflow permissions
[Test] or [Tests] Test [Test] Add unit tests for nn module
[Compile] Compile [Compile] Fix torch.compile issue
[Performance] or [Perf] Perf [Perf] Optimize tensor operations
[Deprecation] Deprecation [Deprecation] Mark old function
[Setup] Setup [Setup] Update build configuration

Note: Common variations like singular/plural are supported (e.g., [Doc] or [Docs]).

@vmoens
Update
96ebfe3 
[ghstack-poisoned]
@github-actions

github-actions Bot commented Feb 19, 2026

Copy link
Copy Markdown
Contributor

PR Title Label Error

Unknown or invalid prefix [Distributed].

Current title: [Distributed] Add broadcast collective

Supported Prefixes

Your PR title must start with exactly one of these prefixes:

Prefix Label Applied Example
[BugFix] BugFix [BugFix] Fix memory leak in TensorDict
[Feature] Feature [Feature] Add new storage backend
[Doc] or [Docs] Documentation [Doc] Update installation guide
[Refactor] Refactor [Refactor] Clean up module imports
[CI] CI [CI] Fix workflow permissions
[Test] or [Tests] Test [Test] Add unit tests for nn module
[Compile] Compile [Compile] Fix torch.compile issue
[Performance] or [Perf] Perf [Perf] Optimize tensor operations
[Deprecation] Deprecation [Deprecation] Mark old function
[Setup] Setup [Setup] Update build configuration

Note: Common variations like singular/plural are supported (e.g., [Doc] or [Docs]).

vmoens added a commit that referenced this pull request Feb 19, 2026
@vmoens @cursoragent
[Distributed] Add broadcast collective
8032484 
New TensorDictBase.broadcast(src) method that broadcasts a tensordict
from the source rank to all other ranks using consolidated transport:
metadata via broadcast_object_list + storage via dist.broadcast.

Two messages total regardless of the number of leaf tensors.

Co-authored-by: Cursor <cursoragent@cursor.com>
ghstack-source-id: b89f29e
Pull-Request: #1588
Co-authored-by: Cursor <cursoragent@cursor.com>
@vmoens
vmoens merged commit 96ebfe3 into gh/vmoens/71/base Feb 19, 2026
35 of 53 checks passed
@vmoens
vmoens deleted the gh/vmoens/71/head branch February 19, 2026 10:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Distributed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@vmoens