Skip to content

[Distributed] Add scatter collective - #1591

Merged
vmoens merged 4 commits into
gh/vmoens/74/basefrom
gh/vmoens/74/head
Feb 19, 2026
Merged

[Distributed] Add scatter collective#1591
vmoens merged 4 commits into
gh/vmoens/74/basefrom
gh/vmoens/74/head

Conversation

@vmoens

@vmoens vmoens commented Feb 18, 2026 •
edited
Loading

Copy link
Copy Markdown
Collaborator

Stack from ghstack (oldest at bottom):

New TensorDictBase.scatter(src, tensordicts) method that scatters a
list of tensordicts from the source rank to all ranks. On source:
consolidates each TD, scatters metadata via scatter_object_list, pads
storages to uniform size and scatters via dist.scatter. Receivers
reconstruct from their metadata + storage slice.

Co-authored-by: Cursor cursoragent@cursor.com

@vmoens
Update
320ba54 
[ghstack-poisoned]
This was referenced Feb 18, 2026
Merged
Merged
Merged
Merged
Merged
Merged
@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Feb 18, 2026
@github-actions

github-actions Bot commented Feb 18, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 243. Improved: $\large\color{#35bf28}32$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_plain_set_nested 45.0710μs 14.1926μs 70.4591 KOps/s 70.6816 KOps/s $\color{#d91a1a}-0.31\%$
test_plain_set_stack_nested 40.3610μs 14.4279μs 69.3100 KOps/s 69.4142 KOps/s $\color{#d91a1a}-0.15\%$
test_plain_set_nested_inplace 42.6400μs 15.7590μs 63.4558 KOps/s 63.1414 KOps/s $\color{#35bf28}+0.50\%$
test_plain_set_stack_nested_inplace 50.6810μs 15.8690μs 63.0160 KOps/s 62.7375 KOps/s $\color{#35bf28}+0.44\%$
test_items 36.3610μs 5.5088μs 181.5282 KOps/s 179.5001 KOps/s $\color{#35bf28}+1.13\%$
test_items_nested 0.4963ms 0.4466ms 2.2392 KOps/s 2.3119 KOps/s $\color{#d91a1a}-3.14\%$
test_items_nested_locked 0.5605ms 0.4518ms 2.2135 KOps/s 2.2952 KOps/s $\color{#d91a1a}-3.56\%$
test_items_nested_leaf 0.1607ms 90.7443μs 11.0200 KOps/s 10.8792 KOps/s $\color{#35bf28}+1.29\%$
test_items_stack_nested 0.4967ms 0.4457ms 2.2438 KOps/s 2.2924 KOps/s $\color{#d91a1a}-2.12\%$
test_items_stack_nested_leaf 0.1447ms 92.8525μs 10.7698 KOps/s 10.8724 KOps/s $\color{#d91a1a}-0.94\%$
test_items_stack_nested_locked 0.5734ms 0.4504ms 2.2200 KOps/s 2.2656 KOps/s $\color{#d91a1a}-2.01\%$
test_keys 30.8210μs 4.1795μs 239.2608 KOps/s 237.3830 KOps/s $\color{#35bf28}+0.79\%$
test_keys_nested 0.1900ms 0.1187ms 8.4216 KOps/s 8.5370 KOps/s $\color{#d91a1a}-1.35\%$
test_keys_nested_locked 0.7080ms 0.1292ms 7.7387 KOps/s 7.8981 KOps/s $\color{#d91a1a}-2.02\%$
test_keys_nested_leaf 0.1669ms 0.1096ms 9.1252 KOps/s 9.2243 KOps/s $\color{#d91a1a}-1.07\%$
test_keys_stack_nested 0.1835ms 0.1191ms 8.3935 KOps/s 8.4883 KOps/s $\color{#d91a1a}-1.12\%$
test_keys_stack_nested_leaf 0.1720ms 0.1096ms 9.1215 KOps/s 9.2845 KOps/s $\color{#d91a1a}-1.76\%$
test_keys_stack_nested_locked 0.2141ms 0.1266ms 7.8966 KOps/s 7.9047 KOps/s $\color{#d91a1a}-0.10\%$
test_values 9.2540μs 0.9894μs 1.0108 MOps/s 1.0077 MOps/s $\color{#35bf28}+0.30\%$
test_values_nested 74.6610μs 46.8876μs 21.3276 KOps/s 21.4053 KOps/s $\color{#d91a1a}-0.36\%$
test_values_nested_locked 99.0720μs 50.0429μs 19.9829 KOps/s 19.9538 KOps/s $\color{#35bf28}+0.15\%$
test_values_nested_leaf 85.5620μs 53.3542μs 18.7427 KOps/s 18.5791 KOps/s $\color{#35bf28}+0.88\%$
test_values_stack_nested 78.5610μs 46.7607μs 21.3855 KOps/s 21.2401 KOps/s $\color{#35bf28}+0.68\%$
test_values_stack_nested_leaf 87.8310μs 53.5006μs 18.6914 KOps/s 18.6759 KOps/s $\color{#35bf28}+0.08\%$
test_values_stack_nested_locked 78.1610μs 49.8757μs 20.0499 KOps/s 19.7995 KOps/s $\color{#35bf28}+1.26\%$
test_membership 13.8953μs 0.8048μs 1.2426 MOps/s 1.2398 MOps/s $\color{#35bf28}+0.23\%$
test_membership_nested 88.5610μs 2.7274μs 366.6437 KOps/s 363.4050 KOps/s $\color{#35bf28}+0.89\%$
test_membership_nested_leaf 45.7005μs 2.6562μs 376.4823 KOps/s 365.6576 KOps/s $\color{#35bf28}+2.96\%$
test_membership_stacked_nested 38.8610μs 2.7285μs 366.5043 KOps/s 360.2372 KOps/s $\color{#35bf28}+1.74\%$
test_membership_stacked_nested_leaf 28.2900μs 2.6826μs 372.7709 KOps/s 362.6743 KOps/s $\color{#35bf28}+2.78\%$
test_membership_nested_last 28.4010μs 4.0500μs 246.9150 KOps/s 242.6378 KOps/s $\color{#35bf28}+1.76\%$
test_membership_nested_leaf_last 86.9310μs 4.0691μs 245.7541 KOps/s 242.9699 KOps/s $\color{#35bf28}+1.15\%$
test_membership_stacked_nested_last 23.6400μs 4.1087μs 243.3843 KOps/s 242.0819 KOps/s $\color{#35bf28}+0.54\%$
test_membership_stacked_nested_leaf_last 39.3310μs 4.0572μs 246.4729 KOps/s 240.4433 KOps/s $\color{#35bf28}+2.51\%$
test_nested_getleaf 0.1177ms 20.4640μs 48.8663 KOps/s 49.2604 KOps/s $\color{#d91a1a}-0.80\%$
test_nested_get 96.7510μs 19.3173μs 51.7669 KOps/s 51.8518 KOps/s $\color{#d91a1a}-0.16\%$
test_stacked_getleaf 0.1173ms 20.0964μs 49.7602 KOps/s 49.6876 KOps/s $\color{#35bf28}+0.15\%$
test_stacked_get 0.1043ms 19.2059μs 52.0672 KOps/s 51.3917 KOps/s $\color{#35bf28}+1.31\%$
test_nested_getitemleaf 59.4010μs 20.6922μs 48.3274 KOps/s 48.2064 KOps/s $\color{#35bf28}+0.25\%$
test_nested_getitem 0.1104ms 19.9007μs 50.2495 KOps/s 50.7052 KOps/s $\color{#d91a1a}-0.90\%$
test_stacked_getitemleaf 0.1102ms 20.7159μs 48.2720 KOps/s 48.1017 KOps/s $\color{#35bf28}+0.35\%$
test_stacked_getitem 0.1029ms 19.8641μs 50.3422 KOps/s 50.7729 KOps/s $\color{#d91a1a}-0.85\%$
test_lock_nested 7.7408ms 0.4522ms 2.2116 KOps/s 2.1874 KOps/s $\color{#35bf28}+1.11\%$
test_lock_stack_nested 0.4921ms 0.4501ms 2.2219 KOps/s 2.1727 KOps/s $\color{#35bf28}+2.27\%$
test_unlock_nested 0.4721ms 0.3593ms 2.7829 KOps/s 2.7250 KOps/s $\color{#35bf28}+2.12\%$
test_unlock_stack_nested 0.4198ms 0.3615ms 2.7661 KOps/s 2.6793 KOps/s $\color{#35bf28}+3.24\%$
test_flatten_speed 0.2019ms 0.1164ms 8.5914 KOps/s 8.5950 KOps/s $\color{#d91a1a}-0.04\%$
test_unflatten_speed 0.6283ms 0.5450ms 1.8348 KOps/s 1.8147 KOps/s $\color{#35bf28}+1.11\%$
test_common_ops 0.7823ms 0.6516ms 1.5348 KOps/s 1.4937 KOps/s $\color{#35bf28}+2.75\%$
test_creation 0.1205ms 2.7166μs 368.1101 KOps/s 367.7501 KOps/s $\color{#35bf28}+0.10\%$
test_creation_empty 37.1700μs 5.7375μs 174.2918 KOps/s 174.4270 KOps/s $\color{#d91a1a}-0.08\%$
test_creation_nested_1 34.5510μs 9.8910μs 101.1022 KOps/s 101.1510 KOps/s $\color{#d91a1a}-0.05\%$
test_creation_nested_2 93.8910μs 11.2247μs 89.0888 KOps/s 88.8811 KOps/s $\color{#35bf28}+0.23\%$
test_creation_many_keys[10] 96.0410μs 17.1714μs 58.2364 KOps/s 58.2729 KOps/s $\color{#d91a1a}-0.06\%$
test_creation_many_keys[50] 99.8110μs 72.9909μs 13.7003 KOps/s 13.7726 KOps/s $\color{#d91a1a}-0.52\%$
test_creation_many_keys[100] 0.2230ms 0.1427ms 7.0055 KOps/s 7.0194 KOps/s $\color{#d91a1a}-0.20\%$
test_creation_nested_many_keys[10] 0.1205ms 37.0242μs 27.0094 KOps/s 27.2563 KOps/s $\color{#d91a1a}-0.91\%$
test_creation_nested_many_keys[50] 0.2279ms 0.1498ms 6.6758 KOps/s 6.7485 KOps/s $\color{#d91a1a}-1.08\%$
test_clone 47.3400μs 12.5689μs 79.5614 KOps/s 76.2561 KOps/s $\color{#35bf28}+4.33\%$
test_getitem[int] 1.8582ms 13.7657μs 72.6444 KOps/s 57.1365 KOps/s $\textbf{\color{#35bf28}+27.14\%}$
test_getitem[slice_int] 0.1457ms 23.0763μs 43.3344 KOps/s 42.2419 KOps/s $\color{#35bf28}+2.59\%$
test_getitem[range] 0.1773ms 58.4574μs 17.1065 KOps/s 16.4437 KOps/s $\color{#35bf28}+4.03\%$
test_getitem[tuple] 0.1938ms 22.4610μs 44.5216 KOps/s 43.3767 KOps/s $\color{#35bf28}+2.64\%$
test_getitem[list] 0.1828ms 54.3165μs 18.4106 KOps/s 17.1570 KOps/s $\textbf{\color{#35bf28}+7.31\%}$
test_setitem_dim[int] 43.3800μs 24.0544μs 41.5724 KOps/s 39.1201 KOps/s $\textbf{\color{#35bf28}+6.27\%}$
test_setitem_dim[slice_int] 63.1510μs 41.1976μs 24.2733 KOps/s 22.3518 KOps/s $\textbf{\color{#35bf28}+8.60\%}$
test_setitem_dim[range] 0.1267ms 89.0742μs 11.2266 KOps/s 10.3077 KOps/s $\textbf{\color{#35bf28}+8.91\%}$
test_setitem_dim[tuple] 58.3910μs 38.0130μs 26.3068 KOps/s 23.8865 KOps/s $\textbf{\color{#35bf28}+10.13\%}$
test_setitem 60.4310μs 16.4774μs 60.6893 KOps/s 57.5404 KOps/s $\textbf{\color{#35bf28}+5.47\%}$
test_set 0.1054ms 15.7669μs 63.4241 KOps/s 59.8281 KOps/s $\textbf{\color{#35bf28}+6.01\%}$
test_set_shared 0.5146ms 0.2025ms 4.9375 KOps/s 4.7928 KOps/s $\color{#35bf28}+3.02\%$
test_update 0.1989ms 19.9359μs 50.1607 KOps/s 45.1868 KOps/s $\textbf{\color{#35bf28}+11.01\%}$
test_update_nested 67.9910μs 31.0685μs 32.1869 KOps/s 29.5320 KOps/s $\textbf{\color{#35bf28}+8.99\%}$
test_update__nested 0.4644ms 32.0910μs 31.1614 KOps/s 29.5427 KOps/s $\textbf{\color{#35bf28}+5.48\%}$
test_set_nested 49.4210μs 17.4573μs 57.2828 KOps/s 53.9442 KOps/s $\textbf{\color{#35bf28}+6.19\%}$
test_set_nested_new 0.1067ms 22.5595μs 44.3271 KOps/s 40.7361 KOps/s $\textbf{\color{#35bf28}+8.82\%}$
test_select 73.6410μs 38.8855μs 25.7165 KOps/s 23.4648 KOps/s $\textbf{\color{#35bf28}+9.60\%}$
test_select_nested 0.1558ms 70.6553μs 14.1532 KOps/s 14.0011 KOps/s $\color{#35bf28}+1.09\%$
test_exclude_nested 0.1706ms 87.1433μs 11.4754 KOps/s 11.4440 KOps/s $\color{#35bf28}+0.27\%$
test_empty[True] 0.4230ms 0.3759ms 2.6603 KOps/s 2.6563 KOps/s $\color{#35bf28}+0.15\%$
test_empty[False] 0.2040ms 1.2632μs 791.6300 KOps/s 796.4585 KOps/s $\color{#d91a1a}-0.61\%$
test_to 0.1025ms 69.9446μs 14.2970 KOps/s 13.9141 KOps/s $\color{#35bf28}+2.75\%$
test_to_nonblocking 0.1045ms 61.4844μs 16.2643 KOps/s 15.3826 KOps/s $\textbf{\color{#35bf28}+5.73\%}$
test_unbind_speed 0.3501ms 0.3049ms 3.2793 KOps/s 3.2251 KOps/s $\color{#35bf28}+1.68\%$
test_unbind_speed_stack0 0.4031ms 0.3031ms 3.2994 KOps/s 3.2276 KOps/s $\color{#35bf28}+2.22\%$
test_unbind_speed_stack1 0.1038s 0.8754ms 1.1423 KOps/s 1.1252 KOps/s $\color{#35bf28}+1.52\%$
test_split 1.1776ms 1.0880ms 919.1303 Ops/s 909.4982 Ops/s $\color{#35bf28}+1.06\%$
test_chunk 0.1030s 1.1667ms 857.1124 Ops/s 953.8996 Ops/s $\textbf{\color{#d91a1a}-10.15\%}$
test_to_cpu_blocking 28.3948ms 28.2852ms 35.3541 Ops/s 46.6929 Ops/s $\textbf{\color{#d91a1a}-24.28\%}$
test_to_cpu_global_sync 11.0019ms 10.9077ms 91.6781 Ops/s 89.6155 Ops/s $\color{#35bf28}+2.30\%$
test_to_cpu_event_sync 0.1158s 13.1123ms 76.2643 Ops/s 81.8925 Ops/s $\textbf{\color{#d91a1a}-6.87\%}$
test_to_cpu_default 12.1164ms 11.8755ms 84.2071 Ops/s 82.3959 Ops/s $\color{#35bf28}+2.20\%$
test_consolidate[False-None] 3.9516ms 3.8468ms 259.9569 Ops/s 226.4301 Ops/s $\textbf{\color{#35bf28}+14.81\%}$
test_consolidate[default-None] 2.0151ms 1.9323ms 517.5240 Ops/s 500.8718 Ops/s $\color{#35bf28}+3.32\%$
test_consolidate[reduce-overhead-None] 1.9297ms 1.8549ms 539.1225 Ops/s 519.3562 Ops/s $\color{#35bf28}+3.81\%$
test_consolidate_njt[False-None] 8.2543ms 8.0923ms 123.5736 Ops/s 124.7213 Ops/s $\color{#d91a1a}-0.92\%$
test_to[False-False-None] 2.1408ms 2.0210ms 494.7932 Ops/s 489.1932 Ops/s $\color{#35bf28}+1.14\%$
test_to[True-False-None] 2.1523ms 1.8748ms 533.3850 Ops/s 554.1105 Ops/s $\color{#d91a1a}-3.74\%$
test_to[within-False-None] 6.1196ms 5.8252ms 171.6693 Ops/s 171.1631 Ops/s $\color{#35bf28}+0.30\%$
test_to[True-default-None] 7.5490ms 7.4228ms 134.7201 Ops/s 70.1522 Ops/s $\textbf{\color{#35bf28}+92.04\%}$
test_to_njt[False-False-None] 8.3243ms 8.2010ms 121.9369 Ops/s 120.9799 Ops/s $\color{#35bf28}+0.79\%$
test_to_njt[True-False-None] 6.8737ms 6.7251ms 148.6966 Ops/s 151.6344 Ops/s $\color{#d91a1a}-1.94\%$
test_to_njt[within-False-None] 15.0535ms 14.9370ms 66.9477 Ops/s 67.9550 Ops/s $\color{#d91a1a}-1.48\%$
test_creation[device0] 0.4001ms 0.1137ms 8.7972 KOps/s 8.9022 KOps/s $\color{#d91a1a}-1.18\%$
test_creation_from_tensor 0.4289ms 0.1116ms 8.9582 KOps/s 9.0226 KOps/s $\color{#d91a1a}-0.71\%$
test_add_one[memmap_tensor0] 0.3655ms 6.1393μs 162.8847 KOps/s 155.8787 KOps/s $\color{#35bf28}+4.49\%$
test_contiguous[memmap_tensor0] 26.9810μs 0.6116μs 1.6350 MOps/s 2.2394 MOps/s $\textbf{\color{#d91a1a}-26.99\%}$
test_stack[memmap_tensor0] 50.9510μs 4.4340μs 225.5322 KOps/s 215.6990 KOps/s $\color{#35bf28}+4.56\%$
test_memmaptd_index 1.0795ms 0.2489ms 4.0170 KOps/s 4.0110 KOps/s $\color{#35bf28}+0.15\%$
test_memmaptd_index_astensor 0.4961ms 0.3387ms 2.9526 KOps/s 2.9575 KOps/s $\color{#d91a1a}-0.16\%$
test_memmaptd_index_op 0.8205ms 0.5662ms 1.7661 KOps/s 1.7426 KOps/s $\color{#35bf28}+1.34\%$
test_serialize_model 0.1392s 0.1371s 7.2949 Ops/s 7.3056 Ops/s $\color{#d91a1a}-0.15\%$
test_serialize_model_pickle 1.3500s 1.2121s 0.8250 Ops/s 0.8261 Ops/s $\color{#d91a1a}-0.13\%$
test_serialize_weights 0.1398s 0.1359s 7.3587 Ops/s 7.3180 Ops/s $\color{#35bf28}+0.56\%$
test_serialize_weights_returnearly 0.4301s 92.0538ms 10.8632 Ops/s 10.5444 Ops/s $\color{#35bf28}+3.02\%$
test_serialize_weights_pickle 1.3656s 1.2126s 0.8247 Ops/s 0.8212 Ops/s $\color{#35bf28}+0.42\%$
test_reshape_pytree 0.2002ms 31.4045μs 31.8426 KOps/s 31.1387 KOps/s $\color{#35bf28}+2.26\%$
test_reshape_td 0.1209ms 41.0067μs 24.3863 KOps/s 24.1527 KOps/s $\color{#35bf28}+0.97\%$
test_view_pytree 0.2228ms 31.2297μs 32.0208 KOps/s 31.6031 KOps/s $\color{#35bf28}+1.32\%$
test_view_td 0.1312ms 49.1650μs 20.3397 KOps/s 20.2955 KOps/s $\color{#35bf28}+0.22\%$
test_unbind_pytree 0.2463ms 35.2656μs 28.3562 KOps/s 27.9610 KOps/s $\color{#35bf28}+1.41\%$
test_unbind_td 0.1359ms 46.1697μs 21.6592 KOps/s 21.2959 KOps/s $\color{#35bf28}+1.71\%$
test_split_pytree 0.2485ms 41.0139μs 24.3820 KOps/s 24.5912 KOps/s $\color{#d91a1a}-0.85\%$
test_split_td 0.1718ms 62.1191μs 16.0981 KOps/s 16.3863 KOps/s $\color{#d91a1a}-1.76\%$
test_add_pytree 0.2132ms 41.0954μs 24.3336 KOps/s 24.5917 KOps/s $\color{#d91a1a}-1.05\%$
test_add_td 92.5220μs 52.9952μs 18.8696 KOps/s 19.7761 KOps/s $\color{#d91a1a}-4.58\%$
test_compile_add_one_nested[tensordict-compile] 0.1952ms 0.1390ms 7.1920 KOps/s 7.0083 KOps/s $\color{#35bf28}+2.62\%$
test_compile_add_one_nested[tensordict-eager] 0.3022ms 0.1905ms 5.2504 KOps/s 5.3942 KOps/s $\color{#d91a1a}-2.67\%$
test_compile_add_one_nested[pytree-compile] 0.1458ms 0.1084ms 9.2216 KOps/s 9.3568 KOps/s $\color{#d91a1a}-1.45\%$
test_compile_add_one_nested[pytree-eager] 0.4494ms 0.1759ms 5.6847 KOps/s 5.7458 KOps/s $\color{#d91a1a}-1.06\%$
test_compile_copy_nested[tensordict-compile] 54.7610μs 26.5605μs 37.6499 KOps/s 31.1960 KOps/s $\textbf{\color{#35bf28}+20.69\%}$
test_compile_copy_nested[tensordict-eager] 0.1467ms 49.9458μs 20.0217 KOps/s 20.1708 KOps/s $\color{#d91a1a}-0.74\%$
test_compile_copy_nested[pytree-compile] 0.1166ms 9.0931μs 109.9741 KOps/s 104.1400 KOps/s $\textbf{\color{#35bf28}+5.60\%}$
test_compile_copy_nested[pytree-eager] 0.4517ms 66.3222μs 15.0779 KOps/s 15.4934 KOps/s $\color{#d91a1a}-2.68\%$
test_compile_add_one_flat[tensordict-compile] 0.2185ms 0.1724ms 5.8010 KOps/s 5.5183 KOps/s $\textbf{\color{#35bf28}+5.12\%}$
test_compile_add_one_flat[tensordict-eager] 0.3566ms 0.2486ms 4.0228 KOps/s 4.0070 KOps/s $\color{#35bf28}+0.39\%$
test_compile_add_one_flat[tensorclass-compile] 0.2299ms 0.1143ms 8.7508 KOps/s 8.6073 KOps/s $\color{#35bf28}+1.67\%$
test_compile_add_one_flat[tensorclass-eager] 0.1201ms 67.2985μs 14.8592 KOps/s 14.7774 KOps/s $\color{#35bf28}+0.55\%$
test_compile_add_one_flat[pytree-compile] 0.1905ms 0.1551ms 6.4463 KOps/s 6.2254 KOps/s $\color{#35bf28}+3.55\%$
test_compile_add_one_flat[pytree-eager] 0.7917ms 0.5148ms 1.9423 KOps/s 1.9026 KOps/s $\color{#35bf28}+2.09\%$
test_compile_add_self_flat[tensordict-eager] 0.3810ms 0.3003ms 3.3301 KOps/s 3.2274 KOps/s $\color{#35bf28}+3.18\%$
test_compile_add_self_flat[tensordict-compile] 0.2316ms 0.1754ms 5.7028 KOps/s 5.2834 KOps/s $\textbf{\color{#35bf28}+7.94\%}$
test_compile_add_self_flat[tensorclass-eager] 0.1854ms 82.2714μs 12.1549 KOps/s 12.0518 KOps/s $\color{#35bf28}+0.86\%$
test_compile_add_self_flat[tensorclass-compile] 0.2372ms 0.1171ms 8.5429 KOps/s 8.1314 KOps/s $\textbf{\color{#35bf28}+5.06\%}$
test_compile_add_self_flat[pytree-eager] 0.6331ms 0.4268ms 2.3433 KOps/s 2.2522 KOps/s $\color{#35bf28}+4.04\%$
test_compile_add_self_flat[pytree-compile] 0.2495ms 0.1562ms 6.4023 KOps/s 6.2269 KOps/s $\color{#35bf28}+2.82\%$
test_compile_copy_flat[tensordict-compile] 70.2410μs 21.2981μs 46.9526 KOps/s 39.4748 KOps/s $\textbf{\color{#35bf28}+18.94\%}$
test_compile_copy_flat[tensordict-eager] 0.1394ms 40.1981μs 24.8768 KOps/s 24.7503 KOps/s $\color{#35bf28}+0.51\%$
test_compile_copy_flat[pytree-compile] 0.1171ms 10.0679μs 99.3251 KOps/s 95.3448 KOps/s $\color{#35bf28}+4.17\%$
test_compile_copy_flat[pytree-eager] 0.3941ms 50.7696μs 19.6968 KOps/s 19.6631 KOps/s $\color{#35bf28}+0.17\%$
test_compile_assign_and_add[tensordict-compile] 1.9206ms 0.1695ms 5.8989 KOps/s 5.6001 KOps/s $\textbf{\color{#35bf28}+5.33\%}$
test_compile_assign_and_add[tensordict-eager] 3.2738ms 3.1323ms 319.2559 Ops/s 299.2359 Ops/s $\textbf{\color{#35bf28}+6.69\%}$
test_compile_assign_and_add[pytree-compile] 1.9076ms 0.1567ms 6.3836 KOps/s 6.2212 KOps/s $\color{#35bf28}+2.61\%$
test_compile_assign_and_add[pytree-eager] 2.8810ms 2.6870ms 372.1580 Ops/s 348.6596 Ops/s $\textbf{\color{#35bf28}+6.74\%}$
test_compile_indexing[tensor-tensordict-compile] 0.1978ms 0.1057ms 9.4597 KOps/s 9.0836 KOps/s $\color{#35bf28}+4.14\%$
test_compile_indexing[tensor-tensordict-eager] 0.3079ms 71.0704μs 14.0706 KOps/s 13.5013 KOps/s $\color{#35bf28}+4.22\%$
test_compile_indexing[tensor-tensorclass-compile] 0.2023ms 94.1692μs 10.6192 KOps/s 10.2963 KOps/s $\color{#35bf28}+3.14\%$
test_compile_indexing[tensor-tensorclass-eager] 0.2600ms 42.4940μs 23.5327 KOps/s 21.2400 KOps/s $\textbf{\color{#35bf28}+10.79\%}$
test_compile_indexing[tensor-pytree-compile] 0.1761ms 94.6217μs 10.5684 KOps/s 10.4078 KOps/s $\color{#35bf28}+1.54\%$
test_compile_indexing[tensor-pytree-eager] 0.2411ms 42.4146μs 23.5768 KOps/s 22.4286 KOps/s $\textbf{\color{#35bf28}+5.12\%}$
test_compile_indexing[slice-tensordict-compile] 0.1312ms 54.6334μs 18.3038 KOps/s 17.7996 KOps/s $\color{#35bf28}+2.83\%$
test_compile_indexing[slice-tensordict-eager] 0.2365ms 27.5693μs 36.2722 KOps/s 37.3273 KOps/s $\color{#d91a1a}-2.83\%$
test_compile_indexing[slice-tensorclass-compile] 0.1519ms 42.9148μs 23.3020 KOps/s 21.8816 KOps/s $\textbf{\color{#35bf28}+6.49\%}$
test_compile_indexing[slice-tensorclass-eager] 0.2620ms 21.5422μs 46.4204 KOps/s 45.5989 KOps/s $\color{#35bf28}+1.80\%$
test_compile_indexing[slice-pytree-compile] 97.8410μs 43.6832μs 22.8921 KOps/s 22.0863 KOps/s $\color{#35bf28}+3.65\%$
test_compile_indexing[slice-pytree-eager] 0.2531ms 21.4255μs 46.6734 KOps/s 45.7760 KOps/s $\color{#35bf28}+1.96\%$
test_compile_indexing[int-tensordict-compile] 0.1377ms 54.2002μs 18.4501 KOps/s 17.8574 KOps/s $\color{#35bf28}+3.32\%$
test_compile_indexing[int-tensordict-eager] 0.2259ms 26.1216μs 38.2825 KOps/s 37.9038 KOps/s $\color{#35bf28}+1.00\%$
test_compile_indexing[int-tensorclass-compile] 0.1317ms 43.6625μs 22.9029 KOps/s 21.9789 KOps/s $\color{#35bf28}+4.20\%$
test_compile_indexing[int-tensorclass-eager] 0.2644ms 21.5084μs 46.4934 KOps/s 45.6714 KOps/s $\color{#35bf28}+1.80\%$
test_compile_indexing[int-pytree-compile] 0.1207ms 43.2026μs 23.1467 KOps/s 22.1692 KOps/s $\color{#35bf28}+4.41\%$
test_compile_indexing[int-pytree-eager] 0.2603ms 21.5657μs 46.3698 KOps/s 45.8083 KOps/s $\color{#35bf28}+1.23\%$
test_mod_add[eager] 0.1613ms 46.9432μs 21.3024 KOps/s 19.0314 KOps/s $\textbf{\color{#35bf28}+11.93\%}$
test_mod_add[compile] 0.1718ms 0.1036ms 9.6566 KOps/s 9.5799 KOps/s $\color{#35bf28}+0.80\%$
test_mod_add[compile-overhead] 0.2282ms 0.1446ms 6.9153 KOps/s 6.6628 KOps/s $\color{#35bf28}+3.79\%$
test_mod_wrap[eager] 0.4033ms 0.2829ms 3.5344 KOps/s 3.4804 KOps/s $\color{#35bf28}+1.55\%$
test_mod_wrap[compile] 0.3986ms 0.3402ms 2.9391 KOps/s 2.8355 KOps/s $\color{#35bf28}+3.65\%$
test_mod_wrap[compile-overhead] 7.1201ms 3.9136ms 255.5191 Ops/s 246.6998 Ops/s $\color{#35bf28}+3.57\%$
test_mod_wrap_and_backward[eager] 1.5852ms 1.4785ms 676.3691 Ops/s 680.4719 Ops/s $\color{#d91a1a}-0.60\%$
test_mod_wrap_and_backward[compile] 1.5675ms 1.4147ms 706.8612 Ops/s 688.4432 Ops/s $\color{#35bf28}+2.68\%$
test_mod_wrap_and_backward[compile-overhead] 1.2160ms 0.8618ms 1.1604 KOps/s 1.1283 KOps/s $\color{#35bf28}+2.84\%$
test_seq_add[eager] 0.2034ms 0.1521ms 6.5741 KOps/s 6.3155 KOps/s $\color{#35bf28}+4.09\%$
test_seq_add[compile] 0.1861ms 0.1122ms 8.9155 KOps/s 8.3210 KOps/s $\textbf{\color{#35bf28}+7.14\%}$
test_seq_add[compile-overhead] 0.2212ms 0.1494ms 6.6950 KOps/s 6.2561 KOps/s $\textbf{\color{#35bf28}+7.02\%}$
test_seq_wrap[eager] 0.6066ms 0.5097ms 1.9620 KOps/s 1.9238 KOps/s $\color{#35bf28}+1.98\%$
test_seq_wrap[compile] 0.4169ms 0.3588ms 2.7869 KOps/s 2.7294 KOps/s $\color{#35bf28}+2.11\%$
test_seq_wrap[compile-overhead] 0.3248ms 0.2580ms 3.8765 KOps/s 3.7807 KOps/s $\color{#35bf28}+2.53\%$
test_func_call_runtime[False-eager] 0.9123ms 0.8254ms 1.2116 KOps/s 1.1988 KOps/s $\color{#35bf28}+1.06\%$
test_func_call_runtime[False-compile] 1.0920ms 0.8723ms 1.1464 KOps/s 1.1197 KOps/s $\color{#35bf28}+2.38\%$
test_func_call_runtime[False-compile-overhead] 0.5448ms 0.4376ms 2.2850 KOps/s 2.2086 KOps/s $\color{#35bf28}+3.46\%$
test_func_call_runtime[True-eager] 1.1563ms 1.0471ms 954.9858 Ops/s 932.4430 Ops/s $\color{#35bf28}+2.42\%$
test_func_call_runtime[True-compile] 1.0261ms 0.9122ms 1.0963 KOps/s 1.1019 KOps/s $\color{#d91a1a}-0.51\%$
test_func_call_runtime[True-compile-overhead] 0.5963ms 0.4533ms 2.2059 KOps/s 2.1846 KOps/s $\color{#35bf28}+0.97\%$
test_func_call_cm_runtime[False-eager] 0.9804ms 0.8483ms 1.1788 KOps/s 1.2056 KOps/s $\color{#d91a1a}-2.23\%$
test_func_call_cm_runtime[False-compile] 1.0027ms 0.8793ms 1.1372 KOps/s 1.1313 KOps/s $\color{#35bf28}+0.52\%$
test_func_call_cm_runtime[False-compile-overhead] 0.5382ms 0.4402ms 2.2717 KOps/s 2.2494 KOps/s $\color{#35bf28}+0.99\%$
test_func_call_cm_runtime[True-eager] 1.3302ms 1.2273ms 814.8280 Ops/s 838.5330 Ops/s $\color{#d91a1a}-2.83\%$
test_func_call_cm_runtime[True-compile] 1.0399ms 0.9130ms 1.0953 KOps/s 1.0791 KOps/s $\color{#35bf28}+1.50\%$
test_func_call_cm_runtime[True-compile-overhead] 0.5923ms 0.4858ms 2.0586 KOps/s 2.0444 KOps/s $\color{#35bf28}+0.69\%$
test_vmap_func_call_cm_runtime[eager] 2.8377ms 2.3617ms 423.4293 Ops/s 427.6037 Ops/s $\color{#d91a1a}-0.98\%$
test_vmap_func_call_cm_runtime[compile] 1.0675ms 0.9651ms 1.0361 KOps/s 1.0572 KOps/s $\color{#d91a1a}-1.99\%$
test_vmap_func_call_cm_runtime[compile-overhead] 0.6078ms 0.4994ms 2.0026 KOps/s 1.9966 KOps/s $\color{#35bf28}+0.30\%$
test_distributed 0.5697ms 0.1529ms 6.5411 KOps/s 6.5409 KOps/s $+0.00\%$
test_tdmodule 48.0400μs 27.2893μs 36.6445 KOps/s 36.2716 KOps/s $\color{#35bf28}+1.03\%$
test_tdmodule_dispatch 74.2310μs 44.1526μs 22.6487 KOps/s 22.5227 KOps/s $\color{#35bf28}+0.56\%$
test_tdseq 47.8800μs 26.6842μs 37.4753 KOps/s 37.7276 KOps/s $\color{#d91a1a}-0.67\%$
test_tdseq_dispatch 88.7620μs 46.6215μs 21.4493 KOps/s 21.5758 KOps/s $\color{#d91a1a}-0.59\%$
test_instantiation_functorch 2.0661ms 1.9645ms 509.0331 Ops/s 504.0725 Ops/s $\color{#35bf28}+0.98\%$
test_exec_functorch 0.2685ms 0.1724ms 5.8016 KOps/s 5.6840 KOps/s $\color{#35bf28}+2.07\%$
test_exec_functional_call 0.2096ms 0.1553ms 6.4375 KOps/s 6.3878 KOps/s $\color{#35bf28}+0.78\%$
test_exec_td_decorator 0.4740ms 0.2315ms 4.3188 KOps/s 4.3740 KOps/s $\color{#d91a1a}-1.26\%$
test_vmap_mlp_speed_decorator[True-True] 0.9945ms 0.8005ms 1.2492 KOps/s 1.2199 KOps/s $\color{#35bf28}+2.40\%$
test_vmap_mlp_speed_decorator[True-False] 0.9741ms 0.7997ms 1.2505 KOps/s 1.2211 KOps/s $\color{#35bf28}+2.41\%$
test_vmap_mlp_speed_decorator[False-True] 0.8684ms 0.6936ms 1.4418 KOps/s 1.4070 KOps/s $\color{#35bf28}+2.47\%$
test_vmap_mlp_speed_decorator[False-False] 0.8724ms 0.6935ms 1.4419 KOps/s 1.4075 KOps/s $\color{#35bf28}+2.45\%$
test_vmap_transformer_speed_decorator[True-True] 20.0602ms 19.9814ms 50.0466 Ops/s 48.5075 Ops/s $\color{#35bf28}+3.17\%$
test_vmap_transformer_speed_decorator[True-False] 20.1659ms 19.9985ms 50.0038 Ops/s 48.4896 Ops/s $\color{#35bf28}+3.12\%$
test_vmap_transformer_speed_decorator[False-True] 19.8911ms 19.7882ms 50.5352 Ops/s 48.9878 Ops/s $\color{#35bf28}+3.16\%$
test_vmap_transformer_speed_decorator[False-False] 20.2631ms 19.8169ms 50.4619 Ops/s 48.9407 Ops/s $\color{#35bf28}+3.11\%$
test_to_module_speed[True] 1.5926ms 1.4103ms 709.0905 Ops/s 696.1670 Ops/s $\color{#35bf28}+1.86\%$
test_to_module_speed[False] 1.5313ms 1.3852ms 721.8918 Ops/s 706.3760 Ops/s $\color{#35bf28}+2.20\%$
test_tc_init 69.5810μs 43.2557μs 23.1183 KOps/s 22.8441 KOps/s $\color{#35bf28}+1.20\%$
test_tc_init_tensor_only 51.0100μs 9.2287μs 108.3572 KOps/s 106.8559 KOps/s $\color{#35bf28}+1.41\%$
test_tc_init_nested 0.1697ms 85.5698μs 11.6864 KOps/s 11.3025 KOps/s $\color{#35bf28}+3.40\%$
test_tc_init_many_fields 64.9000μs 15.5033μs 64.5024 KOps/s 62.6030 KOps/s $\color{#35bf28}+3.03\%$
test_tc_first_layer_tensor 20.3500μs 1.7182μs 582.0065 KOps/s 572.1986 KOps/s $\color{#35bf28}+1.71\%$
test_tc_first_layer_tensor_only 12.9030μs 0.6990μs 1.4307 MOps/s 1.3726 MOps/s $\color{#35bf28}+4.23\%$
test_tc_first_layer_tensor_set 89.0410μs 3.7307μs 268.0444 KOps/s 268.2075 KOps/s $\color{#d91a1a}-0.06\%$
test_tc_first_layer_tensor_only_set 28.5600μs 2.9546μs 338.4515 KOps/s 336.6495 KOps/s $\color{#35bf28}+0.54\%$
test_tc_first_layer_nontensor 46.6000μs 5.7742μs 173.1856 KOps/s 172.0978 KOps/s $\color{#35bf28}+0.63\%$
test_tc_second_layer_tensor 21.5900μs 4.1409μs 241.4924 KOps/s 236.8128 KOps/s $\color{#35bf28}+1.98\%$
test_tc_second_layer_nontensor 98.2810μs 8.1835μs 122.1978 KOps/s 120.6127 KOps/s $\color{#35bf28}+1.31\%$
test_unbind 0.2483s 15.9275ms 62.7844 Ops/s 64.8184 Ops/s $\color{#d91a1a}-3.14\%$
test_full_like 5.2096ms 4.3935ms 227.6074 Ops/s 225.7466 Ops/s $\color{#35bf28}+0.82\%$
test_zeros_like 4.4881ms 4.3670ms 228.9905 Ops/s 226.3440 Ops/s $\color{#35bf28}+1.17\%$
test_ones_like 4.4852ms 4.3714ms 228.7596 Ops/s 226.0498 Ops/s $\color{#35bf28}+1.20\%$
test_clone 7.0911ms 6.5022ms 153.7932 Ops/s 152.1584 Ops/s $\color{#35bf28}+1.07\%$
test_squeeze 0.2042ms 13.4877μs 74.1418 KOps/s 72.8700 KOps/s $\color{#35bf28}+1.75\%$
test_unsqueeze 0.2044ms 0.1067ms 9.3686 KOps/s 9.5226 KOps/s $\color{#d91a1a}-1.62\%$
test_split 0.2365ms 0.1766ms 5.6620 KOps/s 5.7061 KOps/s $\color{#d91a1a}-0.77\%$
test_permute 0.3059ms 0.2050ms 4.8780 KOps/s 5.0139 KOps/s $\color{#d91a1a}-2.71\%$
test_stack 51.8736ms 51.5948ms 19.3818 Ops/s 19.4131 Ops/s $\color{#d91a1a}-0.16\%$
test_cat 51.8241ms 51.5563ms 19.3963 Ops/s 19.4699 Ops/s $\color{#d91a1a}-0.38\%$

@github-actions

github-actions Bot commented Feb 18, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 243. Improved: $\large\color{#35bf28}18$. Worsened: $\large\color{#d91a1a}10$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_plain_set_nested 36.6700μs 14.1734μs 70.5546 KOps/s 70.5289 KOps/s $\color{#35bf28}+0.04\%$
test_plain_set_stack_nested 59.7310μs 14.3292μs 69.7878 KOps/s 69.5999 KOps/s $\color{#35bf28}+0.27\%$
test_plain_set_nested_inplace 40.5710μs 15.6598μs 63.8577 KOps/s 63.0381 KOps/s $\color{#35bf28}+1.30\%$
test_plain_set_stack_nested_inplace 40.3410μs 15.6816μs 63.7688 KOps/s 63.4277 KOps/s $\color{#35bf28}+0.54\%$
test_items 32.5400μs 5.5418μs 180.4474 KOps/s 179.9025 KOps/s $\color{#35bf28}+0.30\%$
test_items_nested 0.5142ms 0.4419ms 2.2627 KOps/s 2.2755 KOps/s $\color{#d91a1a}-0.56\%$
test_items_nested_locked 0.5244ms 0.4390ms 2.2778 KOps/s 2.2601 KOps/s $\color{#35bf28}+0.78\%$
test_items_nested_leaf 0.1406ms 93.2999μs 10.7181 KOps/s 10.7702 KOps/s $\color{#d91a1a}-0.48\%$
test_items_stack_nested 0.5472ms 0.4373ms 2.2868 KOps/s 2.2621 KOps/s $\color{#35bf28}+1.09\%$
test_items_stack_nested_leaf 0.1344ms 90.7922μs 11.0142 KOps/s 10.9382 KOps/s $\color{#35bf28}+0.69\%$
test_items_stack_nested_locked 0.5237ms 0.4448ms 2.2481 KOps/s 2.2260 KOps/s $\color{#35bf28}+0.99\%$
test_keys 35.8010μs 4.2228μs 236.8114 KOps/s 243.3886 KOps/s $\color{#d91a1a}-2.70\%$
test_keys_nested 0.1598ms 0.1180ms 8.4767 KOps/s 8.4933 KOps/s $\color{#d91a1a}-0.19\%$
test_keys_nested_locked 0.6819ms 0.1269ms 7.8808 KOps/s 7.9004 KOps/s $\color{#d91a1a}-0.25\%$
test_keys_nested_leaf 0.1485ms 0.1088ms 9.1923 KOps/s 9.0871 KOps/s $\color{#35bf28}+1.16\%$
test_keys_stack_nested 0.1653ms 0.1178ms 8.4876 KOps/s 8.4238 KOps/s $\color{#35bf28}+0.76\%$
test_keys_stack_nested_leaf 0.1390ms 0.1087ms 9.1985 KOps/s 9.1354 KOps/s $\color{#35bf28}+0.69\%$
test_keys_stack_nested_locked 0.1661ms 0.1282ms 7.7975 KOps/s 7.9060 KOps/s $\color{#d91a1a}-1.37\%$
test_values 5.7340μs 1.0002μs 999.7840 KOps/s 683.6734 KOps/s $\textbf{\color{#35bf28}+46.24\%}$
test_values_nested 77.7420μs 46.8673μs 21.3369 KOps/s 21.3897 KOps/s $\color{#d91a1a}-0.25\%$
test_values_nested_locked 82.8510μs 49.8228μs 20.0711 KOps/s 19.9135 KOps/s $\color{#35bf28}+0.79\%$
test_values_nested_leaf 83.0020μs 53.1898μs 18.8006 KOps/s 18.7627 KOps/s $\color{#35bf28}+0.20\%$
test_values_stack_nested 79.3220μs 46.5861μs 21.4656 KOps/s 21.3487 KOps/s $\color{#35bf28}+0.55\%$
test_values_stack_nested_leaf 84.0810μs 52.9010μs 18.9033 KOps/s 18.9572 KOps/s $\color{#d91a1a}-0.28\%$
test_values_stack_nested_locked 80.7410μs 49.5310μs 20.1894 KOps/s 19.9731 KOps/s $\color{#35bf28}+1.08\%$
test_membership 5.3200μs 0.8111μs 1.2329 MOps/s 1.2528 MOps/s $\color{#d91a1a}-1.58\%$
test_membership_nested 33.0610μs 2.7749μs 360.3784 KOps/s 362.7950 KOps/s $\color{#d91a1a}-0.67\%$
test_membership_nested_leaf 17.8305μs 2.6905μs 371.6743 KOps/s 362.9186 KOps/s $\color{#35bf28}+2.41\%$
test_membership_stacked_nested 35.0410μs 2.7788μs 359.8681 KOps/s 361.6186 KOps/s $\color{#d91a1a}-0.48\%$
test_membership_stacked_nested_leaf 29.9410μs 2.7731μs 360.6008 KOps/s 354.2708 KOps/s $\color{#35bf28}+1.79\%$
test_membership_nested_last 29.5810μs 4.1517μs 240.8649 KOps/s 241.5404 KOps/s $\color{#d91a1a}-0.28\%$
test_membership_nested_leaf_last 37.5500μs 4.1003μs 243.8841 KOps/s 240.5337 KOps/s $\color{#35bf28}+1.39\%$
test_membership_stacked_nested_last 27.4000μs 4.1469μs 241.1466 KOps/s 242.7386 KOps/s $\color{#d91a1a}-0.66\%$
test_membership_stacked_nested_leaf_last 32.1400μs 4.1532μs 240.7761 KOps/s 242.1665 KOps/s $\color{#d91a1a}-0.57\%$
test_nested_getleaf 49.6410μs 20.5957μs 48.5539 KOps/s 49.9922 KOps/s $\color{#d91a1a}-2.88\%$
test_nested_get 47.3210μs 19.4805μs 51.3333 KOps/s 52.5339 KOps/s $\color{#d91a1a}-2.29\%$
test_stacked_getleaf 49.2510μs 20.6806μs 48.3545 KOps/s 49.1494 KOps/s $\color{#d91a1a}-1.62\%$
test_stacked_get 48.9810μs 19.5800μs 51.0725 KOps/s 52.3848 KOps/s $\color{#d91a1a}-2.51\%$
test_nested_getitemleaf 46.8810μs 21.1122μs 47.3661 KOps/s 48.9220 KOps/s $\color{#d91a1a}-3.18\%$
test_nested_getitem 55.6610μs 19.9318μs 50.1711 KOps/s 50.6983 KOps/s $\color{#d91a1a}-1.04\%$
test_stacked_getitemleaf 72.7020μs 21.1264μs 47.3342 KOps/s 48.0195 KOps/s $\color{#d91a1a}-1.43\%$
test_stacked_getitem 50.6610μs 20.0462μs 49.8848 KOps/s 50.5786 KOps/s $\color{#d91a1a}-1.37\%$
test_lock_nested 7.9131ms 0.4567ms 2.1898 KOps/s 2.1748 KOps/s $\color{#35bf28}+0.69\%$
test_lock_stack_nested 0.5057ms 0.4551ms 2.1974 KOps/s 2.1515 KOps/s $\color{#35bf28}+2.13\%$
test_unlock_nested 0.4973ms 0.3649ms 2.7405 KOps/s 2.6721 KOps/s $\color{#35bf28}+2.56\%$
test_unlock_stack_nested 0.3977ms 0.3655ms 2.7363 KOps/s 2.6551 KOps/s $\color{#35bf28}+3.06\%$
test_flatten_speed 0.1710ms 0.1168ms 8.5614 KOps/s 8.4897 KOps/s $\color{#35bf28}+0.84\%$
test_unflatten_speed 0.6053ms 0.5507ms 1.8159 KOps/s 1.8116 KOps/s $\color{#35bf28}+0.24\%$
test_common_ops 0.8069ms 0.6687ms 1.4955 KOps/s 1.4484 KOps/s $\color{#35bf28}+3.25\%$
test_creation 0.1044ms 2.7411μs 364.8104 KOps/s 373.9878 KOps/s $\color{#d91a1a}-2.45\%$
test_creation_empty 29.1010μs 5.7558μs 173.7376 KOps/s 173.3648 KOps/s $\color{#35bf28}+0.22\%$
test_creation_nested_1 37.8300μs 10.1419μs 98.6006 KOps/s 100.7350 KOps/s $\color{#d91a1a}-2.12\%$
test_creation_nested_2 37.3800μs 11.2293μs 89.0529 KOps/s 89.1508 KOps/s $\color{#d91a1a}-0.11\%$
test_creation_many_keys[10] 52.9410μs 17.0077μs 58.7969 KOps/s 59.3003 KOps/s $\color{#d91a1a}-0.85\%$
test_creation_many_keys[50] 0.1078ms 72.4587μs 13.8010 KOps/s 13.6905 KOps/s $\color{#35bf28}+0.81\%$
test_creation_many_keys[100] 0.2201ms 0.1406ms 7.1107 KOps/s 7.0342 KOps/s $\color{#35bf28}+1.09\%$
test_creation_nested_many_keys[10] 64.8010μs 36.7221μs 27.2316 KOps/s 27.2638 KOps/s $\color{#d91a1a}-0.12\%$
test_creation_nested_many_keys[50] 0.1982ms 0.1487ms 6.7256 KOps/s 6.7177 KOps/s $\color{#35bf28}+0.12\%$
test_clone 48.0900μs 12.9472μs 77.2368 KOps/s 75.9826 KOps/s $\color{#35bf28}+1.65\%$
test_getitem[int] 1.7434ms 14.0722μs 71.0621 KOps/s 56.4646 KOps/s $\textbf{\color{#35bf28}+25.85\%}$
test_getitem[slice_int] 0.1340ms 24.0538μs 41.5735 KOps/s 41.6967 KOps/s $\color{#d91a1a}-0.30\%$
test_getitem[range] 0.1732ms 59.6336μs 16.7691 KOps/s 16.1526 KOps/s $\color{#35bf28}+3.82\%$
test_getitem[tuple] 0.1532ms 23.1896μs 43.1228 KOps/s 42.6256 KOps/s $\color{#35bf28}+1.17\%$
test_getitem[list] 0.1764ms 54.8989μs 18.2153 KOps/s 16.9741 KOps/s $\textbf{\color{#35bf28}+7.31\%}$
test_setitem_dim[int] 44.7510μs 25.3061μs 39.5162 KOps/s 37.2623 KOps/s $\textbf{\color{#35bf28}+6.05\%}$
test_setitem_dim[slice_int] 95.0720μs 42.5579μs 23.4974 KOps/s 22.5152 KOps/s $\color{#35bf28}+4.36\%$
test_setitem_dim[range] 0.1209ms 90.0165μs 11.1091 KOps/s 10.8161 KOps/s $\color{#35bf28}+2.71\%$
test_setitem_dim[tuple] 61.2710μs 39.7367μs 25.1656 KOps/s 24.6691 KOps/s $\color{#35bf28}+2.01\%$
test_setitem 56.7210μs 17.2355μs 58.0197 KOps/s 56.9782 KOps/s $\color{#35bf28}+1.83\%$
test_set 58.8510μs 16.0901μs 62.1502 KOps/s 59.6468 KOps/s $\color{#35bf28}+4.20\%$
test_set_shared 0.5100ms 0.2031ms 4.9247 KOps/s 4.8313 KOps/s $\color{#35bf28}+1.93\%$
test_update 0.3398ms 20.8177μs 48.0360 KOps/s 45.3386 KOps/s $\textbf{\color{#35bf28}+5.95\%}$
test_update_nested 63.5110μs 32.4425μs 30.8238 KOps/s 31.0132 KOps/s $\color{#d91a1a}-0.61\%$
test_update__nested 0.4938ms 33.0064μs 30.2972 KOps/s 29.1548 KOps/s $\color{#35bf28}+3.92\%$
test_set_nested 53.5400μs 18.3465μs 54.5064 KOps/s 53.7777 KOps/s $\color{#35bf28}+1.36\%$
test_set_nested_new 72.4510μs 23.4485μs 42.6467 KOps/s 42.9925 KOps/s $\color{#d91a1a}-0.80\%$
test_select 70.6710μs 40.6647μs 24.5914 KOps/s 24.4094 KOps/s $\color{#35bf28}+0.75\%$
test_select_nested 0.1062ms 70.9540μs 14.0936 KOps/s 14.1609 KOps/s $\color{#d91a1a}-0.48\%$
test_exclude_nested 0.1309ms 87.2843μs 11.4568 KOps/s 11.4911 KOps/s $\color{#d91a1a}-0.30\%$
test_empty[True] 0.4299ms 0.3749ms 2.6677 KOps/s 2.6262 KOps/s $\color{#35bf28}+1.58\%$
test_empty[False] 7.7803μs 1.2637μs 791.3288 KOps/s 803.3294 KOps/s $\color{#d91a1a}-1.49\%$
test_to 0.1029ms 71.0262μs 14.0793 KOps/s 13.5264 KOps/s $\color{#35bf28}+4.09\%$
test_to_nonblocking 0.1000ms 63.5132μs 15.7447 KOps/s 14.9979 KOps/s $\color{#35bf28}+4.98\%$
test_unbind_speed 0.3516ms 0.3146ms 3.1783 KOps/s 3.2159 KOps/s $\color{#d91a1a}-1.17\%$
test_unbind_speed_stack0 0.3574ms 0.3074ms 3.2527 KOps/s 3.1979 KOps/s $\color{#35bf28}+1.71\%$
test_unbind_speed_stack1 0.1035s 0.8773ms 1.1399 KOps/s 1.1155 KOps/s $\color{#35bf28}+2.19\%$
test_split 1.1641ms 1.0934ms 914.5463 Ops/s 913.3802 Ops/s $\color{#35bf28}+0.13\%$
test_chunk 0.1032s 1.1612ms 861.1510 Ops/s 956.8306 Ops/s $\textbf{\color{#d91a1a}-10.00\%}$
test_to_cpu_blocking 19.2407ms 19.0024ms 52.6251 Ops/s 32.4818 Ops/s $\textbf{\color{#35bf28}+62.01\%}$
test_to_cpu_global_sync 11.0902ms 10.9869ms 91.0176 Ops/s 89.8835 Ops/s $\color{#35bf28}+1.26\%$
test_to_cpu_event_sync 12.2236ms 11.9604ms 83.6092 Ops/s 82.4525 Ops/s $\color{#35bf28}+1.40\%$
test_to_cpu_default 0.1147s 13.2062ms 75.7218 Ops/s 82.2393 Ops/s $\textbf{\color{#d91a1a}-7.93\%}$
test_consolidate[False-None] 4.1280ms 3.9546ms 252.8729 Ops/s 223.0822 Ops/s $\textbf{\color{#35bf28}+13.35\%}$
test_consolidate[default-None] 2.0439ms 1.9259ms 519.2302 Ops/s 496.0137 Ops/s $\color{#35bf28}+4.68\%$
test_consolidate[reduce-overhead-None] 1.9605ms 1.8421ms 542.8572 Ops/s 513.9153 Ops/s $\textbf{\color{#35bf28}+5.63\%}$
test_consolidate_njt[False-None] 8.4439ms 8.1982ms 121.9783 Ops/s 120.5860 Ops/s $\color{#35bf28}+1.15\%$
test_to[False-False-None] 2.1111ms 2.0043ms 498.9234 Ops/s 491.9037 Ops/s $\color{#35bf28}+1.43\%$
test_to[True-False-None] 2.1390ms 1.8831ms 531.0397 Ops/s 533.9300 Ops/s $\color{#d91a1a}-0.54\%$
test_to[within-False-None] 6.1935ms 5.9493ms 168.0877 Ops/s 168.6223 Ops/s $\color{#d91a1a}-0.32\%$
test_to[True-default-None] 7.5347ms 7.4336ms 134.5251 Ops/s 133.1373 Ops/s $\color{#35bf28}+1.04\%$
test_to_njt[False-False-None] 8.4110ms 8.2321ms 121.4758 Ops/s 119.8112 Ops/s $\color{#35bf28}+1.39\%$
test_to_njt[True-False-None] 6.9194ms 6.7422ms 148.3195 Ops/s 147.7647 Ops/s $\color{#35bf28}+0.38\%$
test_to_njt[within-False-None] 15.1452ms 14.9935ms 66.6955 Ops/s 65.7464 Ops/s $\color{#35bf28}+1.44\%$
test_creation[device0] 0.3407ms 0.1145ms 8.7315 KOps/s 8.8502 KOps/s $\color{#d91a1a}-1.34\%$
test_creation_from_tensor 0.5211ms 0.1129ms 8.8544 KOps/s 9.0525 KOps/s $\color{#d91a1a}-2.19\%$
test_add_one[memmap_tensor0] 0.4363ms 6.4064μs 156.0930 KOps/s 156.1323 KOps/s $\color{#d91a1a}-0.03\%$
test_contiguous[memmap_tensor0] 26.5000μs 0.6129μs 1.6316 MOps/s 2.1504 MOps/s $\textbf{\color{#d91a1a}-24.12\%}$
test_stack[memmap_tensor0] 30.5110μs 4.3111μs 231.9603 KOps/s 216.9334 KOps/s $\textbf{\color{#35bf28}+6.93\%}$
test_memmaptd_index 1.1018ms 0.2528ms 3.9563 KOps/s 3.9596 KOps/s $\color{#d91a1a}-0.08\%$
test_memmaptd_index_astensor 0.5077ms 0.3463ms 2.8880 KOps/s 2.9059 KOps/s $\color{#d91a1a}-0.62\%$
test_memmaptd_index_op 0.8574ms 0.5837ms 1.7133 KOps/s 1.7056 KOps/s $\color{#35bf28}+0.45\%$
test_serialize_model 0.1384s 0.1355s 7.3790 Ops/s 7.3671 Ops/s $\color{#35bf28}+0.16\%$
test_serialize_model_pickle 1.3506s 1.2139s 0.8238 Ops/s 0.8260 Ops/s $\color{#d91a1a}-0.27\%$
test_serialize_weights 0.1387s 0.1355s 7.3790 Ops/s 7.3093 Ops/s $\color{#35bf28}+0.95\%$
test_serialize_weights_returnearly 86.4712ms 68.6303ms 14.5708 Ops/s 11.2597 Ops/s $\textbf{\color{#35bf28}+29.41\%}$
test_serialize_weights_pickle 1.3612s 1.2133s 0.8242 Ops/s 0.8228 Ops/s $\color{#35bf28}+0.17\%$
test_reshape_pytree 0.2203ms 31.8519μs 31.3953 KOps/s 30.2635 KOps/s $\color{#35bf28}+3.74\%$
test_reshape_td 98.5820μs 42.3020μs 23.6395 KOps/s 22.9999 KOps/s $\color{#35bf28}+2.78\%$
test_view_pytree 0.2224ms 31.9318μs 31.3168 KOps/s 30.8160 KOps/s $\color{#35bf28}+1.63\%$
test_view_td 98.7620μs 50.4521μs 19.8208 KOps/s 19.4520 KOps/s $\color{#35bf28}+1.90\%$
test_unbind_pytree 0.2320ms 35.7991μs 27.9337 KOps/s 27.9400 KOps/s $\color{#d91a1a}-0.02\%$
test_unbind_td 0.1352ms 46.8141μs 21.3611 KOps/s 21.2778 KOps/s $\color{#35bf28}+0.39\%$
test_split_pytree 0.2655ms 41.9266μs 23.8512 KOps/s 24.0672 KOps/s $\color{#d91a1a}-0.90\%$
test_split_td 0.1729ms 62.7537μs 15.9353 KOps/s 15.7691 KOps/s $\color{#35bf28}+1.05\%$
test_add_pytree 0.2311ms 41.5511μs 24.0668 KOps/s 24.5845 KOps/s $\color{#d91a1a}-2.11\%$
test_add_td 97.1220μs 51.4572μs 19.4336 KOps/s 19.6338 KOps/s $\color{#d91a1a}-1.02\%$
test_compile_add_one_nested[tensordict-compile] 0.2333ms 0.1357ms 7.3707 KOps/s 6.9548 KOps/s $\textbf{\color{#35bf28}+5.98\%}$
test_compile_add_one_nested[tensordict-eager] 0.3918ms 0.1881ms 5.3155 KOps/s 5.3903 KOps/s $\color{#d91a1a}-1.39\%$
test_compile_add_one_nested[pytree-compile] 0.1824ms 0.1058ms 9.4507 KOps/s 9.3260 KOps/s $\color{#35bf28}+1.34\%$
test_compile_add_one_nested[pytree-eager] 0.1639s 0.2068ms 4.8358 KOps/s 5.6625 KOps/s $\textbf{\color{#d91a1a}-14.60\%}$
test_compile_copy_nested[tensordict-compile] 58.2010μs 28.5484μs 35.0282 KOps/s 32.2187 KOps/s $\textbf{\color{#35bf28}+8.72\%}$
test_compile_copy_nested[tensordict-eager] 75.5220μs 50.0687μs 19.9725 KOps/s 20.3165 KOps/s $\color{#d91a1a}-1.69\%$
test_compile_copy_nested[pytree-compile] 40.9510μs 9.6169μs 103.9838 KOps/s 102.6729 KOps/s $\color{#35bf28}+1.28\%$
test_compile_copy_nested[pytree-eager] 0.4656ms 66.2941μs 15.0843 KOps/s 15.0983 KOps/s $\color{#d91a1a}-0.09\%$
test_compile_add_one_flat[tensordict-compile] 0.2204ms 0.1731ms 5.7762 KOps/s 5.2512 KOps/s $\textbf{\color{#35bf28}+10.00\%}$
test_compile_add_one_flat[tensordict-eager] 0.3098ms 0.2555ms 3.9139 KOps/s 3.9402 KOps/s $\color{#d91a1a}-0.67\%$
test_compile_add_one_flat[tensorclass-compile] 0.1606ms 0.1133ms 8.8293 KOps/s 8.2305 KOps/s $\textbf{\color{#35bf28}+7.27\%}$
test_compile_add_one_flat[tensorclass-eager] 0.1178ms 68.0919μs 14.6860 KOps/s 14.1390 KOps/s $\color{#35bf28}+3.87\%$
test_compile_add_one_flat[pytree-compile] 0.2108ms 0.1598ms 6.2580 KOps/s 6.2555 KOps/s $\color{#35bf28}+0.04\%$
test_compile_add_one_flat[pytree-eager] 0.8419ms 0.5203ms 1.9221 KOps/s 1.9091 KOps/s $\color{#35bf28}+0.68\%$
test_compile_add_self_flat[tensordict-eager] 0.3743ms 0.3007ms 3.3252 KOps/s 3.2443 KOps/s $\color{#35bf28}+2.49\%$
test_compile_add_self_flat[tensordict-compile] 0.2387ms 0.1755ms 5.6984 KOps/s 5.4027 KOps/s $\textbf{\color{#35bf28}+5.47\%}$
test_compile_add_self_flat[tensorclass-eager] 0.1308ms 84.0168μs 11.9024 KOps/s 11.9720 KOps/s $\color{#d91a1a}-0.58\%$
test_compile_add_self_flat[tensorclass-compile] 0.1696ms 0.1201ms 8.3264 KOps/s 8.2649 KOps/s $\color{#35bf28}+0.74\%$
test_compile_add_self_flat[pytree-eager] 0.6435ms 0.4313ms 2.3185 KOps/s 2.2913 KOps/s $\color{#35bf28}+1.19\%$
test_compile_add_self_flat[pytree-compile] 0.2107ms 0.1569ms 6.3754 KOps/s 6.3225 KOps/s $\color{#35bf28}+0.84\%$
test_compile_copy_flat[tensordict-compile] 95.6320μs 24.0800μs 41.5282 KOps/s 39.5533 KOps/s $\color{#35bf28}+4.99\%$
test_compile_copy_flat[tensordict-eager] 74.5110μs 40.2712μs 24.8316 KOps/s 25.3065 KOps/s $\color{#d91a1a}-1.88\%$
test_compile_copy_flat[pytree-compile] 43.4800μs 10.5129μs 95.1215 KOps/s 94.3504 KOps/s $\color{#35bf28}+0.82\%$
test_compile_copy_flat[pytree-eager] 0.4062ms 50.8636μs 19.6604 KOps/s 19.6725 KOps/s $\color{#d91a1a}-0.06\%$
test_compile_assign_and_add[tensordict-compile] 1.9311ms 0.1681ms 5.9490 KOps/s 5.7872 KOps/s $\color{#35bf28}+2.80\%$
test_compile_assign_and_add[tensordict-eager] 3.3352ms 3.2129ms 311.2474 Ops/s 306.5097 Ops/s $\color{#35bf28}+1.55\%$
test_compile_assign_and_add[pytree-compile] 1.8974ms 0.1570ms 6.3686 KOps/s 6.2569 KOps/s $\color{#35bf28}+1.79\%$
test_compile_assign_and_add[pytree-eager] 2.9162ms 2.7493ms 363.7341 Ops/s 360.1013 Ops/s $\color{#35bf28}+1.01\%$
test_compile_indexing[tensor-tensordict-compile] 0.1442ms 0.1063ms 9.4047 KOps/s 9.2811 KOps/s $\color{#35bf28}+1.33\%$
test_compile_indexing[tensor-tensordict-eager] 0.3260ms 72.7017μs 13.7548 KOps/s 12.9254 KOps/s $\textbf{\color{#35bf28}+6.42\%}$
test_compile_indexing[tensor-tensorclass-compile] 0.1405ms 94.0292μs 10.6350 KOps/s 10.4080 KOps/s $\color{#35bf28}+2.18\%$
test_compile_indexing[tensor-tensorclass-eager] 0.2658ms 45.2260μs 22.1112 KOps/s 21.0375 KOps/s $\textbf{\color{#35bf28}+5.10\%}$
test_compile_indexing[tensor-pytree-compile] 0.1793ms 98.9097μs 10.1102 KOps/s 10.3823 KOps/s $\color{#d91a1a}-2.62\%$
test_compile_indexing[tensor-pytree-eager] 0.2731ms 47.0992μs 21.2318 KOps/s 21.0623 KOps/s $\color{#35bf28}+0.80\%$
test_compile_indexing[slice-tensordict-compile] 0.1350ms 56.8474μs 17.5909 KOps/s 17.8558 KOps/s $\color{#d91a1a}-1.48\%$
test_compile_indexing[slice-tensordict-eager] 0.2360ms 27.1473μs 36.8361 KOps/s 36.8115 KOps/s $\color{#35bf28}+0.07\%$
test_compile_indexing[slice-tensorclass-compile] 86.6210μs 47.4026μs 21.0959 KOps/s 22.2936 KOps/s $\textbf{\color{#d91a1a}-5.37\%}$
test_compile_indexing[slice-tensorclass-eager] 0.2577ms 22.0128μs 45.4281 KOps/s 45.4433 KOps/s $\color{#d91a1a}-0.03\%$
test_compile_indexing[slice-pytree-compile] 87.8610μs 47.7248μs 20.9535 KOps/s 21.9204 KOps/s $\color{#d91a1a}-4.41\%$
test_compile_indexing[slice-pytree-eager] 0.2957ms 21.8869μs 45.6894 KOps/s 45.3074 KOps/s $\color{#35bf28}+0.84\%$
test_compile_indexing[int-tensordict-compile] 0.1100ms 58.2245μs 17.1749 KOps/s 17.7712 KOps/s $\color{#d91a1a}-3.36\%$
test_compile_indexing[int-tensordict-eager] 0.2494ms 26.9279μs 37.1362 KOps/s 37.3355 KOps/s $\color{#d91a1a}-0.53\%$
test_compile_indexing[int-tensorclass-compile] 83.5010μs 47.0614μs 21.2488 KOps/s 21.9656 KOps/s $\color{#d91a1a}-3.26\%$
test_compile_indexing[int-tensorclass-eager] 0.2766ms 21.9924μs 45.4703 KOps/s 45.0614 KOps/s $\color{#35bf28}+0.91\%$
test_compile_indexing[int-pytree-compile] 0.1049ms 47.3593μs 21.1152 KOps/s 22.0827 KOps/s $\color{#d91a1a}-4.38\%$
test_compile_indexing[int-pytree-eager] 0.2949ms 21.8328μs 45.8026 KOps/s 45.2849 KOps/s $\color{#35bf28}+1.14\%$
test_mod_add[eager] 0.1020ms 48.0230μs 20.8234 KOps/s 20.1145 KOps/s $\color{#35bf28}+3.52\%$
test_mod_add[compile] 0.1483ms 0.1028ms 9.7271 KOps/s 9.6349 KOps/s $\color{#35bf28}+0.96\%$
test_mod_add[compile-overhead] 0.2289ms 0.1434ms 6.9757 KOps/s 6.7915 KOps/s $\color{#35bf28}+2.71\%$
test_mod_wrap[eager] 0.3715ms 0.2847ms 3.5130 KOps/s 3.4818 KOps/s $\color{#35bf28}+0.90\%$
test_mod_wrap[compile] 0.3928ms 0.3411ms 2.9320 KOps/s 2.9225 KOps/s $\color{#35bf28}+0.32\%$
test_mod_wrap[compile-overhead] 7.2813ms 4.0237ms 248.5265 Ops/s 251.4217 Ops/s $\color{#d91a1a}-1.15\%$
test_mod_wrap_and_backward[eager] 1.5724ms 1.4775ms 676.8040 Ops/s 668.3113 Ops/s $\color{#35bf28}+1.27\%$
test_mod_wrap_and_backward[compile] 1.6698ms 1.4201ms 704.1967 Ops/s 699.3345 Ops/s $\color{#35bf28}+0.70\%$
test_mod_wrap_and_backward[compile-overhead] 1.3292ms 0.8631ms 1.1586 KOps/s 1.1406 KOps/s $\color{#35bf28}+1.58\%$
test_seq_add[eager] 0.2057ms 0.1505ms 6.6442 KOps/s 6.5151 KOps/s $\color{#35bf28}+1.98\%$
test_seq_add[compile] 0.5697ms 0.1126ms 8.8824 KOps/s 8.5867 KOps/s $\color{#35bf28}+3.44\%$
test_seq_add[compile-overhead] 0.2282ms 0.1506ms 6.6412 KOps/s 6.4852 KOps/s $\color{#35bf28}+2.41\%$
test_seq_wrap[eager] 0.5818ms 0.5098ms 1.9617 KOps/s 1.9374 KOps/s $\color{#35bf28}+1.25\%$
test_seq_wrap[compile] 0.4204ms 0.3584ms 2.7904 KOps/s 2.7231 KOps/s $\color{#35bf28}+2.47\%$
test_seq_wrap[compile-overhead] 0.3161ms 0.2576ms 3.8819 KOps/s 3.8174 KOps/s $\color{#35bf28}+1.69\%$
test_func_call_runtime[False-eager] 0.9097ms 0.8266ms 1.2097 KOps/s 1.1466 KOps/s $\textbf{\color{#35bf28}+5.50\%}$
test_func_call_runtime[False-compile] 0.9775ms 0.8831ms 1.1323 KOps/s 1.1184 KOps/s $\color{#35bf28}+1.25\%$
test_func_call_runtime[False-compile-overhead] 0.5076ms 0.4424ms 2.2605 KOps/s 2.2241 KOps/s $\color{#35bf28}+1.64\%$
test_func_call_runtime[True-eager] 1.1367ms 1.0518ms 950.7293 Ops/s 940.5070 Ops/s $\color{#35bf28}+1.09\%$
test_func_call_runtime[True-compile] 1.0361ms 0.8967ms 1.1152 KOps/s 1.1054 KOps/s $\color{#35bf28}+0.88\%$
test_func_call_runtime[True-compile-overhead] 0.5082ms 0.4574ms 2.1861 KOps/s 2.1540 KOps/s $\color{#35bf28}+1.49\%$
test_func_call_cm_runtime[False-eager] 0.9100ms 0.8326ms 1.2011 KOps/s 1.2087 KOps/s $\color{#d91a1a}-0.63\%$
test_func_call_cm_runtime[False-compile] 1.0750ms 0.8852ms 1.1297 KOps/s 1.1174 KOps/s $\color{#35bf28}+1.10\%$
test_func_call_cm_runtime[False-compile-overhead] 0.5086ms 0.4423ms 2.2610 KOps/s 2.2130 KOps/s $\color{#35bf28}+2.17\%$
test_func_call_cm_runtime[True-eager] 1.3623ms 1.2003ms 833.1220 Ops/s 827.3931 Ops/s $\color{#35bf28}+0.69\%$
test_func_call_cm_runtime[True-compile] 1.1009ms 0.9296ms 1.0757 KOps/s 1.0647 KOps/s $\color{#35bf28}+1.04\%$
test_func_call_cm_runtime[True-compile-overhead] 0.9192ms 0.4909ms 2.0372 KOps/s 2.0120 KOps/s $\color{#35bf28}+1.25\%$
test_vmap_func_call_cm_runtime[eager] 2.8513ms 2.3266ms 429.8144 Ops/s 426.5499 Ops/s $\color{#35bf28}+0.77\%$
test_vmap_func_call_cm_runtime[compile] 1.0692ms 0.9419ms 1.0617 KOps/s 1.0481 KOps/s $\color{#35bf28}+1.30\%$
test_vmap_func_call_cm_runtime[compile-overhead] 0.6420ms 0.4933ms 2.0271 KOps/s 1.9892 KOps/s $\color{#35bf28}+1.91\%$
test_distributed 3.2900ms 0.1620ms 6.1712 KOps/s 5.9215 KOps/s $\color{#35bf28}+4.22\%$
test_tdmodule 45.7110μs 27.0068μs 37.0277 KOps/s 35.4415 KOps/s $\color{#35bf28}+4.48\%$
test_tdmodule_dispatch 76.5320μs 44.5050μs 22.4694 KOps/s 22.1123 KOps/s $\color{#35bf28}+1.62\%$
test_tdseq 47.0310μs 26.3875μs 37.8967 KOps/s 36.8750 KOps/s $\color{#35bf28}+2.77\%$
test_tdseq_dispatch 68.7410μs 46.5216μs 21.4954 KOps/s 21.0163 KOps/s $\color{#35bf28}+2.28\%$
test_instantiation_functorch 2.1743ms 1.9777ms 505.6480 Ops/s 503.1550 Ops/s $\color{#35bf28}+0.50\%$
test_exec_functorch 0.2428ms 0.1735ms 5.7651 KOps/s 5.6339 KOps/s $\color{#35bf28}+2.33\%$
test_exec_functional_call 0.2017ms 0.1605ms 6.2288 KOps/s 6.2882 KOps/s $\color{#d91a1a}-0.94\%$
test_exec_td_decorator 0.4367ms 0.2299ms 4.3489 KOps/s 4.2769 KOps/s $\color{#35bf28}+1.68\%$
test_vmap_mlp_speed_decorator[True-True] 1.0117ms 0.8128ms 1.2303 KOps/s 1.2269 KOps/s $\color{#35bf28}+0.28\%$
test_vmap_mlp_speed_decorator[True-False] 0.9887ms 0.8283ms 1.2074 KOps/s 1.2266 KOps/s $\color{#d91a1a}-1.57\%$
test_vmap_mlp_speed_decorator[False-True] 0.9065ms 0.7031ms 1.4223 KOps/s 1.4161 KOps/s $\color{#35bf28}+0.43\%$
test_vmap_mlp_speed_decorator[False-False] 0.8990ms 0.7041ms 1.4202 KOps/s 1.4141 KOps/s $\color{#35bf28}+0.43\%$
test_vmap_transformer_speed_decorator[True-True] 21.1679ms 20.3597ms 49.1166 Ops/s 48.8874 Ops/s $\color{#35bf28}+0.47\%$
test_vmap_transformer_speed_decorator[True-False] 20.5058ms 20.3416ms 49.1603 Ops/s 48.8388 Ops/s $\color{#35bf28}+0.66\%$
test_vmap_transformer_speed_decorator[False-True] 20.2945ms 20.1352ms 49.6643 Ops/s 49.2940 Ops/s $\color{#35bf28}+0.75\%$
test_vmap_transformer_speed_decorator[False-False] 20.2585ms 20.1426ms 49.6460 Ops/s 49.3250 Ops/s $\color{#35bf28}+0.65\%$
test_to_module_speed[True] 1.8529ms 1.4115ms 708.4689 Ops/s 700.0786 Ops/s $\color{#35bf28}+1.20\%$
test_to_module_speed[False] 1.8147ms 1.3924ms 718.1901 Ops/s 714.3261 Ops/s $\color{#35bf28}+0.54\%$
test_tc_init 64.3210μs 44.2134μs 22.6176 KOps/s 22.4690 KOps/s $\color{#35bf28}+0.66\%$
test_tc_init_tensor_only 45.4810μs 9.4340μs 105.9993 KOps/s 106.5219 KOps/s $\color{#d91a1a}-0.49\%$
test_tc_init_nested 0.5131ms 87.3355μs 11.4501 KOps/s 11.2449 KOps/s $\color{#35bf28}+1.83\%$
test_tc_init_many_fields 49.8400μs 15.8672μs 63.0231 KOps/s 63.0630 KOps/s $\color{#d91a1a}-0.06\%$
test_tc_first_layer_tensor 23.5500μs 1.7339μs 576.7403 KOps/s 577.5844 KOps/s $\color{#d91a1a}-0.15\%$
test_tc_first_layer_tensor_only 58.5853μs 0.7122μs 1.4040 MOps/s 1.3985 MOps/s $\color{#35bf28}+0.39\%$
test_tc_first_layer_tensor_set 27.4510μs 3.7604μs 265.9281 KOps/s 270.7900 KOps/s $\color{#d91a1a}-1.80\%$
test_tc_first_layer_tensor_only_set 25.4700μs 2.9837μs 335.1555 KOps/s 336.3346 KOps/s $\color{#d91a1a}-0.35\%$
test_tc_first_layer_nontensor 0.4274ms 5.8829μs 169.9829 KOps/s 169.3889 KOps/s $\color{#35bf28}+0.35\%$
test_tc_second_layer_tensor 46.7300μs 4.2516μs 235.2071 KOps/s 239.5875 KOps/s $\color{#d91a1a}-1.83\%$
test_tc_second_layer_nontensor 35.1810μs 8.2822μs 120.7415 KOps/s 122.8461 KOps/s $\color{#d91a1a}-1.71\%$
test_unbind 0.2446s 15.2112ms 65.7409 Ops/s 70.4218 Ops/s $\textbf{\color{#d91a1a}-6.65\%}$
test_full_like 17.1381ms 16.6884ms 59.9219 Ops/s 227.3603 Ops/s $\textbf{\color{#d91a1a}-73.64\%}$
test_zeros_like 17.0640ms 16.6850ms 59.9340 Ops/s 225.7422 Ops/s $\textbf{\color{#d91a1a}-73.45\%}$
test_ones_like 17.2630ms 16.6854ms 59.9328 Ops/s 228.2584 Ops/s $\textbf{\color{#d91a1a}-73.74\%}$
test_clone 18.2916ms 17.7033ms 56.4867 Ops/s 154.2859 Ops/s $\textbf{\color{#d91a1a}-63.39\%}$
test_squeeze 97.3410μs 13.6514μs 73.2523 KOps/s 72.0816 KOps/s $\color{#35bf28}+1.62\%$
test_unsqueeze 0.1630ms 0.1082ms 9.2395 KOps/s 9.0735 KOps/s $\color{#35bf28}+1.83\%$
test_split 0.6294ms 0.1793ms 5.5767 KOps/s 5.5027 KOps/s $\color{#35bf28}+1.34\%$
test_permute 0.6324ms 0.2021ms 4.9471 KOps/s 4.9668 KOps/s $\color{#d91a1a}-0.40\%$
test_stack 52.3575ms 51.4378ms 19.4409 Ops/s 19.3316 Ops/s $\color{#35bf28}+0.57\%$
test_cat 51.7445ms 51.3056ms 19.4910 Ops/s 19.6545 Ops/s $\color{#d91a1a}-0.83\%$

@vmoens
Update
3738240 
[ghstack-poisoned]
@vmoens vmoens mentioned this pull request Feb 18, 2026
Merged
@vmoens
Update
bf85198 
[ghstack-poisoned]
This was referenced Feb 19, 2026
Closed
Merged
@github-actions

github-actions Bot commented Feb 19, 2026

Copy link
Copy Markdown
Contributor

PR Title Label Error

Unknown or invalid prefix [Distributed].

Current title: [Distributed] Add scatter collective

Supported Prefixes

Your PR title must start with exactly one of these prefixes:

Prefix Label Applied Example
[BugFix] BugFix [BugFix] Fix memory leak in TensorDict
[Feature] Feature [Feature] Add new storage backend
[Doc] or [Docs] Documentation [Doc] Update installation guide
[Refactor] Refactor [Refactor] Clean up module imports
[CI] CI [CI] Fix workflow permissions
[Test] or [Tests] Test [Test] Add unit tests for nn module
[Compile] Compile [Compile] Fix torch.compile issue
[Performance] or [Perf] Perf [Perf] Optimize tensor operations
[Deprecation] Deprecation [Deprecation] Mark old function
[Setup] Setup [Setup] Update build configuration

Note: Common variations like singular/plural are supported (e.g., [Doc] or [Docs]).

@vmoens
Update
36479b2 
[ghstack-poisoned]
@github-actions

github-actions Bot commented Feb 19, 2026

Copy link
Copy Markdown
Contributor

PR Title Label Error

Unknown or invalid prefix [Distributed].

Current title: [Distributed] Add scatter collective

Supported Prefixes

Your PR title must start with exactly one of these prefixes:

Prefix Label Applied Example
[BugFix] BugFix [BugFix] Fix memory leak in TensorDict
[Feature] Feature [Feature] Add new storage backend
[Doc] or [Docs] Documentation [Doc] Update installation guide
[Refactor] Refactor [Refactor] Clean up module imports
[CI] CI [CI] Fix workflow permissions
[Test] or [Tests] Test [Test] Add unit tests for nn module
[Compile] Compile [Compile] Fix torch.compile issue
[Performance] or [Perf] Perf [Perf] Optimize tensor operations
[Deprecation] Deprecation [Deprecation] Mark old function
[Setup] Setup [Setup] Update build configuration

Note: Common variations like singular/plural are supported (e.g., [Doc] or [Docs]).

vmoens added a commit that referenced this pull request Feb 19, 2026
@vmoens @cursoragent
[Distributed] Add scatter collective
fa4131c 
New TensorDictBase.scatter(src, tensordicts) method that scatters a
list of tensordicts from the source rank to all ranks. On source:
consolidates each TD, scatters metadata via scatter_object_list, pads
storages to uniform size and scatters via dist.scatter. Receivers
reconstruct from their metadata + storage slice.

Co-authored-by: Cursor <cursoragent@cursor.com>
ghstack-source-id: 7439439
Pull-Request: #1591
Co-authored-by: Cursor <cursoragent@cursor.com>
@vmoens
vmoens merged commit 36479b2 into gh/vmoens/74/base Feb 19, 2026
34 of 52 checks passed
@vmoens
vmoens deleted the gh/vmoens/74/head branch February 19, 2026 10:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Distributed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@vmoens