Skip to content

[Distributed] Add all_reduce collective - #1589

Merged
vmoens merged 4 commits into
gh/vmoens/72/basefrom
gh/vmoens/72/head
Feb 19, 2026
Merged

[Distributed] Add all_reduce collective#1589
vmoens merged 4 commits into
gh/vmoens/72/basefrom
gh/vmoens/72/head

Conversation

@vmoens

@vmoens vmoens commented Feb 18, 2026 •
edited
Loading

Copy link
Copy Markdown
Collaborator

Stack from ghstack (oldest at bottom):

New TensorDictBase.all_reduce(op) method that performs an in-place
all-reduce across all ranks. Operates per-leaf since the consolidated
storage is dtype-heterogeneous (uint8 buffer with mixed-dtype views).

Co-authored-by: Cursor cursoragent@cursor.com

@vmoens
Update
adde64f 
[ghstack-poisoned]
This was referenced Feb 18, 2026
Merged
Merged
Merged
Merged
Merged
Merged
@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Feb 18, 2026
@github-actions

github-actions Bot commented Feb 18, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 243. Improved: $\large\color{#35bf28}21$. Worsened: $\large\color{#d91a1a}8$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_plain_set_nested 0.4137ms 14.7350μs 67.8658 KOps/s 67.6284 KOps/s $\color{#35bf28}+0.35\%$
test_plain_set_stack_nested 41.0320μs 15.0826μs 66.3015 KOps/s 66.8975 KOps/s $\color{#d91a1a}-0.89\%$
test_plain_set_nested_inplace 48.4530μs 16.6064μs 60.2176 KOps/s 60.6087 KOps/s $\color{#d91a1a}-0.65\%$
test_plain_set_stack_nested_inplace 0.4352ms 16.5879μs 60.2851 KOps/s 60.4472 KOps/s $\color{#d91a1a}-0.27\%$
test_items 0.4178ms 5.8993μs 169.5103 KOps/s 171.6678 KOps/s $\color{#d91a1a}-1.26\%$
test_items_nested 0.8735ms 0.4611ms 2.1688 KOps/s 2.2071 KOps/s $\color{#d91a1a}-1.74\%$
test_items_nested_locked 0.8696ms 0.4652ms 2.1494 KOps/s 2.2001 KOps/s $\color{#d91a1a}-2.30\%$
test_items_nested_leaf 0.5050ms 96.1301μs 10.4026 KOps/s 10.3890 KOps/s $\color{#35bf28}+0.13\%$
test_items_stack_nested 0.8767ms 0.4648ms 2.1514 KOps/s 2.2161 KOps/s $\color{#d91a1a}-2.92\%$
test_items_stack_nested_leaf 0.1451ms 96.1028μs 10.4055 KOps/s 10.2143 KOps/s $\color{#35bf28}+1.87\%$
test_items_stack_nested_locked 0.8941ms 0.4697ms 2.1292 KOps/s 2.1802 KOps/s $\color{#d91a1a}-2.34\%$
test_keys 0.4195ms 4.2054μs 237.7913 KOps/s 237.7745 KOps/s $+0.01\%$
test_keys_nested 0.5493ms 0.1217ms 8.2162 KOps/s 8.2198 KOps/s $\color{#d91a1a}-0.04\%$
test_keys_nested_locked 88.5878ms 0.1408ms 7.0998 KOps/s 7.6584 KOps/s $\textbf{\color{#d91a1a}-7.29\%}$
test_keys_nested_leaf 0.5300ms 0.1120ms 8.9247 KOps/s 8.8972 KOps/s $\color{#35bf28}+0.31\%$
test_keys_stack_nested 0.5320ms 0.1221ms 8.1918 KOps/s 8.2096 KOps/s $\color{#d91a1a}-0.22\%$
test_keys_stack_nested_leaf 0.5340ms 0.1115ms 8.9697 KOps/s 8.9598 KOps/s $\color{#35bf28}+0.11\%$
test_keys_stack_nested_locked 0.5546ms 0.1300ms 7.6896 KOps/s 7.6429 KOps/s $\color{#35bf28}+0.61\%$
test_values 83.0926μs 1.0256μs 975.0538 KOps/s 974.1383 KOps/s $\color{#35bf28}+0.09\%$
test_values_nested 78.2850μs 48.0832μs 20.7973 KOps/s 20.8911 KOps/s $\color{#d91a1a}-0.45\%$
test_values_nested_locked 0.4617ms 51.2666μs 19.5059 KOps/s 19.6662 KOps/s $\color{#d91a1a}-0.82\%$
test_values_nested_leaf 0.4615ms 54.9897μs 18.1852 KOps/s 18.4459 KOps/s $\color{#d91a1a}-1.41\%$
test_values_stack_nested 0.4709ms 48.0692μs 20.8033 KOps/s 20.9074 KOps/s $\color{#d91a1a}-0.50\%$
test_values_stack_nested_leaf 0.4749ms 54.7204μs 18.2747 KOps/s 18.4743 KOps/s $\color{#d91a1a}-1.08\%$
test_values_stack_nested_locked 1.7934ms 51.3354μs 19.4797 KOps/s 19.6590 KOps/s $\color{#d91a1a}-0.91\%$
test_membership 7.9705μs 0.8416μs 1.1882 MOps/s 1.1659 MOps/s $\color{#35bf28}+1.92\%$
test_membership_nested 42.7330μs 2.9215μs 342.2865 KOps/s 342.8963 KOps/s $\color{#d91a1a}-0.18\%$
test_membership_nested_leaf 27.1920μs 2.9204μs 342.4142 KOps/s 343.3982 KOps/s $\color{#d91a1a}-0.29\%$
test_membership_stacked_nested 34.9420μs 2.9350μs 340.7127 KOps/s 340.1529 KOps/s $\color{#35bf28}+0.16\%$
test_membership_stacked_nested_leaf 1.2584ms 2.8990μs 344.9464 KOps/s 340.5979 KOps/s $\color{#35bf28}+1.28\%$
test_membership_nested_last 25.3920μs 4.3363μs 230.6111 KOps/s 228.8220 KOps/s $\color{#35bf28}+0.78\%$
test_membership_nested_leaf_last 37.7530μs 4.3618μs 229.2655 KOps/s 228.5106 KOps/s $\color{#35bf28}+0.33\%$
test_membership_stacked_nested_last 31.9920μs 4.3819μs 228.2096 KOps/s 228.0581 KOps/s $\color{#35bf28}+0.07\%$
test_membership_stacked_nested_leaf_last 41.0520μs 4.3183μs 231.5733 KOps/s 227.4594 KOps/s $\color{#35bf28}+1.81\%$
test_nested_getleaf 51.3130μs 21.6914μs 46.1013 KOps/s 46.4385 KOps/s $\color{#d91a1a}-0.73\%$
test_nested_get 48.0530μs 20.5694μs 48.6160 KOps/s 48.1660 KOps/s $\color{#35bf28}+0.93\%$
test_stacked_getleaf 53.7230μs 21.6420μs 46.2064 KOps/s 46.7794 KOps/s $\color{#d91a1a}-1.22\%$
test_stacked_get 62.4240μs 20.0787μs 49.8039 KOps/s 49.3107 KOps/s $\color{#35bf28}+1.00\%$
test_nested_getitemleaf 45.2120μs 22.1431μs 45.1608 KOps/s 44.4964 KOps/s $\color{#35bf28}+1.49\%$
test_nested_getitem 48.9520μs 21.0086μs 47.5995 KOps/s 47.0389 KOps/s $\color{#35bf28}+1.19\%$
test_stacked_getitemleaf 51.1820μs 22.1355μs 45.1764 KOps/s 44.5024 KOps/s $\color{#35bf28}+1.51\%$
test_stacked_getitem 59.3940μs 20.9670μs 47.6939 KOps/s 46.9411 KOps/s $\color{#35bf28}+1.60\%$
test_lock_nested 7.8629ms 0.4803ms 2.0822 KOps/s 2.0822 KOps/s $+0.00\%$
test_lock_stack_nested 0.5184ms 0.4787ms 2.0889 KOps/s 2.0567 KOps/s $\color{#35bf28}+1.57\%$
test_unlock_nested 0.5378ms 0.3844ms 2.6015 KOps/s 2.5770 KOps/s $\color{#35bf28}+0.95\%$
test_unlock_stack_nested 0.4315ms 0.3866ms 2.5866 KOps/s 2.5492 KOps/s $\color{#35bf28}+1.47\%$
test_flatten_speed 0.1533ms 0.1233ms 8.1074 KOps/s 8.1705 KOps/s $\color{#d91a1a}-0.77\%$
test_unflatten_speed 0.6139ms 0.5755ms 1.7375 KOps/s 1.7389 KOps/s $\color{#d91a1a}-0.08\%$
test_common_ops 0.8106ms 0.6908ms 1.4477 KOps/s 1.3853 KOps/s $\color{#35bf28}+4.50\%$
test_creation 71.9040μs 3.0203μs 331.0883 KOps/s 341.3000 KOps/s $\color{#d91a1a}-2.99\%$
test_creation_empty 54.4530μs 6.2809μs 159.2130 KOps/s 163.1780 KOps/s $\color{#d91a1a}-2.43\%$
test_creation_nested_1 41.9130μs 10.7602μs 92.9348 KOps/s 94.8274 KOps/s $\color{#d91a1a}-2.00\%$
test_creation_nested_2 37.4930μs 12.1012μs 82.6363 KOps/s 84.0674 KOps/s $\color{#d91a1a}-1.70\%$
test_creation_many_keys[10] 47.5330μs 18.4579μs 54.1775 KOps/s 54.5618 KOps/s $\color{#d91a1a}-0.70\%$
test_creation_many_keys[50] 0.1146ms 78.5769μs 12.7264 KOps/s 12.8952 KOps/s $\color{#d91a1a}-1.31\%$
test_creation_many_keys[100] 0.1861ms 0.1526ms 6.5514 KOps/s 6.5491 KOps/s $\color{#35bf28}+0.03\%$
test_creation_nested_many_keys[10] 76.5250μs 39.9178μs 25.0515 KOps/s 25.5413 KOps/s $\color{#d91a1a}-1.92\%$
test_creation_nested_many_keys[50] 0.1935ms 0.1599ms 6.2558 KOps/s 6.2770 KOps/s $\color{#d91a1a}-0.34\%$
test_clone 54.0630μs 13.6498μs 73.2613 KOps/s 73.0411 KOps/s $\color{#35bf28}+0.30\%$
test_getitem[int] 1.6009ms 14.7201μs 67.9344 KOps/s 55.8102 KOps/s $\textbf{\color{#35bf28}+21.72\%}$
test_getitem[slice_int] 0.1431ms 24.8114μs 40.3040 KOps/s 40.6593 KOps/s $\color{#d91a1a}-0.87\%$
test_getitem[range] 0.1723ms 62.2652μs 16.0603 KOps/s 15.6657 KOps/s $\color{#35bf28}+2.52\%$
test_getitem[tuple] 0.1473ms 24.0138μs 41.6428 KOps/s 41.7974 KOps/s $\color{#d91a1a}-0.37\%$
test_getitem[list] 0.1839ms 61.6033μs 16.2329 KOps/s 16.9244 KOps/s $\color{#d91a1a}-4.09\%$
test_setitem_dim[int] 54.2830μs 26.2996μs 38.0233 KOps/s 37.8249 KOps/s $\color{#35bf28}+0.52\%$
test_setitem_dim[slice_int] 78.6750μs 42.9809μs 23.2661 KOps/s 22.8574 KOps/s $\color{#35bf28}+1.79\%$
test_setitem_dim[range] 0.1207ms 94.1140μs 10.6254 KOps/s 9.9446 KOps/s $\textbf{\color{#35bf28}+6.85\%}$
test_setitem_dim[tuple] 64.3940μs 40.9565μs 24.4162 KOps/s 23.1799 KOps/s $\textbf{\color{#35bf28}+5.33\%}$
test_setitem 60.0740μs 18.1674μs 55.0437 KOps/s 55.2143 KOps/s $\color{#d91a1a}-0.31\%$
test_set 60.2040μs 17.2551μs 57.9540 KOps/s 57.9177 KOps/s $\color{#35bf28}+0.06\%$
test_set_shared 0.4882ms 0.2058ms 4.8580 KOps/s 4.8345 KOps/s $\color{#35bf28}+0.49\%$
test_update 0.1930ms 21.6455μs 46.1989 KOps/s 45.2757 KOps/s $\color{#35bf28}+2.04\%$
test_update_nested 74.5940μs 33.5432μs 29.8123 KOps/s 29.1192 KOps/s $\color{#35bf28}+2.38\%$
test_update__nested 0.5230ms 34.4867μs 28.9966 KOps/s 27.2030 KOps/s $\textbf{\color{#35bf28}+6.59\%}$
test_set_nested 78.2250μs 19.2657μs 51.9057 KOps/s 51.6683 KOps/s $\color{#35bf28}+0.46\%$
test_set_nested_new 62.8740μs 24.0959μs 41.5008 KOps/s 40.4851 KOps/s $\color{#35bf28}+2.51\%$
test_select 80.1650μs 42.5087μs 23.5246 KOps/s 24.0391 KOps/s $\color{#d91a1a}-2.14\%$
test_select_nested 0.1145ms 75.0780μs 13.3195 KOps/s 13.3766 KOps/s $\color{#d91a1a}-0.43\%$
test_exclude_nested 0.1195ms 93.6837μs 10.6742 KOps/s 10.8607 KOps/s $\color{#d91a1a}-1.72\%$
test_empty[True] 0.5325ms 0.3960ms 2.5255 KOps/s 2.5759 KOps/s $\color{#d91a1a}-1.95\%$
test_empty[False] 9.2830μs 1.3317μs 750.9147 KOps/s 761.7464 KOps/s $\color{#d91a1a}-1.42\%$
test_to 0.1079ms 72.5252μs 13.7883 KOps/s 13.9587 KOps/s $\color{#d91a1a}-1.22\%$
test_to_nonblocking 0.1160ms 65.4156μs 15.2869 KOps/s 14.7938 KOps/s $\color{#35bf28}+3.33\%$
test_unbind_speed 0.3826ms 0.3306ms 3.0246 KOps/s 3.0477 KOps/s $\color{#d91a1a}-0.76\%$
test_unbind_speed_stack0 0.3638ms 0.3262ms 3.0656 KOps/s 3.0674 KOps/s $\color{#d91a1a}-0.06\%$
test_unbind_speed_stack1 0.1039s 0.8434ms 1.1857 KOps/s 1.1913 KOps/s $\color{#d91a1a}-0.47\%$
test_split 0.1031s 1.2841ms 778.7526 Ops/s 786.9666 Ops/s $\color{#d91a1a}-1.04\%$
test_chunk 0.1032s 1.2302ms 812.8612 Ops/s 923.9861 Ops/s $\textbf{\color{#d91a1a}-12.03\%}$
test_to_cpu_blocking 28.6263ms 28.5351ms 35.0445 Ops/s 45.9233 Ops/s $\textbf{\color{#d91a1a}-23.69\%}$
test_to_cpu_global_sync 11.3791ms 11.2800ms 88.6527 Ops/s 87.5387 Ops/s $\color{#35bf28}+1.27\%$
test_to_cpu_event_sync 13.6708ms 12.3001ms 81.2999 Ops/s 80.8615 Ops/s $\color{#35bf28}+0.54\%$
test_to_cpu_default 0.1146s 13.4865ms 74.1483 Ops/s 80.5449 Ops/s $\textbf{\color{#d91a1a}-7.94\%}$
test_consolidate[False-None] 4.3275ms 4.1549ms 240.6774 Ops/s 215.7638 Ops/s $\textbf{\color{#35bf28}+11.55\%}$
test_consolidate[default-None] 2.1608ms 2.0421ms 489.6845 Ops/s 477.9458 Ops/s $\color{#35bf28}+2.46\%$
test_consolidate[reduce-overhead-None] 2.0339ms 1.9665ms 508.5105 Ops/s 499.3056 Ops/s $\color{#35bf28}+1.84\%$
test_consolidate_njt[False-None] 8.6915ms 8.5140ms 117.4536 Ops/s 116.1427 Ops/s $\color{#35bf28}+1.13\%$
test_to[False-False-None] 2.3608ms 2.0839ms 479.8672 Ops/s 474.5524 Ops/s $\color{#35bf28}+1.12\%$
test_to[True-False-None] 2.2349ms 2.0046ms 498.8477 Ops/s 511.6074 Ops/s $\color{#d91a1a}-2.49\%$
test_to[within-False-None] 6.3541ms 6.2020ms 161.2373 Ops/s 161.5189 Ops/s $\color{#d91a1a}-0.17\%$
test_to[True-default-None] 7.7267ms 7.5847ms 131.8450 Ops/s 128.2075 Ops/s $\color{#35bf28}+2.84\%$
test_to_njt[False-False-None] 8.7527ms 8.5452ms 117.0253 Ops/s 114.9290 Ops/s $\color{#35bf28}+1.82\%$
test_to_njt[True-False-None] 7.0863ms 6.9768ms 143.3321 Ops/s 141.3087 Ops/s $\color{#35bf28}+1.43\%$
test_to_njt[within-False-None] 15.7002ms 15.6183ms 64.0275 Ops/s 63.5422 Ops/s $\color{#35bf28}+0.76\%$
test_creation[device0] 0.3944ms 0.1170ms 8.5469 KOps/s 8.2382 KOps/s $\color{#35bf28}+3.75\%$
test_creation_from_tensor 0.4045ms 0.1143ms 8.7511 KOps/s 8.4959 KOps/s $\color{#35bf28}+3.00\%$
test_add_one[memmap_tensor0] 0.3435ms 6.7112μs 149.0053 KOps/s 147.3613 KOps/s $\color{#35bf28}+1.12\%$
test_contiguous[memmap_tensor0] 26.2810μs 0.6742μs 1.4831 MOps/s 2.1365 MOps/s $\textbf{\color{#d91a1a}-30.58\%}$
test_stack[memmap_tensor0] 33.5520μs 4.6835μs 213.5168 KOps/s 213.6361 KOps/s $\color{#d91a1a}-0.06\%$
test_memmaptd_index 1.0509ms 0.2623ms 3.8120 KOps/s 3.8522 KOps/s $\color{#d91a1a}-1.04\%$
test_memmaptd_index_astensor 0.5201ms 0.3599ms 2.7787 KOps/s 2.8078 KOps/s $\color{#d91a1a}-1.04\%$
test_memmaptd_index_op 0.8683ms 0.6048ms 1.6533 KOps/s 1.6454 KOps/s $\color{#35bf28}+0.48\%$
test_serialize_model 0.3052s 0.1603s 6.2399 Ops/s 7.3185 Ops/s $\textbf{\color{#d91a1a}-14.74\%}$
test_serialize_model_pickle 1.3502s 1.2099s 0.8265 Ops/s 0.8259 Ops/s $\color{#35bf28}+0.08\%$
test_serialize_weights 0.1377s 0.1364s 7.3288 Ops/s 7.3092 Ops/s $\color{#35bf28}+0.27\%$
test_serialize_weights_returnearly 0.4499s 94.9231ms 10.5348 Ops/s 5.8078 Ops/s $\textbf{\color{#35bf28}+81.39\%}$
test_serialize_weights_pickle 1.3499s 1.1948s 0.8370 Ops/s 0.8233 Ops/s $\color{#35bf28}+1.67\%$
test_reshape_pytree 0.2249ms 33.2921μs 30.0371 KOps/s 30.1328 KOps/s $\color{#d91a1a}-0.32\%$
test_reshape_td 81.9640μs 45.0794μs 22.1831 KOps/s 22.4336 KOps/s $\color{#d91a1a}-1.12\%$
test_view_pytree 0.2244ms 33.1263μs 30.1875 KOps/s 30.4898 KOps/s $\color{#d91a1a}-0.99\%$
test_view_td 0.1077ms 53.5239μs 18.6832 KOps/s 18.9606 KOps/s $\color{#d91a1a}-1.46\%$
test_unbind_pytree 0.2336ms 37.0040μs 27.0241 KOps/s 26.8734 KOps/s $\color{#35bf28}+0.56\%$
test_unbind_td 0.1960ms 49.0713μs 20.3785 KOps/s 20.1425 KOps/s $\color{#35bf28}+1.17\%$
test_split_pytree 0.2514ms 42.9147μs 23.3020 KOps/s 23.3473 KOps/s $\color{#d91a1a}-0.19\%$
test_split_td 0.1077ms 64.7334μs 15.4480 KOps/s 15.2583 KOps/s $\color{#35bf28}+1.24\%$
test_add_pytree 0.2118ms 43.1565μs 23.1715 KOps/s 23.4579 KOps/s $\color{#d91a1a}-1.22\%$
test_add_td 0.1013ms 54.2401μs 18.4365 KOps/s 18.5127 KOps/s $\color{#d91a1a}-0.41\%$
test_compile_add_one_nested[tensordict-compile] 0.2569ms 0.1427ms 7.0061 KOps/s 6.6803 KOps/s $\color{#35bf28}+4.88\%$
test_compile_add_one_nested[tensordict-eager] 0.2720ms 0.1940ms 5.1535 KOps/s 5.1788 KOps/s $\color{#d91a1a}-0.49\%$
test_compile_add_one_nested[pytree-compile] 0.1980ms 0.1095ms 9.1364 KOps/s 9.0232 KOps/s $\color{#35bf28}+1.25\%$
test_compile_add_one_nested[pytree-eager] 0.4341ms 0.1814ms 5.5131 KOps/s 5.4720 KOps/s $\color{#35bf28}+0.75\%$
test_compile_copy_nested[tensordict-compile] 0.1694ms 31.1020μs 32.1522 KOps/s 30.3228 KOps/s $\textbf{\color{#35bf28}+6.03\%}$
test_compile_copy_nested[tensordict-eager] 92.6550μs 52.7382μs 18.9616 KOps/s 18.9503 KOps/s $\color{#35bf28}+0.06\%$
test_compile_copy_nested[pytree-compile] 50.2830μs 9.7639μs 102.4183 KOps/s 104.4494 KOps/s $\color{#d91a1a}-1.94\%$
test_compile_copy_nested[pytree-eager] 0.4655ms 68.3614μs 14.6281 KOps/s 14.6995 KOps/s $\color{#d91a1a}-0.49\%$
test_compile_add_one_flat[tensordict-compile] 0.3129ms 0.1783ms 5.6086 KOps/s 5.3241 KOps/s $\textbf{\color{#35bf28}+5.34\%}$
test_compile_add_one_flat[tensordict-eager] 0.3002ms 0.2605ms 3.8386 KOps/s 3.9242 KOps/s $\color{#d91a1a}-2.18\%$
test_compile_add_one_flat[tensorclass-compile] 0.1674ms 0.1176ms 8.5067 KOps/s 8.3189 KOps/s $\color{#35bf28}+2.26\%$
test_compile_add_one_flat[tensorclass-eager] 0.1109ms 69.8574μs 14.3149 KOps/s 14.2084 KOps/s $\color{#35bf28}+0.75\%$
test_compile_add_one_flat[pytree-compile] 0.2437ms 0.1605ms 6.2318 KOps/s 5.8986 KOps/s $\textbf{\color{#35bf28}+5.65\%}$
test_compile_add_one_flat[pytree-eager] 0.8455ms 0.5398ms 1.8524 KOps/s 1.7991 KOps/s $\color{#35bf28}+2.97\%$
test_compile_add_self_flat[tensordict-eager] 0.4005ms 0.3099ms 3.2266 KOps/s 3.1254 KOps/s $\color{#35bf28}+3.24\%$
test_compile_add_self_flat[tensordict-compile] 0.2229ms 0.1813ms 5.5162 KOps/s 4.9998 KOps/s $\textbf{\color{#35bf28}+10.33\%}$
test_compile_add_self_flat[tensorclass-eager] 0.1317ms 86.0808μs 11.6170 KOps/s 11.4775 KOps/s $\color{#35bf28}+1.22\%$
test_compile_add_self_flat[tensorclass-compile] 0.1773ms 0.1264ms 7.9131 KOps/s 7.6824 KOps/s $\color{#35bf28}+3.00\%$
test_compile_add_self_flat[pytree-eager] 0.6899ms 0.4395ms 2.2753 KOps/s 2.1975 KOps/s $\color{#35bf28}+3.54\%$
test_compile_add_self_flat[pytree-compile] 0.2396ms 0.1631ms 6.1320 KOps/s 5.9186 KOps/s $\color{#35bf28}+3.61\%$
test_compile_copy_flat[tensordict-compile] 0.1118ms 23.5688μs 42.4289 KOps/s 37.6846 KOps/s $\textbf{\color{#35bf28}+12.59\%}$
test_compile_copy_flat[tensordict-eager] 73.5240μs 41.1999μs 24.2719 KOps/s 24.4193 KOps/s $\color{#d91a1a}-0.60\%$
test_compile_copy_flat[pytree-compile] 48.4030μs 10.8324μs 92.3156 KOps/s 91.4806 KOps/s $\color{#35bf28}+0.91\%$
test_compile_copy_flat[pytree-eager] 0.1800s 61.9241μs 16.1488 KOps/s 19.1924 KOps/s $\textbf{\color{#d91a1a}-15.86\%}$
test_compile_assign_and_add[tensordict-compile] 1.9906ms 0.1740ms 5.7455 KOps/s 5.3998 KOps/s $\textbf{\color{#35bf28}+6.40\%}$
test_compile_assign_and_add[tensordict-eager] 3.5282ms 3.3412ms 299.2972 Ops/s 302.4571 Ops/s $\color{#d91a1a}-1.04\%$
test_compile_assign_and_add[pytree-compile] 1.9644ms 0.1624ms 6.1586 KOps/s 5.9683 KOps/s $\color{#35bf28}+3.19\%$
test_compile_assign_and_add[pytree-eager] 2.9335ms 2.8107ms 355.7789 Ops/s 352.7287 Ops/s $\color{#35bf28}+0.86\%$
test_compile_indexing[tensor-tensordict-compile] 0.2589ms 0.1107ms 9.0318 KOps/s 8.4287 KOps/s $\textbf{\color{#35bf28}+7.15\%}$
test_compile_indexing[tensor-tensordict-eager] 0.3223ms 72.6843μs 13.7581 KOps/s 13.5085 KOps/s $\color{#35bf28}+1.85\%$
test_compile_indexing[tensor-tensorclass-compile] 0.1641ms 97.2611μs 10.2816 KOps/s 9.9765 KOps/s $\color{#35bf28}+3.06\%$
test_compile_indexing[tensor-tensorclass-eager] 0.2570ms 44.9726μs 22.2358 KOps/s 21.5979 KOps/s $\color{#35bf28}+2.95\%$
test_compile_indexing[tensor-pytree-compile] 0.2606ms 98.1031μs 10.1934 KOps/s 10.1299 KOps/s $\color{#35bf28}+0.63\%$
test_compile_indexing[tensor-pytree-eager] 0.2542ms 45.2157μs 22.1162 KOps/s 21.8106 KOps/s $\color{#35bf28}+1.40\%$
test_compile_indexing[slice-tensordict-compile] 0.1140ms 56.0005μs 17.8570 KOps/s 17.1036 KOps/s $\color{#35bf28}+4.40\%$
test_compile_indexing[slice-tensordict-eager] 0.2265ms 28.3364μs 35.2903 KOps/s 34.9234 KOps/s $\color{#35bf28}+1.05\%$
test_compile_indexing[slice-tensorclass-compile] 88.3150μs 45.6110μs 21.9246 KOps/s 21.5877 KOps/s $\color{#35bf28}+1.56\%$
test_compile_indexing[slice-tensorclass-eager] 0.2646ms 22.7057μs 44.0419 KOps/s 43.4162 KOps/s $\color{#35bf28}+1.44\%$
test_compile_indexing[slice-pytree-compile] 99.9860μs 46.1269μs 21.6793 KOps/s 21.1972 KOps/s $\color{#35bf28}+2.27\%$
test_compile_indexing[slice-pytree-eager] 0.2720ms 22.3925μs 44.6578 KOps/s 43.3846 KOps/s $\color{#35bf28}+2.93\%$
test_compile_indexing[int-tensordict-compile] 97.2950μs 56.5225μs 17.6921 KOps/s 17.1613 KOps/s $\color{#35bf28}+3.09\%$
test_compile_indexing[int-tensordict-eager] 0.2313ms 28.1863μs 35.4782 KOps/s 34.7054 KOps/s $\color{#35bf28}+2.23\%$
test_compile_indexing[int-tensorclass-compile] 86.4050μs 45.8958μs 21.7885 KOps/s 21.3477 KOps/s $\color{#35bf28}+2.06\%$
test_compile_indexing[int-tensorclass-eager] 0.2581ms 22.5008μs 44.4429 KOps/s 43.4140 KOps/s $\color{#35bf28}+2.37\%$
test_compile_indexing[int-pytree-compile] 91.0650μs 45.7881μs 21.8397 KOps/s 21.2388 KOps/s $\color{#35bf28}+2.83\%$
test_compile_indexing[int-pytree-eager] 0.2740ms 22.4372μs 44.5689 KOps/s 43.6677 KOps/s $\color{#35bf28}+2.06\%$
test_mod_add[eager] 0.1033ms 50.7869μs 19.6901 KOps/s 19.6290 KOps/s $\color{#35bf28}+0.31\%$
test_mod_add[compile] 0.2045ms 0.1054ms 9.4884 KOps/s 9.4207 KOps/s $\color{#35bf28}+0.72\%$
test_mod_add[compile-overhead] 0.2333ms 0.1502ms 6.6566 KOps/s 6.6970 KOps/s $\color{#d91a1a}-0.60\%$
test_mod_wrap[eager] 0.3737ms 0.2941ms 3.4003 KOps/s 3.3913 KOps/s $\color{#35bf28}+0.27\%$
test_mod_wrap[compile] 0.4151ms 0.3498ms 2.8588 KOps/s 2.6888 KOps/s $\textbf{\color{#35bf28}+6.32\%}$
test_mod_wrap[compile-overhead] 7.4502ms 4.0739ms 245.4673 Ops/s 246.0846 Ops/s $\color{#d91a1a}-0.25\%$
test_mod_wrap_and_backward[eager] 1.6294ms 1.5139ms 660.5471 Ops/s 652.3827 Ops/s $\color{#35bf28}+1.25\%$
test_mod_wrap_and_backward[compile] 1.5222ms 1.4439ms 692.5786 Ops/s 632.9741 Ops/s $\textbf{\color{#35bf28}+9.42\%}$
test_mod_wrap_and_backward[compile-overhead] 1.2662ms 0.8871ms 1.1273 KOps/s 987.8817 Ops/s $\textbf{\color{#35bf28}+14.11\%}$
test_seq_add[eager] 0.2097ms 0.1563ms 6.3969 KOps/s 6.3088 KOps/s $\color{#35bf28}+1.40\%$
test_seq_add[compile] 0.1715ms 0.1143ms 8.7504 KOps/s 8.0210 KOps/s $\textbf{\color{#35bf28}+9.09\%}$
test_seq_add[compile-overhead] 0.3485ms 0.1561ms 6.4064 KOps/s 6.2012 KOps/s $\color{#35bf28}+3.31\%$
test_seq_wrap[eager] 0.6280ms 0.5288ms 1.8911 KOps/s 1.8109 KOps/s $\color{#35bf28}+4.43\%$
test_seq_wrap[compile] 0.4546ms 0.3683ms 2.7152 KOps/s 2.6447 KOps/s $\color{#35bf28}+2.67\%$
test_seq_wrap[compile-overhead] 0.3453ms 0.2650ms 3.7733 KOps/s 3.6919 KOps/s $\color{#35bf28}+2.21\%$
test_func_call_runtime[False-eager] 0.9219ms 0.8551ms 1.1695 KOps/s 1.1240 KOps/s $\color{#35bf28}+4.04\%$
test_func_call_runtime[False-compile] 0.9560ms 0.9085ms 1.1007 KOps/s 1.0839 KOps/s $\color{#35bf28}+1.55\%$
test_func_call_runtime[False-compile-overhead] 0.4993ms 0.4605ms 2.1717 KOps/s 2.1335 KOps/s $\color{#35bf28}+1.79\%$
test_func_call_runtime[True-eager] 1.1478ms 1.0856ms 921.1655 Ops/s 899.0116 Ops/s $\color{#35bf28}+2.46\%$
test_func_call_runtime[True-compile] 0.9694ms 0.9197ms 1.0873 KOps/s 1.0656 KOps/s $\color{#35bf28}+2.04\%$
test_func_call_runtime[True-compile-overhead] 0.5402ms 0.4735ms 2.1120 KOps/s 2.0690 KOps/s $\color{#35bf28}+2.07\%$
test_func_call_cm_runtime[False-eager] 0.9205ms 0.8471ms 1.1805 KOps/s 1.1717 KOps/s $\color{#35bf28}+0.75\%$
test_func_call_cm_runtime[False-compile] 0.9592ms 0.9138ms 1.0943 KOps/s 1.0779 KOps/s $\color{#35bf28}+1.52\%$
test_func_call_cm_runtime[False-compile-overhead] 0.5552ms 0.4645ms 2.1527 KOps/s 2.1175 KOps/s $\color{#35bf28}+1.66\%$
test_func_call_cm_runtime[True-eager] 1.3503ms 1.2328ms 811.1893 Ops/s 792.9222 Ops/s $\color{#35bf28}+2.30\%$
test_func_call_cm_runtime[True-compile] 1.0321ms 0.9561ms 1.0459 KOps/s 1.0327 KOps/s $\color{#35bf28}+1.28\%$
test_func_call_cm_runtime[True-compile-overhead] 0.5610ms 0.5059ms 1.9767 KOps/s 1.9356 KOps/s $\color{#35bf28}+2.12\%$
test_vmap_func_call_cm_runtime[eager] 2.9126ms 2.3828ms 419.6764 Ops/s 413.1532 Ops/s $\color{#35bf28}+1.58\%$
test_vmap_func_call_cm_runtime[compile] 1.0424ms 0.9716ms 1.0292 KOps/s 1.0093 KOps/s $\color{#35bf28}+1.98\%$
test_vmap_func_call_cm_runtime[compile-overhead] 0.5984ms 0.5105ms 1.9589 KOps/s 1.9106 KOps/s $\color{#35bf28}+2.53\%$
test_distributed 0.4797ms 0.1530ms 6.5339 KOps/s 6.3886 KOps/s $\color{#35bf28}+2.27\%$
test_tdmodule 0.4657ms 28.7236μs 34.8146 KOps/s 35.3241 KOps/s $\color{#d91a1a}-1.44\%$
test_tdmodule_dispatch 77.1740μs 45.7274μs 21.8687 KOps/s 21.8609 KOps/s $\color{#35bf28}+0.04\%$
test_tdseq 47.2630μs 27.2465μs 36.7020 KOps/s 36.2502 KOps/s $\color{#35bf28}+1.25\%$
test_tdseq_dispatch 66.9640μs 47.6937μs 20.9671 KOps/s 20.8621 KOps/s $\color{#35bf28}+0.50\%$
test_instantiation_functorch 2.2168ms 2.0766ms 481.5677 Ops/s 478.9778 Ops/s $\color{#35bf28}+0.54\%$
test_exec_functorch 0.2720ms 0.1825ms 5.4800 KOps/s 5.4667 KOps/s $\color{#35bf28}+0.24\%$
test_exec_functional_call 0.2759ms 0.1620ms 6.1722 KOps/s 6.1139 KOps/s $\color{#35bf28}+0.95\%$
test_exec_td_decorator 0.4679ms 0.2518ms 3.9715 KOps/s 4.1196 KOps/s $\color{#d91a1a}-3.60\%$
test_vmap_mlp_speed_decorator[True-True] 1.0298ms 0.8370ms 1.1948 KOps/s 1.1940 KOps/s $\color{#35bf28}+0.07\%$
test_vmap_mlp_speed_decorator[True-False] 1.0148ms 0.8272ms 1.2089 KOps/s 1.1940 KOps/s $\color{#35bf28}+1.25\%$
test_vmap_mlp_speed_decorator[False-True] 0.8806ms 0.7179ms 1.3930 KOps/s 1.3808 KOps/s $\color{#35bf28}+0.88\%$
test_vmap_mlp_speed_decorator[False-False] 0.9039ms 0.7150ms 1.3986 KOps/s 1.3795 KOps/s $\color{#35bf28}+1.38\%$
test_vmap_transformer_speed_decorator[True-True] 20.9654ms 20.7139ms 48.2769 Ops/s 47.8668 Ops/s $\color{#35bf28}+0.86\%$
test_vmap_transformer_speed_decorator[True-False] 21.3375ms 20.7576ms 48.1751 Ops/s 47.8125 Ops/s $\color{#35bf28}+0.76\%$
test_vmap_transformer_speed_decorator[False-True] 21.2603ms 20.5554ms 48.6489 Ops/s 48.3222 Ops/s $\color{#35bf28}+0.68\%$
test_vmap_transformer_speed_decorator[False-False] 21.3525ms 20.6744ms 48.3689 Ops/s 48.1986 Ops/s $\color{#35bf28}+0.35\%$
test_to_module_speed[True] 2.0991ms 1.4885ms 671.8095 Ops/s 668.3111 Ops/s $\color{#35bf28}+0.52\%$
test_to_module_speed[False] 2.0046ms 1.4590ms 685.3981 Ops/s 680.7504 Ops/s $\color{#35bf28}+0.68\%$
test_tc_init 72.2750μs 45.7558μs 21.8552 KOps/s 21.7228 KOps/s $\color{#35bf28}+0.61\%$
test_tc_init_tensor_only 27.0910μs 9.9449μs 100.5543 KOps/s 103.0413 KOps/s $\color{#d91a1a}-2.41\%$
test_tc_init_nested 0.1299ms 91.0898μs 10.9782 KOps/s 10.8803 KOps/s $\color{#35bf28}+0.90\%$
test_tc_init_many_fields 42.4030μs 16.5420μs 60.4523 KOps/s 60.1077 KOps/s $\color{#35bf28}+0.57\%$
test_tc_first_layer_tensor 22.0820μs 1.8541μs 539.3497 KOps/s 537.3197 KOps/s $\color{#35bf28}+0.38\%$
test_tc_first_layer_tensor_only 5.8333μs 0.7392μs 1.3528 MOps/s 1.3292 MOps/s $\color{#35bf28}+1.77\%$
test_tc_first_layer_tensor_set 21.9210μs 3.8984μs 256.5157 KOps/s 254.4301 KOps/s $\color{#35bf28}+0.82\%$
test_tc_first_layer_tensor_only_set 22.8810μs 3.1437μs 318.0931 KOps/s 312.3436 KOps/s $\color{#35bf28}+1.84\%$
test_tc_first_layer_nontensor 26.9210μs 6.1577μs 162.3976 KOps/s 161.1957 KOps/s $\color{#35bf28}+0.75\%$
test_tc_second_layer_tensor 29.6210μs 4.3832μs 228.1451 KOps/s 225.0098 KOps/s $\color{#35bf28}+1.39\%$
test_tc_second_layer_nontensor 45.3420μs 8.8148μs 113.4452 KOps/s 113.7884 KOps/s $\color{#d91a1a}-0.30\%$
test_unbind 0.2636s 16.5562ms 60.4003 Ops/s 66.9855 Ops/s $\textbf{\color{#d91a1a}-9.83\%}$
test_full_like 10.5971ms 4.3944ms 227.5608 Ops/s 59.3581 Ops/s $\textbf{\color{#35bf28}+283.37\%}$
test_zeros_like 4.4800ms 4.3643ms 229.1324 Ops/s 59.6355 Ops/s $\textbf{\color{#35bf28}+284.22\%}$
test_ones_like 4.8101ms 4.2799ms 233.6508 Ops/s 59.6098 Ops/s $\textbf{\color{#35bf28}+291.97\%}$
test_clone 6.7540ms 6.5004ms 153.8358 Ops/s 56.2822 Ops/s $\textbf{\color{#35bf28}+173.33\%}$
test_squeeze 0.1737ms 14.3525μs 69.6742 KOps/s 69.2365 KOps/s $\color{#35bf28}+0.63\%$
test_unsqueeze 0.2583ms 0.1130ms 8.8464 KOps/s 8.9054 KOps/s $\color{#d91a1a}-0.66\%$
test_split 0.2700ms 0.1871ms 5.3444 KOps/s 5.2967 KOps/s $\color{#35bf28}+0.90\%$
test_permute 0.2668ms 0.2128ms 4.6984 KOps/s 4.8159 KOps/s $\color{#d91a1a}-2.44\%$
test_stack 51.7721ms 51.0477ms 19.5895 Ops/s 19.3472 Ops/s $\color{#35bf28}+1.25\%$
test_cat 51.8422ms 51.4136ms 19.4501 Ops/s 19.4223 Ops/s $\color{#35bf28}+0.14\%$

@github-actions

github-actions Bot commented Feb 18, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 243. Improved: $\large\color{#35bf28}18$. Worsened: $\large\color{#d91a1a}7$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_plain_set_nested 37.7710μs 14.7338μs 67.8712 KOps/s 68.5042 KOps/s $\color{#d91a1a}-0.92\%$
test_plain_set_stack_nested 51.2110μs 14.9320μs 66.9703 KOps/s 67.6686 KOps/s $\color{#d91a1a}-1.03\%$
test_plain_set_nested_inplace 43.8810μs 16.3287μs 61.2417 KOps/s 61.7818 KOps/s $\color{#d91a1a}-0.87\%$
test_plain_set_stack_nested_inplace 41.1910μs 16.2366μs 61.5892 KOps/s 61.6552 KOps/s $\color{#d91a1a}-0.11\%$
test_items 29.0100μs 5.8534μs 170.8423 KOps/s 174.4911 KOps/s $\color{#d91a1a}-2.09\%$
test_items_nested 0.5057ms 0.4584ms 2.1813 KOps/s 2.1851 KOps/s $\color{#d91a1a}-0.18\%$
test_items_nested_locked 0.5092ms 0.4609ms 2.1699 KOps/s 2.1703 KOps/s $\color{#d91a1a}-0.02\%$
test_items_nested_leaf 0.1354ms 96.4731μs 10.3656 KOps/s 10.5593 KOps/s $\color{#d91a1a}-1.83\%$
test_items_stack_nested 0.5155ms 0.4634ms 2.1578 KOps/s 2.1727 KOps/s $\color{#d91a1a}-0.69\%$
test_items_stack_nested_leaf 0.1336ms 96.8100μs 10.3295 KOps/s 10.2065 KOps/s $\color{#35bf28}+1.21\%$
test_items_stack_nested_locked 0.5418ms 0.4599ms 2.1744 KOps/s 2.1458 KOps/s $\color{#35bf28}+1.33\%$
test_keys 34.4010μs 4.2189μs 237.0272 KOps/s 237.5695 KOps/s $\color{#d91a1a}-0.23\%$
test_keys_nested 0.1701ms 0.1202ms 8.3173 KOps/s 8.3692 KOps/s $\color{#d91a1a}-0.62\%$
test_keys_nested_locked 88.9469ms 0.1425ms 7.0186 KOps/s 7.7862 KOps/s $\textbf{\color{#d91a1a}-9.86\%}$
test_keys_nested_leaf 0.1483ms 0.1102ms 9.0762 KOps/s 9.0564 KOps/s $\color{#35bf28}+0.22\%$
test_keys_stack_nested 0.1590ms 0.1207ms 8.2845 KOps/s 8.3283 KOps/s $\color{#d91a1a}-0.53\%$
test_keys_stack_nested_leaf 0.1635ms 0.1105ms 9.0488 KOps/s 9.0798 KOps/s $\color{#d91a1a}-0.34\%$
test_keys_stack_nested_locked 0.1693ms 0.1286ms 7.7769 KOps/s 7.7898 KOps/s $\color{#d91a1a}-0.17\%$
test_values 6.2602μs 1.0236μs 976.9494 KOps/s 961.9108 KOps/s $\color{#35bf28}+1.56\%$
test_values_nested 77.5720μs 47.6784μs 20.9739 KOps/s 20.8411 KOps/s $\color{#35bf28}+0.64\%$
test_values_nested_locked 79.7620μs 51.0187μs 19.6006 KOps/s 19.3641 KOps/s $\color{#35bf28}+1.22\%$
test_values_nested_leaf 0.1982ms 54.5515μs 18.3313 KOps/s 18.3718 KOps/s $\color{#d91a1a}-0.22\%$
test_values_stack_nested 86.2520μs 47.9660μs 20.8481 KOps/s 20.7590 KOps/s $\color{#35bf28}+0.43\%$
test_values_stack_nested_leaf 84.2120μs 54.5769μs 18.3228 KOps/s 18.4999 KOps/s $\color{#d91a1a}-0.96\%$
test_values_stack_nested_locked 84.4420μs 51.1141μs 19.5641 KOps/s 19.4446 KOps/s $\color{#35bf28}+0.61\%$
test_membership 5.6068μs 0.8406μs 1.1896 MOps/s 1.1650 MOps/s $\color{#35bf28}+2.12\%$
test_membership_nested 25.6510μs 2.8930μs 345.6671 KOps/s 343.1945 KOps/s $\color{#35bf28}+0.72\%$
test_membership_nested_leaf 32.8310μs 2.8776μs 347.5137 KOps/s 342.2050 KOps/s $\color{#35bf28}+1.55\%$
test_membership_stacked_nested 28.9210μs 2.9336μs 340.8775 KOps/s 339.7168 KOps/s $\color{#35bf28}+0.34\%$
test_membership_stacked_nested_leaf 33.8510μs 2.9090μs 343.7632 KOps/s 341.5192 KOps/s $\color{#35bf28}+0.66\%$
test_membership_nested_last 38.6210μs 4.3488μs 229.9509 KOps/s 228.9836 KOps/s $\color{#35bf28}+0.42\%$
test_membership_nested_leaf_last 44.0210μs 4.2981μs 232.6599 KOps/s 227.5982 KOps/s $\color{#35bf28}+2.22\%$
test_membership_stacked_nested_last 38.0910μs 4.3133μs 231.8402 KOps/s 228.7676 KOps/s $\color{#35bf28}+1.34\%$
test_membership_stacked_nested_leaf_last 36.4610μs 4.3423μs 230.2954 KOps/s 227.9281 KOps/s $\color{#35bf28}+1.04\%$
test_nested_getleaf 55.4210μs 21.3255μs 46.8922 KOps/s 47.3421 KOps/s $\color{#d91a1a}-0.95\%$
test_nested_get 60.0210μs 20.1964μs 49.5138 KOps/s 49.7005 KOps/s $\color{#d91a1a}-0.38\%$
test_stacked_getleaf 53.2620μs 21.4908μs 46.5316 KOps/s 47.6506 KOps/s $\color{#d91a1a}-2.35\%$
test_stacked_get 50.1010μs 20.5473μs 48.6681 KOps/s 50.0215 KOps/s $\color{#d91a1a}-2.71\%$
test_nested_getitemleaf 54.4520μs 21.8113μs 45.8479 KOps/s 46.1358 KOps/s $\color{#d91a1a}-0.62\%$
test_nested_getitem 45.4610μs 20.7648μs 48.1585 KOps/s 49.0351 KOps/s $\color{#d91a1a}-1.79\%$
test_stacked_getitemleaf 49.0310μs 21.6796μs 46.1263 KOps/s 45.9868 KOps/s $\color{#35bf28}+0.30\%$
test_stacked_getitem 51.0010μs 20.6807μs 48.3542 KOps/s 47.7553 KOps/s $\color{#35bf28}+1.25\%$
test_lock_nested 8.2525ms 0.4815ms 2.0768 KOps/s 2.0865 KOps/s $\color{#d91a1a}-0.47\%$
test_lock_stack_nested 0.5208ms 0.4788ms 2.0886 KOps/s 2.0656 KOps/s $\color{#35bf28}+1.12\%$
test_unlock_nested 0.4620ms 0.3845ms 2.6008 KOps/s 2.6087 KOps/s $\color{#d91a1a}-0.30\%$
test_unlock_stack_nested 0.4319ms 0.3838ms 2.6056 KOps/s 2.5701 KOps/s $\color{#35bf28}+1.38\%$
test_flatten_speed 0.1697ms 0.1218ms 8.2131 KOps/s 8.1657 KOps/s $\color{#35bf28}+0.58\%$
test_unflatten_speed 0.6193ms 0.5662ms 1.7660 KOps/s 1.7675 KOps/s $\color{#d91a1a}-0.08\%$
test_common_ops 0.7962ms 0.6736ms 1.4847 KOps/s 1.4522 KOps/s $\color{#35bf28}+2.24\%$
test_creation 27.6000μs 2.9290μs 341.4184 KOps/s 343.0245 KOps/s $\color{#d91a1a}-0.47\%$
test_creation_empty 28.6000μs 6.1852μs 161.6771 KOps/s 161.9040 KOps/s $\color{#d91a1a}-0.14\%$
test_creation_nested_1 39.1510μs 10.5862μs 94.4628 KOps/s 94.5623 KOps/s $\color{#d91a1a}-0.11\%$
test_creation_nested_2 45.4110μs 11.8965μs 84.0585 KOps/s 83.7244 KOps/s $\color{#35bf28}+0.40\%$
test_creation_many_keys[10] 41.3310μs 18.5640μs 53.8677 KOps/s 54.7542 KOps/s $\color{#d91a1a}-1.62\%$
test_creation_many_keys[50] 0.1114ms 79.0619μs 12.6483 KOps/s 12.8098 KOps/s $\color{#d91a1a}-1.26\%$
test_creation_many_keys[100] 0.2012ms 0.1548ms 6.4584 KOps/s 6.5597 KOps/s $\color{#d91a1a}-1.54\%$
test_creation_nested_many_keys[10] 65.1920μs 39.6569μs 25.2163 KOps/s 25.4281 KOps/s $\color{#d91a1a}-0.83\%$
test_creation_nested_many_keys[50] 0.2011ms 0.1613ms 6.1992 KOps/s 6.2793 KOps/s $\color{#d91a1a}-1.28\%$
test_clone 40.7210μs 13.3558μs 74.8736 KOps/s 73.3471 KOps/s $\color{#35bf28}+2.08\%$
test_getitem[int] 1.6959ms 14.6386μs 68.3125 KOps/s 55.8260 KOps/s $\textbf{\color{#35bf28}+22.37\%}$
test_getitem[slice_int] 0.1441ms 24.5991μs 40.6520 KOps/s 40.8068 KOps/s $\color{#d91a1a}-0.38\%$
test_getitem[range] 0.1745ms 62.0593μs 16.1136 KOps/s 15.9324 KOps/s $\color{#35bf28}+1.14\%$
test_getitem[tuple] 0.1456ms 24.0794μs 41.5294 KOps/s 41.9155 KOps/s $\color{#d91a1a}-0.92\%$
test_getitem[list] 0.1806ms 56.9793μs 17.5502 KOps/s 17.1610 KOps/s $\color{#35bf28}+2.27\%$
test_setitem_dim[int] 46.9710μs 25.1606μs 39.7447 KOps/s 38.0815 KOps/s $\color{#35bf28}+4.37\%$
test_setitem_dim[slice_int] 60.9110μs 42.9538μs 23.2808 KOps/s 22.8123 KOps/s $\color{#35bf28}+2.05\%$
test_setitem_dim[range] 0.1191ms 93.2937μs 10.7188 KOps/s 10.5759 KOps/s $\color{#35bf28}+1.35\%$
test_setitem_dim[tuple] 76.9520μs 40.5899μs 24.6367 KOps/s 24.5311 KOps/s $\color{#35bf28}+0.43\%$
test_setitem 45.5710μs 17.8063μs 56.1598 KOps/s 55.9171 KOps/s $\color{#35bf28}+0.43\%$
test_set 50.8810μs 17.0889μs 58.5174 KOps/s 57.9370 KOps/s $\color{#35bf28}+1.00\%$
test_set_shared 0.4877ms 0.2067ms 4.8370 KOps/s 4.7184 KOps/s $\color{#35bf28}+2.51\%$
test_update 0.1955ms 21.5455μs 46.4134 KOps/s 45.4985 KOps/s $\color{#35bf28}+2.01\%$
test_update_nested 74.1220μs 34.4388μs 29.0370 KOps/s 29.7202 KOps/s $\color{#d91a1a}-2.30\%$
test_update__nested 0.5286ms 33.9202μs 29.4810 KOps/s 28.3011 KOps/s $\color{#35bf28}+4.17\%$
test_set_nested 56.5710μs 18.8743μs 52.9822 KOps/s 52.1374 KOps/s $\color{#35bf28}+1.62\%$
test_set_nested_new 59.5610μs 23.5926μs 42.3862 KOps/s 40.1381 KOps/s $\textbf{\color{#35bf28}+5.60\%}$
test_select 75.8920μs 41.6510μs 24.0090 KOps/s 23.5843 KOps/s $\color{#35bf28}+1.80\%$
test_select_nested 0.1090ms 75.0063μs 13.3322 KOps/s 13.3434 KOps/s $\color{#d91a1a}-0.08\%$
test_exclude_nested 0.1289ms 91.2694μs 10.9566 KOps/s 10.7449 KOps/s $\color{#35bf28}+1.97\%$
test_empty[True] 0.4355ms 0.3858ms 2.5923 KOps/s 2.5494 KOps/s $\color{#35bf28}+1.68\%$
test_empty[False] 7.5928μs 1.3083μs 764.3553 KOps/s 739.6235 KOps/s $\color{#35bf28}+3.34\%$
test_to 0.1065ms 72.2954μs 13.8321 KOps/s 13.0065 KOps/s $\textbf{\color{#35bf28}+6.35\%}$
test_to_nonblocking 0.1108ms 64.9969μs 15.3853 KOps/s 15.2810 KOps/s $\color{#35bf28}+0.68\%$
test_unbind_speed 0.3670ms 0.3289ms 3.0403 KOps/s 3.0400 KOps/s $+0.01\%$
test_unbind_speed_stack0 0.4007ms 0.3246ms 3.0807 KOps/s 3.0649 KOps/s $\color{#35bf28}+0.51\%$
test_unbind_speed_stack1 0.1037s 0.9112ms 1.0975 KOps/s 1.1812 KOps/s $\textbf{\color{#d91a1a}-7.08\%}$
test_split 1.2183ms 1.1323ms 883.1257 Ops/s 776.2650 Ops/s $\textbf{\color{#35bf28}+13.77\%}$
test_chunk 0.1033s 1.2087ms 827.3415 Ops/s 916.3497 Ops/s $\textbf{\color{#d91a1a}-9.71\%}$
test_to_cpu_blocking 28.9731ms 28.7743ms 34.7532 Ops/s 45.7638 Ops/s $\textbf{\color{#d91a1a}-24.06\%}$
test_to_cpu_global_sync 11.5743ms 11.4100ms 87.6423 Ops/s 87.2748 Ops/s $\color{#35bf28}+0.42\%$
test_to_cpu_event_sync 12.5842ms 12.3514ms 80.9623 Ops/s 80.4047 Ops/s $\color{#35bf28}+0.69\%$
test_to_cpu_default 0.1156s 13.6498ms 73.2614 Ops/s 80.2922 Ops/s $\textbf{\color{#d91a1a}-8.76\%}$
test_consolidate[False-None] 4.2348ms 4.1035ms 243.6940 Ops/s 219.9089 Ops/s $\textbf{\color{#35bf28}+10.82\%}$
test_consolidate[default-None] 2.0893ms 2.0091ms 497.7371 Ops/s 486.5803 Ops/s $\color{#35bf28}+2.29\%$
test_consolidate[reduce-overhead-None] 2.0082ms 1.9327ms 517.4161 Ops/s 507.2656 Ops/s $\color{#35bf28}+2.00\%$
test_consolidate_njt[False-None] 8.6102ms 8.3660ms 119.5310 Ops/s 117.9100 Ops/s $\color{#35bf28}+1.37\%$
test_to[False-False-None] 2.1752ms 2.0859ms 479.4070 Ops/s 472.3509 Ops/s $\color{#35bf28}+1.49\%$
test_to[True-False-None] 2.2042ms 1.9265ms 519.0628 Ops/s 518.2225 Ops/s $\color{#35bf28}+0.16\%$
test_to[within-False-None] 6.4350ms 6.1063ms 163.7640 Ops/s 162.4358 Ops/s $\color{#35bf28}+0.82\%$
test_to[True-default-None] 8.1403ms 7.7147ms 129.6226 Ops/s 129.3507 Ops/s $\color{#35bf28}+0.21\%$
test_to_njt[False-False-None] 8.9129ms 8.5078ms 117.5390 Ops/s 115.0971 Ops/s $\color{#35bf28}+2.12\%$
test_to_njt[True-False-None] 7.0221ms 6.8443ms 146.1074 Ops/s 142.0466 Ops/s $\color{#35bf28}+2.86\%$
test_to_njt[within-False-None] 15.5370ms 15.2292ms 65.6634 Ops/s 30.5417 Ops/s $\textbf{\color{#35bf28}+115.00\%}$
test_creation[device0] 0.4425ms 0.1188ms 8.4198 KOps/s 8.2391 KOps/s $\color{#35bf28}+2.19\%$
test_creation_from_tensor 0.4804ms 0.1192ms 8.3869 KOps/s 8.3975 KOps/s $\color{#d91a1a}-0.13\%$
test_add_one[memmap_tensor0] 0.1990ms 6.4976μs 153.9028 KOps/s 152.0647 KOps/s $\color{#35bf28}+1.21\%$
test_contiguous[memmap_tensor0] 29.1910μs 0.6743μs 1.4831 MOps/s 2.1440 MOps/s $\textbf{\color{#d91a1a}-30.83\%}$
test_stack[memmap_tensor0] 33.2010μs 4.5622μs 219.1936 KOps/s 215.9824 KOps/s $\color{#35bf28}+1.49\%$
test_memmaptd_index 0.9647ms 0.2598ms 3.8486 KOps/s 3.8462 KOps/s $\color{#35bf28}+0.06\%$
test_memmaptd_index_astensor 0.5045ms 0.3519ms 2.8413 KOps/s 2.8199 KOps/s $\color{#35bf28}+0.76\%$
test_memmaptd_index_op 0.8424ms 0.5896ms 1.6961 KOps/s 1.6560 KOps/s $\color{#35bf28}+2.42\%$
test_serialize_model 0.1370s 0.1363s 7.3383 Ops/s 7.3171 Ops/s $\color{#35bf28}+0.29\%$
test_serialize_model_pickle 1.3475s 1.2107s 0.8260 Ops/s 0.8230 Ops/s $\color{#35bf28}+0.36\%$
test_serialize_weights 0.1381s 0.1359s 7.3579 Ops/s 7.3887 Ops/s $\color{#d91a1a}-0.42\%$
test_serialize_weights_returnearly 0.4158s 89.8222ms 11.1331 Ops/s 10.5523 Ops/s $\textbf{\color{#35bf28}+5.50\%}$
test_serialize_weights_pickle 1.3687s 1.1970s 0.8355 Ops/s 0.8229 Ops/s $\color{#35bf28}+1.52\%$
test_reshape_pytree 0.2038ms 33.1183μs 30.1948 KOps/s 29.6488 KOps/s $\color{#35bf28}+1.84\%$
test_reshape_td 71.0010μs 44.3401μs 22.5529 KOps/s 22.7411 KOps/s $\color{#d91a1a}-0.83\%$
test_view_pytree 0.2260ms 32.5777μs 30.6959 KOps/s 30.1728 KOps/s $\color{#35bf28}+1.73\%$
test_view_td 81.5120μs 51.6425μs 19.3639 KOps/s 19.5349 KOps/s $\color{#d91a1a}-0.88\%$
test_unbind_pytree 0.2448ms 36.6488μs 27.2860 KOps/s 26.8184 KOps/s $\color{#35bf28}+1.74\%$
test_unbind_td 88.6920μs 49.4382μs 20.2273 KOps/s 20.2301 KOps/s $\color{#d91a1a}-0.01\%$
test_split_pytree 0.2535ms 42.6472μs 23.4482 KOps/s 23.2489 KOps/s $\color{#35bf28}+0.86\%$
test_split_td 0.1586ms 64.8965μs 15.4091 KOps/s 15.6034 KOps/s $\color{#d91a1a}-1.25\%$
test_add_pytree 0.2351ms 41.6220μs 24.0258 KOps/s 23.7410 KOps/s $\color{#35bf28}+1.20\%$
test_add_td 91.5120μs 52.6538μs 18.9920 KOps/s 18.8077 KOps/s $\color{#35bf28}+0.98\%$
test_compile_add_one_nested[tensordict-compile] 0.1924ms 0.1384ms 7.2259 KOps/s 6.6120 KOps/s $\textbf{\color{#35bf28}+9.29\%}$
test_compile_add_one_nested[tensordict-eager] 0.5525ms 0.1924ms 5.1970 KOps/s 5.2971 KOps/s $\color{#d91a1a}-1.89\%$
test_compile_add_one_nested[pytree-compile] 0.1772ms 0.1082ms 9.2423 KOps/s 9.0247 KOps/s $\color{#35bf28}+2.41\%$
test_compile_add_one_nested[pytree-eager] 0.4493ms 0.1803ms 5.5477 KOps/s 5.4876 KOps/s $\color{#35bf28}+1.09\%$
test_compile_copy_nested[tensordict-compile] 0.4544ms 28.3934μs 35.2195 KOps/s 31.5170 KOps/s $\textbf{\color{#35bf28}+11.75\%}$
test_compile_copy_nested[tensordict-eager] 0.4716ms 52.8046μs 18.9378 KOps/s 18.9852 KOps/s $\color{#d91a1a}-0.25\%$
test_compile_copy_nested[pytree-compile] 33.8000μs 9.7354μs 102.7181 KOps/s 103.9156 KOps/s $\color{#d91a1a}-1.15\%$
test_compile_copy_nested[pytree-eager] 0.5055ms 68.4325μs 14.6129 KOps/s 14.2892 KOps/s $\color{#35bf28}+2.27\%$
test_compile_add_one_flat[tensordict-compile] 0.2237ms 0.1774ms 5.6355 KOps/s 5.4305 KOps/s $\color{#35bf28}+3.77\%$
test_compile_add_one_flat[tensordict-eager] 0.4349ms 0.2556ms 3.9124 KOps/s 3.9232 KOps/s $\color{#d91a1a}-0.28\%$
test_compile_add_one_flat[tensorclass-compile] 0.2670ms 0.1161ms 8.6100 KOps/s 8.0021 KOps/s $\textbf{\color{#35bf28}+7.60\%}$
test_compile_add_one_flat[tensorclass-eager] 0.1207ms 68.7588μs 14.5436 KOps/s 14.6440 KOps/s $\color{#d91a1a}-0.69\%$
test_compile_add_one_flat[pytree-compile] 0.3963ms 0.2068ms 4.8359 KOps/s 6.0626 KOps/s $\textbf{\color{#d91a1a}-20.23\%}$
test_compile_add_one_flat[pytree-eager] 0.7029ms 0.5323ms 1.8785 KOps/s 1.8386 KOps/s $\color{#35bf28}+2.17\%$
test_compile_add_self_flat[tensordict-eager] 0.4514ms 0.3109ms 3.2162 KOps/s 3.1938 KOps/s $\color{#35bf28}+0.70\%$
test_compile_add_self_flat[tensordict-compile] 0.2224ms 0.1808ms 5.5309 KOps/s 5.1852 KOps/s $\textbf{\color{#35bf28}+6.67\%}$
test_compile_add_self_flat[tensorclass-eager] 0.1534ms 84.7332μs 11.8018 KOps/s 11.8125 KOps/s $\color{#d91a1a}-0.09\%$
test_compile_add_self_flat[tensorclass-compile] 0.1861ms 0.1194ms 8.3718 KOps/s 8.0087 KOps/s $\color{#35bf28}+4.53\%$
test_compile_add_self_flat[pytree-eager] 0.6553ms 0.4432ms 2.2564 KOps/s 2.2971 KOps/s $\color{#d91a1a}-1.77\%$
test_compile_add_self_flat[pytree-compile] 0.2194ms 0.1601ms 6.2463 KOps/s 6.1274 KOps/s $\color{#35bf28}+1.94\%$
test_compile_copy_flat[tensordict-compile] 94.2620μs 23.4515μs 42.6412 KOps/s 40.1646 KOps/s $\textbf{\color{#35bf28}+6.17\%}$
test_compile_copy_flat[tensordict-eager] 78.2910μs 41.8464μs 23.8969 KOps/s 25.0336 KOps/s $\color{#d91a1a}-4.54\%$
test_compile_copy_flat[pytree-compile] 49.3010μs 10.7394μs 93.1151 KOps/s 92.3781 KOps/s $\color{#35bf28}+0.80\%$
test_compile_copy_flat[pytree-eager] 0.4043ms 52.0389μs 19.2164 KOps/s 19.2239 KOps/s $\color{#d91a1a}-0.04\%$
test_compile_assign_and_add[tensordict-compile] 1.9912ms 0.1743ms 5.7368 KOps/s 5.1951 KOps/s $\textbf{\color{#35bf28}+10.43\%}$
test_compile_assign_and_add[tensordict-eager] 3.4044ms 3.3186ms 301.3327 Ops/s 303.5159 Ops/s $\color{#d91a1a}-0.72\%$
test_compile_assign_and_add[pytree-compile] 1.9830ms 0.1618ms 6.1822 KOps/s 6.0489 KOps/s $\color{#35bf28}+2.20\%$
test_compile_assign_and_add[pytree-eager] 3.2098ms 2.9644ms 337.3409 Ops/s 354.6022 Ops/s $\color{#d91a1a}-4.87\%$
test_compile_indexing[tensor-tensordict-compile] 0.1485ms 0.1085ms 9.2146 KOps/s 8.6374 KOps/s $\textbf{\color{#35bf28}+6.68\%}$
test_compile_indexing[tensor-tensordict-eager] 0.3133ms 73.9402μs 13.5244 KOps/s 13.0555 KOps/s $\color{#35bf28}+3.59\%$
test_compile_indexing[tensor-tensorclass-compile] 0.1405ms 96.2330μs 10.3914 KOps/s 10.2100 KOps/s $\color{#35bf28}+1.78\%$
test_compile_indexing[tensor-tensorclass-eager] 0.2485ms 45.4170μs 22.0182 KOps/s 21.7659 KOps/s $\color{#35bf28}+1.16\%$
test_compile_indexing[tensor-pytree-compile] 0.1470ms 97.1331μs 10.2951 KOps/s 10.1090 KOps/s $\color{#35bf28}+1.84\%$
test_compile_indexing[tensor-pytree-eager] 0.2450ms 45.2925μs 22.0787 KOps/s 21.7837 KOps/s $\color{#35bf28}+1.35\%$
test_compile_indexing[slice-tensordict-compile] 0.1034ms 54.4153μs 18.3772 KOps/s 17.2473 KOps/s $\textbf{\color{#35bf28}+6.55\%}$
test_compile_indexing[slice-tensordict-eager] 0.2248ms 28.0340μs 35.6710 KOps/s 35.6578 KOps/s $\color{#35bf28}+0.04\%$
test_compile_indexing[slice-tensorclass-compile] 92.2620μs 45.1928μs 22.1274 KOps/s 22.1124 KOps/s $\color{#35bf28}+0.07\%$
test_compile_indexing[slice-tensorclass-eager] 0.2552ms 22.5860μs 44.2752 KOps/s 43.7657 KOps/s $\color{#35bf28}+1.16\%$
test_compile_indexing[slice-pytree-compile] 90.5820μs 45.2874μs 22.0812 KOps/s 21.6297 KOps/s $\color{#35bf28}+2.09\%$
test_compile_indexing[slice-pytree-eager] 0.2611ms 22.5297μs 44.3859 KOps/s 44.2147 KOps/s $\color{#35bf28}+0.39\%$
test_compile_indexing[int-tensordict-compile] 0.1000ms 55.9004μs 17.8890 KOps/s 17.5443 KOps/s $\color{#35bf28}+1.96\%$
test_compile_indexing[int-tensordict-eager] 0.2685ms 28.0006μs 35.7135 KOps/s 35.9259 KOps/s $\color{#d91a1a}-0.59\%$
test_compile_indexing[int-tensorclass-compile] 88.2120μs 46.0896μs 21.6968 KOps/s 21.5730 KOps/s $\color{#35bf28}+0.57\%$
test_compile_indexing[int-tensorclass-eager] 0.2701ms 22.4614μs 44.5207 KOps/s 44.1232 KOps/s $\color{#35bf28}+0.90\%$
test_compile_indexing[int-pytree-compile] 81.4720μs 45.2580μs 22.0956 KOps/s 21.4643 KOps/s $\color{#35bf28}+2.94\%$
test_compile_indexing[int-pytree-eager] 0.2678ms 22.4873μs 44.4695 KOps/s 44.0709 KOps/s $\color{#35bf28}+0.90\%$
test_mod_add[eager] 90.7320μs 50.4275μs 19.8305 KOps/s 20.0625 KOps/s $\color{#d91a1a}-1.16\%$
test_mod_add[compile] 0.1956ms 0.1034ms 9.6755 KOps/s 9.3125 KOps/s $\color{#35bf28}+3.90\%$
test_mod_add[compile-overhead] 0.2556ms 0.1487ms 6.7260 KOps/s 6.5329 KOps/s $\color{#35bf28}+2.95\%$
test_mod_wrap[eager] 0.4138ms 0.2953ms 3.3863 KOps/s 3.4225 KOps/s $\color{#d91a1a}-1.06\%$
test_mod_wrap[compile] 0.4361ms 0.3478ms 2.8749 KOps/s 2.8389 KOps/s $\color{#35bf28}+1.27\%$
test_mod_wrap[compile-overhead] 7.3313ms 4.0430ms 247.3416 Ops/s 253.9811 Ops/s $\color{#d91a1a}-2.61\%$
test_mod_wrap_and_backward[eager] 1.9194ms 1.4985ms 667.3498 Ops/s 667.8684 Ops/s $\color{#d91a1a}-0.08\%$
test_mod_wrap_and_backward[compile] 1.7414ms 1.4450ms 692.0610 Ops/s 676.2408 Ops/s $\color{#35bf28}+2.34\%$
test_mod_wrap_and_backward[compile-overhead] 1.2746ms 0.8877ms 1.1265 KOps/s 1.1050 KOps/s $\color{#35bf28}+1.94\%$
test_seq_add[eager] 0.6575ms 0.1560ms 6.4100 KOps/s 6.4830 KOps/s $\color{#d91a1a}-1.12\%$
test_seq_add[compile] 0.5554ms 0.1129ms 8.8555 KOps/s 8.4176 KOps/s $\textbf{\color{#35bf28}+5.20\%}$
test_seq_add[compile-overhead] 0.5991ms 0.1552ms 6.4448 KOps/s 6.2239 KOps/s $\color{#35bf28}+3.55\%$
test_seq_wrap[eager] 0.9587ms 0.5226ms 1.9135 KOps/s 1.9186 KOps/s $\color{#d91a1a}-0.26\%$
test_seq_wrap[compile] 0.8054ms 0.3674ms 2.7216 KOps/s 2.6903 KOps/s $\color{#35bf28}+1.16\%$
test_seq_wrap[compile-overhead] 0.3242ms 0.2649ms 3.7749 KOps/s 3.7045 KOps/s $\color{#35bf28}+1.90\%$
test_func_call_runtime[False-eager] 1.3084ms 0.8420ms 1.1877 KOps/s 1.1863 KOps/s $\color{#35bf28}+0.11\%$
test_func_call_runtime[False-compile] 1.3516ms 0.9142ms 1.0938 KOps/s 1.0917 KOps/s $\color{#35bf28}+0.20\%$
test_func_call_runtime[False-compile-overhead] 0.6370ms 0.4585ms 2.1809 KOps/s 2.1517 KOps/s $\color{#35bf28}+1.36\%$
test_func_call_runtime[True-eager] 1.2317ms 1.0876ms 919.4678 Ops/s 916.3228 Ops/s $\color{#35bf28}+0.34\%$
test_func_call_runtime[True-compile] 1.4325ms 0.9211ms 1.0857 KOps/s 1.0725 KOps/s $\color{#35bf28}+1.23\%$
test_func_call_runtime[True-compile-overhead] 0.5579ms 0.4715ms 2.1209 KOps/s 2.0757 KOps/s $\color{#35bf28}+2.18\%$
test_func_call_cm_runtime[False-eager] 0.9804ms 0.8433ms 1.1859 KOps/s 1.1866 KOps/s $\color{#d91a1a}-0.06\%$
test_func_call_cm_runtime[False-compile] 1.0878ms 0.9157ms 1.0920 KOps/s 1.0886 KOps/s $\color{#35bf28}+0.32\%$
test_func_call_cm_runtime[False-compile-overhead] 0.5211ms 0.4623ms 2.1629 KOps/s 2.1417 KOps/s $\color{#35bf28}+0.99\%$
test_func_call_cm_runtime[True-eager] 1.4127ms 1.2294ms 813.4242 Ops/s 806.9510 Ops/s $\color{#35bf28}+0.80\%$
test_func_call_cm_runtime[True-compile] 1.1144ms 0.9585ms 1.0433 KOps/s 1.0357 KOps/s $\color{#35bf28}+0.73\%$
test_func_call_cm_runtime[True-compile-overhead] 0.5757ms 0.5035ms 1.9860 KOps/s 1.9497 KOps/s $\color{#35bf28}+1.87\%$
test_vmap_func_call_cm_runtime[eager] 2.8796ms 2.3671ms 422.4606 Ops/s 421.0279 Ops/s $\color{#35bf28}+0.34\%$
test_vmap_func_call_cm_runtime[compile] 1.0881ms 0.9753ms 1.0253 KOps/s 1.0163 KOps/s $\color{#35bf28}+0.88\%$
test_vmap_func_call_cm_runtime[compile-overhead] 0.5852ms 0.5099ms 1.9610 KOps/s 1.9170 KOps/s $\color{#35bf28}+2.29\%$
test_distributed 0.6157ms 0.1528ms 6.5425 KOps/s 6.3934 KOps/s $\color{#35bf28}+2.33\%$
test_tdmodule 0.5336ms 28.2639μs 35.3809 KOps/s 36.0525 KOps/s $\color{#d91a1a}-1.86\%$
test_tdmodule_dispatch 76.4020μs 45.6031μs 21.9283 KOps/s 21.9013 KOps/s $\color{#35bf28}+0.12\%$
test_tdseq 49.2910μs 27.1338μs 36.8544 KOps/s 36.7855 KOps/s $\color{#35bf28}+0.19\%$
test_tdseq_dispatch 73.7510μs 47.7357μs 20.9487 KOps/s 20.5540 KOps/s $\color{#35bf28}+1.92\%$
test_instantiation_functorch 2.1629ms 2.0643ms 484.4266 Ops/s 483.5387 Ops/s $\color{#35bf28}+0.18\%$
test_exec_functorch 0.2369ms 0.1798ms 5.5632 KOps/s 5.5179 KOps/s $\color{#35bf28}+0.82\%$
test_exec_functional_call 0.2198ms 0.1602ms 6.2422 KOps/s 6.2528 KOps/s $\color{#d91a1a}-0.17\%$
test_exec_td_decorator 0.4603ms 0.2345ms 4.2636 KOps/s 4.1901 KOps/s $\color{#35bf28}+1.75\%$
test_vmap_mlp_speed_decorator[True-True] 1.0111ms 0.8278ms 1.2081 KOps/s 1.2100 KOps/s $\color{#d91a1a}-0.16\%$
test_vmap_mlp_speed_decorator[True-False] 0.9984ms 0.8252ms 1.2118 KOps/s 1.2151 KOps/s $\color{#d91a1a}-0.27\%$
test_vmap_mlp_speed_decorator[False-True] 0.9058ms 0.7160ms 1.3967 KOps/s 1.3998 KOps/s $\color{#d91a1a}-0.22\%$
test_vmap_mlp_speed_decorator[False-False] 0.8869ms 0.7165ms 1.3958 KOps/s 1.4016 KOps/s $\color{#d91a1a}-0.41\%$
test_vmap_transformer_speed_decorator[True-True] 21.3538ms 20.5763ms 48.5996 Ops/s 48.6343 Ops/s $\color{#d91a1a}-0.07\%$
test_vmap_transformer_speed_decorator[True-False] 21.2765ms 20.5966ms 48.5516 Ops/s 48.6375 Ops/s $\color{#d91a1a}-0.18\%$
test_vmap_transformer_speed_decorator[False-True] 21.0612ms 20.3981ms 49.0243 Ops/s 49.0318 Ops/s $\color{#d91a1a}-0.02\%$
test_vmap_transformer_speed_decorator[False-False] 21.0456ms 20.4322ms 48.9423 Ops/s 48.9958 Ops/s $\color{#d91a1a}-0.11\%$
test_to_module_speed[True] 2.0555ms 1.4735ms 678.6357 Ops/s 669.6369 Ops/s $\color{#35bf28}+1.34\%$
test_to_module_speed[False] 1.9384ms 1.4365ms 696.1598 Ops/s 683.3494 Ops/s $\color{#35bf28}+1.87\%$
test_tc_init 65.7320μs 46.0426μs 21.7190 KOps/s 22.0261 KOps/s $\color{#d91a1a}-1.39\%$
test_tc_init_tensor_only 38.1710μs 9.9626μs 100.3752 KOps/s 101.7070 KOps/s $\color{#d91a1a}-1.31\%$
test_tc_init_nested 0.1593ms 90.8174μs 11.0111 KOps/s 11.0350 KOps/s $\color{#d91a1a}-0.22\%$
test_tc_init_many_fields 53.1710μs 16.6836μs 59.9392 KOps/s 59.9840 KOps/s $\color{#d91a1a}-0.07\%$
test_tc_first_layer_tensor 29.2400μs 1.8810μs 531.6342 KOps/s 536.4129 KOps/s $\color{#d91a1a}-0.89\%$
test_tc_first_layer_tensor_only 9.1830μs 0.7680μs 1.3021 MOps/s 1.3081 MOps/s $\color{#d91a1a}-0.46\%$
test_tc_first_layer_tensor_set 38.1510μs 3.9460μs 253.4224 KOps/s 254.3302 KOps/s $\color{#d91a1a}-0.36\%$
test_tc_first_layer_tensor_only_set 26.9600μs 3.1998μs 312.5182 KOps/s 315.0159 KOps/s $\color{#d91a1a}-0.79\%$
test_tc_first_layer_nontensor 29.5110μs 6.1390μs 162.8933 KOps/s 155.8309 KOps/s $\color{#35bf28}+4.53\%$
test_tc_second_layer_tensor 39.7310μs 4.4033μs 227.1016 KOps/s 227.6150 KOps/s $\color{#d91a1a}-0.23\%$
test_tc_second_layer_nontensor 39.4000μs 8.5879μs 116.4423 KOps/s 109.8657 KOps/s $\textbf{\color{#35bf28}+5.99\%}$
test_unbind 0.2599s 16.1112ms 62.0687 Ops/s 57.4745 Ops/s $\textbf{\color{#35bf28}+7.99\%}$
test_full_like 5.1332ms 4.3314ms 230.8730 Ops/s 230.9443 Ops/s $\color{#d91a1a}-0.03\%$
test_zeros_like 4.6655ms 4.3580ms 229.4646 Ops/s 228.8191 Ops/s $\color{#35bf28}+0.28\%$
test_ones_like 4.8208ms 4.4270ms 225.8884 Ops/s 228.7291 Ops/s $\color{#d91a1a}-1.24\%$
test_clone 6.8373ms 6.4347ms 155.4069 Ops/s 155.2932 Ops/s $\color{#35bf28}+0.07\%$
test_squeeze 0.1841ms 14.1135μs 70.8544 KOps/s 69.4496 KOps/s $\color{#35bf28}+2.02\%$
test_unsqueeze 0.1646ms 0.1100ms 9.0879 KOps/s 9.0759 KOps/s $\color{#35bf28}+0.13\%$
test_split 0.3571ms 0.1833ms 5.4545 KOps/s 5.3686 KOps/s $\color{#35bf28}+1.60\%$
test_permute 0.2943ms 0.2053ms 4.8698 KOps/s 4.9044 KOps/s $\color{#d91a1a}-0.71\%$
test_stack 51.5216ms 51.1791ms 19.5392 Ops/s 19.5016 Ops/s $\color{#35bf28}+0.19\%$
test_cat 51.4976ms 51.2267ms 19.5211 Ops/s 19.1277 Ops/s $\color{#35bf28}+2.06\%$

@vmoens
Update
7581d23 
[ghstack-poisoned]
@vmoens vmoens mentioned this pull request Feb 18, 2026
Merged
@vmoens
Update
de803f0 
[ghstack-poisoned]
@vmoens vmoens mentioned this pull request Feb 19, 2026
Closed
@github-actions

github-actions Bot commented Feb 19, 2026

Copy link
Copy Markdown
Contributor

PR Title Label Error

Unknown or invalid prefix [Distributed].

Current title: [Distributed] Add all_reduce collective

Supported Prefixes

Your PR title must start with exactly one of these prefixes:

Prefix Label Applied Example
[BugFix] BugFix [BugFix] Fix memory leak in TensorDict
[Feature] Feature [Feature] Add new storage backend
[Doc] or [Docs] Documentation [Doc] Update installation guide
[Refactor] Refactor [Refactor] Clean up module imports
[CI] CI [CI] Fix workflow permissions
[Test] or [Tests] Test [Test] Add unit tests for nn module
[Compile] Compile [Compile] Fix torch.compile issue
[Performance] or [Perf] Perf [Perf] Optimize tensor operations
[Deprecation] Deprecation [Deprecation] Mark old function
[Setup] Setup [Setup] Update build configuration

Note: Common variations like singular/plural are supported (e.g., [Doc] or [Docs]).

@vmoens vmoens mentioned this pull request Feb 19, 2026
Merged
@vmoens
Update
54aab3d 
[ghstack-poisoned]
@github-actions

github-actions Bot commented Feb 19, 2026

Copy link
Copy Markdown
Contributor

PR Title Label Error

Unknown or invalid prefix [Distributed].

Current title: [Distributed] Add all_reduce collective

Supported Prefixes

Your PR title must start with exactly one of these prefixes:

Prefix Label Applied Example
[BugFix] BugFix [BugFix] Fix memory leak in TensorDict
[Feature] Feature [Feature] Add new storage backend
[Doc] or [Docs] Documentation [Doc] Update installation guide
[Refactor] Refactor [Refactor] Clean up module imports
[CI] CI [CI] Fix workflow permissions
[Test] or [Tests] Test [Test] Add unit tests for nn module
[Compile] Compile [Compile] Fix torch.compile issue
[Performance] or [Perf] Perf [Perf] Optimize tensor operations
[Deprecation] Deprecation [Deprecation] Mark old function
[Setup] Setup [Setup] Update build configuration

Note: Common variations like singular/plural are supported (e.g., [Doc] or [Docs]).

vmoens added a commit that referenced this pull request Feb 19, 2026
@vmoens @cursoragent
[Distributed] Add all_reduce collective
622c9aa 
New TensorDictBase.all_reduce(op) method that performs an in-place
all-reduce across all ranks. Operates per-leaf since the consolidated
storage is dtype-heterogeneous (uint8 buffer with mixed-dtype views).

Co-authored-by: Cursor <cursoragent@cursor.com>
ghstack-source-id: b70dcf2
Pull-Request: #1589
@vmoens
vmoens merged commit 54aab3d into gh/vmoens/72/base Feb 19, 2026
36 of 53 checks passed
@vmoens
vmoens deleted the gh/vmoens/72/head branch February 19, 2026 10:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Distributed tensorclass Test

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@vmoens