Skip to content

[BugFix] Attempting to make tensordict device transfer marking thread safe [Duplicate] - #1711

Merged
vmoens merged 5 commits into
mainfrom
coreyjadams-main
May 21, 2026
Merged

[BugFix] Attempting to make tensordict device transfer marking thread safe [Duplicate]#1711
vmoens merged 5 commits into
mainfrom
coreyjadams-main

Conversation

@vmoens

@vmoens vmoens commented May 21, 2026

Copy link
Copy Markdown
Collaborator

Duplicate of #1701

coreyjadams and others added 5 commits May 14, 2026 21:45
@coreyjadams
Attempting to make tensordict device transfer marking thread safe.
83843b0
@vmoens
[Test] Add thread-safety tests for _device_recorder
0f2f34d 
Regression coverage for #1700: a unit-level test that ``mark()`` on one
thread does not leak into another, and a stress test that concurrent
``TensorDict(..., device='cpu')`` constructions across 8 threads do not
race on the recorder. The stress test reliably fires the
``RuntimeError("Can only mark one TensorDict at a time.")`` against
pre-fix code in under a second.

Also updates the existing ``test_non_blocking`` assertion, which read
the private ``_has_transfer`` attribute that this PR renamed and moved
onto the per-thread ``_state``.
@vmoens
[Test] Move threading import to module top
7d77cd2
@vmoens
[Test] Fix Dynamo compatibility xfail
731ad4e
@vmoens
Merge remote-tracking branch 'origin/main' into coreyjadams-main
078f2c6 
# Conflicts:
#	tensordict/typedtensordict.py
#	test/test_compile.py
@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label May 21, 2026
@github-actions github-actions Bot added Test Compile torch.compile related bug Something isn't working labels May 21, 2026
@vmoens
vmoens merged commit a231f85 into main May 21, 2026
108 of 118 checks passed
@vmoens
vmoens deleted the coreyjadams-main branch May 21, 2026 19:05
vmoens added a commit that referenced this pull request May 21, 2026
@vmoens @coreyjadams
[BugFix] Attempting to make tensordict device transfer marking thread…
2b82bc1 
… safe [Duplicate] (#1711)

Co-authored-by: Corey Adams <6619961+coreyjadams@users.noreply.github.com>
@github-actions

github-actions Bot commented May 21, 2026

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large&amp;#x26A0;\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 341. Improved: $\large\color{#35bf28}27$. Worsened: $\large\color{#d91a1a}15$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_collector_preallocated_write[stack_out-cpu-32-2] 0.2237ms 0.1744ms 5.7353 KOps/s 5.9766 KOps/s $\color{#d91a1a}-4.04\%$
test_collector_preallocated_write[stack_out-cpu-32-8] 0.4309ms 0.3014ms 3.3183 KOps/s 3.3326 KOps/s $\color{#d91a1a}-0.43\%$
test_collector_preallocated_write[stack_out-cpu-32-32] 0.8646ms 0.7807ms 1.2809 KOps/s 1.2780 KOps/s $\color{#35bf28}+0.23\%$
test_collector_preallocated_write[stack_out-cpu-4096-2] 0.4068ms 0.3414ms 2.9287 KOps/s 2.8745 KOps/s $\color{#35bf28}+1.89\%$
test_collector_preallocated_write[stack_out-cpu-4096-8] 1.4483ms 1.1407ms 876.6246 Ops/s 896.2186 Ops/s $\color{#d91a1a}-2.19\%$
test_collector_preallocated_write[stack_out-cpu-4096-32] 7.6094ms 7.3576ms 135.9134 Ops/s 135.3186 Ops/s $\color{#35bf28}+0.44\%$
test_collector_preallocated_write[stack_out-cuda-32-2] 0.3295ms 0.2572ms 3.8883 KOps/s 4.0370 KOps/s $\color{#d91a1a}-3.69\%$
test_collector_preallocated_write[stack_out-cuda-32-8] 0.4672ms 0.3770ms 2.6527 KOps/s 2.6626 KOps/s $\color{#d91a1a}-0.37\%$
test_collector_preallocated_write[stack_out-cuda-32-32] 0.9436ms 0.8286ms 1.2068 KOps/s 1.2099 KOps/s $\color{#d91a1a}-0.25\%$
test_collector_preallocated_write[stack_out-cuda-4096-2] 0.3174ms 0.2627ms 3.8069 KOps/s 3.8171 KOps/s $\color{#d91a1a}-0.27\%$
test_collector_preallocated_write[stack_out-cuda-4096-8] 0.4577ms 0.3802ms 2.6305 KOps/s 2.6379 KOps/s $\color{#d91a1a}-0.28\%$
test_collector_preallocated_write[stack_out-cuda-4096-32] 1.2835ms 0.8869ms 1.1275 KOps/s 1.1303 KOps/s $\color{#d91a1a}-0.24\%$
test_collector_preallocated_write[set_at_loop-cpu-32-2] 0.5660ms 0.2221ms 4.5026 KOps/s 4.4701 KOps/s $\color{#35bf28}+0.73\%$
test_collector_preallocated_write[set_at_loop-cpu-32-8] 0.9595ms 0.8908ms 1.1226 KOps/s 1.1820 KOps/s $\textbf{\color{#d91a1a}-5.02\%}$
test_collector_preallocated_write[set_at_loop-cpu-32-32] 3.6775ms 3.5921ms 278.3849 Ops/s 301.5232 Ops/s $\textbf{\color{#d91a1a}-7.67\%}$
test_collector_preallocated_write[set_at_loop-cpu-4096-2] 0.4956ms 0.3834ms 2.6081 KOps/s 2.7279 KOps/s $\color{#d91a1a}-4.39\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-8] 2.4175ms 1.6851ms 593.4342 Ops/s 577.4008 Ops/s $\color{#35bf28}+2.78\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-32] 15.9097ms 10.4499ms 95.6951 Ops/s 96.8476 Ops/s $\color{#d91a1a}-1.19\%$
test_collector_preallocated_write[set_at_loop-cuda-32-2] 0.4476ms 0.4004ms 2.4976 KOps/s 2.4048 KOps/s $\color{#35bf28}+3.86\%$
test_collector_preallocated_write[set_at_loop-cuda-32-8] 1.6479ms 1.5709ms 636.5832 Ops/s 641.2488 Ops/s $\color{#d91a1a}-0.73\%$
test_collector_preallocated_write[set_at_loop-cuda-32-32] 6.3345ms 6.1947ms 161.4294 Ops/s 165.0842 Ops/s $\color{#d91a1a}-2.21\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-2] 0.4617ms 0.3990ms 2.5066 KOps/s 2.5405 KOps/s $\color{#d91a1a}-1.34\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-8] 1.5844ms 1.4965ms 668.2473 Ops/s 667.7018 Ops/s $\color{#35bf28}+0.08\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-32] 5.9123ms 5.8500ms 170.9408 Ops/s 173.4332 Ops/s $\color{#d91a1a}-1.44\%$
test_collector_preallocated_write[copy_at-cpu-32-2] 0.2284ms 0.1755ms 5.6993 KOps/s 5.7551 KOps/s $\color{#d91a1a}-0.97\%$
test_collector_preallocated_write[copy_at-cpu-32-8] 0.7925ms 0.6867ms 1.4562 KOps/s 1.4606 KOps/s $\color{#d91a1a}-0.30\%$
test_collector_preallocated_write[copy_at-cpu-32-32] 3.0600ms 2.7414ms 364.7711 Ops/s 364.2553 Ops/s $\color{#35bf28}+0.14\%$
test_collector_preallocated_write[copy_at-cpu-4096-2] 0.8184ms 0.3231ms 3.0953 KOps/s 3.0980 KOps/s $\color{#d91a1a}-0.09\%$
test_collector_preallocated_write[copy_at-cpu-4096-8] 1.7667ms 1.4703ms 680.1460 Ops/s 687.4898 Ops/s $\color{#d91a1a}-1.07\%$
test_collector_preallocated_write[copy_at-cpu-4096-32] 9.9546ms 9.5761ms 104.4265 Ops/s 104.0539 Ops/s $\color{#35bf28}+0.36\%$
test_collector_preallocated_write[copy_at-cuda-32-2] 0.4252ms 0.3323ms 3.0093 KOps/s 3.0486 KOps/s $\color{#d91a1a}-1.29\%$
test_collector_preallocated_write[copy_at-cuda-32-8] 1.3333ms 1.2385ms 807.4322 Ops/s 819.5332 Ops/s $\color{#d91a1a}-1.48\%$
test_collector_preallocated_write[copy_at-cuda-32-32] 5.0591ms 4.8582ms 205.8382 Ops/s 209.0369 Ops/s $\color{#d91a1a}-1.53\%$
test_collector_preallocated_write[copy_at-cuda-4096-2] 0.4084ms 0.3339ms 2.9949 KOps/s 3.0298 KOps/s $\color{#d91a1a}-1.15\%$
test_collector_preallocated_write[copy_at-cuda-4096-8] 1.3475ms 1.2472ms 801.7702 Ops/s 809.2337 Ops/s $\color{#d91a1a}-0.92\%$
test_collector_preallocated_write[copy_at-cuda-4096-32] 5.0087ms 4.8883ms 204.5704 Ops/s 207.9551 Ops/s $\color{#d91a1a}-1.63\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-2] 0.1631ms 0.1252ms 7.9881 KOps/s 8.3009 KOps/s $\color{#d91a1a}-3.77\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-8] 0.5479ms 0.4903ms 2.0394 KOps/s 2.1346 KOps/s $\color{#d91a1a}-4.46\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-32] 2.0803ms 1.9458ms 513.9206 Ops/s 531.4951 Ops/s $\color{#d91a1a}-3.31\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-2] 0.3495ms 0.2582ms 3.8733 KOps/s 3.8060 KOps/s $\color{#35bf28}+1.77\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-8] 1.7015ms 1.2856ms 777.8654 Ops/s 804.6985 Ops/s $\color{#d91a1a}-3.33\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-32] 8.7923ms 8.6048ms 116.2138 Ops/s 117.2427 Ops/s $\color{#d91a1a}-0.88\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-2] 0.4284ms 0.2881ms 3.4707 KOps/s 3.6004 KOps/s $\color{#d91a1a}-3.60\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-8] 1.1524ms 1.0738ms 931.2452 Ops/s 972.9360 Ops/s $\color{#d91a1a}-4.29\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-32] 4.3491ms 4.2272ms 236.5647 Ops/s 248.6136 Ops/s $\color{#d91a1a}-4.85\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-2] 0.4088ms 0.2887ms 3.4636 KOps/s 3.6152 KOps/s $\color{#d91a1a}-4.19\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-8] 1.1729ms 1.0750ms 930.2060 Ops/s 967.6796 Ops/s $\color{#d91a1a}-3.87\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-32] 4.3189ms 4.2190ms 237.0227 Ops/s 247.7960 Ops/s $\color{#d91a1a}-4.35\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-128] 16.5166ms 16.2825ms 61.4157 Ops/s 61.2831 Ops/s $\color{#35bf28}+0.22\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-256] 33.1709ms 32.8247ms 30.4649 Ops/s 30.5640 Ops/s $\color{#d91a1a}-0.32\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-128] 84.8435ms 84.0824ms 11.8931 Ops/s 11.8904 Ops/s $\color{#35bf28}+0.02\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-256] 0.2004s 0.1999s 5.0020 Ops/s 5.0090 Ops/s $\color{#d91a1a}-0.14\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-128] 13.9326ms 13.7431ms 72.7640 Ops/s 72.5467 Ops/s $\color{#35bf28}+0.30\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-256] 28.0568ms 27.2971ms 36.6339 Ops/s 36.9656 Ops/s $\color{#d91a1a}-0.90\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-128] 14.0117ms 13.9082ms 71.8999 Ops/s 71.4630 Ops/s $\color{#35bf28}+0.61\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-256] 27.3624ms 27.2512ms 36.6956 Ops/s 36.5187 Ops/s $\color{#35bf28}+0.48\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-128] 52.8423ms 52.6323ms 18.9997 Ops/s 19.1476 Ops/s $\color{#d91a1a}-0.77\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-256] 0.1071s 0.1065s 9.3906 Ops/s 9.4958 Ops/s $\color{#d91a1a}-1.11\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-128] 0.1500s 0.1472s 6.7945 Ops/s 6.8945 Ops/s $\color{#d91a1a}-1.45\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-256] 0.3264s 0.3242s 3.0845 Ops/s 3.1148 Ops/s $\color{#d91a1a}-0.97\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-128] 79.7036ms 76.5762ms 13.0589 Ops/s 12.5853 Ops/s $\color{#35bf28}+3.76\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-256] 0.1600s 0.1584s 6.3115 Ops/s 6.2797 Ops/s $\color{#35bf28}+0.51\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-128] 77.0468ms 75.5528ms 13.2358 Ops/s 12.4443 Ops/s $\textbf{\color{#35bf28}+6.36\%}$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-256] 0.1621s 0.1594s 6.2722 Ops/s 6.2210 Ops/s $\color{#35bf28}+0.82\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-128] 30.9600ms 30.5050ms 32.7815 Ops/s 32.8153 Ops/s $\color{#d91a1a}-0.10\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-256] 62.3764ms 62.0556ms 16.1146 Ops/s 16.1762 Ops/s $\color{#d91a1a}-0.38\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-128] 0.1229s 0.1220s 8.1996 Ops/s 8.4136 Ops/s $\color{#d91a1a}-2.54\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-256] 0.2667s 0.2656s 3.7655 Ops/s 3.7689 Ops/s $\color{#d91a1a}-0.09\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-128] 44.5867ms 44.3152ms 22.5656 Ops/s 22.8965 Ops/s $\color{#d91a1a}-1.45\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-256] 89.6243ms 88.9524ms 11.2420 Ops/s 11.4721 Ops/s $\color{#d91a1a}-2.01\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-128] 44.8130ms 44.6399ms 22.4015 Ops/s 22.7765 Ops/s $\color{#d91a1a}-1.65\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-256] 89.6086ms 89.4780ms 11.1759 Ops/s 11.3888 Ops/s $\color{#d91a1a}-1.87\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-128] 21.3404ms 21.2316ms 47.0996 Ops/s 48.5546 Ops/s $\color{#d91a1a}-3.00\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-256] 43.4985ms 43.3328ms 23.0772 Ops/s 23.7758 Ops/s $\color{#d91a1a}-2.94\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-128] 0.1096s 0.1089s 9.1846 Ops/s 9.3196 Ops/s $\color{#d91a1a}-1.45\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-256] 0.2430s 0.2424s 4.1255 Ops/s 4.1560 Ops/s $\color{#d91a1a}-0.74\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-128] 38.5076ms 38.1645ms 26.2024 Ops/s 27.3317 Ops/s $\color{#d91a1a}-4.13\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-256] 76.9820ms 76.2402ms 13.1164 Ops/s 13.6590 Ops/s $\color{#d91a1a}-3.97\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-128] 38.6113ms 38.2775ms 26.1250 Ops/s 25.5122 Ops/s $\color{#35bf28}+2.40\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-256] 76.9374ms 76.2709ms 13.1112 Ops/s 12.7004 Ops/s $\color{#35bf28}+3.23\%$
test_plain_set_nested 38.4910μs 15.5711μs 64.2215 KOps/s 65.0931 KOps/s $\color{#d91a1a}-1.34\%$
test_plain_set_stack_nested 44.7910μs 15.3812μs 65.0143 KOps/s 66.1435 KOps/s $\color{#d91a1a}-1.71\%$
test_plain_set_nested_inplace 49.3010μs 16.8434μs 59.3704 KOps/s 59.1115 KOps/s $\color{#35bf28}+0.44\%$
test_plain_set_stack_nested_inplace 53.5710μs 16.5700μs 60.3499 KOps/s 59.4879 KOps/s $\color{#35bf28}+1.45\%$
test_items 27.7010μs 5.9562μs 167.8911 KOps/s 166.4946 KOps/s $\color{#35bf28}+0.84\%$
test_items_nested 0.5156ms 0.4628ms 2.1606 KOps/s 2.1574 KOps/s $\color{#35bf28}+0.15\%$
test_items_nested_locked 0.5318ms 0.4629ms 2.1605 KOps/s 2.1513 KOps/s $\color{#35bf28}+0.43\%$
test_items_nested_leaf 0.1321ms 97.9874μs 10.2054 KOps/s 10.3266 KOps/s $\color{#d91a1a}-1.17\%$
test_items_stack_nested 0.5136ms 0.4593ms 2.1772 KOps/s 2.1701 KOps/s $\color{#35bf28}+0.33\%$
test_items_stack_nested_leaf 0.1352ms 96.8194μs 10.3285 KOps/s 10.3058 KOps/s $\color{#35bf28}+0.22\%$
test_items_stack_nested_locked 0.5473ms 0.4618ms 2.1655 KOps/s 2.1416 KOps/s $\color{#35bf28}+1.12\%$
test_keys 30.3110μs 4.2002μs 238.0817 KOps/s 238.5684 KOps/s $\color{#d91a1a}-0.20\%$
test_keys_nested 0.1828ms 0.1286ms 7.7740 KOps/s 7.6891 KOps/s $\color{#35bf28}+1.10\%$
test_keys_nested_locked 0.7652ms 0.1373ms 7.2845 KOps/s 7.1580 KOps/s $\color{#35bf28}+1.77\%$
test_keys_nested_leaf 0.1624ms 0.1206ms 8.2938 KOps/s 8.2396 KOps/s $\color{#35bf28}+0.66\%$
test_keys_stack_nested 0.1677ms 0.1291ms 7.7467 KOps/s 7.7155 KOps/s $\color{#35bf28}+0.40\%$
test_keys_stack_nested_leaf 0.1922ms 0.1186ms 8.4339 KOps/s 8.3270 KOps/s $\color{#35bf28}+1.28\%$
test_keys_stack_nested_locked 0.1894ms 0.1370ms 7.2976 KOps/s 7.2122 KOps/s $\color{#35bf28}+1.18\%$
test_values 6.4622μs 1.0202μs 980.1948 KOps/s 990.7867 KOps/s $\color{#d91a1a}-1.07\%$
test_values_nested 82.2810μs 52.2726μs 19.1305 KOps/s 19.0113 KOps/s $\color{#35bf28}+0.63\%$
test_values_nested_locked 82.6820μs 55.3537μs 18.0656 KOps/s 18.0616 KOps/s $\color{#35bf28}+0.02\%$
test_values_nested_leaf 90.2720μs 59.4240μs 16.8282 KOps/s 16.6075 KOps/s $\color{#35bf28}+1.33\%$
test_values_stack_nested 82.5320μs 51.9523μs 19.2484 KOps/s 19.1033 KOps/s $\color{#35bf28}+0.76\%$
test_values_stack_nested_leaf 95.3820μs 59.4643μs 16.8168 KOps/s 16.6437 KOps/s $\color{#35bf28}+1.04\%$
test_values_stack_nested_locked 91.7920μs 55.5448μs 18.0035 KOps/s 18.1824 KOps/s $\color{#d91a1a}-0.98\%$
test_membership 6.0152μs 0.8341μs 1.1989 MOps/s 1.2038 MOps/s $\color{#d91a1a}-0.41\%$
test_membership_nested 32.8200μs 2.9503μs 338.9460 KOps/s 341.7814 KOps/s $\color{#d91a1a}-0.83\%$
test_membership_nested_leaf 30.9500μs 2.9289μs 341.4222 KOps/s 338.0999 KOps/s $\color{#35bf28}+0.98\%$
test_membership_stacked_nested 32.2600μs 2.8811μs 347.0933 KOps/s 343.1968 KOps/s $\color{#35bf28}+1.14\%$
test_membership_stacked_nested_leaf 37.7610μs 2.8706μs 348.3546 KOps/s 343.0742 KOps/s $\color{#35bf28}+1.54\%$
test_membership_nested_last 35.5100μs 4.4193μs 226.2797 KOps/s 225.0487 KOps/s $\color{#35bf28}+0.55\%$
test_membership_nested_leaf_last 30.1300μs 4.3976μs 227.3961 KOps/s 227.8096 KOps/s $\color{#d91a1a}-0.18\%$
test_membership_stacked_nested_last 28.7210μs 4.2827μs 233.4986 KOps/s 232.4682 KOps/s $\color{#35bf28}+0.44\%$
test_membership_stacked_nested_leaf_last 40.5710μs 4.2202μs 236.9563 KOps/s 232.4569 KOps/s $\color{#35bf28}+1.94\%$
test_nested_getleaf 54.4510μs 21.6238μs 46.2454 KOps/s 46.4346 KOps/s $\color{#d91a1a}-0.41\%$
test_nested_get 50.4310μs 20.4387μs 48.9268 KOps/s 48.6256 KOps/s $\color{#35bf28}+0.62\%$
test_stacked_getleaf 49.1510μs 21.3167μs 46.9115 KOps/s 47.1216 KOps/s $\color{#d91a1a}-0.45\%$
test_stacked_get 45.1410μs 20.3844μs 49.0570 KOps/s 49.1340 KOps/s $\color{#d91a1a}-0.16\%$
test_nested_getitemleaf 73.7620μs 22.0991μs 45.2507 KOps/s 44.7950 KOps/s $\color{#35bf28}+1.02\%$
test_nested_getitem 46.8010μs 21.2048μs 47.1591 KOps/s 47.5949 KOps/s $\color{#d91a1a}-0.92\%$
test_stacked_getitemleaf 50.1110μs 22.1255μs 45.1967 KOps/s 45.9877 KOps/s $\color{#d91a1a}-1.72\%$
test_stacked_getitem 48.8310μs 20.8021μs 48.0721 KOps/s 47.9667 KOps/s $\color{#35bf28}+0.22\%$
test_lock_nested 7.8096ms 0.4891ms 2.0445 KOps/s 2.0901 KOps/s $\color{#d91a1a}-2.18\%$
test_lock_stack_nested 0.5354ms 0.4904ms 2.0392 KOps/s 2.0839 KOps/s $\color{#d91a1a}-2.15\%$
test_unlock_nested 0.4684ms 0.3954ms 2.5291 KOps/s 2.6080 KOps/s $\color{#d91a1a}-3.03\%$
test_unlock_stack_nested 0.4406ms 0.3978ms 2.5136 KOps/s 2.5918 KOps/s $\color{#d91a1a}-3.02\%$
test_flatten_speed 0.1973ms 0.1213ms 8.2455 KOps/s 8.2594 KOps/s $\color{#d91a1a}-0.17\%$
test_unflatten_speed 0.6309ms 0.5700ms 1.7545 KOps/s 1.7596 KOps/s $\color{#d91a1a}-0.29\%$
test_common_ops 0.1003s 1.8783ms 532.3835 Ops/s 497.9022 Ops/s $\textbf{\color{#35bf28}+6.93\%}$
test_creation 0.1219ms 3.1290μs 319.5887 KOps/s 325.9719 KOps/s $\color{#d91a1a}-1.96\%$
test_creation_empty 53.2310μs 7.0322μs 142.2030 KOps/s 147.0913 KOps/s $\color{#d91a1a}-3.32\%$
test_creation_nested_1 31.5200μs 11.5525μs 86.5613 KOps/s 87.6182 KOps/s $\color{#d91a1a}-1.21\%$
test_creation_nested_2 32.6810μs 13.4955μs 74.0989 KOps/s 75.1958 KOps/s $\color{#d91a1a}-1.46\%$
test_creation_many_keys[10] 58.5920μs 21.0227μs 47.5677 KOps/s 48.7653 KOps/s $\color{#d91a1a}-2.46\%$
test_creation_many_keys[50] 0.1203ms 92.7081μs 10.7865 KOps/s 11.2415 KOps/s $\color{#d91a1a}-4.05\%$
test_creation_many_keys[100] 0.2675ms 0.1795ms 5.5700 KOps/s 5.7419 KOps/s $\color{#d91a1a}-2.99\%$
test_creation_nested_many_keys[10] 73.2920μs 45.6052μs 21.9273 KOps/s 22.4172 KOps/s $\color{#d91a1a}-2.19\%$
test_creation_nested_many_keys[50] 0.2335ms 0.1874ms 5.3364 KOps/s 5.4263 KOps/s $\color{#d91a1a}-1.66\%$
test_clone 42.8010μs 13.4960μs 74.0961 KOps/s 74.5327 KOps/s $\color{#d91a1a}-0.59\%$
test_getitem[int] 1.5385ms 15.7033μs 63.6808 KOps/s 66.0485 KOps/s $\color{#d91a1a}-3.58\%$
test_getitem[slice_int] 0.1516ms 25.0153μs 39.9756 KOps/s 40.8125 KOps/s $\color{#d91a1a}-2.05\%$
test_getitem[range] 0.1804ms 66.4479μs 15.0494 KOps/s 15.3769 KOps/s $\color{#d91a1a}-2.13\%$
test_getitem[tuple] 0.1441ms 24.7432μs 40.4151 KOps/s 41.3837 KOps/s $\color{#d91a1a}-2.34\%$
test_getitem[list] 0.1845ms 60.1426μs 16.6272 KOps/s 16.6607 KOps/s $\color{#d91a1a}-0.20\%$
test_setitem_dim[int] 47.3910μs 26.7929μs 37.3233 KOps/s 35.4536 KOps/s $\textbf{\color{#35bf28}+5.27\%}$
test_setitem_dim[slice_int] 69.6610μs 42.9740μs 23.2699 KOps/s 21.6322 KOps/s $\textbf{\color{#35bf28}+7.57\%}$
test_setitem_dim[range] 0.1254ms 95.4144μs 10.4806 KOps/s 9.8831 KOps/s $\textbf{\color{#35bf28}+6.05\%}$
test_setitem_dim[tuple] 90.0520μs 39.5919μs 25.2577 KOps/s 24.1583 KOps/s $\color{#35bf28}+4.55\%$
test_setitem 52.3110μs 17.8614μs 55.9868 KOps/s 52.4411 KOps/s $\textbf{\color{#35bf28}+6.76\%}$
test_set 50.7610μs 17.0233μs 58.7431 KOps/s 54.9784 KOps/s $\textbf{\color{#35bf28}+6.85\%}$
test_set_shared 0.5783ms 0.2057ms 4.8605 KOps/s 4.8088 KOps/s $\color{#35bf28}+1.08\%$
test_update 0.3523ms 22.4122μs 44.6185 KOps/s 45.0685 KOps/s $\color{#d91a1a}-1.00\%$
test_update_nested 70.7210μs 34.1447μs 29.2871 KOps/s 29.8296 KOps/s $\color{#d91a1a}-1.82\%$
test_update__nested 0.4797ms 33.6470μs 29.7203 KOps/s 30.2434 KOps/s $\color{#d91a1a}-1.73\%$
test_set_nested 55.9310μs 19.1605μs 52.1906 KOps/s 52.5310 KOps/s $\color{#d91a1a}-0.65\%$
test_set_nested_new 60.2310μs 23.7076μs 42.1806 KOps/s 43.1659 KOps/s $\color{#d91a1a}-2.28\%$
test_select 91.3620μs 40.4465μs 24.7240 KOps/s 24.9639 KOps/s $\color{#d91a1a}-0.96\%$
test_select_nested 0.1005ms 73.9237μs 13.5275 KOps/s 13.5299 KOps/s $\color{#d91a1a}-0.02\%$
test_exclude_nested 0.1326ms 91.2937μs 10.9537 KOps/s 10.9674 KOps/s $\color{#d91a1a}-0.13\%$
test_empty[True] 0.4480ms 0.3986ms 2.5091 KOps/s 2.4857 KOps/s $\color{#35bf28}+0.94\%$
test_empty[False] 10.2137μs 1.3894μs 719.7220 KOps/s 727.6833 KOps/s $\color{#d91a1a}-1.09\%$
test_to 99.3920μs 70.2228μs 14.2404 KOps/s 14.2168 KOps/s $\color{#35bf28}+0.17\%$
test_to_nonblocking 0.1156ms 69.6611μs 14.3552 KOps/s 14.6155 KOps/s $\color{#d91a1a}-1.78\%$
test_unbind_speed 0.3828ms 0.3459ms 2.8907 KOps/s 3.0074 KOps/s $\color{#d91a1a}-3.88\%$
test_unbind_speed_stack0 0.4085ms 0.3380ms 2.9589 KOps/s 3.0442 KOps/s $\color{#d91a1a}-2.80\%$
test_unbind_speed_stack1 0.1150s 0.8648ms 1.1563 KOps/s 1.1701 KOps/s $\color{#d91a1a}-1.18\%$
test_split 1.2404ms 1.1456ms 872.8868 Ops/s 704.9485 Ops/s $\textbf{\color{#35bf28}+23.82\%}$
test_chunk 0.1144s 1.2268ms 815.1028 Ops/s 923.3638 Ops/s $\textbf{\color{#d91a1a}-11.72\%}$
test_to_cpu_blocking 20.4200ms 20.3191ms 49.2148 Ops/s 49.7714 Ops/s $\color{#d91a1a}-1.12\%$
test_to_cpu_global_sync 12.1143ms 11.9743ms 83.5122 Ops/s 85.4046 Ops/s $\color{#d91a1a}-2.22\%$
test_to_cpu_event_sync 13.3341ms 13.0615ms 76.5610 Ops/s 78.8426 Ops/s $\color{#d91a1a}-2.89\%$
test_to_cpu_default 13.3874ms 13.0447ms 76.6598 Ops/s 69.5777 Ops/s $\textbf{\color{#35bf28}+10.18\%}$
test_consolidate[False-None] 0.1442s 4.8259ms 207.2150 Ops/s 243.1760 Ops/s $\textbf{\color{#d91a1a}-14.79\%}$
test_consolidate[default-None] 2.2374ms 2.1156ms 472.6787 Ops/s 488.1552 Ops/s $\color{#d91a1a}-3.17\%$
test_consolidate[reduce-overhead-None] 2.1043ms 2.0354ms 491.2991 Ops/s 503.8478 Ops/s $\color{#d91a1a}-2.49\%$
test_consolidate_njt[False-None] 8.8567ms 8.6260ms 115.9285 Ops/s 116.2006 Ops/s $\color{#d91a1a}-0.23\%$
test_to[False-False-None] 2.2738ms 2.2297ms 448.4949 Ops/s 455.3506 Ops/s $\color{#d91a1a}-1.51\%$
test_to[True-False-None] 2.2527ms 1.9808ms 504.8481 Ops/s 533.1942 Ops/s $\textbf{\color{#d91a1a}-5.32\%}$
test_to[within-False-None] 6.4555ms 6.3100ms 158.4797 Ops/s 161.6452 Ops/s $\color{#d91a1a}-1.96\%$
test_to[True-default-None] 10.8781ms 10.6851ms 93.5887 Ops/s 92.5137 Ops/s $\color{#35bf28}+1.16\%$
test_to_njt[False-False-None] 8.7864ms 8.6590ms 115.4870 Ops/s 114.6202 Ops/s $\color{#35bf28}+0.76\%$
test_to_njt[True-False-None] 7.0881ms 6.9306ms 144.2884 Ops/s 143.0215 Ops/s $\color{#35bf28}+0.89\%$
test_to_njt[within-False-None] 15.8446ms 15.5062ms 64.4902 Ops/s 63.5717 Ops/s $\color{#35bf28}+1.44\%$
test_creation[device0] 0.3957ms 0.1187ms 8.4236 KOps/s 8.5537 KOps/s $\color{#d91a1a}-1.52\%$
test_creation_from_tensor 0.4585ms 0.1158ms 8.6371 KOps/s 8.7766 KOps/s $\color{#d91a1a}-1.59\%$
test_add_one[memmap_tensor0] 0.2974ms 6.8724μs 145.5086 KOps/s 148.5440 KOps/s $\color{#d91a1a}-2.04\%$
test_contiguous[memmap_tensor0] 31.3410μs 0.6597μs 1.5158 MOps/s 2.2222 MOps/s $\textbf{\color{#d91a1a}-31.79\%}$
test_stack[memmap_tensor0] 32.3210μs 4.4242μs 226.0316 KOps/s 240.6787 KOps/s $\textbf{\color{#d91a1a}-6.09\%}$
test_memmaptd_index 1.1561ms 0.2904ms 3.4432 KOps/s 3.6645 KOps/s $\textbf{\color{#d91a1a}-6.04\%}$
test_memmaptd_index_astensor 0.5468ms 0.3912ms 2.5561 KOps/s 2.6373 KOps/s $\color{#d91a1a}-3.08\%$
test_memmaptd_index_op 0.8080ms 0.6567ms 1.5227 KOps/s 1.5516 KOps/s $\color{#d91a1a}-1.86\%$
test_serialize_model 0.1349s 0.1333s 7.5035 Ops/s 7.3802 Ops/s $\color{#35bf28}+1.67\%$
test_serialize_model_pickle 1.3474s 1.2101s 0.8264 Ops/s 0.8268 Ops/s $\color{#d91a1a}-0.05\%$
test_serialize_weights 0.3136s 0.1592s 6.2813 Ops/s 7.4444 Ops/s $\textbf{\color{#d91a1a}-15.62\%}$
test_serialize_weights_returnearly 77.6450ms 66.5655ms 15.0228 Ops/s 14.9676 Ops/s $\color{#35bf28}+0.37\%$
test_serialize_weights_pickle 1.3716s 1.2127s 0.8246 Ops/s 0.8208 Ops/s $\color{#35bf28}+0.47\%$
test_reshape_pytree 0.2223ms 33.2688μs 30.0582 KOps/s 30.4185 KOps/s $\color{#d91a1a}-1.18\%$
test_reshape_td 80.9120μs 46.5070μs 21.5022 KOps/s 22.5805 KOps/s $\color{#d91a1a}-4.78\%$
test_view_pytree 0.2184ms 32.5269μs 30.7438 KOps/s 30.8057 KOps/s $\color{#d91a1a}-0.20\%$
test_view_td 90.8120μs 53.2728μs 18.7713 KOps/s 18.9265 KOps/s $\color{#d91a1a}-0.82\%$
test_unbind_pytree 0.2336ms 37.8352μs 26.4304 KOps/s 27.0650 KOps/s $\color{#d91a1a}-2.34\%$
test_unbind_td 0.1071ms 51.4673μs 19.4298 KOps/s 19.8626 KOps/s $\color{#d91a1a}-2.18\%$
test_split_pytree 0.2453ms 43.7695μs 22.8470 KOps/s 23.5780 KOps/s $\color{#d91a1a}-3.10\%$
test_split_td 0.1975ms 65.5925μs 15.2456 KOps/s 15.6779 KOps/s $\color{#d91a1a}-2.76\%$
test_add_pytree 0.1840ms 42.9990μs 23.2563 KOps/s 23.3241 KOps/s $\color{#d91a1a}-0.29\%$
test_add_td 0.1016ms 54.9173μs 18.2092 KOps/s 17.7833 KOps/s $\color{#35bf28}+2.39\%$
test_compile_add_one_nested[tensordict-compile] 0.3395ms 0.2271ms 4.4031 KOps/s 4.0153 KOps/s $\textbf{\color{#35bf28}+9.66\%}$
test_compile_add_one_nested[tensordict-eager] 0.3771ms 0.2057ms 4.8607 KOps/s 5.0131 KOps/s $\color{#d91a1a}-3.04\%$
test_compile_add_one_nested[pytree-compile] 0.5878ms 0.1414ms 7.0743 KOps/s 7.0766 KOps/s $\color{#d91a1a}-0.03\%$
test_compile_add_one_nested[pytree-eager] 0.6468ms 0.1843ms 5.4261 KOps/s 5.6016 KOps/s $\color{#d91a1a}-3.13\%$
test_compile_copy_nested[tensordict-compile] 0.4054ms 16.6219μs 60.1617 KOps/s 66.0523 KOps/s $\textbf{\color{#d91a1a}-8.92\%}$
test_compile_copy_nested[tensordict-eager] 89.6920μs 53.2226μs 18.7890 KOps/s 18.7134 KOps/s $\color{#35bf28}+0.40\%$
test_compile_copy_nested[pytree-compile] 0.1715ms 15.7687μs 63.4169 KOps/s 63.6403 KOps/s $\color{#d91a1a}-0.35\%$
test_compile_copy_nested[pytree-eager] 0.3604ms 68.1914μs 14.6646 KOps/s 14.6653 KOps/s $-0.00\%$
test_compile_add_one_flat[tensordict-compile] 0.5850ms 0.2475ms 4.0404 KOps/s 3.7872 KOps/s $\textbf{\color{#35bf28}+6.69\%}$
test_compile_add_one_flat[tensordict-eager] 0.3605ms 0.2825ms 3.5394 KOps/s 3.5008 KOps/s $\color{#35bf28}+1.10\%$
test_compile_add_one_flat[tensorclass-compile] 0.2955ms 0.1870ms 5.3476 KOps/s 4.9387 KOps/s $\textbf{\color{#35bf28}+8.28\%}$
test_compile_add_one_flat[tensorclass-eager] 0.1197ms 75.4869μs 13.2473 KOps/s 13.3884 KOps/s $\color{#d91a1a}-1.05\%$
test_compile_add_one_flat[pytree-compile] 0.4590ms 0.1923ms 5.2008 KOps/s 4.9087 KOps/s $\textbf{\color{#35bf28}+5.95\%}$
test_compile_add_one_flat[pytree-eager] 0.6930ms 0.5458ms 1.8323 KOps/s 1.9308 KOps/s $\textbf{\color{#d91a1a}-5.10\%}$
test_compile_add_self_flat[tensordict-eager] 0.4946ms 0.3300ms 3.0301 KOps/s 2.9629 KOps/s $\color{#35bf28}+2.27\%$
test_compile_add_self_flat[tensordict-compile] 0.3726ms 0.2563ms 3.9020 KOps/s 3.7011 KOps/s $\textbf{\color{#35bf28}+5.43\%}$
test_compile_add_self_flat[tensorclass-eager] 0.2440ms 93.7753μs 10.6638 KOps/s 10.9061 KOps/s $\color{#d91a1a}-2.22\%$
test_compile_add_self_flat[tensorclass-compile] 0.4293ms 0.1932ms 5.1747 KOps/s 4.9117 KOps/s $\textbf{\color{#35bf28}+5.35\%}$
test_compile_add_self_flat[pytree-eager] 0.7421ms 0.4539ms 2.2031 KOps/s 2.2906 KOps/s $\color{#d91a1a}-3.82\%$
test_compile_add_self_flat[pytree-compile] 0.5059ms 0.1996ms 5.0091 KOps/s 4.9205 KOps/s $\color{#35bf28}+1.80\%$
test_compile_copy_flat[tensordict-compile] 0.1655ms 19.9453μs 50.1371 KOps/s 51.6860 KOps/s $\color{#d91a1a}-3.00\%$
test_compile_copy_flat[tensordict-eager] 0.1752ms 41.1862μs 24.2800 KOps/s 24.4041 KOps/s $\color{#d91a1a}-0.51\%$
test_compile_copy_flat[pytree-compile] 0.1078ms 21.8131μs 45.8439 KOps/s 45.9466 KOps/s $\color{#d91a1a}-0.22\%$
test_compile_copy_flat[pytree-eager] 0.3631ms 51.8105μs 19.3011 KOps/s 19.1807 KOps/s $\color{#35bf28}+0.63\%$
test_compile_assign_and_add[tensordict-compile] 2.2985ms 0.2469ms 4.0509 KOps/s 3.8578 KOps/s $\textbf{\color{#35bf28}+5.01\%}$
test_compile_assign_and_add[tensordict-eager] 3.7697ms 3.4300ms 291.5433 Ops/s 303.3663 Ops/s $\color{#d91a1a}-3.90\%$
test_compile_assign_and_add[pytree-compile] 2.1477ms 0.1847ms 5.4143 KOps/s 5.3068 KOps/s $\color{#35bf28}+2.03\%$
test_compile_assign_and_add[pytree-eager] 3.0884ms 2.9155ms 342.9892 Ops/s 361.2478 Ops/s $\textbf{\color{#d91a1a}-5.05\%}$
test_compile_indexing[tensor-tensordict-compile] 0.3515ms 0.1398ms 7.1550 KOps/s 7.1562 KOps/s $\color{#d91a1a}-0.02\%$
test_compile_indexing[tensor-tensordict-eager] 0.3158ms 77.7474μs 12.8622 KOps/s 13.0876 KOps/s $\color{#d91a1a}-1.72\%$
test_compile_indexing[tensor-tensorclass-compile] 0.2818ms 0.1226ms 8.1581 KOps/s 8.1810 KOps/s $\color{#d91a1a}-0.28\%$
test_compile_indexing[tensor-tensorclass-eager] 0.2720ms 47.1878μs 21.1919 KOps/s 21.0247 KOps/s $\color{#35bf28}+0.80\%$
test_compile_indexing[tensor-pytree-compile] 0.2784ms 0.1237ms 8.0817 KOps/s 8.1445 KOps/s $\color{#d91a1a}-0.77\%$
test_compile_indexing[tensor-pytree-eager] 0.2761ms 46.4197μs 21.5426 KOps/s 21.0339 KOps/s $\color{#35bf28}+2.42\%$
test_compile_indexing[slice-tensordict-compile] 0.2337ms 84.4169μs 11.8460 KOps/s 11.6436 KOps/s $\color{#35bf28}+1.74\%$
test_compile_indexing[slice-tensordict-eager] 0.2022ms 29.7652μs 33.5963 KOps/s 37.0537 KOps/s $\textbf{\color{#d91a1a}-9.33\%}$
test_compile_indexing[slice-tensorclass-compile] 0.2514ms 71.7959μs 13.9284 KOps/s 14.0677 KOps/s $\color{#d91a1a}-0.99\%$
test_compile_indexing[slice-tensorclass-eager] 0.2334ms 22.2749μs 44.8936 KOps/s 44.1625 KOps/s $\color{#35bf28}+1.66\%$
test_compile_indexing[slice-pytree-compile] 0.2141ms 71.2735μs 14.0305 KOps/s 14.0228 KOps/s $\color{#35bf28}+0.05\%$
test_compile_indexing[slice-pytree-eager] 0.2699ms 22.4225μs 44.5981 KOps/s 44.6693 KOps/s $\color{#d91a1a}-0.16\%$
test_compile_indexing[int-tensordict-compile] 0.2333ms 86.6777μs 11.5370 KOps/s 11.6221 KOps/s $\color{#d91a1a}-0.73\%$
test_compile_indexing[int-tensordict-eager] 0.2370ms 28.1467μs 35.5282 KOps/s 36.6450 KOps/s $\color{#d91a1a}-3.05\%$
test_compile_indexing[int-tensorclass-compile] 0.1081ms 70.5735μs 14.1696 KOps/s 14.0374 KOps/s $\color{#35bf28}+0.94\%$
test_compile_indexing[int-tensorclass-eager] 0.2418ms 22.4178μs 44.6073 KOps/s 44.8283 KOps/s $\color{#d91a1a}-0.49\%$
test_compile_indexing[int-pytree-compile] 0.1184ms 70.0663μs 14.2722 KOps/s 13.9708 KOps/s $\color{#35bf28}+2.16\%$
test_compile_indexing[int-pytree-eager] 0.2378ms 22.5065μs 44.4316 KOps/s 44.4199 KOps/s $\color{#35bf28}+0.03\%$
test_compile_replace[single-eager] 93.7620μs 47.4840μs 21.0597 KOps/s 20.4552 KOps/s $\color{#35bf28}+2.96\%$
test_compile_replace[single-compile] 0.2576ms 0.1303ms 7.6756 KOps/s 7.3550 KOps/s $\color{#35bf28}+4.36\%$
test_compile_replace[multi-eager] 0.6995ms 0.5864ms 1.7054 KOps/s 1.7450 KOps/s $\color{#d91a1a}-2.27\%$
test_compile_replace[multi-compile] 0.3190ms 0.1416ms 7.0618 KOps/s 6.9784 KOps/s $\color{#35bf28}+1.20\%$
test_compile_tc_getattr_20[eager] 0.2333ms 0.1787ms 5.5969 KOps/s 6.2070 KOps/s $\textbf{\color{#d91a1a}-9.83\%}$
test_compile_tc_getattr_20[compile] 0.3557ms 0.1481ms 6.7515 KOps/s 6.6567 KOps/s $\color{#35bf28}+1.42\%$
test_compile_clone_shallow[20-eager] 48.1510μs 19.4554μs 51.3995 KOps/s 51.7941 KOps/s $\color{#d91a1a}-0.76\%$
test_compile_clone_shallow[20-compile] 79.1920μs 16.5838μs 60.2999 KOps/s 60.3649 KOps/s $\color{#d91a1a}-0.11\%$
test_compile_clone_shallow[40-eager] 73.3310μs 33.9508μs 29.4544 KOps/s 29.5760 KOps/s $\color{#d91a1a}-0.41\%$
test_compile_clone_shallow[40-compile] 51.7110μs 18.0917μs 55.2741 KOps/s 53.8391 KOps/s $\color{#35bf28}+2.67\%$
test_compile_clone_shallow[80-eager] 95.9420μs 63.1230μs 15.8421 KOps/s 15.8123 KOps/s $\color{#35bf28}+0.19\%$
test_compile_clone_shallow[80-compile] 77.1110μs 21.8085μs 45.8536 KOps/s 46.5593 KOps/s $\color{#d91a1a}-1.52\%$
test_compile_update_inplace[eager] 0.2064ms 61.0479μs 16.3806 KOps/s 16.2824 KOps/s $\color{#35bf28}+0.60\%$
test_compile_update_inplace[compile] 0.3854ms 0.1450ms 6.8976 KOps/s 6.7554 KOps/s $\color{#35bf28}+2.11\%$
test_mod_add[eager] 0.3186ms 0.2270ms 4.4045 KOps/s 4.4093 KOps/s $\color{#d91a1a}-0.11\%$
test_mod_add[compile] 0.2848ms 0.1366ms 7.3203 KOps/s 7.4005 KOps/s $\color{#d91a1a}-1.08\%$
test_mod_add[compile-overhead] 0.2867ms 0.1794ms 5.5742 KOps/s 5.2048 KOps/s $\textbf{\color{#35bf28}+7.10\%}$
test_mod_wrap[eager] 0.5493ms 0.4694ms 2.1302 KOps/s 2.1371 KOps/s $\color{#d91a1a}-0.32\%$
test_mod_wrap[compile] 0.4745ms 0.3983ms 2.5107 KOps/s 2.4149 KOps/s $\color{#35bf28}+3.97\%$
test_mod_wrap[compile-overhead] 9.0650ms 4.7022ms 212.6666 Ops/s 213.5856 Ops/s $\color{#d91a1a}-0.43\%$
test_mod_wrap_and_backward[eager] 1.9232ms 1.7510ms 571.0937 Ops/s 593.9060 Ops/s $\color{#d91a1a}-3.84\%$
test_mod_wrap_and_backward[compile] 2.4779ms 1.6107ms 620.8562 Ops/s 616.4220 Ops/s $\color{#35bf28}+0.72\%$
test_mod_wrap_and_backward[compile-overhead] 1.3368ms 0.9413ms 1.0623 KOps/s 1.0368 KOps/s $\color{#35bf28}+2.46\%$
test_seq_add[eager] 0.6039ms 0.5142ms 1.9449 KOps/s 1.9224 KOps/s $\color{#35bf28}+1.17\%$
test_seq_add[compile] 0.2568ms 0.1398ms 7.1546 KOps/s 6.6204 KOps/s $\textbf{\color{#35bf28}+8.07\%}$
test_seq_add[compile-overhead] 0.3375ms 0.1818ms 5.5020 KOps/s 5.1279 KOps/s $\textbf{\color{#35bf28}+7.29\%}$
test_seq_wrap[eager] 1.5249ms 1.4169ms 705.7486 Ops/s 703.2571 Ops/s $\color{#35bf28}+0.35\%$
test_seq_wrap[compile] 0.5151ms 0.4116ms 2.4294 KOps/s 2.2802 KOps/s $\textbf{\color{#35bf28}+6.54\%}$
test_seq_wrap[compile-overhead] 0.3801ms 0.3043ms 3.2859 KOps/s 3.2214 KOps/s $\color{#35bf28}+2.00\%$
test_func_call_runtime[False-eager] 0.9154ms 0.8062ms 1.2404 KOps/s 1.2604 KOps/s $\color{#d91a1a}-1.58\%$
test_func_call_runtime[False-compile] 1.0834ms 0.9927ms 1.0074 KOps/s 1.0203 KOps/s $\color{#d91a1a}-1.27\%$
test_func_call_runtime[False-compile-overhead] 0.6289ms 0.5107ms 1.9581 KOps/s 1.9360 KOps/s $\color{#35bf28}+1.14\%$
test_func_call_runtime[True-eager] 1.3172ms 1.0421ms 959.5557 Ops/s 960.7068 Ops/s $\color{#d91a1a}-0.12\%$
test_func_call_runtime[True-compile] 1.1464ms 1.0081ms 991.9946 Ops/s 995.7325 Ops/s $\color{#d91a1a}-0.38\%$
test_func_call_runtime[True-compile-overhead] 0.6914ms 0.5255ms 1.9029 KOps/s 1.8824 KOps/s $\color{#35bf28}+1.09\%$
test_func_call_cm_runtime[False-eager] 0.8951ms 0.8076ms 1.2383 KOps/s 1.2473 KOps/s $\color{#d91a1a}-0.72\%$
test_func_call_cm_runtime[False-compile] 1.0731ms 0.9723ms 1.0284 KOps/s 1.0332 KOps/s $\color{#d91a1a}-0.46\%$
test_func_call_cm_runtime[False-compile-overhead] 0.6296ms 0.4888ms 2.0457 KOps/s 2.0191 KOps/s $\color{#35bf28}+1.32\%$
test_func_call_cm_runtime[True-eager] 1.3157ms 1.1854ms 843.6133 Ops/s 846.8965 Ops/s $\color{#d91a1a}-0.39\%$
test_func_call_cm_runtime[True-compile] 1.1660ms 1.0227ms 977.7635 Ops/s 985.7242 Ops/s $\color{#d91a1a}-0.81\%$
test_func_call_cm_runtime[True-compile-overhead] 0.5986ms 0.5419ms 1.8452 KOps/s 1.8215 KOps/s $\color{#35bf28}+1.30\%$
test_vmap_func_call_cm_runtime[eager] 2.8532ms 2.3764ms 420.8076 Ops/s 421.0592 Ops/s $\color{#d91a1a}-0.06\%$
test_vmap_func_call_cm_runtime[compile] 1.0909ms 1.0357ms 965.5116 Ops/s 977.1173 Ops/s $\color{#d91a1a}-1.19\%$
test_vmap_func_call_cm_runtime[compile-overhead] 0.6263ms 0.5354ms 1.8679 KOps/s 1.8521 KOps/s $\color{#35bf28}+0.86\%$
test_distributed 0.7691ms 0.1480ms 6.7554 KOps/s 6.6166 KOps/s $\color{#35bf28}+2.10\%$
test_tdmodule 0.4739ms 0.1943ms 5.1473 KOps/s 5.0885 KOps/s $\color{#35bf28}+1.16\%$
test_tdmodule_dispatch 0.4149ms 0.3708ms 2.6966 KOps/s 2.6403 KOps/s $\color{#35bf28}+2.14\%$
test_tdseq 61.8510μs 26.5413μs 37.6772 KOps/s 34.8991 KOps/s $\textbf{\color{#35bf28}+7.96\%}$
test_tdseq_dispatch 0.2547ms 0.2158ms 4.6343 KOps/s 4.4359 KOps/s $\color{#35bf28}+4.47\%$
test_instantiation_functorch 2.1923ms 2.0894ms 478.6116 Ops/s 466.3866 Ops/s $\color{#35bf28}+2.62\%$
test_exec_functorch 0.2375ms 0.1822ms 5.4894 KOps/s 5.2790 KOps/s $\color{#35bf28}+3.99\%$
test_exec_functional_call 0.2302ms 0.1622ms 6.1664 KOps/s 6.1823 KOps/s $\color{#d91a1a}-0.26\%$
test_exec_td_decorator 0.4556ms 0.2390ms 4.1845 KOps/s 4.1480 KOps/s $\color{#35bf28}+0.88\%$
test_vmap_mlp_speed_decorator[True-True] 1.2117ms 1.0106ms 989.4776 Ops/s 959.0802 Ops/s $\color{#35bf28}+3.17\%$
test_vmap_mlp_speed_decorator[True-False] 1.1839ms 1.0086ms 991.4815 Ops/s 954.2478 Ops/s $\color{#35bf28}+3.90\%$
test_vmap_mlp_speed_decorator[False-True] 0.9178ms 0.7128ms 1.4029 KOps/s 1.3540 KOps/s $\color{#35bf28}+3.61\%$
test_vmap_mlp_speed_decorator[False-False] 0.9432ms 0.7131ms 1.4023 KOps/s 1.3540 KOps/s $\color{#35bf28}+3.56\%$
test_vmap_transformer_speed_decorator[True-True] 21.6891ms 21.0026ms 47.6132 Ops/s 47.1363 Ops/s $\color{#35bf28}+1.01\%$
test_vmap_transformer_speed_decorator[True-False] 21.7509ms 20.9427ms 47.7494 Ops/s 47.0999 Ops/s $\color{#35bf28}+1.38\%$
test_vmap_transformer_speed_decorator[False-True] 21.1632ms 20.5658ms 48.6244 Ops/s 48.2815 Ops/s $\color{#35bf28}+0.71\%$
test_vmap_transformer_speed_decorator[False-False] 21.3377ms 20.5608ms 48.6363 Ops/s 48.2644 Ops/s $\color{#35bf28}+0.77\%$
test_to_module_speed[True] 1.6089ms 1.4871ms 672.4583 Ops/s 673.8845 Ops/s $\color{#d91a1a}-0.21\%$
test_to_module_speed[False] 1.5632ms 1.4552ms 687.1718 Ops/s 689.1187 Ops/s $\color{#d91a1a}-0.28\%$
test_tc_init 79.5910μs 43.2462μs 23.1234 KOps/s 22.0747 KOps/s $\color{#35bf28}+4.75\%$
test_tc_init_tensor_only 32.7110μs 8.9694μs 111.4898 KOps/s 111.2663 KOps/s $\color{#35bf28}+0.20\%$
test_tc_init_nested 0.1276ms 86.4405μs 11.5687 KOps/s 11.3900 KOps/s $\color{#35bf28}+1.57\%$
test_tc_init_many_fields 50.4410μs 14.9972μs 66.6791 KOps/s 67.0999 KOps/s $\color{#d91a1a}-0.63\%$
test_tc_first_layer_tensor 20.2310μs 1.8136μs 551.3800 KOps/s 546.1515 KOps/s $\color{#35bf28}+0.96\%$
test_tc_first_layer_tensor_only 3.3893μs 0.3998μs 2.5010 MOps/s 2.5524 MOps/s $\color{#d91a1a}-2.02\%$
test_tc_first_layer_tensor_set 26.9310μs 3.9607μs 252.4779 KOps/s 258.8465 KOps/s $\color{#d91a1a}-2.46\%$
test_tc_first_layer_tensor_only_set 20.8310μs 3.3089μs 302.2178 KOps/s 307.7664 KOps/s $\color{#d91a1a}-1.80\%$
test_tc_first_layer_nontensor 25.9100μs 6.1645μs 162.2193 KOps/s 147.8500 KOps/s $\textbf{\color{#35bf28}+9.72\%}$
test_tc_second_layer_tensor 17.8810μs 4.4613μs 224.1498 KOps/s 227.6758 KOps/s $\color{#d91a1a}-1.55\%$
test_tc_second_layer_nontensor 43.2110μs 8.7301μs 114.5464 KOps/s 107.2244 KOps/s $\textbf{\color{#35bf28}+6.83\%}$
test_unbind 0.2817s 13.1004ms 76.3333 Ops/s 71.3722 Ops/s $\textbf{\color{#35bf28}+6.95\%}$
test_full_like 4.6683ms 4.3913ms 227.7237 Ops/s 227.5958 Ops/s $\color{#35bf28}+0.06\%$
test_zeros_like 0.2547s 5.3676ms 186.3026 Ops/s 228.1708 Ops/s $\textbf{\color{#d91a1a}-18.35\%}$
test_ones_like 4.5407ms 4.3738ms 228.6337 Ops/s 227.4417 Ops/s $\color{#35bf28}+0.52\%$
test_clone 6.5885ms 6.4342ms 155.4196 Ops/s 154.4684 Ops/s $\color{#35bf28}+0.62\%$
test_squeeze 81.3310μs 14.4056μs 69.4173 KOps/s 71.1051 KOps/s $\color{#d91a1a}-2.37\%$
test_unsqueeze 0.1717ms 0.1130ms 8.8459 KOps/s 8.5357 KOps/s $\color{#35bf28}+3.63\%$
test_split 0.2352ms 0.1834ms 5.4515 KOps/s 5.2067 KOps/s $\color{#35bf28}+4.70\%$
test_permute 0.2635ms 0.2094ms 4.7754 KOps/s 4.6113 KOps/s $\color{#35bf28}+3.56\%$
test_stack 18.5225ms 18.2011ms 54.9416 Ops/s 19.4028 Ops/s $\textbf{\color{#35bf28}+183.16\%}$
test_cat 18.4300ms 18.0986ms 55.2528 Ops/s 23.1993 Ops/s $\textbf{\color{#35bf28}+138.17\%}$
test_sequential_tensordict 0.9853ms 0.5732ms 1.7447 KOps/s 1.6734 KOps/s $\color{#35bf28}+4.26\%$
test_sequential_graph_module 0.2024ms 0.1177ms 8.4929 KOps/s 8.0049 KOps/s $\textbf{\color{#35bf28}+6.10\%}$
test_nested_tensordict 1.0407ms 0.8156ms 1.2261 KOps/s 1.1829 KOps/s $\color{#35bf28}+3.66\%$
test_nested_graph_module 0.5877ms 0.1315ms 7.6044 KOps/s 7.3807 KOps/s $\color{#35bf28}+3.03\%$

@github-actions

github-actions Bot commented May 21, 2026

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large&amp;#x26A0;\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 341. Improved: $\large\color{#35bf28}26$. Worsened: $\large\color{#d91a1a}8$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_collector_preallocated_write[stack_out-cpu-32-2] 0.2272ms 0.1691ms 5.9136 KOps/s 5.8762 KOps/s $\color{#35bf28}+0.64\%$
test_collector_preallocated_write[stack_out-cpu-32-8] 0.4395ms 0.2995ms 3.3390 KOps/s 3.2813 KOps/s $\color{#35bf28}+1.76\%$
test_collector_preallocated_write[stack_out-cpu-32-32] 0.8205ms 0.7810ms 1.2803 KOps/s 1.2759 KOps/s $\color{#35bf28}+0.35\%$
test_collector_preallocated_write[stack_out-cpu-4096-2] 0.3897ms 0.3432ms 2.9135 KOps/s 2.9145 KOps/s $\color{#d91a1a}-0.03\%$
test_collector_preallocated_write[stack_out-cpu-4096-8] 1.3988ms 1.1351ms 881.0007 Ops/s 909.4209 Ops/s $\color{#d91a1a}-3.13\%$
test_collector_preallocated_write[stack_out-cpu-4096-32] 7.8772ms 7.5871ms 131.8025 Ops/s 131.9087 Ops/s $\color{#d91a1a}-0.08\%$
test_collector_preallocated_write[stack_out-cuda-32-2] 0.2967ms 0.2475ms 4.0396 KOps/s 3.9422 KOps/s $\color{#35bf28}+2.47\%$
test_collector_preallocated_write[stack_out-cuda-32-8] 0.5108ms 0.3703ms 2.7008 KOps/s 2.6833 KOps/s $\color{#35bf28}+0.65\%$
test_collector_preallocated_write[stack_out-cuda-32-32] 0.9495ms 0.8224ms 1.2159 KOps/s 1.2176 KOps/s $\color{#d91a1a}-0.14\%$
test_collector_preallocated_write[stack_out-cuda-4096-2] 0.3341ms 0.2472ms 4.0453 KOps/s 3.9801 KOps/s $\color{#35bf28}+1.64\%$
test_collector_preallocated_write[stack_out-cuda-4096-8] 0.4610ms 0.3719ms 2.6886 KOps/s 2.6679 KOps/s $\color{#35bf28}+0.78\%$
test_collector_preallocated_write[stack_out-cuda-4096-32] 0.9710ms 0.8859ms 1.1288 KOps/s 1.1290 KOps/s $\color{#d91a1a}-0.02\%$
test_collector_preallocated_write[set_at_loop-cpu-32-2] 0.2621ms 0.2154ms 4.6434 KOps/s 4.5912 KOps/s $\color{#35bf28}+1.14\%$
test_collector_preallocated_write[set_at_loop-cpu-32-8] 0.9201ms 0.8345ms 1.1984 KOps/s 1.1771 KOps/s $\color{#35bf28}+1.81\%$
test_collector_preallocated_write[set_at_loop-cpu-32-32] 3.5463ms 3.3162ms 301.5481 Ops/s 298.9941 Ops/s $\color{#35bf28}+0.85\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-2] 0.4510ms 0.3714ms 2.6927 KOps/s 2.5793 KOps/s $\color{#35bf28}+4.40\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-8] 1.9976ms 1.7859ms 559.9306 Ops/s 581.6203 Ops/s $\color{#d91a1a}-3.73\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-32] 11.1776ms 10.7454ms 93.0635 Ops/s 94.3248 Ops/s $\color{#d91a1a}-1.34\%$
test_collector_preallocated_write[set_at_loop-cuda-32-2] 0.4651ms 0.4121ms 2.4265 KOps/s 2.4046 KOps/s $\color{#35bf28}+0.91\%$
test_collector_preallocated_write[set_at_loop-cuda-32-8] 1.6370ms 1.5649ms 639.0101 Ops/s 656.0121 Ops/s $\color{#d91a1a}-2.59\%$
test_collector_preallocated_write[set_at_loop-cuda-32-32] 6.3022ms 6.1167ms 163.4868 Ops/s 168.1819 Ops/s $\color{#d91a1a}-2.79\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-2] 0.5017ms 0.4166ms 2.4003 KOps/s 2.3565 KOps/s $\color{#35bf28}+1.86\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-8] 1.7156ms 1.5600ms 641.0245 Ops/s 626.2408 Ops/s $\color{#35bf28}+2.36\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-32] 6.3203ms 6.1445ms 162.7466 Ops/s 160.6831 Ops/s $\color{#35bf28}+1.28\%$
test_collector_preallocated_write[copy_at-cpu-32-2] 0.2362ms 0.1748ms 5.7223 KOps/s 5.7461 KOps/s $\color{#d91a1a}-0.41\%$
test_collector_preallocated_write[copy_at-cpu-32-8] 0.7576ms 0.6789ms 1.4730 KOps/s 1.4752 KOps/s $\color{#d91a1a}-0.14\%$
test_collector_preallocated_write[copy_at-cpu-32-32] 2.7912ms 2.6944ms 371.1404 Ops/s 369.0501 Ops/s $\color{#35bf28}+0.57\%$
test_collector_preallocated_write[copy_at-cpu-4096-2] 0.3970ms 0.3260ms 3.0670 KOps/s 3.1983 KOps/s $\color{#d91a1a}-4.10\%$
test_collector_preallocated_write[copy_at-cpu-4096-8] 2.3134ms 1.6227ms 616.2714 Ops/s 675.2141 Ops/s $\textbf{\color{#d91a1a}-8.73\%}$
test_collector_preallocated_write[copy_at-cpu-4096-32] 10.0787ms 9.7755ms 102.2968 Ops/s 101.7120 Ops/s $\color{#35bf28}+0.57\%$
test_collector_preallocated_write[copy_at-cuda-32-2] 0.3701ms 0.3230ms 3.0961 KOps/s 3.0631 KOps/s $\color{#35bf28}+1.08\%$
test_collector_preallocated_write[copy_at-cuda-32-8] 1.2727ms 1.2105ms 826.1310 Ops/s 827.1040 Ops/s $\color{#d91a1a}-0.12\%$
test_collector_preallocated_write[copy_at-cuda-32-32] 4.8270ms 4.7279ms 211.5094 Ops/s 210.3903 Ops/s $\color{#35bf28}+0.53\%$
test_collector_preallocated_write[copy_at-cuda-4096-2] 0.3812ms 0.3258ms 3.0694 KOps/s 3.0675 KOps/s $\color{#35bf28}+0.06\%$
test_collector_preallocated_write[copy_at-cuda-4096-8] 1.2903ms 1.2173ms 821.4998 Ops/s 820.7578 Ops/s $\color{#35bf28}+0.09\%$
test_collector_preallocated_write[copy_at-cuda-4096-32] 4.8352ms 4.7498ms 210.5343 Ops/s 209.5196 Ops/s $\color{#35bf28}+0.48\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-2] 0.1531ms 0.1213ms 8.2463 KOps/s 8.2614 KOps/s $\color{#d91a1a}-0.18\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-8] 0.5469ms 0.4740ms 2.1095 KOps/s 2.1094 KOps/s $+0.00\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-32] 1.9893ms 1.9002ms 526.2535 Ops/s 526.5933 Ops/s $\color{#d91a1a}-0.06\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-2] 0.3364ms 0.2625ms 3.8093 KOps/s 3.8785 KOps/s $\color{#d91a1a}-1.78\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-8] 1.4032ms 1.2642ms 790.9838 Ops/s 812.2618 Ops/s $\color{#d91a1a}-2.62\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-32] 9.2569ms 8.8839ms 112.5628 Ops/s 111.9805 Ops/s $\color{#35bf28}+0.52\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-2] 0.3315ms 0.2744ms 3.6449 KOps/s 3.6130 KOps/s $\color{#35bf28}+0.88\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-8] 1.2404ms 1.0226ms 977.8872 Ops/s 977.2549 Ops/s $\color{#35bf28}+0.06\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-32] 4.1221ms 4.0141ms 249.1225 Ops/s 248.9287 Ops/s $\color{#35bf28}+0.08\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-2] 0.3262ms 0.2745ms 3.6433 KOps/s 3.6424 KOps/s $\color{#35bf28}+0.02\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-8] 1.0856ms 1.0194ms 981.0172 Ops/s 974.7018 Ops/s $\color{#35bf28}+0.65\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-32] 4.1229ms 4.0275ms 248.2904 Ops/s 247.0368 Ops/s $\color{#35bf28}+0.51\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-128] 17.9371ms 16.3863ms 61.0266 Ops/s 60.5310 Ops/s $\color{#35bf28}+0.82\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-256] 33.2346ms 32.9633ms 30.3367 Ops/s 30.3635 Ops/s $\color{#d91a1a}-0.09\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-128] 91.0254ms 88.4192ms 11.3098 Ops/s 11.4202 Ops/s $\color{#d91a1a}-0.97\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-256] 0.2100s 0.2088s 4.7891 Ops/s 4.8194 Ops/s $\color{#d91a1a}-0.63\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-128] 13.8347ms 13.7699ms 72.6221 Ops/s 73.0574 Ops/s $\color{#d91a1a}-0.60\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-256] 27.2168ms 27.0583ms 36.9573 Ops/s 37.2451 Ops/s $\color{#d91a1a}-0.77\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-128] 14.0117ms 13.9305ms 71.7849 Ops/s 72.1676 Ops/s $\color{#d91a1a}-0.53\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-256] 27.4094ms 27.3097ms 36.6171 Ops/s 36.5468 Ops/s $\color{#35bf28}+0.19\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-128] 52.6900ms 52.4704ms 19.0584 Ops/s 19.0941 Ops/s $\color{#d91a1a}-0.19\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-256] 0.1051s 0.1049s 9.5351 Ops/s 9.4464 Ops/s $\color{#35bf28}+0.94\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-128] 0.1530s 0.1511s 6.6185 Ops/s 6.5389 Ops/s $\color{#35bf28}+1.22\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-256] 0.3372s 0.3330s 3.0031 Ops/s 3.0449 Ops/s $\color{#d91a1a}-1.37\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-128] 75.3772ms 74.4853ms 13.4255 Ops/s 12.9968 Ops/s $\color{#35bf28}+3.30\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-256] 0.1504s 0.1499s 6.6707 Ops/s 6.2639 Ops/s $\textbf{\color{#35bf28}+6.49\%}$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-128] 76.1253ms 74.9904ms 13.3350 Ops/s 12.5648 Ops/s $\textbf{\color{#35bf28}+6.13\%}$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-256] 0.1524s 0.1511s 6.6190 Ops/s 6.2154 Ops/s $\textbf{\color{#35bf28}+6.49\%}$
test_wide_nested_preallocated_write[copy_at-cpu-128-128] 30.5334ms 30.4414ms 32.8500 Ops/s 32.6248 Ops/s $\color{#35bf28}+0.69\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-256] 61.9053ms 61.6468ms 16.2214 Ops/s 16.1362 Ops/s $\color{#35bf28}+0.53\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-128] 0.1251s 0.1236s 8.0917 Ops/s 7.8895 Ops/s $\color{#35bf28}+2.56\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-256] 0.2791s 0.2774s 3.6049 Ops/s 3.5381 Ops/s $\color{#35bf28}+1.89\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-128] 43.6758ms 43.2033ms 23.1464 Ops/s 23.2142 Ops/s $\color{#d91a1a}-0.29\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-256] 87.0405ms 86.5352ms 11.5560 Ops/s 11.5720 Ops/s $\color{#d91a1a}-0.14\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-128] 43.7929ms 43.3169ms 23.0857 Ops/s 23.1254 Ops/s $\color{#d91a1a}-0.17\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-256] 87.8761ms 87.0104ms 11.4929 Ops/s 11.5400 Ops/s $\color{#d91a1a}-0.41\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-128] 20.8404ms 20.5892ms 48.5692 Ops/s 48.3588 Ops/s $\color{#35bf28}+0.44\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-256] 42.4395ms 42.0804ms 23.7640 Ops/s 23.7769 Ops/s $\color{#d91a1a}-0.05\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-128] 0.1159s 0.1132s 8.8310 Ops/s 8.7425 Ops/s $\color{#35bf28}+1.01\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-256] 0.2561s 0.2523s 3.9633 Ops/s 3.8924 Ops/s $\color{#35bf28}+1.82\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-128] 37.0512ms 36.5028ms 27.3951 Ops/s 26.9767 Ops/s $\color{#35bf28}+1.55\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-256] 74.4064ms 73.3007ms 13.6424 Ops/s 13.4011 Ops/s $\color{#35bf28}+1.80\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-128] 37.4225ms 36.8328ms 27.1497 Ops/s 26.8857 Ops/s $\color{#35bf28}+0.98\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-256] 74.4229ms 73.5672ms 13.5930 Ops/s 13.5586 Ops/s $\color{#35bf28}+0.25\%$
test_plain_set_nested 44.1910μs 15.6692μs 63.8195 KOps/s 64.8715 KOps/s $\color{#d91a1a}-1.62\%$
test_plain_set_stack_nested 44.1110μs 15.3909μs 64.9735 KOps/s 65.4479 KOps/s $\color{#d91a1a}-0.72\%$
test_plain_set_nested_inplace 82.6210μs 16.6052μs 60.2223 KOps/s 58.6755 KOps/s $\color{#35bf28}+2.64\%$
test_plain_set_stack_nested_inplace 42.8810μs 16.5184μs 60.5385 KOps/s 59.4823 KOps/s $\color{#35bf28}+1.78\%$
test_items 33.7010μs 6.0689μs 164.7737 KOps/s 164.7556 KOps/s $\color{#35bf28}+0.01\%$
test_items_nested 0.5551ms 0.4634ms 2.1579 KOps/s 2.1195 KOps/s $\color{#35bf28}+1.81\%$
test_items_nested_locked 0.5082ms 0.4614ms 2.1674 KOps/s 2.1020 KOps/s $\color{#35bf28}+3.11\%$
test_items_nested_leaf 0.1342ms 96.5696μs 10.3552 KOps/s 10.2049 KOps/s $\color{#35bf28}+1.47\%$
test_items_stack_nested 0.5502ms 0.4622ms 2.1635 KOps/s 2.1096 KOps/s $\color{#35bf28}+2.55\%$
test_items_stack_nested_leaf 0.1340ms 97.9359μs 10.2108 KOps/s 10.2567 KOps/s $\color{#d91a1a}-0.45\%$
test_items_stack_nested_locked 0.5533ms 0.4692ms 2.1313 KOps/s 2.0910 KOps/s $\color{#35bf28}+1.93\%$
test_keys 32.9710μs 4.2114μs 237.4524 KOps/s 234.4051 KOps/s $\color{#35bf28}+1.30\%$
test_keys_nested 0.1812ms 0.1300ms 7.6931 KOps/s 7.5741 KOps/s $\color{#35bf28}+1.57\%$
test_keys_nested_locked 0.7668ms 0.1393ms 7.1813 KOps/s 7.1018 KOps/s $\color{#35bf28}+1.12\%$
test_keys_nested_leaf 0.1657ms 0.1206ms 8.2907 KOps/s 8.1696 KOps/s $\color{#35bf28}+1.48\%$
test_keys_stack_nested 0.1782ms 0.1292ms 7.7410 KOps/s 7.5878 KOps/s $\color{#35bf28}+2.02\%$
test_keys_stack_nested_leaf 0.1629ms 0.1196ms 8.3644 KOps/s 8.2424 KOps/s $\color{#35bf28}+1.48\%$
test_keys_stack_nested_locked 0.2155ms 0.1399ms 7.1500 KOps/s 7.1632 KOps/s $\color{#d91a1a}-0.18\%$
test_values 7.1222μs 1.0295μs 971.3030 KOps/s 974.7345 KOps/s $\color{#d91a1a}-0.35\%$
test_values_nested 71.7620μs 52.8036μs 18.9381 KOps/s 18.8349 KOps/s $\color{#35bf28}+0.55\%$
test_values_nested_locked 0.1439ms 56.4259μs 17.7224 KOps/s 17.6591 KOps/s $\color{#35bf28}+0.36\%$
test_values_nested_leaf 91.5620μs 60.6126μs 16.4982 KOps/s 16.5042 KOps/s $\color{#d91a1a}-0.04\%$
test_values_stack_nested 89.8820μs 52.8061μs 18.9372 KOps/s 18.9657 KOps/s $\color{#d91a1a}-0.15\%$
test_values_stack_nested_leaf 92.9720μs 60.7433μs 16.4627 KOps/s 16.4437 KOps/s $\color{#35bf28}+0.12\%$
test_values_stack_nested_locked 91.5020μs 56.2304μs 17.7840 KOps/s 17.7916 KOps/s $\color{#d91a1a}-0.04\%$
test_membership 10.6668μs 0.8380μs 1.1934 MOps/s 1.1963 MOps/s $\color{#d91a1a}-0.24\%$
test_membership_nested 37.1410μs 2.9591μs 337.9417 KOps/s 335.2953 KOps/s $\color{#35bf28}+0.79\%$
test_membership_nested_leaf 27.7410μs 2.9477μs 339.2522 KOps/s 337.4302 KOps/s $\color{#35bf28}+0.54\%$
test_membership_stacked_nested 36.3000μs 2.8571μs 350.0108 KOps/s 347.1622 KOps/s $\color{#35bf28}+0.82\%$
test_membership_stacked_nested_leaf 35.9510μs 2.8791μs 347.3327 KOps/s 347.5967 KOps/s $\color{#d91a1a}-0.08\%$
test_membership_nested_last 21.5700μs 4.4183μs 226.3293 KOps/s 224.1345 KOps/s $\color{#35bf28}+0.98\%$
test_membership_nested_leaf_last 40.9700μs 4.4240μs 226.0412 KOps/s 223.5618 KOps/s $\color{#35bf28}+1.11\%$
test_membership_stacked_nested_last 65.3110μs 4.2779μs 233.7574 KOps/s 232.7646 KOps/s $\color{#35bf28}+0.43\%$
test_membership_stacked_nested_leaf_last 37.9310μs 4.2909μs 233.0532 KOps/s 232.7956 KOps/s $\color{#35bf28}+0.11\%$
test_nested_getleaf 60.6210μs 21.6972μs 46.0889 KOps/s 46.3651 KOps/s $\color{#d91a1a}-0.60\%$
test_nested_get 54.0510μs 20.5674μs 48.6207 KOps/s 48.9322 KOps/s $\color{#d91a1a}-0.64\%$
test_stacked_getleaf 53.4710μs 21.4583μs 46.6021 KOps/s 45.8545 KOps/s $\color{#35bf28}+1.63\%$
test_stacked_get 49.1810μs 20.6386μs 48.4528 KOps/s 48.6116 KOps/s $\color{#d91a1a}-0.33\%$
test_nested_getitemleaf 94.2420μs 22.2056μs 45.0338 KOps/s 44.8844 KOps/s $\color{#35bf28}+0.33\%$
test_nested_getitem 52.0120μs 21.2652μs 47.0251 KOps/s 47.4746 KOps/s $\color{#d91a1a}-0.95\%$
test_stacked_getitemleaf 49.2910μs 22.3105μs 44.8220 KOps/s 45.3313 KOps/s $\color{#d91a1a}-1.12\%$
test_stacked_getitem 47.6610μs 21.2640μs 47.0278 KOps/s 47.8049 KOps/s $\color{#d91a1a}-1.63\%$
test_lock_nested 7.9890ms 0.4819ms 2.0751 KOps/s 2.0867 KOps/s $\color{#d91a1a}-0.55\%$
test_lock_stack_nested 0.6717ms 0.4798ms 2.0840 KOps/s 2.0865 KOps/s $\color{#d91a1a}-0.12\%$
test_unlock_nested 0.4580ms 0.3862ms 2.5891 KOps/s 2.5902 KOps/s $\color{#d91a1a}-0.04\%$
test_unlock_stack_nested 0.4430ms 0.3887ms 2.5726 KOps/s 2.5684 KOps/s $\color{#35bf28}+0.16\%$
test_flatten_speed 0.1700ms 0.1214ms 8.2388 KOps/s 8.1919 KOps/s $\color{#35bf28}+0.57\%$
test_unflatten_speed 0.6111ms 0.5687ms 1.7585 KOps/s 1.7400 KOps/s $\color{#35bf28}+1.06\%$
test_common_ops 99.9284ms 1.4980ms 667.5543 Ops/s 580.9036 Ops/s $\textbf{\color{#35bf28}+14.92\%}$
test_creation 0.1503ms 3.1681μs 315.6425 KOps/s 324.1188 KOps/s $\color{#d91a1a}-2.62\%$
test_creation_empty 29.4410μs 7.0314μs 142.2193 KOps/s 144.5363 KOps/s $\color{#d91a1a}-1.60\%$
test_creation_nested_1 43.0310μs 11.5545μs 86.5461 KOps/s 87.7848 KOps/s $\color{#d91a1a}-1.41\%$
test_creation_nested_2 39.0110μs 13.5522μs 73.7887 KOps/s 75.1531 KOps/s $\color{#d91a1a}-1.82\%$
test_creation_many_keys[10] 61.0610μs 20.9782μs 47.6685 KOps/s 48.0875 KOps/s $\color{#d91a1a}-0.87\%$
test_creation_many_keys[50] 0.1212ms 89.9119μs 11.1220 KOps/s 11.2143 KOps/s $\color{#d91a1a}-0.82\%$
test_creation_many_keys[100] 0.2006ms 0.1768ms 5.6557 KOps/s 5.6750 KOps/s $\color{#d91a1a}-0.34\%$
test_creation_nested_many_keys[10] 81.6110μs 45.0359μs 22.2045 KOps/s 22.4392 KOps/s $\color{#d91a1a}-1.05\%$
test_creation_nested_many_keys[50] 0.2372ms 0.1848ms 5.4100 KOps/s 5.4645 KOps/s $\color{#d91a1a}-1.00\%$
test_clone 38.0000μs 13.4056μs 74.5954 KOps/s 75.2079 KOps/s $\color{#d91a1a}-0.81\%$
test_getitem[int] 1.6435ms 15.2873μs 65.4136 KOps/s 64.9787 KOps/s $\color{#35bf28}+0.67\%$
test_getitem[slice_int] 0.1380ms 24.4896μs 40.8336 KOps/s 38.3439 KOps/s $\textbf{\color{#35bf28}+6.49\%}$
test_getitem[range] 0.1707ms 65.6960μs 15.2216 KOps/s 14.9837 KOps/s $\color{#35bf28}+1.59\%$
test_getitem[tuple] 0.1513ms 24.3656μs 41.0414 KOps/s 39.6403 KOps/s $\color{#35bf28}+3.53\%$
test_getitem[list] 0.1812ms 60.3829μs 16.5610 KOps/s 16.0712 KOps/s $\color{#35bf28}+3.05\%$
test_setitem_dim[int] 44.9510μs 25.1722μs 39.7263 KOps/s 36.5644 KOps/s $\textbf{\color{#35bf28}+8.65\%}$
test_setitem_dim[slice_int] 62.3610μs 42.2649μs 23.6603 KOps/s 22.2313 KOps/s $\textbf{\color{#35bf28}+6.43\%}$
test_setitem_dim[range] 0.1410ms 96.7236μs 10.3387 KOps/s 9.8885 KOps/s $\color{#35bf28}+4.55\%$
test_setitem_dim[tuple] 62.5110μs 40.4609μs 24.7152 KOps/s 24.4798 KOps/s $\color{#35bf28}+0.96\%$
test_setitem 99.4120μs 17.8446μs 56.0395 KOps/s 56.8574 KOps/s $\color{#d91a1a}-1.44\%$
test_set 55.0810μs 16.9326μs 59.0576 KOps/s 59.3119 KOps/s $\color{#d91a1a}-0.43\%$
test_set_shared 0.5802ms 0.2068ms 4.8367 KOps/s 4.6082 KOps/s $\color{#35bf28}+4.96\%$
test_update 0.2112ms 21.7248μs 46.0304 KOps/s 45.6746 KOps/s $\color{#35bf28}+0.78\%$
test_update_nested 78.3220μs 33.1918μs 30.1279 KOps/s 29.9156 KOps/s $\color{#35bf28}+0.71\%$
test_update__nested 0.5544ms 33.4263μs 29.9166 KOps/s 29.8851 KOps/s $\color{#35bf28}+0.11\%$
test_set_nested 58.8820μs 19.0978μs 52.3622 KOps/s 53.8056 KOps/s $\color{#d91a1a}-2.68\%$
test_set_nested_new 57.0810μs 23.6466μs 42.2893 KOps/s 42.4826 KOps/s $\color{#d91a1a}-0.45\%$
test_select 77.7920μs 40.1429μs 24.9110 KOps/s 24.3962 KOps/s $\color{#35bf28}+2.11\%$
test_select_nested 97.8120μs 75.0500μs 13.3244 KOps/s 13.5541 KOps/s $\color{#d91a1a}-1.69\%$
test_exclude_nested 0.1389ms 92.1358μs 10.8535 KOps/s 10.8782 KOps/s $\color{#d91a1a}-0.23\%$
test_empty[True] 0.7927ms 0.4036ms 2.4774 KOps/s 2.4745 KOps/s $\color{#35bf28}+0.12\%$
test_empty[False] 8.2875μs 1.4023μs 713.1351 KOps/s 715.8319 KOps/s $\color{#d91a1a}-0.38\%$
test_to 0.1061ms 69.2752μs 14.4352 KOps/s 14.2354 KOps/s $\color{#35bf28}+1.40\%$
test_to_nonblocking 0.1018ms 67.7885μs 14.7518 KOps/s 14.1208 KOps/s $\color{#35bf28}+4.47\%$
test_unbind_speed 1.1259ms 0.3356ms 2.9794 KOps/s 2.9594 KOps/s $\color{#35bf28}+0.67\%$
test_unbind_speed_stack0 0.3727ms 0.3330ms 3.0032 KOps/s 2.9863 KOps/s $\color{#35bf28}+0.56\%$
test_unbind_speed_stack1 0.1163s 0.8652ms 1.1558 KOps/s 1.1564 KOps/s $\color{#d91a1a}-0.05\%$
test_split 1.2451ms 1.1475ms 871.4312 Ops/s 704.2472 Ops/s $\textbf{\color{#35bf28}+23.74\%}$
test_chunk 0.1156s 1.2315ms 812.0460 Ops/s 923.9288 Ops/s $\textbf{\color{#d91a1a}-12.11\%}$
test_to_cpu_blocking 20.1696ms 19.5092ms 51.2580 Ops/s 51.4948 Ops/s $\color{#d91a1a}-0.46\%$
test_to_cpu_global_sync 11.9433ms 11.7697ms 84.9637 Ops/s 85.1452 Ops/s $\color{#d91a1a}-0.21\%$
test_to_cpu_event_sync 13.1814ms 12.6254ms 79.2054 Ops/s 79.1853 Ops/s $\color{#35bf28}+0.03\%$
test_to_cpu_default 13.1393ms 12.6342ms 79.1501 Ops/s 70.3158 Ops/s $\textbf{\color{#35bf28}+12.56\%}$
test_consolidate[False-None] 0.1457s 4.7125ms 212.2033 Ops/s 241.5858 Ops/s $\textbf{\color{#d91a1a}-12.16\%}$
test_consolidate[default-None] 2.0912ms 2.0063ms 498.4370 Ops/s 488.2480 Ops/s $\color{#35bf28}+2.09\%$
test_consolidate[reduce-overhead-None] 2.0310ms 1.9341ms 517.0347 Ops/s 501.5725 Ops/s $\color{#35bf28}+3.08\%$
test_consolidate_njt[False-None] 8.6689ms 8.4145ms 118.8421 Ops/s 115.9605 Ops/s $\color{#35bf28}+2.48\%$
test_to[False-False-None] 2.2206ms 2.1500ms 465.1113 Ops/s 456.6338 Ops/s $\color{#35bf28}+1.86\%$
test_to[True-False-None] 2.1568ms 1.8555ms 538.9276 Ops/s 533.3769 Ops/s $\color{#35bf28}+1.04\%$
test_to[within-False-None] 6.4298ms 6.0659ms 164.8549 Ops/s 163.4860 Ops/s $\color{#35bf28}+0.84\%$
test_to[True-default-None] 10.7965ms 10.5642ms 94.6590 Ops/s 92.7679 Ops/s $\color{#35bf28}+2.04\%$
test_to_njt[False-False-None] 8.8032ms 8.6161ms 116.0622 Ops/s 114.3650 Ops/s $\color{#35bf28}+1.48\%$
test_to_njt[True-False-None] 7.0785ms 6.8167ms 146.6975 Ops/s 141.6408 Ops/s $\color{#35bf28}+3.57\%$
test_to_njt[within-False-None] 15.8302ms 15.3286ms 65.2376 Ops/s 63.2933 Ops/s $\color{#35bf28}+3.07\%$
test_creation[device0] 0.3917ms 0.1199ms 8.3398 KOps/s 8.4707 KOps/s $\color{#d91a1a}-1.54\%$
test_creation_from_tensor 0.4591ms 0.1166ms 8.5788 KOps/s 8.3993 KOps/s $\color{#35bf28}+2.14\%$
test_add_one[memmap_tensor0] 0.1864ms 6.8087μs 146.8718 KOps/s 143.0273 KOps/s $\color{#35bf28}+2.69\%$
test_contiguous[memmap_tensor0] 27.6510μs 0.6517μs 1.5344 MOps/s 2.1915 MOps/s $\textbf{\color{#d91a1a}-29.99\%}$
test_stack[memmap_tensor0] 45.7910μs 4.2751μs 233.9113 KOps/s 232.8091 KOps/s $\color{#35bf28}+0.47\%$
test_memmaptd_index 1.1760ms 0.2693ms 3.7135 KOps/s 3.6663 KOps/s $\color{#35bf28}+1.29\%$
test_memmaptd_index_astensor 0.5408ms 0.3765ms 2.6557 KOps/s 2.6631 KOps/s $\color{#d91a1a}-0.28\%$
test_memmaptd_index_op 0.8499ms 0.6362ms 1.5718 KOps/s 1.5479 KOps/s $\color{#35bf28}+1.54\%$
test_serialize_model 0.1367s 0.1345s 7.4330 Ops/s 7.4393 Ops/s $\color{#d91a1a}-0.09\%$
test_serialize_model_pickle 1.3493s 1.2104s 0.8262 Ops/s 0.8265 Ops/s $\color{#d91a1a}-0.04\%$
test_serialize_weights 0.1357s 0.1338s 7.4747 Ops/s 7.5127 Ops/s $\color{#d91a1a}-0.50\%$
test_serialize_weights_returnearly 0.4666s 86.9103ms 11.5061 Ops/s 15.3859 Ops/s $\textbf{\color{#d91a1a}-25.22\%}$
test_serialize_weights_pickle 1.4041s 1.2232s 0.8175 Ops/s 0.8182 Ops/s $\color{#d91a1a}-0.09\%$
test_reshape_pytree 0.2106ms 32.9277μs 30.3696 KOps/s 30.1882 KOps/s $\color{#35bf28}+0.60\%$
test_reshape_td 0.1032ms 44.2281μs 22.6101 KOps/s 22.6408 KOps/s $\color{#d91a1a}-0.14\%$
test_view_pytree 0.2624ms 32.0583μs 31.1931 KOps/s 30.7957 KOps/s $\color{#35bf28}+1.29\%$
test_view_td 92.5220μs 53.6329μs 18.6453 KOps/s 18.8223 KOps/s $\color{#d91a1a}-0.94\%$
test_unbind_pytree 0.2355ms 36.7222μs 27.2315 KOps/s 27.0005 KOps/s $\color{#35bf28}+0.86\%$
test_unbind_td 98.9720μs 50.5371μs 19.7874 KOps/s 19.9867 KOps/s $\color{#d91a1a}-1.00\%$
test_split_pytree 0.2524ms 42.5075μs 23.5253 KOps/s 23.4676 KOps/s $\color{#35bf28}+0.25\%$
test_split_td 0.1467ms 64.2360μs 15.5676 KOps/s 15.3807 KOps/s $\color{#35bf28}+1.22\%$
test_add_pytree 0.2257ms 42.4217μs 23.5728 KOps/s 22.8945 KOps/s $\color{#35bf28}+2.96\%$
test_add_td 0.1116ms 56.2375μs 17.7817 KOps/s 17.9706 KOps/s $\color{#d91a1a}-1.05\%$
test_compile_add_one_nested[tensordict-compile] 0.3541ms 0.2180ms 4.5866 KOps/s 4.1902 KOps/s $\textbf{\color{#35bf28}+9.46\%}$
test_compile_add_one_nested[tensordict-eager] 0.2989ms 0.2039ms 4.9043 KOps/s 4.9133 KOps/s $\color{#d91a1a}-0.18\%$
test_compile_add_one_nested[pytree-compile] 0.2898ms 0.1332ms 7.5103 KOps/s 7.2748 KOps/s $\color{#35bf28}+3.24\%$
test_compile_add_one_nested[pytree-eager] 0.4323ms 0.1769ms 5.6533 KOps/s 5.5168 KOps/s $\color{#35bf28}+2.47\%$
test_compile_copy_nested[tensordict-compile] 87.0220μs 15.2790μs 65.4491 KOps/s 67.1736 KOps/s $\color{#d91a1a}-2.57\%$
test_compile_copy_nested[tensordict-eager] 0.3077ms 53.9733μs 18.5277 KOps/s 18.5682 KOps/s $\color{#d91a1a}-0.22\%$
test_compile_copy_nested[pytree-compile] 0.1449ms 15.4114μs 64.8872 KOps/s 64.6103 KOps/s $\color{#35bf28}+0.43\%$
test_compile_copy_nested[pytree-eager] 0.3798ms 68.7383μs 14.5479 KOps/s 14.4271 KOps/s $\color{#35bf28}+0.84\%$
test_compile_add_one_flat[tensordict-compile] 0.3725ms 0.2475ms 4.0404 KOps/s 3.8939 KOps/s $\color{#35bf28}+3.76\%$
test_compile_add_one_flat[tensordict-eager] 0.4073ms 0.2809ms 3.5597 KOps/s 3.4424 KOps/s $\color{#35bf28}+3.41\%$
test_compile_add_one_flat[tensorclass-compile] 0.3247ms 0.1871ms 5.3443 KOps/s 5.2475 KOps/s $\color{#35bf28}+1.85\%$
test_compile_add_one_flat[tensorclass-eager] 0.1571ms 76.3895μs 13.0908 KOps/s 12.8250 KOps/s $\color{#35bf28}+2.07\%$
test_compile_add_one_flat[pytree-compile] 0.4616ms 0.1918ms 5.2127 KOps/s 4.9572 KOps/s $\textbf{\color{#35bf28}+5.15\%}$
test_compile_add_one_flat[pytree-eager] 0.8441ms 0.5388ms 1.8561 KOps/s 1.8895 KOps/s $\color{#d91a1a}-1.77\%$
test_compile_add_self_flat[tensordict-eager] 0.4954ms 0.3289ms 3.0409 KOps/s 2.9654 KOps/s $\color{#35bf28}+2.54\%$
test_compile_add_self_flat[tensordict-compile] 0.3332ms 0.2518ms 3.9716 KOps/s 3.7031 KOps/s $\textbf{\color{#35bf28}+7.25\%}$
test_compile_add_self_flat[tensorclass-eager] 0.1556ms 93.6200μs 10.6815 KOps/s 10.9375 KOps/s $\color{#d91a1a}-2.34\%$
test_compile_add_self_flat[tensorclass-compile] 0.3427ms 0.1907ms 5.2449 KOps/s 5.0070 KOps/s $\color{#35bf28}+4.75\%$
test_compile_add_self_flat[pytree-eager] 0.6886ms 0.4454ms 2.2453 KOps/s 2.3001 KOps/s $\color{#d91a1a}-2.38\%$
test_compile_add_self_flat[pytree-compile] 0.5083ms 0.1957ms 5.1093 KOps/s 4.9932 KOps/s $\color{#35bf28}+2.33\%$
test_compile_copy_flat[tensordict-compile] 72.2520μs 19.1356μs 52.2586 KOps/s 50.4865 KOps/s $\color{#35bf28}+3.51\%$
test_compile_copy_flat[tensordict-eager] 75.8720μs 41.7078μs 23.9763 KOps/s 23.9442 KOps/s $\color{#35bf28}+0.13\%$
test_compile_copy_flat[pytree-compile] 0.2080ms 21.0778μs 47.4433 KOps/s 45.0835 KOps/s $\textbf{\color{#35bf28}+5.23\%}$
test_compile_copy_flat[pytree-eager] 0.3395ms 52.5969μs 19.0125 KOps/s 18.9205 KOps/s $\color{#35bf28}+0.49\%$
test_compile_assign_and_add[tensordict-compile] 2.2019ms 0.2370ms 4.2197 KOps/s 3.8981 KOps/s $\textbf{\color{#35bf28}+8.25\%}$
test_compile_assign_and_add[tensordict-eager] 3.3942ms 3.2227ms 310.3031 Ops/s 299.9895 Ops/s $\color{#35bf28}+3.44\%$
test_compile_assign_and_add[pytree-compile] 2.1254ms 0.1772ms 5.6430 KOps/s 5.3718 KOps/s $\textbf{\color{#35bf28}+5.05\%}$
test_compile_assign_and_add[pytree-eager] 2.8974ms 2.7149ms 368.3347 Ops/s 356.6366 Ops/s $\color{#35bf28}+3.28\%$
test_compile_indexing[tensor-tensordict-compile] 0.2590ms 0.1356ms 7.3755 KOps/s 6.9227 KOps/s $\textbf{\color{#35bf28}+6.54\%}$
test_compile_indexing[tensor-tensordict-eager] 0.3231ms 76.9890μs 12.9889 KOps/s 12.9480 KOps/s $\color{#35bf28}+0.32\%$
test_compile_indexing[tensor-tensorclass-compile] 0.2239ms 0.1203ms 8.3134 KOps/s 8.1602 KOps/s $\color{#35bf28}+1.88\%$
test_compile_indexing[tensor-tensorclass-eager] 0.2582ms 48.2901μs 20.7082 KOps/s 20.6879 KOps/s $\color{#35bf28}+0.10\%$
test_compile_indexing[tensor-pytree-compile] 0.1853ms 0.1207ms 8.2848 KOps/s 8.0861 KOps/s $\color{#35bf28}+2.46\%$
test_compile_indexing[tensor-pytree-eager] 0.2497ms 48.0016μs 20.8326 KOps/s 20.8988 KOps/s $\color{#d91a1a}-0.32\%$
test_compile_indexing[slice-tensordict-compile] 0.2266ms 81.4308μs 12.2804 KOps/s 11.2183 KOps/s $\textbf{\color{#35bf28}+9.47\%}$
test_compile_indexing[slice-tensordict-eager] 0.2050ms 30.1337μs 33.1855 KOps/s 35.6821 KOps/s $\textbf{\color{#d91a1a}-7.00\%}$
test_compile_indexing[slice-tensorclass-compile] 0.1551ms 69.9403μs 14.2979 KOps/s 14.2099 KOps/s $\color{#35bf28}+0.62\%$
test_compile_indexing[slice-tensorclass-eager] 0.2367ms 22.4884μs 44.4674 KOps/s 43.8737 KOps/s $\color{#35bf28}+1.35\%$
test_compile_indexing[slice-pytree-compile] 0.1030ms 70.2787μs 14.2291 KOps/s 13.9924 KOps/s $\color{#35bf28}+1.69\%$
test_compile_indexing[slice-pytree-eager] 0.2429ms 22.3585μs 44.7257 KOps/s 44.2830 KOps/s $\color{#35bf28}+1.00\%$
test_compile_indexing[int-tensordict-compile] 0.1283ms 82.3912μs 12.1372 KOps/s 11.4769 KOps/s $\textbf{\color{#35bf28}+5.75\%}$
test_compile_indexing[int-tensordict-eager] 0.2577ms 27.0691μs 36.9424 KOps/s 36.0590 KOps/s $\color{#35bf28}+2.45\%$
test_compile_indexing[int-tensorclass-compile] 0.1139ms 69.8548μs 14.3154 KOps/s 14.1991 KOps/s $\color{#35bf28}+0.82\%$
test_compile_indexing[int-tensorclass-eager] 0.2356ms 22.3183μs 44.8062 KOps/s 44.5154 KOps/s $\color{#35bf28}+0.65\%$
test_compile_indexing[int-pytree-compile] 0.1098ms 69.9614μs 14.2936 KOps/s 14.1356 KOps/s $\color{#35bf28}+1.12\%$
test_compile_indexing[int-pytree-eager] 0.2315ms 22.3029μs 44.8373 KOps/s 44.5132 KOps/s $\color{#35bf28}+0.73\%$
test_compile_replace[single-eager] 86.5620μs 46.5062μs 21.5025 KOps/s 20.9683 KOps/s $\color{#35bf28}+2.55\%$
test_compile_replace[single-compile] 0.2491ms 0.1292ms 7.7389 KOps/s 7.6404 KOps/s $\color{#35bf28}+1.29\%$
test_compile_replace[multi-eager] 0.6173ms 0.5588ms 1.7895 KOps/s 1.7415 KOps/s $\color{#35bf28}+2.75\%$
test_compile_replace[multi-compile] 0.3156ms 0.1365ms 7.3280 KOps/s 6.8464 KOps/s $\textbf{\color{#35bf28}+7.03\%}$
test_compile_tc_getattr_20[eager] 0.2213ms 0.1606ms 6.2263 KOps/s 6.1419 KOps/s $\color{#35bf28}+1.37\%$
test_compile_tc_getattr_20[compile] 0.4349ms 0.1504ms 6.6506 KOps/s 6.6129 KOps/s $\color{#35bf28}+0.57\%$
test_compile_clone_shallow[20-eager] 0.1399ms 19.3262μs 51.7433 KOps/s 51.5452 KOps/s $\color{#35bf28}+0.38\%$
test_compile_clone_shallow[20-compile] 78.9420μs 16.1560μs 61.8966 KOps/s 57.8619 KOps/s $\textbf{\color{#35bf28}+6.97\%}$
test_compile_clone_shallow[40-eager] 69.3810μs 34.5137μs 28.9740 KOps/s 29.5955 KOps/s $\color{#d91a1a}-2.10\%$
test_compile_clone_shallow[40-compile] 90.6420μs 18.0749μs 55.3255 KOps/s 50.9141 KOps/s $\textbf{\color{#35bf28}+8.66\%}$
test_compile_clone_shallow[80-eager] 0.1019ms 64.0007μs 15.6248 KOps/s 15.9145 KOps/s $\color{#d91a1a}-1.82\%$
test_compile_clone_shallow[80-compile] 80.4420μs 21.5774μs 46.3448 KOps/s 44.6526 KOps/s $\color{#35bf28}+3.79\%$
test_compile_update_inplace[eager] 0.2104ms 61.9738μs 16.1358 KOps/s 16.4065 KOps/s $\color{#d91a1a}-1.65\%$
test_compile_update_inplace[compile] 0.3008ms 0.1453ms 6.8846 KOps/s 6.6566 KOps/s $\color{#35bf28}+3.42\%$
test_mod_add[eager] 0.2967ms 0.2271ms 4.4034 KOps/s 4.3860 KOps/s $\color{#35bf28}+0.40\%$
test_mod_add[compile] 0.2642ms 0.1310ms 7.6349 KOps/s 7.4241 KOps/s $\color{#35bf28}+2.84\%$
test_mod_add[compile-overhead] 0.3480ms 0.1771ms 5.6461 KOps/s 5.5644 KOps/s $\color{#35bf28}+1.47\%$
test_mod_wrap[eager] 0.5762ms 0.4705ms 2.1253 KOps/s 2.0945 KOps/s $\color{#35bf28}+1.47\%$
test_mod_wrap[compile] 0.4743ms 0.3915ms 2.5545 KOps/s 2.4493 KOps/s $\color{#35bf28}+4.30\%$
test_mod_wrap[compile-overhead] 8.5866ms 4.6801ms 213.6698 Ops/s 216.1837 Ops/s $\color{#d91a1a}-1.16\%$
test_mod_wrap_and_backward[eager] 2.1491ms 1.7186ms 581.8663 Ops/s 585.0223 Ops/s $\color{#d91a1a}-0.54\%$
test_mod_wrap_and_backward[compile] 2.3658ms 1.5680ms 637.7724 Ops/s 645.0319 Ops/s $\color{#d91a1a}-1.13\%$
test_mod_wrap_and_backward[compile-overhead] 1.3307ms 0.9413ms 1.0624 KOps/s 1.0397 KOps/s $\color{#35bf28}+2.19\%$
test_seq_add[eager] 0.5867ms 0.5133ms 1.9483 KOps/s 1.9469 KOps/s $\color{#35bf28}+0.07\%$
test_seq_add[compile] 0.2686ms 0.1408ms 7.1032 KOps/s 6.5640 KOps/s $\textbf{\color{#35bf28}+8.21\%}$
test_seq_add[compile-overhead] 0.3237ms 0.1816ms 5.5073 KOps/s 5.1005 KOps/s $\textbf{\color{#35bf28}+7.98\%}$
test_seq_wrap[eager] 1.5145ms 1.4128ms 707.8081 Ops/s 700.4290 Ops/s $\color{#35bf28}+1.05\%$
test_seq_wrap[compile] 0.5230ms 0.4075ms 2.4537 KOps/s 2.3633 KOps/s $\color{#35bf28}+3.83\%$
test_seq_wrap[compile-overhead] 0.4143ms 0.3035ms 3.2952 KOps/s 3.1799 KOps/s $\color{#35bf28}+3.63\%$
test_func_call_runtime[False-eager] 0.9051ms 0.8106ms 1.2337 KOps/s 1.2455 KOps/s $\color{#d91a1a}-0.94\%$
test_func_call_runtime[False-compile] 1.0879ms 0.9666ms 1.0346 KOps/s 1.0016 KOps/s $\color{#35bf28}+3.29\%$
test_func_call_runtime[False-compile-overhead] 0.6726ms 0.5120ms 1.9531 KOps/s 1.9121 KOps/s $\color{#35bf28}+2.14\%$
test_func_call_runtime[True-eager] 1.1599ms 1.0512ms 951.3009 Ops/s 946.9229 Ops/s $\color{#35bf28}+0.46\%$
test_func_call_runtime[True-compile] 1.1023ms 0.9916ms 1.0085 KOps/s 964.4991 Ops/s $\color{#35bf28}+4.56\%$
test_func_call_runtime[True-compile-overhead] 0.6011ms 0.5270ms 1.8976 KOps/s 1.8557 KOps/s $\color{#35bf28}+2.26\%$
test_func_call_cm_runtime[False-eager] 0.9198ms 0.8149ms 1.2272 KOps/s 1.1885 KOps/s $\color{#35bf28}+3.25\%$
test_func_call_cm_runtime[False-compile] 1.0171ms 0.9537ms 1.0485 KOps/s 987.9176 Ops/s $\textbf{\color{#35bf28}+6.14\%}$
test_func_call_cm_runtime[False-compile-overhead] 0.6286ms 0.4933ms 2.0270 KOps/s 1.9895 KOps/s $\color{#35bf28}+1.88\%$
test_func_call_cm_runtime[True-eager] 1.3257ms 1.1957ms 836.3462 Ops/s 832.4607 Ops/s $\color{#35bf28}+0.47\%$
test_func_call_cm_runtime[True-compile] 1.1051ms 1.0012ms 998.7635 Ops/s 935.7973 Ops/s $\textbf{\color{#35bf28}+6.73\%}$
test_func_call_cm_runtime[True-compile-overhead] 0.6486ms 0.5427ms 1.8426 KOps/s 1.8078 KOps/s $\color{#35bf28}+1.93\%$
test_vmap_func_call_cm_runtime[eager] 2.8838ms 2.3871ms 418.9183 Ops/s 415.4170 Ops/s $\color{#35bf28}+0.84\%$
test_vmap_func_call_cm_runtime[compile] 1.1656ms 1.0162ms 984.0466 Ops/s 958.9488 Ops/s $\color{#35bf28}+2.62\%$
test_vmap_func_call_cm_runtime[compile-overhead] 0.5906ms 0.5356ms 1.8672 KOps/s 1.8280 KOps/s $\color{#35bf28}+2.15\%$
test_distributed 0.6627ms 0.1472ms 6.7912 KOps/s 6.5861 KOps/s $\color{#35bf28}+3.11\%$
test_tdmodule 0.4777ms 0.1924ms 5.1981 KOps/s 5.0700 KOps/s $\color{#35bf28}+2.53\%$
test_tdmodule_dispatch 0.4121ms 0.3713ms 2.6932 KOps/s 2.6323 KOps/s $\color{#35bf28}+2.32\%$
test_tdseq 63.2520μs 26.8224μs 37.2822 KOps/s 37.3325 KOps/s $\color{#d91a1a}-0.13\%$
test_tdseq_dispatch 0.2913ms 0.2158ms 4.6345 KOps/s 4.6090 KOps/s $\color{#35bf28}+0.55\%$
test_instantiation_functorch 2.1494ms 2.0587ms 485.7483 Ops/s 479.3258 Ops/s $\color{#35bf28}+1.34\%$
test_exec_functorch 0.2385ms 0.1818ms 5.5010 KOps/s 5.4805 KOps/s $\color{#35bf28}+0.37\%$
test_exec_functional_call 0.2279ms 0.1611ms 6.2066 KOps/s 6.1677 KOps/s $\color{#35bf28}+0.63\%$
test_exec_td_decorator 0.4577ms 0.2386ms 4.1907 KOps/s 4.1848 KOps/s $\color{#35bf28}+0.14\%$
test_vmap_mlp_speed_decorator[True-True] 1.2129ms 1.0129ms 987.2954 Ops/s 976.1951 Ops/s $\color{#35bf28}+1.14\%$
test_vmap_mlp_speed_decorator[True-False] 1.2322ms 1.0091ms 990.9755 Ops/s 982.2638 Ops/s $\color{#35bf28}+0.89\%$
test_vmap_mlp_speed_decorator[False-True] 0.9228ms 0.7121ms 1.4044 KOps/s 1.3856 KOps/s $\color{#35bf28}+1.36\%$
test_vmap_mlp_speed_decorator[False-False] 0.9264ms 0.7112ms 1.4061 KOps/s 1.3878 KOps/s $\color{#35bf28}+1.31\%$
test_vmap_transformer_speed_decorator[True-True] 21.7200ms 20.8229ms 48.0239 Ops/s 47.4472 Ops/s $\color{#35bf28}+1.22\%$
test_vmap_transformer_speed_decorator[True-False] 21.6032ms 20.8190ms 48.0331 Ops/s 47.4263 Ops/s $\color{#35bf28}+1.28\%$
test_vmap_transformer_speed_decorator[False-True] 20.9463ms 20.4554ms 48.8869 Ops/s 48.2233 Ops/s $\color{#35bf28}+1.38\%$
test_vmap_transformer_speed_decorator[False-False] 20.5535ms 20.4014ms 49.0163 Ops/s 48.3128 Ops/s $\color{#35bf28}+1.46\%$
test_to_module_speed[True] 1.6493ms 1.4754ms 677.7662 Ops/s 668.8917 Ops/s $\color{#35bf28}+1.33\%$
test_to_module_speed[False] 1.5381ms 1.4406ms 694.1315 Ops/s 684.1732 Ops/s $\color{#35bf28}+1.46\%$
test_tc_init 88.8320μs 42.7456μs 23.3942 KOps/s 22.5549 KOps/s $\color{#35bf28}+3.72\%$
test_tc_init_tensor_only 36.4610μs 8.9139μs 112.1845 KOps/s 110.9352 KOps/s $\color{#35bf28}+1.13\%$
test_tc_init_nested 0.1226ms 86.2346μs 11.5963 KOps/s 11.5067 KOps/s $\color{#35bf28}+0.78\%$
test_tc_init_many_fields 38.8310μs 14.8595μs 67.2971 KOps/s 68.0243 KOps/s $\color{#d91a1a}-1.07\%$
test_tc_first_layer_tensor 17.0600μs 1.8230μs 548.5598 KOps/s 545.8173 KOps/s $\color{#35bf28}+0.50\%$
test_tc_first_layer_tensor_only 4.0611μs 0.4040μs 2.4754 MOps/s 2.5262 MOps/s $\color{#d91a1a}-2.01\%$
test_tc_first_layer_tensor_set 26.7510μs 3.8996μs 256.4346 KOps/s 254.8374 KOps/s $\color{#35bf28}+0.63\%$
test_tc_first_layer_tensor_only_set 19.0000μs 3.2818μs 304.7126 KOps/s 305.8410 KOps/s $\color{#d91a1a}-0.37\%$
test_tc_first_layer_nontensor 33.7810μs 6.1468μs 162.6874 KOps/s 156.9097 KOps/s $\color{#35bf28}+3.68\%$
test_tc_second_layer_tensor 25.0510μs 4.4460μs 224.9233 KOps/s 225.3650 KOps/s $\color{#d91a1a}-0.20\%$
test_tc_second_layer_nontensor 31.7010μs 8.6823μs 115.1774 KOps/s 112.4460 KOps/s $\color{#35bf28}+2.43\%$
test_unbind 0.2827s 13.1744ms 75.9045 Ops/s 63.8970 Ops/s $\textbf{\color{#35bf28}+18.79\%}$
test_full_like 4.7277ms 4.3939ms 227.5881 Ops/s 224.9215 Ops/s $\color{#35bf28}+1.19\%$
test_zeros_like 4.6154ms 4.4069ms 226.9161 Ops/s 226.1545 Ops/s $\color{#35bf28}+0.34\%$
test_ones_like 4.6026ms 4.4245ms 226.0159 Ops/s 225.3068 Ops/s $\color{#35bf28}+0.31\%$
test_clone 7.3570ms 6.8641ms 145.6850 Ops/s 147.9257 Ops/s $\color{#d91a1a}-1.51\%$
test_squeeze 0.1795ms 13.9988μs 71.4348 KOps/s 70.3787 KOps/s $\color{#35bf28}+1.50\%$
test_unsqueeze 0.1619ms 0.1147ms 8.7174 KOps/s 8.6556 KOps/s $\color{#35bf28}+0.71\%$
test_split 0.2478ms 0.1785ms 5.6029 KOps/s 5.4570 KOps/s $\color{#35bf28}+2.67\%$
test_permute 0.2620ms 0.2103ms 4.7553 KOps/s 4.6688 KOps/s $\color{#35bf28}+1.85\%$
test_stack 53.3704ms 52.6694ms 18.9864 Ops/s 36.5077 Ops/s $\textbf{\color{#d91a1a}-47.99\%}$
test_cat 53.2726ms 52.7304ms 18.9644 Ops/s 27.9376 Ops/s $\textbf{\color{#d91a1a}-32.12\%}$
test_sequential_tensordict 0.7055ms 0.5835ms 1.7137 KOps/s 1.7056 KOps/s $\color{#35bf28}+0.48\%$
test_sequential_graph_module 0.1866ms 0.1248ms 8.0140 KOps/s 7.9528 KOps/s $\color{#35bf28}+0.77\%$
test_nested_tensordict 1.1010ms 0.8343ms 1.1986 KOps/s 1.2086 KOps/s $\color{#d91a1a}-0.83\%$
test_nested_graph_module 0.2040ms 0.1356ms 7.3749 KOps/s 7.5297 KOps/s $\color{#d91a1a}-2.06\%$

@vmoens vmoens mentioned this pull request May 21, 2026
Closed
4 tasks
vmoens added a commit that referenced this pull request May 21, 2026
@vmoens @coreyjadams
[BugFix] Attempting to make tensordict device transfer marking thread…
aeec6ca 
… safe [Duplicate] (#1711)

Co-authored-by: Corey Adams <6619961+coreyjadams@users.noreply.github.com>
This was referenced May 27, 2026
Merged
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

bug Something isn't working CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Compile torch.compile related Test

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@vmoens @coreyjadams