Skip to content

[CI] Pin MACOSX_DEPLOYMENT_TARGET for nightly macOS wheels - #1723

Merged
vmoens merged 1 commit into
mainfrom
fix-nightly-macos-deployment-target
Jun 12, 2026
Merged

[CI] Pin MACOSX_DEPLOYMENT_TARGET for nightly macOS wheels#1723
vmoens merged 1 commit into
mainfrom
fix-nightly-macos-deployment-target

Conversation

@vmoens

@vmoens vmoens commented Jun 12, 2026

Copy link
Copy Markdown
Collaborator

Description

The nightly macOS wheels are built on macos-latest runners without MACOSX_DEPLOYMENT_TARGET, so the wheel tag inherits the runner's OS version: tensordict-nightly 2026.6.11 ships only macosx_15_0_universal2 wheels, and no sdist is published as a fallback. The result is that nightlies cannot be installed on macOS 14 or older (torchrl-nightly, by contrast, tags macosx_10_13_universal2).

This pins MACOSX_DEPLOYMENT_TARGET=11.0 (the arm64 floor, matching the universal2 tag) on the nightly build step so wheels install on any Apple-silicon-capable macOS.

🤖 Generated with Claude Code

macos-latest runners tag the wheel with the host OS version
(macosx_15_0_universal2), making nightlies uninstallable on macOS <= 14
since no sdist is published. Target macOS 11, the arm64 floor.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jun 12, 2026
@github-actions github-actions Bot added the CI label Jun 12, 2026
@github-actions

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large&amp;#x26A0;\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 344. Improved: $\large\color{#35bf28}24$. Worsened: $\large\color{#d91a1a}6$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_collector_preallocated_write[stack_out-cpu-32-2] 0.6056ms 0.1721ms 5.8108 KOps/s 5.8646 KOps/s $\color{#d91a1a}-0.92\%$
test_collector_preallocated_write[stack_out-cpu-32-8] 0.3822ms 0.2961ms 3.3773 KOps/s 3.3347 KOps/s $\color{#35bf28}+1.28\%$
test_collector_preallocated_write[stack_out-cpu-32-32] 1.2101ms 0.7789ms 1.2839 KOps/s 1.2719 KOps/s $\color{#35bf28}+0.94\%$
test_collector_preallocated_write[stack_out-cpu-4096-2] 0.3951ms 0.3413ms 2.9300 KOps/s 2.8398 KOps/s $\color{#35bf28}+3.18\%$
test_collector_preallocated_write[stack_out-cpu-4096-8] 1.3554ms 1.1801ms 847.3886 Ops/s 897.5771 Ops/s $\textbf{\color{#d91a1a}-5.59\%}$
test_collector_preallocated_write[stack_out-cpu-4096-32] 7.8265ms 7.4767ms 133.7494 Ops/s 133.6236 Ops/s $\color{#35bf28}+0.09\%$
test_collector_preallocated_write[stack_out-cuda-32-2] 0.3003ms 0.2543ms 3.9318 KOps/s 3.9424 KOps/s $\color{#d91a1a}-0.27\%$
test_collector_preallocated_write[stack_out-cuda-32-8] 0.8104ms 0.3761ms 2.6587 KOps/s 2.6286 KOps/s $\color{#35bf28}+1.14\%$
test_collector_preallocated_write[stack_out-cuda-32-32] 1.2733ms 0.8272ms 1.2089 KOps/s 1.2060 KOps/s $\color{#35bf28}+0.25\%$
test_collector_preallocated_write[stack_out-cuda-4096-2] 0.7010ms 0.2565ms 3.8990 KOps/s 3.8622 KOps/s $\color{#35bf28}+0.95\%$
test_collector_preallocated_write[stack_out-cuda-4096-8] 0.4404ms 0.3776ms 2.6482 KOps/s 2.6884 KOps/s $\color{#d91a1a}-1.50\%$
test_collector_preallocated_write[stack_out-cuda-4096-32] 1.3168ms 0.8844ms 1.1307 KOps/s 1.1282 KOps/s $\color{#35bf28}+0.22\%$
test_collector_preallocated_write[set_at_loop-cpu-32-2] 0.6456ms 0.2199ms 4.5485 KOps/s 4.6675 KOps/s $\color{#d91a1a}-2.55\%$
test_collector_preallocated_write[set_at_loop-cpu-32-8] 1.2803ms 0.8487ms 1.1783 KOps/s 1.1779 KOps/s $\color{#35bf28}+0.04\%$
test_collector_preallocated_write[set_at_loop-cpu-32-32] 3.8040ms 3.3954ms 294.5173 Ops/s 296.2901 Ops/s $\color{#d91a1a}-0.60\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-2] 0.7022ms 0.3765ms 2.6563 KOps/s 2.3885 KOps/s $\textbf{\color{#35bf28}+11.21\%}$
test_collector_preallocated_write[set_at_loop-cpu-4096-8] 2.0449ms 1.8148ms 551.0106 Ops/s 591.7951 Ops/s $\textbf{\color{#d91a1a}-6.89\%}$
test_collector_preallocated_write[set_at_loop-cpu-4096-32] 11.1510ms 10.7256ms 93.2344 Ops/s 95.3239 Ops/s $\color{#d91a1a}-2.19\%$
test_collector_preallocated_write[set_at_loop-cuda-32-2] 0.4452ms 0.4033ms 2.4793 KOps/s 2.4420 KOps/s $\color{#35bf28}+1.53\%$
test_collector_preallocated_write[set_at_loop-cuda-32-8] 1.6690ms 1.5046ms 664.6286 Ops/s 666.2243 Ops/s $\color{#d91a1a}-0.24\%$
test_collector_preallocated_write[set_at_loop-cuda-32-32] 6.0571ms 5.8978ms 169.5559 Ops/s 168.9265 Ops/s $\color{#35bf28}+0.37\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-2] 0.4889ms 0.4035ms 2.4781 KOps/s 2.3766 KOps/s $\color{#35bf28}+4.27\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-8] 1.7181ms 1.5049ms 664.4810 Ops/s 627.6852 Ops/s $\textbf{\color{#35bf28}+5.86\%}$
test_collector_preallocated_write[set_at_loop-cuda-4096-32] 6.1575ms 5.9149ms 169.0656 Ops/s 161.4491 Ops/s $\color{#35bf28}+4.72\%$
test_collector_preallocated_write[copy_at-cpu-32-2] 0.5888ms 0.1756ms 5.6935 KOps/s 5.7352 KOps/s $\color{#d91a1a}-0.73\%$
test_collector_preallocated_write[copy_at-cpu-32-8] 0.8144ms 0.6853ms 1.4593 KOps/s 1.4589 KOps/s $\color{#35bf28}+0.03\%$
test_collector_preallocated_write[copy_at-cpu-32-32] 3.2239ms 2.7264ms 366.7875 Ops/s 367.7716 Ops/s $\color{#d91a1a}-0.27\%$
test_collector_preallocated_write[copy_at-cpu-4096-2] 0.3830ms 0.3143ms 3.1820 KOps/s 3.0020 KOps/s $\textbf{\color{#35bf28}+6.00\%}$
test_collector_preallocated_write[copy_at-cpu-4096-8] 1.8300ms 1.5279ms 654.4756 Ops/s 687.1608 Ops/s $\color{#d91a1a}-4.76\%$
test_collector_preallocated_write[copy_at-cpu-4096-32] 10.2186ms 9.8665ms 101.3530 Ops/s 103.2047 Ops/s $\color{#d91a1a}-1.79\%$
test_collector_preallocated_write[copy_at-cuda-32-2] 0.4197ms 0.3319ms 3.0132 KOps/s 3.0167 KOps/s $\color{#d91a1a}-0.12\%$
test_collector_preallocated_write[copy_at-cuda-32-8] 1.4053ms 1.2448ms 803.3104 Ops/s 816.6911 Ops/s $\color{#d91a1a}-1.64\%$
test_collector_preallocated_write[copy_at-cuda-32-32] 5.0881ms 4.8567ms 205.9014 Ops/s 208.8379 Ops/s $\color{#d91a1a}-1.41\%$
test_collector_preallocated_write[copy_at-cuda-4096-2] 0.4166ms 0.3324ms 3.0088 KOps/s 3.0155 KOps/s $\color{#d91a1a}-0.22\%$
test_collector_preallocated_write[copy_at-cuda-4096-8] 1.4032ms 1.2423ms 804.9325 Ops/s 812.8039 Ops/s $\color{#d91a1a}-0.97\%$
test_collector_preallocated_write[copy_at-cuda-4096-32] 5.0152ms 4.8732ms 205.2031 Ops/s 208.3938 Ops/s $\color{#d91a1a}-1.53\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-2] 0.1696ms 0.1252ms 7.9840 KOps/s 8.2873 KOps/s $\color{#d91a1a}-3.66\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-8] 0.6038ms 0.4896ms 2.0425 KOps/s 2.1222 KOps/s $\color{#d91a1a}-3.76\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-32] 2.0369ms 1.9465ms 513.7363 Ops/s 533.6546 Ops/s $\color{#d91a1a}-3.73\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-2] 0.3650ms 0.2698ms 3.7060 KOps/s 3.8304 KOps/s $\color{#d91a1a}-3.25\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-8] 1.5212ms 1.3662ms 731.9349 Ops/s 769.9020 Ops/s $\color{#d91a1a}-4.93\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-32] 9.1988ms 8.6891ms 115.0869 Ops/s 115.5290 Ops/s $\color{#d91a1a}-0.38\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-2] 0.7098ms 0.2869ms 3.4855 KOps/s 3.5856 KOps/s $\color{#d91a1a}-2.79\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-8] 1.4914ms 1.0753ms 929.9888 Ops/s 961.8293 Ops/s $\color{#d91a1a}-3.31\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-32] 4.6655ms 4.2107ms 237.4885 Ops/s 246.6844 Ops/s $\color{#d91a1a}-3.73\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-2] 0.7339ms 0.2867ms 3.4878 KOps/s 3.5796 KOps/s $\color{#d91a1a}-2.56\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-8] 1.4983ms 1.0729ms 932.0319 Ops/s 960.1113 Ops/s $\color{#d91a1a}-2.92\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-32] 4.6347ms 4.2151ms 237.2403 Ops/s 244.9122 Ops/s $\color{#d91a1a}-3.13\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-128] 16.6036ms 16.2575ms 61.5099 Ops/s 60.9820 Ops/s $\color{#35bf28}+0.87\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-256] 33.2637ms 32.7735ms 30.5125 Ops/s 30.4015 Ops/s $\color{#35bf28}+0.36\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-128] 88.0162ms 87.6789ms 11.4052 Ops/s 11.7123 Ops/s $\color{#d91a1a}-2.62\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-256] 0.2039s 0.2030s 4.9250 Ops/s 5.0406 Ops/s $\color{#d91a1a}-2.29\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-128] 14.2304ms 13.7514ms 72.7200 Ops/s 72.4613 Ops/s $\color{#35bf28}+0.36\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-256] 27.4471ms 27.1682ms 36.8077 Ops/s 37.1230 Ops/s $\color{#d91a1a}-0.85\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-128] 14.3947ms 13.9780ms 71.5412 Ops/s 71.7311 Ops/s $\color{#d91a1a}-0.26\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-256] 36.1577ms 27.7627ms 36.0195 Ops/s 36.2078 Ops/s $\color{#d91a1a}-0.52\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-128] 53.4220ms 52.7897ms 18.9431 Ops/s 19.1322 Ops/s $\color{#d91a1a}-0.99\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-256] 0.1073s 0.1070s 9.3475 Ops/s 9.5061 Ops/s $\color{#d91a1a}-1.67\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-128] 0.1526s 0.1515s 6.6028 Ops/s 6.7617 Ops/s $\color{#d91a1a}-2.35\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-256] 0.3348s 0.3337s 2.9967 Ops/s 3.1298 Ops/s $\color{#d91a1a}-4.25\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-128] 76.9040ms 76.0778ms 13.1444 Ops/s 12.9200 Ops/s $\color{#35bf28}+1.74\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-256] 0.1573s 0.1530s 6.5372 Ops/s 6.2065 Ops/s $\textbf{\color{#35bf28}+5.33\%}$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-128] 80.4122ms 78.3907ms 12.7566 Ops/s 12.4439 Ops/s $\color{#35bf28}+2.51\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-256] 0.1542s 0.1535s 6.5139 Ops/s 6.1763 Ops/s $\textbf{\color{#35bf28}+5.46\%}$
test_wide_nested_preallocated_write[copy_at-cpu-128-128] 31.4145ms 30.6557ms 32.6204 Ops/s 32.6342 Ops/s $\color{#d91a1a}-0.04\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-256] 62.7808ms 62.3202ms 16.0462 Ops/s 16.1963 Ops/s $\color{#d91a1a}-0.93\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-128] 0.1215s 0.1210s 8.2652 Ops/s 8.0906 Ops/s $\color{#35bf28}+2.16\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-256] 0.2700s 0.2695s 3.7106 Ops/s 3.6920 Ops/s $\color{#35bf28}+0.50\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-128] 44.6597ms 44.2829ms 22.5821 Ops/s 23.1103 Ops/s $\color{#d91a1a}-2.29\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-256] 89.3178ms 88.9819ms 11.2382 Ops/s 11.5422 Ops/s $\color{#d91a1a}-2.63\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-128] 44.7333ms 44.4982ms 22.4728 Ops/s 22.9478 Ops/s $\color{#d91a1a}-2.07\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-256] 89.5237ms 89.0401ms 11.2309 Ops/s 11.4728 Ops/s $\color{#d91a1a}-2.11\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-128] 21.5559ms 21.1274ms 47.3319 Ops/s 48.6270 Ops/s $\color{#d91a1a}-2.66\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-256] 43.3084ms 43.0224ms 23.2437 Ops/s 23.7673 Ops/s $\color{#d91a1a}-2.20\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-128] 0.1139s 0.1118s 8.9469 Ops/s 9.1855 Ops/s $\color{#d91a1a}-2.60\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-256] 0.2526s 0.2503s 3.9950 Ops/s 4.0421 Ops/s $\color{#d91a1a}-1.16\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-128] 38.5984ms 38.3889ms 26.0492 Ops/s 27.0440 Ops/s $\color{#d91a1a}-3.68\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-256] 77.2094ms 76.0861ms 13.1430 Ops/s 13.5930 Ops/s $\color{#d91a1a}-3.31\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-128] 38.6099ms 38.3540ms 26.0729 Ops/s 27.0184 Ops/s $\color{#d91a1a}-3.50\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-256] 77.0456ms 76.5992ms 13.0550 Ops/s 13.4543 Ops/s $\color{#d91a1a}-2.97\%$
test_plain_set_nested 0.4308ms 15.7240μs 63.5970 KOps/s 65.2757 KOps/s $\color{#d91a1a}-2.57\%$
test_plain_set_stack_nested 58.2730μs 15.4535μs 64.7101 KOps/s 66.6877 KOps/s $\color{#d91a1a}-2.97\%$
test_plain_set_nested_inplace 0.4259ms 17.0682μs 58.5884 KOps/s 59.2507 KOps/s $\color{#d91a1a}-1.12\%$
test_plain_set_stack_nested_inplace 46.1230μs 16.9112μs 59.1323 KOps/s 60.8025 KOps/s $\color{#d91a1a}-2.75\%$
test_items 0.4197ms 6.0485μs 165.3294 KOps/s 164.8407 KOps/s $\color{#35bf28}+0.30\%$
test_items_nested 0.8807ms 0.4647ms 2.1519 KOps/s 2.1643 KOps/s $\color{#d91a1a}-0.57\%$
test_items_nested_locked 0.8876ms 0.4723ms 2.1173 KOps/s 2.1419 KOps/s $\color{#d91a1a}-1.15\%$
test_items_nested_leaf 0.5228ms 97.6644μs 10.2391 KOps/s 10.3058 KOps/s $\color{#d91a1a}-0.65\%$
test_items_stack_nested 0.8921ms 0.4687ms 2.1334 KOps/s 2.1627 KOps/s $\color{#d91a1a}-1.36\%$
test_items_stack_nested_leaf 0.5101ms 97.6096μs 10.2449 KOps/s 10.3986 KOps/s $\color{#d91a1a}-1.48\%$
test_items_stack_nested_locked 0.8886ms 0.4723ms 2.1172 KOps/s 2.1387 KOps/s $\color{#d91a1a}-1.01\%$
test_keys 0.4263ms 4.2105μs 237.5014 KOps/s 235.2839 KOps/s $\color{#35bf28}+0.94\%$
test_keys_nested 0.1761ms 0.1307ms 7.6491 KOps/s 7.6544 KOps/s $\color{#d91a1a}-0.07\%$
test_keys_nested_locked 2.1590ms 0.1402ms 7.1344 KOps/s 7.1906 KOps/s $\color{#d91a1a}-0.78\%$
test_keys_nested_leaf 0.5405ms 0.1213ms 8.2462 KOps/s 8.3163 KOps/s $\color{#d91a1a}-0.84\%$
test_keys_stack_nested 0.5524ms 0.1303ms 7.6775 KOps/s 7.6850 KOps/s $\color{#d91a1a}-0.10\%$
test_keys_stack_nested_leaf 0.5494ms 0.1188ms 8.4171 KOps/s 8.3251 KOps/s $\color{#35bf28}+1.10\%$
test_keys_stack_nested_locked 0.2124ms 0.1374ms 7.2805 KOps/s 7.2013 KOps/s $\color{#35bf28}+1.10\%$
test_values 6.2284μs 1.0266μs 974.0857 KOps/s 968.6990 KOps/s $\color{#35bf28}+0.56\%$
test_values_nested 88.4960μs 53.1357μs 18.8197 KOps/s 18.8148 KOps/s $\color{#35bf28}+0.03\%$
test_values_nested_locked 93.4150μs 56.2499μs 17.7778 KOps/s 17.8782 KOps/s $\color{#d91a1a}-0.56\%$
test_values_nested_leaf 0.1008ms 60.5646μs 16.5113 KOps/s 16.6419 KOps/s $\color{#d91a1a}-0.79\%$
test_values_stack_nested 89.8050μs 52.6644μs 18.9882 KOps/s 19.0808 KOps/s $\color{#d91a1a}-0.49\%$
test_values_stack_nested_leaf 86.5950μs 59.9953μs 16.6680 KOps/s 16.7510 KOps/s $\color{#d91a1a}-0.50\%$
test_values_stack_nested_locked 90.1760μs 55.8420μs 17.9077 KOps/s 17.9574 KOps/s $\color{#d91a1a}-0.28\%$
test_membership 5.7670μs 0.8455μs 1.1827 MOps/s 1.1926 MOps/s $\color{#d91a1a}-0.83\%$
test_membership_nested 27.7020μs 2.9792μs 335.6595 KOps/s 334.9929 KOps/s $\color{#35bf28}+0.20\%$
test_membership_nested_leaf 31.4420μs 3.0094μs 332.2902 KOps/s 334.7483 KOps/s $\color{#d91a1a}-0.73\%$
test_membership_stacked_nested 32.7520μs 2.8710μs 348.3071 KOps/s 344.1487 KOps/s $\color{#35bf28}+1.21\%$
test_membership_stacked_nested_leaf 28.4720μs 2.9143μs 343.1301 KOps/s 347.3181 KOps/s $\color{#d91a1a}-1.21\%$
test_membership_nested_last 25.2420μs 4.5290μs 220.7998 KOps/s 222.2218 KOps/s $\color{#d91a1a}-0.64\%$
test_membership_nested_leaf_last 37.8620μs 4.5654μs 219.0411 KOps/s 222.8210 KOps/s $\color{#d91a1a}-1.70\%$
test_membership_stacked_nested_last 33.8820μs 4.4134μs 226.5844 KOps/s 230.5143 KOps/s $\color{#d91a1a}-1.70\%$
test_membership_stacked_nested_leaf_last 48.7330μs 4.3953μs 227.5180 KOps/s 229.0334 KOps/s $\color{#d91a1a}-0.66\%$
test_nested_getleaf 48.5630μs 21.8976μs 45.6670 KOps/s 46.2180 KOps/s $\color{#d91a1a}-1.19\%$
test_nested_get 46.8430μs 20.7859μs 48.1095 KOps/s 48.1979 KOps/s $\color{#d91a1a}-0.18\%$
test_stacked_getleaf 47.6620μs 21.7016μs 46.0795 KOps/s 46.1784 KOps/s $\color{#d91a1a}-0.21\%$
test_stacked_get 46.0430μs 20.5994μs 48.5451 KOps/s 47.5164 KOps/s $\color{#35bf28}+2.16\%$
test_nested_getitemleaf 46.1730μs 22.4480μs 44.5473 KOps/s 44.2392 KOps/s $\color{#35bf28}+0.70\%$
test_nested_getitem 47.7830μs 21.2370μs 47.0877 KOps/s 47.1511 KOps/s $\color{#d91a1a}-0.13\%$
test_stacked_getitemleaf 59.9440μs 22.1668μs 45.1126 KOps/s 45.0421 KOps/s $\color{#35bf28}+0.16\%$
test_stacked_getitem 43.5820μs 21.2655μs 47.0245 KOps/s 46.9475 KOps/s $\color{#35bf28}+0.16\%$
test_lock_nested 0.5851ms 0.5058ms 1.9771 KOps/s 1.9740 KOps/s $\color{#35bf28}+0.16\%$
test_lock_stack_nested 0.5900ms 0.5134ms 1.9480 KOps/s 1.9726 KOps/s $\color{#d91a1a}-1.25\%$
test_unlock_nested 0.4818ms 0.4023ms 2.4856 KOps/s 2.5246 KOps/s $\color{#d91a1a}-1.54\%$
test_unlock_stack_nested 0.5385ms 0.4079ms 2.4516 KOps/s 2.4964 KOps/s $\color{#d91a1a}-1.79\%$
test_flatten_speed 0.2577ms 0.1219ms 8.2005 KOps/s 8.1074 KOps/s $\color{#35bf28}+1.15\%$
test_unflatten_speed 0.6663ms 0.5726ms 1.7463 KOps/s 1.7280 KOps/s $\color{#35bf28}+1.06\%$
test_common_ops 0.1002s 1.6256ms 615.1414 Ops/s 212.7362 Ops/s $\textbf{\color{#35bf28}+189.16\%}$
test_creation 0.1030ms 3.1963μs 312.8605 KOps/s 315.9603 KOps/s $\color{#d91a1a}-0.98\%$
test_creation_empty 30.2820μs 7.0696μs 141.4512 KOps/s 141.8237 KOps/s $\color{#d91a1a}-0.26\%$
test_creation_nested_1 39.5220μs 11.5656μs 86.4630 KOps/s 86.7964 KOps/s $\color{#d91a1a}-0.38\%$
test_creation_nested_2 37.3320μs 13.7793μs 72.5729 KOps/s 73.2151 KOps/s $\color{#d91a1a}-0.88\%$
test_creation_many_keys[10] 44.6930μs 21.3972μs 46.7351 KOps/s 47.4327 KOps/s $\color{#d91a1a}-1.47\%$
test_creation_many_keys[50] 0.1304ms 91.2577μs 10.9580 KOps/s 10.9550 KOps/s $\color{#35bf28}+0.03\%$
test_creation_many_keys[100] 0.2389ms 0.1809ms 5.5269 KOps/s 5.5658 KOps/s $\color{#d91a1a}-0.70\%$
test_creation_nested_many_keys[10] 79.5650μs 45.3248μs 22.0630 KOps/s 21.7319 KOps/s $\color{#35bf28}+1.52\%$
test_creation_nested_many_keys[50] 0.2568ms 0.1853ms 5.3970 KOps/s 5.3226 KOps/s $\color{#35bf28}+1.40\%$
test_clone 39.2530μs 13.5976μs 73.5422 KOps/s 72.8417 KOps/s $\color{#35bf28}+0.96\%$
test_getitem[int] 1.5011ms 15.4747μs 64.6217 KOps/s 65.0062 KOps/s $\color{#d91a1a}-0.59\%$
test_getitem[slice_int] 0.1412ms 25.4927μs 39.2269 KOps/s 40.1492 KOps/s $\color{#d91a1a}-2.30\%$
test_getitem[range] 0.1797ms 64.7492μs 15.4442 KOps/s 15.2516 KOps/s $\color{#35bf28}+1.26\%$
test_getitem[tuple] 0.1599ms 25.4963μs 39.2213 KOps/s 40.8999 KOps/s $\color{#d91a1a}-4.10\%$
test_getitem[list] 0.1844ms 59.0765μs 16.9272 KOps/s 16.0875 KOps/s $\textbf{\color{#35bf28}+5.22\%}$
test_setitem_dim[int] 46.8220μs 26.5973μs 37.5977 KOps/s 35.5298 KOps/s $\textbf{\color{#35bf28}+5.82\%}$
test_setitem_dim[slice_int] 63.9640μs 43.2919μs 23.0990 KOps/s 22.1562 KOps/s $\color{#35bf28}+4.26\%$
test_setitem_dim[range] 0.1258ms 96.7166μs 10.3395 KOps/s 9.8171 KOps/s $\textbf{\color{#35bf28}+5.32\%}$
test_setitem_dim[tuple] 62.6440μs 40.2860μs 24.8225 KOps/s 25.1877 KOps/s $\color{#d91a1a}-1.45\%$
test_setitem 52.9040μs 18.0868μs 55.2889 KOps/s 52.6181 KOps/s $\textbf{\color{#35bf28}+5.08\%}$
test_set 46.8530μs 17.3165μs 57.7483 KOps/s 57.2789 KOps/s $\color{#35bf28}+0.82\%$
test_set_shared 0.5073ms 0.2105ms 4.7506 KOps/s 4.6707 KOps/s $\color{#35bf28}+1.71\%$
test_update 0.2066ms 22.1557μs 45.1352 KOps/s 44.9761 KOps/s $\color{#35bf28}+0.35\%$
test_update_nested 77.4850μs 33.6922μs 29.6805 KOps/s 29.1803 KOps/s $\color{#35bf28}+1.71\%$
test_update__nested 0.5301ms 33.1846μs 30.1344 KOps/s 29.7373 KOps/s $\color{#35bf28}+1.34\%$
test_set_nested 49.9830μs 19.3637μs 51.6429 KOps/s 50.0573 KOps/s $\color{#35bf28}+3.17\%$
test_set_nested_new 53.7830μs 24.3033μs 41.1467 KOps/s 40.8834 KOps/s $\color{#35bf28}+0.64\%$
test_select 0.1147ms 40.3115μs 24.8068 KOps/s 23.4205 KOps/s $\textbf{\color{#35bf28}+5.92\%}$
test_select_nested 0.1010ms 75.8116μs 13.1906 KOps/s 13.3792 KOps/s $\color{#d91a1a}-1.41\%$
test_exclude_nested 0.1259ms 92.6811μs 10.7897 KOps/s 10.8537 KOps/s $\color{#d91a1a}-0.59\%$
test_empty[True] 0.4602ms 0.4028ms 2.4824 KOps/s 2.5039 KOps/s $\color{#d91a1a}-0.86\%$
test_empty[False] 8.1605μs 1.3925μs 718.1315 KOps/s 723.2714 KOps/s $\color{#d91a1a}-0.71\%$
test_to 0.1427ms 70.3382μs 14.2170 KOps/s 14.3668 KOps/s $\color{#d91a1a}-1.04\%$
test_to_nonblocking 0.1091ms 69.8506μs 14.3163 KOps/s 14.1981 KOps/s $\color{#35bf28}+0.83\%$
test_unbind_speed 0.4358ms 0.3445ms 2.9027 KOps/s 2.9299 KOps/s $\color{#d91a1a}-0.93\%$
test_unbind_speed_stack0 0.3775ms 0.3387ms 2.9525 KOps/s 2.9734 KOps/s $\color{#d91a1a}-0.70\%$
test_unbind_speed_stack1 0.1156s 0.8613ms 1.1610 KOps/s 1.1604 KOps/s $\color{#35bf28}+0.05\%$
test_split 0.1138s 1.2911ms 774.5304 Ops/s 711.2393 Ops/s $\textbf{\color{#35bf28}+8.90\%}$
test_chunk 1.2450ms 1.0996ms 909.4472 Ops/s 916.2598 Ops/s $\color{#d91a1a}-0.74\%$
test_to_cpu_blocking 20.2931ms 19.9338ms 50.1660 Ops/s 50.5638 Ops/s $\color{#d91a1a}-0.79\%$
test_to_cpu_global_sync 12.1346ms 12.0124ms 83.2471 Ops/s 84.4807 Ops/s $\color{#d91a1a}-1.46\%$
test_to_cpu_event_sync 13.3807ms 12.9581ms 77.1719 Ops/s 77.8165 Ops/s $\color{#d91a1a}-0.83\%$
test_to_cpu_default 13.4750ms 12.9838ms 77.0192 Ops/s 69.4565 Ops/s $\textbf{\color{#35bf28}+10.89\%}$
test_consolidate[False-None] 4.3589ms 4.2494ms 235.3255 Ops/s 237.9025 Ops/s $\color{#d91a1a}-1.08\%$
test_consolidate[default-None] 3.5907ms 2.2429ms 445.8521 Ops/s 460.2311 Ops/s $\color{#d91a1a}-3.12\%$
test_consolidate[reduce-overhead-None] 3.5486ms 2.1549ms 464.0524 Ops/s 470.1708 Ops/s $\color{#d91a1a}-1.30\%$
test_consolidate_njt[False-None] 8.6886ms 8.5165ms 117.4196 Ops/s 115.2528 Ops/s $\color{#35bf28}+1.88\%$
test_to[False-False-None] 2.2573ms 2.2087ms 452.7452 Ops/s 456.6872 Ops/s $\color{#d91a1a}-0.86\%$
test_to[True-False-None] 2.2483ms 1.9553ms 511.4203 Ops/s 516.6322 Ops/s $\color{#d91a1a}-1.01\%$
test_to[within-False-None] 6.5934ms 6.3032ms 158.6498 Ops/s 159.7788 Ops/s $\color{#d91a1a}-0.71\%$
test_to[True-default-None] 11.1920ms 10.6958ms 93.4951 Ops/s 92.4506 Ops/s $\color{#35bf28}+1.13\%$
test_to_njt[False-False-None] 8.9916ms 8.6522ms 115.5769 Ops/s 113.0857 Ops/s $\color{#35bf28}+2.20\%$
test_to_njt[True-False-None] 7.2476ms 6.9911ms 143.0391 Ops/s 141.7646 Ops/s $\color{#35bf28}+0.90\%$
test_to_njt[within-False-None] 15.7169ms 15.6386ms 63.9442 Ops/s 30.5136 Ops/s $\textbf{\color{#35bf28}+109.56\%}$
test_creation[device0] 0.3983ms 0.1214ms 8.2365 KOps/s 8.5189 KOps/s $\color{#d91a1a}-3.31\%$
test_creation_from_tensor 0.4115ms 0.1172ms 8.5317 KOps/s 8.7659 KOps/s $\color{#d91a1a}-2.67\%$
test_add_one[memmap_tensor0] 0.4063ms 6.8813μs 145.3209 KOps/s 146.2897 KOps/s $\color{#d91a1a}-0.66\%$
test_contiguous[memmap_tensor0] 24.3220μs 0.6608μs 1.5133 MOps/s 2.2156 MOps/s $\textbf{\color{#d91a1a}-31.70\%}$
test_stack[memmap_tensor0] 29.1410μs 4.4125μs 226.6265 KOps/s 234.1231 KOps/s $\color{#d91a1a}-3.20\%$
test_memmaptd_index 1.1613ms 0.2911ms 3.4352 KOps/s 3.6030 KOps/s $\color{#d91a1a}-4.66\%$
test_memmaptd_index_astensor 0.5553ms 0.3954ms 2.5294 KOps/s 2.6002 KOps/s $\color{#d91a1a}-2.72\%$
test_memmaptd_index_op 0.8110ms 0.6562ms 1.5239 KOps/s 1.5346 KOps/s $\color{#d91a1a}-0.69\%$
test_serialize_model 0.1371s 0.1344s 7.4419 Ops/s 7.4184 Ops/s $\color{#35bf28}+0.32\%$
test_serialize_model_pickle 1.3498s 1.2102s 0.8263 Ops/s 0.8262 Ops/s $\color{#35bf28}+0.01\%$
test_serialize_weights 0.1373s 0.1352s 7.3985 Ops/s 7.3868 Ops/s $\color{#35bf28}+0.16\%$
test_serialize_weights_returnearly 0.3049s 80.5232ms 12.4188 Ops/s 10.7733 Ops/s $\textbf{\color{#35bf28}+15.27\%}$
test_serialize_weights_pickle 1.3957s 1.2225s 0.8180 Ops/s 0.8171 Ops/s $\color{#35bf28}+0.11\%$
test_reshape_pytree 0.2046ms 33.1993μs 30.1211 KOps/s 30.9494 KOps/s $\color{#d91a1a}-2.68\%$
test_reshape_td 69.9840μs 45.5180μs 21.9693 KOps/s 22.1410 KOps/s $\color{#d91a1a}-0.78\%$
test_view_pytree 0.2215ms 32.8486μs 30.4427 KOps/s 30.9701 KOps/s $\color{#d91a1a}-1.70\%$
test_view_td 81.9250μs 56.1719μs 17.8025 KOps/s 18.3114 KOps/s $\color{#d91a1a}-2.78\%$
test_unbind_pytree 0.2105ms 37.6355μs 26.5707 KOps/s 26.9571 KOps/s $\color{#d91a1a}-1.43\%$
test_unbind_td 0.1794ms 51.8754μs 19.2769 KOps/s 19.9605 KOps/s $\color{#d91a1a}-3.42\%$
test_split_pytree 0.1999ms 44.3510μs 22.5474 KOps/s 23.1977 KOps/s $\color{#d91a1a}-2.80\%$
test_split_td 0.2050ms 66.5819μs 15.0191 KOps/s 15.4427 KOps/s $\color{#d91a1a}-2.74\%$
test_add_pytree 0.2277ms 43.1303μs 23.1856 KOps/s 23.3013 KOps/s $\color{#d91a1a}-0.50\%$
test_add_td 94.6260μs 56.0011μs 17.8568 KOps/s 17.3994 KOps/s $\color{#35bf28}+2.63\%$
test_compile_add_one_nested[tensordict-compile] 0.3518ms 0.2256ms 4.4320 KOps/s 4.2023 KOps/s $\textbf{\color{#35bf28}+5.47\%}$
test_compile_add_one_nested[tensordict-eager] 0.3184ms 0.2056ms 4.8643 KOps/s 4.9655 KOps/s $\color{#d91a1a}-2.04\%$
test_compile_add_one_nested[pytree-compile] 0.2829ms 0.1354ms 7.3870 KOps/s 7.0821 KOps/s $\color{#35bf28}+4.31\%$
test_compile_add_one_nested[pytree-eager] 0.4347ms 0.1830ms 5.4658 KOps/s 5.5000 KOps/s $\color{#d91a1a}-0.62\%$
test_compile_copy_nested[tensordict-compile] 0.1300ms 15.5068μs 64.4877 KOps/s 60.7823 KOps/s $\textbf{\color{#35bf28}+6.10\%}$
test_compile_copy_nested[tensordict-eager] 0.3551ms 52.9780μs 18.8758 KOps/s 18.3101 KOps/s $\color{#35bf28}+3.09\%$
test_compile_copy_nested[pytree-compile] 0.1250ms 15.7001μs 63.6940 KOps/s 61.4940 KOps/s $\color{#35bf28}+3.58\%$
test_compile_copy_nested[pytree-eager] 0.3863ms 67.5253μs 14.8093 KOps/s 14.4249 KOps/s $\color{#35bf28}+2.66\%$
test_compile_add_one_flat[tensordict-compile] 0.3120ms 0.2492ms 4.0123 KOps/s 3.8233 KOps/s $\color{#35bf28}+4.94\%$
test_compile_add_one_flat[tensordict-eager] 0.3416ms 0.2818ms 3.5482 KOps/s 3.5167 KOps/s $\color{#35bf28}+0.90\%$
test_compile_add_one_flat[tensorclass-compile] 0.3191ms 0.1870ms 5.3474 KOps/s 5.1789 KOps/s $\color{#35bf28}+3.25\%$
test_compile_add_one_flat[tensorclass-eager] 0.1763ms 75.8388μs 13.1859 KOps/s 13.2126 KOps/s $\color{#d91a1a}-0.20\%$
test_compile_add_one_flat[pytree-compile] 0.2986ms 0.1934ms 5.1697 KOps/s 5.0139 KOps/s $\color{#35bf28}+3.11\%$
test_compile_add_one_flat[pytree-eager] 0.8095ms 0.5395ms 1.8534 KOps/s 1.8977 KOps/s $\color{#d91a1a}-2.33\%$
test_compile_add_self_flat[tensordict-eager] 0.4228ms 0.3293ms 3.0363 KOps/s 2.9965 KOps/s $\color{#35bf28}+1.33\%$
test_compile_add_self_flat[tensordict-compile] 0.4962ms 0.2500ms 3.9998 KOps/s 3.5866 KOps/s $\textbf{\color{#35bf28}+11.52\%}$
test_compile_add_self_flat[tensorclass-eager] 0.1357ms 92.6708μs 10.7909 KOps/s 10.7914 KOps/s $-0.00\%$
test_compile_add_self_flat[tensorclass-compile] 0.2689ms 0.1874ms 5.3355 KOps/s 5.0069 KOps/s $\textbf{\color{#35bf28}+6.56\%}$
test_compile_add_self_flat[pytree-eager] 0.6485ms 0.4434ms 2.2553 KOps/s 2.2987 KOps/s $\color{#d91a1a}-1.89\%$
test_compile_add_self_flat[pytree-compile] 0.5498ms 0.1926ms 5.1933 KOps/s 5.0032 KOps/s $\color{#35bf28}+3.80\%$
test_compile_copy_flat[tensordict-compile] 56.7430μs 19.8131μs 50.4717 KOps/s 50.0319 KOps/s $\color{#35bf28}+0.88\%$
test_compile_copy_flat[tensordict-eager] 73.0240μs 41.1289μs 24.3138 KOps/s 23.9790 KOps/s $\color{#35bf28}+1.40\%$
test_compile_copy_flat[pytree-compile] 0.1451ms 21.7001μs 46.0828 KOps/s 45.2197 KOps/s $\color{#35bf28}+1.91\%$
test_compile_copy_flat[pytree-eager] 0.3320ms 52.3413μs 19.1054 KOps/s 19.1423 KOps/s $\color{#d91a1a}-0.19\%$
test_compile_assign_and_add[tensordict-compile] 2.2120ms 0.2401ms 4.1642 KOps/s 3.8008 KOps/s $\textbf{\color{#35bf28}+9.56\%}$
test_compile_assign_and_add[tensordict-eager] 3.5075ms 3.3372ms 299.6513 Ops/s 302.5248 Ops/s $\color{#d91a1a}-0.95\%$
test_compile_assign_and_add[pytree-compile] 2.1370ms 0.1810ms 5.5244 KOps/s 5.4179 KOps/s $\color{#35bf28}+1.96\%$
test_compile_assign_and_add[pytree-eager] 3.1007ms 2.8555ms 350.2018 Ops/s 358.4266 Ops/s $\color{#d91a1a}-2.29\%$
test_compile_indexing[tensor-tensordict-compile] 0.3428ms 0.1370ms 7.2968 KOps/s 7.2387 KOps/s $\color{#35bf28}+0.80\%$
test_compile_indexing[tensor-tensordict-eager] 0.3195ms 75.4090μs 13.2610 KOps/s 13.3108 KOps/s $\color{#d91a1a}-0.37\%$
test_compile_indexing[tensor-tensorclass-compile] 0.2143ms 0.1190ms 8.4032 KOps/s 8.3580 KOps/s $\color{#35bf28}+0.54\%$
test_compile_indexing[tensor-tensorclass-eager] 0.2717ms 48.9426μs 20.4321 KOps/s 22.0632 KOps/s $\textbf{\color{#d91a1a}-7.39\%}$
test_compile_indexing[tensor-pytree-compile] 0.1728ms 0.1201ms 8.3274 KOps/s 8.2677 KOps/s $\color{#35bf28}+0.72\%$
test_compile_indexing[tensor-pytree-eager] 0.2503ms 46.1434μs 21.6716 KOps/s 21.9887 KOps/s $\color{#d91a1a}-1.44\%$
test_compile_indexing[slice-tensordict-compile] 0.2035ms 86.6597μs 11.5394 KOps/s 11.7695 KOps/s $\color{#d91a1a}-1.95\%$
test_compile_indexing[slice-tensordict-eager] 0.2074ms 30.2722μs 33.0337 KOps/s 35.8733 KOps/s $\textbf{\color{#d91a1a}-7.92\%}$
test_compile_indexing[slice-tensorclass-compile] 0.1858ms 71.7135μs 13.9444 KOps/s 13.9522 KOps/s $\color{#d91a1a}-0.06\%$
test_compile_indexing[slice-tensorclass-eager] 0.2468ms 22.5578μs 44.3306 KOps/s 44.6995 KOps/s $\color{#d91a1a}-0.83\%$
test_compile_indexing[slice-pytree-compile] 0.1222ms 72.3340μs 13.8247 KOps/s 13.9489 KOps/s $\color{#d91a1a}-0.89\%$
test_compile_indexing[slice-pytree-eager] 0.2280ms 22.5620μs 44.3222 KOps/s 44.7887 KOps/s $\color{#d91a1a}-1.04\%$
test_compile_indexing[int-tensordict-compile] 0.1923ms 84.5267μs 11.8306 KOps/s 11.6079 KOps/s $\color{#35bf28}+1.92\%$
test_compile_indexing[int-tensordict-eager] 0.2823ms 28.9266μs 34.5702 KOps/s 35.6576 KOps/s $\color{#d91a1a}-3.05\%$
test_compile_indexing[int-tensorclass-compile] 0.1203ms 72.4926μs 13.7945 KOps/s 13.8003 KOps/s $\color{#d91a1a}-0.04\%$
test_compile_indexing[int-tensorclass-eager] 0.2419ms 22.5620μs 44.3223 KOps/s 44.2489 KOps/s $\color{#35bf28}+0.17\%$
test_compile_indexing[int-pytree-compile] 0.1176ms 71.8480μs 13.9183 KOps/s 13.9574 KOps/s $\color{#d91a1a}-0.28\%$
test_compile_indexing[int-pytree-eager] 0.2377ms 22.5326μs 44.3801 KOps/s 44.5090 KOps/s $\color{#d91a1a}-0.29\%$
test_compile_replace[single-eager] 94.3960μs 48.3589μs 20.6787 KOps/s 21.0640 KOps/s $\color{#d91a1a}-1.83\%$
test_compile_replace[single-compile] 0.2381ms 0.1303ms 7.6727 KOps/s 7.5687 KOps/s $\color{#35bf28}+1.37\%$
test_compile_replace[multi-eager] 0.6665ms 0.5756ms 1.7373 KOps/s 1.7405 KOps/s $\color{#d91a1a}-0.18\%$
test_compile_replace[multi-compile] 0.3054ms 0.1380ms 7.2438 KOps/s 7.1350 KOps/s $\color{#35bf28}+1.52\%$
test_compile_tc_getattr_20[eager] 0.2108ms 0.1765ms 5.6664 KOps/s 5.9415 KOps/s $\color{#d91a1a}-4.63\%$
test_compile_tc_getattr_20[compile] 0.3475ms 0.1474ms 6.7822 KOps/s 6.6311 KOps/s $\color{#35bf28}+2.28\%$
test_compile_clone_shallow[20-eager] 54.9440μs 18.9881μs 52.6646 KOps/s 51.1969 KOps/s $\color{#35bf28}+2.87\%$
test_compile_clone_shallow[20-compile] 73.6640μs 17.0451μs 58.6680 KOps/s 58.2016 KOps/s $\color{#35bf28}+0.80\%$
test_compile_clone_shallow[40-eager] 78.6450μs 33.5228μs 29.8304 KOps/s 29.2975 KOps/s $\color{#35bf28}+1.82\%$
test_compile_clone_shallow[40-compile] 85.7450μs 18.7264μs 53.4007 KOps/s 54.2383 KOps/s $\color{#d91a1a}-1.54\%$
test_compile_clone_shallow[80-eager] 95.2060μs 62.9675μs 15.8812 KOps/s 15.7483 KOps/s $\color{#35bf28}+0.84\%$
test_compile_clone_shallow[80-compile] 91.6260μs 21.6510μs 46.1873 KOps/s 44.3844 KOps/s $\color{#35bf28}+4.06\%$
test_compile_update_inplace[eager] 0.1028ms 60.4759μs 16.5355 KOps/s 16.3969 KOps/s $\color{#35bf28}+0.85\%$
test_compile_update_inplace[compile] 0.3913ms 0.1486ms 6.7313 KOps/s 6.6042 KOps/s $\color{#35bf28}+1.92\%$
test_mod_add[eager] 0.2943ms 0.2275ms 4.3960 KOps/s 4.3633 KOps/s $\color{#35bf28}+0.75\%$
test_mod_add[compile] 0.2530ms 0.1328ms 7.5275 KOps/s 7.2938 KOps/s $\color{#35bf28}+3.20\%$
test_mod_add[compile-overhead] 0.3558ms 0.1788ms 5.5940 KOps/s 5.4777 KOps/s $\color{#35bf28}+2.12\%$
test_mod_wrap[eager] 0.5493ms 0.4752ms 2.1043 KOps/s 2.1063 KOps/s $\color{#d91a1a}-0.10\%$
test_mod_wrap[compile] 0.5007ms 0.4092ms 2.4437 KOps/s 2.4619 KOps/s $\color{#d91a1a}-0.74\%$
test_mod_wrap[compile-overhead] 8.6537ms 4.7614ms 210.0238 Ops/s 218.0702 Ops/s $\color{#d91a1a}-3.69\%$
test_mod_wrap_and_backward[eager] 1.8470ms 1.7207ms 581.1587 Ops/s 582.5685 Ops/s $\color{#d91a1a}-0.24\%$
test_mod_wrap_and_backward[compile] 2.3293ms 1.6272ms 614.5435 Ops/s 644.3911 Ops/s $\color{#d91a1a}-4.63\%$
test_mod_wrap_and_backward[compile-overhead] 1.4171ms 0.9506ms 1.0520 KOps/s 1.0350 KOps/s $\color{#35bf28}+1.64\%$
test_seq_add[eager] 0.6065ms 0.5136ms 1.9471 KOps/s 1.9439 KOps/s $\color{#35bf28}+0.16\%$
test_seq_add[compile] 0.2398ms 0.1493ms 6.6980 KOps/s 6.8130 KOps/s $\color{#d91a1a}-1.69\%$
test_seq_add[compile-overhead] 0.3465ms 0.1869ms 5.3511 KOps/s 5.2809 KOps/s $\color{#35bf28}+1.33\%$
test_seq_wrap[eager] 1.5295ms 1.4223ms 703.0650 Ops/s 701.5471 Ops/s $\color{#35bf28}+0.22\%$
test_seq_wrap[compile] 0.5451ms 0.4148ms 2.4110 KOps/s 2.3605 KOps/s $\color{#35bf28}+2.14\%$
test_seq_wrap[compile-overhead] 0.3915ms 0.3169ms 3.1558 KOps/s 3.1893 KOps/s $\color{#d91a1a}-1.05\%$
test_func_call_runtime[False-eager] 0.9315ms 0.8210ms 1.2180 KOps/s 1.2502 KOps/s $\color{#d91a1a}-2.57\%$
test_func_call_runtime[False-compile] 1.0707ms 1.0008ms 999.2037 Ops/s 1.0138 KOps/s $\color{#d91a1a}-1.44\%$
test_func_call_runtime[False-compile-overhead] 0.6634ms 0.5135ms 1.9476 KOps/s 1.9366 KOps/s $\color{#35bf28}+0.56\%$
test_func_call_runtime[True-eager] 1.1519ms 1.0726ms 932.2964 Ops/s 929.8539 Ops/s $\color{#35bf28}+0.26\%$
test_func_call_runtime[True-compile] 1.1352ms 1.0143ms 985.9002 Ops/s 998.5978 Ops/s $\color{#d91a1a}-1.27\%$
test_func_call_runtime[True-compile-overhead] 0.5912ms 0.5278ms 1.8947 KOps/s 1.8689 KOps/s $\color{#35bf28}+1.38\%$
test_func_call_cm_runtime[False-eager] 0.9395ms 0.8214ms 1.2174 KOps/s 1.2469 KOps/s $\color{#d91a1a}-2.37\%$
test_func_call_cm_runtime[False-compile] 1.0939ms 0.9830ms 1.0173 KOps/s 1.0363 KOps/s $\color{#d91a1a}-1.83\%$
test_func_call_cm_runtime[False-compile-overhead] 0.6616ms 0.4932ms 2.0277 KOps/s 2.0085 KOps/s $\color{#35bf28}+0.96\%$
test_func_call_cm_runtime[True-eager] 1.3515ms 1.2230ms 817.6742 Ops/s 816.9852 Ops/s $\color{#35bf28}+0.08\%$
test_func_call_cm_runtime[True-compile] 1.1247ms 1.0405ms 961.1079 Ops/s 976.2851 Ops/s $\color{#d91a1a}-1.55\%$
test_func_call_cm_runtime[True-compile-overhead] 0.7050ms 0.5500ms 1.8181 KOps/s 1.7816 KOps/s $\color{#35bf28}+2.04\%$
test_vmap_func_call_cm_runtime[eager] 2.9138ms 2.4331ms 411.0017 Ops/s 410.5502 Ops/s $\color{#35bf28}+0.11\%$
test_vmap_func_call_cm_runtime[compile] 3.1106ms 2.6244ms 381.0424 Ops/s 381.5634 Ops/s $\color{#d91a1a}-0.14\%$
test_vmap_func_call_cm_runtime[compile-overhead] 3.1026ms 2.6263ms 380.7610 Ops/s 381.9705 Ops/s $\color{#d91a1a}-0.32\%$
test_distributed 0.5777ms 0.1470ms 6.8021 KOps/s 6.6617 KOps/s $\color{#35bf28}+2.11\%$
test_tdmodule 0.3524ms 0.1910ms 5.2356 KOps/s 5.0287 KOps/s $\color{#35bf28}+4.11\%$
test_tdmodule_dispatch 0.4088ms 0.3715ms 2.6919 KOps/s 2.6268 KOps/s $\color{#35bf28}+2.48\%$
test_tdseq 64.1950μs 26.7952μs 37.3202 KOps/s 37.3160 KOps/s $\color{#35bf28}+0.01\%$
test_tdseq_dispatch 0.2808ms 0.2149ms 4.6531 KOps/s 4.4717 KOps/s $\color{#35bf28}+4.06\%$
test_instantiation_functorch 2.1694ms 2.0905ms 478.3481 Ops/s 473.6114 Ops/s $\color{#35bf28}+1.00\%$
test_exec_functorch 0.2283ms 0.1869ms 5.3516 KOps/s 5.2636 KOps/s $\color{#35bf28}+1.67\%$
test_exec_functional_call 0.2265ms 0.1653ms 6.0480 KOps/s 5.9746 KOps/s $\color{#35bf28}+1.23\%$
test_exec_td_decorator 0.4807ms 0.2557ms 3.9103 KOps/s 3.8798 KOps/s $\color{#35bf28}+0.79\%$
test_vmap_mlp_speed_decorator[True-True] 1.2355ms 1.0471ms 954.9872 Ops/s 955.2411 Ops/s $\color{#d91a1a}-0.03\%$
test_vmap_mlp_speed_decorator[True-False] 1.2339ms 1.0433ms 958.5193 Ops/s 958.6014 Ops/s $-0.01\%$
test_vmap_mlp_speed_decorator[False-True] 0.9298ms 0.7445ms 1.3433 KOps/s 1.3498 KOps/s $\color{#d91a1a}-0.48\%$
test_vmap_mlp_speed_decorator[False-False] 0.9200ms 0.7433ms 1.3453 KOps/s 1.3502 KOps/s $\color{#d91a1a}-0.36\%$
test_vmap_transformer_speed_decorator[True-True] 21.5384ms 21.3373ms 46.8663 Ops/s 46.9059 Ops/s $\color{#d91a1a}-0.08\%$
test_vmap_transformer_speed_decorator[True-False] 21.4733ms 21.3082ms 46.9303 Ops/s 46.9711 Ops/s $\color{#d91a1a}-0.09\%$
test_vmap_transformer_speed_decorator[False-True] 21.5218ms 20.9051ms 47.8352 Ops/s 47.3790 Ops/s $\color{#35bf28}+0.96\%$
test_vmap_transformer_speed_decorator[False-False] 21.6750ms 20.9245ms 47.7909 Ops/s 47.7817 Ops/s $\color{#35bf28}+0.02\%$
test_to_module_speed[True] 2.2810ms 1.6602ms 602.3248 Ops/s 599.7594 Ops/s $\color{#35bf28}+0.43\%$
test_to_module_speed[False] 2.2196ms 1.6277ms 614.3545 Ops/s 612.7929 Ops/s $\color{#35bf28}+0.25\%$
test_to_module_plain_tensor_speed[None] 2.2146ms 1.7103ms 584.7077 Ops/s 572.3480 Ops/s $\color{#35bf28}+2.16\%$
test_to_module_plain_tensor_speed[False] 2.0055ms 1.5790ms 633.3101 Ops/s 631.8547 Ops/s $\color{#35bf28}+0.23\%$
test_to_module_plain_tensor_speed[True] 3.6217ms 3.4130ms 292.9976 Ops/s 289.6849 Ops/s $\color{#35bf28}+1.14\%$
test_tc_init 79.9750μs 43.0060μs 23.2526 KOps/s 23.3664 KOps/s $\color{#d91a1a}-0.49\%$
test_tc_init_tensor_only 39.6330μs 9.0037μs 111.0659 KOps/s 111.2718 KOps/s $\color{#d91a1a}-0.19\%$
test_tc_init_nested 0.1258ms 85.6391μs 11.6769 KOps/s 11.6858 KOps/s $\color{#d91a1a}-0.08\%$
test_tc_init_many_fields 40.3430μs 14.6319μs 68.3438 KOps/s 67.2477 KOps/s $\color{#35bf28}+1.63\%$
test_tc_first_layer_tensor 17.3710μs 1.8004μs 555.4449 KOps/s 553.1311 KOps/s $\color{#35bf28}+0.42\%$
test_tc_first_layer_tensor_only 3.6813μs 0.3931μs 2.5437 MOps/s 2.5421 MOps/s $\color{#35bf28}+0.06\%$
test_tc_first_layer_tensor_set 63.6340μs 3.9958μs 250.2653 KOps/s 253.4958 KOps/s $\color{#d91a1a}-1.27\%$
test_tc_first_layer_tensor_only_set 18.5110μs 3.2972μs 303.2907 KOps/s 302.7687 KOps/s $\color{#35bf28}+0.17\%$
test_tc_first_layer_nontensor 26.4120μs 6.2064μs 161.1246 KOps/s 154.2649 KOps/s $\color{#35bf28}+4.45\%$
test_tc_second_layer_tensor 24.7120μs 4.4060μs 226.9611 KOps/s 225.4720 KOps/s $\color{#35bf28}+0.66\%$
test_tc_second_layer_nontensor 49.4330μs 8.7396μs 114.4217 KOps/s 111.2165 KOps/s $\color{#35bf28}+2.88\%$
test_unbind 0.2675s 16.8998ms 59.1723 Ops/s 67.8275 Ops/s $\textbf{\color{#d91a1a}-12.76\%}$
test_full_like 4.5766ms 4.4120ms 226.6540 Ops/s 229.5619 Ops/s $\color{#d91a1a}-1.27\%$
test_zeros_like 4.6754ms 4.3943ms 227.5691 Ops/s 232.7213 Ops/s $\color{#d91a1a}-2.21\%$
test_ones_like 4.5502ms 4.4039ms 227.0697 Ops/s 227.5933 Ops/s $\color{#d91a1a}-0.23\%$
test_clone 7.0167ms 6.6289ms 150.8553 Ops/s 151.5283 Ops/s $\color{#d91a1a}-0.44\%$
test_squeeze 0.2377ms 14.6014μs 68.4865 KOps/s 64.3552 KOps/s $\textbf{\color{#35bf28}+6.42\%}$
test_unsqueeze 0.1923ms 0.1110ms 9.0123 KOps/s 8.5016 KOps/s $\textbf{\color{#35bf28}+6.01\%}$
test_split 0.2676ms 0.1833ms 5.4549 KOps/s 5.4467 KOps/s $\color{#35bf28}+0.15\%$
test_permute 0.3029ms 0.2060ms 4.8543 KOps/s 4.6133 KOps/s $\textbf{\color{#35bf28}+5.23\%}$
test_stack 19.7523ms 18.6862ms 53.5154 Ops/s 54.2595 Ops/s $\color{#d91a1a}-1.37\%$
test_cat 19.5893ms 18.6058ms 53.7467 Ops/s 37.3091 Ops/s $\textbf{\color{#35bf28}+44.06\%}$
test_sequential_tensordict 0.8224ms 0.5776ms 1.7312 KOps/s 1.6926 KOps/s $\color{#35bf28}+2.28\%$
test_sequential_graph_module 0.2327ms 0.1214ms 8.2378 KOps/s 7.9946 KOps/s $\color{#35bf28}+3.04\%$
test_nested_tensordict 0.9981ms 0.8409ms 1.1892 KOps/s 1.2106 KOps/s $\color{#d91a1a}-1.76\%$
test_nested_graph_module 0.1967ms 0.1352ms 7.3990 KOps/s 7.7077 KOps/s $\color{#d91a1a}-4.00\%$

@github-actions

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large&amp;#x26A0;\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 344. Improved: $\large\color{#35bf28}22$. Worsened: $\large\color{#d91a1a}18$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_collector_preallocated_write[stack_out-cpu-32-2] 0.2043ms 0.1710ms 5.8469 KOps/s 5.9575 KOps/s $\color{#d91a1a}-1.86\%$
test_collector_preallocated_write[stack_out-cpu-32-8] 0.3453ms 0.2970ms 3.3672 KOps/s 3.4026 KOps/s $\color{#d91a1a}-1.04\%$
test_collector_preallocated_write[stack_out-cpu-32-32] 0.8683ms 0.7764ms 1.2880 KOps/s 1.2827 KOps/s $\color{#35bf28}+0.41\%$
test_collector_preallocated_write[stack_out-cpu-4096-2] 0.3929ms 0.3443ms 2.9048 KOps/s 2.9057 KOps/s $\color{#d91a1a}-0.03\%$
test_collector_preallocated_write[stack_out-cpu-4096-8] 1.2528ms 1.1544ms 866.2650 Ops/s 897.4188 Ops/s $\color{#d91a1a}-3.47\%$
test_collector_preallocated_write[stack_out-cpu-4096-32] 7.7870ms 7.2817ms 137.3303 Ops/s 135.2064 Ops/s $\color{#35bf28}+1.57\%$
test_collector_preallocated_write[stack_out-cuda-32-2] 0.3461ms 0.2512ms 3.9808 KOps/s 4.0655 KOps/s $\color{#d91a1a}-2.08\%$
test_collector_preallocated_write[stack_out-cuda-32-8] 0.4401ms 0.3743ms 2.6718 KOps/s 2.7086 KOps/s $\color{#d91a1a}-1.36\%$
test_collector_preallocated_write[stack_out-cuda-32-32] 0.9331ms 0.8281ms 1.2076 KOps/s 1.2240 KOps/s $\color{#d91a1a}-1.34\%$
test_collector_preallocated_write[stack_out-cuda-4096-2] 0.3273ms 0.2610ms 3.8308 KOps/s 4.0917 KOps/s $\textbf{\color{#d91a1a}-6.38\%}$
test_collector_preallocated_write[stack_out-cuda-4096-8] 0.4296ms 0.3774ms 2.6498 KOps/s 2.7254 KOps/s $\color{#d91a1a}-2.77\%$
test_collector_preallocated_write[stack_out-cuda-4096-32] 0.9680ms 0.8951ms 1.1172 KOps/s 1.1295 KOps/s $\color{#d91a1a}-1.09\%$
test_collector_preallocated_write[set_at_loop-cpu-32-2] 0.3049ms 0.2164ms 4.6209 KOps/s 4.7225 KOps/s $\color{#d91a1a}-2.15\%$
test_collector_preallocated_write[set_at_loop-cpu-32-8] 0.9176ms 0.8303ms 1.2044 KOps/s 1.1985 KOps/s $\color{#35bf28}+0.50\%$
test_collector_preallocated_write[set_at_loop-cpu-32-32] 3.4518ms 3.3469ms 298.7802 Ops/s 307.1794 Ops/s $\color{#d91a1a}-2.73\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-2] 0.7158ms 0.3647ms 2.7416 KOps/s 2.6580 KOps/s $\color{#35bf28}+3.14\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-8] 2.1269ms 1.7502ms 571.3573 Ops/s 588.8910 Ops/s $\color{#d91a1a}-2.98\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-32] 10.4621ms 10.1478ms 98.5431 Ops/s 98.1419 Ops/s $\color{#35bf28}+0.41\%$
test_collector_preallocated_write[set_at_loop-cuda-32-2] 0.4439ms 0.4006ms 2.4965 KOps/s 2.5552 KOps/s $\color{#d91a1a}-2.30\%$
test_collector_preallocated_write[set_at_loop-cuda-32-8] 1.6159ms 1.4971ms 667.9673 Ops/s 681.6140 Ops/s $\color{#d91a1a}-2.00\%$
test_collector_preallocated_write[set_at_loop-cuda-32-32] 6.2391ms 6.1700ms 162.0751 Ops/s 168.7452 Ops/s $\color{#d91a1a}-3.95\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-2] 0.4654ms 0.4048ms 2.4706 KOps/s 2.4910 KOps/s $\color{#d91a1a}-0.82\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-8] 1.6544ms 1.4823ms 674.6477 Ops/s 669.8786 Ops/s $\color{#35bf28}+0.71\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-32] 6.2169ms 6.0572ms 165.0925 Ops/s 166.1826 Ops/s $\color{#d91a1a}-0.66\%$
test_collector_preallocated_write[copy_at-cpu-32-2] 0.6979ms 0.1757ms 5.6909 KOps/s 5.7238 KOps/s $\color{#d91a1a}-0.57\%$
test_collector_preallocated_write[copy_at-cpu-32-8] 0.7174ms 0.6807ms 1.4691 KOps/s 1.4718 KOps/s $\color{#d91a1a}-0.19\%$
test_collector_preallocated_write[copy_at-cpu-32-32] 2.7507ms 2.7013ms 370.1955 Ops/s 369.7314 Ops/s $\color{#35bf28}+0.13\%$
test_collector_preallocated_write[copy_at-cpu-4096-2] 0.4275ms 0.3186ms 3.1384 KOps/s 3.0552 KOps/s $\color{#35bf28}+2.73\%$
test_collector_preallocated_write[copy_at-cpu-4096-8] 1.9469ms 1.5414ms 648.7400 Ops/s 689.6052 Ops/s $\textbf{\color{#d91a1a}-5.93\%}$
test_collector_preallocated_write[copy_at-cpu-4096-32] 9.9376ms 9.5312ms 104.9184 Ops/s 105.0328 Ops/s $\color{#d91a1a}-0.11\%$
test_collector_preallocated_write[copy_at-cuda-32-2] 0.4585ms 0.3290ms 3.0398 KOps/s 3.0637 KOps/s $\color{#d91a1a}-0.78\%$
test_collector_preallocated_write[copy_at-cuda-32-8] 1.3155ms 1.2276ms 814.5923 Ops/s 825.8374 Ops/s $\color{#d91a1a}-1.36\%$
test_collector_preallocated_write[copy_at-cuda-32-32] 4.9507ms 4.8101ms 207.8954 Ops/s 210.5757 Ops/s $\color{#d91a1a}-1.27\%$
test_collector_preallocated_write[copy_at-cuda-4096-2] 0.3755ms 0.3306ms 3.0251 KOps/s 3.0605 KOps/s $\color{#d91a1a}-1.16\%$
test_collector_preallocated_write[copy_at-cuda-4096-8] 1.3194ms 1.2381ms 807.6809 Ops/s 821.7268 Ops/s $\color{#d91a1a}-1.71\%$
test_collector_preallocated_write[copy_at-cuda-4096-32] 4.9468ms 4.8549ms 205.9761 Ops/s 209.9238 Ops/s $\color{#d91a1a}-1.88\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-2] 0.1726ms 0.1240ms 8.0671 KOps/s 8.3748 KOps/s $\color{#d91a1a}-3.67\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-8] 0.5577ms 0.4865ms 2.0554 KOps/s 2.1358 KOps/s $\color{#d91a1a}-3.77\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-32] 2.0234ms 1.9273ms 518.8633 Ops/s 538.5503 Ops/s $\color{#d91a1a}-3.66\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-2] 0.6288ms 0.2596ms 3.8528 KOps/s 3.8545 KOps/s $\color{#d91a1a}-0.04\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-8] 1.4832ms 1.2551ms 796.7300 Ops/s 815.4937 Ops/s $\color{#d91a1a}-2.30\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-32] 9.1830ms 8.5760ms 116.6040 Ops/s 116.5507 Ops/s $\color{#35bf28}+0.05\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-2] 0.3426ms 0.2874ms 3.4790 KOps/s 3.6153 KOps/s $\color{#d91a1a}-3.77\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-8] 1.1657ms 1.0760ms 929.4102 Ops/s 974.0487 Ops/s $\color{#d91a1a}-4.58\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-32] 4.3253ms 4.1714ms 239.7276 Ops/s 249.0580 Ops/s $\color{#d91a1a}-3.75\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-2] 0.3601ms 0.2876ms 3.4767 KOps/s 3.6179 KOps/s $\color{#d91a1a}-3.90\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-8] 1.2226ms 1.0699ms 934.6684 Ops/s 969.3042 Ops/s $\color{#d91a1a}-3.57\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-32] 4.3370ms 4.2243ms 236.7275 Ops/s 248.6178 Ops/s $\color{#d91a1a}-4.78\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-128] 18.2505ms 16.3861ms 61.0274 Ops/s 61.2804 Ops/s $\color{#d91a1a}-0.41\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-256] 33.2366ms 32.8530ms 30.4386 Ops/s 30.4680 Ops/s $\color{#d91a1a}-0.10\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-128] 90.4332ms 88.7825ms 11.2635 Ops/s 12.0486 Ops/s $\textbf{\color{#d91a1a}-6.52\%}$
test_wide_nested_preallocated_write[stack_out-cpu-4096-256] 0.2078s 0.2074s 4.8225 Ops/s 5.1280 Ops/s $\textbf{\color{#d91a1a}-5.96\%}$
test_wide_nested_preallocated_write[stack_out-cuda-128-128] 14.0191ms 13.8837ms 72.0268 Ops/s 72.9150 Ops/s $\color{#d91a1a}-1.22\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-256] 27.4795ms 27.2738ms 36.6652 Ops/s 37.0459 Ops/s $\color{#d91a1a}-1.03\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-128] 14.1163ms 13.9868ms 71.4958 Ops/s 71.3907 Ops/s $\color{#35bf28}+0.15\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-256] 27.9252ms 27.7104ms 36.0875 Ops/s 36.1837 Ops/s $\color{#d91a1a}-0.27\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-128] 53.5083ms 53.0815ms 18.8389 Ops/s 19.3730 Ops/s $\color{#d91a1a}-2.76\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-256] 0.1075s 0.1069s 9.3561 Ops/s 9.6121 Ops/s $\color{#d91a1a}-2.66\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-128] 0.1528s 0.1522s 6.5698 Ops/s 6.9435 Ops/s $\textbf{\color{#d91a1a}-5.38\%}$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-256] 0.3306s 0.3292s 3.0373 Ops/s 3.1551 Ops/s $\color{#d91a1a}-3.73\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-128] 79.7140ms 79.0189ms 12.6552 Ops/s 12.7963 Ops/s $\color{#d91a1a}-1.10\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-256] 0.1583s 0.1573s 6.3585 Ops/s 6.4123 Ops/s $\color{#d91a1a}-0.84\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-128] 79.6259ms 77.8930ms 12.8381 Ops/s 12.8015 Ops/s $\color{#35bf28}+0.29\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-256] 0.1586s 0.1580s 6.3286 Ops/s 6.3864 Ops/s $\color{#d91a1a}-0.91\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-128] 31.2335ms 30.7873ms 32.4809 Ops/s 32.7209 Ops/s $\color{#d91a1a}-0.73\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-256] 62.9727ms 62.6186ms 15.9697 Ops/s 16.2473 Ops/s $\color{#d91a1a}-1.71\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-128] 0.1248s 0.1244s 8.0389 Ops/s 8.5536 Ops/s $\textbf{\color{#d91a1a}-6.02\%}$
test_wide_nested_preallocated_write[copy_at-cpu-4096-256] 0.2756s 0.2748s 3.6384 Ops/s 3.7784 Ops/s $\color{#d91a1a}-3.71\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-128] 44.4549ms 44.2414ms 22.6032 Ops/s 23.0765 Ops/s $\color{#d91a1a}-2.05\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-256] 89.1475ms 88.8778ms 11.2514 Ops/s 11.5688 Ops/s $\color{#d91a1a}-2.74\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-128] 44.7100ms 44.4420ms 22.5013 Ops/s 22.9849 Ops/s $\color{#d91a1a}-2.10\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-256] 89.5030ms 89.0858ms 11.2251 Ops/s 11.4773 Ops/s $\color{#d91a1a}-2.20\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-128] 21.0519ms 20.8565ms 47.9466 Ops/s 48.5342 Ops/s $\color{#d91a1a}-1.21\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-256] 42.9675ms 42.8029ms 23.3629 Ops/s 23.7783 Ops/s $\color{#d91a1a}-1.75\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-128] 0.1134s 0.1132s 8.8361 Ops/s 9.5012 Ops/s $\textbf{\color{#d91a1a}-7.00\%}$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-256] 0.2516s 0.2510s 3.9843 Ops/s 4.1860 Ops/s $\color{#d91a1a}-4.82\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-128] 38.3819ms 38.0725ms 26.2657 Ops/s 27.2569 Ops/s $\color{#d91a1a}-3.64\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-256] 76.8010ms 76.3144ms 13.1037 Ops/s 13.7429 Ops/s $\color{#d91a1a}-4.65\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-128] 38.6737ms 38.2524ms 26.1422 Ops/s 27.3373 Ops/s $\color{#d91a1a}-4.37\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-256] 76.5813ms 76.1084ms 13.1392 Ops/s 13.6374 Ops/s $\color{#d91a1a}-3.65\%$
test_plain_set_nested 47.3110μs 15.3955μs 64.9541 KOps/s 64.3070 KOps/s $\color{#35bf28}+1.01\%$
test_plain_set_stack_nested 36.6110μs 15.2817μs 65.4376 KOps/s 65.0612 KOps/s $\color{#35bf28}+0.58\%$
test_plain_set_nested_inplace 63.4020μs 16.8852μs 59.2236 KOps/s 58.0393 KOps/s $\color{#35bf28}+2.04\%$
test_plain_set_stack_nested_inplace 45.7410μs 16.5592μs 60.3893 KOps/s 60.7061 KOps/s $\color{#d91a1a}-0.52\%$
test_items 33.9110μs 5.9536μs 167.9658 KOps/s 166.8995 KOps/s $\color{#35bf28}+0.64\%$
test_items_nested 0.5481ms 0.4614ms 2.1674 KOps/s 2.1498 KOps/s $\color{#35bf28}+0.82\%$
test_items_nested_locked 0.5475ms 0.4619ms 2.1648 KOps/s 2.1228 KOps/s $\color{#35bf28}+1.97\%$
test_items_nested_leaf 0.1436ms 96.4212μs 10.3712 KOps/s 10.4147 KOps/s $\color{#d91a1a}-0.42\%$
test_items_stack_nested 0.5398ms 0.4631ms 2.1595 KOps/s 2.1373 KOps/s $\color{#35bf28}+1.04\%$
test_items_stack_nested_leaf 0.1451ms 96.9969μs 10.3096 KOps/s 10.3377 KOps/s $\color{#d91a1a}-0.27\%$
test_items_stack_nested_locked 0.5305ms 0.4640ms 2.1551 KOps/s 2.1484 KOps/s $\color{#35bf28}+0.31\%$
test_keys 27.7100μs 4.2028μs 237.9393 KOps/s 234.8311 KOps/s $\color{#35bf28}+1.32\%$
test_keys_nested 0.1761ms 0.1308ms 7.6481 KOps/s 7.6485 KOps/s $-0.01\%$
test_keys_nested_locked 1.9992ms 0.1394ms 7.1740 KOps/s 7.1238 KOps/s $\color{#35bf28}+0.70\%$
test_keys_nested_leaf 0.1675ms 0.1210ms 8.2617 KOps/s 8.2217 KOps/s $\color{#35bf28}+0.49\%$
test_keys_stack_nested 0.1873ms 0.1296ms 7.7168 KOps/s 7.5967 KOps/s $\color{#35bf28}+1.58\%$
test_keys_stack_nested_leaf 0.1732ms 0.1200ms 8.3314 KOps/s 8.2831 KOps/s $\color{#35bf28}+0.58\%$
test_keys_stack_nested_locked 0.2128ms 0.1386ms 7.2154 KOps/s 7.1878 KOps/s $\color{#35bf28}+0.38\%$
test_values 6.0402μs 1.0142μs 986.0234 KOps/s 975.8553 KOps/s $\color{#35bf28}+1.04\%$
test_values_nested 85.5410μs 53.5682μs 18.6678 KOps/s 18.8332 KOps/s $\color{#d91a1a}-0.88\%$
test_values_nested_locked 92.9410μs 56.4735μs 17.7074 KOps/s 17.5855 KOps/s $\color{#35bf28}+0.69\%$
test_values_nested_leaf 0.1080ms 60.5147μs 16.5249 KOps/s 16.3962 KOps/s $\color{#35bf28}+0.78\%$
test_values_stack_nested 0.1032ms 52.7253μs 18.9662 KOps/s 18.9740 KOps/s $\color{#d91a1a}-0.04\%$
test_values_stack_nested_leaf 89.4820μs 59.8201μs 16.7168 KOps/s 16.4214 KOps/s $\color{#35bf28}+1.80\%$
test_values_stack_nested_locked 0.1040ms 56.1480μs 17.8101 KOps/s 17.7439 KOps/s $\color{#35bf28}+0.37\%$
test_membership 5.6633μs 0.8435μs 1.1856 MOps/s 1.1861 MOps/s $\color{#d91a1a}-0.04\%$
test_membership_nested 37.5910μs 2.9717μs 336.5054 KOps/s 334.0886 KOps/s $\color{#35bf28}+0.72\%$
test_membership_nested_leaf 34.3710μs 2.9881μs 334.6630 KOps/s 339.6618 KOps/s $\color{#d91a1a}-1.47\%$
test_membership_stacked_nested 26.7010μs 2.9166μs 342.8613 KOps/s 344.0467 KOps/s $\color{#d91a1a}-0.34\%$
test_membership_stacked_nested_leaf 40.1010μs 2.8837μs 346.7800 KOps/s 344.8455 KOps/s $\color{#35bf28}+0.56\%$
test_membership_nested_last 33.3200μs 4.5206μs 221.2078 KOps/s 222.1425 KOps/s $\color{#d91a1a}-0.42\%$
test_membership_nested_leaf_last 35.2500μs 4.4791μs 223.2575 KOps/s 230.3371 KOps/s $\color{#d91a1a}-3.07\%$
test_membership_stacked_nested_last 33.7000μs 4.3852μs 228.0373 KOps/s 228.2986 KOps/s $\color{#d91a1a}-0.11\%$
test_membership_stacked_nested_leaf_last 43.0810μs 4.3822μs 228.1967 KOps/s 229.5476 KOps/s $\color{#d91a1a}-0.59\%$
test_nested_getleaf 54.3510μs 21.8637μs 45.7380 KOps/s 45.6998 KOps/s $\color{#35bf28}+0.08\%$
test_nested_get 53.1310μs 20.5252μs 48.7207 KOps/s 48.3833 KOps/s $\color{#35bf28}+0.70\%$
test_stacked_getleaf 55.8810μs 21.6142μs 46.2659 KOps/s 46.3995 KOps/s $\color{#d91a1a}-0.29\%$
test_stacked_get 50.0610μs 20.3978μs 49.0250 KOps/s 48.9844 KOps/s $\color{#35bf28}+0.08\%$
test_nested_getitemleaf 56.7410μs 22.1374μs 45.1725 KOps/s 44.5086 KOps/s $\color{#35bf28}+1.49\%$
test_nested_getitem 59.1710μs 20.8708μs 47.9138 KOps/s 47.1649 KOps/s $\color{#35bf28}+1.59\%$
test_stacked_getitemleaf 57.4910μs 22.0969μs 45.2551 KOps/s 45.0621 KOps/s $\color{#35bf28}+0.43\%$
test_stacked_getitem 63.7710μs 21.0308μs 47.5492 KOps/s 47.7592 KOps/s $\color{#d91a1a}-0.44\%$
test_lock_nested 0.5945ms 0.5070ms 1.9725 KOps/s 1.9764 KOps/s $\color{#d91a1a}-0.20\%$
test_lock_stack_nested 0.5754ms 0.5151ms 1.9413 KOps/s 1.9752 KOps/s $\color{#d91a1a}-1.71\%$
test_unlock_nested 0.4908ms 0.4054ms 2.4666 KOps/s 2.5150 KOps/s $\color{#d91a1a}-1.92\%$
test_unlock_stack_nested 0.5321ms 0.4092ms 2.4438 KOps/s 2.4915 KOps/s $\color{#d91a1a}-1.91\%$
test_flatten_speed 0.1832ms 0.1221ms 8.1904 KOps/s 8.1540 KOps/s $\color{#35bf28}+0.45\%$
test_unflatten_speed 0.6661ms 0.5733ms 1.7443 KOps/s 1.7420 KOps/s $\color{#35bf28}+0.14\%$
test_common_ops 99.0927ms 1.6894ms 591.9211 Ops/s 295.5674 Ops/s $\textbf{\color{#35bf28}+100.27\%}$
test_creation 74.2720μs 3.1790μs 314.5642 KOps/s 319.9929 KOps/s $\color{#d91a1a}-1.70\%$
test_creation_empty 38.0110μs 7.0296μs 142.2557 KOps/s 141.3028 KOps/s $\color{#35bf28}+0.67\%$
test_creation_nested_1 43.2210μs 11.6062μs 86.1611 KOps/s 86.4467 KOps/s $\color{#d91a1a}-0.33\%$
test_creation_nested_2 45.0710μs 13.5978μs 73.5415 KOps/s 73.1239 KOps/s $\color{#35bf28}+0.57\%$
test_creation_many_keys[10] 51.8810μs 21.1235μs 47.3407 KOps/s 46.7280 KOps/s $\color{#35bf28}+1.31\%$
test_creation_many_keys[50] 0.1269ms 91.3397μs 10.9481 KOps/s 10.8299 KOps/s $\color{#35bf28}+1.09\%$
test_creation_many_keys[100] 0.2281ms 0.1783ms 5.6099 KOps/s 5.5550 KOps/s $\color{#35bf28}+0.99\%$
test_creation_nested_many_keys[10] 84.8920μs 45.2916μs 22.0791 KOps/s 21.7899 KOps/s $\color{#35bf28}+1.33\%$
test_creation_nested_many_keys[50] 0.2471ms 0.1871ms 5.3444 KOps/s 5.3256 KOps/s $\color{#35bf28}+0.35\%$
test_clone 0.2828ms 13.4942μs 74.1057 KOps/s 73.8783 KOps/s $\color{#35bf28}+0.31\%$
test_getitem[int] 1.5006ms 15.5680μs 64.2345 KOps/s 65.9154 KOps/s $\color{#d91a1a}-2.55\%$
test_getitem[slice_int] 0.1488ms 25.0185μs 39.9705 KOps/s 41.3572 KOps/s $\color{#d91a1a}-3.35\%$
test_getitem[range] 0.1835ms 63.7544μs 15.6852 KOps/s 15.5984 KOps/s $\color{#35bf28}+0.56\%$
test_getitem[tuple] 0.1444ms 24.8444μs 40.2505 KOps/s 41.3029 KOps/s $\color{#d91a1a}-2.55\%$
test_getitem[list] 0.1951ms 62.3688μs 16.0336 KOps/s 16.8778 KOps/s $\textbf{\color{#d91a1a}-5.00\%}$
test_setitem_dim[int] 67.8210μs 27.7688μs 36.0116 KOps/s 38.8332 KOps/s $\textbf{\color{#d91a1a}-7.27\%}$
test_setitem_dim[slice_int] 90.4920μs 45.8688μs 21.8013 KOps/s 23.2302 KOps/s $\textbf{\color{#d91a1a}-6.15\%}$
test_setitem_dim[range] 0.1523ms 0.1010ms 9.9034 KOps/s 10.3990 KOps/s $\color{#d91a1a}-4.77\%$
test_setitem_dim[tuple] 71.2420μs 42.8894μs 23.3158 KOps/s 25.3968 KOps/s $\textbf{\color{#d91a1a}-8.19\%}$
test_setitem 0.3023ms 18.2363μs 54.8357 KOps/s 55.7523 KOps/s $\color{#d91a1a}-1.64\%$
test_set 0.2793ms 17.5989μs 56.8218 KOps/s 58.4770 KOps/s $\color{#d91a1a}-2.83\%$
test_set_shared 0.6067ms 0.2109ms 4.7417 KOps/s 4.8040 KOps/s $\color{#d91a1a}-1.30\%$
test_update 0.3430ms 22.1605μs 45.1254 KOps/s 46.4638 KOps/s $\color{#d91a1a}-2.88\%$
test_update_nested 84.0310μs 34.4012μs 29.0688 KOps/s 29.6843 KOps/s $\color{#d91a1a}-2.07\%$
test_update__nested 0.5032ms 33.7277μs 29.6492 KOps/s 29.8532 KOps/s $\color{#d91a1a}-0.68\%$
test_set_nested 76.0210μs 19.6282μs 50.9471 KOps/s 52.8572 KOps/s $\color{#d91a1a}-3.61\%$
test_set_nested_new 61.1410μs 24.1050μs 41.4852 KOps/s 41.6126 KOps/s $\color{#d91a1a}-0.31\%$
test_select 80.7810μs 40.8439μs 24.4835 KOps/s 24.4606 KOps/s $\color{#35bf28}+0.09\%$
test_select_nested 0.1561ms 71.6844μs 13.9500 KOps/s 13.4048 KOps/s $\color{#35bf28}+4.07\%$
test_exclude_nested 0.1281ms 90.6914μs 11.0264 KOps/s 10.8317 KOps/s $\color{#35bf28}+1.80\%$
test_empty[True] 0.5043ms 0.3962ms 2.5240 KOps/s 2.4870 KOps/s $\color{#35bf28}+1.49\%$
test_empty[False] 8.6927μs 1.3843μs 722.3720 KOps/s 706.6384 KOps/s $\color{#35bf28}+2.23\%$
test_to 0.1064ms 70.1255μs 14.2601 KOps/s 14.3529 KOps/s $\color{#d91a1a}-0.65\%$
test_to_nonblocking 0.1116ms 69.5333μs 14.3816 KOps/s 14.6136 KOps/s $\color{#d91a1a}-1.59\%$
test_unbind_speed 0.4513ms 0.3448ms 2.9004 KOps/s 2.9525 KOps/s $\color{#d91a1a}-1.76\%$
test_unbind_speed_stack0 0.4062ms 0.3411ms 2.9316 KOps/s 2.9995 KOps/s $\color{#d91a1a}-2.26\%$
test_unbind_speed_stack1 0.1143s 0.8584ms 1.1650 KOps/s 1.1567 KOps/s $\color{#35bf28}+0.72\%$
test_split 0.1144s 1.2901ms 775.1580 Ops/s 701.1723 Ops/s $\textbf{\color{#35bf28}+10.55\%}$
test_chunk 1.1383ms 1.0967ms 911.8099 Ops/s 919.7593 Ops/s $\color{#d91a1a}-0.86\%$
test_to_cpu_blocking 0.1340s 22.7715ms 43.9146 Ops/s 49.9653 Ops/s $\textbf{\color{#d91a1a}-12.11\%}$
test_to_cpu_global_sync 12.1083ms 11.9772ms 83.4918 Ops/s 84.4485 Ops/s $\color{#d91a1a}-1.13\%$
test_to_cpu_event_sync 13.2705ms 12.9901ms 76.9814 Ops/s 78.0146 Ops/s $\color{#d91a1a}-1.32\%$
test_to_cpu_default 13.3092ms 13.0081ms 76.8749 Ops/s 69.3349 Ops/s $\textbf{\color{#35bf28}+10.87\%}$
test_consolidate[False-None] 4.5249ms 4.2491ms 235.3417 Ops/s 236.9348 Ops/s $\color{#d91a1a}-0.67\%$
test_consolidate[default-None] 3.4495ms 2.1795ms 458.8307 Ops/s 462.7977 Ops/s $\color{#d91a1a}-0.86\%$
test_consolidate[reduce-overhead-None] 3.4188ms 2.1158ms 472.6300 Ops/s 473.5125 Ops/s $\color{#d91a1a}-0.19\%$
test_consolidate_njt[False-None] 8.9505ms 8.5414ms 117.0764 Ops/s 113.8596 Ops/s $\color{#35bf28}+2.83\%$
test_to[False-False-None] 2.3025ms 2.2072ms 453.0617 Ops/s 452.6348 Ops/s $\color{#35bf28}+0.09\%$
test_to[True-False-None] 2.2042ms 1.9281ms 518.6332 Ops/s 514.3772 Ops/s $\color{#35bf28}+0.83\%$
test_to[within-False-None] 6.4207ms 6.3070ms 158.5534 Ops/s 157.4649 Ops/s $\color{#35bf28}+0.69\%$
test_to[True-default-None] 10.9880ms 10.6199ms 94.1628 Ops/s 92.0497 Ops/s $\color{#35bf28}+2.30\%$
test_to_njt[False-False-None] 8.7831ms 8.6410ms 115.7269 Ops/s 112.4416 Ops/s $\color{#35bf28}+2.92\%$
test_to_njt[True-False-None] 7.1236ms 6.9523ms 143.8374 Ops/s 140.5175 Ops/s $\color{#35bf28}+2.36\%$
test_to_njt[within-False-None] 15.8256ms 15.5738ms 64.2106 Ops/s 30.0319 Ops/s $\textbf{\color{#35bf28}+113.81\%}$
test_creation[device0] 0.2769ms 0.1181ms 8.4702 KOps/s 8.1502 KOps/s $\color{#35bf28}+3.93\%$
test_creation_from_tensor 0.4253ms 0.1145ms 8.7308 KOps/s 8.4974 KOps/s $\color{#35bf28}+2.75\%$
test_add_one[memmap_tensor0] 0.2223ms 6.8380μs 146.2417 KOps/s 150.5112 KOps/s $\color{#d91a1a}-2.84\%$
test_contiguous[memmap_tensor0] 16.4510μs 0.6598μs 1.5157 MOps/s 2.2219 MOps/s $\textbf{\color{#d91a1a}-31.79\%}$
test_stack[memmap_tensor0] 28.9410μs 4.3452μs 230.1413 KOps/s 240.4402 KOps/s $\color{#d91a1a}-4.28\%$
test_memmaptd_index 1.3356ms 0.2872ms 3.4820 KOps/s 3.5973 KOps/s $\color{#d91a1a}-3.20\%$
test_memmaptd_index_astensor 0.5411ms 0.3922ms 2.5497 KOps/s 2.6097 KOps/s $\color{#d91a1a}-2.30\%$
test_memmaptd_index_op 0.8284ms 0.6523ms 1.5330 KOps/s 1.5647 KOps/s $\color{#d91a1a}-2.02\%$
test_serialize_model 0.1363s 0.1345s 7.4373 Ops/s 7.4152 Ops/s $\color{#35bf28}+0.30\%$
test_serialize_model_pickle 1.3493s 1.2091s 0.8270 Ops/s 0.8265 Ops/s $\color{#35bf28}+0.06\%$
test_serialize_weights 0.1352s 0.1337s 7.4805 Ops/s 7.4485 Ops/s $\color{#35bf28}+0.43\%$
test_serialize_weights_returnearly 0.3375s 81.5195ms 12.2670 Ops/s 10.4347 Ops/s $\textbf{\color{#35bf28}+17.56\%}$
test_serialize_weights_pickle 1.3783s 1.2150s 0.8231 Ops/s 0.8223 Ops/s $\color{#35bf28}+0.09\%$
test_reshape_pytree 0.2035ms 32.7966μs 30.4910 KOps/s 30.2352 KOps/s $\color{#35bf28}+0.85\%$
test_reshape_td 88.2410μs 45.9860μs 21.7458 KOps/s 22.5417 KOps/s $\color{#d91a1a}-3.53\%$
test_view_pytree 0.2150ms 32.1367μs 31.1171 KOps/s 30.5355 KOps/s $\color{#35bf28}+1.90\%$
test_view_td 0.1120ms 56.3320μs 17.7519 KOps/s 18.5841 KOps/s $\color{#d91a1a}-4.48\%$
test_unbind_pytree 0.2325ms 36.9360μs 27.0739 KOps/s 26.7279 KOps/s $\color{#35bf28}+1.29\%$
test_unbind_td 0.2120ms 52.6273μs 19.0015 KOps/s 20.0194 KOps/s $\textbf{\color{#d91a1a}-5.08\%}$
test_split_pytree 0.2509ms 42.5478μs 23.5030 KOps/s 23.3191 KOps/s $\color{#35bf28}+0.79\%$
test_split_td 0.1350ms 65.0726μs 15.3674 KOps/s 15.4163 KOps/s $\color{#d91a1a}-0.32\%$
test_add_pytree 0.1895ms 41.6600μs 24.0039 KOps/s 23.6266 KOps/s $\color{#35bf28}+1.60\%$
test_add_td 0.1123ms 55.4393μs 18.0378 KOps/s 18.3343 KOps/s $\color{#d91a1a}-1.62\%$
test_compile_add_one_nested[tensordict-compile] 0.3670ms 0.2330ms 4.2922 KOps/s 4.1755 KOps/s $\color{#35bf28}+2.80\%$
test_compile_add_one_nested[tensordict-eager] 0.3142ms 0.2014ms 4.9645 KOps/s 4.9900 KOps/s $\color{#d91a1a}-0.51\%$
test_compile_add_one_nested[pytree-compile] 0.2803ms 0.1361ms 7.3472 KOps/s 7.1450 KOps/s $\color{#35bf28}+2.83\%$
test_compile_add_one_nested[pytree-eager] 0.4414ms 0.1837ms 5.4442 KOps/s 5.6241 KOps/s $\color{#d91a1a}-3.20\%$
test_compile_copy_nested[tensordict-compile] 74.8120μs 15.4459μs 64.7422 KOps/s 66.3719 KOps/s $\color{#d91a1a}-2.46\%$
test_compile_copy_nested[tensordict-eager] 0.4338ms 53.5328μs 18.6801 KOps/s 18.5941 KOps/s $\color{#35bf28}+0.46\%$
test_compile_copy_nested[pytree-compile] 0.1125ms 15.8746μs 62.9937 KOps/s 63.5975 KOps/s $\color{#d91a1a}-0.95\%$
test_compile_copy_nested[pytree-eager] 0.3964ms 67.2332μs 14.8736 KOps/s 14.4780 KOps/s $\color{#35bf28}+2.73\%$
test_compile_add_one_flat[tensordict-compile] 0.5064ms 0.2475ms 4.0404 KOps/s 3.7448 KOps/s $\textbf{\color{#35bf28}+7.89\%}$
test_compile_add_one_flat[tensordict-eager] 0.3440ms 0.2835ms 3.5279 KOps/s 3.5162 KOps/s $\color{#35bf28}+0.33\%$
test_compile_add_one_flat[tensorclass-compile] 0.2640ms 0.1844ms 5.4235 KOps/s 4.8634 KOps/s $\textbf{\color{#35bf28}+11.52\%}$
test_compile_add_one_flat[tensorclass-eager] 0.1222ms 74.7178μs 13.3837 KOps/s 13.3027 KOps/s $\color{#35bf28}+0.61\%$
test_compile_add_one_flat[pytree-compile] 0.3136ms 0.1924ms 5.1968 KOps/s 4.9111 KOps/s $\textbf{\color{#35bf28}+5.82\%}$
test_compile_add_one_flat[pytree-eager] 0.8627ms 0.5357ms 1.8666 KOps/s 1.9415 KOps/s $\color{#d91a1a}-3.86\%$
test_compile_add_self_flat[tensordict-eager] 0.4855ms 0.3301ms 3.0297 KOps/s 3.0027 KOps/s $\color{#35bf28}+0.90\%$
test_compile_add_self_flat[tensordict-compile] 0.3082ms 0.2494ms 4.0096 KOps/s 2.6770 KOps/s $\textbf{\color{#35bf28}+49.78\%}$
test_compile_add_self_flat[tensorclass-eager] 0.1377ms 90.1518μs 11.0924 KOps/s 10.9329 KOps/s $\color{#35bf28}+1.46\%$
test_compile_add_self_flat[tensorclass-compile] 0.2810ms 0.1878ms 5.3245 KOps/s 4.8141 KOps/s $\textbf{\color{#35bf28}+10.60\%}$
test_compile_add_self_flat[pytree-eager] 0.6909ms 0.4428ms 2.2585 KOps/s 2.3351 KOps/s $\color{#d91a1a}-3.28\%$
test_compile_add_self_flat[pytree-compile] 0.4101ms 0.1933ms 5.1742 KOps/s 4.9806 KOps/s $\color{#35bf28}+3.89\%$
test_compile_copy_flat[tensordict-compile] 68.1320μs 19.5893μs 51.0483 KOps/s 48.4735 KOps/s $\textbf{\color{#35bf28}+5.31\%}$
test_compile_copy_flat[tensordict-eager] 76.9210μs 41.0246μs 24.3756 KOps/s 24.4595 KOps/s $\color{#d91a1a}-0.34\%$
test_compile_copy_flat[pytree-compile] 0.1319ms 21.2450μs 47.0700 KOps/s 46.9412 KOps/s $\color{#35bf28}+0.27\%$
test_compile_copy_flat[pytree-eager] 0.3358ms 52.3136μs 19.1155 KOps/s 19.2205 KOps/s $\color{#d91a1a}-0.55\%$
test_compile_assign_and_add[tensordict-compile] 2.1954ms 0.2405ms 4.1585 KOps/s 3.8243 KOps/s $\textbf{\color{#35bf28}+8.74\%}$
test_compile_assign_and_add[tensordict-eager] 3.4891ms 3.3136ms 301.7859 Ops/s 303.8049 Ops/s $\color{#d91a1a}-0.66\%$
test_compile_assign_and_add[pytree-compile] 2.0848ms 0.1799ms 5.5597 KOps/s 5.4362 KOps/s $\color{#35bf28}+2.27\%$
test_compile_assign_and_add[pytree-eager] 3.0164ms 2.8546ms 350.3069 Ops/s 364.7507 Ops/s $\color{#d91a1a}-3.96\%$
test_compile_indexing[tensor-tensordict-compile] 0.3419ms 0.1347ms 7.4258 KOps/s 6.9171 KOps/s $\textbf{\color{#35bf28}+7.35\%}$
test_compile_indexing[tensor-tensordict-eager] 0.3212ms 75.0844μs 13.3184 KOps/s 12.8841 KOps/s $\color{#35bf28}+3.37\%$
test_compile_indexing[tensor-tensorclass-compile] 0.2353ms 0.1180ms 8.4725 KOps/s 7.9440 KOps/s $\textbf{\color{#35bf28}+6.65\%}$
test_compile_indexing[tensor-tensorclass-eager] 0.2591ms 45.6310μs 21.9149 KOps/s 21.1933 KOps/s $\color{#35bf28}+3.41\%$
test_compile_indexing[tensor-pytree-compile] 0.1766ms 0.1197ms 8.3575 KOps/s 7.8550 KOps/s $\textbf{\color{#35bf28}+6.40\%}$
test_compile_indexing[tensor-pytree-eager] 0.2723ms 45.7770μs 21.8451 KOps/s 21.3139 KOps/s $\color{#35bf28}+2.49\%$
test_compile_indexing[slice-tensordict-compile] 0.1707ms 83.9750μs 11.9083 KOps/s 11.9578 KOps/s $\color{#d91a1a}-0.41\%$
test_compile_indexing[slice-tensordict-eager] 0.2067ms 31.5201μs 31.7258 KOps/s 36.6649 KOps/s $\textbf{\color{#d91a1a}-13.47\%}$
test_compile_indexing[slice-tensorclass-compile] 0.1913ms 70.6437μs 14.1555 KOps/s 14.2300 KOps/s $\color{#d91a1a}-0.52\%$
test_compile_indexing[slice-tensorclass-eager] 0.2401ms 22.2512μs 44.9413 KOps/s 44.7767 KOps/s $\color{#35bf28}+0.37\%$
test_compile_indexing[slice-pytree-compile] 0.1131ms 70.9734μs 14.0898 KOps/s 13.9968 KOps/s $\color{#35bf28}+0.66\%$
test_compile_indexing[slice-pytree-eager] 0.2370ms 22.1937μs 45.0578 KOps/s 44.6435 KOps/s $\color{#35bf28}+0.93\%$
test_compile_indexing[int-tensordict-compile] 0.1317ms 83.8797μs 11.9218 KOps/s 11.7995 KOps/s $\color{#35bf28}+1.04\%$
test_compile_indexing[int-tensordict-eager] 0.2575ms 27.7895μs 35.9848 KOps/s 36.9812 KOps/s $\color{#d91a1a}-2.69\%$
test_compile_indexing[int-tensorclass-compile] 0.1191ms 70.8607μs 14.1122 KOps/s 14.2053 KOps/s $\color{#d91a1a}-0.66\%$
test_compile_indexing[int-tensorclass-eager] 0.2540ms 22.1386μs 45.1699 KOps/s 45.1001 KOps/s $\color{#35bf28}+0.15\%$
test_compile_indexing[int-pytree-compile] 0.1223ms 70.6522μs 14.1539 KOps/s 14.1073 KOps/s $\color{#35bf28}+0.33\%$
test_compile_indexing[int-pytree-eager] 0.2306ms 22.0786μs 45.2928 KOps/s 44.4403 KOps/s $\color{#35bf28}+1.92\%$
test_compile_replace[single-eager] 0.1019ms 48.3590μs 20.6787 KOps/s 20.2252 KOps/s $\color{#35bf28}+2.24\%$
test_compile_replace[single-compile] 0.2336ms 0.1302ms 7.6809 KOps/s 7.5262 KOps/s $\color{#35bf28}+2.06\%$
test_compile_replace[multi-eager] 0.6530ms 0.5739ms 1.7424 KOps/s 1.7807 KOps/s $\color{#d91a1a}-2.15\%$
test_compile_replace[multi-compile] 0.2866ms 0.1371ms 7.2939 KOps/s 7.0668 KOps/s $\color{#35bf28}+3.21\%$
test_compile_tc_getattr_20[eager] 0.2861ms 0.1753ms 5.7057 KOps/s 6.1759 KOps/s $\textbf{\color{#d91a1a}-7.61\%}$
test_compile_tc_getattr_20[compile] 0.3725ms 0.1470ms 6.8035 KOps/s 6.6095 KOps/s $\color{#35bf28}+2.93\%$
test_compile_clone_shallow[20-eager] 50.8210μs 19.2134μs 52.0470 KOps/s 52.1220 KOps/s $\color{#d91a1a}-0.14\%$
test_compile_clone_shallow[20-compile] 54.2610μs 16.9399μs 59.0323 KOps/s 59.8540 KOps/s $\color{#d91a1a}-1.37\%$
test_compile_clone_shallow[40-eager] 68.2520μs 34.0834μs 29.3398 KOps/s 29.3011 KOps/s $\color{#35bf28}+0.13\%$
test_compile_clone_shallow[40-compile] 81.9510μs 18.5941μs 53.7806 KOps/s 53.0382 KOps/s $\color{#35bf28}+1.40\%$
test_compile_clone_shallow[80-eager] 0.1008ms 63.4585μs 15.7583 KOps/s 15.8533 KOps/s $\color{#d91a1a}-0.60\%$
test_compile_clone_shallow[80-compile] 77.7820μs 22.2867μs 44.8697 KOps/s 45.1407 KOps/s $\color{#d91a1a}-0.60\%$
test_compile_update_inplace[eager] 99.9420μs 60.4768μs 16.5353 KOps/s 16.1394 KOps/s $\color{#35bf28}+2.45\%$
test_compile_update_inplace[compile] 0.2999ms 0.1466ms 6.8190 KOps/s 6.7041 KOps/s $\color{#35bf28}+1.71\%$
test_mod_add[eager] 0.2874ms 0.2276ms 4.3938 KOps/s 4.4297 KOps/s $\color{#d91a1a}-0.81\%$
test_mod_add[compile] 0.3145ms 0.1338ms 7.4715 KOps/s 7.0798 KOps/s $\textbf{\color{#35bf28}+5.53\%}$
test_mod_add[compile-overhead] 0.3679ms 0.1762ms 5.6740 KOps/s 5.3816 KOps/s $\textbf{\color{#35bf28}+5.43\%}$
test_mod_wrap[eager] 0.5879ms 0.4721ms 2.1181 KOps/s 2.0722 KOps/s $\color{#35bf28}+2.21\%$
test_mod_wrap[compile] 0.4932ms 0.3997ms 2.5019 KOps/s 2.4321 KOps/s $\color{#35bf28}+2.87\%$
test_mod_wrap[compile-overhead] 8.2051ms 4.4115ms 226.6805 Ops/s 214.7225 Ops/s $\textbf{\color{#35bf28}+5.57\%}$
test_mod_wrap_and_backward[eager] 1.8166ms 1.6984ms 588.7932 Ops/s 555.1287 Ops/s $\textbf{\color{#35bf28}+6.06\%}$
test_mod_wrap_and_backward[compile] 2.3689ms 1.5864ms 630.3412 Ops/s 649.7423 Ops/s $\color{#d91a1a}-2.99\%$
test_mod_wrap_and_backward[compile-overhead] 1.3538ms 0.9420ms 1.0615 KOps/s 1.0407 KOps/s $\color{#35bf28}+2.00\%$
test_seq_add[eager] 0.6238ms 0.5151ms 1.9415 KOps/s 1.9556 KOps/s $\color{#d91a1a}-0.72\%$
test_seq_add[compile] 0.2399ms 0.1425ms 7.0157 KOps/s 6.6077 KOps/s $\textbf{\color{#35bf28}+6.17\%}$
test_seq_add[compile-overhead] 0.3046ms 0.1814ms 5.5115 KOps/s 5.2560 KOps/s $\color{#35bf28}+4.86\%$
test_seq_wrap[eager] 1.4967ms 1.4187ms 704.8669 Ops/s 709.8925 Ops/s $\color{#d91a1a}-0.71\%$
test_seq_wrap[compile] 0.5090ms 0.4103ms 2.4375 KOps/s 2.3747 KOps/s $\color{#35bf28}+2.64\%$
test_seq_wrap[compile-overhead] 0.3731ms 0.3035ms 3.2954 KOps/s 3.2247 KOps/s $\color{#35bf28}+2.19\%$
test_func_call_runtime[False-eager] 0.9026ms 0.8071ms 1.2391 KOps/s 1.2556 KOps/s $\color{#d91a1a}-1.32\%$
test_func_call_runtime[False-compile] 1.0852ms 0.9912ms 1.0089 KOps/s 1.0164 KOps/s $\color{#d91a1a}-0.74\%$
test_func_call_runtime[False-compile-overhead] 0.5775ms 0.5124ms 1.9517 KOps/s 1.9373 KOps/s $\color{#35bf28}+0.75\%$
test_func_call_runtime[True-eager] 1.1381ms 1.0728ms 932.0974 Ops/s 937.5427 Ops/s $\color{#d91a1a}-0.58\%$
test_func_call_runtime[True-compile] 1.1152ms 1.0065ms 993.5593 Ops/s 1.0009 KOps/s $\color{#d91a1a}-0.74\%$
test_func_call_runtime[True-compile-overhead] 0.6583ms 0.5257ms 1.9023 KOps/s 1.8809 KOps/s $\color{#35bf28}+1.14\%$
test_func_call_cm_runtime[False-eager] 0.9412ms 0.8072ms 1.2389 KOps/s 1.2520 KOps/s $\color{#d91a1a}-1.05\%$
test_func_call_cm_runtime[False-compile] 1.1419ms 0.9668ms 1.0343 KOps/s 1.0363 KOps/s $\color{#d91a1a}-0.19\%$
test_func_call_cm_runtime[False-compile-overhead] 0.6287ms 0.4919ms 2.0329 KOps/s 2.0157 KOps/s $\color{#35bf28}+0.85\%$
test_func_call_cm_runtime[True-eager] 1.3241ms 1.2230ms 817.6537 Ops/s 822.6314 Ops/s $\color{#d91a1a}-0.61\%$
test_func_call_cm_runtime[True-compile] 1.0966ms 1.0283ms 972.4608 Ops/s 978.5322 Ops/s $\color{#d91a1a}-0.62\%$
test_func_call_cm_runtime[True-compile-overhead] 0.7041ms 0.5471ms 1.8279 KOps/s 1.7868 KOps/s $\color{#35bf28}+2.30\%$
test_vmap_func_call_cm_runtime[eager] 2.8399ms 2.4054ms 415.7330 Ops/s 413.2977 Ops/s $\color{#35bf28}+0.59\%$
test_vmap_func_call_cm_runtime[compile] 3.0767ms 2.5940ms 385.4993 Ops/s 384.3923 Ops/s $\color{#35bf28}+0.29\%$
test_vmap_func_call_cm_runtime[compile-overhead] 3.0777ms 2.5947ms 385.4072 Ops/s 384.7733 Ops/s $\color{#35bf28}+0.16\%$
test_distributed 0.5887ms 0.1492ms 6.7006 KOps/s 5.7150 KOps/s $\textbf{\color{#35bf28}+17.25\%}$
test_tdmodule 0.2939ms 0.1929ms 5.1838 KOps/s 5.1911 KOps/s $\color{#d91a1a}-0.14\%$
test_tdmodule_dispatch 0.4244ms 0.3731ms 2.6801 KOps/s 2.6713 KOps/s $\color{#35bf28}+0.33\%$
test_tdseq 53.8010μs 27.4215μs 36.4678 KOps/s 37.3933 KOps/s $\color{#d91a1a}-2.48\%$
test_tdseq_dispatch 0.2641ms 0.2183ms 4.5806 KOps/s 4.5994 KOps/s $\color{#d91a1a}-0.41\%$
test_instantiation_functorch 2.1714ms 2.0838ms 479.8982 Ops/s 485.3421 Ops/s $\color{#d91a1a}-1.12\%$
test_exec_functorch 0.2451ms 0.1844ms 5.4222 KOps/s 5.5552 KOps/s $\color{#d91a1a}-2.39\%$
test_exec_functional_call 0.2261ms 0.1643ms 6.0865 KOps/s 6.2011 KOps/s $\color{#d91a1a}-1.85\%$
test_exec_td_decorator 0.4909ms 0.2531ms 3.9517 KOps/s 3.9673 KOps/s $\color{#d91a1a}-0.39\%$
test_vmap_mlp_speed_decorator[True-True] 1.2366ms 1.0441ms 957.8049 Ops/s 967.3099 Ops/s $\color{#d91a1a}-0.98\%$
test_vmap_mlp_speed_decorator[True-False] 1.2139ms 1.0422ms 959.5255 Ops/s 964.6974 Ops/s $\color{#d91a1a}-0.54\%$
test_vmap_mlp_speed_decorator[False-True] 0.9177ms 0.7399ms 1.3515 KOps/s 1.3502 KOps/s $\color{#35bf28}+0.09\%$
test_vmap_mlp_speed_decorator[False-False] 0.9505ms 0.7403ms 1.3508 KOps/s 1.3599 KOps/s $\color{#d91a1a}-0.67\%$
test_vmap_transformer_speed_decorator[True-True] 22.0345ms 21.1972ms 47.1760 Ops/s 46.3180 Ops/s $\color{#35bf28}+1.85\%$
test_vmap_transformer_speed_decorator[True-False] 21.9945ms 21.1975ms 47.1754 Ops/s 46.3299 Ops/s $\color{#35bf28}+1.82\%$
test_vmap_transformer_speed_decorator[False-True] 21.6939ms 20.9060ms 47.8331 Ops/s 47.3447 Ops/s $\color{#35bf28}+1.03\%$
test_vmap_transformer_speed_decorator[False-False] 21.3073ms 20.8392ms 47.9864 Ops/s 47.3239 Ops/s $\color{#35bf28}+1.40\%$
test_to_module_speed[True] 1.7293ms 1.6326ms 612.5267 Ops/s 602.1145 Ops/s $\color{#35bf28}+1.73\%$
test_to_module_speed[False] 1.7189ms 1.6116ms 620.5004 Ops/s 617.8386 Ops/s $\color{#35bf28}+0.43\%$
test_to_module_plain_tensor_speed[None] 2.4673ms 1.7289ms 578.3926 Ops/s 580.2010 Ops/s $\color{#d91a1a}-0.31\%$
test_to_module_plain_tensor_speed[False] 2.1693ms 1.5532ms 643.8400 Ops/s 634.7198 Ops/s $\color{#35bf28}+1.44\%$
test_to_module_plain_tensor_speed[True] 3.5073ms 3.3884ms 295.1211 Ops/s 292.7521 Ops/s $\color{#35bf28}+0.81\%$
test_tc_init 93.2820μs 42.8277μs 23.3494 KOps/s 23.1132 KOps/s $\color{#35bf28}+1.02\%$
test_tc_init_tensor_only 34.2100μs 8.9979μs 111.1376 KOps/s 111.0095 KOps/s $\color{#35bf28}+0.12\%$
test_tc_init_nested 0.1228ms 83.7463μs 11.9408 KOps/s 11.9445 KOps/s $\color{#d91a1a}-0.03\%$
test_tc_init_many_fields 34.4510μs 14.8384μs 67.3929 KOps/s 67.0380 KOps/s $\color{#35bf28}+0.53\%$
test_tc_first_layer_tensor 30.5500μs 1.7978μs 556.2465 KOps/s 558.1315 KOps/s $\color{#d91a1a}-0.34\%$
test_tc_first_layer_tensor_only 1.7571μs 0.3894μs 2.5679 MOps/s 2.5761 MOps/s $\color{#d91a1a}-0.32\%$
test_tc_first_layer_tensor_set 33.2700μs 3.8906μs 257.0321 KOps/s 254.4345 KOps/s $\color{#35bf28}+1.02\%$
test_tc_first_layer_tensor_only_set 34.6010μs 3.2428μs 308.3797 KOps/s 305.5214 KOps/s $\color{#35bf28}+0.94\%$
test_tc_first_layer_nontensor 32.5900μs 6.0760μs 164.5808 KOps/s 156.9342 KOps/s $\color{#35bf28}+4.87\%$
test_tc_second_layer_tensor 26.3800μs 4.3691μs 228.8803 KOps/s 226.9694 KOps/s $\color{#35bf28}+0.84\%$
test_tc_second_layer_nontensor 36.2000μs 8.5654μs 116.7485 KOps/s 115.3187 KOps/s $\color{#35bf28}+1.24\%$
test_unbind 0.2696s 13.6563ms 73.2265 Ops/s 66.9763 Ops/s $\textbf{\color{#35bf28}+9.33\%}$
test_full_like 4.4519ms 4.3570ms 229.5152 Ops/s 233.0244 Ops/s $\color{#d91a1a}-1.51\%$
test_zeros_like 4.7076ms 4.3458ms 230.1087 Ops/s 229.1739 Ops/s $\color{#35bf28}+0.41\%$
test_ones_like 4.4800ms 4.3508ms 229.8440 Ops/s 227.9692 Ops/s $\color{#35bf28}+0.82\%$
test_clone 6.6106ms 6.4303ms 155.5141 Ops/s 155.5210 Ops/s $-0.00\%$
test_squeeze 67.9210μs 14.5477μs 68.7394 KOps/s 70.2544 KOps/s $\color{#d91a1a}-2.16\%$
test_unsqueeze 0.1706ms 0.1158ms 8.6327 KOps/s 8.7162 KOps/s $\color{#d91a1a}-0.96\%$
test_split 0.3847ms 0.1833ms 5.4564 KOps/s 5.5019 KOps/s $\color{#d91a1a}-0.83\%$
test_permute 0.2660ms 0.2088ms 4.7884 KOps/s 4.7191 KOps/s $\color{#35bf28}+1.47\%$
test_stack 37.8294ms 35.2031ms 28.4066 Ops/s 38.7220 Ops/s $\textbf{\color{#d91a1a}-26.64\%}$
test_cat 43.6304ms 43.1131ms 23.1948 Ops/s 37.7130 Ops/s $\textbf{\color{#d91a1a}-38.50\%}$
test_sequential_tensordict 1.0629ms 0.5816ms 1.7195 KOps/s 1.7472 KOps/s $\color{#d91a1a}-1.59\%$
test_sequential_graph_module 0.1814ms 0.1212ms 8.2483 KOps/s 8.5068 KOps/s $\color{#d91a1a}-3.04\%$
test_nested_tensordict 1.7491ms 0.8274ms 1.2086 KOps/s 1.2228 KOps/s $\color{#d91a1a}-1.16\%$
test_nested_graph_module 0.1795ms 0.1293ms 7.7343 KOps/s 7.8359 KOps/s $\color{#d91a1a}-1.30\%$

@vmoens
vmoens merged commit 693066f into main Jun 12, 2026
73 of 74 checks passed
@vmoens
vmoens deleted the fix-nightly-macos-deployment-target branch June 12, 2026 19:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CI CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant