Skip to content

[CI] Fix M1 wheel builds broken by py3.14 runner base conda - #1737

Merged
vmoens merged 1 commit into
mainfrom
fix-m1-wheels-py314-conda
Jul 9, 2026
Merged

[CI] Fix M1 wheel builds broken by py3.14 runner base conda#1737
vmoens merged 1 commit into
mainfrom
fix-m1-wheels-py314-conda

Conversation

@vmoens

@vmoens vmoens commented Jul 9, 2026

Copy link
Copy Markdown
Collaborator

Problem

Build M1 Wheels runs started failing around 2026-07-08 20:00 UTC, on every branch and every matrix python version (the py3.10 job fails just like the others). Example: https://github.com/pytorch/tensordict/actions/runs/29003865594

Root cause: the M1 runners' preinstalled Homebrew miniconda base environment was updated to Python 3.14. test-infra's setup-binary-builds action runs conda install -y conda=25.3.0 in the active (base) env, which now fails with:

LibMambaUnsatisfiableError: Encountered problems while solving:
└─ pin on python =3.14 * is not installable because it requires
   └─ python =3.14 *, which conflicts with any installable versions previously reported.

conda=25.3.0 has no Python 3.14 build — the defaults channel only ships py3.14 conda builds from 26.1.0 onward. The failure is unrelated to the build matrix (the python=3.14 pin is the runner base env's own python), so excluding 3.14 from the matrix would not help. Occasional green runs just mean the job landed on a runner whose base env hasn't been updated yet. pytorch/rl and pytorch/vision's M1 wheel builds broke the same way at the same time.

Fix

Pass setup-miniconda: true to the reusable build_wheels_macos.yml workflow, same as pytorch/rl#3960. The job then provisions a fresh miniconda via conda-incubator/setup-miniconda with an active py3.10 env, where the conda=25.3.0 pin still solves. pytorch/executorch already uses this configuration and its macOS wheel builds stayed green after the runner update.

This is a workaround until pytorch/test-infra bumps its conda pin to a py3.14-compatible version (>=26.1); pytorch/test-infra#7951 tracks bumping that pin.

The Build M1 Wheels run on this PR is the verification.

🤖 Generated with Claude Code

@vmoens @claude
[CI] Fix M1 wheel builds broken by py3.14 runner base conda
7a37553 
The M1 runners' Homebrew miniconda base env moved to python 3.14, where
test-infra's setup-binary-builds `conda install -y conda=25.3.0` fails
with LibMambaUnsatisfiableError (no py3.14 build of conda 25.3.0 exists).
Pass setup-miniconda: true so the job provisions a fresh miniconda with
an active py3.10 env where the pin still solves.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jul 9, 2026
@vmoens
vmoens merged commit c6277be into main Jul 9, 2026
58 of 71 checks passed
@github-actions

github-actions Bot commented Jul 9, 2026

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large&amp;#x26A0;\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 344. Improved: $\large\color{#35bf28}15$. Worsened: $\large\color{#d91a1a}23$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_collector_preallocated_write[stack_out-cpu-32-2] 0.2104ms 0.1655ms 6.0435 KOps/s 6.1350 KOps/s $\color{#d91a1a}-1.49\%$
test_collector_preallocated_write[stack_out-cpu-32-8] 0.3826ms 0.2951ms 3.3882 KOps/s 3.3824 KOps/s $\color{#35bf28}+0.17\%$
test_collector_preallocated_write[stack_out-cpu-32-32] 0.8840ms 0.7855ms 1.2731 KOps/s 1.2657 KOps/s $\color{#35bf28}+0.58\%$
test_collector_preallocated_write[stack_out-cpu-4096-2] 0.3868ms 0.3361ms 2.9754 KOps/s 2.9547 KOps/s $\color{#35bf28}+0.70\%$
test_collector_preallocated_write[stack_out-cpu-4096-8] 1.2533ms 1.1137ms 897.9397 Ops/s 916.5283 Ops/s $\color{#d91a1a}-2.03\%$
test_collector_preallocated_write[stack_out-cpu-4096-32] 7.6559ms 7.3964ms 135.2017 Ops/s 134.3508 Ops/s $\color{#35bf28}+0.63\%$
test_collector_preallocated_write[stack_out-cuda-32-2] 0.3185ms 0.2519ms 3.9699 KOps/s 3.9946 KOps/s $\color{#d91a1a}-0.62\%$
test_collector_preallocated_write[stack_out-cuda-32-8] 0.5109ms 0.3733ms 2.6789 KOps/s 2.6491 KOps/s $\color{#35bf28}+1.12\%$
test_collector_preallocated_write[stack_out-cuda-32-32] 0.9249ms 0.8329ms 1.2006 KOps/s 1.1996 KOps/s $\color{#35bf28}+0.08\%$
test_collector_preallocated_write[stack_out-cuda-4096-2] 0.3987ms 0.2569ms 3.8919 KOps/s 3.8606 KOps/s $\color{#35bf28}+0.81\%$
test_collector_preallocated_write[stack_out-cuda-4096-8] 0.4830ms 0.3735ms 2.6772 KOps/s 2.6608 KOps/s $\color{#35bf28}+0.62\%$
test_collector_preallocated_write[stack_out-cuda-4096-32] 0.9804ms 0.8886ms 1.1253 KOps/s 1.1246 KOps/s $\color{#35bf28}+0.06\%$
test_collector_preallocated_write[set_at_loop-cpu-32-2] 0.2696ms 0.2108ms 4.7431 KOps/s 4.7417 KOps/s $\color{#35bf28}+0.03\%$
test_collector_preallocated_write[set_at_loop-cpu-32-8] 0.9217ms 0.8152ms 1.2267 KOps/s 1.2678 KOps/s $\color{#d91a1a}-3.24\%$
test_collector_preallocated_write[set_at_loop-cpu-32-32] 3.3879ms 3.2145ms 311.0905 Ops/s 312.0301 Ops/s $\color{#d91a1a}-0.30\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-2] 0.6368ms 0.3760ms 2.6596 KOps/s 2.7713 KOps/s $\color{#d91a1a}-4.03\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-8] 2.0431ms 1.7753ms 563.2761 Ops/s 631.7274 Ops/s $\textbf{\color{#d91a1a}-10.84\%}$
test_collector_preallocated_write[set_at_loop-cpu-4096-32] 10.3897ms 10.0686ms 99.3182 Ops/s 98.7183 Ops/s $\color{#35bf28}+0.61\%$
test_collector_preallocated_write[set_at_loop-cuda-32-2] 0.4581ms 0.4053ms 2.4671 KOps/s 2.6136 KOps/s $\textbf{\color{#d91a1a}-5.61\%}$
test_collector_preallocated_write[set_at_loop-cuda-32-8] 1.6093ms 1.5239ms 656.2255 Ops/s 702.7124 Ops/s $\textbf{\color{#d91a1a}-6.62\%}$
test_collector_preallocated_write[set_at_loop-cuda-32-32] 6.2104ms 6.0100ms 166.3900 Ops/s 167.1627 Ops/s $\color{#d91a1a}-0.46\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-2] 0.4802ms 0.4103ms 2.4372 KOps/s 2.4624 KOps/s $\color{#d91a1a}-1.03\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-8] 1.6208ms 1.5486ms 645.7559 Ops/s 661.9346 Ops/s $\color{#d91a1a}-2.44\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-32] 6.1768ms 6.0924ms 164.1388 Ops/s 176.5299 Ops/s $\textbf{\color{#d91a1a}-7.02\%}$
test_collector_preallocated_write[copy_at-cpu-32-2] 0.5342ms 0.1721ms 5.8094 KOps/s 5.8606 KOps/s $\color{#d91a1a}-0.87\%$
test_collector_preallocated_write[copy_at-cpu-32-8] 0.7645ms 0.6617ms 1.5113 KOps/s 1.5145 KOps/s $\color{#d91a1a}-0.21\%$
test_collector_preallocated_write[copy_at-cpu-32-32] 2.8956ms 2.6501ms 377.3387 Ops/s 382.1152 Ops/s $\color{#d91a1a}-1.25\%$
test_collector_preallocated_write[copy_at-cpu-4096-2] 0.3938ms 0.3191ms 3.1340 KOps/s 3.1062 KOps/s $\color{#35bf28}+0.89\%$
test_collector_preallocated_write[copy_at-cpu-4096-8] 3.3328ms 1.4911ms 670.6286 Ops/s 696.8967 Ops/s $\color{#d91a1a}-3.77\%$
test_collector_preallocated_write[copy_at-cpu-4096-32] 9.8252ms 9.5044ms 105.2145 Ops/s 106.0217 Ops/s $\color{#d91a1a}-0.76\%$
test_collector_preallocated_write[copy_at-cuda-32-2] 0.3858ms 0.3235ms 3.0916 KOps/s 3.1432 KOps/s $\color{#d91a1a}-1.64\%$
test_collector_preallocated_write[copy_at-cuda-32-8] 1.3523ms 1.2038ms 830.6723 Ops/s 846.9596 Ops/s $\color{#d91a1a}-1.92\%$
test_collector_preallocated_write[copy_at-cuda-32-32] 4.8008ms 4.7039ms 212.5907 Ops/s 217.4805 Ops/s $\color{#d91a1a}-2.25\%$
test_collector_preallocated_write[copy_at-cuda-4096-2] 0.4214ms 0.3243ms 3.0835 KOps/s 3.1041 KOps/s $\color{#d91a1a}-0.66\%$
test_collector_preallocated_write[copy_at-cuda-4096-8] 1.3056ms 1.2124ms 824.7964 Ops/s 844.8397 Ops/s $\color{#d91a1a}-2.37\%$
test_collector_preallocated_write[copy_at-cuda-4096-32] 4.8562ms 4.7418ms 210.8900 Ops/s 215.4434 Ops/s $\color{#d91a1a}-2.11\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-2] 0.1572ms 0.1201ms 8.3251 KOps/s 8.6028 KOps/s $\color{#d91a1a}-3.23\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-8] 0.5395ms 0.4704ms 2.1259 KOps/s 2.1962 KOps/s $\color{#d91a1a}-3.20\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-32] 8.7114ms 1.8726ms 534.0045 Ops/s 532.8724 Ops/s $\color{#35bf28}+0.21\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-2] 0.4923ms 0.2657ms 3.7635 KOps/s 3.9873 KOps/s $\textbf{\color{#d91a1a}-5.61\%}$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-8] 1.4435ms 1.2564ms 795.9478 Ops/s 842.3246 Ops/s $\textbf{\color{#d91a1a}-5.51\%}$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-32] 8.7719ms 8.5457ms 117.0179 Ops/s 118.2538 Ops/s $\color{#d91a1a}-1.05\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-2] 0.3344ms 0.2766ms 3.6157 KOps/s 3.7325 KOps/s $\color{#d91a1a}-3.13\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-8] 1.1739ms 1.0288ms 971.9648 Ops/s 947.2044 Ops/s $\color{#35bf28}+2.61\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-32] 4.3590ms 4.2247ms 236.7027 Ops/s 241.6649 Ops/s $\color{#d91a1a}-2.05\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-2] 0.3412ms 0.2900ms 3.4487 KOps/s 3.6870 KOps/s $\textbf{\color{#d91a1a}-6.46\%}$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-8] 1.1340ms 1.0694ms 935.1305 Ops/s 1.0063 KOps/s $\textbf{\color{#d91a1a}-7.07\%}$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-32] 4.2845ms 4.0418ms 247.4127 Ops/s 256.3983 Ops/s $\color{#d91a1a}-3.50\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-128] 16.7871ms 16.5214ms 60.5277 Ops/s 60.3823 Ops/s $\color{#35bf28}+0.24\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-256] 33.6114ms 33.3241ms 30.0083 Ops/s 29.9323 Ops/s $\color{#35bf28}+0.25\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-128] 88.6430ms 86.1412ms 11.6089 Ops/s 11.9313 Ops/s $\color{#d91a1a}-2.70\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-256] 0.2023s 0.2012s 4.9693 Ops/s 5.0254 Ops/s $\color{#d91a1a}-1.12\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-128] 13.9464ms 13.7967ms 72.4811 Ops/s 71.9428 Ops/s $\color{#35bf28}+0.75\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-256] 27.2286ms 27.0565ms 36.9597 Ops/s 36.8434 Ops/s $\color{#35bf28}+0.32\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-128] 14.2347ms 14.0451ms 71.1993 Ops/s 70.9982 Ops/s $\color{#35bf28}+0.28\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-256] 27.5592ms 27.3107ms 36.6157 Ops/s 36.6115 Ops/s $\color{#35bf28}+0.01\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-128] 53.0371ms 51.5837ms 19.3860 Ops/s 20.0101 Ops/s $\color{#d91a1a}-3.12\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-256] 0.1051s 0.1034s 9.6678 Ops/s 9.8776 Ops/s $\color{#d91a1a}-2.12\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-128] 0.1460s 0.1452s 6.8871 Ops/s 6.9862 Ops/s $\color{#d91a1a}-1.42\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-256] 0.3176s 0.3165s 3.1591 Ops/s 3.1905 Ops/s $\color{#d91a1a}-0.98\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-128] 78.8109ms 78.1176ms 12.8012 Ops/s 14.0604 Ops/s $\textbf{\color{#d91a1a}-8.96\%}$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-256] 0.1575s 0.1568s 6.3781 Ops/s 7.0133 Ops/s $\textbf{\color{#d91a1a}-9.06\%}$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-128] 78.8672ms 78.1249ms 12.8000 Ops/s 13.7769 Ops/s $\textbf{\color{#d91a1a}-7.09\%}$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-256] 0.1593s 0.1575s 6.3496 Ops/s 6.5528 Ops/s $\color{#d91a1a}-3.10\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-128] 30.4677ms 29.8196ms 33.5350 Ops/s 33.4154 Ops/s $\color{#35bf28}+0.36\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-256] 61.2938ms 60.3750ms 16.5631 Ops/s 16.4882 Ops/s $\color{#35bf28}+0.45\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-128] 0.1187s 0.1181s 8.4708 Ops/s 8.4145 Ops/s $\color{#35bf28}+0.67\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-256] 0.2640s 0.2630s 3.8025 Ops/s 3.8292 Ops/s $\color{#d91a1a}-0.70\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-128] 43.3572ms 43.1837ms 23.1569 Ops/s 23.6196 Ops/s $\color{#d91a1a}-1.96\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-256] 86.5723ms 86.3120ms 11.5859 Ops/s 11.8343 Ops/s $\color{#d91a1a}-2.10\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-128] 43.6030ms 43.4604ms 23.0094 Ops/s 23.4798 Ops/s $\color{#d91a1a}-2.00\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-256] 86.9349ms 86.7611ms 11.5259 Ops/s 11.7329 Ops/s $\color{#d91a1a}-1.76\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-128] 20.5557ms 20.2379ms 49.4122 Ops/s 50.5050 Ops/s $\color{#d91a1a}-2.16\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-256] 41.5643ms 41.3912ms 24.1597 Ops/s 24.6385 Ops/s $\color{#d91a1a}-1.94\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-128] 0.1093s 0.1085s 9.2149 Ops/s 9.3146 Ops/s $\color{#d91a1a}-1.07\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-256] 0.2444s 0.2425s 4.1232 Ops/s 4.1977 Ops/s $\color{#d91a1a}-1.78\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-128] 37.0740ms 36.6226ms 27.3056 Ops/s 26.8721 Ops/s $\color{#35bf28}+1.61\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-256] 73.8151ms 73.4351ms 13.6175 Ops/s 13.4152 Ops/s $\color{#35bf28}+1.51\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-128] 37.1633ms 36.8316ms 27.1506 Ops/s 27.1927 Ops/s $\color{#d91a1a}-0.15\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-256] 75.0386ms 74.4889ms 13.4248 Ops/s 14.1622 Ops/s $\textbf{\color{#d91a1a}-5.21\%}$
test_plain_set_nested 41.3710μs 15.2249μs 65.6818 KOps/s 65.7033 KOps/s $\color{#d91a1a}-0.03\%$
test_plain_set_stack_nested 55.1620μs 14.8234μs 67.4608 KOps/s 67.5914 KOps/s $\color{#d91a1a}-0.19\%$
test_plain_set_nested_inplace 56.0610μs 16.6220μs 60.1612 KOps/s 60.4740 KOps/s $\color{#d91a1a}-0.52\%$
test_plain_set_stack_nested_inplace 46.7910μs 16.1482μs 61.9265 KOps/s 62.0259 KOps/s $\color{#d91a1a}-0.16\%$
test_items 36.8310μs 6.0946μs 164.0808 KOps/s 164.6516 KOps/s $\color{#d91a1a}-0.35\%$
test_items_nested 0.5434ms 0.4538ms 2.2034 KOps/s 2.1837 KOps/s $\color{#35bf28}+0.90\%$
test_items_nested_locked 0.6712ms 0.4663ms 2.1448 KOps/s 2.1554 KOps/s $\color{#d91a1a}-0.49\%$
test_items_nested_leaf 0.1397ms 98.0492μs 10.1990 KOps/s 10.1960 KOps/s $\color{#35bf28}+0.03\%$
test_items_stack_nested 0.5457ms 0.4586ms 2.1803 KOps/s 2.1628 KOps/s $\color{#35bf28}+0.81\%$
test_items_stack_nested_leaf 0.1433ms 97.8976μs 10.2148 KOps/s 10.1237 KOps/s $\color{#35bf28}+0.90\%$
test_items_stack_nested_locked 0.5486ms 0.4639ms 2.1558 KOps/s 2.1869 KOps/s $\color{#d91a1a}-1.42\%$
test_keys 38.8810μs 4.1770μs 239.4064 KOps/s 239.0679 KOps/s $\color{#35bf28}+0.14\%$
test_keys_nested 0.1653ms 0.1304ms 7.6714 KOps/s 7.7771 KOps/s $\color{#d91a1a}-1.36\%$
test_keys_nested_locked 0.7423ms 0.1396ms 7.1624 KOps/s 7.2681 KOps/s $\color{#d91a1a}-1.46\%$
test_keys_nested_leaf 0.1727ms 0.1211ms 8.2582 KOps/s 8.3258 KOps/s $\color{#d91a1a}-0.81\%$
test_keys_stack_nested 0.1798ms 0.1295ms 7.7194 KOps/s 7.7559 KOps/s $\color{#d91a1a}-0.47\%$
test_keys_stack_nested_leaf 0.1872ms 0.1191ms 8.3937 KOps/s 8.3765 KOps/s $\color{#35bf28}+0.21\%$
test_keys_stack_nested_locked 0.1897ms 0.1371ms 7.2966 KOps/s 7.3293 KOps/s $\color{#d91a1a}-0.45\%$
test_values 3.3770μs 0.9978μs 1.0022 MOps/s 984.1186 KOps/s $\color{#35bf28}+1.83\%$
test_values_nested 90.9820μs 52.7087μs 18.9722 KOps/s 19.0628 KOps/s $\color{#d91a1a}-0.48\%$
test_values_nested_locked 98.5620μs 56.2977μs 17.7627 KOps/s 17.9270 KOps/s $\color{#d91a1a}-0.92\%$
test_values_nested_leaf 94.8530μs 61.0821μs 16.3714 KOps/s 16.5793 KOps/s $\color{#d91a1a}-1.25\%$
test_values_stack_nested 93.5230μs 52.6534μs 18.9921 KOps/s 18.9627 KOps/s $\color{#35bf28}+0.16\%$
test_values_stack_nested_leaf 90.9220μs 60.5437μs 16.5170 KOps/s 16.6839 KOps/s $\color{#d91a1a}-1.00\%$
test_values_stack_nested_locked 0.1158ms 55.9548μs 17.8716 KOps/s 17.9821 KOps/s $\color{#d91a1a}-0.61\%$
test_membership 6.0318μs 0.8347μs 1.1980 MOps/s 1.1816 MOps/s $\color{#35bf28}+1.39\%$
test_membership_nested 29.8010μs 2.9415μs 339.9631 KOps/s 336.8266 KOps/s $\color{#35bf28}+0.93\%$
test_membership_nested_leaf 17.8405μs 2.8421μs 351.8503 KOps/s 351.8103 KOps/s $\color{#35bf28}+0.01\%$
test_membership_stacked_nested 22.3500μs 2.8501μs 350.8590 KOps/s 348.7582 KOps/s $\color{#35bf28}+0.60\%$
test_membership_stacked_nested_leaf 27.6510μs 2.8465μs 351.3061 KOps/s 344.8331 KOps/s $\color{#35bf28}+1.88\%$
test_membership_nested_last 37.6410μs 4.4555μs 224.4437 KOps/s 223.5547 KOps/s $\color{#35bf28}+0.40\%$
test_membership_nested_leaf_last 35.5710μs 4.4395μs 225.2514 KOps/s 224.5894 KOps/s $\color{#35bf28}+0.29\%$
test_membership_stacked_nested_last 40.8710μs 4.2946μs 232.8503 KOps/s 234.5662 KOps/s $\color{#d91a1a}-0.73\%$
test_membership_stacked_nested_leaf_last 54.7810μs 4.2910μs 233.0442 KOps/s 233.6515 KOps/s $\color{#d91a1a}-0.26\%$
test_nested_getleaf 57.1220μs 21.4672μs 46.5827 KOps/s 46.6860 KOps/s $\color{#d91a1a}-0.22\%$
test_nested_get 47.5010μs 20.3151μs 49.2245 KOps/s 49.6801 KOps/s $\color{#d91a1a}-0.92\%$
test_stacked_getleaf 50.7510μs 20.9201μs 47.8009 KOps/s 48.0269 KOps/s $\color{#d91a1a}-0.47\%$
test_stacked_get 52.1410μs 19.9718μs 50.0706 KOps/s 50.1128 KOps/s $\color{#d91a1a}-0.08\%$
test_nested_getitemleaf 50.9610μs 22.0723μs 45.3056 KOps/s 47.0446 KOps/s $\color{#d91a1a}-3.70\%$
test_nested_getitem 81.8720μs 20.7960μs 48.0861 KOps/s 47.6013 KOps/s $\color{#35bf28}+1.02\%$
test_stacked_getitemleaf 48.7910μs 21.5356μs 46.4347 KOps/s 46.2730 KOps/s $\color{#35bf28}+0.35\%$
test_stacked_getitem 51.4610μs 20.7077μs 48.2912 KOps/s 48.8330 KOps/s $\color{#d91a1a}-1.11\%$
test_lock_nested 5.2906ms 0.5073ms 1.9711 KOps/s 1.9875 KOps/s $\color{#d91a1a}-0.82\%$
test_lock_stack_nested 0.5943ms 0.5081ms 1.9679 KOps/s 1.9757 KOps/s $\color{#d91a1a}-0.39\%$
test_unlock_nested 0.4779ms 0.4008ms 2.4948 KOps/s 2.5221 KOps/s $\color{#d91a1a}-1.08\%$
test_unlock_stack_nested 0.4341ms 0.4011ms 2.4932 KOps/s 2.5019 KOps/s $\color{#d91a1a}-0.35\%$
test_flatten_speed 0.1689ms 0.1235ms 8.1002 KOps/s 8.0998 KOps/s $+0.01\%$
test_unflatten_speed 0.6109ms 0.5669ms 1.7639 KOps/s 1.7691 KOps/s $\color{#d91a1a}-0.29\%$
test_common_ops 0.8316ms 0.6925ms 1.4440 KOps/s 1.4280 KOps/s $\color{#35bf28}+1.12\%$
test_creation 0.1825ms 3.1771μs 314.7495 KOps/s 311.6876 KOps/s $\color{#35bf28}+0.98\%$
test_creation_empty 35.8510μs 7.0430μs 141.9858 KOps/s 141.8837 KOps/s $\color{#35bf28}+0.07\%$
test_creation_nested_1 42.7310μs 11.4106μs 87.6378 KOps/s 86.4283 KOps/s $\color{#35bf28}+1.40\%$
test_creation_nested_2 46.1110μs 13.3607μs 74.8462 KOps/s 73.8438 KOps/s $\color{#35bf28}+1.36\%$
test_creation_many_keys[10] 50.3720μs 20.9170μs 47.8081 KOps/s 46.8445 KOps/s $\color{#35bf28}+2.06\%$
test_creation_many_keys[50] 0.1323ms 90.1969μs 11.0869 KOps/s 10.9887 KOps/s $\color{#35bf28}+0.89\%$
test_creation_many_keys[100] 0.2147ms 0.1764ms 5.6686 KOps/s 5.5916 KOps/s $\color{#35bf28}+1.38\%$
test_creation_nested_many_keys[10] 77.4020μs 44.7410μs 22.3508 KOps/s 21.9873 KOps/s $\color{#35bf28}+1.65\%$
test_creation_nested_many_keys[50] 0.2451ms 0.1834ms 5.4534 KOps/s 5.3951 KOps/s $\color{#35bf28}+1.08\%$
test_clone 48.5010μs 12.8131μs 78.0452 KOps/s 78.5292 KOps/s $\color{#d91a1a}-0.62\%$
test_getitem[int] 1.4527ms 15.4189μs 64.8555 KOps/s 65.4212 KOps/s $\color{#d91a1a}-0.86\%$
test_getitem[slice_int] 0.1449ms 25.0710μs 39.8867 KOps/s 40.5266 KOps/s $\color{#d91a1a}-1.58\%$
test_getitem[range] 0.1809ms 65.4487μs 15.2791 KOps/s 16.1806 KOps/s $\textbf{\color{#d91a1a}-5.57\%}$
test_getitem[tuple] 0.1481ms 24.1204μs 41.4586 KOps/s 42.0278 KOps/s $\color{#d91a1a}-1.35\%$
test_getitem[list] 0.1879ms 59.8113μs 16.7193 KOps/s 17.4987 KOps/s $\color{#d91a1a}-4.45\%$
test_setitem_dim[int] 62.1020μs 26.5344μs 37.6869 KOps/s 39.7117 KOps/s $\textbf{\color{#d91a1a}-5.10\%}$
test_setitem_dim[slice_int] 64.4010μs 43.2971μs 23.0962 KOps/s 24.7140 KOps/s $\textbf{\color{#d91a1a}-6.55\%}$
test_setitem_dim[range] 0.1361ms 97.5071μs 10.2557 KOps/s 10.8036 KOps/s $\textbf{\color{#d91a1a}-5.07\%}$
test_setitem_dim[tuple] 75.8520μs 38.7289μs 25.8205 KOps/s 26.3704 KOps/s $\color{#d91a1a}-2.09\%$
test_setitem 74.3010μs 16.9437μs 59.0191 KOps/s 58.7846 KOps/s $\color{#35bf28}+0.40\%$
test_set 50.6910μs 16.3470μs 61.1734 KOps/s 61.7965 KOps/s $\color{#d91a1a}-1.01\%$
test_set_shared 0.6128ms 0.2108ms 4.7443 KOps/s 4.9143 KOps/s $\color{#d91a1a}-3.46\%$
test_update 0.3537ms 21.0509μs 47.5039 KOps/s 47.3076 KOps/s $\color{#35bf28}+0.41\%$
test_update_nested 71.8320μs 33.5267μs 29.8270 KOps/s 30.3899 KOps/s $\color{#d91a1a}-1.85\%$
test_update__nested 0.5703ms 32.7215μs 30.5610 KOps/s 31.1682 KOps/s $\color{#d91a1a}-1.95\%$
test_set_nested 56.8220μs 17.9748μs 55.6333 KOps/s 55.4832 KOps/s $\color{#35bf28}+0.27\%$
test_set_nested_new 72.7920μs 22.4698μs 44.5041 KOps/s 43.6032 KOps/s $\color{#35bf28}+2.07\%$
test_select 75.4520μs 39.3943μs 25.3844 KOps/s 25.2153 KOps/s $\color{#35bf28}+0.67\%$
test_select_nested 0.1138ms 74.9510μs 13.3420 KOps/s 13.3601 KOps/s $\color{#d91a1a}-0.14\%$
test_exclude_nested 0.1334ms 91.1932μs 10.9657 KOps/s 10.8962 KOps/s $\color{#35bf28}+0.64\%$
test_empty[True] 0.4343ms 0.3997ms 2.5017 KOps/s 2.5221 KOps/s $\color{#d91a1a}-0.81\%$
test_empty[False] 9.3553μs 1.3997μs 714.4222 KOps/s 718.5213 KOps/s $\color{#d91a1a}-0.57\%$
test_to 0.1158ms 70.9473μs 14.0950 KOps/s 14.4090 KOps/s $\color{#d91a1a}-2.18\%$
test_to_nonblocking 0.1119ms 70.0832μs 14.2688 KOps/s 14.6452 KOps/s $\color{#d91a1a}-2.57\%$
test_unbind_speed 6.6624ms 0.3366ms 2.9706 KOps/s 2.9891 KOps/s $\color{#d91a1a}-0.62\%$
test_unbind_speed_stack0 0.4241ms 0.3308ms 3.0228 KOps/s 3.0268 KOps/s $\color{#d91a1a}-0.13\%$
test_unbind_speed_stack1 0.1159s 0.8489ms 1.1780 KOps/s 1.1604 KOps/s $\color{#35bf28}+1.52\%$
test_split 0.1155s 1.4559ms 686.8612 Ops/s 637.9971 Ops/s $\textbf{\color{#35bf28}+7.66\%}$
test_chunk 1.3028ms 1.2319ms 811.7330 Ops/s 812.0746 Ops/s $\color{#d91a1a}-0.04\%$
test_to_cpu_blocking 19.9829ms 19.7759ms 50.5666 Ops/s 51.0453 Ops/s $\color{#d91a1a}-0.94\%$
test_to_cpu_global_sync 0.1269s 12.9830ms 77.0238 Ops/s 87.6433 Ops/s $\textbf{\color{#d91a1a}-12.12\%}$
test_to_cpu_event_sync 13.1062ms 12.6586ms 78.9975 Ops/s 80.6448 Ops/s $\color{#d91a1a}-2.04\%$
test_to_cpu_default 12.9107ms 12.6123ms 79.2879 Ops/s 71.7485 Ops/s $\textbf{\color{#35bf28}+10.51\%}$
test_consolidate[False-None] 4.6619ms 4.1976ms 238.2294 Ops/s 240.2628 Ops/s $\color{#d91a1a}-0.85\%$
test_consolidate[default-None] 3.3289ms 2.3386ms 427.5972 Ops/s 439.8135 Ops/s $\color{#d91a1a}-2.78\%$
test_consolidate[reduce-overhead-None] 3.2761ms 2.2191ms 450.6374 Ops/s 447.6834 Ops/s $\color{#35bf28}+0.66\%$
test_consolidate_njt[False-None] 5.2752ms 5.1232ms 195.1919 Ops/s 193.4847 Ops/s $\color{#35bf28}+0.88\%$
test_to[False-False-None] 2.6652ms 2.2172ms 451.0104 Ops/s 458.4778 Ops/s $\color{#d91a1a}-1.63\%$
test_to[True-False-None] 2.2901ms 1.9845ms 503.9082 Ops/s 517.3860 Ops/s $\color{#d91a1a}-2.60\%$
test_to[within-False-None] 6.5265ms 6.3657ms 157.0916 Ops/s 160.3395 Ops/s $\color{#d91a1a}-2.03\%$
test_to[True-default-None] 10.6425ms 10.3343ms 96.7656 Ops/s 96.6569 Ops/s $\color{#35bf28}+0.11\%$
test_to_njt[False-False-None] 7.2475ms 6.9782ms 143.3036 Ops/s 143.2220 Ops/s $\color{#35bf28}+0.06\%$
test_to_njt[True-False-None] 4.1049ms 3.8936ms 256.8348 Ops/s 256.4706 Ops/s $\color{#35bf28}+0.14\%$
test_to_njt[within-False-None] 9.3387ms 9.0855ms 110.0657 Ops/s 110.8962 Ops/s $\color{#d91a1a}-0.75\%$
test_creation[device0] 0.4497ms 0.1162ms 8.6088 KOps/s 8.5702 KOps/s $\color{#35bf28}+0.45\%$
test_creation_from_tensor 0.3976ms 0.1126ms 8.8844 KOps/s 8.8745 KOps/s $\color{#35bf28}+0.11\%$
test_add_one[memmap_tensor0] 0.3364ms 6.1773μs 161.8818 KOps/s 164.8474 KOps/s $\color{#d91a1a}-1.80\%$
test_contiguous[memmap_tensor0] 29.4110μs 0.6749μs 1.4818 MOps/s 2.0909 MOps/s $\textbf{\color{#d91a1a}-29.13\%}$
test_stack[memmap_tensor0] 85.8920μs 4.2113μs 237.4573 KOps/s 245.6633 KOps/s $\color{#d91a1a}-3.34\%$
test_memmaptd_index 1.2826ms 0.2762ms 3.6203 KOps/s 3.7039 KOps/s $\color{#d91a1a}-2.26\%$
test_memmaptd_index_astensor 0.5270ms 0.3771ms 2.6520 KOps/s 2.6794 KOps/s $\color{#d91a1a}-1.02\%$
test_memmaptd_index_op 1.0260ms 0.6179ms 1.6183 KOps/s 1.6281 KOps/s $\color{#d91a1a}-0.60\%$
test_serialize_model 0.1373s 0.1357s 7.3696 Ops/s 7.3881 Ops/s $\color{#d91a1a}-0.25\%$
test_serialize_model_pickle 1.3697s 1.2152s 0.8229 Ops/s 0.8255 Ops/s $\color{#d91a1a}-0.31\%$
test_serialize_weights 0.1366s 0.1344s 7.4416 Ops/s 7.4517 Ops/s $\color{#d91a1a}-0.14\%$
test_serialize_weights_returnearly 0.4020s 87.3038ms 11.4543 Ops/s 10.3831 Ops/s $\textbf{\color{#35bf28}+10.32\%}$
test_serialize_weights_pickle 1.3493s 1.2323s 0.8115 Ops/s 0.8230 Ops/s $\color{#d91a1a}-1.39\%$
test_reshape_pytree 0.2049ms 32.2574μs 31.0007 KOps/s 31.2795 KOps/s $\color{#d91a1a}-0.89\%$
test_reshape_td 85.7020μs 45.9596μs 21.7582 KOps/s 22.3354 KOps/s $\color{#d91a1a}-2.58\%$
test_view_pytree 0.2058ms 31.5915μs 31.6541 KOps/s 31.6607 KOps/s $\color{#d91a1a}-0.02\%$
test_view_td 95.3220μs 54.9452μs 18.1999 KOps/s 18.8871 KOps/s $\color{#d91a1a}-3.64\%$
test_unbind_pytree 0.2444ms 36.5600μs 27.3523 KOps/s 28.0099 KOps/s $\color{#d91a1a}-2.35\%$
test_unbind_td 0.1813ms 49.9520μs 20.0192 KOps/s 20.1461 KOps/s $\color{#d91a1a}-0.63\%$
test_split_pytree 0.2039ms 42.0333μs 23.7906 KOps/s 24.6121 KOps/s $\color{#d91a1a}-3.34\%$
test_split_td 0.1904ms 71.0548μs 14.0737 KOps/s 14.0301 KOps/s $\color{#35bf28}+0.31\%$
test_add_pytree 0.1919ms 39.9669μs 25.0207 KOps/s 24.9978 KOps/s $\color{#35bf28}+0.09\%$
test_add_td 93.6930μs 53.4931μs 18.6940 KOps/s 18.8623 KOps/s $\color{#d91a1a}-0.89\%$
test_compile_add_one_nested[tensordict-compile] 0.3946ms 0.2738ms 3.6519 KOps/s 3.6831 KOps/s $\color{#d91a1a}-0.85\%$
test_compile_add_one_nested[tensordict-eager] 0.3501ms 0.2044ms 4.8916 KOps/s 4.9982 KOps/s $\color{#d91a1a}-2.13\%$
test_compile_add_one_nested[pytree-compile] 0.3836ms 0.1555ms 6.4318 KOps/s 6.2775 KOps/s $\color{#35bf28}+2.46\%$
test_compile_add_one_nested[pytree-eager] 0.4988ms 0.1790ms 5.5868 KOps/s 5.5780 KOps/s $\color{#35bf28}+0.16\%$
test_compile_copy_nested[tensordict-compile] 76.2910μs 23.1524μs 43.1921 KOps/s 47.2674 KOps/s $\textbf{\color{#d91a1a}-8.62\%}$
test_compile_copy_nested[tensordict-eager] 93.8120μs 53.2887μs 18.7657 KOps/s 18.2771 KOps/s $\color{#35bf28}+2.67\%$
test_compile_copy_nested[pytree-compile] 0.1455ms 19.0835μs 52.4013 KOps/s 51.0998 KOps/s $\color{#35bf28}+2.55\%$
test_compile_copy_nested[pytree-eager] 0.3945ms 66.7373μs 14.9841 KOps/s 14.9076 KOps/s $\color{#35bf28}+0.51\%$
test_compile_add_one_flat[tensordict-compile] 0.5339ms 0.3065ms 3.2629 KOps/s 3.1216 KOps/s $\color{#35bf28}+4.53\%$
test_compile_add_one_flat[tensordict-eager] 0.3725ms 0.2922ms 3.4222 KOps/s 3.4502 KOps/s $\color{#d91a1a}-0.81\%$
test_compile_add_one_flat[tensorclass-compile] 0.3183ms 0.2114ms 4.7303 KOps/s 4.6058 KOps/s $\color{#35bf28}+2.70\%$
test_compile_add_one_flat[tensorclass-eager] 0.1403ms 77.9614μs 12.8269 KOps/s 13.2474 KOps/s $\color{#d91a1a}-3.17\%$
test_compile_add_one_flat[pytree-compile] 0.3820ms 0.2420ms 4.1319 KOps/s 4.0359 KOps/s $\color{#35bf28}+2.38\%$
test_compile_add_one_flat[pytree-eager] 0.8063ms 0.5419ms 1.8453 KOps/s 1.8720 KOps/s $\color{#d91a1a}-1.43\%$
test_compile_add_self_flat[tensordict-eager] 0.5186ms 0.3452ms 2.8971 KOps/s 2.9443 KOps/s $\color{#d91a1a}-1.60\%$
test_compile_add_self_flat[tensordict-compile] 0.3521ms 0.3065ms 3.2622 KOps/s 3.0950 KOps/s $\textbf{\color{#35bf28}+5.40\%}$
test_compile_add_self_flat[tensorclass-eager] 0.1339ms 93.8116μs 10.6597 KOps/s 10.7280 KOps/s $\color{#d91a1a}-0.64\%$
test_compile_add_self_flat[tensorclass-compile] 0.3660ms 0.2087ms 4.7924 KOps/s 4.5399 KOps/s $\textbf{\color{#35bf28}+5.56\%}$
test_compile_add_self_flat[pytree-eager] 0.7037ms 0.4494ms 2.2254 KOps/s 2.2522 KOps/s $\color{#d91a1a}-1.19\%$
test_compile_add_self_flat[pytree-compile] 0.5200ms 0.2422ms 4.1280 KOps/s 4.0599 KOps/s $\color{#35bf28}+1.68\%$
test_compile_copy_flat[tensordict-compile] 72.0120μs 27.4658μs 36.4090 KOps/s 36.3711 KOps/s $\color{#35bf28}+0.10\%$
test_compile_copy_flat[tensordict-eager] 87.8920μs 41.3248μs 24.1985 KOps/s 24.8698 KOps/s $\color{#d91a1a}-2.70\%$
test_compile_copy_flat[pytree-compile] 0.1821ms 25.6443μs 38.9950 KOps/s 38.0103 KOps/s $\color{#35bf28}+2.59\%$
test_compile_copy_flat[pytree-eager] 0.3333ms 51.1842μs 19.5373 KOps/s 19.4252 KOps/s $\color{#35bf28}+0.58\%$
test_compile_assign_and_add[tensordict-compile] 2.0877ms 0.2525ms 3.9600 KOps/s 3.7361 KOps/s $\textbf{\color{#35bf28}+5.99\%}$
test_compile_assign_and_add[tensordict-eager] 3.5067ms 3.3433ms 299.1073 Ops/s 300.1401 Ops/s $\color{#d91a1a}-0.34\%$
test_compile_assign_and_add[pytree-compile] 1.9478ms 0.1940ms 5.1548 KOps/s 5.0138 KOps/s $\color{#35bf28}+2.81\%$
test_compile_assign_and_add[pytree-eager] 2.9659ms 2.7800ms 359.7130 Ops/s 359.4684 Ops/s $\color{#35bf28}+0.07\%$
test_compile_indexing[tensor-tensordict-compile] 0.2967ms 0.1540ms 6.4945 KOps/s 6.2505 KOps/s $\color{#35bf28}+3.90\%$
test_compile_indexing[tensor-tensordict-eager] 0.3808ms 74.4312μs 13.4352 KOps/s 13.0377 KOps/s $\color{#35bf28}+3.05\%$
test_compile_indexing[tensor-tensorclass-compile] 0.3179ms 0.1346ms 7.4277 KOps/s 7.2554 KOps/s $\color{#35bf28}+2.37\%$
test_compile_indexing[tensor-tensorclass-eager] 0.3152ms 44.7597μs 22.3415 KOps/s 21.8600 KOps/s $\color{#35bf28}+2.20\%$
test_compile_indexing[tensor-pytree-compile] 0.1781ms 0.1349ms 7.4103 KOps/s 7.0771 KOps/s $\color{#35bf28}+4.71\%$
test_compile_indexing[tensor-pytree-eager] 0.3045ms 45.0185μs 22.2131 KOps/s 21.6407 KOps/s $\color{#35bf28}+2.64\%$
test_compile_indexing[slice-tensordict-compile] 0.2041ms 88.6893μs 11.2753 KOps/s 10.9765 KOps/s $\color{#35bf28}+2.72\%$
test_compile_indexing[slice-tensordict-eager] 0.2209ms 29.2099μs 34.2349 KOps/s 36.3213 KOps/s $\textbf{\color{#d91a1a}-5.74\%}$
test_compile_indexing[slice-tensorclass-compile] 0.2210ms 71.0590μs 14.0728 KOps/s 13.8714 KOps/s $\color{#35bf28}+1.45\%$
test_compile_indexing[slice-tensorclass-eager] 0.2502ms 22.4282μs 44.5867 KOps/s 45.9115 KOps/s $\color{#d91a1a}-2.89\%$
test_compile_indexing[slice-pytree-compile] 0.1280ms 71.9103μs 13.9062 KOps/s 13.3916 KOps/s $\color{#35bf28}+3.84\%$
test_compile_indexing[slice-pytree-eager] 0.2419ms 22.3766μs 44.6895 KOps/s 45.6088 KOps/s $\color{#d91a1a}-2.02\%$
test_compile_indexing[int-tensordict-compile] 0.8593ms 88.4355μs 11.3077 KOps/s 10.6420 KOps/s $\textbf{\color{#35bf28}+6.26\%}$
test_compile_indexing[int-tensordict-eager] 0.2603ms 27.4600μs 36.4166 KOps/s 35.9513 KOps/s $\color{#35bf28}+1.29\%$
test_compile_indexing[int-tensorclass-compile] 0.1168ms 72.8104μs 13.7343 KOps/s 13.1739 KOps/s $\color{#35bf28}+4.25\%$
test_compile_indexing[int-tensorclass-eager] 0.2522ms 22.0720μs 45.3062 KOps/s 45.6913 KOps/s $\color{#d91a1a}-0.84\%$
test_compile_indexing[int-pytree-compile] 0.1154ms 72.1795μs 13.8543 KOps/s 13.1775 KOps/s $\textbf{\color{#35bf28}+5.14\%}$
test_compile_indexing[int-pytree-eager] 0.2697ms 22.1207μs 45.2066 KOps/s 44.7607 KOps/s $\color{#35bf28}+1.00\%$
test_compile_replace[single-eager] 90.9330μs 48.8270μs 20.4805 KOps/s 20.8672 KOps/s $\color{#d91a1a}-1.85\%$
test_compile_replace[single-compile] 0.2660ms 0.1450ms 6.8976 KOps/s 6.5280 KOps/s $\textbf{\color{#35bf28}+5.66\%}$
test_compile_replace[multi-eager] 0.7490ms 0.5999ms 1.6670 KOps/s 1.7362 KOps/s $\color{#d91a1a}-3.99\%$
test_compile_replace[multi-compile] 0.3220ms 0.1577ms 6.3407 KOps/s 6.1810 KOps/s $\color{#35bf28}+2.58\%$
test_compile_tc_getattr_20[eager] 0.2338ms 0.1814ms 5.5122 KOps/s 5.8890 KOps/s $\textbf{\color{#d91a1a}-6.40\%}$
test_compile_tc_getattr_20[compile] 0.4236ms 0.1796ms 5.5685 KOps/s 5.5312 KOps/s $\color{#35bf28}+0.67\%$
test_compile_clone_shallow[20-eager] 54.7810μs 18.8928μs 52.9302 KOps/s 52.0592 KOps/s $\color{#35bf28}+1.67\%$
test_compile_clone_shallow[20-compile] 71.8410μs 23.6675μs 42.2520 KOps/s 42.0825 KOps/s $\color{#35bf28}+0.40\%$
test_compile_clone_shallow[40-eager] 70.1820μs 33.6502μs 29.7175 KOps/s 30.0677 KOps/s $\color{#d91a1a}-1.16\%$
test_compile_clone_shallow[40-compile] 75.3620μs 25.5724μs 39.1047 KOps/s 37.3854 KOps/s $\color{#35bf28}+4.60\%$
test_compile_clone_shallow[80-eager] 0.1235ms 61.2068μs 16.3381 KOps/s 16.3966 KOps/s $\color{#d91a1a}-0.36\%$
test_compile_clone_shallow[80-compile] 82.5420μs 28.4753μs 35.1182 KOps/s 33.8531 KOps/s $\color{#35bf28}+3.74\%$
test_compile_update_inplace[eager] 0.1250ms 63.1014μs 15.8475 KOps/s 16.0817 KOps/s $\color{#d91a1a}-1.46\%$
test_compile_update_inplace[compile] 0.3037ms 0.1192ms 8.3926 KOps/s 8.0098 KOps/s $\color{#35bf28}+4.78\%$
test_mod_add[eager] 0.2875ms 0.2271ms 4.4024 KOps/s 4.4428 KOps/s $\color{#d91a1a}-0.91\%$
test_mod_add[compile] 0.2280ms 0.1192ms 8.3871 KOps/s 8.2059 KOps/s $\color{#35bf28}+2.21\%$
test_mod_add[compile-overhead] 0.3809ms 0.1957ms 5.1087 KOps/s 5.0942 KOps/s $\color{#35bf28}+0.29\%$
test_mod_wrap[eager] 0.5581ms 0.4703ms 2.1263 KOps/s 2.1426 KOps/s $\color{#d91a1a}-0.76\%$
test_mod_wrap[compile] 0.4332ms 0.3450ms 2.8987 KOps/s 2.9012 KOps/s $\color{#d91a1a}-0.09\%$
test_mod_wrap[compile-overhead] 7.0965ms 3.9747ms 251.5923 Ops/s 253.4088 Ops/s $\color{#d91a1a}-0.72\%$
test_mod_wrap_and_backward[eager] 1.8096ms 1.6897ms 591.8329 Ops/s 599.8547 Ops/s $\color{#d91a1a}-1.34\%$
test_mod_wrap_and_backward[compile] 1.6408ms 1.4169ms 705.7850 Ops/s 752.9695 Ops/s $\textbf{\color{#d91a1a}-6.27\%}$
test_mod_wrap_and_backward[compile-overhead] 1.5498ms 0.9580ms 1.0438 KOps/s 1.0539 KOps/s $\color{#d91a1a}-0.95\%$
test_seq_add[eager] 0.5976ms 0.5165ms 1.9362 KOps/s 1.9608 KOps/s $\color{#d91a1a}-1.25\%$
test_seq_add[compile] 0.2865ms 0.1349ms 7.4149 KOps/s 7.4699 KOps/s $\color{#d91a1a}-0.74\%$
test_seq_add[compile-overhead] 0.2666ms 0.2123ms 4.7105 KOps/s 4.7151 KOps/s $\color{#d91a1a}-0.10\%$
test_seq_wrap[eager] 5.3098ms 1.4241ms 702.1911 Ops/s 709.0818 Ops/s $\color{#d91a1a}-0.97\%$
test_seq_wrap[compile] 0.4411ms 0.3613ms 2.7675 KOps/s 2.7226 KOps/s $\color{#35bf28}+1.65\%$
test_seq_wrap[compile-overhead] 0.4835ms 0.3312ms 3.0192 KOps/s 3.0188 KOps/s $\color{#35bf28}+0.01\%$
test_func_call_runtime[False-eager] 0.9326ms 0.8564ms 1.1677 KOps/s 1.2536 KOps/s $\textbf{\color{#d91a1a}-6.85\%}$
test_func_call_runtime[False-compile] 0.8920ms 0.7726ms 1.2944 KOps/s 1.3128 KOps/s $\color{#d91a1a}-1.40\%$
test_func_call_runtime[False-compile-overhead] 0.6758ms 0.5101ms 1.9603 KOps/s 1.9523 KOps/s $\color{#35bf28}+0.41\%$
test_func_call_runtime[True-eager] 1.1309ms 1.0604ms 943.0524 Ops/s 942.4550 Ops/s $\color{#35bf28}+0.06\%$
test_func_call_runtime[True-compile] 0.9373ms 0.7865ms 1.2714 KOps/s 1.2961 KOps/s $\color{#d91a1a}-1.91\%$
test_func_call_runtime[True-compile-overhead] 0.6932ms 0.5216ms 1.9173 KOps/s 1.8850 KOps/s $\color{#35bf28}+1.71\%$
test_func_call_cm_runtime[False-eager] 0.9257ms 0.8043ms 1.2433 KOps/s 1.2130 KOps/s $\color{#35bf28}+2.49\%$
test_func_call_cm_runtime[False-compile] 0.8989ms 0.7606ms 1.3147 KOps/s 1.3411 KOps/s $\color{#d91a1a}-1.96\%$
test_func_call_cm_runtime[False-compile-overhead] 0.5782ms 0.4883ms 2.0479 KOps/s 2.0317 KOps/s $\color{#35bf28}+0.80\%$
test_func_call_cm_runtime[True-eager] 1.3243ms 1.2149ms 823.1134 Ops/s 832.9774 Ops/s $\color{#d91a1a}-1.18\%$
test_func_call_cm_runtime[True-compile] 0.9692ms 0.8650ms 1.1561 KOps/s 1.1742 KOps/s $\color{#d91a1a}-1.54\%$
test_func_call_cm_runtime[True-compile-overhead] 1.1706ms 0.8553ms 1.1691 KOps/s 1.1444 KOps/s $\color{#35bf28}+2.16\%$
test_vmap_func_call_cm_runtime[eager] 3.1605ms 2.6582ms 376.1974 Ops/s 376.9395 Ops/s $\color{#d91a1a}-0.20\%$
test_vmap_func_call_cm_runtime[compile] 4.1280ms 3.6608ms 273.1615 Ops/s 271.2154 Ops/s $\color{#35bf28}+0.72\%$
test_vmap_func_call_cm_runtime[compile-overhead] 4.1606ms 3.6707ms 272.4251 Ops/s 272.6644 Ops/s $\color{#d91a1a}-0.09\%$
test_distributed 1.9348ms 0.1470ms 6.8012 KOps/s 6.0601 KOps/s $\textbf{\color{#35bf28}+12.23\%}$
test_tdmodule 0.7461ms 0.1942ms 5.1480 KOps/s 5.1030 KOps/s $\color{#35bf28}+0.88\%$
test_tdmodule_dispatch 0.4108ms 0.3764ms 2.6571 KOps/s 2.6669 KOps/s $\color{#d91a1a}-0.37\%$
test_tdseq 52.3310μs 26.3263μs 37.9848 KOps/s 37.5629 KOps/s $\color{#35bf28}+1.12\%$
test_tdseq_dispatch 0.2590ms 0.2197ms 4.5526 KOps/s 4.5568 KOps/s $\color{#d91a1a}-0.09\%$
test_instantiation_functorch 2.1101ms 2.0386ms 490.5273 Ops/s 490.1534 Ops/s $\color{#35bf28}+0.08\%$
test_exec_functorch 0.2535ms 0.1744ms 5.7329 KOps/s 5.6979 KOps/s $\color{#35bf28}+0.62\%$
test_exec_functional_call 0.4578ms 0.1540ms 6.4953 KOps/s 6.4901 KOps/s $\color{#35bf28}+0.08\%$
test_exec_td_decorator 0.5079ms 0.2420ms 4.1316 KOps/s 4.1691 KOps/s $\color{#d91a1a}-0.90\%$
test_vmap_mlp_speed_decorator[True-True] 1.3260ms 1.1173ms 895.0231 Ops/s 898.8919 Ops/s $\color{#d91a1a}-0.43\%$
test_vmap_mlp_speed_decorator[True-False] 1.3199ms 1.1100ms 900.9243 Ops/s 898.6960 Ops/s $\color{#35bf28}+0.25\%$
test_vmap_mlp_speed_decorator[False-True] 1.0086ms 0.8132ms 1.2297 KOps/s 1.2258 KOps/s $\color{#35bf28}+0.31\%$
test_vmap_mlp_speed_decorator[False-False] 1.0294ms 0.8125ms 1.2307 KOps/s 1.2298 KOps/s $\color{#35bf28}+0.07\%$
test_vmap_transformer_speed_decorator[True-True] 27.2112ms 24.9324ms 40.1085 Ops/s 40.4848 Ops/s $\color{#d91a1a}-0.93\%$
test_vmap_transformer_speed_decorator[True-False] 24.9330ms 24.7783ms 40.3579 Ops/s 40.4927 Ops/s $\color{#d91a1a}-0.33\%$
test_vmap_transformer_speed_decorator[False-True] 24.6498ms 24.4141ms 40.9599 Ops/s 41.1531 Ops/s $\color{#d91a1a}-0.47\%$
test_vmap_transformer_speed_decorator[False-False] 25.0219ms 24.3636ms 41.0449 Ops/s 41.2770 Ops/s $\color{#d91a1a}-0.56\%$
test_to_module_speed[True] 1.7706ms 1.6642ms 600.8916 Ops/s 605.3439 Ops/s $\color{#d91a1a}-0.74\%$
test_to_module_speed[False] 1.7747ms 1.6238ms 615.8355 Ops/s 615.2479 Ops/s $\color{#35bf28}+0.10\%$
test_to_module_plain_tensor_speed[None] 2.5657ms 1.7508ms 571.1619 Ops/s 568.1837 Ops/s $\color{#35bf28}+0.52\%$
test_to_module_plain_tensor_speed[False] 2.1765ms 1.5733ms 635.6266 Ops/s 626.3348 Ops/s $\color{#35bf28}+1.48\%$
test_to_module_plain_tensor_speed[True] 3.4822ms 3.3943ms 294.6103 Ops/s 290.5915 Ops/s $\color{#35bf28}+1.38\%$
test_tc_init 80.5720μs 44.1269μs 22.6619 KOps/s 21.6057 KOps/s $\color{#35bf28}+4.89\%$
test_tc_init_tensor_only 71.9310μs 9.0041μs 111.0607 KOps/s 104.4375 KOps/s $\textbf{\color{#35bf28}+6.34\%}$
test_tc_init_nested 0.1252ms 86.7178μs 11.5317 KOps/s 10.8465 KOps/s $\textbf{\color{#35bf28}+6.32\%}$
test_tc_init_many_fields 39.3110μs 17.2017μs 58.1339 KOps/s 58.0814 KOps/s $\color{#35bf28}+0.09\%$
test_tc_first_layer_tensor 28.5010μs 1.8099μs 552.5078 KOps/s 554.4823 KOps/s $\color{#d91a1a}-0.36\%$
test_tc_first_layer_tensor_only 2.4051μs 0.4017μs 2.4893 MOps/s 2.5021 MOps/s $\color{#d91a1a}-0.51\%$
test_tc_first_layer_tensor_set 31.5110μs 4.2005μs 238.0679 KOps/s 235.9533 KOps/s $\color{#35bf28}+0.90\%$
test_tc_first_layer_tensor_only_set 27.8310μs 3.4795μs 287.3979 KOps/s 287.3134 KOps/s $\color{#35bf28}+0.03\%$
test_tc_first_layer_nontensor 35.5500μs 6.1598μs 162.3437 KOps/s 164.2543 KOps/s $\color{#d91a1a}-1.16\%$
test_tc_second_layer_tensor 22.4100μs 4.4025μs 227.1429 KOps/s 231.4453 KOps/s $\color{#d91a1a}-1.86\%$
test_tc_second_layer_nontensor 37.0710μs 8.6239μs 115.9566 KOps/s 116.1356 KOps/s $\color{#d91a1a}-0.15\%$
test_unbind 0.2872s 14.1088ms 70.8776 Ops/s 66.6483 Ops/s $\textbf{\color{#35bf28}+6.35\%}$
test_full_like 4.7203ms 4.3805ms 228.2844 Ops/s 228.6133 Ops/s $\color{#d91a1a}-0.14\%$
test_zeros_like 4.5183ms 4.3768ms 228.4788 Ops/s 231.2128 Ops/s $\color{#d91a1a}-1.18\%$
test_ones_like 4.5863ms 4.3846ms 228.0715 Ops/s 233.1033 Ops/s $\color{#d91a1a}-2.16\%$
test_clone 6.9174ms 6.4839ms 154.2275 Ops/s 155.2921 Ops/s $\color{#d91a1a}-0.69\%$
test_squeeze 73.5510μs 14.2812μs 70.0222 KOps/s 70.3293 KOps/s $\color{#d91a1a}-0.44\%$
test_unsqueeze 0.2888ms 0.1133ms 8.8291 KOps/s 9.0362 KOps/s $\color{#d91a1a}-2.29\%$
test_split 0.2575ms 0.1892ms 5.2858 KOps/s 5.2760 KOps/s $\color{#35bf28}+0.19\%$
test_permute 0.2517ms 0.2003ms 4.9937 KOps/s 4.9981 KOps/s $\color{#d91a1a}-0.09\%$
test_stack 43.2467ms 42.6565ms 23.4431 Ops/s 19.5532 Ops/s $\textbf{\color{#35bf28}+19.89\%}$
test_cat 43.4185ms 42.6286ms 23.4584 Ops/s 19.6738 Ops/s $\textbf{\color{#35bf28}+19.24\%}$
test_sequential_tensordict 0.6434ms 0.5634ms 1.7750 KOps/s 1.7669 KOps/s $\color{#35bf28}+0.46\%$
test_sequential_graph_module 0.1631ms 0.1107ms 9.0345 KOps/s 8.7784 KOps/s $\color{#35bf28}+2.92\%$
test_nested_tensordict 0.9404ms 0.8064ms 1.2400 KOps/s 1.2300 KOps/s $\color{#35bf28}+0.81\%$
test_nested_graph_module 0.1781ms 0.1221ms 8.1915 KOps/s 8.2750 KOps/s $\color{#d91a1a}-1.01\%$

@github-actions

github-actions Bot commented Jul 9, 2026

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large&amp;#x26A0;\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 344. Improved: $\large\color{#35bf28}15$. Worsened: $\large\color{#d91a1a}17$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_collector_preallocated_write[stack_out-cpu-32-2] 0.2639ms 0.1741ms 5.7449 KOps/s 5.9044 KOps/s $\color{#d91a1a}-2.70\%$
test_collector_preallocated_write[stack_out-cpu-32-8] 0.3904ms 0.3024ms 3.3064 KOps/s 3.3106 KOps/s $\color{#d91a1a}-0.13\%$
test_collector_preallocated_write[stack_out-cpu-32-32] 0.9310ms 0.7795ms 1.2828 KOps/s 1.2503 KOps/s $\color{#35bf28}+2.60\%$
test_collector_preallocated_write[stack_out-cpu-4096-2] 0.4733ms 0.3437ms 2.9099 KOps/s 2.9011 KOps/s $\color{#35bf28}+0.30\%$
test_collector_preallocated_write[stack_out-cpu-4096-8] 1.3614ms 1.1552ms 865.6520 Ops/s 906.2318 Ops/s $\color{#d91a1a}-4.48\%$
test_collector_preallocated_write[stack_out-cpu-4096-32] 7.7431ms 7.4005ms 135.1253 Ops/s 133.4416 Ops/s $\color{#35bf28}+1.26\%$
test_collector_preallocated_write[stack_out-cuda-32-2] 0.4007ms 0.2556ms 3.9120 KOps/s 3.9130 KOps/s $\color{#d91a1a}-0.03\%$
test_collector_preallocated_write[stack_out-cuda-32-8] 0.5232ms 0.3806ms 2.6277 KOps/s 2.6246 KOps/s $\color{#35bf28}+0.12\%$
test_collector_preallocated_write[stack_out-cuda-32-32] 0.9830ms 0.8358ms 1.1964 KOps/s 1.1904 KOps/s $\color{#35bf28}+0.50\%$
test_collector_preallocated_write[stack_out-cuda-4096-2] 0.3189ms 0.2552ms 3.9189 KOps/s 3.8986 KOps/s $\color{#35bf28}+0.52\%$
test_collector_preallocated_write[stack_out-cuda-4096-8] 0.5140ms 0.3824ms 2.6152 KOps/s 2.6227 KOps/s $\color{#d91a1a}-0.28\%$
test_collector_preallocated_write[stack_out-cuda-4096-32] 1.2785ms 0.8968ms 1.1151 KOps/s 1.1161 KOps/s $\color{#d91a1a}-0.09\%$
test_collector_preallocated_write[set_at_loop-cpu-32-2] 0.5106ms 0.2162ms 4.6263 KOps/s 4.6266 KOps/s $-0.01\%$
test_collector_preallocated_write[set_at_loop-cpu-32-8] 0.9011ms 0.8364ms 1.1956 KOps/s 1.1952 KOps/s $\color{#35bf28}+0.03\%$
test_collector_preallocated_write[set_at_loop-cpu-32-32] 3.4268ms 3.3596ms 297.6516 Ops/s 301.4977 Ops/s $\color{#d91a1a}-1.28\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-2] 0.6705ms 0.3710ms 2.6953 KOps/s 2.7397 KOps/s $\color{#d91a1a}-1.62\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-8] 1.8877ms 1.7453ms 572.9542 Ops/s 605.6653 Ops/s $\textbf{\color{#d91a1a}-5.40\%}$
test_collector_preallocated_write[set_at_loop-cpu-4096-32] 10.6284ms 10.3048ms 97.0426 Ops/s 97.2604 Ops/s $\color{#d91a1a}-0.22\%$
test_collector_preallocated_write[set_at_loop-cuda-32-2] 0.4208ms 0.3956ms 2.5281 KOps/s 2.5182 KOps/s $\color{#35bf28}+0.39\%$
test_collector_preallocated_write[set_at_loop-cuda-32-8] 1.6455ms 1.5570ms 642.2586 Ops/s 672.6176 Ops/s $\color{#d91a1a}-4.51\%$
test_collector_preallocated_write[set_at_loop-cuda-32-32] 6.1988ms 6.1114ms 163.6294 Ops/s 170.4344 Ops/s $\color{#d91a1a}-3.99\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-2] 0.5426ms 0.4119ms 2.4275 KOps/s 2.4321 KOps/s $\color{#d91a1a}-0.19\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-8] 1.6469ms 1.5606ms 640.7863 Ops/s 664.1946 Ops/s $\color{#d91a1a}-3.52\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-32] 6.2361ms 6.1198ms 163.4029 Ops/s 168.1995 Ops/s $\color{#d91a1a}-2.85\%$
test_collector_preallocated_write[copy_at-cpu-32-2] 0.5288ms 0.1714ms 5.8352 KOps/s 5.7587 KOps/s $\color{#35bf28}+1.33\%$
test_collector_preallocated_write[copy_at-cpu-32-8] 0.7522ms 0.6685ms 1.4960 KOps/s 1.4932 KOps/s $\color{#35bf28}+0.19\%$
test_collector_preallocated_write[copy_at-cpu-32-32] 2.8046ms 2.6549ms 376.6644 Ops/s 376.7866 Ops/s $\color{#d91a1a}-0.03\%$
test_collector_preallocated_write[copy_at-cpu-4096-2] 0.4525ms 0.3301ms 3.0294 KOps/s 3.1080 KOps/s $\color{#d91a1a}-2.53\%$
test_collector_preallocated_write[copy_at-cpu-4096-8] 1.7185ms 1.5513ms 644.6045 Ops/s 678.4158 Ops/s $\color{#d91a1a}-4.98\%$
test_collector_preallocated_write[copy_at-cpu-4096-32] 9.8192ms 9.6067ms 104.0936 Ops/s 103.9597 Ops/s $\color{#35bf28}+0.13\%$
test_collector_preallocated_write[copy_at-cuda-32-2] 0.4088ms 0.3311ms 3.0203 KOps/s 3.0468 KOps/s $\color{#d91a1a}-0.87\%$
test_collector_preallocated_write[copy_at-cuda-32-8] 1.3715ms 1.2274ms 814.7574 Ops/s 818.5973 Ops/s $\color{#d91a1a}-0.47\%$
test_collector_preallocated_write[copy_at-cuda-32-32] 4.9405ms 4.8515ms 206.1231 Ops/s 209.4382 Ops/s $\color{#d91a1a}-1.58\%$
test_collector_preallocated_write[copy_at-cuda-4096-2] 0.3873ms 0.3330ms 3.0032 KOps/s 3.0456 KOps/s $\color{#d91a1a}-1.39\%$
test_collector_preallocated_write[copy_at-cuda-4096-8] 1.3902ms 1.2400ms 806.4236 Ops/s 815.3394 Ops/s $\color{#d91a1a}-1.09\%$
test_collector_preallocated_write[copy_at-cuda-4096-32] 4.9719ms 4.8410ms 206.5699 Ops/s 207.3289 Ops/s $\color{#d91a1a}-0.37\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-2] 0.1595ms 0.1238ms 8.0789 KOps/s 8.1338 KOps/s $\color{#d91a1a}-0.68\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-8] 0.5284ms 0.4850ms 2.0620 KOps/s 2.0776 KOps/s $\color{#d91a1a}-0.75\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-32] 1.9812ms 1.9174ms 521.5422 Ops/s 525.2101 Ops/s $\color{#d91a1a}-0.70\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-2] 0.3414ms 0.2656ms 3.7651 KOps/s 3.7960 KOps/s $\color{#d91a1a}-0.81\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-8] 1.4984ms 1.2753ms 784.1535 Ops/s 821.9047 Ops/s $\color{#d91a1a}-4.59\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-32] 8.7906ms 8.6427ms 115.7040 Ops/s 115.0668 Ops/s $\color{#35bf28}+0.55\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-2] 0.4044ms 0.2873ms 3.4809 KOps/s 3.5563 KOps/s $\color{#d91a1a}-2.12\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-8] 1.2046ms 1.0532ms 949.4510 Ops/s 952.6479 Ops/s $\color{#d91a1a}-0.34\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-32] 4.4625ms 4.1745ms 239.5495 Ops/s 244.0350 Ops/s $\color{#d91a1a}-1.84\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-2] 0.3771ms 0.2837ms 3.5249 KOps/s 3.5508 KOps/s $\color{#d91a1a}-0.73\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-8] 1.1348ms 1.0531ms 949.6142 Ops/s 955.3261 Ops/s $\color{#d91a1a}-0.60\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-32] 4.4169ms 4.2676ms 234.3256 Ops/s 244.0180 Ops/s $\color{#d91a1a}-3.97\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-128] 16.5440ms 16.3824ms 61.0412 Ops/s 60.4104 Ops/s $\color{#35bf28}+1.04\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-256] 33.2859ms 33.1136ms 30.1991 Ops/s 30.2367 Ops/s $\color{#d91a1a}-0.12\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-128] 84.7511ms 83.9658ms 11.9096 Ops/s 11.5569 Ops/s $\color{#35bf28}+3.05\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-256] 0.2008s 0.1995s 5.0136 Ops/s 4.9654 Ops/s $\color{#35bf28}+0.97\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-128] 14.0687ms 13.9667ms 71.5989 Ops/s 71.9441 Ops/s $\color{#d91a1a}-0.48\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-256] 27.2888ms 27.1705ms 36.8046 Ops/s 36.8966 Ops/s $\color{#d91a1a}-0.25\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-128] 14.1601ms 14.0696ms 71.0753 Ops/s 71.0924 Ops/s $\color{#d91a1a}-0.02\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-256] 27.6707ms 27.5215ms 36.3352 Ops/s 36.4244 Ops/s $\color{#d91a1a}-0.25\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-128] 53.1461ms 52.8505ms 18.9213 Ops/s 19.5659 Ops/s $\color{#d91a1a}-3.29\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-256] 0.1122s 0.1098s 9.1089 Ops/s 9.6365 Ops/s $\textbf{\color{#d91a1a}-5.47\%}$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-128] 0.1541s 0.1512s 6.6152 Ops/s 6.8256 Ops/s $\color{#d91a1a}-3.08\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-256] 0.3237s 0.3212s 3.1134 Ops/s 3.1307 Ops/s $\color{#d91a1a}-0.55\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-128] 77.1050ms 76.5201ms 13.0685 Ops/s 12.9611 Ops/s $\color{#35bf28}+0.83\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-256] 0.1529s 0.1523s 6.5673 Ops/s 6.6032 Ops/s $\color{#d91a1a}-0.54\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-128] 76.9865ms 76.5204ms 13.0684 Ops/s 13.0018 Ops/s $\color{#35bf28}+0.51\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-256] 0.1544s 0.1534s 6.5199 Ops/s 6.4890 Ops/s $\color{#35bf28}+0.48\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-128] 30.4316ms 30.2945ms 33.0093 Ops/s 33.4303 Ops/s $\color{#d91a1a}-1.26\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-256] 61.4341ms 61.2206ms 16.3344 Ops/s 16.3751 Ops/s $\color{#d91a1a}-0.25\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-128] 0.1213s 0.1205s 8.2992 Ops/s 8.2749 Ops/s $\color{#35bf28}+0.29\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-256] 0.2697s 0.2683s 3.7266 Ops/s 3.7481 Ops/s $\color{#d91a1a}-0.57\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-128] 44.2837ms 44.1226ms 22.6641 Ops/s 22.7233 Ops/s $\color{#d91a1a}-0.26\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-256] 88.5251ms 88.3699ms 11.3161 Ops/s 11.4201 Ops/s $\color{#d91a1a}-0.91\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-128] 44.5322ms 44.3123ms 22.5671 Ops/s 22.7818 Ops/s $\color{#d91a1a}-0.94\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-256] 89.0061ms 88.6765ms 11.2770 Ops/s 11.3530 Ops/s $\color{#d91a1a}-0.67\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-128] 21.0380ms 20.6142ms 48.5101 Ops/s 48.5184 Ops/s $\color{#d91a1a}-0.02\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-256] 45.0278ms 42.4955ms 23.5319 Ops/s 23.5455 Ops/s $\color{#d91a1a}-0.06\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-128] 0.1178s 0.1146s 8.7228 Ops/s 9.0944 Ops/s $\color{#d91a1a}-4.09\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-256] 0.2610s 0.2596s 3.8525 Ops/s 4.1003 Ops/s $\textbf{\color{#d91a1a}-6.04\%}$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-128] 39.6994ms 38.6880ms 25.8478 Ops/s 26.7376 Ops/s $\color{#d91a1a}-3.33\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-256] 79.1492ms 78.0674ms 12.8094 Ops/s 13.3033 Ops/s $\color{#d91a1a}-3.71\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-128] 39.6783ms 39.4724ms 25.3342 Ops/s 26.7675 Ops/s $\textbf{\color{#d91a1a}-5.35\%}$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-256] 75.5999ms 75.3669ms 13.2684 Ops/s 13.2062 Ops/s $\color{#35bf28}+0.47\%$
test_plain_set_nested 73.4510μs 15.1544μs 65.9872 KOps/s 66.7946 KOps/s $\color{#d91a1a}-1.21\%$
test_plain_set_stack_nested 58.1610μs 14.8483μs 67.3479 KOps/s 67.7438 KOps/s $\color{#d91a1a}-0.58\%$
test_plain_set_nested_inplace 59.5810μs 16.4714μs 60.7112 KOps/s 60.3027 KOps/s $\color{#35bf28}+0.68\%$
test_plain_set_stack_nested_inplace 0.1105ms 16.0243μs 62.4054 KOps/s 62.1809 KOps/s $\color{#35bf28}+0.36\%$
test_items 45.2510μs 6.0207μs 166.0938 KOps/s 165.2191 KOps/s $\color{#35bf28}+0.53\%$
test_items_nested 0.5248ms 0.4668ms 2.1424 KOps/s 2.1725 KOps/s $\color{#d91a1a}-1.38\%$
test_items_nested_locked 0.5829ms 0.4596ms 2.1759 KOps/s 2.1754 KOps/s $\color{#35bf28}+0.02\%$
test_items_nested_leaf 0.1473ms 97.2742μs 10.2802 KOps/s 10.1244 KOps/s $\color{#35bf28}+1.54\%$
test_items_stack_nested 0.5066ms 0.4589ms 2.1790 KOps/s 2.2273 KOps/s $\color{#d91a1a}-2.17\%$
test_items_stack_nested_leaf 0.1375ms 96.8207μs 10.3284 KOps/s 10.3263 KOps/s $\color{#35bf28}+0.02\%$
test_items_stack_nested_locked 0.5423ms 0.4588ms 2.1795 KOps/s 2.1641 KOps/s $\color{#35bf28}+0.71\%$
test_keys 50.2910μs 4.1539μs 240.7376 KOps/s 239.4409 KOps/s $\color{#35bf28}+0.54\%$
test_keys_nested 0.1762ms 0.1293ms 7.7314 KOps/s 7.8079 KOps/s $\color{#d91a1a}-0.98\%$
test_keys_nested_locked 0.7739ms 0.1375ms 7.2709 KOps/s 7.2481 KOps/s $\color{#35bf28}+0.31\%$
test_keys_nested_leaf 0.2076ms 0.1186ms 8.4348 KOps/s 8.4146 KOps/s $\color{#35bf28}+0.24\%$
test_keys_stack_nested 0.2261ms 0.1290ms 7.7533 KOps/s 7.8307 KOps/s $\color{#d91a1a}-0.99\%$
test_keys_stack_nested_leaf 0.1719ms 0.1186ms 8.4312 KOps/s 8.4679 KOps/s $\color{#d91a1a}-0.43\%$
test_keys_stack_nested_locked 0.1876ms 0.1364ms 7.3301 KOps/s 7.3605 KOps/s $\color{#d91a1a}-0.41\%$
test_values 8.6022μs 1.0094μs 990.7316 KOps/s 988.7637 KOps/s $\color{#35bf28}+0.20\%$
test_values_nested 0.1006ms 52.6497μs 18.9934 KOps/s 19.0154 KOps/s $\color{#d91a1a}-0.12\%$
test_values_nested_locked 0.1152ms 55.0083μs 18.1791 KOps/s 17.8400 KOps/s $\color{#35bf28}+1.90\%$
test_values_nested_leaf 0.1146ms 60.3723μs 16.5639 KOps/s 16.6693 KOps/s $\color{#d91a1a}-0.63\%$
test_values_stack_nested 0.1172ms 52.4908μs 19.0510 KOps/s 19.0603 KOps/s $\color{#d91a1a}-0.05\%$
test_values_stack_nested_leaf 93.5810μs 60.1049μs 16.6376 KOps/s 16.7647 KOps/s $\color{#d91a1a}-0.76\%$
test_values_stack_nested_locked 90.9420μs 55.7569μs 17.9350 KOps/s 17.7639 KOps/s $\color{#35bf28}+0.96\%$
test_membership 7.5718μs 0.8257μs 1.2110 MOps/s 1.1877 MOps/s $\color{#35bf28}+1.97\%$
test_membership_nested 29.0110μs 2.9124μs 343.3564 KOps/s 342.4344 KOps/s $\color{#35bf28}+0.27\%$
test_membership_nested_leaf 24.4700μs 2.8991μs 344.9378 KOps/s 341.3739 KOps/s $\color{#35bf28}+1.04\%$
test_membership_stacked_nested 35.1900μs 2.8271μs 353.7147 KOps/s 353.4161 KOps/s $\color{#35bf28}+0.08\%$
test_membership_stacked_nested_leaf 48.5610μs 2.7269μs 366.7232 KOps/s 352.5146 KOps/s $\color{#35bf28}+4.03\%$
test_membership_nested_last 41.2810μs 4.3678μs 228.9478 KOps/s 223.4418 KOps/s $\color{#35bf28}+2.46\%$
test_membership_nested_leaf_last 52.7310μs 4.2567μs 234.9235 KOps/s 226.0202 KOps/s $\color{#35bf28}+3.94\%$
test_membership_stacked_nested_last 34.3110μs 4.2351μs 236.1202 KOps/s 233.0112 KOps/s $\color{#35bf28}+1.33\%$
test_membership_stacked_nested_leaf_last 33.5510μs 4.2239μs 236.7499 KOps/s 235.2923 KOps/s $\color{#35bf28}+0.62\%$
test_nested_getleaf 52.7610μs 21.2081μs 47.1518 KOps/s 46.6798 KOps/s $\color{#35bf28}+1.01\%$
test_nested_get 86.0320μs 19.7049μs 50.7488 KOps/s 49.7435 KOps/s $\color{#35bf28}+2.02\%$
test_stacked_getleaf 55.6210μs 20.9771μs 47.6710 KOps/s 47.6421 KOps/s $\color{#35bf28}+0.06\%$
test_stacked_get 52.9410μs 20.1496μs 49.6287 KOps/s 50.0053 KOps/s $\color{#d91a1a}-0.75\%$
test_nested_getitemleaf 72.5510μs 21.5233μs 46.4613 KOps/s 45.3855 KOps/s $\color{#35bf28}+2.37\%$
test_nested_getitem 52.3910μs 20.7057μs 48.2960 KOps/s 47.7790 KOps/s $\color{#35bf28}+1.08\%$
test_stacked_getitemleaf 72.8720μs 21.1568μs 47.2661 KOps/s 46.1420 KOps/s $\color{#35bf28}+2.44\%$
test_stacked_getitem 60.5610μs 20.4574μs 48.8820 KOps/s 48.8418 KOps/s $\color{#35bf28}+0.08\%$
test_lock_nested 5.3175ms 0.5084ms 1.9670 KOps/s 1.9575 KOps/s $\color{#35bf28}+0.49\%$
test_lock_stack_nested 0.5549ms 0.5110ms 1.9569 KOps/s 1.9629 KOps/s $\color{#d91a1a}-0.31\%$
test_unlock_nested 0.4684ms 0.3994ms 2.5038 KOps/s 2.4991 KOps/s $\color{#35bf28}+0.19\%$
test_unlock_stack_nested 0.4411ms 0.4044ms 2.4731 KOps/s 2.4727 KOps/s $\color{#35bf28}+0.02\%$
test_flatten_speed 0.1656ms 0.1214ms 8.2362 KOps/s 8.1160 KOps/s $\color{#35bf28}+1.48\%$
test_unflatten_speed 0.6127ms 0.5615ms 1.7809 KOps/s 1.7695 KOps/s $\color{#35bf28}+0.65\%$
test_common_ops 0.9159ms 0.7051ms 1.4182 KOps/s 1.3554 KOps/s $\color{#35bf28}+4.63\%$
test_creation 57.8910μs 3.1141μs 321.1172 KOps/s 314.6337 KOps/s $\color{#35bf28}+2.06\%$
test_creation_empty 39.4100μs 6.9866μs 143.1302 KOps/s 141.3078 KOps/s $\color{#35bf28}+1.29\%$
test_creation_nested_1 42.9200μs 11.5362μs 86.6838 KOps/s 86.9916 KOps/s $\color{#d91a1a}-0.35\%$
test_creation_nested_2 75.9920μs 12.9602μs 77.1596 KOps/s 73.6346 KOps/s $\color{#35bf28}+4.79\%$
test_creation_many_keys[10] 69.9820μs 20.5366μs 48.6936 KOps/s 47.5576 KOps/s $\color{#35bf28}+2.39\%$
test_creation_many_keys[50] 0.1684ms 87.5267μs 11.4251 KOps/s 10.9769 KOps/s $\color{#35bf28}+4.08\%$
test_creation_many_keys[100] 0.2247ms 0.1731ms 5.7758 KOps/s 5.6200 KOps/s $\color{#35bf28}+2.77\%$
test_creation_nested_many_keys[10] 82.2020μs 44.3120μs 22.5672 KOps/s 21.9499 KOps/s $\color{#35bf28}+2.81\%$
test_creation_nested_many_keys[50] 0.2415ms 0.1813ms 5.5146 KOps/s 5.4008 KOps/s $\color{#35bf28}+2.11\%$
test_clone 58.5610μs 13.6773μs 73.1139 KOps/s 74.4184 KOps/s $\color{#d91a1a}-1.75\%$
test_getitem[int] 1.5474ms 15.4389μs 64.7715 KOps/s 65.0721 KOps/s $\color{#d91a1a}-0.46\%$
test_getitem[slice_int] 0.1545ms 24.8676μs 40.2130 KOps/s 38.2669 KOps/s $\textbf{\color{#35bf28}+5.09\%}$
test_getitem[range] 0.1802ms 61.7774μs 16.1872 KOps/s 15.4483 KOps/s $\color{#35bf28}+4.78\%$
test_getitem[tuple] 0.1530ms 24.3879μs 41.0040 KOps/s 41.3818 KOps/s $\color{#d91a1a}-0.91\%$
test_getitem[list] 0.1848ms 57.8931μs 17.2732 KOps/s 17.5090 KOps/s $\color{#d91a1a}-1.35\%$
test_setitem_dim[int] 54.3010μs 26.0135μs 38.4415 KOps/s 37.8563 KOps/s $\color{#35bf28}+1.55\%$
test_setitem_dim[slice_int] 78.4020μs 43.8313μs 22.8147 KOps/s 24.1702 KOps/s $\textbf{\color{#d91a1a}-5.61\%}$
test_setitem_dim[range] 0.1425ms 97.9015μs 10.2144 KOps/s 10.6338 KOps/s $\color{#d91a1a}-3.94\%$
test_setitem_dim[tuple] 81.3720μs 40.3550μs 24.7801 KOps/s 24.9441 KOps/s $\color{#d91a1a}-0.66\%$
test_setitem 72.8520μs 17.6817μs 56.5556 KOps/s 56.5062 KOps/s $\color{#35bf28}+0.09\%$
test_set 93.4110μs 16.9692μs 58.9302 KOps/s 58.9376 KOps/s $\color{#d91a1a}-0.01\%$
test_set_shared 0.7146ms 0.2123ms 4.7104 KOps/s 4.8647 KOps/s $\color{#d91a1a}-3.17\%$
test_update 0.4636ms 23.0064μs 43.4662 KOps/s 46.8461 KOps/s $\textbf{\color{#d91a1a}-7.21\%}$
test_update_nested 0.1176ms 34.3303μs 29.1287 KOps/s 30.2287 KOps/s $\color{#d91a1a}-3.64\%$
test_update__nested 0.4496ms 33.1921μs 30.1277 KOps/s 29.6172 KOps/s $\color{#35bf28}+1.72\%$
test_set_nested 62.7420μs 18.6682μs 53.5671 KOps/s 53.6493 KOps/s $\color{#d91a1a}-0.15\%$
test_set_nested_new 81.3110μs 23.3809μs 42.7699 KOps/s 42.7615 KOps/s $\color{#35bf28}+0.02\%$
test_select 86.0510μs 42.0501μs 23.7812 KOps/s 24.8512 KOps/s $\color{#d91a1a}-4.31\%$
test_select_nested 0.1184ms 74.8070μs 13.3677 KOps/s 13.5120 KOps/s $\color{#d91a1a}-1.07\%$
test_exclude_nested 0.1368ms 91.5104μs 10.9277 KOps/s 11.0564 KOps/s $\color{#d91a1a}-1.16\%$
test_empty[True] 0.4352ms 0.3999ms 2.5004 KOps/s 2.5442 KOps/s $\color{#d91a1a}-1.72\%$
test_empty[False] 8.1953μs 1.3898μs 719.5323 KOps/s 712.7978 KOps/s $\color{#35bf28}+0.94\%$
test_to 0.1211ms 72.3897μs 13.8141 KOps/s 14.3462 KOps/s $\color{#d91a1a}-3.71\%$
test_to_nonblocking 0.1161ms 74.2703μs 13.4643 KOps/s 14.2562 KOps/s $\textbf{\color{#d91a1a}-5.55\%}$
test_unbind_speed 0.3850ms 0.3406ms 2.9361 KOps/s 2.9194 KOps/s $\color{#35bf28}+0.57\%$
test_unbind_speed_stack0 0.4318ms 0.3341ms 2.9935 KOps/s 2.9623 KOps/s $\color{#35bf28}+1.05\%$
test_unbind_speed_stack1 0.1166s 0.8619ms 1.1602 KOps/s 1.1611 KOps/s $\color{#d91a1a}-0.08\%$
test_split 0.1170s 1.4665ms 681.9163 Ops/s 635.4065 Ops/s $\textbf{\color{#35bf28}+7.32\%}$
test_chunk 1.2862ms 1.2461ms 802.4873 Ops/s 811.0481 Ops/s $\color{#d91a1a}-1.06\%$
test_to_cpu_blocking 20.2755ms 20.1608ms 49.6012 Ops/s 49.4060 Ops/s $\color{#35bf28}+0.40\%$
test_to_cpu_global_sync 0.1294s 13.4157ms 74.5393 Ops/s 83.1542 Ops/s $\textbf{\color{#d91a1a}-10.36\%}$
test_to_cpu_event_sync 13.4449ms 13.0475ms 76.6428 Ops/s 76.9063 Ops/s $\color{#d91a1a}-0.34\%$
test_to_cpu_default 13.4389ms 13.0751ms 76.4812 Ops/s 68.2907 Ops/s $\textbf{\color{#35bf28}+11.99\%}$
test_consolidate[False-None] 4.6345ms 4.2207ms 236.9250 Ops/s 234.8009 Ops/s $\color{#35bf28}+0.90\%$
test_consolidate[default-None] 3.3607ms 2.3575ms 424.1864 Ops/s 412.5823 Ops/s $\color{#35bf28}+2.81\%$
test_consolidate[reduce-overhead-None] 3.2736ms 2.2526ms 443.9291 Ops/s 427.6948 Ops/s $\color{#35bf28}+3.80\%$
test_consolidate_njt[False-None] 5.2812ms 5.1477ms 194.2625 Ops/s 190.9668 Ops/s $\color{#35bf28}+1.73\%$
test_to[False-False-None] 2.3782ms 2.2567ms 443.1280 Ops/s 440.1885 Ops/s $\color{#35bf28}+0.67\%$
test_to[True-False-None] 2.3052ms 1.9829ms 504.3218 Ops/s 497.8049 Ops/s $\color{#35bf28}+1.31\%$
test_to[within-False-None] 6.4948ms 6.3154ms 158.3428 Ops/s 154.3160 Ops/s $\color{#35bf28}+2.61\%$
test_to[True-default-None] 11.0641ms 10.4096ms 96.0656 Ops/s 93.0249 Ops/s $\color{#35bf28}+3.27\%$
test_to_njt[False-False-None] 7.3545ms 7.0730ms 141.3836 Ops/s 139.6031 Ops/s $\color{#35bf28}+1.28\%$
test_to_njt[True-False-None] 4.2534ms 3.9931ms 250.4350 Ops/s 242.0813 Ops/s $\color{#35bf28}+3.45\%$
test_to_njt[within-False-None] 9.2058ms 9.0910ms 109.9984 Ops/s 107.2372 Ops/s $\color{#35bf28}+2.57\%$
test_creation[device0] 0.3932ms 0.1147ms 8.7186 KOps/s 8.4838 KOps/s $\color{#35bf28}+2.77\%$
test_creation_from_tensor 0.4638ms 0.1127ms 8.8722 KOps/s 8.6389 KOps/s $\color{#35bf28}+2.70\%$
test_add_one[memmap_tensor0] 0.2244ms 6.6012μs 151.4865 KOps/s 155.8702 KOps/s $\color{#d91a1a}-2.81\%$
test_contiguous[memmap_tensor0] 20.8100μs 0.6738μs 1.4842 MOps/s 2.0867 MOps/s $\textbf{\color{#d91a1a}-28.87\%}$
test_stack[memmap_tensor0] 88.6610μs 4.3373μs 230.5599 KOps/s 230.8586 KOps/s $\color{#d91a1a}-0.13\%$
test_memmaptd_index 1.2992ms 0.2843ms 3.5170 KOps/s 3.6003 KOps/s $\color{#d91a1a}-2.31\%$
test_memmaptd_index_astensor 0.5360ms 0.3849ms 2.5978 KOps/s 2.6023 KOps/s $\color{#d91a1a}-0.17\%$
test_memmaptd_index_op 1.0404ms 0.6305ms 1.5862 KOps/s 1.5604 KOps/s $\color{#35bf28}+1.65\%$
test_serialize_model 0.1404s 0.1365s 7.3250 Ops/s 3.2366 Ops/s $\textbf{\color{#35bf28}+126.31\%}$
test_serialize_model_pickle 1.3717s 1.2146s 0.8233 Ops/s 0.8245 Ops/s $\color{#d91a1a}-0.14\%$
test_serialize_weights 0.1372s 0.1338s 7.4751 Ops/s 7.4708 Ops/s $\color{#35bf28}+0.06\%$
test_serialize_weights_returnearly 0.5022s 91.4265ms 10.9377 Ops/s 15.4650 Ops/s $\textbf{\color{#d91a1a}-29.27\%}$
test_serialize_weights_pickle 1.3656s 1.2130s 0.8244 Ops/s 0.8227 Ops/s $\color{#35bf28}+0.20\%$
test_reshape_pytree 0.2070ms 32.9152μs 30.3811 KOps/s 30.8067 KOps/s $\color{#d91a1a}-1.38\%$
test_reshape_td 93.6510μs 46.5475μs 21.4834 KOps/s 21.9372 KOps/s $\color{#d91a1a}-2.07\%$
test_view_pytree 0.2252ms 32.1724μs 31.0826 KOps/s 31.1489 KOps/s $\color{#d91a1a}-0.21\%$
test_view_td 91.1820μs 54.7658μs 18.2596 KOps/s 17.1195 KOps/s $\textbf{\color{#35bf28}+6.66\%}$
test_unbind_pytree 0.2390ms 35.8635μs 27.8835 KOps/s 25.9408 KOps/s $\textbf{\color{#35bf28}+7.49\%}$
test_unbind_td 0.1509ms 50.2361μs 19.9060 KOps/s 18.7302 KOps/s $\textbf{\color{#35bf28}+6.28\%}$
test_split_pytree 0.2467ms 41.8339μs 23.9041 KOps/s 22.9539 KOps/s $\color{#35bf28}+4.14\%$
test_split_td 0.1260ms 70.9710μs 14.0903 KOps/s 13.1915 KOps/s $\textbf{\color{#35bf28}+6.81\%}$
test_add_pytree 0.2336ms 42.6574μs 23.4426 KOps/s 15.5511 KOps/s $\textbf{\color{#35bf28}+50.75\%}$
test_add_td 0.1101ms 55.0336μs 18.1707 KOps/s 17.1469 KOps/s $\textbf{\color{#35bf28}+5.97\%}$
test_compile_add_one_nested[tensordict-compile] 0.3769ms 0.2720ms 3.6763 KOps/s 3.6811 KOps/s $\color{#d91a1a}-0.13\%$
test_compile_add_one_nested[tensordict-eager] 0.2856ms 0.2062ms 4.8499 KOps/s 4.9651 KOps/s $\color{#d91a1a}-2.32\%$
test_compile_add_one_nested[pytree-compile] 0.4258ms 0.1593ms 6.2789 KOps/s 6.3248 KOps/s $\color{#d91a1a}-0.73\%$
test_compile_add_one_nested[pytree-eager] 0.5111ms 0.1826ms 5.4755 KOps/s 5.4369 KOps/s $\color{#35bf28}+0.71\%$
test_compile_copy_nested[tensordict-compile] 80.7210μs 23.9672μs 41.7236 KOps/s 45.1669 KOps/s $\textbf{\color{#d91a1a}-7.62\%}$
test_compile_copy_nested[tensordict-eager] 0.1012ms 53.9128μs 18.5485 KOps/s 18.2352 KOps/s $\color{#35bf28}+1.72\%$
test_compile_copy_nested[pytree-compile] 0.1649ms 19.7976μs 50.5111 KOps/s 49.4736 KOps/s $\color{#35bf28}+2.10\%$
test_compile_copy_nested[pytree-eager] 0.3819ms 66.6567μs 15.0022 KOps/s 14.9505 KOps/s $\color{#35bf28}+0.35\%$
test_compile_add_one_flat[tensordict-compile] 0.4150ms 0.3064ms 3.2639 KOps/s 3.0523 KOps/s $\textbf{\color{#35bf28}+6.93\%}$
test_compile_add_one_flat[tensordict-eager] 0.3867ms 0.2934ms 3.4081 KOps/s 3.4640 KOps/s $\color{#d91a1a}-1.61\%$
test_compile_add_one_flat[tensorclass-compile] 0.2911ms 0.2141ms 4.6700 KOps/s 4.5487 KOps/s $\color{#35bf28}+2.67\%$
test_compile_add_one_flat[tensorclass-eager] 0.1371ms 80.0214μs 12.4967 KOps/s 13.0757 KOps/s $\color{#d91a1a}-4.43\%$
test_compile_add_one_flat[pytree-compile] 0.5093ms 0.2432ms 4.1117 KOps/s 4.0377 KOps/s $\color{#35bf28}+1.83\%$
test_compile_add_one_flat[pytree-eager] 0.8589ms 0.5839ms 1.7126 KOps/s 1.8307 KOps/s $\textbf{\color{#d91a1a}-6.45\%}$
test_compile_add_self_flat[tensordict-eager] 0.4078ms 0.3452ms 2.8968 KOps/s 2.9415 KOps/s $\color{#d91a1a}-1.52\%$
test_compile_add_self_flat[tensordict-compile] 0.4042ms 0.3074ms 3.2536 KOps/s 2.9909 KOps/s $\textbf{\color{#35bf28}+8.78\%}$
test_compile_add_self_flat[tensorclass-eager] 0.1640ms 92.9923μs 10.7536 KOps/s 10.3594 KOps/s $\color{#35bf28}+3.81\%$
test_compile_add_self_flat[tensorclass-compile] 0.3612ms 0.2190ms 4.5654 KOps/s 4.5142 KOps/s $\color{#35bf28}+1.14\%$
test_compile_add_self_flat[pytree-eager] 0.7639ms 0.4531ms 2.2070 KOps/s 2.1844 KOps/s $\color{#35bf28}+1.03\%$
test_compile_add_self_flat[pytree-compile] 0.5508ms 0.2432ms 4.1113 KOps/s 4.0200 KOps/s $\color{#35bf28}+2.27\%$
test_compile_copy_flat[tensordict-compile] 87.5110μs 26.8405μs 37.2571 KOps/s 36.0884 KOps/s $\color{#35bf28}+3.24\%$
test_compile_copy_flat[tensordict-eager] 84.1010μs 40.7635μs 24.5318 KOps/s 24.3707 KOps/s $\color{#35bf28}+0.66\%$
test_compile_copy_flat[pytree-compile] 0.1443ms 26.7666μs 37.3600 KOps/s 36.4362 KOps/s $\color{#35bf28}+2.54\%$
test_compile_copy_flat[pytree-eager] 0.3454ms 51.3953μs 19.4570 KOps/s 19.5030 KOps/s $\color{#d91a1a}-0.24\%$
test_compile_assign_and_add[tensordict-compile] 2.1390ms 0.2636ms 3.7931 KOps/s 3.5556 KOps/s $\textbf{\color{#35bf28}+6.68\%}$
test_compile_assign_and_add[tensordict-eager] 3.6481ms 3.5079ms 285.0740 Ops/s 293.9581 Ops/s $\color{#d91a1a}-3.02\%$
test_compile_assign_and_add[pytree-compile] 1.9813ms 0.1951ms 5.1256 KOps/s 5.0160 KOps/s $\color{#35bf28}+2.19\%$
test_compile_assign_and_add[pytree-eager] 3.1814ms 2.8898ms 346.0493 Ops/s 348.5684 Ops/s $\color{#d91a1a}-0.72\%$
test_compile_indexing[tensor-tensordict-compile] 0.2994ms 0.1594ms 6.2718 KOps/s 6.2455 KOps/s $\color{#35bf28}+0.42\%$
test_compile_indexing[tensor-tensordict-eager] 0.3761ms 78.8530μs 12.6818 KOps/s 12.9786 KOps/s $\color{#d91a1a}-2.29\%$
test_compile_indexing[tensor-tensorclass-compile] 0.2841ms 0.1386ms 7.2129 KOps/s 7.4091 KOps/s $\color{#d91a1a}-2.65\%$
test_compile_indexing[tensor-tensorclass-eager] 0.3484ms 48.3816μs 20.6690 KOps/s 21.3433 KOps/s $\color{#d91a1a}-3.16\%$
test_compile_indexing[tensor-pytree-compile] 0.2785ms 0.1414ms 7.0742 KOps/s 7.3041 KOps/s $\color{#d91a1a}-3.15\%$
test_compile_indexing[tensor-pytree-eager] 0.2864ms 46.2360μs 21.6281 KOps/s 21.2083 KOps/s $\color{#35bf28}+1.98\%$
test_compile_indexing[slice-tensordict-compile] 0.1936ms 89.1435μs 11.2179 KOps/s 10.9896 KOps/s $\color{#35bf28}+2.08\%$
test_compile_indexing[slice-tensordict-eager] 0.2127ms 28.0957μs 35.5926 KOps/s 35.3799 KOps/s $\color{#35bf28}+0.60\%$
test_compile_indexing[slice-tensorclass-compile] 0.2213ms 72.8315μs 13.7303 KOps/s 13.7460 KOps/s $\color{#d91a1a}-0.11\%$
test_compile_indexing[slice-tensorclass-eager] 0.2441ms 22.8361μs 43.7903 KOps/s 44.8407 KOps/s $\color{#d91a1a}-2.34\%$
test_compile_indexing[slice-pytree-compile] 0.1801ms 72.7061μs 13.7540 KOps/s 13.5140 KOps/s $\color{#35bf28}+1.78\%$
test_compile_indexing[slice-pytree-eager] 0.2635ms 22.5435μs 44.3586 KOps/s 44.9190 KOps/s $\color{#d91a1a}-1.25\%$
test_compile_indexing[int-tensordict-compile] 0.1525ms 91.0477μs 10.9833 KOps/s 10.7488 KOps/s $\color{#35bf28}+2.18\%$
test_compile_indexing[int-tensordict-eager] 0.2284ms 28.0731μs 35.6213 KOps/s 35.8524 KOps/s $\color{#d91a1a}-0.64\%$
test_compile_indexing[int-tensorclass-compile] 0.1113ms 74.4516μs 13.4315 KOps/s 13.4817 KOps/s $\color{#d91a1a}-0.37\%$
test_compile_indexing[int-tensorclass-eager] 0.2507ms 22.5363μs 44.3728 KOps/s 44.3817 KOps/s $\color{#d91a1a}-0.02\%$
test_compile_indexing[int-pytree-compile] 0.1215ms 73.6149μs 13.5842 KOps/s 13.4428 KOps/s $\color{#35bf28}+1.05\%$
test_compile_indexing[int-pytree-eager] 0.2657ms 23.1502μs 43.1961 KOps/s 44.3095 KOps/s $\color{#d91a1a}-2.51\%$
test_compile_replace[single-eager] 87.7810μs 50.7612μs 19.7001 KOps/s 20.5921 KOps/s $\color{#d91a1a}-4.33\%$
test_compile_replace[single-compile] 0.2530ms 0.1470ms 6.8033 KOps/s 6.6876 KOps/s $\color{#35bf28}+1.73\%$
test_compile_replace[multi-eager] 0.6605ms 0.5774ms 1.7320 KOps/s 1.6952 KOps/s $\color{#35bf28}+2.17\%$
test_compile_replace[multi-compile] 0.2958ms 0.1582ms 6.3225 KOps/s 6.2561 KOps/s $\color{#35bf28}+1.06\%$
test_compile_tc_getattr_20[eager] 0.2618ms 0.1785ms 5.6021 KOps/s 5.4256 KOps/s $\color{#35bf28}+3.25\%$
test_compile_tc_getattr_20[compile] 0.3451ms 0.1801ms 5.5512 KOps/s 5.5558 KOps/s $\color{#d91a1a}-0.08\%$
test_compile_clone_shallow[20-eager] 57.2810μs 19.1773μs 52.1450 KOps/s 52.8825 KOps/s $\color{#d91a1a}-1.39\%$
test_compile_clone_shallow[20-compile] 0.1543ms 22.9247μs 43.6211 KOps/s 42.5454 KOps/s $\color{#35bf28}+2.53\%$
test_compile_clone_shallow[40-eager] 83.4710μs 33.3217μs 30.0105 KOps/s 30.1002 KOps/s $\color{#d91a1a}-0.30\%$
test_compile_clone_shallow[40-compile] 93.9910μs 25.6800μs 38.9408 KOps/s 38.3526 KOps/s $\color{#35bf28}+1.53\%$
test_compile_clone_shallow[80-eager] 0.1061ms 61.4785μs 16.2658 KOps/s 16.2074 KOps/s $\color{#35bf28}+0.36\%$
test_compile_clone_shallow[80-compile] 82.8710μs 29.5524μs 33.8382 KOps/s 32.6556 KOps/s $\color{#35bf28}+3.62\%$
test_compile_update_inplace[eager] 98.6520μs 62.5662μs 15.9831 KOps/s 15.9917 KOps/s $\color{#d91a1a}-0.05\%$
test_compile_update_inplace[compile] 0.4652ms 0.1209ms 8.2700 KOps/s 8.0037 KOps/s $\color{#35bf28}+3.33\%$
test_mod_add[eager] 0.2895ms 0.2267ms 4.4108 KOps/s 4.4156 KOps/s $\color{#d91a1a}-0.11\%$
test_mod_add[compile] 0.2626ms 0.1185ms 8.4367 KOps/s 8.1376 KOps/s $\color{#35bf28}+3.67\%$
test_mod_add[compile-overhead] 0.2864ms 0.2017ms 4.9576 KOps/s 5.0047 KOps/s $\color{#d91a1a}-0.94\%$
test_mod_wrap[eager] 0.5666ms 0.4777ms 2.0932 KOps/s 2.0646 KOps/s $\color{#35bf28}+1.38\%$
test_mod_wrap[compile] 0.4465ms 0.3554ms 2.8140 KOps/s 2.8604 KOps/s $\color{#d91a1a}-1.62\%$
test_mod_wrap[compile-overhead] 7.2303ms 4.0263ms 248.3650 Ops/s 252.0983 Ops/s $\color{#d91a1a}-1.48\%$
test_mod_wrap_and_backward[eager] 1.9105ms 1.7751ms 563.3531 Ops/s 595.0653 Ops/s $\textbf{\color{#d91a1a}-5.33\%}$
test_mod_wrap_and_backward[compile] 1.9238ms 1.4413ms 693.7942 Ops/s 741.5641 Ops/s $\textbf{\color{#d91a1a}-6.44\%}$
test_mod_wrap_and_backward[compile-overhead] 1.7875ms 1.0511ms 951.4088 Ops/s 1.0367 KOps/s $\textbf{\color{#d91a1a}-8.22\%}$
test_seq_add[eager] 0.6156ms 0.5116ms 1.9546 KOps/s 1.9574 KOps/s $\color{#d91a1a}-0.14\%$
test_seq_add[compile] 0.2713ms 0.1323ms 7.5584 KOps/s 7.1140 KOps/s $\textbf{\color{#35bf28}+6.25\%}$
test_seq_add[compile-overhead] 0.3586ms 0.2035ms 4.9138 KOps/s 4.7143 KOps/s $\color{#35bf28}+4.23\%$
test_seq_wrap[eager] 5.2476ms 1.4268ms 700.8513 Ops/s 698.2466 Ops/s $\color{#35bf28}+0.37\%$
test_seq_wrap[compile] 0.4278ms 0.3628ms 2.7566 KOps/s 2.6756 KOps/s $\color{#35bf28}+3.03\%$
test_seq_wrap[compile-overhead] 0.4552ms 0.3207ms 3.1182 KOps/s 3.0512 KOps/s $\color{#35bf28}+2.20\%$
test_func_call_runtime[False-eager] 0.8572ms 0.8092ms 1.2358 KOps/s 1.1902 KOps/s $\color{#35bf28}+3.84\%$
test_func_call_runtime[False-compile] 0.9144ms 0.7708ms 1.2973 KOps/s 1.2799 KOps/s $\color{#35bf28}+1.36\%$
test_func_call_runtime[False-compile-overhead] 0.6710ms 0.5085ms 1.9667 KOps/s 1.9345 KOps/s $\color{#35bf28}+1.67\%$
test_func_call_runtime[True-eager] 1.1784ms 1.0738ms 931.2777 Ops/s 932.8204 Ops/s $\color{#d91a1a}-0.17\%$
test_func_call_runtime[True-compile] 0.8354ms 0.7858ms 1.2725 KOps/s 1.2576 KOps/s $\color{#35bf28}+1.19\%$
test_func_call_runtime[True-compile-overhead] 0.6871ms 0.5254ms 1.9032 KOps/s 1.8732 KOps/s $\color{#35bf28}+1.60\%$
test_func_call_cm_runtime[False-eager] 0.9053ms 0.8078ms 1.2379 KOps/s 1.2239 KOps/s $\color{#35bf28}+1.14\%$
test_func_call_cm_runtime[False-compile] 0.9034ms 0.7607ms 1.3146 KOps/s 1.3004 KOps/s $\color{#35bf28}+1.09\%$
test_func_call_cm_runtime[False-compile-overhead] 0.5868ms 0.4912ms 2.0357 KOps/s 2.0088 KOps/s $\color{#35bf28}+1.34\%$
test_func_call_cm_runtime[True-eager] 1.3476ms 1.2302ms 812.8543 Ops/s 816.6520 Ops/s $\color{#d91a1a}-0.47\%$
test_func_call_cm_runtime[True-compile] 0.9698ms 0.8695ms 1.1501 KOps/s 1.1468 KOps/s $\color{#35bf28}+0.28\%$
test_func_call_cm_runtime[True-compile-overhead] 1.1868ms 0.8515ms 1.1744 KOps/s 1.1385 KOps/s $\color{#35bf28}+3.16\%$
test_vmap_func_call_cm_runtime[eager] 3.1867ms 2.6841ms 372.5708 Ops/s 372.4736 Ops/s $\color{#35bf28}+0.03\%$
test_vmap_func_call_cm_runtime[compile] 4.1625ms 3.6913ms 270.9084 Ops/s 270.4689 Ops/s $\color{#35bf28}+0.16\%$
test_vmap_func_call_cm_runtime[compile-overhead] 4.1670ms 3.6854ms 271.3415 Ops/s 270.5202 Ops/s $\color{#35bf28}+0.30\%$
test_distributed 0.8686ms 0.1429ms 6.9968 KOps/s 6.9873 KOps/s $\color{#35bf28}+0.14\%$
test_tdmodule 0.4181ms 0.1935ms 5.1691 KOps/s 5.1819 KOps/s $\color{#d91a1a}-0.25\%$
test_tdmodule_dispatch 0.4122ms 0.3755ms 2.6631 KOps/s 2.6551 KOps/s $\color{#35bf28}+0.30\%$
test_tdseq 48.7110μs 26.9260μs 37.1389 KOps/s 37.4444 KOps/s $\color{#d91a1a}-0.82\%$
test_tdseq_dispatch 0.2792ms 0.2200ms 4.5464 KOps/s 4.5460 KOps/s $+0.01\%$
test_instantiation_functorch 2.1304ms 2.0578ms 485.9595 Ops/s 485.2156 Ops/s $\color{#35bf28}+0.15\%$
test_exec_functorch 0.2263ms 0.1786ms 5.5976 KOps/s 5.6243 KOps/s $\color{#d91a1a}-0.47\%$
test_exec_functional_call 0.2087ms 0.1587ms 6.3016 KOps/s 6.2791 KOps/s $\color{#35bf28}+0.36\%$
test_exec_td_decorator 0.5043ms 0.2451ms 4.0807 KOps/s 4.0747 KOps/s $\color{#35bf28}+0.15\%$
test_vmap_mlp_speed_decorator[True-True] 1.3354ms 1.1298ms 885.1222 Ops/s 887.0153 Ops/s $\color{#d91a1a}-0.21\%$
test_vmap_mlp_speed_decorator[True-False] 1.3677ms 1.1280ms 886.4894 Ops/s 889.3357 Ops/s $\color{#d91a1a}-0.32\%$
test_vmap_mlp_speed_decorator[False-True] 1.0911ms 0.8424ms 1.1871 KOps/s 1.2089 KOps/s $\color{#d91a1a}-1.81\%$
test_vmap_mlp_speed_decorator[False-False] 1.0307ms 0.8372ms 1.1944 KOps/s 1.2108 KOps/s $\color{#d91a1a}-1.35\%$
test_vmap_transformer_speed_decorator[True-True] 26.1999ms 25.6528ms 38.9821 Ops/s 39.5887 Ops/s $\color{#d91a1a}-1.53\%$
test_vmap_transformer_speed_decorator[True-False] 26.1005ms 25.3071ms 39.5146 Ops/s 39.6847 Ops/s $\color{#d91a1a}-0.43\%$
test_vmap_transformer_speed_decorator[False-True] 25.5310ms 24.6553ms 40.5593 Ops/s 40.2737 Ops/s $\color{#35bf28}+0.71\%$
test_vmap_transformer_speed_decorator[False-False] 25.6201ms 24.5808ms 40.6821 Ops/s 40.4314 Ops/s $\color{#35bf28}+0.62\%$
test_to_module_speed[True] 2.2893ms 1.6371ms 610.8343 Ops/s 596.6655 Ops/s $\color{#35bf28}+2.37\%$
test_to_module_speed[False] 2.2519ms 1.6169ms 618.4669 Ops/s 610.2312 Ops/s $\color{#35bf28}+1.35\%$
test_to_module_plain_tensor_speed[None] 1.8635ms 1.7348ms 576.4416 Ops/s 571.0113 Ops/s $\color{#35bf28}+0.95\%$
test_to_module_plain_tensor_speed[False] 1.6891ms 1.5742ms 635.2400 Ops/s 632.2005 Ops/s $\color{#35bf28}+0.48\%$
test_to_module_plain_tensor_speed[True] 3.5141ms 3.3940ms 294.6415 Ops/s 293.1368 Ops/s $\color{#35bf28}+0.51\%$
test_tc_init 78.0820μs 43.7482μs 22.8581 KOps/s 22.5900 KOps/s $\color{#35bf28}+1.19\%$
test_tc_init_tensor_only 66.8910μs 9.4190μs 106.1680 KOps/s 104.3832 KOps/s $\color{#35bf28}+1.71\%$
test_tc_init_nested 0.1376ms 88.1982μs 11.3381 KOps/s 11.6339 KOps/s $\color{#d91a1a}-2.54\%$
test_tc_init_many_fields 52.3910μs 17.0716μs 58.5767 KOps/s 58.0084 KOps/s $\color{#35bf28}+0.98\%$
test_tc_first_layer_tensor 31.3300μs 1.7481μs 572.0462 KOps/s 558.2053 KOps/s $\color{#35bf28}+2.48\%$
test_tc_first_layer_tensor_only 4.8532μs 0.3996μs 2.5025 MOps/s 2.4669 MOps/s $\color{#35bf28}+1.44\%$
test_tc_first_layer_tensor_set 36.8510μs 4.1462μs 241.1869 KOps/s 236.7766 KOps/s $\color{#35bf28}+1.86\%$
test_tc_first_layer_tensor_only_set 34.0010μs 3.4775μs 287.5605 KOps/s 286.8730 KOps/s $\color{#35bf28}+0.24\%$
test_tc_first_layer_nontensor 37.3010μs 6.0972μs 164.0091 KOps/s 160.8491 KOps/s $\color{#35bf28}+1.96\%$
test_tc_second_layer_tensor 44.1710μs 4.3901μs 227.7847 KOps/s 226.8970 KOps/s $\color{#35bf28}+0.39\%$
test_tc_second_layer_nontensor 34.4610μs 8.5841μs 116.4945 KOps/s 114.5068 KOps/s $\color{#35bf28}+1.74\%$
test_unbind 0.2841s 13.1717ms 75.9205 Ops/s 66.1238 Ops/s $\textbf{\color{#35bf28}+14.82\%}$
test_full_like 4.5663ms 4.3897ms 227.8063 Ops/s 228.1866 Ops/s $\color{#d91a1a}-0.17\%$
test_zeros_like 4.5524ms 4.3785ms 228.3868 Ops/s 228.8077 Ops/s $\color{#d91a1a}-0.18\%$
test_ones_like 4.5426ms 4.3814ms 228.2352 Ops/s 228.4019 Ops/s $\color{#d91a1a}-0.07\%$
test_clone 7.0477ms 6.5632ms 152.3657 Ops/s 155.0103 Ops/s $\color{#d91a1a}-1.71\%$
test_squeeze 68.5210μs 14.2133μs 70.3568 KOps/s 70.9538 KOps/s $\color{#d91a1a}-0.84\%$
test_unsqueeze 0.1660ms 0.1115ms 8.9668 KOps/s 8.8415 KOps/s $\color{#35bf28}+1.42\%$
test_split 0.4056ms 0.1878ms 5.3245 KOps/s 5.2377 KOps/s $\color{#35bf28}+1.66\%$
test_permute 0.2739ms 0.1952ms 5.1217 KOps/s 5.1525 KOps/s $\color{#d91a1a}-0.60\%$
test_stack 51.8019ms 51.3206ms 19.4853 Ops/s 55.1672 Ops/s $\textbf{\color{#d91a1a}-64.68\%}$
test_cat 51.6858ms 51.2801ms 19.5007 Ops/s 37.7777 Ops/s $\textbf{\color{#d91a1a}-48.38\%}$
test_sequential_tensordict 0.6340ms 0.5742ms 1.7416 KOps/s 1.7617 KOps/s $\color{#d91a1a}-1.14\%$
test_sequential_graph_module 0.1731ms 0.1161ms 8.6135 KOps/s 8.7608 KOps/s $\color{#d91a1a}-1.68\%$
test_nested_tensordict 1.8112ms 0.8259ms 1.2108 KOps/s 1.2248 KOps/s $\color{#d91a1a}-1.15\%$
test_nested_graph_module 0.1774ms 0.1261ms 7.9310 KOps/s 7.7912 KOps/s $\color{#35bf28}+1.79\%$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CI CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@vmoens