Skip to content

[CI] Fix flaky test tracker: use job-level API data, always notify, add badge - #1599

Merged
vmoens merged 1 commit into
gh/vmoens/79/basefrom
gh/vmoens/79/head
Feb 19, 2026
Merged

[CI] Fix flaky test tracker: use job-level API data, always notify, add badge#1599
vmoens merged 1 commit into
gh/vmoens/79/basefrom
gh/vmoens/79/head

Conversation

@vmoens

@vmoens vmoens commented Feb 19, 2026 •
edited
Loading

Copy link
Copy Markdown
Collaborator

Stack from ghstack (oldest at bottom):

The flaky test tracker was collecting 0 test results because the CI
(pytorch/test-infra) doesn't upload test result artifacts. Rewrote
analyze_flaky_tests.py to use the GitHub Actions API directly, tracking
job-level pass/fail outcomes (e.g. "test-cpu (3.13) failed 3/30 runs").

Also fixed the notify step to always run (so it can close the tracking
issue when all flaky tests are resolved), and added a shields.io flaky
test badge to README.md.

Co-authored-by: Cursor cursoragent@cursor.com

@vmoens
Update
7751ec6 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Feb 19, 2026
@vmoens @cursoragent
[CI] Fix flaky test tracker: use job-level API data, always notify, a…
fd0b81f 
…dd badge

The flaky test tracker was collecting 0 test results because the CI
(pytorch/test-infra) doesn't upload test result artifacts. Rewrote
analyze_flaky_tests.py to use the GitHub Actions API directly, tracking
job-level pass/fail outcomes (e.g. "test-cpu (3.13) failed 3/30 runs").

Also fixed the notify step to always run (so it can close the tracking
issue when all flaky tests are resolved), and added a shields.io flaky
test badge to README.md.

Co-authored-by: Cursor <cursoragent@cursor.com>
ghstack-source-id: 54a62d9
Pull-Request: #1599
@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Feb 19, 2026
@github-actions github-actions Bot added CI documentation Improvements or additions to documentation labels Feb 19, 2026
@github-actions

github-actions Bot commented Feb 19, 2026

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large&amp;#x26A0;\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 243. Improved: $\large\color{#35bf28}10$. Worsened: $\large\color{#d91a1a}10$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_plain_set_nested 42.0010μs 14.5033μs 68.9496 KOps/s 69.6804 KOps/s $\color{#d91a1a}-1.05\%$
test_plain_set_stack_nested 0.8861ms 14.4031μs 69.4294 KOps/s 69.2596 KOps/s $\color{#35bf28}+0.25\%$
test_plain_set_nested_inplace 38.7110μs 15.7806μs 63.3691 KOps/s 62.5862 KOps/s $\color{#35bf28}+1.25\%$
test_plain_set_stack_nested_inplace 47.9710μs 15.8928μs 62.9216 KOps/s 62.7405 KOps/s $\color{#35bf28}+0.29\%$
test_items 32.9210μs 5.5361μs 180.6328 KOps/s 179.1833 KOps/s $\color{#35bf28}+0.81\%$
test_items_nested 0.4734ms 0.4369ms 2.2886 KOps/s 2.2857 KOps/s $\color{#35bf28}+0.13\%$
test_items_nested_locked 0.4880ms 0.4376ms 2.2851 KOps/s 2.2688 KOps/s $\color{#35bf28}+0.72\%$
test_items_nested_leaf 0.1501ms 91.2567μs 10.9581 KOps/s 10.8023 KOps/s $\color{#35bf28}+1.44\%$
test_items_stack_nested 0.5104ms 0.4347ms 2.3002 KOps/s 2.2727 KOps/s $\color{#35bf28}+1.21\%$
test_items_stack_nested_leaf 0.1228ms 91.1032μs 10.9766 KOps/s 10.7674 KOps/s $\color{#35bf28}+1.94\%$
test_items_stack_nested_locked 0.6902ms 0.4349ms 2.2995 KOps/s 2.2683 KOps/s $\color{#35bf28}+1.38\%$
test_keys 28.9100μs 4.1265μs 242.3389 KOps/s 243.1181 KOps/s $\color{#d91a1a}-0.32\%$
test_keys_nested 0.1681ms 0.1193ms 8.3820 KOps/s 8.4387 KOps/s $\color{#d91a1a}-0.67\%$
test_keys_nested_locked 87.6588ms 0.1407ms 7.1083 KOps/s 7.8867 KOps/s $\textbf{\color{#d91a1a}-9.87\%}$
test_keys_nested_leaf 0.1474ms 0.1101ms 9.0797 KOps/s 9.1658 KOps/s $\color{#d91a1a}-0.94\%$
test_keys_stack_nested 0.1903ms 0.1197ms 8.3522 KOps/s 8.4364 KOps/s $\color{#d91a1a}-1.00\%$
test_keys_stack_nested_leaf 0.1804ms 0.1099ms 9.0966 KOps/s 9.1989 KOps/s $\color{#d91a1a}-1.11\%$
test_keys_stack_nested_locked 0.1789ms 0.1283ms 7.7970 KOps/s 7.8448 KOps/s $\color{#d91a1a}-0.61\%$
test_values 7.2802μs 1.0059μs 994.0974 KOps/s 997.2822 KOps/s $\color{#d91a1a}-0.32\%$
test_values_nested 87.6210μs 46.5242μs 21.4942 KOps/s 21.4947 KOps/s $-0.00\%$
test_values_nested_locked 86.1920μs 49.5866μs 20.1667 KOps/s 19.9437 KOps/s $\color{#35bf28}+1.12\%$
test_values_nested_leaf 0.1118ms 52.3957μs 19.0855 KOps/s 18.8131 KOps/s $\color{#35bf28}+1.45\%$
test_values_stack_nested 95.2520μs 46.5358μs 21.4888 KOps/s 21.3781 KOps/s $\color{#35bf28}+0.52\%$
test_values_stack_nested_leaf 89.4820μs 53.3437μs 18.7463 KOps/s 18.7721 KOps/s $\color{#d91a1a}-0.14\%$
test_values_stack_nested_locked 83.0610μs 49.4016μs 20.2422 KOps/s 20.0139 KOps/s $\color{#35bf28}+1.14\%$
test_membership 5.3935μs 0.8073μs 1.2386 MOps/s 1.2285 MOps/s $\color{#35bf28}+0.83\%$
test_membership_nested 32.2210μs 2.8028μs 356.7845 KOps/s 357.3110 KOps/s $\color{#d91a1a}-0.15\%$
test_membership_nested_leaf 26.8410μs 2.7804μs 359.6646 KOps/s 358.6067 KOps/s $\color{#35bf28}+0.30\%$
test_membership_stacked_nested 26.7010μs 2.7779μs 359.9797 KOps/s 358.7432 KOps/s $\color{#35bf28}+0.34\%$
test_membership_stacked_nested_leaf 31.7510μs 2.7806μs 359.6319 KOps/s 357.9592 KOps/s $\color{#35bf28}+0.47\%$
test_membership_nested_last 27.9800μs 4.1619μs 240.2774 KOps/s 239.9073 KOps/s $\color{#35bf28}+0.15\%$
test_membership_nested_leaf_last 38.2500μs 4.1773μs 239.3889 KOps/s 240.6269 KOps/s $\color{#d91a1a}-0.51\%$
test_membership_stacked_nested_last 37.5510μs 4.1254μs 242.3986 KOps/s 240.2211 KOps/s $\color{#35bf28}+0.91\%$
test_membership_stacked_nested_leaf_last 30.6700μs 4.1194μs 242.7556 KOps/s 242.4353 KOps/s $\color{#35bf28}+0.13\%$
test_nested_getleaf 54.7610μs 20.7356μs 48.2263 KOps/s 48.0757 KOps/s $\color{#35bf28}+0.31\%$
test_nested_get 42.3010μs 19.5196μs 51.2304 KOps/s 50.9406 KOps/s $\color{#35bf28}+0.57\%$
test_stacked_getleaf 55.2210μs 20.2794μs 49.3112 KOps/s 48.7393 KOps/s $\color{#35bf28}+1.17\%$
test_stacked_get 51.2210μs 19.4390μs 51.4430 KOps/s 49.9938 KOps/s $\color{#35bf28}+2.90\%$
test_nested_getitemleaf 54.0010μs 20.9783μs 47.6683 KOps/s 47.3487 KOps/s $\color{#35bf28}+0.68\%$
test_nested_getitem 56.8910μs 19.9375μs 50.1567 KOps/s 49.8905 KOps/s $\color{#35bf28}+0.53\%$
test_stacked_getitemleaf 47.4410μs 20.8548μs 47.9506 KOps/s 47.6704 KOps/s $\color{#35bf28}+0.59\%$
test_stacked_getitem 46.6710μs 19.8966μs 50.2598 KOps/s 49.8098 KOps/s $\color{#35bf28}+0.90\%$
test_lock_nested 8.2215ms 0.4611ms 2.1688 KOps/s 2.1833 KOps/s $\color{#d91a1a}-0.66\%$
test_lock_stack_nested 0.5300ms 0.4575ms 2.1857 KOps/s 2.1564 KOps/s $\color{#35bf28}+1.36\%$
test_unlock_nested 0.4616ms 0.3683ms 2.7154 KOps/s 2.7104 KOps/s $\color{#35bf28}+0.19\%$
test_unlock_stack_nested 0.5034ms 0.3693ms 2.7080 KOps/s 2.6686 KOps/s $\color{#35bf28}+1.48\%$
test_flatten_speed 0.2420ms 0.1151ms 8.6900 KOps/s 8.4948 KOps/s $\color{#35bf28}+2.30\%$
test_unflatten_speed 0.6172ms 0.5488ms 1.8223 KOps/s 1.8112 KOps/s $\color{#35bf28}+0.61\%$
test_common_ops 0.8171ms 0.6769ms 1.4773 KOps/s 1.4820 KOps/s $\color{#d91a1a}-0.32\%$
test_creation 29.6610μs 2.7421μs 364.6836 KOps/s 358.1870 KOps/s $\color{#35bf28}+1.81\%$
test_creation_empty 61.0110μs 5.5239μs 181.0300 KOps/s 172.0808 KOps/s $\textbf{\color{#35bf28}+5.20\%}$
test_creation_nested_1 39.1010μs 9.9045μs 100.9641 KOps/s 99.2514 KOps/s $\color{#35bf28}+1.73\%$
test_creation_nested_2 40.3310μs 11.1145μs 89.9729 KOps/s 88.1190 KOps/s $\color{#35bf28}+2.10\%$
test_creation_many_keys[10] 80.7010μs 16.9022μs 59.1639 KOps/s 58.1373 KOps/s $\color{#35bf28}+1.77\%$
test_creation_many_keys[50] 0.1056ms 72.3376μs 13.8241 KOps/s 13.6884 KOps/s $\color{#35bf28}+0.99\%$
test_creation_many_keys[100] 0.1774ms 0.1412ms 7.0836 KOps/s 7.0385 KOps/s $\color{#35bf28}+0.64\%$
test_creation_nested_many_keys[10] 76.5210μs 36.4078μs 27.4666 KOps/s 27.3889 KOps/s $\color{#35bf28}+0.28\%$
test_creation_nested_many_keys[50] 0.2029ms 0.1477ms 6.7705 KOps/s 6.7221 KOps/s $\color{#35bf28}+0.72\%$
test_clone 43.5800μs 13.2638μs 75.3932 KOps/s 74.7915 KOps/s $\color{#35bf28}+0.80\%$
test_getitem[int] 1.7352ms 14.1087μs 70.8784 KOps/s 59.3628 KOps/s $\textbf{\color{#35bf28}+19.40\%}$
test_getitem[slice_int] 0.1361ms 23.7979μs 42.0206 KOps/s 42.1770 KOps/s $\color{#d91a1a}-0.37\%$
test_getitem[range] 0.1727ms 60.8234μs 16.4410 KOps/s 16.4390 KOps/s $\color{#35bf28}+0.01\%$
test_getitem[tuple] 0.1484ms 23.3543μs 42.8186 KOps/s 43.3245 KOps/s $\color{#d91a1a}-1.17\%$
test_getitem[list] 0.1957ms 56.7183μs 17.6310 KOps/s 17.6757 KOps/s $\color{#d91a1a}-0.25\%$
test_setitem_dim[int] 45.6010μs 25.9793μs 38.4922 KOps/s 39.5085 KOps/s $\color{#d91a1a}-2.57\%$
test_setitem_dim[slice_int] 69.2010μs 43.2933μs 23.0982 KOps/s 23.6179 KOps/s $\color{#d91a1a}-2.20\%$
test_setitem_dim[range] 0.1314ms 92.5140μs 10.8092 KOps/s 10.9551 KOps/s $\color{#d91a1a}-1.33\%$
test_setitem_dim[tuple] 61.6910μs 39.1239μs 25.5598 KOps/s 25.7115 KOps/s $\color{#d91a1a}-0.59\%$
test_setitem 46.1410μs 17.5448μs 56.9969 KOps/s 56.5277 KOps/s $\color{#35bf28}+0.83\%$
test_set 59.8710μs 16.9627μs 58.9529 KOps/s 59.3940 KOps/s $\color{#d91a1a}-0.74\%$
test_set_shared 0.4994ms 0.2035ms 4.9148 KOps/s 4.9085 KOps/s $\color{#35bf28}+0.13\%$
test_update 0.3505ms 21.2308μs 47.1013 KOps/s 47.2625 KOps/s $\color{#d91a1a}-0.34\%$
test_update_nested 98.3320μs 32.1538μs 31.1005 KOps/s 30.2318 KOps/s $\color{#35bf28}+2.87\%$
test_update__nested 0.4699ms 33.9469μs 29.4578 KOps/s 29.3819 KOps/s $\color{#35bf28}+0.26\%$
test_set_nested 53.9810μs 18.9248μs 52.8409 KOps/s 53.2928 KOps/s $\color{#d91a1a}-0.85\%$
test_set_nested_new 57.5410μs 24.0281μs 41.6180 KOps/s 42.2346 KOps/s $\color{#d91a1a}-1.46\%$
test_select 76.0310μs 40.2271μs 24.8589 KOps/s 24.5096 KOps/s $\color{#35bf28}+1.43\%$
test_select_nested 0.1196ms 70.9473μs 14.0950 KOps/s 14.1827 KOps/s $\color{#d91a1a}-0.62\%$
test_exclude_nested 0.1224ms 87.7042μs 11.4020 KOps/s 11.3884 KOps/s $\color{#35bf28}+0.12\%$
test_empty[True] 0.4015ms 0.3739ms 2.6742 KOps/s 2.6672 KOps/s $\color{#35bf28}+0.26\%$
test_empty[False] 7.7277μs 1.2585μs 794.6259 KOps/s 798.3805 KOps/s $\color{#d91a1a}-0.47\%$
test_to 0.1007ms 70.7889μs 14.1265 KOps/s 14.2939 KOps/s $\color{#d91a1a}-1.17\%$
test_to_nonblocking 0.1008ms 64.6544μs 15.4668 KOps/s 15.9524 KOps/s $\color{#d91a1a}-3.04\%$
test_unbind_speed 0.3524ms 0.3129ms 3.1959 KOps/s 3.1708 KOps/s $\color{#35bf28}+0.79\%$
test_unbind_speed_stack0 0.3808ms 0.3106ms 3.2197 KOps/s 3.1736 KOps/s $\color{#35bf28}+1.45\%$
test_unbind_speed_stack1 0.1023s 0.8795ms 1.1370 KOps/s 1.1056 KOps/s $\color{#35bf28}+2.84\%$
test_split 1.1410ms 1.0925ms 915.2948 Ops/s 915.1798 Ops/s $\color{#35bf28}+0.01\%$
test_chunk 0.1012s 1.1668ms 857.0245 Ops/s 961.6563 Ops/s $\textbf{\color{#d91a1a}-10.88\%}$
test_to_cpu_blocking 28.3607ms 28.0103ms 35.7011 Ops/s 41.2208 Ops/s $\textbf{\color{#d91a1a}-13.39\%}$
test_to_cpu_global_sync 11.1362ms 11.0397ms 90.5820 Ops/s 91.4056 Ops/s $\color{#d91a1a}-0.90\%$
test_to_cpu_event_sync 0.1137s 13.1456ms 76.0713 Ops/s 84.6583 Ops/s $\textbf{\color{#d91a1a}-10.14\%}$
test_to_cpu_default 12.2848ms 11.8923ms 84.0883 Ops/s 84.6465 Ops/s $\color{#d91a1a}-0.66\%$
test_consolidate[False-None] 4.0558ms 3.9996ms 250.0240 Ops/s 225.7632 Ops/s $\textbf{\color{#35bf28}+10.75\%}$
test_consolidate[default-None] 2.1128ms 1.9989ms 500.2716 Ops/s 495.3997 Ops/s $\color{#35bf28}+0.98\%$
test_consolidate[reduce-overhead-None] 2.0223ms 1.9216ms 520.4094 Ops/s 514.0116 Ops/s $\color{#35bf28}+1.24\%$
test_consolidate_njt[False-None] 8.7035ms 8.3011ms 120.4663 Ops/s 120.8522 Ops/s $\color{#d91a1a}-0.32\%$
test_to[False-False-None] 2.1685ms 2.0443ms 489.1669 Ops/s 492.9694 Ops/s $\color{#d91a1a}-0.77\%$
test_to[True-False-None] 2.1485ms 1.9057ms 524.7408 Ops/s 529.6785 Ops/s $\color{#d91a1a}-0.93\%$
test_to[within-False-None] 6.2499ms 6.0179ms 166.1708 Ops/s 167.3071 Ops/s $\color{#d91a1a}-0.68\%$
test_to[True-default-None] 7.9933ms 7.5293ms 132.8136 Ops/s 126.3936 Ops/s $\textbf{\color{#35bf28}+5.08\%}$
test_to_njt[False-False-None] 8.3991ms 8.3348ms 119.9788 Ops/s 116.4712 Ops/s $\color{#35bf28}+3.01\%$
test_to_njt[True-False-None] 7.2001ms 6.8692ms 145.5766 Ops/s 145.3194 Ops/s $\color{#35bf28}+0.18\%$
test_to_njt[within-False-None] 15.7613ms 15.1292ms 66.0974 Ops/s 64.3017 Ops/s $\color{#35bf28}+2.79\%$
test_creation[device0] 0.3903ms 0.1205ms 8.2968 KOps/s 8.7273 KOps/s $\color{#d91a1a}-4.93\%$
test_creation_from_tensor 0.4671ms 0.1176ms 8.5004 KOps/s 8.6583 KOps/s $\color{#d91a1a}-1.82\%$
test_add_one[memmap_tensor0] 0.3026ms 6.5660μs 152.2998 KOps/s 155.9776 KOps/s $\color{#d91a1a}-2.36\%$
test_contiguous[memmap_tensor0] 36.0510μs 0.6497μs 1.5392 MOps/s 2.3391 MOps/s $\textbf{\color{#d91a1a}-34.20\%}$
test_stack[memmap_tensor0] 35.7510μs 4.7803μs 209.1907 KOps/s 218.2469 KOps/s $\color{#d91a1a}-4.15\%$
test_memmaptd_index 0.9699ms 0.2613ms 3.8270 KOps/s 3.9121 KOps/s $\color{#d91a1a}-2.18\%$
test_memmaptd_index_astensor 0.5032ms 0.3502ms 2.8558 KOps/s 2.8989 KOps/s $\color{#d91a1a}-1.49\%$
test_memmaptd_index_op 0.8467ms 0.5983ms 1.6715 KOps/s 1.6876 KOps/s $\color{#d91a1a}-0.96\%$
test_serialize_model 0.1375s 0.1356s 7.3722 Ops/s 7.2483 Ops/s $\color{#35bf28}+1.71\%$
test_serialize_model_pickle 1.3472s 1.2133s 0.8242 Ops/s 0.8257 Ops/s $\color{#d91a1a}-0.19\%$
test_serialize_weights 0.1385s 0.1355s 7.3801 Ops/s 7.3853 Ops/s $\color{#d91a1a}-0.07\%$
test_serialize_weights_returnearly 0.4171s 91.2580ms 10.9579 Ops/s 11.1636 Ops/s $\color{#d91a1a}-1.84\%$
test_serialize_weights_pickle 1.3643s 1.1973s 0.8352 Ops/s 0.8233 Ops/s $\color{#35bf28}+1.44\%$
test_reshape_pytree 0.2276ms 32.4414μs 30.8248 KOps/s 30.7647 KOps/s $\color{#35bf28}+0.20\%$
test_reshape_td 82.5420μs 42.5318μs 23.5118 KOps/s 22.8099 KOps/s $\color{#35bf28}+3.08\%$
test_view_pytree 0.2126ms 31.9064μs 31.3417 KOps/s 31.1828 KOps/s $\color{#35bf28}+0.51\%$
test_view_td 94.7220μs 51.3025μs 19.4922 KOps/s 19.7229 KOps/s $\color{#d91a1a}-1.17\%$
test_unbind_pytree 0.2325ms 35.6268μs 28.0687 KOps/s 28.0515 KOps/s $\color{#35bf28}+0.06\%$
test_unbind_td 88.4820μs 47.0674μs 21.2461 KOps/s 21.2081 KOps/s $\color{#35bf28}+0.18\%$
test_split_pytree 0.2534ms 41.1389μs 24.3079 KOps/s 24.3593 KOps/s $\color{#d91a1a}-0.21\%$
test_split_td 0.1459ms 62.7413μs 15.9385 KOps/s 15.7908 KOps/s $\color{#35bf28}+0.93\%$
test_add_pytree 0.2372ms 41.2405μs 24.2480 KOps/s 23.9738 KOps/s $\color{#35bf28}+1.14\%$
test_add_td 94.4810μs 51.9993μs 19.2310 KOps/s 19.1728 KOps/s $\color{#35bf28}+0.30\%$
test_compile_add_one_nested[tensordict-compile] 0.2035ms 0.1367ms 7.3166 KOps/s 7.0370 KOps/s $\color{#35bf28}+3.97\%$
test_compile_add_one_nested[tensordict-eager] 0.2800ms 0.1880ms 5.3183 KOps/s 5.3994 KOps/s $\color{#d91a1a}-1.50\%$
test_compile_add_one_nested[pytree-compile] 0.1543ms 0.1071ms 9.3413 KOps/s 8.8554 KOps/s $\textbf{\color{#35bf28}+5.49\%}$
test_compile_add_one_nested[pytree-eager] 0.4296ms 0.1748ms 5.7192 KOps/s 5.7405 KOps/s $\color{#d91a1a}-0.37\%$
test_compile_copy_nested[tensordict-compile] 71.9020μs 29.0749μs 34.3939 KOps/s 30.8049 KOps/s $\textbf{\color{#35bf28}+11.65\%}$
test_compile_copy_nested[tensordict-eager] 0.1027ms 49.5937μs 20.1639 KOps/s 20.1436 KOps/s $\color{#35bf28}+0.10\%$
test_compile_copy_nested[pytree-compile] 42.4510μs 9.4673μs 105.6269 KOps/s 103.3688 KOps/s $\color{#35bf28}+2.18\%$
test_compile_copy_nested[pytree-eager] 0.4553ms 64.9452μs 15.3976 KOps/s 15.4488 KOps/s $\color{#d91a1a}-0.33\%$
test_compile_add_one_flat[tensordict-compile] 0.2586ms 0.1744ms 5.7330 KOps/s 5.1770 KOps/s $\textbf{\color{#35bf28}+10.74\%}$
test_compile_add_one_flat[tensordict-eager] 0.3821ms 0.2537ms 3.9415 KOps/s 3.9927 KOps/s $\color{#d91a1a}-1.28\%$
test_compile_add_one_flat[tensorclass-compile] 0.1987ms 0.1153ms 8.6720 KOps/s 8.3378 KOps/s $\color{#35bf28}+4.01\%$
test_compile_add_one_flat[tensorclass-eager] 0.1143ms 70.2614μs 14.2326 KOps/s 14.8199 KOps/s $\color{#d91a1a}-3.96\%$
test_compile_add_one_flat[pytree-compile] 0.2108ms 0.1615ms 6.1914 KOps/s 6.2062 KOps/s $\color{#d91a1a}-0.24\%$
test_compile_add_one_flat[pytree-eager] 0.8138ms 0.5207ms 1.9205 KOps/s 1.8997 KOps/s $\color{#35bf28}+1.09\%$
test_compile_add_self_flat[tensordict-eager] 0.3565ms 0.3015ms 3.3168 KOps/s 3.2899 KOps/s $\color{#35bf28}+0.82\%$
test_compile_add_self_flat[tensordict-compile] 0.2471ms 0.1800ms 5.5561 KOps/s 5.3972 KOps/s $\color{#35bf28}+2.94\%$
test_compile_add_self_flat[tensorclass-eager] 0.1485ms 86.2271μs 11.5973 KOps/s 12.1343 KOps/s $\color{#d91a1a}-4.43\%$
test_compile_add_self_flat[tensorclass-compile] 0.1992ms 0.1227ms 8.1500 KOps/s 8.3087 KOps/s $\color{#d91a1a}-1.91\%$
test_compile_add_self_flat[pytree-eager] 0.6566ms 0.4355ms 2.2961 KOps/s 2.2916 KOps/s $\color{#35bf28}+0.20\%$
test_compile_add_self_flat[pytree-compile] 0.2091ms 0.1583ms 6.3177 KOps/s 6.2959 KOps/s $\color{#35bf28}+0.35\%$
test_compile_copy_flat[tensordict-compile] 0.1116ms 23.4648μs 42.6170 KOps/s 39.8032 KOps/s $\textbf{\color{#35bf28}+7.07\%}$
test_compile_copy_flat[tensordict-eager] 77.9020μs 40.1821μs 24.8867 KOps/s 24.8325 KOps/s $\color{#35bf28}+0.22\%$
test_compile_copy_flat[pytree-compile] 37.1110μs 10.5051μs 95.1915 KOps/s 96.2441 KOps/s $\color{#d91a1a}-1.09\%$
test_compile_copy_flat[pytree-eager] 0.3736ms 51.2406μs 19.5158 KOps/s 19.6825 KOps/s $\color{#d91a1a}-0.85\%$
test_compile_assign_and_add[tensordict-compile] 1.9647ms 0.1680ms 5.9526 KOps/s 5.7440 KOps/s $\color{#35bf28}+3.63\%$
test_compile_assign_and_add[tensordict-eager] 3.9148ms 3.2649ms 306.2878 Ops/s 307.2855 Ops/s $\color{#d91a1a}-0.32\%$
test_compile_assign_and_add[pytree-compile] 1.9251ms 0.1577ms 6.3403 KOps/s 6.2624 KOps/s $\color{#35bf28}+1.24\%$
test_compile_assign_and_add[pytree-eager] 2.9037ms 2.7614ms 362.1417 Ops/s 365.2406 Ops/s $\color{#d91a1a}-0.85\%$
test_compile_indexing[tensor-tensordict-compile] 0.1766ms 0.1074ms 9.3113 KOps/s 9.2510 KOps/s $\color{#35bf28}+0.65\%$
test_compile_indexing[tensor-tensordict-eager] 0.3080ms 71.5751μs 13.9713 KOps/s 13.4374 KOps/s $\color{#35bf28}+3.97\%$
test_compile_indexing[tensor-tensorclass-compile] 0.1336ms 95.5998μs 10.4603 KOps/s 10.5048 KOps/s $\color{#d91a1a}-0.42\%$
test_compile_indexing[tensor-tensorclass-eager] 0.2512ms 44.3488μs 22.5485 KOps/s 22.2898 KOps/s $\color{#35bf28}+1.16\%$
test_compile_indexing[tensor-pytree-compile] 0.1688ms 96.1862μs 10.3965 KOps/s 10.0964 KOps/s $\color{#35bf28}+2.97\%$
test_compile_indexing[tensor-pytree-eager] 0.2431ms 44.6755μs 22.3836 KOps/s 21.0287 KOps/s $\textbf{\color{#35bf28}+6.44\%}$
test_compile_indexing[slice-tensordict-compile] 0.1302ms 55.8174μs 17.9156 KOps/s 17.8487 KOps/s $\color{#35bf28}+0.37\%$
test_compile_indexing[slice-tensordict-eager] 0.2209ms 27.3728μs 36.5327 KOps/s 37.1933 KOps/s $\color{#d91a1a}-1.78\%$
test_compile_indexing[slice-tensorclass-compile] 88.1310μs 45.6339μs 21.9136 KOps/s 21.0222 KOps/s $\color{#35bf28}+4.24\%$
test_compile_indexing[slice-tensorclass-eager] 0.2596ms 21.9462μs 45.5660 KOps/s 45.6026 KOps/s $\color{#d91a1a}-0.08\%$
test_compile_indexing[slice-pytree-compile] 84.1520μs 46.0670μs 21.7075 KOps/s 21.8483 KOps/s $\color{#d91a1a}-0.64\%$
test_compile_indexing[slice-pytree-eager] 0.2882ms 21.9616μs 45.5340 KOps/s 45.6726 KOps/s $\color{#d91a1a}-0.30\%$
test_compile_indexing[int-tensordict-compile] 95.7820μs 58.0871μs 17.2155 KOps/s 17.4134 KOps/s $\color{#d91a1a}-1.14\%$
test_compile_indexing[int-tensordict-eager] 0.2339ms 27.0934μs 36.9094 KOps/s 37.4787 KOps/s $\color{#d91a1a}-1.52\%$
test_compile_indexing[int-tensorclass-compile] 92.1720μs 47.4608μs 21.0700 KOps/s 21.5483 KOps/s $\color{#d91a1a}-2.22\%$
test_compile_indexing[int-tensorclass-eager] 0.2654ms 21.9931μs 45.4687 KOps/s 44.9403 KOps/s $\color{#35bf28}+1.18\%$
test_compile_indexing[int-pytree-compile] 0.2123ms 47.2995μs 21.1419 KOps/s 21.9020 KOps/s $\color{#d91a1a}-3.47\%$
test_compile_indexing[int-pytree-eager] 0.2547ms 21.9526μs 45.5526 KOps/s 45.9116 KOps/s $\color{#d91a1a}-0.78\%$
test_mod_add[eager] 96.5120μs 51.8742μs 19.2774 KOps/s 20.6323 KOps/s $\textbf{\color{#d91a1a}-6.57\%}$
test_mod_add[compile] 0.1576ms 0.1073ms 9.3162 KOps/s 9.6254 KOps/s $\color{#d91a1a}-3.21\%$
test_mod_add[compile-overhead] 0.2305ms 0.1452ms 6.8860 KOps/s 6.7766 KOps/s $\color{#35bf28}+1.61\%$
test_mod_wrap[eager] 0.3609ms 0.3023ms 3.3079 KOps/s 3.5271 KOps/s $\textbf{\color{#d91a1a}-6.22\%}$
test_mod_wrap[compile] 0.4168ms 0.3418ms 2.9253 KOps/s 2.9567 KOps/s $\color{#d91a1a}-1.06\%$
test_mod_wrap[compile-overhead] 7.3086ms 4.0390ms 247.5884 Ops/s 251.4688 Ops/s $\color{#d91a1a}-1.54\%$
test_mod_wrap_and_backward[eager] 1.6724ms 1.5117ms 661.5196 Ops/s 673.4022 Ops/s $\color{#d91a1a}-1.76\%$
test_mod_wrap_and_backward[compile] 1.5411ms 1.4261ms 701.1955 Ops/s 701.7539 Ops/s $\color{#d91a1a}-0.08\%$
test_mod_wrap_and_backward[compile-overhead] 1.2416ms 0.8712ms 1.1478 KOps/s 1.1389 KOps/s $\color{#35bf28}+0.78\%$
test_seq_add[eager] 0.2073ms 0.1528ms 6.5428 KOps/s 6.3370 KOps/s $\color{#35bf28}+3.25\%$
test_seq_add[compile] 0.3444ms 0.1179ms 8.4841 KOps/s 8.5463 KOps/s $\color{#d91a1a}-0.73\%$
test_seq_add[compile-overhead] 0.2796ms 0.1583ms 6.3159 KOps/s 6.4040 KOps/s $\color{#d91a1a}-1.37\%$
test_seq_wrap[eager] 0.5973ms 0.5201ms 1.9229 KOps/s 1.9654 KOps/s $\color{#d91a1a}-2.16\%$
test_seq_wrap[compile] 0.4411ms 0.3704ms 2.6995 KOps/s 2.7754 KOps/s $\color{#d91a1a}-2.74\%$
test_seq_wrap[compile-overhead] 0.3662ms 0.2586ms 3.8663 KOps/s 3.8236 KOps/s $\color{#35bf28}+1.12\%$
test_func_call_runtime[False-eager] 0.9672ms 0.8745ms 1.1435 KOps/s 1.2198 KOps/s $\textbf{\color{#d91a1a}-6.26\%}$
test_func_call_runtime[False-compile] 1.0699ms 0.8912ms 1.1220 KOps/s 1.1309 KOps/s $\color{#d91a1a}-0.79\%$
test_func_call_runtime[False-compile-overhead] 0.4828ms 0.4435ms 2.2548 KOps/s 2.2381 KOps/s $\color{#35bf28}+0.75\%$
test_func_call_runtime[True-eager] 1.1582ms 1.0624ms 941.2452 Ops/s 938.4553 Ops/s $\color{#35bf28}+0.30\%$
test_func_call_runtime[True-compile] 1.0515ms 0.9023ms 1.1082 KOps/s 1.1162 KOps/s $\color{#d91a1a}-0.71\%$
test_func_call_runtime[True-compile-overhead] 0.5006ms 0.4575ms 2.1859 KOps/s 2.1729 KOps/s $\color{#35bf28}+0.60\%$
test_func_call_cm_runtime[False-eager] 0.9211ms 0.8319ms 1.2021 KOps/s 1.1570 KOps/s $\color{#35bf28}+3.89\%$
test_func_call_cm_runtime[False-compile] 0.9890ms 0.8919ms 1.1212 KOps/s 1.1096 KOps/s $\color{#35bf28}+1.04\%$
test_func_call_cm_runtime[False-compile-overhead] 0.5788ms 0.4460ms 2.2424 KOps/s 2.2268 KOps/s $\color{#35bf28}+0.70\%$
test_func_call_cm_runtime[True-eager] 1.3182ms 1.2130ms 824.4285 Ops/s 832.6974 Ops/s $\color{#d91a1a}-0.99\%$
test_func_call_cm_runtime[True-compile] 1.0159ms 0.9322ms 1.0727 KOps/s 1.0348 KOps/s $\color{#35bf28}+3.66\%$
test_func_call_cm_runtime[True-compile-overhead] 0.5369ms 0.4866ms 2.0552 KOps/s 2.0151 KOps/s $\color{#35bf28}+1.99\%$
test_vmap_func_call_cm_runtime[eager] 2.8334ms 2.3277ms 429.6032 Ops/s 428.3033 Ops/s $\color{#35bf28}+0.30\%$
test_vmap_func_call_cm_runtime[compile] 1.0039ms 0.9494ms 1.0533 KOps/s 1.0596 KOps/s $\color{#d91a1a}-0.59\%$
test_vmap_func_call_cm_runtime[compile-overhead] 0.5687ms 0.4925ms 2.0303 KOps/s 2.0095 KOps/s $\color{#35bf28}+1.03\%$
test_distributed 0.7629ms 0.1511ms 6.6193 KOps/s 6.4975 KOps/s $\color{#35bf28}+1.88\%$
test_tdmodule 53.2410μs 27.5580μs 36.2872 KOps/s 35.7053 KOps/s $\color{#35bf28}+1.63\%$
test_tdmodule_dispatch 77.4510μs 44.4899μs 22.4770 KOps/s 22.6140 KOps/s $\color{#d91a1a}-0.61\%$
test_tdseq 57.9510μs 26.9358μs 37.1252 KOps/s 37.3057 KOps/s $\color{#d91a1a}-0.48\%$
test_tdseq_dispatch 80.3210μs 46.8931μs 21.3251 KOps/s 21.2980 KOps/s $\color{#35bf28}+0.13\%$
test_instantiation_functorch 2.1522ms 1.9984ms 500.3951 Ops/s 499.2220 Ops/s $\color{#35bf28}+0.23\%$
test_exec_functorch 0.2768ms 0.1773ms 5.6406 KOps/s 5.7172 KOps/s $\color{#d91a1a}-1.34\%$
test_exec_functional_call 0.2575ms 0.1610ms 6.2097 KOps/s 6.3816 KOps/s $\color{#d91a1a}-2.69\%$
test_exec_td_decorator 0.4514ms 0.2312ms 4.3262 KOps/s 4.3452 KOps/s $\color{#d91a1a}-0.44\%$
test_vmap_mlp_speed_decorator[True-True] 0.9959ms 0.8151ms 1.2269 KOps/s 1.2348 KOps/s $\color{#d91a1a}-0.64\%$
test_vmap_mlp_speed_decorator[True-False] 1.0561ms 0.8119ms 1.2316 KOps/s 1.2367 KOps/s $\color{#d91a1a}-0.41\%$
test_vmap_mlp_speed_decorator[False-True] 0.9104ms 0.7098ms 1.4088 KOps/s 1.4350 KOps/s $\color{#d91a1a}-1.82\%$
test_vmap_mlp_speed_decorator[False-False] 0.8863ms 0.7090ms 1.4104 KOps/s 1.3721 KOps/s $\color{#35bf28}+2.79\%$
test_vmap_transformer_speed_decorator[True-True] 21.1409ms 20.4751ms 48.8398 Ops/s 49.6817 Ops/s $\color{#d91a1a}-1.69\%$
test_vmap_transformer_speed_decorator[True-False] 21.0521ms 20.4859ms 48.8141 Ops/s 49.6541 Ops/s $\color{#d91a1a}-1.69\%$
test_vmap_transformer_speed_decorator[False-True] 21.0275ms 20.3085ms 49.2404 Ops/s 50.1139 Ops/s $\color{#d91a1a}-1.74\%$
test_vmap_transformer_speed_decorator[False-False] 20.3089ms 20.1860ms 49.5393 Ops/s 50.0684 Ops/s $\color{#d91a1a}-1.06\%$
test_to_module_speed[True] 1.6297ms 1.3976ms 715.5115 Ops/s 703.0649 Ops/s $\color{#35bf28}+1.77\%$
test_to_module_speed[False] 1.5096ms 1.4159ms 706.2665 Ops/s 720.4699 Ops/s $\color{#d91a1a}-1.97\%$
test_tc_init 75.2120μs 44.0667μs 22.6929 KOps/s 22.3694 KOps/s $\color{#35bf28}+1.45\%$
test_tc_init_tensor_only 33.5810μs 9.3299μs 107.1826 KOps/s 106.4373 KOps/s $\color{#35bf28}+0.70\%$
test_tc_init_nested 0.1380ms 87.5670μs 11.4198 KOps/s 11.2648 KOps/s $\color{#35bf28}+1.38\%$
test_tc_init_many_fields 40.6610μs 15.7448μs 63.5131 KOps/s 64.0782 KOps/s $\color{#d91a1a}-0.88\%$
test_tc_first_layer_tensor 24.0410μs 1.7426μs 573.8611 KOps/s 570.4281 KOps/s $\color{#35bf28}+0.60\%$
test_tc_first_layer_tensor_only 9.1659μs 0.7195μs 1.3899 MOps/s 1.4024 MOps/s $\color{#d91a1a}-0.89\%$
test_tc_first_layer_tensor_set 53.5210μs 3.7258μs 268.3952 KOps/s 267.4192 KOps/s $\color{#35bf28}+0.36\%$
test_tc_first_layer_tensor_only_set 26.2910μs 2.9702μs 336.6723 KOps/s 333.1434 KOps/s $\color{#35bf28}+1.06\%$
test_tc_first_layer_nontensor 91.4020μs 5.8256μs 171.6566 KOps/s 170.9875 KOps/s $\color{#35bf28}+0.39\%$
test_tc_second_layer_tensor 19.5500μs 4.2998μs 232.5707 KOps/s 240.4996 KOps/s $\color{#d91a1a}-3.30\%$
test_tc_second_layer_nontensor 43.7310μs 8.2113μs 121.7835 KOps/s 120.9562 KOps/s $\color{#35bf28}+0.68\%$
test_unbind 0.2429s 14.1229ms 70.8070 Ops/s 57.8819 Ops/s $\textbf{\color{#35bf28}+22.33\%}$
test_full_like 4.4836ms 4.3659ms 229.0481 Ops/s 228.8125 Ops/s $\color{#35bf28}+0.10\%$
test_zeros_like 4.9425ms 4.3659ms 229.0466 Ops/s 229.1221 Ops/s $\color{#d91a1a}-0.03\%$
test_ones_like 4.6405ms 4.3611ms 229.3012 Ops/s 228.3311 Ops/s $\color{#35bf28}+0.42\%$
test_clone 6.7803ms 6.4803ms 154.3139 Ops/s 154.8218 Ops/s $\color{#d91a1a}-0.33\%$
test_squeeze 0.1727ms 13.7752μs 72.5945 KOps/s 72.7578 KOps/s $\color{#d91a1a}-0.22\%$
test_unsqueeze 0.2748ms 0.1079ms 9.2689 KOps/s 9.3058 KOps/s $\color{#d91a1a}-0.40\%$
test_split 0.2298ms 0.1788ms 5.5922 KOps/s 5.6451 KOps/s $\color{#d91a1a}-0.94\%$
test_permute 0.2514ms 0.2096ms 4.7702 KOps/s 4.9103 KOps/s $\color{#d91a1a}-2.85\%$
test_stack 54.0473ms 51.4873ms 19.4223 Ops/s 23.2192 Ops/s $\textbf{\color{#d91a1a}-16.35\%}$
test_cat 51.8068ms 51.1883ms 19.5357 Ops/s 23.0699 Ops/s $\textbf{\color{#d91a1a}-15.32\%}$

@github-actions

github-actions Bot commented Feb 19, 2026

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large&amp;#x26A0;\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 243. Improved: $\large\color{#35bf28}18$. Worsened: $\large\color{#d91a1a}14$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_plain_set_nested 36.0310μs 14.7067μs 67.9963 KOps/s 68.0116 KOps/s $\color{#d91a1a}-0.02\%$
test_plain_set_stack_nested 37.7010μs 15.0985μs 66.2319 KOps/s 66.8009 KOps/s $\color{#d91a1a}-0.85\%$
test_plain_set_nested_inplace 54.8610μs 16.2487μs 61.5434 KOps/s 60.3047 KOps/s $\color{#35bf28}+2.05\%$
test_plain_set_stack_nested_inplace 60.9610μs 16.4170μs 60.9124 KOps/s 60.7323 KOps/s $\color{#35bf28}+0.30\%$
test_items 41.8100μs 5.9629μs 167.7043 KOps/s 165.7210 KOps/s $\color{#35bf28}+1.20\%$
test_items_nested 0.5143ms 0.4571ms 2.1876 KOps/s 2.1631 KOps/s $\color{#35bf28}+1.13\%$
test_items_nested_locked 0.5206ms 0.4566ms 2.1902 KOps/s 2.1426 KOps/s $\color{#35bf28}+2.22\%$
test_items_nested_leaf 0.1380ms 94.6266μs 10.5679 KOps/s 10.3776 KOps/s $\color{#35bf28}+1.83\%$
test_items_stack_nested 0.5927ms 0.4509ms 2.2177 KOps/s 2.1358 KOps/s $\color{#35bf28}+3.83\%$
test_items_stack_nested_leaf 0.1388ms 96.7165μs 10.3395 KOps/s 10.1204 KOps/s $\color{#35bf28}+2.17\%$
test_items_stack_nested_locked 0.5210ms 0.4570ms 2.1881 KOps/s 2.1345 KOps/s $\color{#35bf28}+2.51\%$
test_keys 23.5810μs 4.2451μs 235.5658 KOps/s 237.6452 KOps/s $\color{#d91a1a}-0.87\%$
test_keys_nested 0.1562ms 0.1198ms 8.3494 KOps/s 8.2949 KOps/s $\color{#35bf28}+0.66\%$
test_keys_nested_locked 87.7755ms 0.1418ms 7.0517 KOps/s 7.7338 KOps/s $\textbf{\color{#d91a1a}-8.82\%}$
test_keys_nested_leaf 0.1471ms 0.1093ms 9.1517 KOps/s 8.9585 KOps/s $\color{#35bf28}+2.16\%$
test_keys_stack_nested 0.1735ms 0.1208ms 8.2803 KOps/s 8.2794 KOps/s $\color{#35bf28}+0.01\%$
test_keys_stack_nested_leaf 0.1524ms 0.1112ms 8.9946 KOps/s 8.9990 KOps/s $\color{#d91a1a}-0.05\%$
test_keys_stack_nested_locked 0.1686ms 0.1306ms 7.6568 KOps/s 7.7163 KOps/s $\color{#d91a1a}-0.77\%$
test_values 5.2600μs 1.0298μs 971.0561 KOps/s 972.8270 KOps/s $\color{#d91a1a}-0.18\%$
test_values_nested 77.6620μs 47.6958μs 20.9662 KOps/s 20.8796 KOps/s $\color{#35bf28}+0.41\%$
test_values_nested_locked 89.5220μs 51.1510μs 19.5500 KOps/s 19.4778 KOps/s $\color{#35bf28}+0.37\%$
test_values_nested_leaf 91.1620μs 54.2133μs 18.4457 KOps/s 18.3998 KOps/s $\color{#35bf28}+0.25\%$
test_values_stack_nested 0.1953ms 47.7711μs 20.9332 KOps/s 20.7864 KOps/s $\color{#35bf28}+0.71\%$
test_values_stack_nested_leaf 83.7220μs 54.2209μs 18.4431 KOps/s 18.2958 KOps/s $\color{#35bf28}+0.80\%$
test_values_stack_nested_locked 0.1613ms 50.2682μs 19.8933 KOps/s 19.6456 KOps/s $\color{#35bf28}+1.26\%$
test_membership 5.7017μs 0.8401μs 1.1903 MOps/s 1.1735 MOps/s $\color{#35bf28}+1.43\%$
test_membership_nested 44.3810μs 2.9294μs 341.3723 KOps/s 337.5967 KOps/s $\color{#35bf28}+1.12\%$
test_membership_nested_leaf 56.1700μs 2.9332μs 340.9300 KOps/s 342.3155 KOps/s $\color{#d91a1a}-0.40\%$
test_membership_stacked_nested 36.6000μs 2.9254μs 341.8280 KOps/s 342.3473 KOps/s $\color{#d91a1a}-0.15\%$
test_membership_stacked_nested_leaf 36.1000μs 2.9404μs 340.0912 KOps/s 342.2602 KOps/s $\color{#d91a1a}-0.63\%$
test_membership_nested_last 47.2710μs 4.4017μs 227.1859 KOps/s 231.7194 KOps/s $\color{#d91a1a}-1.96\%$
test_membership_nested_leaf_last 47.0710μs 4.3958μs 227.4885 KOps/s 231.6752 KOps/s $\color{#d91a1a}-1.81\%$
test_membership_stacked_nested_last 39.9300μs 4.3791μs 228.3569 KOps/s 228.8887 KOps/s $\color{#d91a1a}-0.23\%$
test_membership_stacked_nested_leaf_last 39.3600μs 4.3599μs 229.3634 KOps/s 230.3505 KOps/s $\color{#d91a1a}-0.43\%$
test_nested_getleaf 0.1095ms 20.8550μs 47.9502 KOps/s 45.7639 KOps/s $\color{#35bf28}+4.78\%$
test_nested_get 73.7710μs 19.8069μs 50.4875 KOps/s 49.0761 KOps/s $\color{#35bf28}+2.88\%$
test_stacked_getleaf 57.5910μs 21.0648μs 47.4725 KOps/s 46.2689 KOps/s $\color{#35bf28}+2.60\%$
test_stacked_get 49.2910μs 19.9199μs 50.2011 KOps/s 48.1372 KOps/s $\color{#35bf28}+4.29\%$
test_nested_getitemleaf 60.7310μs 21.6829μs 46.1193 KOps/s 45.0450 KOps/s $\color{#35bf28}+2.38\%$
test_nested_getitem 67.5820μs 20.2923μs 49.2798 KOps/s 48.2604 KOps/s $\color{#35bf28}+2.11\%$
test_stacked_getitemleaf 82.8620μs 21.7544μs 45.9678 KOps/s 45.3834 KOps/s $\color{#35bf28}+1.29\%$
test_stacked_getitem 50.9110μs 20.3533μs 49.1321 KOps/s 47.9539 KOps/s $\color{#35bf28}+2.46\%$
test_lock_nested 7.8635ms 0.4879ms 2.0495 KOps/s 2.0903 KOps/s $\color{#d91a1a}-1.96\%$
test_lock_stack_nested 0.5748ms 0.4819ms 2.0752 KOps/s 2.0573 KOps/s $\color{#35bf28}+0.87\%$
test_unlock_nested 0.4708ms 0.3895ms 2.5672 KOps/s 2.6043 KOps/s $\color{#d91a1a}-1.42\%$
test_unlock_stack_nested 0.4720ms 0.3874ms 2.5813 KOps/s 2.5602 KOps/s $\color{#35bf28}+0.82\%$
test_flatten_speed 0.1704ms 0.1206ms 8.2940 KOps/s 8.1496 KOps/s $\color{#35bf28}+1.77\%$
test_unflatten_speed 0.6703ms 0.5716ms 1.7493 KOps/s 1.7369 KOps/s $\color{#35bf28}+0.72\%$
test_common_ops 1.0261ms 0.6898ms 1.4497 KOps/s 1.4527 KOps/s $\color{#d91a1a}-0.21\%$
test_creation 69.4120μs 2.9321μs 341.0490 KOps/s 338.7763 KOps/s $\color{#35bf28}+0.67\%$
test_creation_empty 79.4810μs 6.0954μs 164.0588 KOps/s 159.8473 KOps/s $\color{#35bf28}+2.63\%$
test_creation_nested_1 43.6210μs 10.4371μs 95.8121 KOps/s 94.7524 KOps/s $\color{#35bf28}+1.12\%$
test_creation_nested_2 54.2610μs 11.8458μs 84.4184 KOps/s 83.1563 KOps/s $\color{#35bf28}+1.52\%$
test_creation_many_keys[10] 49.2610μs 18.1139μs 55.2064 KOps/s 55.0063 KOps/s $\color{#35bf28}+0.36\%$
test_creation_many_keys[50] 0.1386ms 77.3247μs 12.9325 KOps/s 12.8854 KOps/s $\color{#35bf28}+0.37\%$
test_creation_many_keys[100] 0.2431ms 0.1482ms 6.7489 KOps/s 6.5396 KOps/s $\color{#35bf28}+3.20\%$
test_creation_nested_many_keys[10] 69.7110μs 39.6040μs 25.2499 KOps/s 25.4939 KOps/s $\color{#d91a1a}-0.96\%$
test_creation_nested_many_keys[50] 0.2069ms 0.1590ms 6.2874 KOps/s 6.2402 KOps/s $\color{#35bf28}+0.76\%$
test_clone 44.7210μs 13.5203μs 73.9630 KOps/s 71.6770 KOps/s $\color{#35bf28}+3.19\%$
test_getitem[int] 1.7813ms 14.7020μs 68.0179 KOps/s 56.5082 KOps/s $\textbf{\color{#35bf28}+20.37\%}$
test_getitem[slice_int] 0.1456ms 24.9842μs 40.0253 KOps/s 40.1088 KOps/s $\color{#d91a1a}-0.21\%$
test_getitem[range] 0.1882ms 65.7818μs 15.2018 KOps/s 15.9627 KOps/s $\color{#d91a1a}-4.77\%$
test_getitem[tuple] 0.1490ms 24.2071μs 41.3102 KOps/s 41.2954 KOps/s $\color{#35bf28}+0.04\%$
test_getitem[list] 0.2080ms 59.5500μs 16.7926 KOps/s 16.2432 KOps/s $\color{#35bf28}+3.38\%$
test_setitem_dim[int] 51.8910μs 28.1431μs 35.5327 KOps/s 34.0558 KOps/s $\color{#35bf28}+4.34\%$
test_setitem_dim[slice_int] 77.3820μs 47.3470μs 21.1207 KOps/s 20.8003 KOps/s $\color{#35bf28}+1.54\%$
test_setitem_dim[range] 0.1307ms 99.3588μs 10.0645 KOps/s 10.5233 KOps/s $\color{#d91a1a}-4.36\%$
test_setitem_dim[tuple] 64.1610μs 43.2417μs 23.1258 KOps/s 22.7343 KOps/s $\color{#35bf28}+1.72\%$
test_setitem 53.0910μs 18.3355μs 54.5390 KOps/s 54.0301 KOps/s $\color{#35bf28}+0.94\%$
test_set 61.2710μs 17.1437μs 58.3304 KOps/s 55.8157 KOps/s $\color{#35bf28}+4.51\%$
test_set_shared 0.6788ms 0.2129ms 4.6968 KOps/s 4.6484 KOps/s $\color{#35bf28}+1.04\%$
test_update 0.3322ms 21.9980μs 45.4587 KOps/s 43.7640 KOps/s $\color{#35bf28}+3.87\%$
test_update_nested 74.9720μs 34.5009μs 28.9847 KOps/s 27.8088 KOps/s $\color{#35bf28}+4.23\%$
test_update__nested 0.4511ms 36.3871μs 27.4822 KOps/s 27.0219 KOps/s $\color{#35bf28}+1.70\%$
test_set_nested 48.9410μs 19.1013μs 52.3526 KOps/s 51.2039 KOps/s $\color{#35bf28}+2.24\%$
test_set_nested_new 56.6610μs 24.3014μs 41.1498 KOps/s 39.9652 KOps/s $\color{#35bf28}+2.96\%$
test_select 90.8710μs 42.0918μs 23.7576 KOps/s 22.8438 KOps/s $\color{#35bf28}+4.00\%$
test_select_nested 0.1033ms 74.4371μs 13.4342 KOps/s 13.3684 KOps/s $\color{#35bf28}+0.49\%$
test_exclude_nested 0.1303ms 91.6054μs 10.9164 KOps/s 10.7574 KOps/s $\color{#35bf28}+1.48\%$
test_empty[True] 0.4400ms 0.3875ms 2.5806 KOps/s 2.5248 KOps/s $\color{#35bf28}+2.21\%$
test_empty[False] 7.9950μs 1.3077μs 764.7248 KOps/s 750.8070 KOps/s $\color{#35bf28}+1.85\%$
test_to 0.1048ms 72.9489μs 13.7082 KOps/s 13.5624 KOps/s $\color{#35bf28}+1.08\%$
test_to_nonblocking 0.1559ms 69.9517μs 14.2956 KOps/s 15.4813 KOps/s $\textbf{\color{#d91a1a}-7.66\%}$
test_unbind_speed 0.3756ms 0.3246ms 3.0804 KOps/s 3.0515 KOps/s $\color{#35bf28}+0.95\%$
test_unbind_speed_stack0 0.4253ms 0.3215ms 3.1103 KOps/s 3.0538 KOps/s $\color{#35bf28}+1.85\%$
test_unbind_speed_stack1 0.1016s 0.9081ms 1.1013 KOps/s 1.1795 KOps/s $\textbf{\color{#d91a1a}-6.63\%}$
test_split 1.1887ms 1.1395ms 877.6016 Ops/s 784.5166 Ops/s $\textbf{\color{#35bf28}+11.87\%}$
test_chunk 0.1013s 1.2047ms 830.0543 Ops/s 913.9725 Ops/s $\textbf{\color{#d91a1a}-9.18\%}$
test_to_cpu_blocking 19.4468ms 19.3293ms 51.7348 Ops/s 35.6637 Ops/s $\textbf{\color{#35bf28}+45.06\%}$
test_to_cpu_global_sync 11.3222ms 11.2166ms 89.1533 Ops/s 79.8734 Ops/s $\textbf{\color{#35bf28}+11.62\%}$
test_to_cpu_event_sync 0.1135s 13.3897ms 74.6840 Ops/s 81.4132 Ops/s $\textbf{\color{#d91a1a}-8.27\%}$
test_to_cpu_default 12.4691ms 12.2051ms 81.9331 Ops/s 81.6199 Ops/s $\color{#35bf28}+0.38\%$
test_consolidate[False-None] 4.2902ms 4.1309ms 242.0783 Ops/s 217.2618 Ops/s $\textbf{\color{#35bf28}+11.42\%}$
test_consolidate[default-None] 2.0808ms 2.0104ms 497.4058 Ops/s 482.7997 Ops/s $\color{#35bf28}+3.03\%$
test_consolidate[reduce-overhead-None] 2.0033ms 1.9319ms 517.6328 Ops/s 504.1057 Ops/s $\color{#35bf28}+2.68\%$
test_consolidate_njt[False-None] 8.6153ms 8.4400ms 118.4840 Ops/s 117.3149 Ops/s $\color{#35bf28}+1.00\%$
test_to[False-False-None] 2.1959ms 2.0730ms 482.3930 Ops/s 476.0787 Ops/s $\color{#35bf28}+1.33\%$
test_to[True-False-None] 2.2346ms 1.9593ms 510.3872 Ops/s 512.4295 Ops/s $\color{#d91a1a}-0.40\%$
test_to[within-False-None] 6.2022ms 6.1531ms 162.5193 Ops/s 161.6121 Ops/s $\color{#35bf28}+0.56\%$
test_to[True-default-None] 7.6870ms 7.5567ms 132.3333 Ops/s 129.6834 Ops/s $\color{#35bf28}+2.04\%$
test_to_njt[False-False-None] 8.7224ms 8.5762ms 116.6015 Ops/s 114.9393 Ops/s $\color{#35bf28}+1.45\%$
test_to_njt[True-False-None] 7.0525ms 6.9508ms 143.8679 Ops/s 141.7187 Ops/s $\color{#35bf28}+1.52\%$
test_to_njt[within-False-None] 15.5363ms 15.4757ms 64.6174 Ops/s 64.0544 Ops/s $\color{#35bf28}+0.88\%$
test_creation[device0] 0.4087ms 0.1165ms 8.5818 KOps/s 8.3367 KOps/s $\color{#35bf28}+2.94\%$
test_creation_from_tensor 0.5117ms 0.1142ms 8.7552 KOps/s 8.6123 KOps/s $\color{#35bf28}+1.66\%$
test_add_one[memmap_tensor0] 0.1958ms 6.5785μs 152.0113 KOps/s 143.8342 KOps/s $\textbf{\color{#35bf28}+5.69\%}$
test_contiguous[memmap_tensor0] 31.7700μs 0.6690μs 1.4948 MOps/s 2.1730 MOps/s $\textbf{\color{#d91a1a}-31.21\%}$
test_stack[memmap_tensor0] 32.2010μs 4.5802μs 218.3322 KOps/s 216.8565 KOps/s $\color{#35bf28}+0.68\%$
test_memmaptd_index 0.9918ms 0.2631ms 3.8006 KOps/s 3.7844 KOps/s $\color{#35bf28}+0.43\%$
test_memmaptd_index_astensor 0.5085ms 0.3585ms 2.7895 KOps/s 2.7779 KOps/s $\color{#35bf28}+0.42\%$
test_memmaptd_index_op 0.7574ms 0.6016ms 1.6622 KOps/s 1.6295 KOps/s $\color{#35bf28}+2.00\%$
test_serialize_model 0.1380s 0.1359s 7.3559 Ops/s 7.2861 Ops/s $\color{#35bf28}+0.96\%$
test_serialize_model_pickle 2.0488s 1.3334s 0.7500 Ops/s 0.8261 Ops/s $\textbf{\color{#d91a1a}-9.22\%}$
test_serialize_weights 0.1394s 0.1363s 7.3343 Ops/s 7.4374 Ops/s $\color{#d91a1a}-1.39\%$
test_serialize_weights_returnearly 0.4680s 95.4566ms 10.4760 Ops/s 6.5884 Ops/s $\textbf{\color{#35bf28}+59.01\%}$
test_serialize_weights_pickle 1.3620s 1.2125s 0.8248 Ops/s 0.8097 Ops/s $\color{#35bf28}+1.86\%$
test_reshape_pytree 0.2140ms 33.2859μs 30.0428 KOps/s 29.9162 KOps/s $\color{#35bf28}+0.42\%$
test_reshape_td 79.4620μs 43.9591μs 22.7484 KOps/s 22.6454 KOps/s $\color{#35bf28}+0.45\%$
test_view_pytree 0.2204ms 32.9618μs 30.3381 KOps/s 30.1460 KOps/s $\color{#35bf28}+0.64\%$
test_view_td 90.6420μs 52.3002μs 19.1204 KOps/s 18.7598 KOps/s $\color{#35bf28}+1.92\%$
test_unbind_pytree 0.2367ms 36.7078μs 27.2422 KOps/s 26.6808 KOps/s $\color{#35bf28}+2.10\%$
test_unbind_td 0.1707ms 48.8418μs 20.4743 KOps/s 20.0694 KOps/s $\color{#35bf28}+2.02\%$
test_split_pytree 0.1985ms 42.6350μs 23.4549 KOps/s 23.2607 KOps/s $\color{#35bf28}+0.83\%$
test_split_td 0.2171ms 65.3058μs 15.3126 KOps/s 15.2831 KOps/s $\color{#35bf28}+0.19\%$
test_add_pytree 0.2393ms 44.2487μs 22.5995 KOps/s 23.2511 KOps/s $\color{#d91a1a}-2.80\%$
test_add_td 98.5120μs 56.9051μs 17.5731 KOps/s 18.7669 KOps/s $\textbf{\color{#d91a1a}-6.36\%}$
test_compile_add_one_nested[tensordict-compile] 0.1983ms 0.1416ms 7.0633 KOps/s 6.5365 KOps/s $\textbf{\color{#35bf28}+8.06\%}$
test_compile_add_one_nested[tensordict-eager] 0.2847ms 0.1985ms 5.0369 KOps/s 5.2705 KOps/s $\color{#d91a1a}-4.43\%$
test_compile_add_one_nested[pytree-compile] 0.1579ms 0.1105ms 9.0524 KOps/s 9.0891 KOps/s $\color{#d91a1a}-0.40\%$
test_compile_add_one_nested[pytree-eager] 0.4251ms 0.1795ms 5.5714 KOps/s 5.3321 KOps/s $\color{#35bf28}+4.49\%$
test_compile_copy_nested[tensordict-compile] 0.4533ms 40.0542μs 24.9662 KOps/s 27.4392 KOps/s $\textbf{\color{#d91a1a}-9.01\%}$
test_compile_copy_nested[tensordict-eager] 0.4647ms 52.6003μs 19.0113 KOps/s 19.2618 KOps/s $\color{#d91a1a}-1.30\%$
test_compile_copy_nested[pytree-compile] 0.4357ms 9.7926μs 102.1183 KOps/s 103.3923 KOps/s $\color{#d91a1a}-1.23\%$
test_compile_copy_nested[pytree-eager] 0.4881ms 68.4587μs 14.6074 KOps/s 14.2100 KOps/s $\color{#35bf28}+2.80\%$
test_compile_add_one_flat[tensordict-compile] 0.6077ms 0.1771ms 5.6473 KOps/s 5.3348 KOps/s $\textbf{\color{#35bf28}+5.86\%}$
test_compile_add_one_flat[tensordict-eager] 0.7088ms 0.2549ms 3.9224 KOps/s 3.9170 KOps/s $\color{#35bf28}+0.14\%$
test_compile_add_one_flat[tensorclass-compile] 0.1939ms 0.1169ms 8.5565 KOps/s 7.8901 KOps/s $\textbf{\color{#35bf28}+8.45\%}$
test_compile_add_one_flat[tensorclass-eager] 0.5019ms 72.1422μs 13.8615 KOps/s 14.1331 KOps/s $\color{#d91a1a}-1.92\%$
test_compile_add_one_flat[pytree-compile] 0.6005ms 0.1624ms 6.1563 KOps/s 6.1628 KOps/s $\color{#d91a1a}-0.10\%$
test_compile_add_one_flat[pytree-eager] 0.9600ms 0.5320ms 1.8796 KOps/s 1.8273 KOps/s $\color{#35bf28}+2.86\%$
test_compile_add_self_flat[tensordict-eager] 0.7343ms 0.3078ms 3.2485 KOps/s 3.2395 KOps/s $\color{#35bf28}+0.28\%$
test_compile_add_self_flat[tensordict-compile] 0.2817ms 0.1823ms 5.4847 KOps/s 5.2050 KOps/s $\textbf{\color{#35bf28}+5.37\%}$
test_compile_add_self_flat[tensorclass-eager] 0.5117ms 86.0768μs 11.6175 KOps/s 11.4825 KOps/s $\color{#35bf28}+1.18\%$
test_compile_add_self_flat[tensorclass-compile] 0.2359ms 0.1193ms 8.3805 KOps/s 8.0585 KOps/s $\color{#35bf28}+4.00\%$
test_compile_add_self_flat[pytree-eager] 0.8673ms 0.4361ms 2.2930 KOps/s 2.2404 KOps/s $\color{#35bf28}+2.35\%$
test_compile_add_self_flat[pytree-compile] 0.2058ms 0.1600ms 6.2482 KOps/s 6.1219 KOps/s $\color{#35bf28}+2.06\%$
test_compile_copy_flat[tensordict-compile] 0.4987ms 23.1639μs 43.1706 KOps/s 39.2194 KOps/s $\textbf{\color{#35bf28}+10.07\%}$
test_compile_copy_flat[tensordict-eager] 0.4668ms 41.6758μs 23.9947 KOps/s 23.5848 KOps/s $\color{#35bf28}+1.74\%$
test_compile_copy_flat[pytree-compile] 0.1131ms 10.7842μs 92.7283 KOps/s 91.7348 KOps/s $\color{#35bf28}+1.08\%$
test_compile_copy_flat[pytree-eager] 0.4647ms 52.2357μs 19.1440 KOps/s 19.0805 KOps/s $\color{#35bf28}+0.33\%$
test_compile_assign_and_add[tensordict-compile] 1.9762ms 0.1727ms 5.7908 KOps/s 5.3319 KOps/s $\textbf{\color{#35bf28}+8.61\%}$
test_compile_assign_and_add[tensordict-eager] 3.7238ms 3.3001ms 303.0186 Ops/s 285.7577 Ops/s $\textbf{\color{#35bf28}+6.04\%}$
test_compile_assign_and_add[pytree-compile] 2.0145ms 0.1636ms 6.1126 KOps/s 6.1068 KOps/s $\color{#35bf28}+0.10\%$
test_compile_assign_and_add[pytree-eager] 3.2370ms 2.7982ms 357.3666 Ops/s 349.8344 Ops/s $\color{#35bf28}+2.15\%$
test_compile_indexing[tensor-tensordict-compile] 0.5392ms 0.1095ms 9.1340 KOps/s 8.8509 KOps/s $\color{#35bf28}+3.20\%$
test_compile_indexing[tensor-tensordict-eager] 0.4994ms 72.7053μs 13.7542 KOps/s 13.8057 KOps/s $\color{#d91a1a}-0.37\%$
test_compile_indexing[tensor-tensorclass-compile] 0.1556ms 96.7868μs 10.3320 KOps/s 10.3027 KOps/s $\color{#35bf28}+0.28\%$
test_compile_indexing[tensor-tensorclass-eager] 0.5363ms 45.1167μs 22.1647 KOps/s 22.0739 KOps/s $\color{#35bf28}+0.41\%$
test_compile_indexing[tensor-pytree-compile] 0.5295ms 98.2012μs 10.1832 KOps/s 10.1577 KOps/s $\color{#35bf28}+0.25\%$
test_compile_indexing[tensor-pytree-eager] 0.4733ms 45.2452μs 22.1018 KOps/s 22.0850 KOps/s $\color{#35bf28}+0.08\%$
test_compile_indexing[slice-tensordict-compile] 0.4890ms 56.3496μs 17.7464 KOps/s 17.1524 KOps/s $\color{#35bf28}+3.46\%$
test_compile_indexing[slice-tensordict-eager] 0.4503ms 28.3802μs 35.2358 KOps/s 35.6006 KOps/s $\color{#d91a1a}-1.02\%$
test_compile_indexing[slice-tensorclass-compile] 0.4688ms 47.5238μs 21.0421 KOps/s 21.7395 KOps/s $\color{#d91a1a}-3.21\%$
test_compile_indexing[slice-tensorclass-eager] 0.2654ms 22.4734μs 44.4971 KOps/s 43.3692 KOps/s $\color{#35bf28}+2.60\%$
test_compile_indexing[slice-pytree-compile] 0.4724ms 46.6563μs 21.4333 KOps/s 21.1295 KOps/s $\color{#35bf28}+1.44\%$
test_compile_indexing[slice-pytree-eager] 0.4457ms 22.6315μs 44.1862 KOps/s 43.9052 KOps/s $\color{#35bf28}+0.64\%$
test_compile_indexing[int-tensordict-compile] 0.4776ms 57.7789μs 17.3073 KOps/s 16.4082 KOps/s $\textbf{\color{#35bf28}+5.48\%}$
test_compile_indexing[int-tensordict-eager] 0.4488ms 28.5327μs 35.0476 KOps/s 35.7346 KOps/s $\color{#d91a1a}-1.92\%$
test_compile_indexing[int-tensorclass-compile] 0.4642ms 46.3493μs 21.5753 KOps/s 21.4516 KOps/s $\color{#35bf28}+0.58\%$
test_compile_indexing[int-tensorclass-eager] 0.2747ms 22.3311μs 44.7807 KOps/s 43.6340 KOps/s $\color{#35bf28}+2.63\%$
test_compile_indexing[int-pytree-compile] 0.4732ms 46.9955μs 21.2786 KOps/s 20.7436 KOps/s $\color{#35bf28}+2.58\%$
test_compile_indexing[int-pytree-eager] 0.4385ms 22.5698μs 44.3069 KOps/s 44.1990 KOps/s $\color{#35bf28}+0.24\%$
test_mod_add[eager] 0.4753ms 50.1502μs 19.9401 KOps/s 19.9441 KOps/s $\color{#d91a1a}-0.02\%$
test_mod_add[compile] 0.4381ms 0.1053ms 9.4930 KOps/s 9.3650 KOps/s $\color{#35bf28}+1.37\%$
test_mod_add[compile-overhead] 0.5096ms 0.1497ms 6.6804 KOps/s 6.6819 KOps/s $\color{#d91a1a}-0.02\%$
test_mod_wrap[eager] 0.7486ms 0.2931ms 3.4123 KOps/s 3.4153 KOps/s $\color{#d91a1a}-0.09\%$
test_mod_wrap[compile] 0.4760ms 0.3655ms 2.7362 KOps/s 2.8326 KOps/s $\color{#d91a1a}-3.40\%$
test_mod_wrap[compile-overhead] 7.2811ms 4.0298ms 248.1496 Ops/s 248.4160 Ops/s $\color{#d91a1a}-0.11\%$
test_mod_wrap_and_backward[eager] 1.7638ms 1.5900ms 628.9259 Ops/s 657.4465 Ops/s $\color{#d91a1a}-4.34\%$
test_mod_wrap_and_backward[compile] 1.6917ms 1.5479ms 646.0409 Ops/s 680.5036 Ops/s $\textbf{\color{#d91a1a}-5.06\%}$
test_mod_wrap_and_backward[compile-overhead] 1.4655ms 0.9892ms 1.0109 KOps/s 1.1100 KOps/s $\textbf{\color{#d91a1a}-8.93\%}$
test_seq_add[eager] 0.2346ms 0.1576ms 6.3436 KOps/s 6.2176 KOps/s $\color{#35bf28}+2.03\%$
test_seq_add[compile] 0.1991ms 0.1137ms 8.7935 KOps/s 7.9393 KOps/s $\textbf{\color{#35bf28}+10.76\%}$
test_seq_add[compile-overhead] 0.2302ms 0.1576ms 6.3432 KOps/s 6.1847 KOps/s $\color{#35bf28}+2.56\%$
test_seq_wrap[eager] 0.6273ms 0.5233ms 1.9110 KOps/s 1.7914 KOps/s $\textbf{\color{#35bf28}+6.68\%}$
test_seq_wrap[compile] 0.4663ms 0.3799ms 2.6326 KOps/s 2.6959 KOps/s $\color{#d91a1a}-2.35\%$
test_seq_wrap[compile-overhead] 0.3298ms 0.2635ms 3.7958 KOps/s 3.6688 KOps/s $\color{#35bf28}+3.46\%$
test_func_call_runtime[False-eager] 0.9599ms 0.8446ms 1.1840 KOps/s 1.1895 KOps/s $\color{#d91a1a}-0.46\%$
test_func_call_runtime[False-compile] 0.9769ms 0.9046ms 1.1055 KOps/s 1.0655 KOps/s $\color{#35bf28}+3.75\%$
test_func_call_runtime[False-compile-overhead] 0.5288ms 0.4596ms 2.1760 KOps/s 2.1375 KOps/s $\color{#35bf28}+1.80\%$
test_func_call_runtime[True-eager] 1.1896ms 1.0919ms 915.8045 Ops/s 917.0017 Ops/s $\color{#d91a1a}-0.13\%$
test_func_call_runtime[True-compile] 1.0234ms 0.9136ms 1.0946 KOps/s 1.0758 KOps/s $\color{#35bf28}+1.75\%$
test_func_call_runtime[True-compile-overhead] 0.5587ms 0.4718ms 2.1196 KOps/s 2.0712 KOps/s $\color{#35bf28}+2.34\%$
test_func_call_cm_runtime[False-eager] 0.9967ms 0.8424ms 1.1871 KOps/s 1.1231 KOps/s $\textbf{\color{#35bf28}+5.70\%}$
test_func_call_cm_runtime[False-compile] 1.0666ms 0.9070ms 1.1026 KOps/s 1.0849 KOps/s $\color{#35bf28}+1.62\%$
test_func_call_cm_runtime[False-compile-overhead] 0.5297ms 0.4622ms 2.1636 KOps/s 2.1279 KOps/s $\color{#35bf28}+1.67\%$
test_func_call_cm_runtime[True-eager] 1.3424ms 1.2420ms 805.1576 Ops/s 804.4341 Ops/s $\color{#35bf28}+0.09\%$
test_func_call_cm_runtime[True-compile] 1.0106ms 0.9487ms 1.0541 KOps/s 1.0333 KOps/s $\color{#35bf28}+2.02\%$
test_func_call_cm_runtime[True-compile-overhead] 0.5959ms 0.5062ms 1.9756 KOps/s 1.9370 KOps/s $\color{#35bf28}+1.99\%$
test_vmap_func_call_cm_runtime[eager] 2.9093ms 2.3694ms 422.0548 Ops/s 419.0212 Ops/s $\color{#35bf28}+0.72\%$
test_vmap_func_call_cm_runtime[compile] 1.0435ms 0.9703ms 1.0306 KOps/s 1.0137 KOps/s $\color{#35bf28}+1.66\%$
test_vmap_func_call_cm_runtime[compile-overhead] 0.5613ms 0.5093ms 1.9634 KOps/s 1.9233 KOps/s $\color{#35bf28}+2.08\%$
test_distributed 2.9202ms 0.1687ms 5.9292 KOps/s 6.3684 KOps/s $\textbf{\color{#d91a1a}-6.90\%}$
test_tdmodule 46.0810μs 27.5732μs 36.2671 KOps/s 34.7880 KOps/s $\color{#35bf28}+4.25\%$
test_tdmodule_dispatch 94.9110μs 45.0919μs 22.1769 KOps/s 21.8652 KOps/s $\color{#35bf28}+1.43\%$
test_tdseq 45.5810μs 26.9927μs 37.0471 KOps/s 36.7989 KOps/s $\color{#35bf28}+0.67\%$
test_tdseq_dispatch 78.0720μs 47.1005μs 21.2312 KOps/s 21.0165 KOps/s $\color{#35bf28}+1.02\%$
test_instantiation_functorch 2.1656ms 2.0726ms 482.4937 Ops/s 477.8291 Ops/s $\color{#35bf28}+0.98\%$
test_exec_functorch 0.2381ms 0.1814ms 5.5117 KOps/s 5.4688 KOps/s $\color{#35bf28}+0.78\%$
test_exec_functional_call 0.2784ms 0.1620ms 6.1726 KOps/s 6.0658 KOps/s $\color{#35bf28}+1.76\%$
test_exec_td_decorator 0.4476ms 0.2383ms 4.1964 KOps/s 4.1494 KOps/s $\color{#35bf28}+1.13\%$
test_vmap_mlp_speed_decorator[True-True] 1.0047ms 0.8231ms 1.2149 KOps/s 1.2047 KOps/s $\color{#35bf28}+0.85\%$
test_vmap_mlp_speed_decorator[True-False] 1.0067ms 0.8345ms 1.1983 KOps/s 1.2058 KOps/s $\color{#d91a1a}-0.62\%$
test_vmap_mlp_speed_decorator[False-True] 0.9064ms 0.7125ms 1.4035 KOps/s 1.3924 KOps/s $\color{#35bf28}+0.80\%$
test_vmap_mlp_speed_decorator[False-False] 0.8966ms 0.7262ms 1.3769 KOps/s 1.3927 KOps/s $\color{#d91a1a}-1.13\%$
test_vmap_transformer_speed_decorator[True-True] 21.3029ms 20.5497ms 48.6626 Ops/s 48.5650 Ops/s $\color{#35bf28}+0.20\%$
test_vmap_transformer_speed_decorator[True-False] 21.2629ms 20.5720ms 48.6098 Ops/s 48.4858 Ops/s $\color{#35bf28}+0.26\%$
test_vmap_transformer_speed_decorator[False-True] 21.0520ms 20.4039ms 49.0102 Ops/s 49.0205 Ops/s $\color{#d91a1a}-0.02\%$
test_vmap_transformer_speed_decorator[False-False] 21.2140ms 20.4449ms 48.9119 Ops/s 48.9916 Ops/s $\color{#d91a1a}-0.16\%$
test_to_module_speed[True] 1.6733ms 1.4716ms 679.5548 Ops/s 667.8427 Ops/s $\color{#35bf28}+1.75\%$
test_to_module_speed[False] 1.5628ms 1.4662ms 682.0552 Ops/s 681.0973 Ops/s $\color{#35bf28}+0.14\%$
test_tc_init 69.0610μs 45.0837μs 22.1810 KOps/s 21.6899 KOps/s $\color{#35bf28}+2.26\%$
test_tc_init_tensor_only 44.0610μs 9.8562μs 101.4587 KOps/s 99.5562 KOps/s $\color{#35bf28}+1.91\%$
test_tc_init_nested 0.1289ms 90.7083μs 11.0243 KOps/s 10.9110 KOps/s $\color{#35bf28}+1.04\%$
test_tc_init_many_fields 45.4510μs 16.7699μs 59.6306 KOps/s 59.7596 KOps/s $\color{#d91a1a}-0.22\%$
test_tc_first_layer_tensor 24.3910μs 1.8430μs 542.5842 KOps/s 534.1022 KOps/s $\color{#35bf28}+1.59\%$
test_tc_first_layer_tensor_only 4.7144μs 0.7502μs 1.3330 MOps/s 1.2897 MOps/s $\color{#35bf28}+3.36\%$
test_tc_first_layer_tensor_set 28.3010μs 3.9682μs 252.0034 KOps/s 250.9668 KOps/s $\color{#35bf28}+0.41\%$
test_tc_first_layer_tensor_only_set 25.4400μs 3.3187μs 301.3237 KOps/s 311.9252 KOps/s $\color{#d91a1a}-3.40\%$
test_tc_first_layer_nontensor 25.9310μs 6.1710μs 162.0493 KOps/s 159.7766 KOps/s $\color{#35bf28}+1.42\%$
test_tc_second_layer_tensor 90.3310μs 4.4372μs 225.3672 KOps/s 219.9647 KOps/s $\color{#35bf28}+2.46\%$
test_tc_second_layer_nontensor 25.8610μs 8.8562μs 112.9150 KOps/s 112.8560 KOps/s $\color{#35bf28}+0.05\%$
test_unbind 0.2541s 17.3800ms 57.5373 Ops/s 56.8097 Ops/s $\color{#35bf28}+1.28\%$
test_full_like 7.9476ms 4.4019ms 227.1756 Ops/s 227.8789 Ops/s $\color{#d91a1a}-0.31\%$
test_zeros_like 4.9656ms 4.3715ms 228.7547 Ops/s 228.5558 Ops/s $\color{#35bf28}+0.09\%$
test_ones_like 4.5692ms 4.3796ms 228.3301 Ops/s 227.6368 Ops/s $\color{#35bf28}+0.30\%$
test_clone 6.9725ms 6.5722ms 152.1561 Ops/s 151.5468 Ops/s $\color{#35bf28}+0.40\%$
test_squeeze 69.3210μs 14.7268μs 67.9032 KOps/s 65.2410 KOps/s $\color{#35bf28}+4.08\%$
test_unsqueeze 0.1861ms 0.1130ms 8.8518 KOps/s 9.0504 KOps/s $\color{#d91a1a}-2.19\%$
test_split 0.3604ms 0.1867ms 5.3564 KOps/s 5.3515 KOps/s $\color{#35bf28}+0.09\%$
test_permute 0.2670ms 0.2155ms 4.6396 KOps/s 4.8716 KOps/s $\color{#d91a1a}-4.76\%$
test_stack 52.2318ms 51.5534ms 19.3974 Ops/s 23.0310 Ops/s $\textbf{\color{#d91a1a}-15.78\%}$
test_cat 51.7865ms 51.2292ms 19.5201 Ops/s 23.1075 Ops/s $\textbf{\color{#d91a1a}-15.52\%}$

@vmoens
vmoens merged commit 81c355f into gh/vmoens/79/base Feb 19, 2026
85 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CI CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. documentation Improvements or additions to documentation

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@vmoens