Skip to content

[Feature] Harden TypedTensorDict schemas - #1766

Draft
vmoens wants to merge 1 commit into
mainfrom
harden-typed-tensordict
Draft

[Feature] Harden TypedTensorDict schemas#1766
vmoens wants to merge 1 commit into
mainfrom
harden-typed-tensordict

Conversation

@vmoens

@vmoens vmoens commented Aug 20, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • make TypedTensorDict constructor metadata and declared fields statically enforceable on Python 3.10+
  • support portable optional fields through class defaults while preserving NotRequired compatibility
  • generate direct field properties, document mutation limitations, and add eager/compiled benchmarks
  • add mypy contract coverage and install mypy in test environments

What this enables

import torch
from torch import Tensor
from typing_extensions import assert_type

from tensordict import TypedTensorDict


class PolicyBatch(TypedTensorDict):
    observation: Tensor
    action: Tensor
    log_prob: Tensor | None = None


def score(batch: PolicyBatch) -> Tensor:
    # Type checkers know the declared fields and their types downstream.
    assert_type(batch.observation, Tensor)
    assert_type(batch.log_prob, Tensor | None)
    return batch.observation.square().sum(-1) + batch.action


batch = PolicyBatch(
    observation=torch.randn(32, 4),
    action=torch.randn(32),
    batch_size=[32],
)

# TypedTensorDict remains a regular TensorDict and is full-graph compilable.
scores = torch.compile(score, fullgraph=True)(batch)

# Rejected by mypy/pyright before execution:
PolicyBatch(observation=torch.randn(32, 4), batch_size=[32])
# error: missing named argument "action"

PolicyBatch(observation="not a tensor", action=torch.randn(32))
# error: argument "observation" has incompatible type "str"; expected "Tensor"

batch.reward
# error: "PolicyBatch" has no attribute "reward"

Test plan

  • pytest test/tensorclass/test_typedtensordict.py test/tensorclass/test_compatibility.py -q (156 passed, 15 skipped)
  • pytest test/compile/test_compile.py -q -k TestTTD (57 passed, 4 skipped, 1 expected failure)
  • mypy and pyright valid/invalid schema probes using Python 3.10 semantics
  • Black, flake8, torchfix, RST title, TOML, YAML, shell syntax, and diff checks
  • eager and full-graph TypedTensorDict benchmark runs

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 20, 2026
@github-actions github-actions Bot added documentation Improvements or additions to documentation CI Benchmarks Test Compile torch.compile related Feature New feature labels Aug 20, 2026
@github-actions

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 356. Improved: $\large\color{#35bf28}24$. Worsened: $\large\color{#d91a1a}13$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_collector_preallocated_write[stack_out-cpu-32-2] 0.1903ms 0.1614ms 6.1962 KOps/s 5.9782 KOps/s $\color{#35bf28}+3.65\%$
test_collector_preallocated_write[stack_out-cpu-32-8] 0.4048ms 0.2851ms 3.5078 KOps/s 3.4460 KOps/s $\color{#35bf28}+1.79\%$
test_collector_preallocated_write[stack_out-cpu-32-32] 0.8536ms 0.7570ms 1.3211 KOps/s 1.3242 KOps/s $\color{#d91a1a}-0.24\%$
test_collector_preallocated_write[stack_out-cpu-4096-2] 0.3993ms 0.3363ms 2.9738 KOps/s 3.0054 KOps/s $\color{#d91a1a}-1.05\%$
test_collector_preallocated_write[stack_out-cpu-4096-8] 1.2482ms 1.0799ms 926.0359 Ops/s 876.7904 Ops/s $\textbf{\color{#35bf28}+5.62\%}$
test_collector_preallocated_write[stack_out-cpu-4096-32] 8.1072ms 7.3191ms 136.6290 Ops/s 137.0081 Ops/s $\color{#d91a1a}-0.28\%$
test_collector_preallocated_write[stack_out-cuda-32-2] 0.3103ms 0.2525ms 3.9606 KOps/s 3.9240 KOps/s $\color{#35bf28}+0.93\%$
test_collector_preallocated_write[stack_out-cuda-32-8] 0.5174ms 0.3700ms 2.7029 KOps/s 2.6818 KOps/s $\color{#35bf28}+0.79\%$
test_collector_preallocated_write[stack_out-cuda-32-32] 0.9361ms 0.7977ms 1.2537 KOps/s 1.2417 KOps/s $\color{#35bf28}+0.96\%$
test_collector_preallocated_write[stack_out-cuda-4096-2] 0.3661ms 0.2551ms 3.9198 KOps/s 3.9923 KOps/s $\color{#d91a1a}-1.82\%$
test_collector_preallocated_write[stack_out-cuda-4096-8] 0.5039ms 0.3745ms 2.6704 KOps/s 2.7327 KOps/s $\color{#d91a1a}-2.28\%$
test_collector_preallocated_write[stack_out-cuda-4096-32] 0.9701ms 0.8613ms 1.1610 KOps/s 1.1563 KOps/s $\color{#35bf28}+0.41\%$
test_collector_preallocated_write[set_at_loop-cpu-32-2] 0.2936ms 0.2060ms 4.8554 KOps/s 4.6614 KOps/s $\color{#35bf28}+4.16\%$
test_collector_preallocated_write[set_at_loop-cpu-32-8] 0.9004ms 0.7804ms 1.2813 KOps/s 1.2340 KOps/s $\color{#35bf28}+3.83\%$
test_collector_preallocated_write[set_at_loop-cpu-32-32] 3.2116ms 3.0955ms 323.0525 Ops/s 314.2780 Ops/s $\color{#35bf28}+2.79\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-2] 0.4231ms 0.3642ms 2.7459 KOps/s 2.7484 KOps/s $\color{#d91a1a}-0.09\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-8] 1.8198ms 1.6271ms 614.5845 Ops/s 611.0799 Ops/s $\color{#35bf28}+0.57\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-32] 10.2694ms 10.0575ms 99.4287 Ops/s 98.8306 Ops/s $\color{#35bf28}+0.61\%$
test_collector_preallocated_write[set_at_loop-cuda-32-2] 0.4112ms 0.3819ms 2.6185 KOps/s 2.6095 KOps/s $\color{#35bf28}+0.34\%$
test_collector_preallocated_write[set_at_loop-cuda-32-8] 1.6064ms 1.5055ms 664.2423 Ops/s 655.5506 Ops/s $\color{#35bf28}+1.33\%$
test_collector_preallocated_write[set_at_loop-cuda-32-32] 6.0302ms 5.8869ms 169.8687 Ops/s 169.3967 Ops/s $\color{#35bf28}+0.28\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-2] 0.4997ms 0.3987ms 2.5082 KOps/s 2.4477 KOps/s $\color{#35bf28}+2.47\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-8] 1.5489ms 1.4940ms 669.3532 Ops/s 674.6345 Ops/s $\color{#d91a1a}-0.78\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-32] 6.0299ms 5.9249ms 168.7796 Ops/s 166.9264 Ops/s $\color{#35bf28}+1.11\%$
test_collector_preallocated_write[copy_at-cpu-32-2] 0.2605ms 0.1648ms 6.0669 KOps/s 5.9343 KOps/s $\color{#35bf28}+2.23\%$
test_collector_preallocated_write[copy_at-cpu-32-8] 0.6942ms 0.6441ms 1.5527 KOps/s 1.5418 KOps/s $\color{#35bf28}+0.70\%$
test_collector_preallocated_write[copy_at-cpu-32-32] 2.6973ms 2.5827ms 387.1886 Ops/s 389.1908 Ops/s $\color{#d91a1a}-0.51\%$
test_collector_preallocated_write[copy_at-cpu-4096-2] 0.4147ms 0.3194ms 3.1314 KOps/s 3.1692 KOps/s $\color{#d91a1a}-1.19\%$
test_collector_preallocated_write[copy_at-cpu-4096-8] 1.5606ms 1.4231ms 702.6707 Ops/s 668.1580 Ops/s $\textbf{\color{#35bf28}+5.17\%}$
test_collector_preallocated_write[copy_at-cpu-4096-32] 9.6359ms 9.4362ms 105.9749 Ops/s 106.4626 Ops/s $\color{#d91a1a}-0.46\%$
test_collector_preallocated_write[copy_at-cuda-32-2] 0.3766ms 0.3202ms 3.1231 KOps/s 3.1502 KOps/s $\color{#d91a1a}-0.86\%$
test_collector_preallocated_write[copy_at-cuda-32-8] 1.2641ms 1.1894ms 840.7706 Ops/s 844.7281 Ops/s $\color{#d91a1a}-0.47\%$
test_collector_preallocated_write[copy_at-cuda-32-32] 4.8517ms 4.6814ms 213.6112 Ops/s 214.9449 Ops/s $\color{#d91a1a}-0.62\%$
test_collector_preallocated_write[copy_at-cuda-4096-2] 0.3720ms 0.3209ms 3.1162 KOps/s 3.1304 KOps/s $\color{#d91a1a}-0.45\%$
test_collector_preallocated_write[copy_at-cuda-4096-8] 1.3403ms 1.1976ms 835.0238 Ops/s 842.8165 Ops/s $\color{#d91a1a}-0.92\%$
test_collector_preallocated_write[copy_at-cuda-4096-32] 4.7934ms 4.7078ms 212.4129 Ops/s 214.6103 Ops/s $\color{#d91a1a}-1.02\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-2] 0.1545ms 0.1132ms 8.8360 KOps/s 8.7444 KOps/s $\color{#35bf28}+1.05\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-8] 0.5637ms 0.4442ms 2.2514 KOps/s 2.2223 KOps/s $\color{#35bf28}+1.31\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-32] 1.8833ms 1.7798ms 561.8567 Ops/s 559.6768 Ops/s $\color{#35bf28}+0.39\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-2] 0.3189ms 0.2415ms 4.1402 KOps/s 3.9404 KOps/s $\textbf{\color{#35bf28}+5.07\%}$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-8] 1.3871ms 1.1807ms 846.9787 Ops/s 821.8391 Ops/s $\color{#35bf28}+3.06\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-32] 8.5093ms 8.3877ms 119.2229 Ops/s 117.8134 Ops/s $\color{#35bf28}+1.20\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-2] 0.3604ms 0.2715ms 3.6838 KOps/s 3.6376 KOps/s $\color{#35bf28}+1.27\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-8] 1.0662ms 1.0048ms 995.1807 Ops/s 983.3918 Ops/s $\color{#35bf28}+1.20\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-32] 4.0835ms 3.9313ms 254.3686 Ops/s 254.3194 Ops/s $\color{#35bf28}+0.02\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-2] 0.3433ms 0.2703ms 3.6995 KOps/s 3.6947 KOps/s $\color{#35bf28}+0.13\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-8] 1.1206ms 1.0105ms 989.6327 Ops/s 990.0382 Ops/s $\color{#d91a1a}-0.04\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-32] 4.0725ms 3.9273ms 254.6248 Ops/s 253.3869 Ops/s $\color{#35bf28}+0.49\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-128] 16.1499ms 15.7733ms 63.3984 Ops/s 63.2881 Ops/s $\color{#35bf28}+0.17\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-256] 32.0448ms 31.8693ms 31.3781 Ops/s 31.3382 Ops/s $\color{#35bf28}+0.13\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-128] 84.2062ms 83.6175ms 11.9592 Ops/s 12.0291 Ops/s $\color{#d91a1a}-0.58\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-256] 0.1996s 0.1981s 5.0484 Ops/s 5.1511 Ops/s $\color{#d91a1a}-1.99\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-128] 13.2954ms 13.0844ms 76.4267 Ops/s 76.1224 Ops/s $\color{#35bf28}+0.40\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-256] 26.1962ms 25.7266ms 38.8703 Ops/s 39.2124 Ops/s $\color{#d91a1a}-0.87\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-128] 13.4420ms 13.2109ms 75.6950 Ops/s 74.9933 Ops/s $\color{#35bf28}+0.94\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-256] 26.3105ms 26.1317ms 38.2677 Ops/s 38.2686 Ops/s $-0.00\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-128] 49.7128ms 49.3183ms 20.2764 Ops/s 19.8771 Ops/s $\color{#35bf28}+2.01\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-256] 0.1010s 0.1004s 9.9575 Ops/s 9.9255 Ops/s $\color{#35bf28}+0.32\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-128] 0.1447s 0.1430s 6.9916 Ops/s 6.8274 Ops/s $\color{#35bf28}+2.41\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-256] 0.3160s 0.3139s 3.1861 Ops/s 3.1456 Ops/s $\color{#35bf28}+1.29\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-128] 77.8402ms 76.5986ms 13.0551 Ops/s 13.3272 Ops/s $\color{#d91a1a}-2.04\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-256] 0.1535s 0.1527s 6.5479 Ops/s 6.6593 Ops/s $\color{#d91a1a}-1.67\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-128] 78.3547ms 77.6345ms 12.8809 Ops/s 13.2089 Ops/s $\color{#d91a1a}-2.48\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-256] 0.1542s 0.1522s 6.5683 Ops/s 6.5556 Ops/s $\color{#35bf28}+0.19\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-128] 29.7248ms 29.5334ms 33.8599 Ops/s 34.0097 Ops/s $\color{#d91a1a}-0.44\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-256] 60.1169ms 59.8634ms 16.7047 Ops/s 16.7857 Ops/s $\color{#d91a1a}-0.48\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-128] 0.1211s 0.1202s 8.3181 Ops/s 8.4202 Ops/s $\color{#d91a1a}-1.21\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-256] 0.2663s 0.2657s 3.7631 Ops/s 3.7488 Ops/s $\color{#35bf28}+0.38\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-128] 42.9451ms 42.7714ms 23.3801 Ops/s 23.5906 Ops/s $\color{#d91a1a}-0.89\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-256] 85.9442ms 85.5461ms 11.6896 Ops/s 11.8253 Ops/s $\color{#d91a1a}-1.15\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-128] 43.2176ms 43.0447ms 23.2317 Ops/s 23.4482 Ops/s $\color{#d91a1a}-0.92\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-256] 86.1437ms 85.9842ms 11.6300 Ops/s 11.6983 Ops/s $\color{#d91a1a}-0.58\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-128] 19.8929ms 19.6328ms 50.9351 Ops/s 51.1967 Ops/s $\color{#d91a1a}-0.51\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-256] 40.0820ms 39.8315ms 25.1058 Ops/s 25.1830 Ops/s $\color{#d91a1a}-0.31\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-128] 0.1088s 0.1075s 9.2982 Ops/s 9.2636 Ops/s $\color{#35bf28}+0.37\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-256] 0.2432s 0.2422s 4.1281 Ops/s 4.2323 Ops/s $\color{#d91a1a}-2.46\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-128] 36.4679ms 36.0156ms 27.7658 Ops/s 27.7269 Ops/s $\color{#35bf28}+0.14\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-256] 72.4678ms 72.0466ms 13.8799 Ops/s 13.9248 Ops/s $\color{#d91a1a}-0.32\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-128] 36.3204ms 35.9693ms 27.8015 Ops/s 27.8017 Ops/s $-0.00\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-256] 72.5186ms 72.0505ms 13.8792 Ops/s 13.9326 Ops/s $\color{#d91a1a}-0.38\%$
test_plain_set_nested 45.1230μs 14.6187μs 68.4054 KOps/s 68.4073 KOps/s $-0.00\%$
test_plain_set_stack_nested 57.0340μs 14.4696μs 69.1105 KOps/s 68.8053 KOps/s $\color{#35bf28}+0.44\%$
test_plain_set_nested_inplace 51.6240μs 16.2239μs 61.6376 KOps/s 61.7781 KOps/s $\color{#d91a1a}-0.23\%$
test_plain_set_stack_nested_inplace 68.4450μs 15.8402μs 63.1304 KOps/s 62.7964 KOps/s $\color{#35bf28}+0.53\%$
test_items 36.0230μs 5.6127μs 178.1689 KOps/s 179.5185 KOps/s $\color{#d91a1a}-0.75\%$
test_items_nested 0.5174ms 0.4498ms 2.2232 KOps/s 2.2420 KOps/s $\color{#d91a1a}-0.84\%$
test_items_nested_locked 0.5426ms 0.4462ms 2.2412 KOps/s 2.2369 KOps/s $\color{#35bf28}+0.19\%$
test_items_nested_leaf 0.1317ms 92.8629μs 10.7686 KOps/s 10.7865 KOps/s $\color{#d91a1a}-0.17\%$
test_items_stack_nested 0.5339ms 0.4460ms 2.2422 KOps/s 2.2621 KOps/s $\color{#d91a1a}-0.88\%$
test_items_stack_nested_leaf 0.1246ms 91.6658μs 10.9092 KOps/s 10.7949 KOps/s $\color{#35bf28}+1.06\%$
test_items_stack_nested_locked 0.5704ms 0.4428ms 2.2585 KOps/s 2.2420 KOps/s $\color{#35bf28}+0.74\%$
test_keys 31.6620μs 4.0645μs 246.0308 KOps/s 246.3241 KOps/s $\color{#d91a1a}-0.12\%$
test_keys_nested 0.1824ms 0.1296ms 7.7172 KOps/s 7.7172 KOps/s $+0.00\%$
test_keys_nested_locked 2.2882ms 0.1383ms 7.2308 KOps/s 7.2634 KOps/s $\color{#d91a1a}-0.45\%$
test_keys_nested_leaf 0.1591ms 0.1190ms 8.4004 KOps/s 8.3509 KOps/s $\color{#35bf28}+0.59\%$
test_keys_stack_nested 0.1785ms 0.1277ms 7.8278 KOps/s 7.7718 KOps/s $\color{#35bf28}+0.72\%$
test_keys_stack_nested_leaf 0.1815ms 0.1182ms 8.4604 KOps/s 8.4357 KOps/s $\color{#35bf28}+0.29\%$
test_keys_stack_nested_locked 0.1904ms 0.1356ms 7.3720 KOps/s 7.3518 KOps/s $\color{#35bf28}+0.28\%$
test_values 3.8312μs 0.9777μs 1.0228 MOps/s 992.2467 KOps/s $\color{#35bf28}+3.08\%$
test_values_nested 0.1075ms 50.9882μs 19.6124 KOps/s 19.3978 KOps/s $\color{#35bf28}+1.11\%$
test_values_nested_locked 91.6950μs 54.2271μs 18.4410 KOps/s 18.3398 KOps/s $\color{#35bf28}+0.55\%$
test_values_nested_leaf 88.6450μs 59.2522μs 16.8770 KOps/s 16.8796 KOps/s $\color{#d91a1a}-0.02\%$
test_values_stack_nested 87.3260μs 51.4789μs 19.4254 KOps/s 19.4478 KOps/s $\color{#d91a1a}-0.11\%$
test_values_stack_nested_leaf 0.1075ms 58.7965μs 17.0078 KOps/s 16.8770 KOps/s $\color{#35bf28}+0.78\%$
test_values_stack_nested_locked 0.1029ms 54.1519μs 18.4666 KOps/s 18.4209 KOps/s $\color{#35bf28}+0.25\%$
test_membership 5.3520μs 0.7947μs 1.2584 MOps/s 1.3169 MOps/s $\color{#d91a1a}-4.44\%$
test_membership_nested 31.0620μs 2.8769μs 347.5931 KOps/s 355.3119 KOps/s $\color{#d91a1a}-2.17\%$
test_membership_nested_leaf 37.5630μs 2.8489μs 351.0121 KOps/s 354.6224 KOps/s $\color{#d91a1a}-1.02\%$
test_membership_stacked_nested 35.8620μs 2.7483μs 363.8676 KOps/s 365.4395 KOps/s $\color{#d91a1a}-0.43\%$
test_membership_stacked_nested_leaf 37.7620μs 2.7485μs 363.8346 KOps/s 367.6072 KOps/s $\color{#d91a1a}-1.03\%$
test_membership_nested_last 26.4120μs 4.1745μs 239.5509 KOps/s 237.2303 KOps/s $\color{#35bf28}+0.98\%$
test_membership_nested_leaf_last 36.1520μs 4.1693μs 239.8503 KOps/s 240.1110 KOps/s $\color{#d91a1a}-0.11\%$
test_membership_stacked_nested_last 60.9430μs 4.0897μs 244.5156 KOps/s 247.2153 KOps/s $\color{#d91a1a}-1.09\%$
test_membership_stacked_nested_leaf_last 46.9530μs 4.0736μs 245.4823 KOps/s 245.6189 KOps/s $\color{#d91a1a}-0.06\%$
test_nested_getleaf 54.4530μs 20.0503μs 49.8744 KOps/s 48.8624 KOps/s $\color{#35bf28}+2.07\%$
test_nested_get 55.5830μs 19.2207μs 52.0273 KOps/s 51.5821 KOps/s $\color{#35bf28}+0.86\%$
test_stacked_getleaf 58.3830μs 19.7926μs 50.5238 KOps/s 49.3148 KOps/s $\color{#35bf28}+2.45\%$
test_stacked_get 56.1830μs 19.0676μs 52.4449 KOps/s 51.3082 KOps/s $\color{#35bf28}+2.22\%$
test_nested_getitemleaf 51.5140μs 20.7337μs 48.2308 KOps/s 47.2212 KOps/s $\color{#35bf28}+2.14\%$
test_nested_getitem 47.2630μs 19.3560μs 51.6635 KOps/s 50.7475 KOps/s $\color{#35bf28}+1.81\%$
test_stacked_getitemleaf 61.9040μs 20.1571μs 49.6103 KOps/s 47.5055 KOps/s $\color{#35bf28}+4.43\%$
test_stacked_getitem 58.2630μs 19.4523μs 51.4077 KOps/s 50.1501 KOps/s $\color{#35bf28}+2.51\%$
test_lock_nested 3.0464ms 0.4862ms 2.0569 KOps/s 2.0380 KOps/s $\color{#35bf28}+0.93\%$
test_lock_stack_nested 0.6704ms 0.4896ms 2.0425 KOps/s 2.0459 KOps/s $\color{#d91a1a}-0.17\%$
test_unlock_nested 0.4596ms 0.3858ms 2.5922 KOps/s 2.5826 KOps/s $\color{#35bf28}+0.37\%$
test_unlock_stack_nested 0.5709ms 0.3902ms 2.5625 KOps/s 2.5836 KOps/s $\color{#d91a1a}-0.81\%$
test_flatten_speed 0.2917ms 0.1162ms 8.6079 KOps/s 8.3153 KOps/s $\color{#35bf28}+3.52\%$
test_unflatten_speed 0.6616ms 0.5250ms 1.9049 KOps/s 1.8591 KOps/s $\color{#35bf28}+2.46\%$
test_common_ops 0.8499ms 0.6828ms 1.4647 KOps/s 1.4558 KOps/s $\color{#35bf28}+0.60\%$
test_creation 0.1368ms 2.9709μs 336.5998 KOps/s 331.0048 KOps/s $\color{#35bf28}+1.69\%$
test_creation_empty 33.6320μs 6.6210μs 151.0356 KOps/s 150.9756 KOps/s $\color{#35bf28}+0.04\%$
test_creation_nested_1 39.8230μs 10.7966μs 92.6220 KOps/s 91.9878 KOps/s $\color{#35bf28}+0.69\%$
test_creation_nested_2 80.4250μs 12.3208μs 81.1632 KOps/s 77.6096 KOps/s $\color{#35bf28}+4.58\%$
test_creation_many_keys[10] 46.1930μs 19.4888μs 51.3116 KOps/s 50.3592 KOps/s $\color{#35bf28}+1.89\%$
test_creation_many_keys[50] 0.1618ms 82.6570μs 12.0982 KOps/s 11.5976 KOps/s $\color{#35bf28}+4.32\%$
test_creation_many_keys[100] 0.2122ms 0.1636ms 6.1118 KOps/s 5.9739 KOps/s $\color{#35bf28}+2.31\%$
test_creation_nested_many_keys[10] 87.2050μs 42.0934μs 23.7567 KOps/s 23.2194 KOps/s $\color{#35bf28}+2.31\%$
test_creation_nested_many_keys[50] 0.2109ms 0.1702ms 5.8769 KOps/s 5.7465 KOps/s $\color{#35bf28}+2.27\%$
test_clone 43.2820μs 12.1866μs 82.0570 KOps/s 80.7013 KOps/s $\color{#35bf28}+1.68\%$
test_getitem[int] 1.6686ms 14.8322μs 67.4208 KOps/s 66.4823 KOps/s $\color{#35bf28}+1.41\%$
test_getitem[slice_int] 0.1505ms 23.3117μs 42.8969 KOps/s 42.2639 KOps/s $\color{#35bf28}+1.50\%$
test_getitem[range] 0.1884ms 60.8047μs 16.4461 KOps/s 16.3979 KOps/s $\color{#35bf28}+0.29\%$
test_getitem[tuple] 0.1484ms 23.3929μs 42.7480 KOps/s 42.5810 KOps/s $\color{#35bf28}+0.39\%$
test_getitem[list] 0.1964ms 56.2569μs 17.7756 KOps/s 17.9626 KOps/s $\color{#d91a1a}-1.04\%$
test_setitem_dim[int] 49.7330μs 24.6669μs 40.5402 KOps/s 39.5208 KOps/s $\color{#35bf28}+2.58\%$
test_setitem_dim[slice_int] 73.1240μs 40.7605μs 24.5335 KOps/s 23.7865 KOps/s $\color{#35bf28}+3.14\%$
test_setitem_dim[range] 0.1401ms 89.0084μs 11.2349 KOps/s 11.0629 KOps/s $\color{#35bf28}+1.56\%$
test_setitem_dim[tuple] 63.5440μs 37.3519μs 26.7724 KOps/s 26.2944 KOps/s $\color{#35bf28}+1.82\%$
test_setitem 54.8930μs 16.4584μs 60.7591 KOps/s 59.7803 KOps/s $\color{#35bf28}+1.64\%$
test_set 47.2530μs 15.9360μs 62.7511 KOps/s 61.7543 KOps/s $\color{#35bf28}+1.61\%$
test_set_shared 0.5593ms 0.2098ms 4.7660 KOps/s 4.7740 KOps/s $\color{#d91a1a}-0.17\%$
test_update 0.4394ms 20.3664μs 49.1006 KOps/s 48.5406 KOps/s $\color{#35bf28}+1.15\%$
test_update_nested 65.4840μs 30.9567μs 32.3032 KOps/s 31.4119 KOps/s $\color{#35bf28}+2.84\%$
test_update__nested 0.5196ms 31.2222μs 32.0285 KOps/s 31.8225 KOps/s $\color{#35bf28}+0.65\%$
test_set_nested 57.2440μs 17.1958μs 58.1537 KOps/s 56.6745 KOps/s $\color{#35bf28}+2.61\%$
test_set_nested_new 58.2030μs 21.9661μs 45.5246 KOps/s 45.5620 KOps/s $\color{#d91a1a}-0.08\%$
test_select 84.6860μs 37.5118μs 26.6583 KOps/s 27.1627 KOps/s $\color{#d91a1a}-1.86\%$
test_select_nested 98.2860μs 69.0492μs 14.4824 KOps/s 14.1932 KOps/s $\color{#35bf28}+2.04\%$
test_exclude_nested 0.1277ms 86.0681μs 11.6187 KOps/s 11.4779 KOps/s $\color{#35bf28}+1.23\%$
test_empty[True] 0.4826ms 0.3888ms 2.5717 KOps/s 2.5992 KOps/s $\color{#d91a1a}-1.06\%$
test_empty[False] 10.1408μs 1.3002μs 769.1232 KOps/s 759.8062 KOps/s $\color{#35bf28}+1.23\%$
test_to 0.1123ms 70.8218μs 14.1199 KOps/s 14.1494 KOps/s $\color{#d91a1a}-0.21\%$
test_to_nonblocking 0.1113ms 68.4436μs 14.6106 KOps/s 13.7637 KOps/s $\textbf{\color{#35bf28}+6.15\%}$
test_unbind_speed 0.3811ms 0.3266ms 3.0615 KOps/s 3.0466 KOps/s $\color{#35bf28}+0.49\%$
test_unbind_speed_stack0 0.3735ms 0.3160ms 3.1643 KOps/s 3.0791 KOps/s $\color{#35bf28}+2.77\%$
test_unbind_speed_stack1 0.1257s 0.8343ms 1.1986 KOps/s 1.1760 KOps/s $\color{#35bf28}+1.93\%$
test_split 0.1254s 1.3897ms 719.5869 Ops/s 818.2026 Ops/s $\textbf{\color{#d91a1a}-12.05\%}$
test_chunk 1.2759ms 1.1849ms 843.9193 Ops/s 847.5438 Ops/s $\color{#d91a1a}-0.43\%$
test_to_cpu_blocking 20.2092ms 20.0836ms 49.7918 Ops/s 43.8754 Ops/s $\textbf{\color{#35bf28}+13.48\%}$
test_to_cpu_global_sync 0.1373s 13.0282ms 76.7565 Ops/s 84.5805 Ops/s $\textbf{\color{#d91a1a}-9.25\%}$
test_to_cpu_event_sync 13.0749ms 12.6507ms 79.0469 Ops/s 78.0486 Ops/s $\color{#35bf28}+1.28\%$
test_to_cpu_default 13.0849ms 12.6529ms 79.0330 Ops/s 77.8985 Ops/s $\color{#35bf28}+1.46\%$
test_consolidate[False-None] 4.3483ms 3.9648ms 252.2220 Ops/s 246.4023 Ops/s $\color{#35bf28}+2.36\%$
test_consolidate[default-None] 3.1841ms 2.1559ms 463.8364 Ops/s 455.8794 Ops/s $\color{#35bf28}+1.75\%$
test_consolidate[reduce-overhead-None] 3.0461ms 2.0663ms 483.9549 Ops/s 465.9297 Ops/s $\color{#35bf28}+3.87\%$
test_consolidate_njt[False-None] 5.9454ms 4.8933ms 204.3611 Ops/s 195.5835 Ops/s $\color{#35bf28}+4.49\%$
test_to[False-False-None] 2.2527ms 2.1726ms 460.2799 Ops/s 455.6443 Ops/s $\color{#35bf28}+1.02\%$
test_to[True-False-None] 2.2371ms 1.8953ms 527.6324 Ops/s 531.0613 Ops/s $\color{#d91a1a}-0.65\%$
test_to[within-False-None] 6.0870ms 5.9939ms 166.8373 Ops/s 165.4357 Ops/s $\color{#35bf28}+0.85\%$
test_to[True-default-None] 10.3205ms 10.1475ms 98.5466 Ops/s 96.4859 Ops/s $\color{#35bf28}+2.14\%$
test_to_njt[False-False-None] 7.2682ms 7.0824ms 141.1961 Ops/s 142.9600 Ops/s $\color{#d91a1a}-1.23\%$
test_to_njt[True-False-None] 4.0714ms 3.8105ms 262.4330 Ops/s 259.9291 Ops/s $\color{#35bf28}+0.96\%$
test_to_njt[within-False-None] 8.9778ms 8.8074ms 113.5410 Ops/s 112.2008 Ops/s $\color{#35bf28}+1.19\%$
test_creation[device0] 0.4153ms 0.1172ms 8.5325 KOps/s 8.2691 KOps/s $\color{#35bf28}+3.19\%$
test_creation_from_tensor 0.4613ms 0.1191ms 8.3960 KOps/s 8.2644 KOps/s $\color{#35bf28}+1.59\%$
test_add_one[memmap_tensor0] 0.3480ms 6.2783μs 159.2783 KOps/s 161.1670 KOps/s $\color{#d91a1a}-1.17\%$
test_contiguous[memmap_tensor0] 14.8910μs 0.6311μs 1.5846 MOps/s 1.5366 MOps/s $\color{#35bf28}+3.13\%$
test_stack[memmap_tensor0] 78.6350μs 4.0330μs 247.9527 KOps/s 241.7010 KOps/s $\color{#35bf28}+2.59\%$
test_memmaptd_index 1.3400ms 0.2654ms 3.7674 KOps/s 3.6615 KOps/s $\color{#35bf28}+2.89\%$
test_memmaptd_index_astensor 0.5955ms 0.3641ms 2.7466 KOps/s 2.6920 KOps/s $\color{#35bf28}+2.03\%$
test_memmaptd_index_op 0.9819ms 0.5991ms 1.6693 KOps/s 1.6114 KOps/s $\color{#35bf28}+3.59\%$
test_serialize_model 0.1418s 0.1411s 7.0888 Ops/s 7.0801 Ops/s $\color{#35bf28}+0.12\%$
test_serialize_model_archive 1.3520s 1.2438s 0.8040 Ops/s 0.8042 Ops/s $\color{#d91a1a}-0.03\%$
test_load_archive 17.8833ms 17.5247ms 57.0622 Ops/s 56.9228 Ops/s $\color{#35bf28}+0.24\%$
test_serialize_model_zarr 2.6902s 2.5248s 0.3961 Ops/s 0.4043 Ops/s $\color{#d91a1a}-2.03\%$
test_load_zarr 0.4186s 0.3966s 2.5213 Ops/s 2.4001 Ops/s $\textbf{\color{#35bf28}+5.05\%}$
test_serialize_model_pickle 1.3646s 1.2137s 0.8239 Ops/s 0.6968 Ops/s $\textbf{\color{#35bf28}+18.25\%}$
test_serialize_weights 0.1446s 0.1411s 7.0848 Ops/s 7.1001 Ops/s $\color{#d91a1a}-0.22\%$
test_serialize_weights_returnearly 68.5834ms 52.8434ms 18.9238 Ops/s 19.1782 Ops/s $\color{#d91a1a}-1.33\%$
test_serialize_weights_pickle 1.3599s 1.2128s 0.8245 Ops/s 0.8247 Ops/s $\color{#d91a1a}-0.02\%$
test_consolidate[few_large-0] 60.5514ms 7.5226ms 132.9323 Ops/s 142.6243 Ops/s $\textbf{\color{#d91a1a}-6.80\%}$
test_consolidate[few_large-8] 74.1987ms 7.9050ms 126.5021 Ops/s 146.0237 Ops/s $\textbf{\color{#d91a1a}-13.37\%}$
test_consolidate[many_small-0] 0.1297s 0.1257s 7.9541 Ops/s 7.9375 Ops/s $\color{#35bf28}+0.21\%$
test_consolidate[many_small-8] 57.8173ms 42.4558ms 23.5539 Ops/s 20.2325 Ops/s $\textbf{\color{#35bf28}+16.42\%}$
test_consolidate_to_file[few_large-0] 0.1321s 23.3921ms 42.7495 Ops/s 42.7983 Ops/s $\color{#d91a1a}-0.11\%$
test_consolidate_to_file[few_large-8] 0.1428s 27.7041ms 36.0958 Ops/s 40.0774 Ops/s $\textbf{\color{#d91a1a}-9.93\%}$
test_consolidate_to_file[many_small-0] 0.4006s 0.3047s 3.2815 Ops/s 5.2942 Ops/s $\textbf{\color{#d91a1a}-38.02\%}$
test_consolidate_to_file[many_small-8] 0.5301s 0.4868s 2.0542 Ops/s 3.7672 Ops/s $\textbf{\color{#d91a1a}-45.47\%}$
test_reshape_pytree 6.3520ms 30.9179μs 32.3437 KOps/s 31.9255 KOps/s $\color{#35bf28}+1.31\%$
test_reshape_td 87.4960μs 43.1449μs 23.1777 KOps/s 23.2341 KOps/s $\color{#d91a1a}-0.24\%$
test_view_pytree 0.2384ms 30.1465μs 33.1713 KOps/s 33.0596 KOps/s $\color{#35bf28}+0.34\%$
test_view_td 0.1108ms 51.5073μs 19.4147 KOps/s 19.6980 KOps/s $\color{#d91a1a}-1.44\%$
test_unbind_pytree 0.2238ms 34.7240μs 28.7986 KOps/s 28.5668 KOps/s $\color{#35bf28}+0.81\%$
test_unbind_td 0.1964ms 48.0243μs 20.8228 KOps/s 20.1668 KOps/s $\color{#35bf28}+3.25\%$
test_split_pytree 0.1925ms 39.5351μs 25.2940 KOps/s 24.3910 KOps/s $\color{#35bf28}+3.70\%$
test_split_td 0.1438ms 68.7781μs 14.5395 KOps/s 14.6070 KOps/s $\color{#d91a1a}-0.46\%$
test_add_pytree 0.2282ms 38.4127μs 26.0331 KOps/s 24.7766 KOps/s $\textbf{\color{#35bf28}+5.07\%}$
test_add_td 0.1112ms 51.8957μs 19.2694 KOps/s 19.1034 KOps/s $\color{#35bf28}+0.87\%$
test_compile_add_one_nested[tensordict-compile] 0.5870ms 0.2754ms 3.6317 KOps/s 3.5252 KOps/s $\color{#35bf28}+3.02\%$
test_compile_add_one_nested[tensordict-eager] 0.4538ms 0.1967ms 5.0841 KOps/s 5.1642 KOps/s $\color{#d91a1a}-1.55\%$
test_compile_add_one_nested[pytree-compile] 0.3390ms 0.1507ms 6.6340 KOps/s 5.3054 KOps/s $\textbf{\color{#35bf28}+25.04\%}$
test_compile_add_one_nested[pytree-eager] 0.5228ms 0.1726ms 5.7954 KOps/s 5.8543 KOps/s $\color{#d91a1a}-1.01\%$
test_compile_copy_nested[tensordict-compile] 75.6940μs 20.5551μs 48.6497 KOps/s 50.0119 KOps/s $\color{#d91a1a}-2.72\%$
test_compile_copy_nested[tensordict-eager] 0.2840ms 50.0671μs 19.9732 KOps/s 19.5912 KOps/s $\color{#35bf28}+1.95\%$
test_compile_copy_nested[pytree-compile] 0.1714ms 18.1726μs 55.0278 KOps/s 54.7590 KOps/s $\color{#35bf28}+0.49\%$
test_compile_copy_nested[pytree-eager] 0.3957ms 62.1413μs 16.0924 KOps/s 15.8813 KOps/s $\color{#35bf28}+1.33\%$
test_compile_add_one_flat[tensordict-compile] 0.4482ms 0.3018ms 3.3130 KOps/s 3.2051 KOps/s $\color{#35bf28}+3.37\%$
test_compile_add_one_flat[tensordict-eager] 0.3752ms 0.2852ms 3.5064 KOps/s 3.5245 KOps/s $\color{#d91a1a}-0.51\%$
test_compile_add_one_flat[tensorclass-compile] 0.3422ms 0.2054ms 4.8676 KOps/s 4.6832 KOps/s $\color{#35bf28}+3.94\%$
test_compile_add_one_flat[tensorclass-eager] 0.1193ms 75.4993μs 13.2452 KOps/s 13.4088 KOps/s $\color{#d91a1a}-1.22\%$
test_compile_add_one_flat[pytree-compile] 0.4153ms 0.2366ms 4.2273 KOps/s 4.1896 KOps/s $\color{#35bf28}+0.90\%$
test_compile_add_one_flat[pytree-eager] 0.8383ms 0.5281ms 1.8937 KOps/s 1.9277 KOps/s $\color{#d91a1a}-1.76\%$
test_compile_add_self_flat[tensordict-eager] 0.5121ms 0.3309ms 3.0223 KOps/s 3.0164 KOps/s $\color{#35bf28}+0.20\%$
test_compile_add_self_flat[tensordict-compile] 0.4080ms 0.3003ms 3.3295 KOps/s 3.2057 KOps/s $\color{#35bf28}+3.86\%$
test_compile_add_self_flat[tensorclass-eager] 0.1846ms 89.9325μs 11.1195 KOps/s 11.0698 KOps/s $\color{#35bf28}+0.45\%$
test_compile_add_self_flat[tensorclass-compile] 0.3652ms 0.2095ms 4.7735 KOps/s 4.6721 KOps/s $\color{#35bf28}+2.17\%$
test_compile_add_self_flat[pytree-eager] 0.7217ms 0.4489ms 2.2276 KOps/s 2.2647 KOps/s $\color{#d91a1a}-1.64\%$
test_compile_add_self_flat[pytree-compile] 0.4174ms 0.2372ms 4.2155 KOps/s 4.1242 KOps/s $\color{#35bf28}+2.21\%$
test_compile_copy_flat[tensordict-compile] 63.4640μs 25.9924μs 38.4728 KOps/s 39.0643 KOps/s $\color{#d91a1a}-1.51\%$
test_compile_copy_flat[tensordict-eager] 73.6640μs 39.2201μs 25.4971 KOps/s 25.2912 KOps/s $\color{#35bf28}+0.81\%$
test_compile_copy_flat[pytree-compile] 0.1944ms 25.0145μs 39.9768 KOps/s 37.1091 KOps/s $\textbf{\color{#35bf28}+7.73\%}$
test_compile_copy_flat[pytree-eager] 0.3486ms 50.3541μs 19.8594 KOps/s 19.6605 KOps/s $\color{#35bf28}+1.01\%$
test_compile_assign_and_add[tensordict-compile] 1.9994ms 0.2476ms 4.0386 KOps/s 3.7558 KOps/s $\textbf{\color{#35bf28}+7.53\%}$
test_compile_assign_and_add[tensordict-eager] 3.5499ms 3.3255ms 300.7071 Ops/s 297.9323 Ops/s $\color{#35bf28}+0.93\%$
test_compile_assign_and_add[pytree-compile] 1.9617ms 0.1897ms 5.2721 KOps/s 5.1010 KOps/s $\color{#35bf28}+3.35\%$
test_compile_assign_and_add[pytree-eager] 3.0036ms 2.7939ms 357.9281 Ops/s 357.3066 Ops/s $\color{#35bf28}+0.17\%$
test_compile_indexing[tensor-tensordict-compile] 0.2779ms 0.1559ms 6.4128 KOps/s 6.4873 KOps/s $\color{#d91a1a}-1.15\%$
test_compile_indexing[tensor-tensordict-eager] 0.4022ms 75.2397μs 13.2909 KOps/s 13.6507 KOps/s $\color{#d91a1a}-2.64\%$
test_compile_indexing[tensor-tensorclass-compile] 0.2780ms 0.1299ms 7.7003 KOps/s 7.6611 KOps/s $\color{#35bf28}+0.51\%$
test_compile_indexing[tensor-tensorclass-eager] 0.2944ms 43.2810μs 23.1048 KOps/s 22.7198 KOps/s $\color{#35bf28}+1.69\%$
test_compile_indexing[tensor-pytree-compile] 0.1862ms 0.1323ms 7.5611 KOps/s 7.4693 KOps/s $\color{#35bf28}+1.23\%$
test_compile_indexing[tensor-pytree-eager] 0.2438ms 44.0816μs 22.6852 KOps/s 21.5525 KOps/s $\textbf{\color{#35bf28}+5.26\%}$
test_compile_indexing[slice-tensordict-compile] 0.1955ms 92.5800μs 10.8015 KOps/s 10.7763 KOps/s $\color{#35bf28}+0.23\%$
test_compile_indexing[slice-tensordict-eager] 0.2318ms 26.7210μs 37.4237 KOps/s 37.4211 KOps/s $+0.01\%$
test_compile_indexing[slice-tensorclass-compile] 0.2443ms 67.5631μs 14.8010 KOps/s 14.5794 KOps/s $\color{#35bf28}+1.52\%$
test_compile_indexing[slice-tensorclass-eager] 0.2538ms 20.7102μs 48.2854 KOps/s 46.5133 KOps/s $\color{#35bf28}+3.81\%$
test_compile_indexing[slice-pytree-compile] 0.1168ms 69.1763μs 14.4558 KOps/s 13.5181 KOps/s $\textbf{\color{#35bf28}+6.94\%}$
test_compile_indexing[slice-pytree-eager] 0.2941ms 21.1306μs 47.3247 KOps/s 47.9468 KOps/s $\color{#d91a1a}-1.30\%$
test_compile_indexing[int-tensordict-compile] 0.1376ms 89.7614μs 11.1406 KOps/s 10.6916 KOps/s $\color{#35bf28}+4.20\%$
test_compile_indexing[int-tensordict-eager] 0.2416ms 27.0555μs 36.9611 KOps/s 37.1159 KOps/s $\color{#d91a1a}-0.42\%$
test_compile_indexing[int-tensorclass-compile] 0.1756ms 68.7454μs 14.5464 KOps/s 14.3172 KOps/s $\color{#35bf28}+1.60\%$
test_compile_indexing[int-tensorclass-eager] 0.2604ms 21.0020μs 47.6145 KOps/s 47.9401 KOps/s $\color{#d91a1a}-0.68\%$
test_compile_indexing[int-pytree-compile] 0.1321ms 70.1207μs 14.2611 KOps/s 14.3012 KOps/s $\color{#d91a1a}-0.28\%$
test_compile_indexing[int-pytree-eager] 0.2803ms 21.1606μs 47.2577 KOps/s 47.7642 KOps/s $\color{#d91a1a}-1.06\%$
test_compile_replace[single-eager] 0.1091ms 45.3372μs 22.0569 KOps/s 21.9368 KOps/s $\color{#35bf28}+0.55\%$
test_compile_replace[single-compile] 0.2578ms 0.1469ms 6.8075 KOps/s 6.7945 KOps/s $\color{#35bf28}+0.19\%$
test_compile_replace[multi-eager] 0.6721ms 0.5716ms 1.7494 KOps/s 1.8385 KOps/s $\color{#d91a1a}-4.85\%$
test_compile_replace[multi-compile] 0.3460ms 0.1556ms 6.4275 KOps/s 6.3213 KOps/s $\color{#35bf28}+1.68\%$
test_compile_tc_getattr_20[eager] 0.2143ms 0.1759ms 5.6845 KOps/s 5.4896 KOps/s $\color{#35bf28}+3.55\%$
test_compile_tc_getattr_20[compile] 0.4422ms 0.1760ms 5.6807 KOps/s 5.6876 KOps/s $\color{#d91a1a}-0.12\%$
test_compile_clone_shallow[20-eager] 52.8730μs 18.3358μs 54.5381 KOps/s 54.1277 KOps/s $\color{#35bf28}+0.76\%$
test_compile_clone_shallow[20-compile] 76.9540μs 21.7246μs 46.0308 KOps/s 43.6775 KOps/s $\textbf{\color{#35bf28}+5.39\%}$
test_compile_clone_shallow[40-eager] 67.0740μs 32.6974μs 30.5835 KOps/s 30.8057 KOps/s $\color{#d91a1a}-0.72\%$
test_compile_clone_shallow[40-compile] 89.2460μs 24.0346μs 41.6066 KOps/s 41.5079 KOps/s $\color{#35bf28}+0.24\%$
test_compile_clone_shallow[80-eager] 91.4760μs 60.2402μs 16.6002 KOps/s 16.5672 KOps/s $\color{#35bf28}+0.20\%$
test_compile_clone_shallow[80-compile] 94.4260μs 26.9072μs 37.1648 KOps/s 35.6924 KOps/s $\color{#35bf28}+4.13\%$
test_compile_update_inplace[eager] 0.2296ms 61.0913μs 16.3690 KOps/s 16.6399 KOps/s $\color{#d91a1a}-1.63\%$
test_compile_update_inplace[compile] 0.3802ms 0.1187ms 8.4224 KOps/s 8.1937 KOps/s $\color{#35bf28}+2.79\%$
test_mod_add[eager] 0.2689ms 0.2183ms 4.5814 KOps/s 4.5444 KOps/s $\color{#35bf28}+0.81\%$
test_mod_add[compile] 0.1670ms 0.1197ms 8.3549 KOps/s 8.2539 KOps/s $\color{#35bf28}+1.22\%$
test_mod_add[compile-overhead] 0.2829ms 0.1936ms 5.1650 KOps/s 5.1211 KOps/s $\color{#35bf28}+0.86\%$
test_mod_wrap[eager] 0.5434ms 0.4688ms 2.1333 KOps/s 2.1436 KOps/s $\color{#d91a1a}-0.48\%$
test_mod_wrap[compile] 0.5119ms 0.3401ms 2.9405 KOps/s 2.8200 KOps/s $\color{#35bf28}+4.27\%$
test_mod_wrap[compile-overhead] 7.2866ms 4.0851ms 244.7938 Ops/s 249.5726 Ops/s $\color{#d91a1a}-1.91\%$
test_mod_wrap_and_backward[eager] 2.2295ms 1.7728ms 564.0655 Ops/s 607.5822 Ops/s $\textbf{\color{#d91a1a}-7.16\%}$
test_mod_wrap_and_backward[compile] 1.6809ms 1.4444ms 692.3154 Ops/s 754.6769 Ops/s $\textbf{\color{#d91a1a}-8.26\%}$
test_mod_wrap_and_backward[compile-overhead] 1.7989ms 1.0615ms 942.1005 Ops/s 1.0427 KOps/s $\textbf{\color{#d91a1a}-9.65\%}$
test_seq_add[eager] 0.6483ms 0.4906ms 2.0381 KOps/s 2.0222 KOps/s $\color{#35bf28}+0.79\%$
test_seq_add[compile] 0.2446ms 0.1309ms 7.6398 KOps/s 6.8840 KOps/s $\textbf{\color{#35bf28}+10.98\%}$
test_seq_add[compile-overhead] 0.2824ms 0.2008ms 4.9801 KOps/s 4.6958 KOps/s $\textbf{\color{#35bf28}+6.05\%}$
test_seq_wrap[eager] 1.4602ms 1.3801ms 724.5997 Ops/s 726.2071 Ops/s $\color{#d91a1a}-0.22\%$
test_seq_wrap[compile] 0.4464ms 0.3549ms 2.8181 KOps/s 2.7333 KOps/s $\color{#35bf28}+3.10\%$
test_seq_wrap[compile-overhead] 0.4816ms 0.3147ms 3.1776 KOps/s 3.1164 KOps/s $\color{#35bf28}+1.96\%$
test_func_call_runtime[False-eager] 0.9715ms 0.8221ms 1.2164 KOps/s 1.2805 KOps/s $\textbf{\color{#d91a1a}-5.01\%}$
test_func_call_runtime[False-compile] 0.8874ms 0.7585ms 1.3185 KOps/s 1.3349 KOps/s $\color{#d91a1a}-1.23\%$
test_func_call_runtime[False-compile-overhead] 0.6735ms 0.4930ms 2.0283 KOps/s 1.9923 KOps/s $\color{#35bf28}+1.81\%$
test_func_call_runtime[True-eager] 1.3998ms 1.2691ms 787.9909 Ops/s 785.7798 Ops/s $\color{#35bf28}+0.28\%$
test_func_call_runtime[True-compile] 0.9413ms 0.7537ms 1.3267 KOps/s 1.3245 KOps/s $\color{#35bf28}+0.17\%$
test_func_call_runtime[True-compile-overhead] 0.7193ms 0.5143ms 1.9444 KOps/s 1.9312 KOps/s $\color{#35bf28}+0.68\%$
test_func_call_cm_runtime[False-eager] 0.8279ms 0.7861ms 1.2722 KOps/s 1.2071 KOps/s $\textbf{\color{#35bf28}+5.39\%}$
test_func_call_cm_runtime[False-compile] 0.7965ms 0.7258ms 1.3777 KOps/s 1.3488 KOps/s $\color{#35bf28}+2.14\%$
test_func_call_cm_runtime[False-compile-overhead] 0.5697ms 0.4789ms 2.0880 KOps/s 2.0880 KOps/s $+0.00\%$
test_func_call_cm_runtime[True-eager] 1.5816ms 1.4257ms 701.3908 Ops/s 709.4182 Ops/s $\color{#d91a1a}-1.13\%$
test_func_call_cm_runtime[True-compile] 0.8918ms 0.8353ms 1.1972 KOps/s 1.1935 KOps/s $\color{#35bf28}+0.32\%$
test_func_call_cm_runtime[True-compile-overhead] 1.1823ms 0.8600ms 1.1627 KOps/s 1.1539 KOps/s $\color{#35bf28}+0.76\%$
test_vmap_func_call_cm_runtime[eager] 3.2192ms 2.6319ms 379.9485 Ops/s 382.3081 Ops/s $\color{#d91a1a}-0.62\%$
test_vmap_func_call_cm_runtime[compile] 4.1894ms 3.6671ms 272.6941 Ops/s 270.6426 Ops/s $\color{#35bf28}+0.76\%$
test_vmap_func_call_cm_runtime[compile-overhead] 4.2002ms 3.6755ms 272.0733 Ops/s 266.9185 Ops/s $\color{#35bf28}+1.93\%$
test_distributed 1.8027ms 0.1596ms 6.2663 KOps/s 6.3985 KOps/s $\color{#d91a1a}-2.07\%$
test_tdmodule 0.3792ms 0.1877ms 5.3266 KOps/s 5.3231 KOps/s $\color{#35bf28}+0.07\%$
test_tdmodule_dispatch 0.3941ms 0.3638ms 2.7490 KOps/s 2.7719 KOps/s $\color{#d91a1a}-0.82\%$
test_tdseq 36.7020μs 25.8375μs 38.7034 KOps/s 38.5833 KOps/s $\color{#35bf28}+0.31\%$
test_tdseq_dispatch 0.2527ms 0.2117ms 4.7238 KOps/s 4.7213 KOps/s $\color{#35bf28}+0.05\%$
test_instantiation_functorch 2.7287ms 2.5954ms 385.3029 Ops/s 387.4890 Ops/s $\color{#d91a1a}-0.56\%$
test_exec_functorch 0.2708ms 0.1876ms 5.3317 KOps/s 5.2041 KOps/s $\color{#35bf28}+2.45\%$
test_exec_functional_call 0.4266ms 0.1506ms 6.6409 KOps/s 6.6572 KOps/s $\color{#d91a1a}-0.25\%$
test_exec_td_decorator 0.6621ms 0.3528ms 2.8344 KOps/s 2.8025 KOps/s $\color{#35bf28}+1.14\%$
test_vmap_mlp_speed_decorator[True-True] 1.4073ms 1.1707ms 854.1577 Ops/s 849.2740 Ops/s $\color{#35bf28}+0.58\%$
test_vmap_mlp_speed_decorator[True-False] 1.4555ms 1.1669ms 856.9642 Ops/s 851.5641 Ops/s $\color{#35bf28}+0.63\%$
test_vmap_mlp_speed_decorator[False-True] 1.1624ms 0.8824ms 1.1333 KOps/s 1.1397 KOps/s $\color{#d91a1a}-0.56\%$
test_vmap_mlp_speed_decorator[False-False] 1.1120ms 0.8814ms 1.1346 KOps/s 1.1369 KOps/s $\color{#d91a1a}-0.20\%$
test_vmap_transformer_speed_decorator[True-True] 26.5175ms 26.2255ms 38.1308 Ops/s 37.6127 Ops/s $\color{#35bf28}+1.38\%$
test_vmap_transformer_speed_decorator[True-False] 26.3314ms 26.1566ms 38.2312 Ops/s 37.4566 Ops/s $\color{#35bf28}+2.07\%$
test_vmap_transformer_speed_decorator[False-True] 26.7121ms 25.8708ms 38.6536 Ops/s 38.2230 Ops/s $\color{#35bf28}+1.13\%$
test_vmap_transformer_speed_decorator[False-False] 26.7443ms 25.8036ms 38.7543 Ops/s 38.0927 Ops/s $\color{#35bf28}+1.74\%$
test_to_module_speed[True] 3.4067ms 3.2790ms 304.9755 Ops/s 304.9277 Ops/s $\color{#35bf28}+0.02\%$
test_to_module_speed[False] 3.3816ms 3.2466ms 308.0149 Ops/s 306.1216 Ops/s $\color{#35bf28}+0.62\%$
test_to_module_plain_tensor_speed[None] 3.3949ms 3.2825ms 304.6490 Ops/s 305.3666 Ops/s $\color{#d91a1a}-0.24\%$
test_to_module_plain_tensor_speed[False] 3.0847ms 1.5117ms 661.4982 Ops/s 661.7403 Ops/s $\color{#d91a1a}-0.04\%$
test_to_module_plain_tensor_speed[True] 3.3880ms 3.2795ms 304.9214 Ops/s 307.2651 Ops/s $\color{#d91a1a}-0.76\%$
test_tc_init 83.6360μs 43.7405μs 22.8621 KOps/s 23.2105 KOps/s $\color{#d91a1a}-1.50\%$
test_tc_init_tensor_only 34.1220μs 9.0339μs 110.6945 KOps/s 111.7579 KOps/s $\color{#d91a1a}-0.95\%$
test_tc_init_nested 0.1693ms 85.2133μs 11.7353 KOps/s 11.8208 KOps/s $\color{#d91a1a}-0.72\%$
test_tc_init_many_fields 47.2530μs 16.5265μs 60.5090 KOps/s 60.1453 KOps/s $\color{#35bf28}+0.60\%$
test_tc_first_layer_tensor 20.5910μs 1.6877μs 592.5347 KOps/s 599.3331 KOps/s $\color{#d91a1a}-1.13\%$
test_tc_first_layer_tensor_only 2.5001μs 0.3892μs 2.5691 MOps/s 2.6188 MOps/s $\color{#d91a1a}-1.90\%$
test_tc_first_layer_tensor_set 76.9150μs 3.7535μs 266.4158 KOps/s 249.4041 KOps/s $\textbf{\color{#35bf28}+6.82\%}$
test_tc_first_layer_tensor_only_set 19.9710μs 3.6502μs 273.9595 KOps/s 285.7983 KOps/s $\color{#d91a1a}-4.14\%$
test_tc_first_layer_nontensor 27.5920μs 5.7848μs 172.8681 KOps/s 170.9769 KOps/s $\color{#35bf28}+1.11\%$
test_tc_second_layer_tensor 30.9720μs 4.1558μs 240.6298 KOps/s 242.8107 KOps/s $\color{#d91a1a}-0.90\%$
test_tc_second_layer_nontensor 33.8720μs 8.1924μs 122.0645 KOps/s 121.6902 KOps/s $\color{#35bf28}+0.31\%$
test_unbind 0.3109s 13.7131ms 72.9228 Ops/s 65.1761 Ops/s $\textbf{\color{#35bf28}+11.89\%}$
test_full_like 4.8423ms 4.6430ms 215.3778 Ops/s 214.9712 Ops/s $\color{#35bf28}+0.19\%$
test_zeros_like 4.7605ms 4.6174ms 216.5733 Ops/s 217.1059 Ops/s $\color{#d91a1a}-0.25\%$
test_ones_like 6.0567ms 4.6386ms 215.5835 Ops/s 216.3712 Ops/s $\color{#d91a1a}-0.36\%$
test_clone 6.9949ms 6.8242ms 146.5367 Ops/s 145.8388 Ops/s $\color{#35bf28}+0.48\%$
test_squeeze 0.1692ms 13.5185μs 73.9726 KOps/s 73.8252 KOps/s $\color{#35bf28}+0.20\%$
test_unsqueeze 0.2244ms 0.1118ms 8.9424 KOps/s 8.8154 KOps/s $\color{#35bf28}+1.44\%$
test_split 0.2697ms 0.1856ms 5.3876 KOps/s 5.4472 KOps/s $\color{#d91a1a}-1.09\%$
test_permute 0.2671ms 0.1889ms 5.2925 KOps/s 5.0891 KOps/s $\color{#35bf28}+4.00\%$
test_stack 55.7094ms 54.5860ms 18.3197 Ops/s 52.1631 Ops/s $\textbf{\color{#d91a1a}-64.88\%}$
test_cat 55.3471ms 55.0257ms 18.1733 Ops/s 52.0080 Ops/s $\textbf{\color{#d91a1a}-65.06\%}$
test_sequential_tensordict 0.9344ms 0.8677ms 1.1525 KOps/s 1.0800 KOps/s $\textbf{\color{#35bf28}+6.71\%}$
test_sequential_graph_module 0.5683ms 0.4280ms 2.3367 KOps/s 2.2189 KOps/s $\textbf{\color{#35bf28}+5.31\%}$
test_nested_tensordict 1.3079ms 1.2217ms 818.5217 Ops/s 770.5456 Ops/s $\textbf{\color{#35bf28}+6.23\%}$
test_nested_graph_module 0.6808ms 0.5568ms 1.7959 KOps/s 1.6726 KOps/s $\textbf{\color{#35bf28}+7.37\%}$

@github-actions

Copy link
Copy Markdown
Contributor

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 356. Improved: $\large\color{#35bf28}33$. Worsened: $\large\color{#d91a1a}15$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_collector_preallocated_write[stack_out-cpu-32-2] 0.2041ms 0.1665ms 6.0044 KOps/s 6.0141 KOps/s $\color{#d91a1a}-0.16\%$
test_collector_preallocated_write[stack_out-cpu-32-8] 0.3653ms 0.2950ms 3.3901 KOps/s 3.3997 KOps/s $\color{#d91a1a}-0.28\%$
test_collector_preallocated_write[stack_out-cpu-32-32] 0.8809ms 0.7814ms 1.2798 KOps/s 1.2626 KOps/s $\color{#35bf28}+1.36\%$
test_collector_preallocated_write[stack_out-cpu-4096-2] 0.3960ms 0.3414ms 2.9292 KOps/s 2.9508 KOps/s $\color{#d91a1a}-0.73\%$
test_collector_preallocated_write[stack_out-cpu-4096-8] 1.3063ms 1.1301ms 884.9037 Ops/s 890.2463 Ops/s $\color{#d91a1a}-0.60\%$
test_collector_preallocated_write[stack_out-cpu-4096-32] 7.7517ms 7.5283ms 132.8327 Ops/s 132.8280 Ops/s $+0.00\%$
test_collector_preallocated_write[stack_out-cuda-32-2] 0.3133ms 0.2615ms 3.8243 KOps/s 3.9386 KOps/s $\color{#d91a1a}-2.90\%$
test_collector_preallocated_write[stack_out-cuda-32-8] 0.4729ms 0.3776ms 2.6485 KOps/s 2.6115 KOps/s $\color{#35bf28}+1.41\%$
test_collector_preallocated_write[stack_out-cuda-32-32] 1.1107ms 0.8371ms 1.1946 KOps/s 1.1964 KOps/s $\color{#d91a1a}-0.15\%$
test_collector_preallocated_write[stack_out-cuda-4096-2] 0.3444ms 0.2527ms 3.9571 KOps/s 3.9252 KOps/s $\color{#35bf28}+0.81\%$
test_collector_preallocated_write[stack_out-cuda-4096-8] 0.4683ms 0.3757ms 2.6615 KOps/s 2.6432 KOps/s $\color{#35bf28}+0.69\%$
test_collector_preallocated_write[stack_out-cuda-4096-32] 0.9571ms 0.8888ms 1.1251 KOps/s 1.1199 KOps/s $\color{#35bf28}+0.46\%$
test_collector_preallocated_write[set_at_loop-cpu-32-2] 0.2892ms 0.2164ms 4.6215 KOps/s 4.5606 KOps/s $\color{#35bf28}+1.34\%$
test_collector_preallocated_write[set_at_loop-cpu-32-8] 1.1199ms 0.8386ms 1.1925 KOps/s 1.1297 KOps/s $\textbf{\color{#35bf28}+5.56\%}$
test_collector_preallocated_write[set_at_loop-cpu-32-32] 3.4560ms 3.3401ms 299.3964 Ops/s 294.6507 Ops/s $\color{#35bf28}+1.61\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-2] 0.5920ms 0.3842ms 2.6031 KOps/s 2.7095 KOps/s $\color{#d91a1a}-3.93\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-8] 2.0523ms 1.6958ms 589.7056 Ops/s 592.6828 Ops/s $\color{#d91a1a}-0.50\%$
test_collector_preallocated_write[set_at_loop-cpu-4096-32] 10.7177ms 10.4457ms 95.7334 Ops/s 95.3995 Ops/s $\color{#35bf28}+0.35\%$
test_collector_preallocated_write[set_at_loop-cuda-32-2] 0.4830ms 0.4026ms 2.4841 KOps/s 2.4443 KOps/s $\color{#35bf28}+1.63\%$
test_collector_preallocated_write[set_at_loop-cuda-32-8] 1.6442ms 1.4776ms 676.7862 Ops/s 632.5399 Ops/s $\textbf{\color{#35bf28}+7.00\%}$
test_collector_preallocated_write[set_at_loop-cuda-32-32] 6.1327ms 5.8188ms 171.8570 Ops/s 160.9262 Ops/s $\textbf{\color{#35bf28}+6.79\%}$
test_collector_preallocated_write[set_at_loop-cuda-4096-2] 0.4666ms 0.3998ms 2.5013 KOps/s 2.3632 KOps/s $\textbf{\color{#35bf28}+5.84\%}$
test_collector_preallocated_write[set_at_loop-cuda-4096-8] 1.5522ms 1.4927ms 669.9144 Ops/s 643.9785 Ops/s $\color{#35bf28}+4.03\%$
test_collector_preallocated_write[set_at_loop-cuda-4096-32] 6.1145ms 5.8442ms 171.1090 Ops/s 165.9001 Ops/s $\color{#35bf28}+3.14\%$
test_collector_preallocated_write[copy_at-cpu-32-2] 0.2120ms 0.1727ms 5.7912 KOps/s 5.7527 KOps/s $\color{#35bf28}+0.67\%$
test_collector_preallocated_write[copy_at-cpu-32-8] 0.7667ms 0.6732ms 1.4854 KOps/s 1.4790 KOps/s $\color{#35bf28}+0.43\%$
test_collector_preallocated_write[copy_at-cpu-32-32] 2.9329ms 2.6683ms 374.7673 Ops/s 372.4087 Ops/s $\color{#35bf28}+0.63\%$
test_collector_preallocated_write[copy_at-cpu-4096-2] 0.3857ms 0.3329ms 3.0042 KOps/s 3.0202 KOps/s $\color{#d91a1a}-0.53\%$
test_collector_preallocated_write[copy_at-cpu-4096-8] 1.8521ms 1.6060ms 622.6495 Ops/s 658.4200 Ops/s $\textbf{\color{#d91a1a}-5.43\%}$
test_collector_preallocated_write[copy_at-cpu-4096-32] 9.8425ms 9.6327ms 103.8136 Ops/s 103.8224 Ops/s $-0.01\%$
test_collector_preallocated_write[copy_at-cuda-32-2] 0.4034ms 0.3251ms 3.0756 KOps/s 3.0323 KOps/s $\color{#35bf28}+1.43\%$
test_collector_preallocated_write[copy_at-cuda-32-8] 1.2518ms 1.2160ms 822.3498 Ops/s 810.5607 Ops/s $\color{#35bf28}+1.45\%$
test_collector_preallocated_write[copy_at-cuda-32-32] 5.0096ms 4.7644ms 209.8890 Ops/s 207.6582 Ops/s $\color{#35bf28}+1.07\%$
test_collector_preallocated_write[copy_at-cuda-4096-2] 0.4278ms 0.3280ms 3.0492 KOps/s 3.0162 KOps/s $\color{#35bf28}+1.09\%$
test_collector_preallocated_write[copy_at-cuda-4096-8] 1.2844ms 1.2199ms 819.7391 Ops/s 810.7899 Ops/s $\color{#35bf28}+1.10\%$
test_collector_preallocated_write[copy_at-cuda-4096-32] 4.8716ms 4.7839ms 209.0336 Ops/s 206.6515 Ops/s $\color{#35bf28}+1.15\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-2] 0.1567ms 0.1210ms 8.2665 KOps/s 8.3371 KOps/s $\color{#d91a1a}-0.85\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-8] 0.5318ms 0.4724ms 2.1169 KOps/s 2.0995 KOps/s $\color{#35bf28}+0.83\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-32-32] 1.9277ms 1.8800ms 531.9128 Ops/s 534.8016 Ops/s $\color{#d91a1a}-0.54\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-2] 0.4464ms 0.2594ms 3.8545 KOps/s 4.0122 KOps/s $\color{#d91a1a}-3.93\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-8] 1.4896ms 1.2899ms 775.2452 Ops/s 774.4622 Ops/s $\color{#35bf28}+0.10\%$
test_collector_preallocated_write[manual_leaf_copy-cpu-4096-32] 8.9996ms 8.6749ms 115.2752 Ops/s 113.0741 Ops/s $\color{#35bf28}+1.95\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-2] 0.3501ms 0.2848ms 3.5118 KOps/s 3.4718 KOps/s $\color{#35bf28}+1.15\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-8] 1.1491ms 1.0626ms 941.0565 Ops/s 928.7632 Ops/s $\color{#35bf28}+1.32\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-32-32] 4.2289ms 4.1568ms 240.5683 Ops/s 240.3616 Ops/s $\color{#35bf28}+0.09\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-2] 0.3604ms 0.2842ms 3.5185 KOps/s 3.4946 KOps/s $\color{#35bf28}+0.68\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-8] 1.1472ms 1.0560ms 947.0008 Ops/s 938.5641 Ops/s $\color{#35bf28}+0.90\%$
test_collector_preallocated_write[manual_leaf_copy-cuda-4096-32] 4.2231ms 4.1575ms 240.5266 Ops/s 239.9236 Ops/s $\color{#35bf28}+0.25\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-128] 16.6914ms 16.5317ms 60.4898 Ops/s 60.5695 Ops/s $\color{#d91a1a}-0.13\%$
test_wide_nested_preallocated_write[stack_out-cpu-128-256] 33.6510ms 33.4598ms 29.8867 Ops/s 30.0318 Ops/s $\color{#d91a1a}-0.48\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-128] 85.7821ms 84.7474ms 11.7998 Ops/s 11.6939 Ops/s $\color{#35bf28}+0.91\%$
test_wide_nested_preallocated_write[stack_out-cpu-4096-256] 0.2039s 0.2023s 4.9420 Ops/s 5.0092 Ops/s $\color{#d91a1a}-1.34\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-128] 14.0082ms 13.9012ms 71.9360 Ops/s 71.6862 Ops/s $\color{#35bf28}+0.35\%$
test_wide_nested_preallocated_write[stack_out-cuda-128-256] 27.4138ms 27.1717ms 36.8030 Ops/s 36.9695 Ops/s $\color{#d91a1a}-0.45\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-128] 14.1157ms 14.0222ms 71.3156 Ops/s 71.3529 Ops/s $\color{#d91a1a}-0.05\%$
test_wide_nested_preallocated_write[stack_out-cuda-4096-256] 27.6932ms 27.5528ms 36.2940 Ops/s 36.4340 Ops/s $\color{#d91a1a}-0.38\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-128] 52.9874ms 52.6158ms 19.0057 Ops/s 18.1884 Ops/s $\color{#35bf28}+4.49\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-128-256] 0.1068s 0.1062s 9.4145 Ops/s 8.8495 Ops/s $\textbf{\color{#35bf28}+6.38\%}$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-128] 0.1482s 0.1475s 6.7816 Ops/s 6.6029 Ops/s $\color{#35bf28}+2.71\%$
test_wide_nested_preallocated_write[set_at_loop-cpu-4096-256] 0.3270s 0.3252s 3.0746 Ops/s 3.0523 Ops/s $\color{#35bf28}+0.73\%$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-128] 75.7154ms 74.7158ms 13.3840 Ops/s 12.3222 Ops/s $\textbf{\color{#35bf28}+8.62\%}$
test_wide_nested_preallocated_write[set_at_loop-cuda-128-256] 0.1551s 0.1511s 6.6166 Ops/s 6.1525 Ops/s $\textbf{\color{#35bf28}+7.54\%}$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-128] 79.5950ms 76.8657ms 13.0097 Ops/s 12.2977 Ops/s $\textbf{\color{#35bf28}+5.79\%}$
test_wide_nested_preallocated_write[set_at_loop-cuda-4096-256] 0.1601s 0.1555s 6.4323 Ops/s 6.1272 Ops/s $\color{#35bf28}+4.98\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-128] 30.6373ms 30.5184ms 32.7671 Ops/s 32.9358 Ops/s $\color{#d91a1a}-0.51\%$
test_wide_nested_preallocated_write[copy_at-cpu-128-256] 62.1514ms 61.9330ms 16.1465 Ops/s 16.1558 Ops/s $\color{#d91a1a}-0.06\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-128] 0.1231s 0.1212s 8.2482 Ops/s 8.3472 Ops/s $\color{#d91a1a}-1.19\%$
test_wide_nested_preallocated_write[copy_at-cpu-4096-256] 0.2710s 0.2681s 3.7299 Ops/s 3.7584 Ops/s $\color{#d91a1a}-0.76\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-128] 43.8668ms 43.6752ms 22.8963 Ops/s 22.7952 Ops/s $\color{#35bf28}+0.44\%$
test_wide_nested_preallocated_write[copy_at-cuda-128-256] 87.8513ms 87.6043ms 11.4150 Ops/s 11.3755 Ops/s $\color{#35bf28}+0.35\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-128] 44.1904ms 44.0775ms 22.6873 Ops/s 22.6149 Ops/s $\color{#35bf28}+0.32\%$
test_wide_nested_preallocated_write[copy_at-cuda-4096-256] 88.4213ms 88.0143ms 11.3618 Ops/s 11.3013 Ops/s $\color{#35bf28}+0.54\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-128] 20.6057ms 20.4958ms 48.7906 Ops/s 48.8103 Ops/s $\color{#d91a1a}-0.04\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-128-256] 42.0258ms 41.7751ms 23.9377 Ops/s 24.0201 Ops/s $\color{#d91a1a}-0.34\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-128] 0.1094s 0.1084s 9.2218 Ops/s 9.2145 Ops/s $\color{#35bf28}+0.08\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cpu-4096-256] 0.2506s 0.2492s 4.0128 Ops/s 4.0623 Ops/s $\color{#d91a1a}-1.22\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-128] 38.0474ms 37.7011ms 26.5245 Ops/s 26.3749 Ops/s $\color{#35bf28}+0.57\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-128-256] 75.7807ms 75.3617ms 13.2693 Ops/s 13.1638 Ops/s $\color{#35bf28}+0.80\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-128] 37.6841ms 37.3689ms 26.7603 Ops/s 26.2081 Ops/s $\color{#35bf28}+2.11\%$
test_wide_nested_preallocated_write[manual_leaf_copy-cuda-4096-256] 76.1254ms 75.3877ms 13.2648 Ops/s 13.2315 Ops/s $\color{#35bf28}+0.25\%$
test_plain_set_nested 39.2310μs 15.5958μs 64.1197 KOps/s 65.5434 KOps/s $\color{#d91a1a}-2.17\%$
test_plain_set_stack_nested 43.9810μs 15.2042μs 65.7714 KOps/s 66.6654 KOps/s $\color{#d91a1a}-1.34\%$
test_plain_set_nested_inplace 75.0520μs 16.6995μs 59.8820 KOps/s 61.2525 KOps/s $\color{#d91a1a}-2.24\%$
test_plain_set_stack_nested_inplace 50.2310μs 16.3797μs 61.0510 KOps/s 60.7150 KOps/s $\color{#35bf28}+0.55\%$
test_items 81.6910μs 6.1428μs 162.7925 KOps/s 164.0790 KOps/s $\color{#d91a1a}-0.78\%$
test_items_nested 0.5032ms 0.4714ms 2.1214 KOps/s 2.1816 KOps/s $\color{#d91a1a}-2.76\%$
test_items_nested_locked 0.5134ms 0.4777ms 2.0933 KOps/s 2.1678 KOps/s $\color{#d91a1a}-3.44\%$
test_items_nested_leaf 0.1388ms 0.1001ms 9.9933 KOps/s 10.0957 KOps/s $\color{#d91a1a}-1.01\%$
test_items_stack_nested 0.5516ms 0.4757ms 2.1024 KOps/s 2.1879 KOps/s $\color{#d91a1a}-3.91\%$
test_items_stack_nested_leaf 0.1325ms 0.1001ms 9.9921 KOps/s 10.2471 KOps/s $\color{#d91a1a}-2.49\%$
test_items_stack_nested_locked 0.5127ms 0.4790ms 2.0876 KOps/s 2.1732 KOps/s $\color{#d91a1a}-3.94\%$
test_keys 38.9510μs 4.2260μs 236.6278 KOps/s 237.7693 KOps/s $\color{#d91a1a}-0.48\%$
test_keys_nested 0.2142ms 0.1302ms 7.6819 KOps/s 7.5440 KOps/s $\color{#35bf28}+1.83\%$
test_keys_nested_locked 2.0874ms 0.1422ms 7.0307 KOps/s 7.0708 KOps/s $\color{#d91a1a}-0.57\%$
test_keys_nested_leaf 0.1671ms 0.1225ms 8.1640 KOps/s 8.1700 KOps/s $\color{#d91a1a}-0.07\%$
test_keys_stack_nested 0.1676ms 0.1317ms 7.5947 KOps/s 7.5879 KOps/s $\color{#35bf28}+0.09\%$
test_keys_stack_nested_leaf 0.1713ms 0.1223ms 8.1772 KOps/s 8.1875 KOps/s $\color{#d91a1a}-0.13\%$
test_keys_stack_nested_locked 0.1894ms 0.1397ms 7.1577 KOps/s 7.1559 KOps/s $\color{#35bf28}+0.03\%$
test_values 4.0050μs 1.0012μs 998.7820 KOps/s 976.9270 KOps/s $\color{#35bf28}+2.24\%$
test_values_nested 90.1220μs 53.1881μs 18.8012 KOps/s 18.8641 KOps/s $\color{#d91a1a}-0.33\%$
test_values_nested_locked 86.4520μs 56.3886μs 17.7341 KOps/s 17.6926 KOps/s $\color{#35bf28}+0.23\%$
test_values_nested_leaf 91.9320μs 61.0317μs 16.3849 KOps/s 16.4372 KOps/s $\color{#d91a1a}-0.32\%$
test_values_stack_nested 77.2120μs 52.8395μs 18.9252 KOps/s 18.8960 KOps/s $\color{#35bf28}+0.15\%$
test_values_stack_nested_leaf 94.4820μs 60.8097μs 16.4448 KOps/s 16.4446 KOps/s $+0.00\%$
test_values_stack_nested_locked 92.1420μs 56.2273μs 17.7849 KOps/s 17.8183 KOps/s $\color{#d91a1a}-0.19\%$
test_membership 5.0552μs 0.8491μs 1.1777 MOps/s 1.1915 MOps/s $\color{#d91a1a}-1.16\%$
test_membership_nested 27.6400μs 3.0628μs 326.4958 KOps/s 330.7711 KOps/s $\color{#d91a1a}-1.29\%$
test_membership_nested_leaf 27.8110μs 3.0422μs 328.7132 KOps/s 327.5305 KOps/s $\color{#35bf28}+0.36\%$
test_membership_stacked_nested 22.8310μs 2.9647μs 337.3005 KOps/s 342.9094 KOps/s $\color{#d91a1a}-1.64\%$
test_membership_stacked_nested_leaf 22.4600μs 2.9224μs 342.1880 KOps/s 349.0056 KOps/s $\color{#d91a1a}-1.95\%$
test_membership_nested_last 34.4310μs 4.5194μs 221.2702 KOps/s 224.3373 KOps/s $\color{#d91a1a}-1.37\%$
test_membership_nested_leaf_last 33.4010μs 4.5328μs 220.6166 KOps/s 221.4858 KOps/s $\color{#d91a1a}-0.39\%$
test_membership_stacked_nested_last 37.4810μs 4.3805μs 228.2835 KOps/s 229.8422 KOps/s $\color{#d91a1a}-0.68\%$
test_membership_stacked_nested_leaf_last 37.2710μs 4.3534μs 229.7047 KOps/s 237.1273 KOps/s $\color{#d91a1a}-3.13\%$
test_nested_getleaf 92.4710μs 21.2284μs 47.1067 KOps/s 45.2985 KOps/s $\color{#35bf28}+3.99\%$
test_nested_get 52.7210μs 20.6699μs 48.3795 KOps/s 48.7568 KOps/s $\color{#d91a1a}-0.77\%$
test_stacked_getleaf 69.5820μs 21.4242μs 46.6763 KOps/s 46.5691 KOps/s $\color{#35bf28}+0.23\%$
test_stacked_get 46.6510μs 20.5343μs 48.6989 KOps/s 48.4669 KOps/s $\color{#35bf28}+0.48\%$
test_nested_getitemleaf 79.4920μs 22.4188μs 44.6055 KOps/s 44.3788 KOps/s $\color{#35bf28}+0.51\%$
test_nested_getitem 44.1900μs 21.0668μs 47.4680 KOps/s 47.2496 KOps/s $\color{#35bf28}+0.46\%$
test_stacked_getitemleaf 55.0810μs 21.7979μs 45.8759 KOps/s 45.3250 KOps/s $\color{#35bf28}+1.22\%$
test_stacked_getitem 44.8010μs 21.1031μs 47.3864 KOps/s 47.2540 KOps/s $\color{#35bf28}+0.28\%$
test_lock_nested 2.9612ms 0.5086ms 1.9662 KOps/s 1.9481 KOps/s $\color{#35bf28}+0.93\%$
test_lock_stack_nested 0.5586ms 0.5116ms 1.9546 KOps/s 1.9538 KOps/s $\color{#35bf28}+0.04\%$
test_unlock_nested 0.4796ms 0.4019ms 2.4884 KOps/s 2.4928 KOps/s $\color{#d91a1a}-0.17\%$
test_unlock_stack_nested 0.4992ms 0.4025ms 2.4845 KOps/s 2.4678 KOps/s $\color{#35bf28}+0.68\%$
test_flatten_speed 0.1674ms 0.1246ms 8.0260 KOps/s 8.1464 KOps/s $\color{#d91a1a}-1.48\%$
test_unflatten_speed 0.6907ms 0.5556ms 1.8000 KOps/s 1.7682 KOps/s $\color{#35bf28}+1.80\%$
test_common_ops 0.8565ms 0.6974ms 1.4339 KOps/s 1.4055 KOps/s $\color{#35bf28}+2.02\%$
test_creation 0.1189ms 3.2000μs 312.4971 KOps/s 310.2767 KOps/s $\color{#35bf28}+0.72\%$
test_creation_empty 35.7010μs 7.0720μs 141.4031 KOps/s 141.8245 KOps/s $\color{#d91a1a}-0.30\%$
test_creation_nested_1 43.3110μs 11.6457μs 85.8683 KOps/s 86.4975 KOps/s $\color{#d91a1a}-0.73\%$
test_creation_nested_2 42.5800μs 13.7984μs 72.4722 KOps/s 72.8543 KOps/s $\color{#d91a1a}-0.52\%$
test_creation_many_keys[10] 56.8210μs 21.2590μs 47.0388 KOps/s 47.1422 KOps/s $\color{#d91a1a}-0.22\%$
test_creation_many_keys[50] 0.1199ms 91.3570μs 10.9461 KOps/s 10.9691 KOps/s $\color{#d91a1a}-0.21\%$
test_creation_many_keys[100] 0.2254ms 0.1786ms 5.5993 KOps/s 5.5935 KOps/s $\color{#35bf28}+0.10\%$
test_creation_nested_many_keys[10] 74.9820μs 45.5922μs 21.9336 KOps/s 21.9629 KOps/s $\color{#d91a1a}-0.13\%$
test_creation_nested_many_keys[50] 0.2460ms 0.1863ms 5.3683 KOps/s 5.3556 KOps/s $\color{#35bf28}+0.24\%$
test_clone 41.6200μs 12.9399μs 77.2803 KOps/s 76.8873 KOps/s $\color{#35bf28}+0.51\%$
test_getitem[int] 1.5824ms 15.7462μs 63.5072 KOps/s 64.1426 KOps/s $\color{#d91a1a}-0.99\%$
test_getitem[slice_int] 0.1444ms 24.9021μs 40.1572 KOps/s 39.1759 KOps/s $\color{#35bf28}+2.51\%$
test_getitem[range] 0.1744ms 64.8810μs 15.4128 KOps/s 15.9176 KOps/s $\color{#d91a1a}-3.17\%$
test_getitem[tuple] 0.1503ms 24.7467μs 40.4095 KOps/s 40.2765 KOps/s $\color{#35bf28}+0.33\%$
test_getitem[list] 0.1847ms 58.3849μs 17.1277 KOps/s 17.1793 KOps/s $\color{#d91a1a}-0.30\%$
test_setitem_dim[int] 52.4410μs 26.3362μs 37.9706 KOps/s 38.8797 KOps/s $\color{#d91a1a}-2.34\%$
test_setitem_dim[slice_int] 82.8310μs 43.7306μs 22.8673 KOps/s 22.6461 KOps/s $\color{#35bf28}+0.98\%$
test_setitem_dim[range] 0.1245ms 0.1003ms 9.9668 KOps/s 10.5443 KOps/s $\textbf{\color{#d91a1a}-5.48\%}$
test_setitem_dim[tuple] 65.0220μs 39.1560μs 25.5389 KOps/s 24.4597 KOps/s $\color{#35bf28}+4.41\%$
test_setitem 48.9310μs 17.4046μs 57.4561 KOps/s 57.5253 KOps/s $\color{#d91a1a}-0.12\%$
test_set 73.3110μs 16.6718μs 59.9815 KOps/s 59.5759 KOps/s $\color{#35bf28}+0.68\%$
test_set_shared 0.6181ms 0.2072ms 4.8263 KOps/s 4.8002 KOps/s $\color{#35bf28}+0.54\%$
test_update 0.3587ms 21.3131μs 46.9196 KOps/s 46.3402 KOps/s $\color{#35bf28}+1.25\%$
test_update_nested 65.9820μs 33.1966μs 30.1236 KOps/s 30.2480 KOps/s $\color{#d91a1a}-0.41\%$
test_update__nested 0.5705ms 33.3536μs 29.9818 KOps/s 30.0172 KOps/s $\color{#d91a1a}-0.12\%$
test_set_nested 63.4910μs 18.4381μs 54.2356 KOps/s 54.1901 KOps/s $\color{#35bf28}+0.08\%$
test_set_nested_new 63.0210μs 23.3510μs 42.8248 KOps/s 42.9631 KOps/s $\color{#d91a1a}-0.32\%$
test_select 74.9220μs 39.3264μs 25.4282 KOps/s 25.0421 KOps/s $\color{#35bf28}+1.54\%$
test_select_nested 0.1072ms 75.2525μs 13.2886 KOps/s 13.3834 KOps/s $\color{#d91a1a}-0.71\%$
test_exclude_nested 0.1509ms 91.3238μs 10.9500 KOps/s 10.8281 KOps/s $\color{#35bf28}+1.13\%$
test_empty[True] 1.3482ms 0.4066ms 2.4592 KOps/s 2.5063 KOps/s $\color{#d91a1a}-1.88\%$
test_empty[False] 10.3603μs 1.4132μs 707.5945 KOps/s 714.5414 KOps/s $\color{#d91a1a}-0.97\%$
test_to 0.1250ms 70.7697μs 14.1303 KOps/s 13.5750 KOps/s $\color{#35bf28}+4.09\%$
test_to_nonblocking 0.1123ms 71.3244μs 14.0204 KOps/s 13.8025 KOps/s $\color{#35bf28}+1.58\%$
test_unbind_speed 0.4194ms 0.3426ms 2.9191 KOps/s 2.8600 KOps/s $\color{#35bf28}+2.07\%$
test_unbind_speed_stack0 0.3857ms 0.3403ms 2.9387 KOps/s 2.9129 KOps/s $\color{#35bf28}+0.89\%$
test_unbind_speed_stack1 0.1256s 0.8733ms 1.1451 KOps/s 1.1299 KOps/s $\color{#35bf28}+1.34\%$
test_split 0.1255s 1.4766ms 677.2159 Ops/s 768.3880 Ops/s $\textbf{\color{#d91a1a}-11.87\%}$
test_chunk 1.2925ms 1.2476ms 801.5287 Ops/s 802.3743 Ops/s $\color{#d91a1a}-0.11\%$
test_to_cpu_blocking 20.3167ms 20.2153ms 49.4675 Ops/s 49.5784 Ops/s $\color{#d91a1a}-0.22\%$
test_to_cpu_global_sync 12.0815ms 11.9857ms 83.4330 Ops/s 72.8400 Ops/s $\textbf{\color{#35bf28}+14.54\%}$
test_to_cpu_event_sync 13.3405ms 13.0158ms 76.8298 Ops/s 76.1227 Ops/s $\color{#35bf28}+0.93\%$
test_to_cpu_default 13.3636ms 13.0713ms 76.5033 Ops/s 76.0952 Ops/s $\color{#35bf28}+0.54\%$
test_consolidate[False-None] 4.3686ms 4.2487ms 235.3666 Ops/s 236.0730 Ops/s $\color{#d91a1a}-0.30\%$
test_consolidate[default-None] 3.2866ms 2.2821ms 438.1933 Ops/s 423.5427 Ops/s $\color{#35bf28}+3.46\%$
test_consolidate[reduce-overhead-None] 3.1711ms 2.1840ms 457.8668 Ops/s 439.1830 Ops/s $\color{#35bf28}+4.25\%$
test_consolidate_njt[False-None] 5.5022ms 5.1865ms 192.8092 Ops/s 190.8237 Ops/s $\color{#35bf28}+1.04\%$
test_to[False-False-None] 2.3275ms 2.2438ms 445.6784 Ops/s 445.4490 Ops/s $\color{#35bf28}+0.05\%$
test_to[True-False-None] 2.2104ms 1.9456ms 513.9893 Ops/s 507.8076 Ops/s $\color{#35bf28}+1.22\%$
test_to[within-False-None] 6.5580ms 6.2902ms 158.9776 Ops/s 157.7556 Ops/s $\color{#35bf28}+0.77\%$
test_to[True-default-None] 10.7044ms 10.5068ms 95.1765 Ops/s 45.6611 Ops/s $\textbf{\color{#35bf28}+108.44\%}$
test_to_njt[False-False-None] 7.2195ms 7.1117ms 140.6143 Ops/s 139.2977 Ops/s $\color{#35bf28}+0.95\%$
test_to_njt[True-False-None] 4.1194ms 3.9545ms 252.8781 Ops/s 249.6225 Ops/s $\color{#35bf28}+1.30\%$
test_to_njt[within-False-None] 0.2420s 11.4190ms 87.5734 Ops/s 106.0442 Ops/s $\textbf{\color{#d91a1a}-17.42\%}$
test_creation[device0] 0.3501ms 0.1218ms 8.2072 KOps/s 8.2951 KOps/s $\color{#d91a1a}-1.06\%$
test_creation_from_tensor 0.3552ms 0.1174ms 8.5180 KOps/s 8.2755 KOps/s $\color{#35bf28}+2.93\%$
test_add_one[memmap_tensor0] 0.1991ms 6.3388μs 157.7575 KOps/s 158.3800 KOps/s $\color{#d91a1a}-0.39\%$
test_contiguous[memmap_tensor0] 15.5010μs 0.6862μs 1.4574 MOps/s 2.1285 MOps/s $\textbf{\color{#d91a1a}-31.53\%}$
test_stack[memmap_tensor0] 0.1651ms 4.2280μs 236.5197 KOps/s 233.9067 KOps/s $\color{#35bf28}+1.12\%$
test_memmaptd_index 1.4417ms 0.2847ms 3.5127 KOps/s 3.4683 KOps/s $\color{#35bf28}+1.28\%$
test_memmaptd_index_astensor 0.5494ms 0.3874ms 2.5816 KOps/s 2.5628 KOps/s $\color{#35bf28}+0.74\%$
test_memmaptd_index_op 0.7969ms 0.6369ms 1.5702 KOps/s 1.5633 KOps/s $\color{#35bf28}+0.44\%$
test_serialize_model 0.1429s 0.1411s 7.0848 Ops/s 7.0956 Ops/s $\color{#d91a1a}-0.15\%$
test_serialize_model_archive 1.3687s 1.2487s 0.8008 Ops/s 0.8037 Ops/s $\color{#d91a1a}-0.35\%$
test_load_archive 18.4958ms 18.2868ms 54.6842 Ops/s 54.9425 Ops/s $\color{#d91a1a}-0.47\%$
test_serialize_model_zarr 2.5029s 2.4981s 0.4003 Ops/s 0.4010 Ops/s $\color{#d91a1a}-0.17\%$
test_load_zarr 0.4301s 0.4013s 2.4922 Ops/s 2.5189 Ops/s $\color{#d91a1a}-1.06\%$
test_serialize_model_pickle 1.8162s 1.2894s 0.7756 Ops/s 0.6960 Ops/s $\textbf{\color{#35bf28}+11.43\%}$
test_serialize_weights 0.3346s 0.1683s 5.9401 Ops/s 7.1372 Ops/s $\textbf{\color{#d91a1a}-16.77\%}$
test_serialize_weights_returnearly 57.5612ms 51.4783ms 19.4257 Ops/s 13.5965 Ops/s $\textbf{\color{#35bf28}+42.87\%}$
test_serialize_weights_pickle 1.3669s 1.2130s 0.8244 Ops/s 0.8246 Ops/s $\color{#d91a1a}-0.03\%$
test_consolidate[few_large-0] 67.6759ms 7.7874ms 128.4133 Ops/s 121.4624 Ops/s $\textbf{\color{#35bf28}+5.72\%}$
test_consolidate[few_large-8] 33.3019ms 6.4579ms 154.8496 Ops/s 128.7200 Ops/s $\textbf{\color{#35bf28}+20.30\%}$
test_consolidate[many_small-0] 0.1277s 0.1215s 8.2334 Ops/s 8.0884 Ops/s $\color{#35bf28}+1.79\%$
test_consolidate[many_small-8] 43.5743ms 40.6038ms 24.6283 Ops/s 19.8057 Ops/s $\textbf{\color{#35bf28}+24.35\%}$
test_consolidate_to_file[few_large-0] 0.1377s 23.1514ms 43.1939 Ops/s 44.6143 Ops/s $\color{#d91a1a}-3.18\%$
test_consolidate_to_file[few_large-8] 0.1679s 31.5759ms 31.6697 Ops/s 37.0766 Ops/s $\textbf{\color{#d91a1a}-14.58\%}$
test_consolidate_to_file[many_small-0] 0.5766s 0.4774s 2.0946 Ops/s 3.6002 Ops/s $\textbf{\color{#d91a1a}-41.82\%}$
test_consolidate_to_file[many_small-8] 0.5972s 0.5602s 1.7852 Ops/s 2.7571 Ops/s $\textbf{\color{#d91a1a}-35.25\%}$
test_reshape_pytree 7.1333ms 32.7931μs 30.4942 KOps/s 30.1149 KOps/s $\color{#35bf28}+1.26\%$
test_reshape_td 85.7720μs 45.7008μs 21.8814 KOps/s 21.9206 KOps/s $\color{#d91a1a}-0.18\%$
test_view_pytree 0.2283ms 32.0705μs 31.1813 KOps/s 30.9465 KOps/s $\color{#35bf28}+0.76\%$
test_view_td 86.4120μs 53.3185μs 18.7552 KOps/s 18.4050 KOps/s $\color{#35bf28}+1.90\%$
test_unbind_pytree 0.2425ms 36.7322μs 27.2241 KOps/s 27.0879 KOps/s $\color{#35bf28}+0.50\%$
test_unbind_td 0.1576ms 50.4017μs 19.8406 KOps/s 19.6011 KOps/s $\color{#35bf28}+1.22\%$
test_split_pytree 0.1968ms 41.6302μs 24.0210 KOps/s 23.7744 KOps/s $\color{#35bf28}+1.04\%$
test_split_td 0.2165ms 72.7288μs 13.7497 KOps/s 13.6848 KOps/s $\color{#35bf28}+0.47\%$
test_add_pytree 0.2327ms 40.4565μs 24.7179 KOps/s 24.4528 KOps/s $\color{#35bf28}+1.08\%$
test_add_td 88.9120μs 54.2954μs 18.4178 KOps/s 18.3873 KOps/s $\color{#35bf28}+0.17\%$
test_compile_add_one_nested[tensordict-compile] 0.4374ms 0.2820ms 3.5467 KOps/s 3.6462 KOps/s $\color{#d91a1a}-2.73\%$
test_compile_add_one_nested[tensordict-eager] 0.2840ms 0.2076ms 4.8181 KOps/s 4.9185 KOps/s $\color{#d91a1a}-2.04\%$
test_compile_add_one_nested[pytree-compile] 0.2903ms 0.1540ms 6.4926 KOps/s 6.1166 KOps/s $\textbf{\color{#35bf28}+6.15\%}$
test_compile_add_one_nested[pytree-eager] 0.5215ms 0.1791ms 5.5842 KOps/s 5.2928 KOps/s $\textbf{\color{#35bf28}+5.50\%}$
test_compile_copy_nested[tensordict-compile] 92.6320μs 23.9934μs 41.6781 KOps/s 45.7195 KOps/s $\textbf{\color{#d91a1a}-8.84\%}$
test_compile_copy_nested[tensordict-eager] 94.6520μs 54.0990μs 18.4846 KOps/s 18.4855 KOps/s $-0.00\%$
test_compile_copy_nested[pytree-compile] 0.2281ms 18.9003μs 52.9091 KOps/s 52.4951 KOps/s $\color{#35bf28}+0.79\%$
test_compile_copy_nested[pytree-eager] 0.3983ms 66.6794μs 14.9971 KOps/s 14.9596 KOps/s $\color{#35bf28}+0.25\%$
test_compile_add_one_flat[tensordict-compile] 0.3539ms 0.3108ms 3.2175 KOps/s 3.0523 KOps/s $\textbf{\color{#35bf28}+5.41\%}$
test_compile_add_one_flat[tensordict-eager] 0.3657ms 0.2888ms 3.4622 KOps/s 3.3987 KOps/s $\color{#35bf28}+1.87\%$
test_compile_add_one_flat[tensorclass-compile] 0.3882ms 0.2130ms 4.6949 KOps/s 4.4598 KOps/s $\textbf{\color{#35bf28}+5.27\%}$
test_compile_add_one_flat[tensorclass-eager] 0.1156ms 75.6348μs 13.2214 KOps/s 12.9245 KOps/s $\color{#35bf28}+2.30\%$
test_compile_add_one_flat[pytree-compile] 0.4781ms 0.2426ms 4.1221 KOps/s 3.9975 KOps/s $\color{#35bf28}+3.12\%$
test_compile_add_one_flat[pytree-eager] 0.8342ms 0.5453ms 1.8339 KOps/s 1.8263 KOps/s $\color{#35bf28}+0.42\%$
test_compile_add_self_flat[tensordict-eager] 0.3987ms 0.3371ms 2.9665 KOps/s 2.9253 KOps/s $\color{#35bf28}+1.41\%$
test_compile_add_self_flat[tensordict-compile] 0.4363ms 0.3127ms 3.1976 KOps/s 3.0744 KOps/s $\color{#35bf28}+4.01\%$
test_compile_add_self_flat[tensorclass-eager] 0.1365ms 91.2551μs 10.9583 KOps/s 10.7614 KOps/s $\color{#35bf28}+1.83\%$
test_compile_add_self_flat[tensorclass-compile] 0.3418ms 0.2113ms 4.7335 KOps/s 4.3468 KOps/s $\textbf{\color{#35bf28}+8.90\%}$
test_compile_add_self_flat[pytree-eager] 0.7056ms 0.4547ms 2.1991 KOps/s 2.0695 KOps/s $\textbf{\color{#35bf28}+6.26\%}$
test_compile_add_self_flat[pytree-compile] 0.5028ms 0.2428ms 4.1182 KOps/s 3.9613 KOps/s $\color{#35bf28}+3.96\%$
test_compile_copy_flat[tensordict-compile] 80.3020μs 26.0644μs 38.3665 KOps/s 38.4602 KOps/s $\color{#d91a1a}-0.24\%$
test_compile_copy_flat[tensordict-eager] 76.1920μs 40.5596μs 24.6551 KOps/s 24.0405 KOps/s $\color{#35bf28}+2.56\%$
test_compile_copy_flat[pytree-compile] 0.1221ms 25.0854μs 39.8638 KOps/s 39.0346 KOps/s $\color{#35bf28}+2.12\%$
test_compile_copy_flat[pytree-eager] 0.3434ms 52.7080μs 18.9725 KOps/s 18.9343 KOps/s $\color{#35bf28}+0.20\%$
test_compile_assign_and_add[tensordict-compile] 2.1191ms 0.2599ms 3.8483 KOps/s 3.7041 KOps/s $\color{#35bf28}+3.89\%$
test_compile_assign_and_add[tensordict-eager] 3.7574ms 3.4835ms 287.0639 Ops/s 284.1769 Ops/s $\color{#35bf28}+1.02\%$
test_compile_assign_and_add[pytree-compile] 1.9556ms 0.1943ms 5.1464 KOps/s 4.9516 KOps/s $\color{#35bf28}+3.93\%$
test_compile_assign_and_add[pytree-eager] 3.0953ms 2.8458ms 351.3935 Ops/s 319.5388 Ops/s $\textbf{\color{#35bf28}+9.97\%}$
test_compile_indexing[tensor-tensordict-compile] 0.2615ms 0.1643ms 6.0850 KOps/s 6.1728 KOps/s $\color{#d91a1a}-1.42\%$
test_compile_indexing[tensor-tensordict-eager] 0.3929ms 74.2776μs 13.4630 KOps/s 12.4850 KOps/s $\textbf{\color{#35bf28}+7.83\%}$
test_compile_indexing[tensor-tensorclass-compile] 0.2843ms 0.1379ms 7.2508 KOps/s 7.0711 KOps/s $\color{#35bf28}+2.54\%$
test_compile_indexing[tensor-tensorclass-eager] 0.3256ms 46.5253μs 21.4937 KOps/s 20.3217 KOps/s $\textbf{\color{#35bf28}+5.77\%}$
test_compile_indexing[tensor-pytree-compile] 0.2418ms 0.1375ms 7.2752 KOps/s 7.0729 KOps/s $\color{#35bf28}+2.86\%$
test_compile_indexing[tensor-pytree-eager] 0.3032ms 44.6670μs 22.3879 KOps/s 20.7506 KOps/s $\textbf{\color{#35bf28}+7.89\%}$
test_compile_indexing[slice-tensordict-compile] 0.2104ms 91.7388μs 10.9005 KOps/s 10.3682 KOps/s $\textbf{\color{#35bf28}+5.13\%}$
test_compile_indexing[slice-tensordict-eager] 0.2269ms 28.0314μs 35.6743 KOps/s 32.8988 KOps/s $\textbf{\color{#35bf28}+8.44\%}$
test_compile_indexing[slice-tensorclass-compile] 0.1887ms 70.8396μs 14.1164 KOps/s 13.4935 KOps/s $\color{#35bf28}+4.62\%$
test_compile_indexing[slice-tensorclass-eager] 0.2643ms 22.4363μs 44.5706 KOps/s 43.3898 KOps/s $\color{#35bf28}+2.72\%$
test_compile_indexing[slice-pytree-compile] 1.0979ms 75.9542μs 13.1658 KOps/s 13.5691 KOps/s $\color{#d91a1a}-2.97\%$
test_compile_indexing[slice-pytree-eager] 0.3369ms 22.0874μs 45.2747 KOps/s 44.5462 KOps/s $\color{#35bf28}+1.64\%$
test_compile_indexing[int-tensordict-compile] 0.1359ms 95.4879μs 10.4725 KOps/s 10.1735 KOps/s $\color{#35bf28}+2.94\%$
test_compile_indexing[int-tensordict-eager] 0.3454ms 28.1644μs 35.5058 KOps/s 35.4625 KOps/s $\color{#35bf28}+0.12\%$
test_compile_indexing[int-tensorclass-compile] 0.1162ms 73.9058μs 13.5307 KOps/s 13.6635 KOps/s $\color{#d91a1a}-0.97\%$
test_compile_indexing[int-tensorclass-eager] 0.2588ms 22.0038μs 45.4467 KOps/s 44.6225 KOps/s $\color{#35bf28}+1.85\%$
test_compile_indexing[int-pytree-compile] 0.1245ms 72.8688μs 13.7233 KOps/s 13.4662 KOps/s $\color{#35bf28}+1.91\%$
test_compile_indexing[int-pytree-eager] 0.3039ms 22.2528μs 44.9381 KOps/s 44.3977 KOps/s $\color{#35bf28}+1.22\%$
test_compile_replace[single-eager] 0.1116ms 49.0519μs 20.3866 KOps/s 19.2930 KOps/s $\textbf{\color{#35bf28}+5.67\%}$
test_compile_replace[single-compile] 0.2902ms 0.1509ms 6.6286 KOps/s 6.5642 KOps/s $\color{#35bf28}+0.98\%$
test_compile_replace[multi-eager] 0.6528ms 0.5744ms 1.7410 KOps/s 1.6929 KOps/s $\color{#35bf28}+2.84\%$
test_compile_replace[multi-compile] 0.3502ms 0.1624ms 6.1586 KOps/s 6.0300 KOps/s $\color{#35bf28}+2.13\%$
test_compile_tc_getattr_20[eager] 0.2437ms 0.1810ms 5.5250 KOps/s 5.2077 KOps/s $\textbf{\color{#35bf28}+6.09\%}$
test_compile_tc_getattr_20[compile] 0.3930ms 0.1782ms 5.6104 KOps/s 5.2127 KOps/s $\textbf{\color{#35bf28}+7.63\%}$
test_compile_clone_shallow[20-eager] 53.1710μs 19.1041μs 52.3447 KOps/s 52.1321 KOps/s $\color{#35bf28}+0.41\%$
test_compile_clone_shallow[20-compile] 83.7720μs 24.1531μs 41.4025 KOps/s 44.2642 KOps/s $\textbf{\color{#d91a1a}-6.47\%}$
test_compile_clone_shallow[40-eager] 67.4210μs 33.7994μs 29.5863 KOps/s 29.5409 KOps/s $\color{#35bf28}+0.15\%$
test_compile_clone_shallow[40-compile] 83.4310μs 24.9931μs 40.0111 KOps/s 37.7243 KOps/s $\textbf{\color{#35bf28}+6.06\%}$
test_compile_clone_shallow[80-eager] 0.1241ms 61.1897μs 16.3426 KOps/s 15.8018 KOps/s $\color{#35bf28}+3.42\%$
test_compile_clone_shallow[80-compile] 0.1065ms 29.3384μs 34.0851 KOps/s 32.0293 KOps/s $\textbf{\color{#35bf28}+6.42\%}$
test_compile_update_inplace[eager] 0.2338ms 62.0342μs 16.1201 KOps/s 15.7947 KOps/s $\color{#35bf28}+2.06\%$
test_compile_update_inplace[compile] 0.2802ms 0.1229ms 8.1349 KOps/s 7.7976 KOps/s $\color{#35bf28}+4.33\%$
test_mod_add[eager] 0.2775ms 0.2270ms 4.4058 KOps/s 4.4087 KOps/s $\color{#d91a1a}-0.07\%$
test_mod_add[compile] 0.2636ms 0.1276ms 7.8339 KOps/s 7.8530 KOps/s $\color{#d91a1a}-0.24\%$
test_mod_add[compile-overhead] 0.3032ms 0.2052ms 4.8725 KOps/s 4.8210 KOps/s $\color{#35bf28}+1.07\%$
test_mod_wrap[eager] 0.5854ms 0.4773ms 2.0950 KOps/s 2.0474 KOps/s $\color{#35bf28}+2.33\%$
test_mod_wrap[compile] 0.4530ms 0.3648ms 2.7415 KOps/s 2.7082 KOps/s $\color{#35bf28}+1.23\%$
test_mod_wrap[compile-overhead] 7.0405ms 3.9286ms 254.5464 Ops/s 249.3331 Ops/s $\color{#35bf28}+2.09\%$
test_mod_wrap_and_backward[eager] 1.8268ms 1.6952ms 589.8972 Ops/s 593.6259 Ops/s $\color{#d91a1a}-0.63\%$
test_mod_wrap_and_backward[compile] 1.4921ms 1.3468ms 742.5006 Ops/s 728.8037 Ops/s $\color{#35bf28}+1.88\%$
test_mod_wrap_and_backward[compile-overhead] 1.5924ms 0.9624ms 1.0391 KOps/s 1.0221 KOps/s $\color{#35bf28}+1.67\%$
test_seq_add[eager] 0.6104ms 0.5118ms 1.9537 KOps/s 1.9414 KOps/s $\color{#35bf28}+0.63\%$
test_seq_add[compile] 0.2965ms 0.1361ms 7.3461 KOps/s 7.1974 KOps/s $\color{#35bf28}+2.07\%$
test_seq_add[compile-overhead] 0.3024ms 0.2065ms 4.8417 KOps/s 4.6642 KOps/s $\color{#35bf28}+3.81\%$
test_seq_wrap[eager] 1.5053ms 1.4135ms 707.4720 Ops/s 709.6751 Ops/s $\color{#d91a1a}-0.31\%$
test_seq_wrap[compile] 0.4252ms 0.3654ms 2.7367 KOps/s 2.6495 KOps/s $\color{#35bf28}+3.29\%$
test_seq_wrap[compile-overhead] 0.4905ms 0.3406ms 2.9361 KOps/s 3.0075 KOps/s $\color{#d91a1a}-2.37\%$
test_func_call_runtime[False-eager] 0.8609ms 0.8111ms 1.2329 KOps/s 1.2185 KOps/s $\color{#35bf28}+1.18\%$
test_func_call_runtime[False-compile] 1.0063ms 0.7981ms 1.2530 KOps/s 1.3066 KOps/s $\color{#d91a1a}-4.10\%$
test_func_call_runtime[False-compile-overhead] 0.6928ms 0.5144ms 1.9441 KOps/s 1.9311 KOps/s $\color{#35bf28}+0.67\%$
test_func_call_runtime[True-eager] 1.4529ms 1.3137ms 761.2196 Ops/s 752.0078 Ops/s $\color{#35bf28}+1.22\%$
test_func_call_runtime[True-compile] 0.8276ms 0.7764ms 1.2880 KOps/s 1.2486 KOps/s $\color{#35bf28}+3.16\%$
test_func_call_runtime[True-compile-overhead] 0.7221ms 0.5330ms 1.8763 KOps/s 1.8578 KOps/s $\color{#35bf28}+0.99\%$
test_func_call_cm_runtime[False-eager] 1.2582ms 0.7984ms 1.2525 KOps/s 1.2226 KOps/s $\color{#35bf28}+2.45\%$
test_func_call_cm_runtime[False-compile] 0.8292ms 0.7475ms 1.3378 KOps/s 1.3168 KOps/s $\color{#35bf28}+1.60\%$
test_func_call_cm_runtime[False-compile-overhead] 0.5766ms 0.4938ms 2.0251 KOps/s 1.9921 KOps/s $\color{#35bf28}+1.65\%$
test_func_call_cm_runtime[True-eager] 1.6023ms 1.4587ms 685.5269 Ops/s 672.4776 Ops/s $\color{#35bf28}+1.94\%$
test_func_call_cm_runtime[True-compile] 0.9238ms 0.8590ms 1.1641 KOps/s 1.1520 KOps/s $\color{#35bf28}+1.05\%$
test_func_call_cm_runtime[True-compile-overhead] 1.1544ms 0.8842ms 1.1310 KOps/s 1.1258 KOps/s $\color{#35bf28}+0.46\%$
test_vmap_func_call_cm_runtime[eager] 3.3431ms 2.7448ms 364.3295 Ops/s 369.1495 Ops/s $\color{#d91a1a}-1.31\%$
test_vmap_func_call_cm_runtime[compile] 4.3303ms 3.7795ms 264.5840 Ops/s 259.4240 Ops/s $\color{#35bf28}+1.99\%$
test_vmap_func_call_cm_runtime[compile-overhead] 4.3212ms 3.7820ms 264.4135 Ops/s 263.8810 Ops/s $\color{#35bf28}+0.20\%$
test_distributed 1.8701ms 0.1601ms 6.2442 KOps/s 6.4698 KOps/s $\color{#d91a1a}-3.49\%$
test_tdmodule 0.3933ms 0.1942ms 5.1498 KOps/s 5.1746 KOps/s $\color{#d91a1a}-0.48\%$
test_tdmodule_dispatch 0.4275ms 0.3765ms 2.6559 KOps/s 2.6583 KOps/s $\color{#d91a1a}-0.09\%$
test_tdseq 51.9210μs 26.7231μs 37.4207 KOps/s 38.1051 KOps/s $\color{#d91a1a}-1.80\%$
test_tdseq_dispatch 0.2522ms 0.2174ms 4.5996 KOps/s 4.5758 KOps/s $\color{#35bf28}+0.52\%$
test_instantiation_functorch 2.8316ms 2.7419ms 364.7141 Ops/s 370.2747 Ops/s $\color{#d91a1a}-1.50\%$
test_exec_functorch 0.2449ms 0.1978ms 5.0555 KOps/s 5.0847 KOps/s $\color{#d91a1a}-0.58\%$
test_exec_functional_call 0.2253ms 0.1574ms 6.3526 KOps/s 6.2021 KOps/s $\color{#35bf28}+2.43\%$
test_exec_td_decorator 0.6916ms 0.3701ms 2.7021 KOps/s 2.7154 KOps/s $\color{#d91a1a}-0.49\%$
test_vmap_mlp_speed_decorator[True-True] 1.4117ms 1.1975ms 835.0409 Ops/s 833.2323 Ops/s $\color{#35bf28}+0.22\%$
test_vmap_mlp_speed_decorator[True-False] 1.4345ms 1.1926ms 838.5266 Ops/s 835.0717 Ops/s $\color{#35bf28}+0.41\%$
test_vmap_mlp_speed_decorator[False-True] 1.0985ms 0.8968ms 1.1150 KOps/s 1.1034 KOps/s $\color{#35bf28}+1.05\%$
test_vmap_mlp_speed_decorator[False-False] 1.0833ms 0.8958ms 1.1163 KOps/s 1.1075 KOps/s $\color{#35bf28}+0.79\%$
test_vmap_transformer_speed_decorator[True-True] 29.1363ms 26.8498ms 37.2442 Ops/s 37.1876 Ops/s $\color{#35bf28}+0.15\%$
test_vmap_transformer_speed_decorator[True-False] 26.8724ms 26.6623ms 37.5061 Ops/s 37.3028 Ops/s $\color{#35bf28}+0.55\%$
test_vmap_transformer_speed_decorator[False-True] 26.4833ms 26.3735ms 37.9168 Ops/s 37.7963 Ops/s $\color{#35bf28}+0.32\%$
test_vmap_transformer_speed_decorator[False-False] 26.4301ms 26.2588ms 38.0825 Ops/s 37.8169 Ops/s $\color{#35bf28}+0.70\%$
test_to_module_speed[True] 3.5473ms 3.4214ms 292.2816 Ops/s 289.0666 Ops/s $\color{#35bf28}+1.11\%$
test_to_module_speed[False] 3.5098ms 3.3876ms 295.1969 Ops/s 290.8758 Ops/s $\color{#35bf28}+1.49\%$
test_to_module_plain_tensor_speed[None] 3.5123ms 3.4178ms 292.5867 Ops/s 291.2289 Ops/s $\color{#35bf28}+0.47\%$
test_to_module_plain_tensor_speed[False] 1.7509ms 1.5479ms 646.0547 Ops/s 638.1926 Ops/s $\color{#35bf28}+1.23\%$
test_to_module_plain_tensor_speed[True] 3.5116ms 3.4069ms 293.5214 Ops/s 292.2144 Ops/s $\color{#35bf28}+0.45\%$
test_tc_init 82.7820μs 45.2832μs 22.0832 KOps/s 21.7788 KOps/s $\color{#35bf28}+1.40\%$
test_tc_init_tensor_only 59.2610μs 9.5626μs 104.5736 KOps/s 105.5105 KOps/s $\color{#d91a1a}-0.89\%$
test_tc_init_nested 0.1285ms 89.6407μs 11.1556 KOps/s 11.1261 KOps/s $\color{#35bf28}+0.27\%$
test_tc_init_many_fields 51.7410μs 17.6198μs 56.7542 KOps/s 57.5228 KOps/s $\color{#d91a1a}-1.34\%$
test_tc_first_layer_tensor 37.5600μs 1.8104μs 552.3612 KOps/s 563.0929 KOps/s $\color{#d91a1a}-1.91\%$
test_tc_first_layer_tensor_only 2.1625μs 0.4023μs 2.4860 MOps/s 2.5499 MOps/s $\color{#d91a1a}-2.51\%$
test_tc_first_layer_tensor_set 25.3110μs 4.2560μs 234.9606 KOps/s 240.8594 KOps/s $\color{#d91a1a}-2.45\%$
test_tc_first_layer_tensor_only_set 33.3710μs 3.7070μs 269.7605 KOps/s 273.2789 KOps/s $\color{#d91a1a}-1.29\%$
test_tc_first_layer_nontensor 45.5210μs 6.1713μs 162.0394 KOps/s 168.1112 KOps/s $\color{#d91a1a}-3.61\%$
test_tc_second_layer_tensor 44.5510μs 4.3824μs 228.1850 KOps/s 231.6365 KOps/s $\color{#d91a1a}-1.49\%$
test_tc_second_layer_nontensor 42.3000μs 8.7013μs 114.9249 KOps/s 118.4121 KOps/s $\color{#d91a1a}-2.94\%$
test_unbind 0.2976s 14.1025ms 70.9096 Ops/s 63.6246 Ops/s $\textbf{\color{#35bf28}+11.45\%}$
test_full_like 4.9802ms 4.7259ms 211.5986 Ops/s 213.5010 Ops/s $\color{#d91a1a}-0.89\%$
test_zeros_like 4.7678ms 4.5844ms 218.1327 Ops/s 215.2452 Ops/s $\color{#35bf28}+1.34\%$
test_ones_like 4.8418ms 4.6308ms 215.9451 Ops/s 214.9585 Ops/s $\color{#35bf28}+0.46\%$
test_clone 7.3971ms 6.9405ms 144.0821 Ops/s 143.5546 Ops/s $\color{#35bf28}+0.37\%$
test_squeeze 0.1945ms 15.6560μs 63.8731 KOps/s 70.2609 KOps/s $\textbf{\color{#d91a1a}-9.09\%}$
test_unsqueeze 0.3398ms 0.1178ms 8.4880 KOps/s 8.7878 KOps/s $\color{#d91a1a}-3.41\%$
test_split 0.2590ms 0.1950ms 5.1279 KOps/s 5.2162 KOps/s $\color{#d91a1a}-1.69\%$
test_permute 0.2823ms 0.1974ms 5.0670 KOps/s 5.1469 KOps/s $\color{#d91a1a}-1.55\%$
test_stack 36.8409ms 36.2328ms 27.5993 Ops/s 51.0904 Ops/s $\textbf{\color{#d91a1a}-45.98\%}$
test_cat 28.5161ms 28.0341ms 35.6709 Ops/s 51.2285 Ops/s $\textbf{\color{#d91a1a}-30.37\%}$
test_sequential_tensordict 0.9729ms 0.8805ms 1.1357 KOps/s 1.1395 KOps/s $\color{#d91a1a}-0.33\%$
test_sequential_graph_module 0.5607ms 0.4556ms 2.1948 KOps/s 2.3432 KOps/s $\textbf{\color{#d91a1a}-6.33\%}$
test_nested_tensordict 1.4006ms 1.3248ms 754.8382 Ops/s 771.9986 Ops/s $\color{#d91a1a}-2.22\%$
test_nested_graph_module 0.6507ms 0.6033ms 1.6577 KOps/s 1.7064 KOps/s $\color{#d91a1a}-2.86\%$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Benchmarks CI CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Compile torch.compile related documentation Improvements or additions to documentation Feature New feature Test

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant