[BugFix,Test] Fix envpool failing tests

[vmoens]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3345

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 164. Improved: $\large\color{#35bf28}27$. Worsened: $\large\color{#d91a1a}8$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_tensor_to_bytestream_speed[pickle]	81.1979μs	79.9947μs	12.5008 KOps/s	11.9307 KOps/s	$\color{#35bf28}+4.78\%$
test_tensor_to_bytestream_speed[torch.save]	0.1375ms	0.1369ms	7.3033 KOps/s	7.0987 KOps/s	$\color{#35bf28}+2.88\%$
test_tensor_to_bytestream_speed[untyped_storage]	0.1087s	0.1082s	9.2428 Ops/s	9.1340 Ops/s	$\color{#35bf28}+1.19\%$
test_tensor_to_bytestream_speed[numpy]	2.6854μs	2.6833μs	372.6714 KOps/s	378.2593 KOps/s	$\color{#d91a1a}-1.48\%$
test_tensor_to_bytestream_speed[safetensors]	37.4061μs	37.2049μs	26.8781 KOps/s	24.6579 KOps/s	$\textbf{\color{#35bf28}+9.00\%}$
test_simple	0.5293s	0.5284s	1.8926 Ops/s	1.7873 Ops/s	$\textbf{\color{#35bf28}+5.89\%}$
test_transformed	1.0832s	1.0820s	0.9242 Ops/s	0.8885 Ops/s	$\color{#35bf28}+4.02\%$
test_serial	1.5998s	1.5995s	0.6252 Ops/s	0.6062 Ops/s	$\color{#35bf28}+3.13\%$
test_parallel	1.1817s	1.0953s	0.9130 Ops/s	0.9071 Ops/s	$\color{#35bf28}+0.64\%$
test_step_mdp_speed[True-True-True-True-True]	0.1543ms	43.3084μs	23.0902 KOps/s	23.6504 KOps/s	$\color{#d91a1a}-2.37\%$
test_step_mdp_speed[True-True-True-True-False]	67.7410μs	24.4313μs	40.9312 KOps/s	40.9835 KOps/s	$\color{#d91a1a}-0.13\%$
test_step_mdp_speed[True-True-True-False-True]	50.1710μs	24.1197μs	41.4599 KOps/s	40.3772 KOps/s	$\color{#35bf28}+2.68\%$
test_step_mdp_speed[True-True-True-False-False]	45.6510μs	13.4796μs	74.1861 KOps/s	74.7536 KOps/s	$\color{#d91a1a}-0.76\%$
test_step_mdp_speed[True-True-False-True-True]	78.1010μs	46.2713μs	21.6117 KOps/s	21.5397 KOps/s	$\color{#35bf28}+0.33\%$
test_step_mdp_speed[True-True-False-True-False]	58.2710μs	27.0524μs	36.9653 KOps/s	36.1114 KOps/s	$\color{#35bf28}+2.36\%$
test_step_mdp_speed[True-True-False-False-True]	49.9810μs	26.8834μs	37.1977 KOps/s	36.6547 KOps/s	$\color{#35bf28}+1.48\%$
test_step_mdp_speed[True-True-False-False-False]	49.5410μs	16.1778μs	61.8133 KOps/s	60.8916 KOps/s	$\color{#35bf28}+1.51\%$
test_step_mdp_speed[True-False-True-True-True]	84.8100μs	49.6682μs	20.1336 KOps/s	19.9123 KOps/s	$\color{#35bf28}+1.11\%$
test_step_mdp_speed[True-False-True-True-False]	57.1210μs	29.9548μs	33.3836 KOps/s	32.3560 KOps/s	$\color{#35bf28}+3.18\%$
test_step_mdp_speed[True-False-True-False-True]	56.5210μs	27.0298μs	36.9962 KOps/s	37.2387 KOps/s	$\color{#d91a1a}-0.65\%$
test_step_mdp_speed[True-False-True-False-False]	68.4410μs	16.1271μs	62.0074 KOps/s	62.0194 KOps/s	$\color{#d91a1a}-0.02\%$
test_step_mdp_speed[True-False-False-True-True]	0.1250ms	51.7775μs	19.3134 KOps/s	19.7619 KOps/s	$\color{#d91a1a}-2.27\%$
test_step_mdp_speed[True-False-False-True-False]	68.9300μs	32.3502μs	30.9117 KOps/s	30.2005 KOps/s	$\color{#35bf28}+2.35\%$
test_step_mdp_speed[True-False-False-False-True]	63.7900μs	29.6420μs	33.7359 KOps/s	33.6296 KOps/s	$\color{#35bf28}+0.32\%$
test_step_mdp_speed[True-False-False-False-False]	41.0200μs	18.8916μs	52.9334 KOps/s	52.8197 KOps/s	$\color{#35bf28}+0.22\%$
test_step_mdp_speed[False-True-True-True-True]	86.3310μs	49.2578μs	20.3014 KOps/s	20.2442 KOps/s	$\color{#35bf28}+0.28\%$
test_step_mdp_speed[False-True-True-True-False]	63.7300μs	30.0837μs	33.2406 KOps/s	33.2017 KOps/s	$\color{#35bf28}+0.12\%$
test_step_mdp_speed[False-True-True-False-True]	2.3232ms	31.5237μs	31.7222 KOps/s	32.4042 KOps/s	$\color{#d91a1a}-2.10\%$
test_step_mdp_speed[False-True-True-False-False]	42.4800μs	17.9729μs	55.6394 KOps/s	55.0558 KOps/s	$\color{#35bf28}+1.06\%$
test_step_mdp_speed[False-True-False-True-True]	0.1123ms	52.4626μs	19.0612 KOps/s	19.6683 KOps/s	$\color{#d91a1a}-3.09\%$
test_step_mdp_speed[False-True-False-True-False]	68.5210μs	32.8322μs	30.4579 KOps/s	30.3565 KOps/s	$\color{#35bf28}+0.33\%$
test_step_mdp_speed[False-True-False-False-True]	66.9310μs	33.6425μs	29.7243 KOps/s	29.6994 KOps/s	$\color{#35bf28}+0.08\%$
test_step_mdp_speed[False-True-False-False-False]	46.7710μs	20.5363μs	48.6943 KOps/s	47.9528 KOps/s	$\color{#35bf28}+1.55\%$
test_step_mdp_speed[False-False-True-True-True]	91.0910μs	54.6258μs	18.3064 KOps/s	18.4974 KOps/s	$\color{#d91a1a}-1.03\%$
test_step_mdp_speed[False-False-True-True-False]	67.0710μs	35.6609μs	28.0419 KOps/s	28.0446 KOps/s	$-0.01\%$
test_step_mdp_speed[False-False-True-False-True]	67.4700μs	32.9584μs	30.3413 KOps/s	30.3117 KOps/s	$\color{#35bf28}+0.10\%$
test_step_mdp_speed[False-False-True-False-False]	63.2110μs	20.5510μs	48.6593 KOps/s	48.6686 KOps/s	$\color{#d91a1a}-0.02\%$
test_step_mdp_speed[False-False-False-True-True]	90.9710μs	56.5930μs	17.6700 KOps/s	17.6312 KOps/s	$\color{#35bf28}+0.22\%$
test_step_mdp_speed[False-False-False-True-False]	67.9910μs	38.0833μs	26.2582 KOps/s	26.4419 KOps/s	$\color{#d91a1a}-0.69\%$
test_step_mdp_speed[False-False-False-False-True]	66.0210μs	34.7256μs	28.7972 KOps/s	28.2894 KOps/s	$\color{#35bf28}+1.80\%$
test_step_mdp_speed[False-False-False-False-False]	54.9010μs	23.2668μs	42.9796 KOps/s	44.6592 KOps/s	$\color{#d91a1a}-3.76\%$
test_non_tensor_env_rollout_speed[1000-single-True]	0.8440s	0.7418s	1.3481 Ops/s	1.3146 Ops/s	$\color{#35bf28}+2.54\%$
test_non_tensor_env_rollout_speed[1000-single-False]	0.7104s	0.6108s	1.6371 Ops/s	1.6143 Ops/s	$\color{#35bf28}+1.41\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-True]	1.7101s	1.6294s	0.6137 Ops/s	0.6092 Ops/s	$\color{#35bf28}+0.75\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-False]	1.5332s	1.4318s	0.6984 Ops/s	0.7026 Ops/s	$\color{#d91a1a}-0.60\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-True]	1.9522s	1.9014s	0.5259 Ops/s	0.5333 Ops/s	$\color{#d91a1a}-1.38\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-False]	1.7370s	1.6559s	0.6039 Ops/s	0.6036 Ops/s	$\color{#35bf28}+0.05\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-True]	4.7248s	4.5691s	0.2189 Ops/s	0.2154 Ops/s	$\color{#35bf28}+1.61\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-False]	4.4318s	4.3696s	0.2289 Ops/s	0.2244 Ops/s	$\color{#35bf28}+2.00\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-True]	2.1244s	1.9797s	0.5051 Ops/s	0.5137 Ops/s	$\color{#d91a1a}-1.67\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-False]	1.7834s	1.6601s	0.6024 Ops/s	0.6077 Ops/s	$\color{#d91a1a}-0.87\%$
test_values[generalized_advantage_estimate-True-True]	9.7469ms	9.5351ms	104.8752 Ops/s	101.6277 Ops/s	$\color{#35bf28}+3.20\%$
test_values[vec_generalized_advantage_estimate-True-True]	19.4994ms	17.8902ms	55.8964 Ops/s	87.7286 Ops/s	$\textbf{\color{#d91a1a}-36.28\%}$
test_values[td0_return_estimate-False-False]	0.2122ms	0.1230ms	8.1271 KOps/s	7.8577 KOps/s	$\color{#35bf28}+3.43\%$
test_values[td1_return_estimate-False-False]	25.6327ms	25.3015ms	39.5233 Ops/s	38.2516 Ops/s	$\color{#35bf28}+3.32\%$
test_values[vec_td1_return_estimate-False-False]	18.4703ms	18.0335ms	55.4524 Ops/s	87.7754 Ops/s	$\textbf{\color{#d91a1a}-36.82\%}$
test_values[td_lambda_return_estimate-True-False]	38.3847ms	37.6888ms	26.5331 Ops/s	26.3363 Ops/s	$\color{#35bf28}+0.75\%$
test_values[vec_td_lambda_return_estimate-True-False]	18.5297ms	17.9902ms	55.5857 Ops/s	88.1958 Ops/s	$\textbf{\color{#d91a1a}-36.97\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512]	8.4291ms	8.3832ms	119.2857 Ops/s	119.8406 Ops/s	$\color{#d91a1a}-0.46\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	1.6732ms	1.4417ms	693.6245 Ops/s	650.3766 Ops/s	$\textbf{\color{#35bf28}+6.65\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.4544ms	0.3990ms	2.5060 KOps/s	2.4704 KOps/s	$\color{#35bf28}+1.44\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	34.8823ms	34.2982ms	29.1561 Ops/s	43.1705 Ops/s	$\textbf{\color{#d91a1a}-32.46\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	1.7847ms	1.7196ms	581.5153 Ops/s	583.8137 Ops/s	$\color{#d91a1a}-0.39\%$
test_dqn_speed[False-None]	1.4535ms	1.3598ms	735.3874 Ops/s	727.7259 Ops/s	$\color{#35bf28}+1.05\%$
test_dqn_speed[False-backward]	1.9782ms	1.8651ms	536.1624 Ops/s	540.2322 Ops/s	$\color{#d91a1a}-0.75\%$
test_dqn_speed[True-None]	0.6668ms	0.5259ms	1.9014 KOps/s	1.8727 KOps/s	$\color{#35bf28}+1.53\%$
test_dqn_speed[True-backward]	1.0134ms	0.9654ms	1.0358 KOps/s	1.0161 KOps/s	$\color{#35bf28}+1.94\%$
test_dqn_speed[reduce-overhead-None]	0.6570ms	0.5112ms	1.9563 KOps/s	1.8756 KOps/s	$\color{#35bf28}+4.30\%$
test_dqn_speed[reduce-overhead-backward]	0.9936ms	0.9491ms	1.0536 KOps/s	934.1656 Ops/s	$\textbf{\color{#35bf28}+12.78\%}$
test_ddpg_speed[False-None]	3.0838ms	2.7652ms	361.6337 Ops/s	357.4799 Ops/s	$\color{#35bf28}+1.16\%$
test_ddpg_speed[False-backward]	4.0402ms	3.9386ms	253.8969 Ops/s	251.7303 Ops/s	$\color{#35bf28}+0.86\%$
test_ddpg_speed[True-None]	1.8568ms	1.3548ms	738.1108 Ops/s	718.1096 Ops/s	$\color{#35bf28}+2.79\%$
test_ddpg_speed[True-backward]	2.3465ms	2.3056ms	433.7297 Ops/s	398.7381 Ops/s	$\textbf{\color{#35bf28}+8.78\%}$
test_ddpg_speed[reduce-overhead-None]	1.8493ms	1.3411ms	745.6410 Ops/s	726.1535 Ops/s	$\color{#35bf28}+2.68\%$
test_ddpg_speed[reduce-overhead-backward]	2.3833ms	2.3039ms	434.0417 Ops/s	390.7319 Ops/s	$\textbf{\color{#35bf28}+11.08\%}$
test_sac_speed[False-None]	8.4426ms	7.7716ms	128.6742 Ops/s	128.2526 Ops/s	$\color{#35bf28}+0.33\%$
test_sac_speed[False-backward]	11.8919ms	10.9457ms	91.3603 Ops/s	91.6349 Ops/s	$\color{#d91a1a}-0.30\%$
test_sac_speed[True-None]	2.2111ms	2.0799ms	480.8015 Ops/s	473.5087 Ops/s	$\color{#35bf28}+1.54\%$
test_sac_speed[True-backward]	4.0758ms	3.9529ms	252.9785 Ops/s	250.1816 Ops/s	$\color{#35bf28}+1.12\%$
test_sac_speed[reduce-overhead-None]	2.2202ms	2.0743ms	482.0891 Ops/s	476.2688 Ops/s	$\color{#35bf28}+1.22\%$
test_sac_speed[reduce-overhead-backward]	4.0703ms	3.9105ms	255.7248 Ops/s	218.0488 Ops/s	$\textbf{\color{#35bf28}+17.28\%}$
test_redq_speed[False-None]	14.6228ms	10.2099ms	97.9445 Ops/s	99.3321 Ops/s	$\color{#d91a1a}-1.40\%$
test_redq_speed[False-backward]	18.4856ms	17.6385ms	56.6943 Ops/s	59.7169 Ops/s	$\textbf{\color{#d91a1a}-5.06\%}$
test_redq_speed[True-None]	4.6616ms	4.3227ms	231.3361 Ops/s	219.5809 Ops/s	$\textbf{\color{#35bf28}+5.35\%}$
test_redq_speed[True-backward]	9.9712ms	9.7081ms	103.0072 Ops/s	108.9977 Ops/s	$\textbf{\color{#d91a1a}-5.50\%}$
test_redq_speed[reduce-overhead-None]	4.8304ms	4.3481ms	229.9847 Ops/s	226.1361 Ops/s	$\color{#35bf28}+1.70\%$
test_redq_speed[reduce-overhead-backward]	10.1561ms	9.7781ms	102.2697 Ops/s	105.0405 Ops/s	$\color{#d91a1a}-2.64\%$
test_redq_deprec_speed[False-None]	11.2150ms	10.7878ms	92.6969 Ops/s	95.0837 Ops/s	$\color{#d91a1a}-2.51\%$
test_redq_deprec_speed[False-backward]	16.4228ms	15.5893ms	64.1464 Ops/s	66.9525 Ops/s	$\color{#d91a1a}-4.19\%$
test_redq_deprec_speed[True-None]	4.0152ms	3.5659ms	280.4302 Ops/s	276.8525 Ops/s	$\color{#35bf28}+1.29\%$
test_redq_deprec_speed[True-backward]	7.6335ms	7.4241ms	134.6959 Ops/s	126.7927 Ops/s	$\textbf{\color{#35bf28}+6.23\%}$
test_redq_deprec_speed[reduce-overhead-None]	4.0353ms	3.5557ms	281.2359 Ops/s	278.0214 Ops/s	$\color{#35bf28}+1.16\%$
test_redq_deprec_speed[reduce-overhead-backward]	7.9273ms	7.4467ms	134.2874 Ops/s	132.3083 Ops/s	$\color{#35bf28}+1.50\%$
test_td3_speed[False-None]	8.1415ms	7.8647ms	127.1505 Ops/s	127.2886 Ops/s	$\color{#d91a1a}-0.11\%$
test_td3_speed[False-backward]	11.0450ms	10.6253ms	94.1148 Ops/s	94.3818 Ops/s	$\color{#d91a1a}-0.28\%$
test_td3_speed[True-None]	1.8418ms	1.7782ms	562.3615 Ops/s	555.7712 Ops/s	$\color{#35bf28}+1.19\%$
test_td3_speed[True-backward]	3.7721ms	3.6045ms	277.4321 Ops/s	278.7068 Ops/s	$\color{#d91a1a}-0.46\%$
test_td3_speed[reduce-overhead-None]	1.9496ms	1.7654ms	566.4577 Ops/s	564.4073 Ops/s	$\color{#35bf28}+0.36\%$
test_td3_speed[reduce-overhead-backward]	3.7147ms	3.6094ms	277.0557 Ops/s	251.4274 Ops/s	$\textbf{\color{#35bf28}+10.19\%}$
test_cql_speed[False-None]	30.0896ms	25.8001ms	38.7596 Ops/s	39.8738 Ops/s	$\color{#d91a1a}-2.79\%$
test_cql_speed[False-backward]	37.5312ms	34.6192ms	28.8857 Ops/s	28.3972 Ops/s	$\color{#35bf28}+1.72\%$
test_cql_speed[True-None]	12.6729ms	12.2441ms	81.6717 Ops/s	81.4000 Ops/s	$\color{#35bf28}+0.33\%$
test_cql_speed[True-backward]	18.8829ms	18.2051ms	54.9298 Ops/s	57.5753 Ops/s	$\color{#d91a1a}-4.59\%$
test_cql_speed[reduce-overhead-None]	15.7732ms	12.5063ms	79.9599 Ops/s	82.2698 Ops/s	$\color{#d91a1a}-2.81\%$
test_cql_speed[reduce-overhead-backward]	18.4618ms	18.0513ms	55.3977 Ops/s	56.8762 Ops/s	$\color{#d91a1a}-2.60\%$
test_a2c_speed[False-None]	5.6369ms	5.3069ms	188.4335 Ops/s	190.6948 Ops/s	$\color{#d91a1a}-1.19\%$
test_a2c_speed[False-backward]	12.0494ms	11.6591ms	85.7699 Ops/s	86.5401 Ops/s	$\color{#d91a1a}-0.89\%$
test_a2c_speed[True-None]	3.9308ms	3.6883ms	271.1275 Ops/s	269.6862 Ops/s	$\color{#35bf28}+0.53\%$
test_a2c_speed[True-backward]	8.7628ms	8.4137ms	118.8531 Ops/s	113.5019 Ops/s	$\color{#35bf28}+4.71\%$
test_a2c_speed[reduce-overhead-None]	3.8197ms	3.6518ms	273.8389 Ops/s	270.2982 Ops/s	$\color{#35bf28}+1.31\%$
test_a2c_speed[reduce-overhead-backward]	8.7877ms	8.6156ms	116.0682 Ops/s	107.6299 Ops/s	$\textbf{\color{#35bf28}+7.84\%}$
test_ppo_speed[False-None]	5.9152ms	5.7603ms	173.6031 Ops/s	172.9757 Ops/s	$\color{#35bf28}+0.36\%$
test_ppo_speed[False-backward]	12.7400ms	12.1548ms	82.2723 Ops/s	81.6274 Ops/s	$\color{#35bf28}+0.79\%$
test_ppo_speed[True-None]	4.0112ms	3.5636ms	280.6153 Ops/s	271.1524 Ops/s	$\color{#35bf28}+3.49\%$
test_ppo_speed[True-backward]	8.5817ms	8.2727ms	120.8798 Ops/s	117.0468 Ops/s	$\color{#35bf28}+3.27\%$
test_ppo_speed[reduce-overhead-None]	3.7650ms	3.5233ms	283.8274 Ops/s	279.2519 Ops/s	$\color{#35bf28}+1.64\%$
test_ppo_speed[reduce-overhead-backward]	8.7789ms	8.5669ms	116.7282 Ops/s	115.2041 Ops/s	$\color{#35bf28}+1.32\%$
test_reinforce_speed[False-None]	6.1841ms	4.4897ms	222.7323 Ops/s	221.1820 Ops/s	$\color{#35bf28}+0.70\%$
test_reinforce_speed[False-backward]	7.5719ms	7.2507ms	137.9168 Ops/s	136.0091 Ops/s	$\color{#35bf28}+1.40\%$
test_reinforce_speed[True-None]	3.2332ms	2.8314ms	353.1766 Ops/s	347.0356 Ops/s	$\color{#35bf28}+1.77\%$
test_reinforce_speed[True-backward]	7.7843ms	7.6188ms	131.2540 Ops/s	120.7996 Ops/s	$\textbf{\color{#35bf28}+8.65\%}$
test_reinforce_speed[reduce-overhead-None]	3.0807ms	2.8024ms	356.8317 Ops/s	352.6457 Ops/s	$\color{#35bf28}+1.19\%$
test_reinforce_speed[reduce-overhead-backward]	8.0133ms	7.7552ms	128.9460 Ops/s	120.0440 Ops/s	$\textbf{\color{#35bf28}+7.42\%}$
test_iql_speed[False-None]	24.5641ms	19.6724ms	50.8327 Ops/s	50.6435 Ops/s	$\color{#35bf28}+0.37\%$
test_iql_speed[False-backward]	30.5693ms	29.8808ms	33.4663 Ops/s	33.6108 Ops/s	$\color{#d91a1a}-0.43\%$
test_iql_speed[True-None]	8.8504ms	8.4242ms	118.7060 Ops/s	117.4490 Ops/s	$\color{#35bf28}+1.07\%$
test_iql_speed[True-backward]	17.0543ms	16.6288ms	60.1366 Ops/s	60.2930 Ops/s	$\color{#d91a1a}-0.26\%$
test_iql_speed[reduce-overhead-None]	8.8221ms	8.4768ms	117.9684 Ops/s	113.2213 Ops/s	$\color{#35bf28}+4.19\%$
test_iql_speed[reduce-overhead-backward]	17.2172ms	16.9756ms	58.9080 Ops/s	59.5524 Ops/s	$\color{#d91a1a}-1.08\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	8.1328ms	5.9754ms	167.3528 Ops/s	168.3146 Ops/s	$\color{#d91a1a}-0.57\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.5401ms	0.3540ms	2.8248 KOps/s	2.7112 KOps/s	$\color{#35bf28}+4.19\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.5921ms	0.3441ms	2.9065 KOps/s	2.8562 KOps/s	$\color{#35bf28}+1.76\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	6.0091ms	5.6362ms	177.4249 Ops/s	176.6373 Ops/s	$\color{#35bf28}+0.45\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.6338ms	0.2779ms	3.5990 KOps/s	2.8683 KOps/s	$\textbf{\color{#35bf28}+25.47\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.4837ms	0.2562ms	3.9034 KOps/s	2.8874 KOps/s	$\textbf{\color{#35bf28}+35.19\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	1.6231ms	1.2093ms	826.9070 Ops/s	723.4866 Ops/s	$\textbf{\color{#35bf28}+14.29\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	1.6090ms	1.1313ms	883.9536 Ops/s	771.9254 Ops/s	$\textbf{\color{#35bf28}+14.51\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	6.1968ms	5.7643ms	173.4802 Ops/s	173.9626 Ops/s	$\color{#d91a1a}-0.28\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.7278ms	0.4589ms	2.1790 KOps/s	2.0666 KOps/s	$\textbf{\color{#35bf28}+5.44\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.8647ms	0.4330ms	2.3094 KOps/s	2.3972 KOps/s	$\color{#d91a1a}-3.66\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	5.8280ms	5.6551ms	176.8314 Ops/s	179.5657 Ops/s	$\color{#d91a1a}-1.52\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.9314ms	0.2758ms	3.6252 KOps/s	3.0269 KOps/s	$\textbf{\color{#35bf28}+19.76\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.5780ms	0.3038ms	3.2919 KOps/s	2.9963 KOps/s	$\textbf{\color{#35bf28}+9.87\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	5.9445ms	5.6001ms	178.5672 Ops/s	181.3110 Ops/s	$\color{#d91a1a}-1.51\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.8954ms	0.2993ms	3.3412 KOps/s	492.9670 Ops/s	$\textbf{\color{#35bf28}+577.78\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.4574ms	0.2726ms	3.6680 KOps/s	2.9043 KOps/s	$\textbf{\color{#35bf28}+26.30\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	6.0268ms	5.7632ms	173.5150 Ops/s	170.8781 Ops/s	$\color{#35bf28}+1.54\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.8959ms	0.4448ms	2.2484 KOps/s	2.1328 KOps/s	$\textbf{\color{#35bf28}+5.42\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.6965ms	0.4753ms	2.1039 KOps/s	2.0565 KOps/s	$\color{#35bf28}+2.30\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	6.2852ms	4.9414ms	202.3710 Ops/s	200.0832 Ops/s	$\color{#35bf28}+1.14\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	4.1720ms	2.0341ms	491.6256 Ops/s	577.4445 Ops/s	$\textbf{\color{#d91a1a}-14.86\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	1.0157ms	0.8415ms	1.1884 KOps/s	1.0894 KOps/s	$\textbf{\color{#35bf28}+9.09\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	0.6716s	18.3385ms	54.5300 Ops/s	199.9668 Ops/s	$\textbf{\color{#d91a1a}-72.73\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	3.7213ms	1.7258ms	579.4487 Ops/s	512.8074 Ops/s	$\textbf{\color{#35bf28}+13.00\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	0.9791ms	0.8763ms	1.1411 KOps/s	865.6273 Ops/s	$\textbf{\color{#35bf28}+31.82\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	9.4806ms	5.1222ms	195.2285 Ops/s	53.2833 Ops/s	$\textbf{\color{#35bf28}+266.40\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	8.6667ms	1.9706ms	507.4563 Ops/s	530.6195 Ops/s	$\color{#d91a1a}-4.37\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	3.0615ms	1.0232ms	977.2864 Ops/s	942.9193 Ops/s	$\color{#35bf28}+3.64\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True]	37.1544ms	33.4546ms	29.8913 Ops/s	29.8237 Ops/s	$\color{#35bf28}+0.23\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False]	18.9664ms	17.1983ms	58.1453 Ops/s	58.1584 Ops/s	$\color{#d91a1a}-0.02\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True]	38.6884ms	34.6407ms	28.8678 Ops/s	28.7650 Ops/s	$\color{#35bf28}+0.36\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False]	19.5369ms	17.4817ms	57.2025 Ops/s	56.5764 Ops/s	$\color{#35bf28}+1.11\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True]	38.3932ms	36.5441ms	27.3642 Ops/s	27.1975 Ops/s	$\color{#35bf28}+0.61\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False]	20.5968ms	19.1484ms	52.2238 Ops/s	52.4063 Ops/s	$\color{#d91a1a}-0.35\%$