[BugFix,Test] recompiles with string failure

[vmoens]

No description provided.

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3338

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 164. Improved: $\large\color{#35bf28}23$. Worsened: $\large\color{#d91a1a}7$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_tensor_to_bytestream_speed[pickle]	82.2686μs	81.3764μs	12.2886 KOps/s	11.8325 KOps/s	$\color{#35bf28}+3.85\%$
test_tensor_to_bytestream_speed[torch.save]	0.1407ms	0.1395ms	7.1664 KOps/s	6.9825 KOps/s	$\color{#35bf28}+2.63\%$
test_tensor_to_bytestream_speed[untyped_storage]	0.1260s	0.1258s	7.9494 Ops/s	7.4200 Ops/s	$\textbf{\color{#35bf28}+7.13\%}$
test_tensor_to_bytestream_speed[numpy]	2.7917μs	2.7850μs	359.0688 KOps/s	361.2138 KOps/s	$\color{#d91a1a}-0.59\%$
test_tensor_to_bytestream_speed[safetensors]	38.0812μs	37.6038μs	26.5930 KOps/s	25.9400 KOps/s	$\color{#35bf28}+2.52\%$
test_simple	0.5524s	0.5463s	1.8306 Ops/s	1.7262 Ops/s	$\textbf{\color{#35bf28}+6.05\%}$
test_transformed	1.1194s	1.1159s	0.8961 Ops/s	0.8636 Ops/s	$\color{#35bf28}+3.76\%$
test_serial	1.6675s	1.6633s	0.6012 Ops/s	0.5846 Ops/s	$\color{#35bf28}+2.84\%$
test_parallel	1.1277s	1.1009s	0.9083 Ops/s	0.8506 Ops/s	$\textbf{\color{#35bf28}+6.79\%}$
test_step_mdp_speed[True-True-True-True-True]	0.3320ms	45.4237μs	22.0149 KOps/s	21.9918 KOps/s	$\color{#35bf28}+0.11\%$
test_step_mdp_speed[True-True-True-True-False]	58.0010μs	25.0403μs	39.9356 KOps/s	39.6108 KOps/s	$\color{#35bf28}+0.82\%$
test_step_mdp_speed[True-True-True-False-True]	57.2300μs	25.4684μs	39.2643 KOps/s	39.6379 KOps/s	$\color{#d91a1a}-0.94\%$
test_step_mdp_speed[True-True-True-False-False]	72.6110μs	13.8045μs	72.4399 KOps/s	71.9272 KOps/s	$\color{#35bf28}+0.71\%$
test_step_mdp_speed[True-True-False-True-True]	0.1659ms	46.8726μs	21.3344 KOps/s	20.8438 KOps/s	$\color{#35bf28}+2.35\%$
test_step_mdp_speed[True-True-False-True-False]	0.4458ms	27.4202μs	36.4694 KOps/s	35.4217 KOps/s	$\color{#35bf28}+2.96\%$
test_step_mdp_speed[True-True-False-False-True]	0.4489ms	27.3738μs	36.5312 KOps/s	35.4253 KOps/s	$\color{#35bf28}+3.12\%$
test_step_mdp_speed[True-True-False-False-False]	64.6610μs	16.4590μs	60.7570 KOps/s	59.5940 KOps/s	$\color{#35bf28}+1.95\%$
test_step_mdp_speed[True-False-True-True-True]	0.4716ms	51.8004μs	19.3049 KOps/s	19.4976 KOps/s	$\color{#d91a1a}-0.99\%$
test_step_mdp_speed[True-False-True-True-False]	61.6210μs	30.9249μs	32.3364 KOps/s	32.6046 KOps/s	$\color{#d91a1a}-0.82\%$
test_step_mdp_speed[True-False-True-False-True]	0.4447ms	27.9459μs	35.7834 KOps/s	35.7672 KOps/s	$\color{#35bf28}+0.05\%$
test_step_mdp_speed[True-False-True-False-False]	44.3400μs	16.5923μs	60.2691 KOps/s	59.8606 KOps/s	$\color{#35bf28}+0.68\%$
test_step_mdp_speed[True-False-False-True-True]	0.4727ms	53.4891μs	18.6954 KOps/s	18.7287 KOps/s	$\color{#d91a1a}-0.18\%$
test_step_mdp_speed[True-False-False-True-False]	0.4438ms	33.4851μs	29.8640 KOps/s	29.8280 KOps/s	$\color{#35bf28}+0.12\%$
test_step_mdp_speed[True-False-False-False-True]	0.4413ms	30.9743μs	32.2848 KOps/s	32.7967 KOps/s	$\color{#d91a1a}-1.56\%$
test_step_mdp_speed[True-False-False-False-False]	50.1310μs	19.5551μs	51.1375 KOps/s	51.6462 KOps/s	$\color{#d91a1a}-0.98\%$
test_step_mdp_speed[False-True-True-True-True]	0.4735ms	50.4676μs	19.8147 KOps/s	19.7774 KOps/s	$\color{#35bf28}+0.19\%$
test_step_mdp_speed[False-True-True-True-False]	0.4456ms	30.4454μs	32.8456 KOps/s	32.8435 KOps/s	$+0.01\%$
test_step_mdp_speed[False-True-True-False-True]	2.3980ms	32.0876μs	31.1647 KOps/s	31.3410 KOps/s	$\color{#d91a1a}-0.56\%$
test_step_mdp_speed[False-True-True-False-False]	64.4010μs	18.2968μs	54.6545 KOps/s	54.5257 KOps/s	$\color{#35bf28}+0.24\%$
test_step_mdp_speed[False-True-False-True-True]	92.2910μs	53.3124μs	18.7574 KOps/s	18.6757 KOps/s	$\color{#35bf28}+0.44\%$
test_step_mdp_speed[False-True-False-True-False]	0.4609ms	33.2134μs	30.1083 KOps/s	29.9056 KOps/s	$\color{#35bf28}+0.68\%$
test_step_mdp_speed[False-True-False-False-True]	66.8510μs	34.1508μs	29.2819 KOps/s	29.4537 KOps/s	$\color{#d91a1a}-0.58\%$
test_step_mdp_speed[False-True-False-False-False]	44.2100μs	21.1954μs	47.1800 KOps/s	47.6293 KOps/s	$\color{#d91a1a}-0.94\%$
test_step_mdp_speed[False-False-True-True-True]	0.4756ms	56.7878μs	17.6094 KOps/s	17.5800 KOps/s	$\color{#35bf28}+0.17\%$
test_step_mdp_speed[False-False-True-True-False]	0.4526ms	36.2890μs	27.5565 KOps/s	27.6533 KOps/s	$\color{#d91a1a}-0.35\%$
test_step_mdp_speed[False-False-True-False-True]	0.4559ms	34.5264μs	28.9633 KOps/s	28.9313 KOps/s	$\color{#35bf28}+0.11\%$
test_step_mdp_speed[False-False-True-False-False]	51.9510μs	21.0163μs	47.5821 KOps/s	48.2838 KOps/s	$\color{#d91a1a}-1.45\%$
test_step_mdp_speed[False-False-False-True-True]	0.4721ms	58.3084μs	17.1502 KOps/s	17.1225 KOps/s	$\color{#35bf28}+0.16\%$
test_step_mdp_speed[False-False-False-True-False]	0.4772ms	39.1804μs	25.5230 KOps/s	25.7256 KOps/s	$\color{#d91a1a}-0.79\%$
test_step_mdp_speed[False-False-False-False-True]	0.4544ms	36.0368μs	27.7494 KOps/s	27.5971 KOps/s	$\color{#35bf28}+0.55\%$
test_step_mdp_speed[False-False-False-False-False]	55.0810μs	23.4899μs	42.5715 KOps/s	42.9225 KOps/s	$\color{#d91a1a}-0.82\%$
test_non_tensor_env_rollout_speed[1000-single-True]	0.8683s	0.7690s	1.3005 Ops/s	1.2894 Ops/s	$\color{#35bf28}+0.86\%$
test_non_tensor_env_rollout_speed[1000-single-False]	0.7393s	0.6413s	1.5593 Ops/s	1.5637 Ops/s	$\color{#d91a1a}-0.28\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-True]	1.7637s	1.6802s	0.5952 Ops/s	0.5907 Ops/s	$\color{#35bf28}+0.76\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-False]	1.5407s	1.4591s	0.6854 Ops/s	0.6763 Ops/s	$\color{#35bf28}+1.35\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-True]	2.0039s	1.9223s	0.5202 Ops/s	0.5162 Ops/s	$\color{#35bf28}+0.78\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-False]	1.7829s	1.7015s	0.5877 Ops/s	0.5819 Ops/s	$\color{#35bf28}+1.00\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-True]	4.7929s	4.6881s	0.2133 Ops/s	0.2120 Ops/s	$\color{#35bf28}+0.59\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-False]	4.5678s	4.4918s	0.2226 Ops/s	0.2233 Ops/s	$\color{#d91a1a}-0.31\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-True]	2.1257s	1.9905s	0.5024 Ops/s	0.5066 Ops/s	$\color{#d91a1a}-0.83\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-False]	1.7866s	1.6788s	0.5957 Ops/s	0.5772 Ops/s	$\color{#35bf28}+3.20\%$
test_values[generalized_advantage_estimate-True-True]	10.9033ms	10.6577ms	93.8285 Ops/s	91.4598 Ops/s	$\color{#35bf28}+2.59\%$
test_values[vec_generalized_advantage_estimate-True-True]	14.1452ms	11.0405ms	90.5758 Ops/s	57.1342 Ops/s	$\textbf{\color{#35bf28}+58.53\%}$
test_values[td0_return_estimate-False-False]	0.2250ms	0.1331ms	7.5124 KOps/s	7.9635 KOps/s	$\textbf{\color{#d91a1a}-5.66\%}$
test_values[td1_return_estimate-False-False]	28.9664ms	28.5876ms	34.9802 Ops/s	33.0531 Ops/s	$\textbf{\color{#35bf28}+5.83\%}$
test_values[vec_td1_return_estimate-False-False]	11.7275ms	11.1091ms	90.0160 Ops/s	56.8290 Ops/s	$\textbf{\color{#35bf28}+58.40\%}$
test_values[td_lambda_return_estimate-True-False]	43.1891ms	42.5775ms	23.4866 Ops/s	22.4334 Ops/s	$\color{#35bf28}+4.69\%$
test_values[vec_td_lambda_return_estimate-True-False]	11.4927ms	11.0906ms	90.1663 Ops/s	57.1821 Ops/s	$\textbf{\color{#35bf28}+57.68\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512]	9.6970ms	9.4310ms	106.0334 Ops/s	103.2552 Ops/s	$\color{#35bf28}+2.69\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	1.9656ms	1.5536ms	643.6661 Ops/s	643.5056 Ops/s	$\color{#35bf28}+0.02\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.4875ms	0.4281ms	2.3358 KOps/s	2.2940 KOps/s	$\color{#35bf28}+1.82\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	37.5663ms	29.5806ms	33.8059 Ops/s	28.8343 Ops/s	$\textbf{\color{#35bf28}+17.24\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	2.1713ms	1.7338ms	576.7568 Ops/s	578.3877 Ops/s	$\color{#d91a1a}-0.28\%$
test_dqn_speed[False-None]	1.7885ms	1.4039ms	712.3248 Ops/s	700.4197 Ops/s	$\color{#35bf28}+1.70\%$
test_dqn_speed[False-backward]	2.1014ms	1.9775ms	505.6854 Ops/s	512.5142 Ops/s	$\color{#d91a1a}-1.33\%$
test_dqn_speed[True-None]	0.9488ms	0.5365ms	1.8640 KOps/s	1.8093 KOps/s	$\color{#35bf28}+3.02\%$
test_dqn_speed[True-backward]	1.0449ms	0.9946ms	1.0054 KOps/s	836.2507 Ops/s	$\textbf{\color{#35bf28}+20.23\%}$
test_dqn_speed[reduce-overhead-None]	0.8527ms	0.5253ms	1.9037 KOps/s	1.8382 KOps/s	$\color{#35bf28}+3.56\%$
test_dqn_speed[reduce-overhead-backward]	1.0077ms	0.9758ms	1.0248 KOps/s	1.0056 KOps/s	$\color{#35bf28}+1.90\%$
test_ddpg_speed[False-None]	3.2118ms	2.8525ms	350.5683 Ops/s	341.4715 Ops/s	$\color{#35bf28}+2.66\%$
test_ddpg_speed[False-backward]	4.2450ms	4.0996ms	243.9270 Ops/s	239.9775 Ops/s	$\color{#35bf28}+1.65\%$
test_ddpg_speed[True-None]	1.7706ms	1.3959ms	716.4036 Ops/s	706.0916 Ops/s	$\color{#35bf28}+1.46\%$
test_ddpg_speed[True-backward]	2.5091ms	2.4136ms	414.3166 Ops/s	341.6967 Ops/s	$\textbf{\color{#35bf28}+21.25\%}$
test_ddpg_speed[reduce-overhead-None]	1.5550ms	1.3905ms	719.1898 Ops/s	699.4140 Ops/s	$\color{#35bf28}+2.83\%$
test_ddpg_speed[reduce-overhead-backward]	2.6491ms	2.3886ms	418.6628 Ops/s	359.5713 Ops/s	$\textbf{\color{#35bf28}+16.43\%}$
test_sac_speed[False-None]	8.5999ms	8.0355ms	124.4484 Ops/s	121.8799 Ops/s	$\color{#35bf28}+2.11\%$
test_sac_speed[False-backward]	11.8377ms	11.3471ms	88.1279 Ops/s	87.1562 Ops/s	$\color{#35bf28}+1.11\%$
test_sac_speed[True-None]	2.4677ms	2.1211ms	471.4640 Ops/s	453.0917 Ops/s	$\color{#35bf28}+4.05\%$
test_sac_speed[True-backward]	4.2057ms	4.0361ms	247.7626 Ops/s	220.7367 Ops/s	$\textbf{\color{#35bf28}+12.24\%}$
test_sac_speed[reduce-overhead-None]	2.5140ms	2.1114ms	473.6218 Ops/s	454.7928 Ops/s	$\color{#35bf28}+4.14\%$
test_sac_speed[reduce-overhead-backward]	4.4400ms	4.0373ms	247.6899 Ops/s	245.6527 Ops/s	$\color{#35bf28}+0.83\%$
test_redq_speed[False-None]	10.9926ms	10.3874ms	96.2704 Ops/s	92.1666 Ops/s	$\color{#35bf28}+4.45\%$
test_redq_speed[False-backward]	18.9080ms	18.0229ms	55.4849 Ops/s	56.9601 Ops/s	$\color{#d91a1a}-2.59\%$
test_redq_speed[True-None]	5.6430ms	4.3436ms	230.2230 Ops/s	223.9925 Ops/s	$\color{#35bf28}+2.78\%$
test_redq_speed[True-backward]	10.1025ms	9.6830ms	103.2735 Ops/s	100.6812 Ops/s	$\color{#35bf28}+2.57\%$
test_redq_speed[reduce-overhead-None]	4.7336ms	4.3256ms	231.1808 Ops/s	225.8769 Ops/s	$\color{#35bf28}+2.35\%$
test_redq_speed[reduce-overhead-backward]	10.0330ms	9.8173ms	101.8610 Ops/s	98.8032 Ops/s	$\color{#35bf28}+3.09\%$
test_redq_deprec_speed[False-None]	11.6859ms	11.0735ms	90.3059 Ops/s	87.1623 Ops/s	$\color{#35bf28}+3.61\%$
test_redq_deprec_speed[False-backward]	16.5386ms	15.9881ms	62.5466 Ops/s	61.4654 Ops/s	$\color{#35bf28}+1.76\%$
test_redq_deprec_speed[True-None]	4.0617ms	3.6733ms	272.2320 Ops/s	270.8250 Ops/s	$\color{#35bf28}+0.52\%$
test_redq_deprec_speed[True-backward]	7.7693ms	7.5179ms	133.0167 Ops/s	129.2038 Ops/s	$\color{#35bf28}+2.95\%$
test_redq_deprec_speed[reduce-overhead-None]	3.9875ms	3.5987ms	277.8797 Ops/s	272.4318 Ops/s	$\color{#35bf28}+2.00\%$
test_redq_deprec_speed[reduce-overhead-backward]	8.0400ms	7.6173ms	131.2807 Ops/s	129.4307 Ops/s	$\color{#35bf28}+1.43\%$
test_td3_speed[False-None]	8.1853ms	8.0415ms	124.3548 Ops/s	121.7082 Ops/s	$\color{#35bf28}+2.17\%$
test_td3_speed[False-backward]	11.6439ms	11.0687ms	90.3447 Ops/s	90.1841 Ops/s	$\color{#35bf28}+0.18\%$
test_td3_speed[True-None]	1.8754ms	1.8098ms	552.5579 Ops/s	536.4273 Ops/s	$\color{#35bf28}+3.01\%$
test_td3_speed[True-backward]	3.7635ms	3.6485ms	274.0825 Ops/s	276.1481 Ops/s	$\color{#d91a1a}-0.75\%$
test_td3_speed[reduce-overhead-None]	1.8221ms	1.7849ms	560.2583 Ops/s	551.2207 Ops/s	$\color{#35bf28}+1.64\%$
test_td3_speed[reduce-overhead-backward]	3.7954ms	3.6604ms	273.1921 Ops/s	266.5540 Ops/s	$\color{#35bf28}+2.49\%$
test_cql_speed[False-None]	28.5261ms	26.1018ms	38.3116 Ops/s	37.3850 Ops/s	$\color{#35bf28}+2.48\%$
test_cql_speed[False-backward]	36.2181ms	35.4948ms	28.1731 Ops/s	28.1750 Ops/s	$-0.01\%$
test_cql_speed[True-None]	12.7150ms	12.3056ms	81.2637 Ops/s	80.3941 Ops/s	$\color{#35bf28}+1.08\%$
test_cql_speed[True-backward]	18.9401ms	18.3507ms	54.4939 Ops/s	53.6061 Ops/s	$\color{#35bf28}+1.66\%$
test_cql_speed[reduce-overhead-None]	12.7867ms	12.4333ms	80.4289 Ops/s	81.9622 Ops/s	$\color{#d91a1a}-1.87\%$
test_cql_speed[reduce-overhead-backward]	18.5807ms	18.1906ms	54.9735 Ops/s	57.2984 Ops/s	$\color{#d91a1a}-4.06\%$
test_a2c_speed[False-None]	5.6527ms	5.3782ms	185.9362 Ops/s	182.3076 Ops/s	$\color{#35bf28}+1.99\%$
test_a2c_speed[False-backward]	12.2381ms	11.7918ms	84.8048 Ops/s	81.0402 Ops/s	$\color{#35bf28}+4.65\%$
test_a2c_speed[True-None]	3.9820ms	3.7277ms	268.2650 Ops/s	271.6877 Ops/s	$\color{#d91a1a}-1.26\%$
test_a2c_speed[True-backward]	8.7171ms	8.5595ms	116.8286 Ops/s	114.7926 Ops/s	$\color{#35bf28}+1.77\%$
test_a2c_speed[reduce-overhead-None]	4.0383ms	3.7082ms	269.6721 Ops/s	267.3504 Ops/s	$\color{#35bf28}+0.87\%$
test_a2c_speed[reduce-overhead-backward]	9.3326ms	8.6648ms	115.4091 Ops/s	103.7023 Ops/s	$\textbf{\color{#35bf28}+11.29\%}$
test_ppo_speed[False-None]	6.2503ms	5.8685ms	170.4008 Ops/s	166.6433 Ops/s	$\color{#35bf28}+2.25\%$
test_ppo_speed[False-backward]	12.6098ms	12.2924ms	81.3510 Ops/s	79.4802 Ops/s	$\color{#35bf28}+2.35\%$
test_ppo_speed[True-None]	3.7676ms	3.5949ms	278.1704 Ops/s	273.0847 Ops/s	$\color{#35bf28}+1.86\%$
test_ppo_speed[True-backward]	8.4601ms	8.2894ms	120.6366 Ops/s	117.6147 Ops/s	$\color{#35bf28}+2.57\%$
test_ppo_speed[reduce-overhead-None]	3.9647ms	3.5889ms	278.6393 Ops/s	277.3084 Ops/s	$\color{#35bf28}+0.48\%$
test_ppo_speed[reduce-overhead-backward]	8.8252ms	8.6361ms	115.7935 Ops/s	112.8737 Ops/s	$\color{#35bf28}+2.59\%$
test_reinforce_speed[False-None]	4.8484ms	4.5881ms	217.9563 Ops/s	218.6327 Ops/s	$\color{#d91a1a}-0.31\%$
test_reinforce_speed[False-backward]	7.5657ms	7.3518ms	136.0218 Ops/s	133.8037 Ops/s	$\color{#35bf28}+1.66\%$
test_reinforce_speed[True-None]	3.2794ms	2.8617ms	349.4458 Ops/s	353.8173 Ops/s	$\color{#d91a1a}-1.24\%$
test_reinforce_speed[True-backward]	7.9788ms	7.6817ms	130.1801 Ops/s	129.1607 Ops/s	$\color{#35bf28}+0.79\%$
test_reinforce_speed[reduce-overhead-None]	3.2382ms	2.8352ms	352.7046 Ops/s	337.6470 Ops/s	$\color{#35bf28}+4.46\%$
test_reinforce_speed[reduce-overhead-backward]	8.2834ms	7.8849ms	126.8252 Ops/s	125.5688 Ops/s	$\color{#35bf28}+1.00\%$
test_iql_speed[False-None]	21.1338ms	20.0200ms	49.9501 Ops/s	48.7537 Ops/s	$\color{#35bf28}+2.45\%$
test_iql_speed[False-backward]	31.1955ms	30.3694ms	32.9279 Ops/s	32.9987 Ops/s	$\color{#d91a1a}-0.21\%$
test_iql_speed[True-None]	8.7498ms	8.4432ms	118.4381 Ops/s	116.2070 Ops/s	$\color{#35bf28}+1.92\%$
test_iql_speed[True-backward]	17.0744ms	16.6598ms	60.0247 Ops/s	60.3204 Ops/s	$\color{#d91a1a}-0.49\%$
test_iql_speed[reduce-overhead-None]	9.0733ms	8.5173ms	117.4081 Ops/s	117.0216 Ops/s	$\color{#35bf28}+0.33\%$
test_iql_speed[reduce-overhead-backward]	17.5036ms	17.0622ms	58.6091 Ops/s	58.8625 Ops/s	$\color{#d91a1a}-0.43\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	8.3341ms	6.1729ms	161.9980 Ops/s	163.3551 Ops/s	$\color{#d91a1a}-0.83\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.5833ms	0.3462ms	2.8884 KOps/s	2.9111 KOps/s	$\color{#d91a1a}-0.78\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.5854ms	0.3065ms	3.2622 KOps/s	3.2505 KOps/s	$\color{#35bf28}+0.36\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	6.1284ms	5.8559ms	170.7679 Ops/s	169.9051 Ops/s	$\color{#35bf28}+0.51\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	1.2132ms	0.2795ms	3.5774 KOps/s	3.2042 KOps/s	$\textbf{\color{#35bf28}+11.65\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.6073ms	0.2856ms	3.5016 KOps/s	3.1518 KOps/s	$\textbf{\color{#35bf28}+11.10\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	1.5331ms	1.2835ms	779.1477 Ops/s	771.0478 Ops/s	$\color{#35bf28}+1.05\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	1.4445ms	1.2058ms	829.2913 Ops/s	817.6258 Ops/s	$\color{#35bf28}+1.43\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	9.9729ms	6.0656ms	164.8633 Ops/s	166.4332 Ops/s	$\color{#d91a1a}-0.94\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	0.9097ms	0.4304ms	2.3236 KOps/s	2.1144 KOps/s	$\textbf{\color{#35bf28}+9.90\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.6940ms	0.4152ms	2.4084 KOps/s	2.1516 KOps/s	$\textbf{\color{#35bf28}+11.94\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	6.0376ms	5.8528ms	170.8587 Ops/s	170.1942 Ops/s	$\color{#35bf28}+0.39\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.6379ms	0.3654ms	2.7365 KOps/s	3.1402 KOps/s	$\textbf{\color{#d91a1a}-12.85\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.6706ms	0.3210ms	3.1152 KOps/s	3.7747 KOps/s	$\textbf{\color{#d91a1a}-17.47\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	6.0261ms	5.7635ms	173.5062 Ops/s	171.3916 Ops/s	$\color{#35bf28}+1.23\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	0.9165s	1.8293ms	546.6653 Ops/s	3.4806 KOps/s	$\textbf{\color{#d91a1a}-84.29\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.5179ms	0.3098ms	3.2282 KOps/s	3.8032 KOps/s	$\textbf{\color{#d91a1a}-15.12\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	6.1316ms	5.9854ms	167.0740 Ops/s	167.2869 Ops/s	$\color{#d91a1a}-0.13\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	2.1659ms	0.4338ms	2.3053 KOps/s	2.0649 KOps/s	$\textbf{\color{#35bf28}+11.64\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.6527ms	0.4117ms	2.4291 KOps/s	2.0341 KOps/s	$\textbf{\color{#35bf28}+19.42\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	6.4318ms	4.9845ms	200.6200 Ops/s	51.2085 Ops/s	$\textbf{\color{#35bf28}+291.77\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	3.8804ms	1.7724ms	564.1943 Ops/s	561.1677 Ops/s	$\color{#35bf28}+0.54\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	9.0428ms	1.2506ms	799.6039 Ops/s	736.2394 Ops/s	$\textbf{\color{#35bf28}+8.61\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	6.6433ms	5.0411ms	198.3688 Ops/s	193.6798 Ops/s	$\color{#35bf28}+2.42\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	11.1058ms	1.8870ms	529.9408 Ops/s	475.8409 Ops/s	$\textbf{\color{#35bf28}+11.37\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	8.6286ms	1.2362ms	808.9138 Ops/s	795.8273 Ops/s	$\color{#35bf28}+1.64\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.6082s	17.3030ms	57.7935 Ops/s	189.2269 Ops/s	$\textbf{\color{#d91a1a}-69.46\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	4.0734ms	1.9768ms	505.8667 Ops/s	461.1514 Ops/s	$\textbf{\color{#35bf28}+9.70\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	6.9545ms	1.3497ms	740.9024 Ops/s	955.2494 Ops/s	$\textbf{\color{#d91a1a}-22.44\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True]	37.6506ms	34.3814ms	29.0855 Ops/s	28.3505 Ops/s	$\color{#35bf28}+2.59\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False]	19.4432ms	17.7722ms	56.2676 Ops/s	55.3048 Ops/s	$\color{#35bf28}+1.74\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True]	37.1666ms	35.3041ms	28.3253 Ops/s	27.4246 Ops/s	$\color{#35bf28}+3.28\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False]	19.6305ms	18.0193ms	55.4960 Ops/s	54.5599 Ops/s	$\color{#35bf28}+1.72\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True]	38.4793ms	37.0207ms	27.0119 Ops/s	26.2442 Ops/s	$\color{#35bf28}+2.93\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False]	20.9876ms	19.4660ms	51.3716 Ops/s	50.4036 Ops/s	$\color{#35bf28}+1.92\%$