Skip to content

Conversation

@vmoens
Copy link
Collaborator

@vmoens vmoens commented Dec 31, 2025

Stack from ghstack (oldest at bottom):

[ghstack-poisoned]
@pytorch-bot
Copy link

pytorch-bot bot commented Dec 31, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3286

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

vmoens added a commit that referenced this pull request Dec 31, 2025
ghstack-source-id: 2e1839f
Pull-Request: #3286
@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Dec 31, 2025
@github-actions
Copy link

github-actions bot commented Dec 31, 2025

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 164. Improved: $\large\color{#35bf28}24$. Worsened: $\large\color{#d91a1a}6$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_tensor_to_bytestream_speed[pickle] 85.6396μs 83.2196μs 12.0164 KOps/s 12.6725 KOps/s $\textbf{\color{#d91a1a}-5.18\%}$
test_tensor_to_bytestream_speed[torch.save] 0.1438ms 0.1434ms 6.9738 KOps/s 7.3016 KOps/s $\color{#d91a1a}-4.49\%$
test_tensor_to_bytestream_speed[untyped_storage] 0.1292s 0.1286s 7.7748 Ops/s 8.4288 Ops/s $\textbf{\color{#d91a1a}-7.76\%}$
test_tensor_to_bytestream_speed[numpy] 2.6944μs 2.6757μs 373.7286 KOps/s 378.0229 KOps/s $\color{#d91a1a}-1.14\%$
test_tensor_to_bytestream_speed[safetensors] 39.5989μs 38.2627μs 26.1351 KOps/s 27.5921 KOps/s $\textbf{\color{#d91a1a}-5.28\%}$
test_simple 0.5470s 0.5400s 1.8517 Ops/s 1.7523 Ops/s $\textbf{\color{#35bf28}+5.67\%}$
test_transformed 1.1160s 1.1077s 0.9027 Ops/s 0.8812 Ops/s $\color{#35bf28}+2.44\%$
test_serial 1.6706s 1.6591s 0.6028 Ops/s 0.5997 Ops/s $\color{#35bf28}+0.51\%$
test_parallel 1.2097s 1.1405s 0.8768 Ops/s 0.8966 Ops/s $\color{#d91a1a}-2.20\%$
test_step_mdp_speed[True-True-True-True-True] 0.4519ms 41.9311μs 23.8487 KOps/s 23.9968 KOps/s $\color{#d91a1a}-0.62\%$
test_step_mdp_speed[True-True-True-True-False] 56.0810μs 23.8854μs 41.8666 KOps/s 41.3245 KOps/s $\color{#35bf28}+1.31\%$
test_step_mdp_speed[True-True-True-False-True] 0.4481ms 24.5570μs 40.7215 KOps/s 42.1964 KOps/s $\color{#d91a1a}-3.50\%$
test_step_mdp_speed[True-True-True-False-False] 0.4356ms 13.3714μs 74.7864 KOps/s 74.1601 KOps/s $\color{#35bf28}+0.84\%$
test_step_mdp_speed[True-True-False-True-True] 82.4210μs 45.7392μs 21.8631 KOps/s 21.6517 KOps/s $\color{#35bf28}+0.98\%$
test_step_mdp_speed[True-True-False-True-False] 0.4482ms 26.2182μs 38.1414 KOps/s 37.3436 KOps/s $\color{#35bf28}+2.14\%$
test_step_mdp_speed[True-True-False-False-True] 0.4545ms 27.4537μs 36.4249 KOps/s 37.5975 KOps/s $\color{#d91a1a}-3.12\%$
test_step_mdp_speed[True-True-False-False-False] 43.8600μs 16.1111μs 62.0688 KOps/s 61.6874 KOps/s $\color{#35bf28}+0.62\%$
test_step_mdp_speed[True-False-True-True-True] 0.4750ms 48.8594μs 20.4669 KOps/s 20.0451 KOps/s $\color{#35bf28}+2.10\%$
test_step_mdp_speed[True-False-True-True-False] 0.4595ms 29.3304μs 34.0944 KOps/s 33.9885 KOps/s $\color{#35bf28}+0.31\%$
test_step_mdp_speed[True-False-True-False-True] 0.4559ms 27.1527μs 36.8287 KOps/s 37.9176 KOps/s $\color{#d91a1a}-2.87\%$
test_step_mdp_speed[True-False-True-False-False] 48.6410μs 15.9319μs 62.7671 KOps/s 62.1948 KOps/s $\color{#35bf28}+0.92\%$
test_step_mdp_speed[True-False-False-True-True] 0.4823ms 50.6518μs 19.7426 KOps/s 19.3442 KOps/s $\color{#35bf28}+2.06\%$
test_step_mdp_speed[True-False-False-True-False] 0.4571ms 31.7087μs 31.5371 KOps/s 31.0161 KOps/s $\color{#35bf28}+1.68\%$
test_step_mdp_speed[True-False-False-False-True] 0.4530ms 29.0073μs 34.4741 KOps/s 34.3713 KOps/s $\color{#35bf28}+0.30\%$
test_step_mdp_speed[True-False-False-False-False] 51.4100μs 18.6097μs 53.7355 KOps/s 53.9162 KOps/s $\color{#d91a1a}-0.34\%$
test_step_mdp_speed[False-True-True-True-True] 0.4673ms 48.4832μs 20.6257 KOps/s 20.2309 KOps/s $\color{#35bf28}+1.95\%$
test_step_mdp_speed[False-True-True-True-False] 0.4483ms 28.9893μs 34.4955 KOps/s 33.3787 KOps/s $\color{#35bf28}+3.35\%$
test_step_mdp_speed[False-True-True-False-True] 2.5751ms 30.8624μs 32.4018 KOps/s 32.5880 KOps/s $\color{#d91a1a}-0.57\%$
test_step_mdp_speed[False-True-True-False-False] 49.5610μs 17.5808μs 56.8802 KOps/s 57.0005 KOps/s $\color{#d91a1a}-0.21\%$
test_step_mdp_speed[False-True-False-True-True] 0.4771ms 50.7092μs 19.7203 KOps/s 19.8352 KOps/s $\color{#d91a1a}-0.58\%$
test_step_mdp_speed[False-True-False-True-False] 0.4461ms 31.5907μs 31.6549 KOps/s 30.7909 KOps/s $\color{#35bf28}+2.81\%$
test_step_mdp_speed[False-True-False-False-True] 67.9310μs 32.1584μs 31.0961 KOps/s 30.1794 KOps/s $\color{#35bf28}+3.04\%$
test_step_mdp_speed[False-True-False-False-False] 0.4379ms 19.9275μs 50.1819 KOps/s 49.4983 KOps/s $\color{#35bf28}+1.38\%$
test_step_mdp_speed[False-False-True-True-True] 0.4711ms 52.8473μs 18.9224 KOps/s 18.8824 KOps/s $\color{#35bf28}+0.21\%$
test_step_mdp_speed[False-False-True-True-False] 0.4469ms 34.1856μs 29.2521 KOps/s 28.8350 KOps/s $\color{#35bf28}+1.45\%$
test_step_mdp_speed[False-False-True-False-True] 66.7310μs 32.7633μs 30.5220 KOps/s 30.2211 KOps/s $\color{#35bf28}+1.00\%$
test_step_mdp_speed[False-False-True-False-False] 51.1710μs 20.2479μs 49.3878 KOps/s 49.1974 KOps/s $\color{#35bf28}+0.39\%$
test_step_mdp_speed[False-False-False-True-True] 0.4703ms 55.7764μs 17.9287 KOps/s 17.8942 KOps/s $\color{#35bf28}+0.19\%$
test_step_mdp_speed[False-False-False-True-False] 0.4517ms 37.0163μs 27.0151 KOps/s 26.8918 KOps/s $\color{#35bf28}+0.46\%$
test_step_mdp_speed[False-False-False-False-True] 72.1620μs 34.6046μs 28.8979 KOps/s 28.8575 KOps/s $\color{#35bf28}+0.14\%$
test_step_mdp_speed[False-False-False-False-False] 0.4345ms 22.6252μs 44.1985 KOps/s 44.1650 KOps/s $\color{#35bf28}+0.08\%$
test_non_tensor_env_rollout_speed[1000-single-True] 0.8518s 0.7493s 1.3346 Ops/s 1.3219 Ops/s $\color{#35bf28}+0.97\%$
test_non_tensor_env_rollout_speed[1000-single-False] 0.7202s 0.6153s 1.6252 Ops/s 1.6093 Ops/s $\color{#35bf28}+0.99\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-True] 1.7157s 1.6366s 0.6110 Ops/s 0.6052 Ops/s $\color{#35bf28}+0.97\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-False] 1.5031s 1.4241s 0.7022 Ops/s 0.7002 Ops/s $\color{#35bf28}+0.29\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-True] 1.9762s 1.8902s 0.5291 Ops/s 0.5303 Ops/s $\color{#d91a1a}-0.23\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-False] 1.7573s 1.6710s 0.5984 Ops/s 0.5974 Ops/s $\color{#35bf28}+0.17\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-True] 4.6637s 4.5662s 0.2190 Ops/s 0.2173 Ops/s $\color{#35bf28}+0.80\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-False] 4.4831s 4.3755s 0.2285 Ops/s 0.2249 Ops/s $\color{#35bf28}+1.62\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-True] 2.0016s 1.9228s 0.5201 Ops/s 0.5068 Ops/s $\color{#35bf28}+2.62\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-False] 1.7811s 1.6600s 0.6024 Ops/s 0.6068 Ops/s $\color{#d91a1a}-0.73\%$
test_values[generalized_advantage_estimate-True-True] 11.2313ms 10.9773ms 91.0968 Ops/s 93.9806 Ops/s $\color{#d91a1a}-3.07\%$
test_values[vec_generalized_advantage_estimate-True-True] 20.5162ms 17.5815ms 56.8780 Ops/s 57.2052 Ops/s $\color{#d91a1a}-0.57\%$
test_values[td0_return_estimate-False-False] 0.2279ms 0.1290ms 7.7533 KOps/s 7.8175 KOps/s $\color{#d91a1a}-0.82\%$
test_values[td1_return_estimate-False-False] 29.4020ms 29.0842ms 34.3829 Ops/s 35.1422 Ops/s $\color{#d91a1a}-2.16\%$
test_values[vec_td1_return_estimate-False-False] 17.8921ms 17.4855ms 57.1901 Ops/s 56.5917 Ops/s $\color{#35bf28}+1.06\%$
test_values[td_lambda_return_estimate-True-False] 44.1692ms 43.0934ms 23.2054 Ops/s 23.7503 Ops/s $\color{#d91a1a}-2.29\%$
test_values[vec_td_lambda_return_estimate-True-False] 18.0620ms 17.4892ms 57.1781 Ops/s 57.1667 Ops/s $\color{#35bf28}+0.02\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 9.7376ms 9.6245ms 103.9019 Ops/s 107.5872 Ops/s $\color{#d91a1a}-3.43\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.7546ms 1.5582ms 641.7524 Ops/s 641.5893 Ops/s $\color{#35bf28}+0.03\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4704ms 0.4261ms 2.3467 KOps/s 2.2987 KOps/s $\color{#35bf28}+2.09\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 34.6877ms 34.0707ms 29.3507 Ops/s 28.5447 Ops/s $\color{#35bf28}+2.82\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 2.1502ms 1.7198ms 581.4537 Ops/s 583.7221 Ops/s $\color{#d91a1a}-0.39\%$
test_dqn_speed[False-None] 1.7704ms 1.3771ms 726.1426 Ops/s 728.7586 Ops/s $\color{#d91a1a}-0.36\%$
test_dqn_speed[False-backward] 1.9541ms 1.9071ms 524.3611 Ops/s 520.9010 Ops/s $\color{#35bf28}+0.66\%$
test_dqn_speed[True-None] 0.7728ms 0.5409ms 1.8486 KOps/s 1.8429 KOps/s $\color{#35bf28}+0.31\%$
test_dqn_speed[True-backward] 1.0302ms 0.9940ms 1.0060 KOps/s 978.1897 Ops/s $\color{#35bf28}+2.84\%$
test_dqn_speed[reduce-overhead-None] 0.9282ms 0.5407ms 1.8494 KOps/s 1.8580 KOps/s $\color{#d91a1a}-0.47\%$
test_dqn_speed[reduce-overhead-backward] 1.0110ms 0.9815ms 1.0188 KOps/s 992.6582 Ops/s $\color{#35bf28}+2.64\%$
test_ddpg_speed[False-None] 3.5106ms 2.8508ms 350.7736 Ops/s 346.8255 Ops/s $\color{#35bf28}+1.14\%$
test_ddpg_speed[False-backward] 4.1569ms 4.0774ms 245.2517 Ops/s 244.8217 Ops/s $\color{#35bf28}+0.18\%$
test_ddpg_speed[True-None] 1.7996ms 1.4038ms 712.3462 Ops/s 704.8687 Ops/s $\color{#35bf28}+1.06\%$
test_ddpg_speed[True-backward] 2.4596ms 2.3981ms 416.9933 Ops/s 345.9005 Ops/s $\textbf{\color{#35bf28}+20.55\%}$
test_ddpg_speed[reduce-overhead-None] 1.6232ms 1.3973ms 715.6598 Ops/s 693.6467 Ops/s $\color{#35bf28}+3.17\%$
test_ddpg_speed[reduce-overhead-backward] 2.4407ms 2.3947ms 417.5831 Ops/s 417.0130 Ops/s $\color{#35bf28}+0.14\%$
test_sac_speed[False-None] 8.6156ms 8.0052ms 124.9194 Ops/s 125.9631 Ops/s $\color{#d91a1a}-0.83\%$
test_sac_speed[False-backward] 11.8186ms 11.2762ms 88.6820 Ops/s 89.0147 Ops/s $\color{#d91a1a}-0.37\%$
test_sac_speed[True-None] 2.5541ms 2.1689ms 461.0737 Ops/s 461.6626 Ops/s $\color{#d91a1a}-0.13\%$
test_sac_speed[True-backward] 4.1560ms 4.0662ms 245.9293 Ops/s 220.5439 Ops/s $\textbf{\color{#35bf28}+11.51\%}$
test_sac_speed[reduce-overhead-None] 3.8734ms 2.2121ms 452.0587 Ops/s 455.5724 Ops/s $\color{#d91a1a}-0.77\%$
test_sac_speed[reduce-overhead-backward] 4.1946ms 4.0464ms 247.1319 Ops/s 202.6431 Ops/s $\textbf{\color{#35bf28}+21.95\%}$
test_redq_speed[False-None] 11.1267ms 10.4978ms 95.2577 Ops/s 67.6356 Ops/s $\textbf{\color{#35bf28}+40.84\%}$
test_redq_speed[False-backward] 18.6498ms 17.9505ms 55.7088 Ops/s 55.2192 Ops/s $\color{#35bf28}+0.89\%$
test_redq_speed[True-None] 4.8369ms 4.4157ms 226.4658 Ops/s 211.9081 Ops/s $\textbf{\color{#35bf28}+6.87\%}$
test_redq_speed[True-backward] 10.2259ms 9.9478ms 100.5251 Ops/s 95.1592 Ops/s $\textbf{\color{#35bf28}+5.64\%}$
test_redq_speed[reduce-overhead-None] 4.6990ms 4.4019ms 227.1742 Ops/s 224.2320 Ops/s $\color{#35bf28}+1.31\%$
test_redq_speed[reduce-overhead-backward] 10.2459ms 10.0956ms 99.0535 Ops/s 99.9516 Ops/s $\color{#d91a1a}-0.90\%$
test_redq_deprec_speed[False-None] 11.6381ms 11.1945ms 89.3296 Ops/s 90.6239 Ops/s $\color{#d91a1a}-1.43\%$
test_redq_deprec_speed[False-backward] 16.6184ms 16.1367ms 61.9706 Ops/s 62.5757 Ops/s $\color{#d91a1a}-0.97\%$
test_redq_deprec_speed[True-None] 4.0514ms 3.6990ms 270.3424 Ops/s 269.7510 Ops/s $\color{#35bf28}+0.22\%$
test_redq_deprec_speed[True-backward] 7.9938ms 7.7873ms 128.4145 Ops/s 126.5525 Ops/s $\color{#35bf28}+1.47\%$
test_redq_deprec_speed[reduce-overhead-None] 4.6308ms 3.6336ms 275.2103 Ops/s 269.8525 Ops/s $\color{#35bf28}+1.99\%$
test_redq_deprec_speed[reduce-overhead-backward] 8.0623ms 7.7435ms 129.1406 Ops/s 123.5419 Ops/s $\color{#35bf28}+4.53\%$
test_td3_speed[False-None] 8.5191ms 8.0080ms 124.8759 Ops/s 124.5312 Ops/s $\color{#35bf28}+0.28\%$
test_td3_speed[False-backward] 11.4433ms 10.8848ms 91.8712 Ops/s 91.3616 Ops/s $\color{#35bf28}+0.56\%$
test_td3_speed[True-None] 1.8807ms 1.8457ms 541.7855 Ops/s 537.3855 Ops/s $\color{#35bf28}+0.82\%$
test_td3_speed[True-backward] 3.8199ms 3.6972ms 270.4753 Ops/s 264.7735 Ops/s $\color{#35bf28}+2.15\%$
test_td3_speed[reduce-overhead-None] 1.8589ms 1.8032ms 554.5821 Ops/s 548.4687 Ops/s $\color{#35bf28}+1.11\%$
test_td3_speed[reduce-overhead-backward] 3.8581ms 3.6855ms 271.3331 Ops/s 245.1063 Ops/s $\textbf{\color{#35bf28}+10.70\%}$
test_cql_speed[False-None] 28.6113ms 26.0460ms 38.3936 Ops/s 37.9845 Ops/s $\color{#35bf28}+1.08\%$
test_cql_speed[False-backward] 36.0106ms 35.2135ms 28.3982 Ops/s 27.3892 Ops/s $\color{#35bf28}+3.68\%$
test_cql_speed[True-None] 12.5948ms 12.2949ms 81.3347 Ops/s 78.5713 Ops/s $\color{#35bf28}+3.52\%$
test_cql_speed[True-backward] 18.5650ms 18.0775ms 55.3174 Ops/s 54.3910 Ops/s $\color{#35bf28}+1.70\%$
test_cql_speed[reduce-overhead-None] 14.5595ms 12.6454ms 79.0801 Ops/s 80.0007 Ops/s $\color{#d91a1a}-1.15\%$
test_cql_speed[reduce-overhead-backward] 18.4395ms 17.9956ms 55.5692 Ops/s 54.4505 Ops/s $\color{#35bf28}+2.05\%$
test_a2c_speed[False-None] 6.3531ms 5.4853ms 182.3065 Ops/s 183.1918 Ops/s $\color{#d91a1a}-0.48\%$
test_a2c_speed[False-backward] 12.2981ms 12.0190ms 83.2016 Ops/s 83.4672 Ops/s $\color{#d91a1a}-0.32\%$
test_a2c_speed[True-None] 3.9798ms 3.7458ms 266.9678 Ops/s 266.2643 Ops/s $\color{#35bf28}+0.26\%$
test_a2c_speed[True-backward] 8.8897ms 8.6908ms 115.0640 Ops/s 109.2042 Ops/s $\textbf{\color{#35bf28}+5.37\%}$
test_a2c_speed[reduce-overhead-None] 4.0707ms 3.7084ms 269.6579 Ops/s 263.5806 Ops/s $\color{#35bf28}+2.31\%$
test_a2c_speed[reduce-overhead-backward] 8.9676ms 8.8260ms 113.3013 Ops/s 111.9320 Ops/s $\color{#35bf28}+1.22\%$
test_ppo_speed[False-None] 6.2790ms 5.9130ms 169.1188 Ops/s 167.7096 Ops/s $\color{#35bf28}+0.84\%$
test_ppo_speed[False-backward] 13.0903ms 12.6289ms 79.1833 Ops/s 78.3502 Ops/s $\color{#35bf28}+1.06\%$
test_ppo_speed[True-None] 3.9816ms 3.5863ms 278.8412 Ops/s 276.5725 Ops/s $\color{#35bf28}+0.82\%$
test_ppo_speed[True-backward] 8.7008ms 8.4508ms 118.3326 Ops/s 111.1905 Ops/s $\textbf{\color{#35bf28}+6.42\%}$
test_ppo_speed[reduce-overhead-None] 3.9335ms 3.5983ms 277.9077 Ops/s 272.7495 Ops/s $\color{#35bf28}+1.89\%$
test_ppo_speed[reduce-overhead-backward] 9.0079ms 8.7357ms 114.4732 Ops/s 112.1114 Ops/s $\color{#35bf28}+2.11\%$
test_reinforce_speed[False-None] 4.9975ms 4.5989ms 217.4439 Ops/s 214.7139 Ops/s $\color{#35bf28}+1.27\%$
test_reinforce_speed[False-backward] 7.8908ms 7.4222ms 134.7302 Ops/s 133.6830 Ops/s $\color{#35bf28}+0.78\%$
test_reinforce_speed[True-None] 3.2309ms 2.8802ms 347.2012 Ops/s 338.1569 Ops/s $\color{#35bf28}+2.67\%$
test_reinforce_speed[True-backward] 8.0130ms 7.7467ms 129.0874 Ops/s 124.4125 Ops/s $\color{#35bf28}+3.76\%$
test_reinforce_speed[reduce-overhead-None] 3.3662ms 2.8854ms 346.5756 Ops/s 338.5673 Ops/s $\color{#35bf28}+2.37\%$
test_reinforce_speed[reduce-overhead-backward] 8.4422ms 8.0050ms 124.9216 Ops/s 123.6852 Ops/s $\color{#35bf28}+1.00\%$
test_iql_speed[False-None] 21.1631ms 20.1881ms 49.5341 Ops/s 48.7569 Ops/s $\color{#35bf28}+1.59\%$
test_iql_speed[False-backward] 31.3860ms 30.4692ms 32.8201 Ops/s 32.3730 Ops/s $\color{#35bf28}+1.38\%$
test_iql_speed[True-None] 8.7859ms 8.5597ms 116.8265 Ops/s 113.8521 Ops/s $\color{#35bf28}+2.61\%$
test_iql_speed[True-backward] 17.3452ms 16.9412ms 59.0277 Ops/s 59.6402 Ops/s $\color{#d91a1a}-1.03\%$
test_iql_speed[reduce-overhead-None] 9.1357ms 8.6652ms 115.4039 Ops/s 112.3702 Ops/s $\color{#35bf28}+2.70\%$
test_iql_speed[reduce-overhead-backward] 17.7187ms 17.3607ms 57.6014 Ops/s 62.2956 Ops/s $\textbf{\color{#d91a1a}-7.54\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.2331ms 5.8697ms 170.3661 Ops/s 169.4880 Ops/s $\color{#35bf28}+0.52\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6150ms 0.3536ms 2.8279 KOps/s 2.8451 KOps/s $\color{#d91a1a}-0.60\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6219ms 0.3328ms 3.0047 KOps/s 3.0030 KOps/s $\color{#35bf28}+0.06\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.7818ms 5.5825ms 179.1326 Ops/s 176.7882 Ops/s $\color{#35bf28}+1.33\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.2275ms 0.3403ms 2.9385 KOps/s 2.7545 KOps/s $\textbf{\color{#35bf28}+6.68\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5492ms 0.2750ms 3.6358 KOps/s 2.8836 KOps/s $\textbf{\color{#35bf28}+26.09\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.4807ms 1.3093ms 763.7859 Ops/s 735.7215 Ops/s $\color{#35bf28}+3.81\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.5353ms 1.2097ms 826.6664 Ops/s 767.4139 Ops/s $\textbf{\color{#35bf28}+7.72\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 8.9825ms 5.8493ms 170.9599 Ops/s 170.6889 Ops/s $\color{#35bf28}+0.16\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 2.3070ms 0.4770ms 2.0965 KOps/s 1.9470 KOps/s $\textbf{\color{#35bf28}+7.68\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8409ms 0.4899ms 2.0412 KOps/s 2.0207 KOps/s $\color{#35bf28}+1.01\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.6701ms 5.5752ms 179.3650 Ops/s 176.8672 Ops/s $\color{#35bf28}+1.41\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.9266ms 0.3456ms 2.8931 KOps/s 2.6193 KOps/s $\textbf{\color{#35bf28}+10.46\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6828ms 0.3169ms 3.1553 KOps/s 2.7518 KOps/s $\textbf{\color{#35bf28}+14.67\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.7073ms 5.4972ms 181.9113 Ops/s 178.2848 Ops/s $\color{#35bf28}+2.03\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.9831ms 0.3475ms 2.8780 KOps/s 3.1035 KOps/s $\textbf{\color{#d91a1a}-7.27\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5533ms 0.2793ms 3.5804 KOps/s 3.2629 KOps/s $\textbf{\color{#35bf28}+9.73\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.1264ms 5.7150ms 174.9768 Ops/s 171.9070 Ops/s $\color{#35bf28}+1.79\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.8878ms 0.4710ms 2.1232 KOps/s 1.9069 KOps/s $\textbf{\color{#35bf28}+11.34\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6235ms 0.4147ms 2.4114 KOps/s 1.9717 KOps/s $\textbf{\color{#35bf28}+22.30\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.6342s 17.4971ms 57.1522 Ops/s 48.2455 Ops/s $\textbf{\color{#35bf28}+18.46\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 3.7973ms 1.6669ms 599.9003 Ops/s 563.3456 Ops/s $\textbf{\color{#35bf28}+6.49\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 3.3315ms 0.9897ms 1.0104 KOps/s 937.9393 Ops/s $\textbf{\color{#35bf28}+7.72\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 6.3715ms 4.9258ms 203.0134 Ops/s 197.4927 Ops/s $\color{#35bf28}+2.80\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 3.8884ms 1.7480ms 572.0752 Ops/s 588.3446 Ops/s $\color{#d91a1a}-2.77\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.8773ms 0.9123ms 1.0962 KOps/s 746.3821 Ops/s $\textbf{\color{#35bf28}+46.86\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.6092s 17.2687ms 57.9082 Ops/s 191.2731 Ops/s $\textbf{\color{#d91a1a}-69.72\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 13.0097ms 2.1317ms 469.1196 Ops/s 468.4719 Ops/s $\color{#35bf28}+0.14\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 1.2879ms 0.9974ms 1.0026 KOps/s 683.3530 Ops/s $\textbf{\color{#35bf28}+46.72\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 40.5191ms 36.2705ms 27.5706 Ops/s 27.8524 Ops/s $\color{#d91a1a}-1.01\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 20.1706ms 18.3145ms 54.6015 Ops/s 57.4737 Ops/s $\color{#d91a1a}-5.00\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 40.2082ms 37.0463ms 26.9932 Ops/s 27.1170 Ops/s $\color{#d91a1a}-0.46\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 19.4859ms 17.9257ms 55.7858 Ops/s 55.6891 Ops/s $\color{#35bf28}+0.17\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 40.5811ms 38.7418ms 25.8119 Ops/s 25.6886 Ops/s $\color{#35bf28}+0.48\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 20.2332ms 19.1109ms 52.3261 Ops/s 52.2195 Ops/s $\color{#35bf28}+0.20\%$

@vmoens vmoens added the CI Has to do with CI setup (e.g. wheels & builds, tests...) label Dec 31, 2025
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 31, 2025
ghstack-source-id: 7c92a6d
Pull-Request: #3286
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 31, 2025
ghstack-source-id: d5fae60
Pull-Request: #3286
[ghstack-poisoned]
@vmoens vmoens mentioned this pull request Jan 1, 2026
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 1, 2026
ghstack-source-id: 34cd3ab
Pull-Request: #3286

amend

ghstack-source-id: 34cd3ab
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 1, 2026
ghstack-source-id: b6179e0
Pull-Request: #3286

amend

ghstack-source-id: b6179e0
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: 8379fda
Pull-Request: #3286

amend

ghstack-source-id: 8379fda
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: 535577c
Pull-Request: #3286

amend

ghstack-source-id: 535577c
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: fc83efd
Pull-Request: #3286

amend

ghstack-source-id: fc83efd
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: 5eaa840
Pull-Request: #3286

amend

ghstack-source-id: 5eaa840
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: 962c34a
Pull-Request: #3286

amend

ghstack-source-id: 962c34a
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: d98ab44
Pull-Request: #3286

amend

ghstack-source-id: d98ab44
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: 70a9cf1
Pull-Request: #3286

amend

ghstack-source-id: 70a9cf1
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: ad7fceb
Pull-Request: #3286

amend

ghstack-source-id: ad7fceb
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: e497e7b
Pull-Request: #3286

amend

ghstack-source-id: e497e7b
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 14, 2026
ghstack-source-id: ef9bd91
Pull-Request: #3286

amend

ghstack-source-id: ef9bd91
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 15, 2026
ghstack-source-id: 6310763
Pull-Request: #3286

amend

ghstack-source-id: 6310763
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 15, 2026
ghstack-source-id: 5bfa605
Pull-Request: #3286

amend

ghstack-source-id: 5bfa605
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 15, 2026
ghstack-source-id: 9c4adbd
Pull-Request: #3286

amend

ghstack-source-id: 9c4adbd
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 15, 2026
ghstack-source-id: 5938227
Pull-Request: #3286

amend

ghstack-source-id: 5938227
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 16, 2026
ghstack-source-id: 3d7e92c
Pull-Request: #3286

amend

ghstack-source-id: 3d7e92c
Pull-Request: #3287
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 16, 2026
ghstack-source-id: 5ae2167
Pull-Request: #3286

amend

ghstack-source-id: 5ae2167
Pull-Request: #3287
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants