+
Skip to content

[Feature] Dynamic specs for make_composite_from_td #2829

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Mar 5, 2025
Merged

[Feature] Dynamic specs for make_composite_from_td #2829

merged 1 commit into from
Mar 5, 2025

Conversation

vmoens
Copy link
Collaborator

@vmoens vmoens commented Mar 5, 2025 •
edited
Loading

Update
800c94b 
[ghstack-poisoned]
vmoens pushed a commit that referenced this pull request Mar 5, 2025
[Feature] Dynamic specs for make_composite_from_td
f315e5c 
ghstack-source-id: 79e31e7
Pull Request resolved: #2829
@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Mar 5, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2829

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Mar 5, 2025
@vmoens vmoens merged commit 800c94b into gh/vmoens/103/base Mar 5, 2025
9 of 21 checks passed
vmoens pushed a commit that referenced this pull request Mar 5, 2025
[Feature] Dynamic specs for make_composite_from_td
413571b 
ghstack-source-id: 79e31e7
Pull Request resolved: #2829
@vmoens vmoens deleted the gh/vmoens/103/head branch March 5, 2025 19:14
@github-actions GitHub Actions
Copy link

github-actions bot commented Mar 5, 2025

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 149. Improved: $\large\color{#35bf28}8$. Worsened: $\large\color{#d91a1a}5$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_simple 0.6058s 0.5115s 1.9550 Ops/s 1.9286 Ops/s $\color{#35bf28}+1.37\%$
test_transformed 1.0753s 0.9900s 1.0101 Ops/s 0.9992 Ops/s $\color{#35bf28}+1.08\%$
test_serial 1.6023s 1.4952s 0.6688 Ops/s 0.6628 Ops/s $\color{#35bf28}+0.91\%$
test_parallel 1.4043s 1.3182s 0.7586 Ops/s 0.7669 Ops/s $\color{#d91a1a}-1.09\%$
test_step_mdp_speed[True-True-True-True-True] 0.1847ms 30.2812μs 33.0238 KOps/s 32.7129 KOps/s $\color{#35bf28}+0.95\%$
test_step_mdp_speed[True-True-True-True-False] 45.1240μs 17.6568μs 56.6353 KOps/s 55.1886 KOps/s $\color{#35bf28}+2.62\%$
test_step_mdp_speed[True-True-True-False-True] 41.6480μs 17.0848μs 58.5315 KOps/s 57.5139 KOps/s $\color{#35bf28}+1.77\%$
test_step_mdp_speed[True-True-True-False-False] 34.9550μs 9.9905μs 100.0946 KOps/s 98.3228 KOps/s $\color{#35bf28}+1.80\%$
test_step_mdp_speed[True-True-False-True-True] 71.6930μs 31.8660μs 31.3814 KOps/s 30.6356 KOps/s $\color{#35bf28}+2.43\%$
test_step_mdp_speed[True-True-False-True-False] 58.6490μs 19.5540μs 51.1404 KOps/s 49.9106 KOps/s $\color{#35bf28}+2.46\%$
test_step_mdp_speed[True-True-False-False-True] 52.0260μs 18.7838μs 53.2374 KOps/s 51.8309 KOps/s $\color{#35bf28}+2.71\%$
test_step_mdp_speed[True-True-False-False-False] 39.1330μs 11.8362μs 84.4868 KOps/s 82.7156 KOps/s $\color{#35bf28}+2.14\%$
test_step_mdp_speed[True-False-True-True-True] 76.5730μs 33.8460μs 29.5456 KOps/s 28.8729 KOps/s $\color{#35bf28}+2.33\%$
test_step_mdp_speed[True-False-True-True-False] 58.1180μs 21.2878μs 46.9753 KOps/s 45.4355 KOps/s $\color{#35bf28}+3.39\%$
test_step_mdp_speed[True-False-True-False-True] 42.8300μs 18.8914μs 52.9342 KOps/s 51.6194 KOps/s $\color{#35bf28}+2.55\%$
test_step_mdp_speed[True-False-True-False-False] 42.1890μs 11.7684μs 84.9737 KOps/s 82.6009 KOps/s $\color{#35bf28}+2.87\%$
test_step_mdp_speed[True-False-False-True-True] 74.2380μs 35.3281μs 28.3061 KOps/s 27.3285 KOps/s $\color{#35bf28}+3.58\%$
test_step_mdp_speed[True-False-False-True-False] 56.8460μs 23.0392μs 43.4042 KOps/s 42.0859 KOps/s $\color{#35bf28}+3.13\%$
test_step_mdp_speed[True-False-False-False-True] 60.9730μs 20.4431μs 48.9164 KOps/s 47.8105 KOps/s $\color{#35bf28}+2.31\%$
test_step_mdp_speed[True-False-False-False-False] 44.6330μs 13.4789μs 74.1901 KOps/s 71.5990 KOps/s $\color{#35bf28}+3.62\%$
test_step_mdp_speed[False-True-True-True-True] 69.3090μs 33.7366μs 29.6414 KOps/s 28.9532 KOps/s $\color{#35bf28}+2.38\%$
test_step_mdp_speed[False-True-True-True-False] 54.0310μs 21.2851μs 46.9812 KOps/s 45.1841 KOps/s $\color{#35bf28}+3.98\%$
test_step_mdp_speed[False-True-True-False-True] 55.9140μs 21.5327μs 46.4410 KOps/s 44.8062 KOps/s $\color{#35bf28}+3.65\%$
test_step_mdp_speed[False-True-True-False-False] 52.4280μs 13.1742μs 75.9059 KOps/s 74.0871 KOps/s $\color{#35bf28}+2.45\%$
test_step_mdp_speed[False-True-False-True-True] 71.5440μs 35.3756μs 28.2680 KOps/s 27.6113 KOps/s $\color{#35bf28}+2.38\%$
test_step_mdp_speed[False-True-False-True-False] 58.8500μs 23.0842μs 43.3196 KOps/s 42.0392 KOps/s $\color{#35bf28}+3.05\%$
test_step_mdp_speed[False-True-False-False-True] 2.6900ms 22.9928μs 43.4918 KOps/s 41.5826 KOps/s $\color{#35bf28}+4.59\%$
test_step_mdp_speed[False-True-False-False-False] 46.9770μs 14.8087μs 67.5281 KOps/s 66.1411 KOps/s $\color{#35bf28}+2.10\%$
test_step_mdp_speed[False-False-True-True-True] 79.6980μs 37.0454μs 26.9939 KOps/s 26.0595 KOps/s $\color{#35bf28}+3.59\%$
test_step_mdp_speed[False-False-True-True-False] 63.0070μs 24.8952μs 40.1684 KOps/s 38.5904 KOps/s $\color{#35bf28}+4.09\%$
test_step_mdp_speed[False-False-True-False-True] 57.4470μs 23.2660μs 42.9812 KOps/s 42.2943 KOps/s $\color{#35bf28}+1.62\%$
test_step_mdp_speed[False-False-True-False-False] 42.1380μs 14.8523μs 67.3298 KOps/s 64.9245 KOps/s $\color{#35bf28}+3.70\%$
test_step_mdp_speed[False-False-False-True-True] 90.8790μs 39.1203μs 25.5622 KOps/s 25.0366 KOps/s $\color{#35bf28}+2.10\%$
test_step_mdp_speed[False-False-False-True-False] 56.4750μs 26.7041μs 37.4475 KOps/s 36.4240 KOps/s $\color{#35bf28}+2.81\%$
test_step_mdp_speed[False-False-False-False-True] 58.6690μs 24.4980μs 40.8196 KOps/s 39.4741 KOps/s $\color{#35bf28}+3.41\%$
test_step_mdp_speed[False-False-False-False-False] 50.2430μs 16.6595μs 60.0258 KOps/s 58.3478 KOps/s $\color{#35bf28}+2.88\%$
test_values[generalized_advantage_estimate-True-True] 9.7979ms 9.5542ms 104.6658 Ops/s 101.6218 Ops/s $\color{#35bf28}+3.00\%$
test_values[vec_generalized_advantage_estimate-True-True] 28.9062ms 26.2314ms 38.1223 Ops/s 37.2799 Ops/s $\color{#35bf28}+2.26\%$
test_values[td0_return_estimate-False-False] 0.2512ms 0.1774ms 5.6361 KOps/s 5.9880 KOps/s $\textbf{\color{#d91a1a}-5.88\%}$
test_values[td1_return_estimate-False-False] 25.3671ms 24.0733ms 41.5397 Ops/s 41.2346 Ops/s $\color{#35bf28}+0.74\%$
test_values[vec_td1_return_estimate-False-False] 28.8143ms 26.2737ms 38.0608 Ops/s 38.3081 Ops/s $\color{#d91a1a}-0.65\%$
test_values[td_lambda_return_estimate-True-False] 38.2920ms 34.6483ms 28.8615 Ops/s 29.5602 Ops/s $\color{#d91a1a}-2.36\%$
test_values[vec_td_lambda_return_estimate-True-False] 28.7826ms 26.1794ms 38.1980 Ops/s 38.5483 Ops/s $\color{#d91a1a}-0.91\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.7474ms 8.5626ms 116.7869 Ops/s 118.3007 Ops/s $\color{#d91a1a}-1.28\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.3428ms 1.8832ms 531.0142 Ops/s 518.9798 Ops/s $\color{#35bf28}+2.32\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.6363ms 0.3733ms 2.6791 KOps/s 2.7566 KOps/s $\color{#d91a1a}-2.81\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 46.8767ms 42.4601ms 23.5515 Ops/s 22.9410 Ops/s $\color{#35bf28}+2.66\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 4.3098ms 3.4415ms 290.5700 Ops/s 276.5872 Ops/s $\textbf{\color{#35bf28}+5.06\%}$
test_dqn_speed[False-None] 5.5840ms 1.3968ms 715.9254 Ops/s 710.5885 Ops/s $\color{#35bf28}+0.75\%$
test_dqn_speed[False-backward] 1.9577ms 1.8807ms 531.7310 Ops/s 538.6935 Ops/s $\color{#d91a1a}-1.29\%$
test_dqn_speed[True-None] 0.7874ms 0.5711ms 1.7511 KOps/s 1.7576 KOps/s $\color{#d91a1a}-0.37\%$
test_dqn_speed[True-backward] 1.0504ms 0.9928ms 1.0072 KOps/s 881.6799 Ops/s $\textbf{\color{#35bf28}+14.24\%}$
test_dqn_speed[reduce-overhead-None] 0.7695ms 0.5692ms 1.7567 KOps/s 1.7565 KOps/s $\color{#35bf28}+0.01\%$
test_dqn_speed[reduce-overhead-backward] 1.1537ms 1.0422ms 959.4820 Ops/s 996.5146 Ops/s $\color{#d91a1a}-3.72\%$
test_ddpg_speed[False-None] 3.3094ms 2.9126ms 343.3358 Ops/s 333.6995 Ops/s $\color{#35bf28}+2.89\%$
test_ddpg_speed[False-backward] 4.2384ms 4.1046ms 243.6275 Ops/s 250.1651 Ops/s $\color{#d91a1a}-2.61\%$
test_ddpg_speed[True-None] 2.2984ms 1.4382ms 695.3323 Ops/s 686.4513 Ops/s $\color{#35bf28}+1.29\%$
test_ddpg_speed[True-backward] 2.4438ms 2.3530ms 424.9857 Ops/s 344.0060 Ops/s $\textbf{\color{#35bf28}+23.54\%}$
test_ddpg_speed[reduce-overhead-None] 1.7292ms 1.4456ms 691.7720 Ops/s 528.3948 Ops/s $\textbf{\color{#35bf28}+30.92\%}$
test_ddpg_speed[reduce-overhead-backward] 2.5704ms 2.4003ms 416.6194 Ops/s 426.3473 Ops/s $\color{#d91a1a}-2.28\%$
test_sac_speed[False-None] 8.5471ms 7.9499ms 125.7872 Ops/s 125.7696 Ops/s $\color{#35bf28}+0.01\%$
test_sac_speed[False-backward] 11.0000ms 10.6372ms 94.0100 Ops/s 90.8780 Ops/s $\color{#35bf28}+3.45\%$
test_sac_speed[True-None] 2.9275ms 2.5826ms 387.2011 Ops/s 384.3611 Ops/s $\color{#35bf28}+0.74\%$
test_sac_speed[True-backward] 4.6476ms 4.2961ms 232.7669 Ops/s 233.6785 Ops/s $\color{#d91a1a}-0.39\%$
test_sac_speed[reduce-overhead-None] 3.1060ms 2.7164ms 368.1306 Ops/s 382.2311 Ops/s $\color{#d91a1a}-3.69\%$
test_sac_speed[reduce-overhead-backward] 4.3861ms 4.2945ms 232.8566 Ops/s 229.0667 Ops/s $\color{#35bf28}+1.65\%$
test_redq_speed[False-None] 17.2471ms 13.1872ms 75.8309 Ops/s 71.9372 Ops/s $\textbf{\color{#35bf28}+5.41\%}$
test_redq_speed[False-backward] 30.0758ms 23.1444ms 43.2069 Ops/s 43.7234 Ops/s $\color{#d91a1a}-1.18\%$
test_redq_speed[True-None] 8.0510ms 6.9789ms 143.2881 Ops/s 147.6916 Ops/s $\color{#d91a1a}-2.98\%$
test_redq_speed[True-backward] 15.2481ms 14.3812ms 69.5350 Ops/s 71.4628 Ops/s $\color{#d91a1a}-2.70\%$
test_redq_speed[reduce-overhead-None] 7.6930ms 6.9031ms 144.8632 Ops/s 149.4777 Ops/s $\color{#d91a1a}-3.09\%$
test_redq_speed[reduce-overhead-backward] 15.5502ms 14.5290ms 68.8279 Ops/s 70.1560 Ops/s $\color{#d91a1a}-1.89\%$
test_redq_deprec_speed[False-None] 14.8151ms 13.0493ms 76.6324 Ops/s 77.1306 Ops/s $\color{#d91a1a}-0.65\%$
test_redq_deprec_speed[False-backward] 19.6489ms 18.8238ms 53.1242 Ops/s 53.7997 Ops/s $\color{#d91a1a}-1.26\%$
test_redq_deprec_speed[True-None] 6.0285ms 5.3494ms 186.9354 Ops/s 190.9870 Ops/s $\color{#d91a1a}-2.12\%$
test_redq_deprec_speed[True-backward] 11.7134ms 10.4265ms 95.9095 Ops/s 99.5371 Ops/s $\color{#d91a1a}-3.64\%$
test_redq_deprec_speed[reduce-overhead-None] 6.0089ms 5.3487ms 186.9609 Ops/s 192.4319 Ops/s $\color{#d91a1a}-2.84\%$
test_redq_deprec_speed[reduce-overhead-backward] 11.8305ms 10.6680ms 93.7379 Ops/s 99.9470 Ops/s $\textbf{\color{#d91a1a}-6.21\%}$
test_td3_speed[False-None] 8.7301ms 8.1606ms 122.5400 Ops/s 122.7372 Ops/s $\color{#d91a1a}-0.16\%$
test_td3_speed[False-backward] 12.4362ms 10.7149ms 93.3277 Ops/s 94.1588 Ops/s $\color{#d91a1a}-0.88\%$
test_td3_speed[True-None] 2.8495ms 2.3110ms 432.7212 Ops/s 432.0780 Ops/s $\color{#35bf28}+0.15\%$
test_td3_speed[True-backward] 4.0773ms 3.9704ms 251.8625 Ops/s 253.5291 Ops/s $\color{#d91a1a}-0.66\%$
test_td3_speed[reduce-overhead-None] 2.5871ms 2.3080ms 433.2799 Ops/s 441.2388 Ops/s $\color{#d91a1a}-1.80\%$
test_td3_speed[reduce-overhead-backward] 5.6157ms 4.7163ms 212.0315 Ops/s 258.1731 Ops/s $\textbf{\color{#d91a1a}-17.87\%}$
test_cql_speed[False-None] 40.0753ms 37.6727ms 26.5444 Ops/s 27.3301 Ops/s $\color{#d91a1a}-2.87\%$
test_cql_speed[False-backward] 48.8433ms 47.0039ms 21.2748 Ops/s 21.5801 Ops/s $\color{#d91a1a}-1.41\%$
test_cql_speed[True-None] 23.3339ms 22.2231ms 44.9982 Ops/s 45.0749 Ops/s $\color{#d91a1a}-0.17\%$
test_cql_speed[True-backward] 30.6209ms 29.1243ms 34.3355 Ops/s 34.1290 Ops/s $\color{#35bf28}+0.61\%$
test_cql_speed[reduce-overhead-None] 23.3408ms 22.3070ms 44.8289 Ops/s 45.1467 Ops/s $\color{#d91a1a}-0.70\%$
test_cql_speed[reduce-overhead-backward] 31.4677ms 29.3980ms 34.0160 Ops/s 34.4657 Ops/s $\color{#d91a1a}-1.30\%$
test_a2c_speed[False-None] 8.7752ms 7.1726ms 139.4200 Ops/s 138.2385 Ops/s $\color{#35bf28}+0.85\%$
test_a2c_speed[False-backward] 16.3144ms 14.4760ms 69.0800 Ops/s 69.5794 Ops/s $\color{#d91a1a}-0.72\%$
test_a2c_speed[True-None] 5.5967ms 4.6432ms 215.3691 Ops/s 213.2761 Ops/s $\color{#35bf28}+0.98\%$
test_a2c_speed[True-backward] 12.2317ms 11.0647ms 90.3774 Ops/s 90.1002 Ops/s $\color{#35bf28}+0.31\%$
test_a2c_speed[reduce-overhead-None] 5.5214ms 4.6516ms 214.9815 Ops/s 213.7761 Ops/s $\color{#35bf28}+0.56\%$
test_a2c_speed[reduce-overhead-backward] 12.1259ms 11.0312ms 90.6519 Ops/s 90.3491 Ops/s $\color{#35bf28}+0.34\%$
test_ppo_speed[False-None] 8.3173ms 7.4332ms 134.5312 Ops/s 130.5104 Ops/s $\color{#35bf28}+3.08\%$
test_ppo_speed[False-backward] 17.0875ms 15.0149ms 66.6004 Ops/s 68.6395 Ops/s $\color{#d91a1a}-2.97\%$
test_ppo_speed[True-None] 5.6693ms 5.0426ms 198.3084 Ops/s 197.6480 Ops/s $\color{#35bf28}+0.33\%$
test_ppo_speed[True-backward] 12.1738ms 10.8375ms 92.2720 Ops/s 90.8910 Ops/s $\color{#35bf28}+1.52\%$
test_ppo_speed[reduce-overhead-None] 6.0375ms 5.0347ms 198.6204 Ops/s 198.2630 Ops/s $\color{#35bf28}+0.18\%$
test_ppo_speed[reduce-overhead-backward] 11.5938ms 10.9683ms 91.1714 Ops/s 91.3200 Ops/s $\color{#d91a1a}-0.16\%$
test_reinforce_speed[False-None] 8.0824ms 6.6683ms 149.9639 Ops/s 152.7429 Ops/s $\color{#d91a1a}-1.82\%$
test_reinforce_speed[False-backward] 10.4809ms 9.9181ms 100.8260 Ops/s 100.9387 Ops/s $\color{#d91a1a}-0.11\%$
test_reinforce_speed[True-None] 5.2775ms 4.2631ms 234.5725 Ops/s 245.0719 Ops/s $\color{#d91a1a}-4.28\%$
test_reinforce_speed[True-backward] 10.7388ms 9.9643ms 100.3579 Ops/s 99.9740 Ops/s $\color{#35bf28}+0.38\%$
test_reinforce_speed[reduce-overhead-None] 4.5059ms 4.0490ms 246.9725 Ops/s 242.8943 Ops/s $\color{#35bf28}+1.68\%$
test_reinforce_speed[reduce-overhead-backward] 10.6991ms 10.3433ms 96.6807 Ops/s 97.0595 Ops/s $\color{#d91a1a}-0.39\%$
test_iql_speed[False-None] 33.9498ms 32.4103ms 30.8544 Ops/s 29.7140 Ops/s $\color{#35bf28}+3.84\%$
test_iql_speed[False-backward] 56.2555ms 45.8781ms 21.7969 Ops/s 21.3632 Ops/s $\color{#35bf28}+2.03\%$
test_iql_speed[True-None] 17.5049ms 16.0121ms 62.4527 Ops/s 61.7223 Ops/s $\color{#35bf28}+1.18\%$
test_iql_speed[True-backward] 29.4720ms 27.3815ms 36.5210 Ops/s 36.5171 Ops/s $\color{#35bf28}+0.01\%$
test_iql_speed[reduce-overhead-None] 17.6345ms 16.3528ms 61.1517 Ops/s 62.0563 Ops/s $\color{#d91a1a}-1.46\%$
test_iql_speed[reduce-overhead-backward] 30.1095ms 27.7641ms 36.0178 Ops/s 36.0707 Ops/s $\color{#d91a1a}-0.15\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.2966ms 4.9058ms 203.8406 Ops/s 203.4708 Ops/s $\color{#35bf28}+0.18\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7846ms 0.5270ms 1.8974 KOps/s 1.9056 KOps/s $\color{#d91a1a}-0.43\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7475ms 0.4997ms 2.0012 KOps/s 1.9763 KOps/s $\color{#35bf28}+1.26\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.5331ms 4.6762ms 213.8506 Ops/s 215.6979 Ops/s $\color{#d91a1a}-0.86\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 2.3062ms 0.5054ms 1.9788 KOps/s 1.9429 KOps/s $\color{#35bf28}+1.85\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7171ms 0.4914ms 2.0350 KOps/s 2.0282 KOps/s $\color{#35bf28}+0.34\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.2816ms 1.6890ms 592.0717 Ops/s 597.4442 Ops/s $\color{#d91a1a}-0.90\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 2.4373ms 1.5862ms 630.4307 Ops/s 635.5282 Ops/s $\color{#d91a1a}-0.80\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 7.7536ms 4.8083ms 207.9725 Ops/s 210.2942 Ops/s $\color{#d91a1a}-1.10\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 2.1295ms 0.6647ms 1.5044 KOps/s 1.5393 KOps/s $\color{#d91a1a}-2.27\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.9142ms 0.6391ms 1.5647 KOps/s 1.5889 KOps/s $\color{#d91a1a}-1.52\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 7.6570ms 4.6891ms 213.2586 Ops/s 219.5564 Ops/s $\color{#d91a1a}-2.87\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.3494ms 0.5249ms 1.9051 KOps/s 1.8905 KOps/s $\color{#35bf28}+0.77\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.8383ms 0.5033ms 1.9870 KOps/s 2.0300 KOps/s $\color{#d91a1a}-2.12\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.8948ms 4.6722ms 214.0336 Ops/s 224.5320 Ops/s $\color{#d91a1a}-4.68\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 2.2613ms 0.5232ms 1.9114 KOps/s 1.9755 KOps/s $\color{#d91a1a}-3.24\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6841ms 0.4885ms 2.0471 KOps/s 2.0201 KOps/s $\color{#35bf28}+1.34\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.1897ms 4.8602ms 205.7533 Ops/s 212.1149 Ops/s $\color{#d91a1a}-3.00\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 2.7253ms 0.6722ms 1.4876 KOps/s 1.5190 KOps/s $\color{#d91a1a}-2.07\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.9102ms 0.6387ms 1.5658 KOps/s 1.5892 KOps/s $\color{#d91a1a}-1.47\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 6.1299ms 4.3728ms 228.6840 Ops/s 235.0534 Ops/s $\color{#d91a1a}-2.71\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 8.3818ms 2.3240ms 430.3011 Ops/s 449.6787 Ops/s $\color{#d91a1a}-4.31\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 6.1518ms 1.6013ms 624.4734 Ops/s 684.1909 Ops/s $\textbf{\color{#d91a1a}-8.73\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 6.1112ms 4.4690ms 223.7639 Ops/s 24.2549 Ops/s $\textbf{\color{#35bf28}+822.55\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 6.8693ms 2.3412ms 427.1361 Ops/s 429.9436 Ops/s $\color{#d91a1a}-0.65\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.7595ms 1.2524ms 798.4505 Ops/s 705.0748 Ops/s $\textbf{\color{#35bf28}+13.24\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.7501s 19.5157ms 51.2407 Ops/s 220.0601 Ops/s $\textbf{\color{#d91a1a}-76.72\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 8.9952ms 2.5061ms 399.0334 Ops/s 369.6850 Ops/s $\textbf{\color{#35bf28}+7.94\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.0974ms 1.5017ms 665.8907 Ops/s 643.0874 Ops/s $\color{#35bf28}+3.55\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 13.7099ms 12.4490ms 80.3281 Ops/s 79.3920 Ops/s $\color{#35bf28}+1.18\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 15.4786ms 14.3785ms 69.5481 Ops/s 69.8648 Ops/s $\color{#d91a1a}-0.45\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 23.8690ms 21.4683ms 46.5803 Ops/s 46.7554 Ops/s $\color{#d91a1a}-0.37\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 16.1271ms 14.6634ms 68.1969 Ops/s 67.1990 Ops/s $\color{#35bf28}+1.48\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 23.3099ms 21.2732ms 47.0074 Ops/s 47.3347 Ops/s $\color{#d91a1a}-0.69\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 17.2881ms 16.0462ms 62.3202 Ops/s 62.7082 Ops/s $\color{#d91a1a}-0.62\%$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@vmoens @facebook-github-bot
点击 这是indexloc提供的php浏览器服务，不要输入任何密码和下载