+
Skip to content
This repository was archived by the owner on Aug 31, 2023. It is now read-only.

feat(ci): add a new PR command to benchmark the CLI with hyperfine #3764

Merged
merged 2 commits into from
Nov 16, 2022

Conversation

leops
Copy link
Contributor

@leops leops commented Nov 16, 2022

Summary

This adds a new !bench_cli command similar to the existing !bench_* comments we can use to trigger benchmark runs of the analyzer, formatter and parser on pull requests. The CLI is special though as it's using hyperfine to run the actual CLI binary on the same repos used for the benchmark suite in benchmark/ (Webpack, Prettier and ESLint), as opposed to using criterion to benchmark individual parts of the toolchain.

Test Plan

Unfortunately I don't think I can run this workflow without merging it first, hopefully it shouldn't take too many tries to get it to work correctly ...

@leops leops requested a review from a team November 16, 2022 14:09
@netlify
Copy link

netlify bot commented Nov 16, 2022

Deploy Preview for docs-rometools canceled.

Name Link
🔨 Latest commit 0498581
🔍 Latest deploy log https://app.netlify.com/sites/docs-rometools/deploys/6374f4dd6ba6c8000807c303

@leops leops merged commit b707af8 into main Nov 16, 2022
@leops leops deleted the feature/bench-cli branch November 16, 2022 14:39
@leops leops restored the feature/bench-cli branch November 16, 2022 14:39
@leops leops deleted the feature/bench-cli branch November 16, 2022 14:44
@github-actions
Copy link

Command Mean [ms] Min [ms] Max [ms] Relative
Rome (main) 906.0 ± 82.0 864.9 1126.7 1.00
Rome (PR) 908.4 ± 101.2 867.6 1193.6 1.00 ± 0.14
Command Mean [s] Min [s] Max [s] Relative
:--- ---: ---: ---: ---:
Rome (main) 1.143 ± 0.034 1.111 1.224 1.02 ± 0.03
Rome (PR) 1.124 ± 0.015 1.101 1.143 1.00

@github-actions
Copy link

Command Mean [ms] Min [ms] Max [ms] Relative
Rome (main) 858.7 ± 4.9 852.4 871.0 1.00
Rome (PR) 870.3 ± 42.4 850.5 990.6 1.01 ± 0.05
Command Mean [s] Min [s] Max [s] Relative
Rome (main) 1.107 ± 0.024 1.069 1.164 1.00 ± 0.02
Rome (PR) 1.101 ± 0.004 1.095 1.108 1.00

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants
点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载