This repository was archived by the owner on Aug 31, 2023. It is now read-only.
feat(ci): add a new PR command to benchmark the CLI with hyperfine #3764
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
This adds a new
!bench_cli
command similar to the existing!bench_*
comments we can use to trigger benchmark runs of the analyzer, formatter and parser on pull requests. The CLI is special though as it's usinghyperfine
to run the actual CLI binary on the same repos used for the benchmark suite inbenchmark/
(Webpack, Prettier and ESLint), as opposed to usingcriterion
to benchmark individual parts of the toolchain.Test Plan
Unfortunately I don't think I can run this workflow without merging it first, hopefully it shouldn't take too many tries to get it to work correctly ...