Add benchmark regression alert

Not sure what's the appropriate value for the alert threshold, set it to 3% for now. Signed-off-by: Thing-han, Lim <[email protected]>
pq-code-package · Nov 18, 2024 · 33efd04 · 33efd04
1 parent 78008a2
commit 33efd04
Show file tree

Hide file tree

Showing 2 changed files with 4 additions and 0 deletions.
diff --git a/.github/actions/bench/action.yml b/.github/actions/bench/action.yml
@@ -92,3 +92,6 @@ runs:
         output-file-path: output.json
         github-token: ${{ inputs.gh_token }}
         auto-push: true
+        comment-on-alert: true
+        summary-always: true
+        alert-threshold: 103%
diff --git a/.github/workflows/bench.yml b/.github/workflows/bench.yml
@@ -3,6 +3,7 @@
 name: Bench
 permissions:
   contents: read
+  pull-requests: write
 on:
   workflow_dispatch:
   push: