Skip to content

Commit

Permalink
Merge pull request #568 from pq-code-package/quickcheck-dev-null
Browse files Browse the repository at this point in the history 
CI: Don't suppress output of `make quickcheck`
  • Loading branch information
@hanno-becker
hanno-becker authored Dec 22, 2024
2 parents 23dbf5e + 8d8dad3 commit d2984df
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions .github/workflows/ci_ec2_container.yml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -147,9 +147,9 @@ jobs:
sudo: ""
- name: make quickcheck
run: |
OPT=0 make quickcheck >/dev/null
OPT=0 make quickcheck
make clean >/dev/null
OPT=1 make quickcheck >/dev/null
OPT=1 make quickcheck
- name: Functional Tests
uses: ./.github/actions/multi-functest
with:
Expand Down

18 comments on commit d2984df

@oqs-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A76 (Raspberry Pi 5) benchmarks

Benchmark suite Current: d2984df Previous: 23dbf5e Ratio
ML-KEM-512 keypair 29019 cycles 29017 cycles 1.00
ML-KEM-512 encaps 35399 cycles 35397 cycles 1.00
ML-KEM-512 decaps 45885 cycles 45883 cycles 1.00
ML-KEM-768 keypair 49349 cycles 49351 cycles 1.00
ML-KEM-768 encaps 55573 cycles 55573 cycles 1
ML-KEM-768 decaps 70333 cycles 70334 cycles 1.00
ML-KEM-1024 keypair 72070 cycles 72074 cycles 1.00
ML-KEM-1024 encaps 80840 cycles 80841 cycles 1.00
ML-KEM-1024 decaps 100673 cycles 100675 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@oqs-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Intel Xeon 4th gen (c7i)

Benchmark suite Current: d2984df Previous: 23dbf5e Ratio
ML-KEM-512 keypair 13528 cycles 13505 cycles 1.00
ML-KEM-512 encaps 17322 cycles 17242 cycles 1.00
ML-KEM-512 decaps 22867 cycles 22712 cycles 1.01
ML-KEM-768 keypair 22526 cycles 22511 cycles 1.00
ML-KEM-768 encaps 24580 cycles 24493 cycles 1.00
ML-KEM-768 decaps 32603 cycles 32521 cycles 1.00
ML-KEM-1024 keypair 31368 cycles 31354 cycles 1.00
ML-KEM-1024 encaps 34901 cycles 34888 cycles 1.00
ML-KEM-1024 decaps 45808 cycles 45734 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@oqs-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMD EPYC 3rd gen (c6a)

Benchmark suite Current: d2984df Previous: 23dbf5e Ratio
ML-KEM-512 keypair 18130 cycles 18136 cycles 1.00
ML-KEM-512 encaps 23199 cycles 23195 cycles 1.00
ML-KEM-512 decaps 30495 cycles 30495 cycles 1
ML-KEM-768 keypair 31066 cycles 31073 cycles 1.00
ML-KEM-768 encaps 34136 cycles 34179 cycles 1.00
ML-KEM-768 decaps 44729 cycles 44829 cycles 1.00
ML-KEM-1024 keypair 44593 cycles 44590 cycles 1.00
ML-KEM-1024 encaps 49870 cycles 49958 cycles 1.00
ML-KEM-1024 decaps 64348 cycles 64416 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@oqs-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMD EPYC 4th gen (c7a)

Benchmark suite Current: d2984df Previous: 23dbf5e Ratio
ML-KEM-512 keypair 15076 cycles 15080 cycles 1.00
ML-KEM-512 encaps 19659 cycles 19653 cycles 1.00
ML-KEM-512 decaps 26322 cycles 26313 cycles 1.00
ML-KEM-768 keypair 25602 cycles 25600 cycles 1.00
ML-KEM-768 encaps 28132 cycles 28255 cycles 1.00
ML-KEM-768 decaps 37862 cycles 37951 cycles 1.00
ML-KEM-1024 keypair 35646 cycles 35883 cycles 0.99
ML-KEM-1024 encaps 41015 cycles 41046 cycles 1.00
ML-KEM-1024 decaps 54482 cycles 54564 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@oqs-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Intel Xeon 3rd gen (c6i)

Benchmark suite Current: d2984df Previous: 23dbf5e Ratio
ML-KEM-512 keypair 20337 cycles 20332 cycles 1.00
ML-KEM-512 encaps 27000 cycles 27008 cycles 1.00
ML-KEM-512 decaps 35835 cycles 36113 cycles 0.99
ML-KEM-768 keypair 34902 cycles 34897 cycles 1.00
ML-KEM-768 encaps 38168 cycles 38186 cycles 1.00
ML-KEM-768 decaps 50942 cycles 50934 cycles 1.00
ML-KEM-1024 keypair 47941 cycles 47973 cycles 1.00
ML-KEM-1024 encaps 54109 cycles 54157 cycles 1.00
ML-KEM-1024 decaps 71681 cycles 71715 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@oqs-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Intel Xeon 4th gen (c7i) (no-opt)

Benchmark suite Current: d2984df Previous: 23dbf5e Ratio
ML-KEM-512 keypair 34907 cycles 34883 cycles 1.00
ML-KEM-512 encaps 45013 cycles 44981 cycles 1.00
ML-KEM-512 decaps 58996 cycles 58972 cycles 1.00
ML-KEM-768 keypair 59194 cycles 59095 cycles 1.00
ML-KEM-768 encaps 71834 cycles 71799 cycles 1.00
ML-KEM-768 decaps 89370 cycles 89222 cycles 1.00
ML-KEM-1024 keypair 87495 cycles 87676 cycles 1.00
ML-KEM-1024 encaps 104667 cycles 104718 cycles 1.00
ML-KEM-1024 decaps 127577 cycles 127625 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@oqs-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton3

Benchmark suite Current: d2984df Previous: 23dbf5e Ratio
ML-KEM-512 keypair 18967 cycles 18966 cycles 1.00
ML-KEM-512 encaps 23554 cycles 23556 cycles 1.00
ML-KEM-512 decaps 30665 cycles 30663 cycles 1.00
ML-KEM-768 keypair 32294 cycles 32294 cycles 1
ML-KEM-768 encaps 35884 cycles 35887 cycles 1.00
ML-KEM-768 decaps 46027 cycles 46029 cycles 1.00
ML-KEM-1024 keypair 46629 cycles 46628 cycles 1.00
ML-KEM-1024 encaps 52443 cycles 52444 cycles 1.00
ML-KEM-1024 decaps 66244 cycles 66247 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@oqs-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton2

Benchmark suite Current: d2984df Previous: 23dbf5e Ratio
ML-KEM-512 keypair 29024 cycles 29024 cycles 1
ML-KEM-512 encaps 35408 cycles 35405 cycles 1.00
ML-KEM-512 decaps 45895 cycles 45889 cycles 1.00
ML-KEM-768 keypair 49364 cycles 49369 cycles 1.00
ML-KEM-768 encaps 55584 cycles 55597 cycles 1.00
ML-KEM-768 decaps 70302 cycles 70320 cycles 1.00
ML-KEM-1024 keypair 72015 cycles 72009 cycles 1.00
ML-KEM-1024 encaps 80785 cycles 80792 cycles 1.00
ML-KEM-1024 decaps 100663 cycles 100656 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@oqs-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMD EPYC 3rd gen (c6a) (no-opt)

Benchmark suite Current: d2984df Previous: 23dbf5e Ratio
ML-KEM-512 keypair 52154 cycles 52166 cycles 1.00
ML-KEM-512 encaps 65752 cycles 65781 cycles 1.00
ML-KEM-512 decaps 88395 cycles 88401 cycles 1.00
ML-KEM-768 keypair 84769 cycles 84793 cycles 1.00
ML-KEM-768 encaps 101476 cycles 101493 cycles 1.00
ML-KEM-768 decaps 132457 cycles 132118 cycles 1.00
ML-KEM-1024 keypair 124089 cycles 124208 cycles 1.00
ML-KEM-1024 encaps 145773 cycles 146072 cycles 1.00
ML-KEM-1024 decaps 184014 cycles 184102 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@oqs-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMD EPYC 4th gen (c7a) (no-opt)

Benchmark suite Current: d2984df Previous: 23dbf5e Ratio
ML-KEM-512 keypair 45746 cycles 45755 cycles 1.00
ML-KEM-512 encaps 56884 cycles 56865 cycles 1.00
ML-KEM-512 decaps 76246 cycles 76240 cycles 1.00
ML-KEM-768 keypair 74525 cycles 74509 cycles 1.00
ML-KEM-768 encaps 88591 cycles 88553 cycles 1.00
ML-KEM-768 decaps 114407 cycles 114396 cycles 1.00
ML-KEM-1024 keypair 109428 cycles 109659 cycles 1.00
ML-KEM-1024 encaps 127243 cycles 127293 cycles 1.00
ML-KEM-1024 decaps 160218 cycles 159996 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@oqs-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A55 (Snapdragon 888) benchmarks

Benchmark suite Current: d2984df Previous: 23dbf5e Ratio
ML-KEM-512 keypair 58340 cycles 58344 cycles 1.00
ML-KEM-512 encaps 65767 cycles 65800 cycles 1.00
ML-KEM-512 decaps 84598 cycles 84639 cycles 1.00
ML-KEM-768 keypair 98930 cycles 98930 cycles 1
ML-KEM-768 encaps 110570 cycles 110435 cycles 1.00
ML-KEM-768 decaps 137103 cycles 137154 cycles 1.00
ML-KEM-1024 keypair 150550 cycles 150286 cycles 1.00
ML-KEM-1024 encaps 166678 cycles 166707 cycles 1.00
ML-KEM-1024 decaps 203150 cycles 202556 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@oqs-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Intel Xeon 3rd gen (c6i) (no-opt)

Benchmark suite Current: d2984df Previous: 23dbf5e Ratio
ML-KEM-512 keypair 56588 cycles 56571 cycles 1.00
ML-KEM-512 encaps 69417 cycles 69426 cycles 1.00
ML-KEM-512 decaps 91327 cycles 91378 cycles 1.00
ML-KEM-768 keypair 91796 cycles 91925 cycles 1.00
ML-KEM-768 encaps 107779 cycles 107798 cycles 1.00
ML-KEM-768 decaps 136299 cycles 136378 cycles 1.00
ML-KEM-1024 keypair 134732 cycles 134898 cycles 1.00
ML-KEM-1024 encaps 155124 cycles 155403 cycles 1.00
ML-KEM-1024 decaps 191440 cycles 191535 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@oqs-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton3 (no-opt)

Benchmark suite Current: d2984df Previous: 23dbf5e Ratio
ML-KEM-512 keypair 45389 cycles 45391 cycles 1.00
ML-KEM-512 encaps 54214 cycles 54212 cycles 1.00
ML-KEM-512 decaps 71150 cycles 71153 cycles 1.00
ML-KEM-768 keypair 74822 cycles 74825 cycles 1.00
ML-KEM-768 encaps 86060 cycles 86060 cycles 1
ML-KEM-768 decaps 108802 cycles 108808 cycles 1.00
ML-KEM-1024 keypair 111122 cycles 111119 cycles 1.00
ML-KEM-1024 encaps 125929 cycles 125929 cycles 1
ML-KEM-1024 decaps 154621 cycles 154628 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@oqs-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton4

Benchmark suite Current: d2984df Previous: 23dbf5e Ratio
ML-KEM-512 keypair 18139 cycles 18137 cycles 1.00
ML-KEM-512 encaps 22155 cycles 22155 cycles 1
ML-KEM-512 decaps 28791 cycles 28791 cycles 1
ML-KEM-768 keypair 30573 cycles 30570 cycles 1.00
ML-KEM-768 encaps 33632 cycles 33640 cycles 1.00
ML-KEM-768 decaps 43172 cycles 43178 cycles 1.00
ML-KEM-1024 keypair 44211 cycles 44212 cycles 1.00
ML-KEM-1024 encaps 49660 cycles 49661 cycles 1.00
ML-KEM-1024 decaps 62657 cycles 62654 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@oqs-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton2 (no-opt)

Benchmark suite Current: d2984df Previous: 23dbf5e Ratio
ML-KEM-512 keypair 71240 cycles 71257 cycles 1.00
ML-KEM-512 encaps 85190 cycles 85054 cycles 1.00
ML-KEM-512 decaps 112992 cycles 112751 cycles 1.00
ML-KEM-768 keypair 117748 cycles 117562 cycles 1.00
ML-KEM-768 encaps 135401 cycles 135262 cycles 1.00
ML-KEM-768 decaps 172006 cycles 171877 cycles 1.00
ML-KEM-1024 keypair 174401 cycles 175038 cycles 1.00
ML-KEM-1024 encaps 196619 cycles 197168 cycles 1.00
ML-KEM-1024 decaps 242631 cycles 243395 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@oqs-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Graviton4 (no-opt)

Benchmark suite Current: d2984df Previous: 23dbf5e Ratio
ML-KEM-512 keypair 41967 cycles 41968 cycles 1.00
ML-KEM-512 encaps 50161 cycles 50158 cycles 1.00
ML-KEM-512 decaps 66048 cycles 66050 cycles 1.00
ML-KEM-768 keypair 69055 cycles 69056 cycles 1.00
ML-KEM-768 encaps 79755 cycles 79761 cycles 1.00
ML-KEM-768 decaps 101014 cycles 101019 cycles 1.00
ML-KEM-1024 keypair 102463 cycles 102201 cycles 1.00
ML-KEM-1024 encaps 117440 cycles 117201 cycles 1.00
ML-KEM-1024 decaps 143369 cycles 143701 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@oqs-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Bananapi bpi-f3 benchmarks

Benchmark suite Current: d2984df Previous: 23dbf5e Ratio
ML-KEM-512 keypair 335120 cycles 335142 cycles 1.00
ML-KEM-512 encaps 445834 cycles 445713 cycles 1.00
ML-KEM-512 decaps 593943 cycles 593994 cycles 1.00
ML-KEM-768 keypair 556216 cycles 556308 cycles 1.00
ML-KEM-768 encaps 698152 cycles 698270 cycles 1.00
ML-KEM-768 decaps 890491 cycles 890554 cycles 1.00
ML-KEM-1024 keypair 821595 cycles 821551 cycles 1.00
ML-KEM-1024 encaps 998541 cycles 998382 cycles 1.00
ML-KEM-1024 decaps 1230777 cycles 1230526 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

@oqs-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Arm Cortex-A72 (Raspberry Pi 4) benchmarks

Benchmark suite Current: d2984df Previous: 23dbf5e Ratio
ML-KEM-512 keypair 51861 cycles 51670 cycles 1.00
ML-KEM-512 encaps 58416 cycles 58241 cycles 1.00
ML-KEM-512 decaps 74366 cycles 75145 cycles 0.99
ML-KEM-768 keypair 87599 cycles 87784 cycles 1.00
ML-KEM-768 encaps 96283 cycles 96595 cycles 1.00
ML-KEM-768 decaps 119489 cycles 119985 cycles 1.00
ML-KEM-1024 keypair 132152 cycles 131161 cycles 1.01
ML-KEM-1024 encaps 146498 cycles 145356 cycles 1.01
ML-KEM-1024 decaps 175757 cycles 175084 cycles 1.00

This comment was automatically generated by workflow using github-action-benchmark.

Please sign in to comment.