Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Check coverage matrix #10475

Open
kesselb opened this issue Dec 10, 2024 · 0 comments
Open

Check coverage matrix #10475

kesselb opened this issue Dec 10, 2024 · 0 comments

Comments

@kesselb
Copy link
Contributor

kesselb commented Dec 10, 2024

To do: Check if we could reduce the coverage matrix.

Why? The CI runs with coverage are usually a bit slower, and it takes some time for Codecov to process the results.

The initial reason to look into this topic were some issues when updating the Codecov action, leading to a "flanky" coverage score. This was resolved by settings the working-directory for the action: #9401 (comment)

Example: https://app.codecov.io/gh/nextcloud/mail/commit/63f31a2009e3c0a4aef9e56b9a471ddcaf40ea26

Image

Workflow: https://github.com/nextcloud/mail/blob/63f31a2009e3c0a4aef9e56b9a471ddcaf40ea26/.github/workflows/test.yml

Unit:

matrix:
php-versions: ['8.1', '8.2', '8.3']
nextcloud-versions: ['master', 'stable30']
include:
- php-versions: '8.4'
nextcloud-versions: 'master'

The coverage is calculated if php = 8.3
=> 2x coverage

Integration:

matrix:
php-versions: ['8.3']
nextcloud-versions: ['master']
db: ['sqlite', 'mysql', 'pgsql']
cache: ['nocache']
include:
- php-versions: 8.1
nextcloud-versions: master
db: 'sqlite'
cache: 'redis'
- php-versions: 8.2
nextcloud-versions: master
db: 'mysql'
cache: 'redis'
- php-versions: 8.2
nextcloud-versions: stable30
db: 'mysql'
cache: 'redis'

The coverage is calculated if db = mysql
=> 4x coverage

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant