Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tasks with uncertainty should enforce all folds have uncertainty #162

Open
ardunn opened this issue Jul 27, 2022 · 0 comments
Open

Tasks with uncertainty should enforce all folds have uncertainty #162

ardunn opened this issue Jul 27, 2022 · 0 comments
Assignees
Labels
code Anything having to do with matbench python package code high priority

Comments

@ardunn
Copy link
Collaborator

ardunn commented Jul 27, 2022

Right now, one fold can have uncertainty and others might not have uncertainty within a single task. A task should either have all folds with uncertainty or all folds without uncertainty, otherwise, there is potential for hard-to-debug problems down the line.

This must be implemented in MatbenchTask.validate()

@ardunn ardunn self-assigned this Jul 27, 2022
@ardunn ardunn added code Anything having to do with matbench python package code high priority labels Aug 13, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
code Anything having to do with matbench python package code high priority
Projects
None yet
Development

No branches or pull requests

1 participant