Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add an option to disable using the distributed scheduler from the diagnostic script #3787

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

bouweandela
Copy link
Member

Description

Some diagnostic scripts do not work with the distributed scheduler. Typically this happens because they insert large numpy arrays into the task graph, which subsequently leads to the scheduler killing the worker because they exceed their maximum allowed amount of memory. This adds an option to use the default scheduler for some diagnostic scripts by specifying no_distributed: true in the diagnostic script settings.

The diagnostic script in recipe_eady_growth_rate.yml does not work with the distributed scheduler. This pull request disables using the distributed scheduler for that recipe.

  • Link to documentation:

Before you get started

Checklist

It is the responsibility of the author to make sure the pull request is ready to review. The icons indicate whether the item will be subject to the 🛠 Technical or 🧪 Scientific review.


To help with the number of pull requests:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant