Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

handle stopped tasks without throwing error #57

Merged
merged 1 commit into from
Nov 9, 2023
Merged

Conversation

mshannon-sil
Copy link
Collaborator

@mshannon-sil mshannon-sil commented Nov 9, 2023

This PR ensures that we catch exceptions caused by stopping a clearml task without reraising the exception or marking the task as failed. Also, the check_canceled() function is now called before progress updates are made in the _ProgressCallback methods rather than after.

In addition, I removed the stopping status in the check_canceled() function since it's not listed under task_status_enum.


This change is Reviewable

Copy link
Contributor

@ddaspit ddaspit left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:lgtm:

Reviewed 2 of 2 files at r1, all commit messages.
Reviewable status: :shipit: complete! all files reviewed, all discussions resolved (waiting on @johnml1135)

Copy link
Collaborator

@johnml1135 johnml1135 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed 2 of 2 files at r1, all commit messages.
Reviewable status: :shipit: complete! all files reviewed, all discussions resolved (waiting on @mshannon-sil)

@johnml1135 johnml1135 merged commit daa1b8e into main Nov 9, 2023
14 checks passed
@mshannon-sil mshannon-sil deleted the #56_stopped_task branch November 17, 2023 15:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Status: ✅ Done
Development

Successfully merging this pull request may close these issues.

Updating ClearML Task after stopped faults build Nonexistent status "stopping" in clearml_check_canceled()
3 participants