From be485e68ab44f351a71104429d4e52c500dcf102 Mon Sep 17 00:00:00 2001 From: Christopher Harris Date: Fri, 1 Nov 2024 12:53:47 -0500 Subject: [PATCH] Add known issue for dask shutdown (#2027) See https://github.com/nv-morpheus/Morpheus/issues/2026 ## By Submitting this PR I confirm: - I am familiar with the [Contributing Guidelines](https://github.com/nv-morpheus/Morpheus/blob/main/docs/source/developer_guide/contributing.md). - When the PR is ready for review, new or existing tests cover these changes. - When the PR is ready for review, the documentation is up to date with these changes. Authors: - Christopher Harris (https://github.com/cwharris) Approvers: - David Gardner (https://github.com/dagardner-nv) URL: https://github.com/nv-morpheus/Morpheus/pull/2027 --- docs/source/extra_info/known_issues.md | 1 + examples/ransomware_detection/README.md | 2 ++ 2 files changed, 3 insertions(+) diff --git a/docs/source/extra_info/known_issues.md b/docs/source/extra_info/known_issues.md index b009da5ce9..d8173f1002 100644 --- a/docs/source/extra_info/known_issues.md +++ b/docs/source/extra_info/known_issues.md @@ -18,5 +18,6 @@ limitations under the License. # Known Issues - `vdb_upload` example pipeline triggers an internal error in Triton ([#1649](https://github.com/nv-morpheus/Morpheus/issues/1649)) +- `ransomware_detection` example pipeline occasionally logs a `distributed.comm.core.CommClosedError` error during shutdown ([#2026](https://github.com/nv-morpheus/Morpheus/issues/2026)). Refer to [open issues in the Morpheus project](https://github.com/nv-morpheus/Morpheus/issues) diff --git a/examples/ransomware_detection/README.md b/examples/ransomware_detection/README.md index 4b15a30b71..9d19b7820a 100644 --- a/examples/ransomware_detection/README.md +++ b/examples/ransomware_detection/README.md @@ -121,3 +121,5 @@ Options: output will be saved. --help Show this message and exit. ``` + +> **Note**: There is a known race condition in `dask.distributed` which occasionally causes `tornado.iostream.StreamClosedError` to be raised during shutdown, but does not affect the output of the pipeline. If you see this exception during shutdown, it is typically safe to ignore unless it corresponds to other undesirable behavior. For more information see ([#2026](https://github.com/nv-morpheus/Morpheus/issues/2026)).