Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Verify Interchange terminates on HTEX shutdown #3081

Merged
merged 5 commits into from
Feb 20, 2024
Merged

Conversation

rjmello
Copy link
Member

@rjmello rjmello commented Feb 16, 2024

Description

We give the Interchange process 10 seconds to terminate when calling the HTEX shutdown() method. If it doesn't terminate after 10 seconds, we'll add an informative log to notify the user of the stuck process, and then continue.

I've also updated the tests in test_htex.py to ensure we call htex.shutdown() at the end of each test.

Fixes #3080

Type of change

  • Bug fix
  • Code maintenance/cleanup

@rjmello rjmello added bug executor:htex globus-compute Issues that globus-compute team might be interested in fixing labels Feb 16, 2024
@rjmello rjmello force-pushed the htex-shutdown-#3080 branch from 6970725 to 792b52e Compare February 16, 2024 20:54
Copy link
Collaborator

@khk-globus khk-globus left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me, though I don't see a need for hasattr(), and an open question regarding whether we .kill() the process. I don't currently have in mind the larger setup here, so ... either wait until Monday, or get @benclifford to chime in. 😉

parsl/executors/high_throughput/executor.py Outdated Show resolved Hide resolved
parsl/executors/high_throughput/executor.py Outdated Show resolved Hide resolved
parsl/executors/high_throughput/executor.py Outdated Show resolved Hide resolved
parsl/tests/test_htex/test_htex.py Outdated Show resolved Hide resolved
@rjmello rjmello force-pushed the htex-shutdown-#3080 branch from 792b52e to 5299112 Compare February 17, 2024 21:10
@rjmello rjmello force-pushed the htex-shutdown-#3080 branch from 5299112 to c5a0ccf Compare February 18, 2024 16:23
@benclifford benclifford merged commit 604d28d into master Feb 20, 2024
6 checks passed
@benclifford benclifford deleted the htex-shutdown-#3080 branch February 20, 2024 15:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug executor:htex globus-compute Issues that globus-compute team might be interested in fixing
Projects
None yet
Development

Successfully merging this pull request may close these issues.

test_htex does not shut down all of its test htexes
3 participants