[BUG] A task should never report as running if the parent workflow is in a terminal phase

[katrogan]

Describe the bug

An internal workflow ran for 58 min before failing due to

RuntimeExecutionError: max number of system retry attempts [31/30] exhausted. Last known status message: failed at Node[n0]. RuntimeExecutionError: remote output for launchplan execution was not found, uri

The workflow consisted of one subworkflow which was still reporting running. We should never show any nodes or tasks as running when the top level workflow execution reports that it's in a terminal phase

Expected behavior

See description

Additional context to reproduce

No response

Screenshots

Are you sure this issue hasn't been raised already?

• Yes

Have you read the Code of Conduct?

• Yes

[katrogan]

cc @hamersaw @eapolinario

[github-actions]

Hello 👋, this issue has been inactive for over 9 months. To help maintain a clean and focused backlog, we'll be marking this issue as stale and will engage on it to decide if it is still applicable.
Thank you for your contribution and understanding! 🙏