Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dev kmr #469

Merged
merged 4 commits into from
Feb 26, 2024
Merged

Dev kmr #469

merged 4 commits into from
Feb 26, 2024

Conversation

k-rister
Copy link
Contributor

No description provided.

- verbosely log errors so that they can easily be identified

- add retry logic to podman logs collection because it can fail when
  podman is under heavy load due to lock contention
…aded job processing model

- when there were many endpoints in use it could take a very long time
  to perform endpoint validation when done serially

- by switching to a multi-threaded model multiple endpoints can be
  validated in parallel and it significantly speeds up the process

- multi-threading is used instead of a fork/multi-process model
  because data needs to be captured and shared back to main thread
  (return code status and STDOUT output)

- in tests run with 1024 endpoints and 16 parallel jobs (based on the
  number of controller CPUs) the validation time was reduced from over
  20 minutes to less than 2 minutes
@k-rister k-rister merged commit 382ab26 into master Feb 26, 2024
138 checks passed
@k-rister k-rister deleted the dev-kmr branch February 26, 2024 16:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

2 participants