You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The batch_extract and batch_reduce functions within batch_utils module uses progressbar to estimate the time remaining and print them to STDOUT and cannot be turned off. The new batch aggregation feature uses this library and progressbar ends up printing thousands of lines to the worker logs, including the same number many times (depending on the speed of the action). It would be great if this could either be turned off or have the frequency that it prints lowered to something that wouldn't flood the logs quite so much.
The text was updated successfully, but these errors were encountered:
The
batch_extract
andbatch_reduce
functions withinbatch_utils
module uses progressbar to estimate the time remaining and print them to STDOUT and cannot be turned off. The new batch aggregation feature uses this library and progressbar ends up printing thousands of lines to the worker logs, including the same number many times (depending on the speed of the action). It would be great if this could either be turned off or have the frequency that it prints lowered to something that wouldn't flood the logs quite so much.The text was updated successfully, but these errors were encountered: