release/7.6.1

We are pleased to announce the release of version 7.6.1
of the Cooperative Computing Tools from the University of Notre Dame,
including TaskVine, Work Queue, Makeflow, Parrot, Chirp, and other software.

• Docs: https://cctools.readthedocs.io/
• Download: http://ccl.cse.nd.edu/software/download
• Forum: http://ccl.cse.nd.edu/community/forum

This release introduces several bug fixes and minor improvementsto the TaskVine workflow executor and Work Queue scheduler.
TaskVine:

• Fix bug in task scheduling that would result in manager hanging.  (Colin Thomas)
• Fix bug in execution of Dask task graphs that would lead to a hang.  (Ben Tovar)
• Fix bug in deployment of serverless LibraryTask.  (Thanh Phung)
• Add option to specify Python package dependencies inline.  (Barry Sly-Delgado)
• Add visualization of task graph and documentation. (Douglas Thain)

Work Queue:

• Fix bug in task scheduling that would result in manager hanging.  (Colin Thomas)

release/7.6.1rc1

We are pleased to announce the release of version 7.6.1
of the Cooperative Computing Tools from the University of Notre Dame,
including TaskVine, Work Queue, Makeflow, Parrot, Chirp, and other software.

• Docs: https://cctools.readthedocs.io/
• Download: http://ccl.cse.nd.edu/software/download
• Forum: http://ccl.cse.nd.edu/community/forum

This release introduces several bug fixes and minor improvementsto the TaskVine workflow executor and Work Queue scheduler.

TaskVine:

• Fix bug in task scheduling that would result in manager hanging.  (Colin Thomas)
• Fix bug in execution of Dask task graphs that would lead to a hang.  (Ben Tovar)
• Fix bug in deployment of serverless LibraryTask.  (Thanh Phung)
• Add option to specify Python package dependencies inline.  (Barry Sly-Delgado)
• Add visualization of task graph and documentation. (Douglas Thain)

Work Queue:

• Fix bug in task scheduling that would result in manager hanging.  (Colin Thomas)

release/7.6.0

bump to version 7.6.0

release/7.5.5

• TaskVine: Fixes for dask executor in TaskVine
• TaskVine: Fix for non-cached files being shared in peer transfers
• TaskVine: Re-computation of temp files when workers are lost.

release/7.5.5rc1

bump to 7.5.5rc1

release/7.5.4

Fixes for dask executor

release/7.5.3

• Experimental support to run dask task graphs with TaskVine
• Python modules should now be imported as, e.g., import ndcctools.taskvine. import taskvine prints a deprecation warning.

release/7.5.2

• vine: remove : from log directory names as it is special in the shell (no-op) (#3269)
  

• TaskVine: Big Manual Update (#3268)
  

• add command line options to vine_example_blast.py (#3270)
  

• print default value of options in plotting tool (#3271)
  

• Reproducibility edits to BGD example (#3265)
  

• updates with name, port to bgd (#3275)
  

release/7.5.1

• add CCTOOLS_OPSYS as a var available for tests (#3125)
  

• configure: detect conda (#3126)
  

• py: vine examples fix error messages (#3128)
  

• vine: New Cachenames (Merge and Fixup) (#3120)
  

• vine: Fix up Examples (#3133)
  

• vine: Schedule to Files by Default (#3134)
  

• poncho_package_create: fallback to $CONDA_EXE (#3138)
  

• vine: Reorganized Use of MD5 (#3142)
  

• Enable coprocess to start with poncho_package_run (#3123)
  

• vine xrootd (#3132)
  

• vine py: do not double raise on error (#3135)
  

• remove always-true condition (#3143)
  

• vine: Cleanup Debug Output (#3139)
  

• change to octal number instead of decimal (#3147)
  

• delete cache on startup/shutdown, uid+pid workspace (#3144)
  

• adds commit times, attempt number to transactions log (#3152)
  

• vine symlink to most recent logs (#3153)
  

• Disable (but don't yet remove old) taskvine JSON API proxy. (#3145)
  

• Vine: Simplified Output Buffer API (#3149)
  

• int file->length to size_t file->size (#3154)
  

• Vine: minitask input file transfer fix (#3155)
  

• Vine declare file (#3157)
  

• Vine: Added logging and graphing capabilities for duties (#3150)
  

• Vine: File Replica Table (#3151)
  

• Pythonify examples (#3163)
  

• adds cache directory at vine_runtime_info_path/ (#3171)
  

• Workqueue: Fixes for BenC running serverless with Parsl (#3161)
  

• Add startime io updates (#3172)
  

• use usecs instead of seconds in transfer transactions (#3174)
  

•  Vine: Peer Transfer Flags in vine_file (#3173)
  

• Task declaration with keywords and **dict
  

• adds size input info to running state transaction (#3176)
  

• reimplement parsing for vine_plot_txn_log with dataframes (#3175)
  

• rework enable_monitoring API (#3178)
  

• Fix plot cache update bug (#3179)
  

• Adds vine_declare_chirp (#3186)
  

• correctly plot tasks attempts lost on disconnect (#3187)
  

• Allow plot of partial logs (for plots while workflow still active) (#3189)
  

• Fix proportional resources and resource multiplier (#3190)
  

• More realistic Blast example uses 16 random queries for each task. (#3177)
  

• Vine: Add complex Blast example in C (#3191)
  

• Vine: file_flags and mount_flags (#3181)
  

• work_queue: Adding coprocesses-total default (#3180)
  

• Add files to file_table when they are declared (#3193)
  

• Adds caching flags for vine files (#3195)
  

• Cleanup add files (#3192)
  

• Edit main loop using vine_tune (#3194)
  

• Rename file flags (#3197)
  

• Fixes for cache name and replicas (#3200)
  

• adds s = vine_task_get_resources(t, name) (#3201)
  

• remove deprecated -py3 from swig command line (#3202)
  

• Assign slots to executing tasks by default (#3203)
  

• only untar if it does not look like the directory already has an untared environment (#3206)
  

• Comment blast c example (#3205)
  

• Adds execution environments to tasks (#3208)
  

• non-interactive tzconfig for apptainer (#3209)
  

• remove add_{in,out}put_* from task dict (#3204)
  

• Add env parameter to declare_xrootd (#3210)
  

• guard against worker replicas not yet declared at the manager (#3212)
  

• adds remove_file to python bindings (#3213)
  

• mark temp files with VINE_CACHE (#3211)
  

• update chirp and mosaic python examples to use add_environment (#3214)
  

• use same time window for final summary and log series (#3215)
  

• vine py: remove methods that added files to tasks without declaring them at the manager (#3207)
  

• Poncho run_in_env (#3220)
  

• vine: display for jupyter notebooks (#3223)
  

• on failure to start a transfer server, terminate worker (#3224)
  

• forbid sharing minitasks, for now (#3225)
  

• vine py: SSL fixes (#3226)
  

• vine factory: vine understand manager_status, no queue_status (#3228)
  

• ssl better logs (#3229)
  

• do not str None (#3230)
  

• Vine: serverless rename and create_library_from_functions (#3170)
  

• vine library: small changes to function docs, example with command line arguments (#3232)
  

• vine factory: update config if factory already running (#3237)
  

• Fix status notebook for taskvine and wq (#3238)
  

• vine: Add resource monitor, track fds to test with valgrind (#3239)
  

• fix mini task flags (#3241)
  

• fix poncho doc examples, add json syntax (#3243)
  

• Fix double waiting log (#3245)
  

• adds tics at regular time intervals to vine_plot_txn_log, option to hide legend (#3246)
  

• adds strict input flag for input files, sort merge example (#3217)
  

• vine: fix cache path when only dir is needed (#3247)
  

• vine plot: fix issue where ticks did not respect origin (#3250)
  

• remove message when no coprocess is found with a given state (#3249)
  

• Serverless sandbox fix (#3248)
  

• taskvine: Library Plotting (#3251)
  

• vine: ensure log dir exists for ssl keys (#3256)
  

• vine: do not break out of mount loop when looking for transfers (#3253)
  

• Fix deprecations in github actions workflow (#3260)
  

• Fix auto mode (#3257)
  

• wq updates (#3261)
  

• Vine install examples (#3262)
  

• updates to taskvine to most recent version, marked todos (#3244)
  

• add stats mode to plot_txn_log (#3258)
  

• correctly activate auto-mode allocation tests (#3263)
  

• Conda from vars (#3264)
  

• add python to path for local tests (#3266)
  

• keep given prefix on CONDA_BUILD (#3267)
  

release/7.5.1rc4

bump to 7.5.1rc4