TaPS v0.2.2

Highlights

This release add official support for TaskVine and a new physics app based on https://github.com/globus-labs/globus-compute-golf-demo.

What's Changed

New Features

• Add TaskVine executor support by @gpauloski in #174
• Enable metric recording metrics when using ProxyTransformer by @gpauloski in #183
• Add physics app based on Globus Compute golf demo by @gpauloski in #186

Bug Fixes

• Fix __qualname__ AttributeError in config parsing with Pydantic >= 2.10 by @gpauloski in #180
• Remove all Parsl channels by @gpauloski in #185

Full Changelog: v0.2.1...v0.2.2

TaPS v0.2.1

Highlights

This release makes a number of quality of life improvements, bugs fixes, and internal changes to how tasks are represented to improve executor compatibility.

What's Changed

Breaking Changes

• Remove AllFilter and NullTransformer and improve breadth/detail of logging by @gpauloski in #146

New Features

• Add monitoring config to Parsl HTEx by @ClaudiaCumberbatch in #106
• Add manager_selector to Parsl HTEx config by @matthewc2003 in #118
• Allow multiple Parsl HTEx executors in ParslHTExConfig by @ClaudiaCumberbatch in #142
• Add the @task() decorator so task functions can be serialized by reference by @gpauloski in #143
• Add wait_for_workers flag in Dask Distributed config and executor (#131) by @gpauloski in #144
• Forbid extra fields in engine plugin config types by @gpauloski in #147
• Raise task errors in synthetic bag-of-tasks app by @gpauloski in #148
• Support custom number of warmup tasks and fix last batch size in synthetic app by @gpauloski in #149
• Add async_resolve option to ProxyTransformer and make RunConfig.env_vars optional by @gpauloski in #150
• Add warning to failures app guide about dill version incompatibility by @gpauloski in #159
• Refactor environment collection and log to file by @gpauloski in #162

Bug Fixes

• Ensure run_dir is an absolute path by @gpauloski in #111
• Fix Dask Futures getting proxied in chained tasks by @gpauloski in #113
• Log failed tasks in moldesign when resubmitting by @gpauloski in #114
• Record total virtual memory instead of available by @gpauloski in #125
• Fix concurrency bug in FutureDependencyExecutor by @gpauloski in #145
• Fix not fully defined pydantic model Client of fedlearn app by @gpauloski in #153
• Make child task submission idempotent and thread-safe in FuturesDependencyExecutor by @gpauloski in #158
• Fill dill serialization of tasks when using the failures app by @gpauloski in #163

Improvements

• Add tests for Cholesky app by @gpauloski in #101
• Add tests for mapreduce app by @gpauloski in #102
• Add tests for montage app by @gpauloski in #104
• Add tests for remaining app configs by @gpauloski in #105
• Refactor taps.engine module layout by @gpauloski in #115
• Use non-deprecated Parsl provider for tests by @gpauloski in #128
• Create Config docstrings from Field descriptions by @gpauloski in #137

Documentation

• Fix typo in docs mapreduce example by @gpauloski in #103
• Fix typo in CLI argument for Cholesky example by @gpauloski in #116
• Add FAQ and update Github templates and contributing guide by @gpauloski in #117
• Add TaPS preprint citation by @gpauloski in #129
• Upgrade doc dependencies and templates by @gpauloski in #136
• Update logo, icon, and color palette by @gpauloski in #138
• Update tips for resolving libsqlite linking error docking app guide by @gpauloski in #157
• Update citation with official publication by @gpauloski in #166
• Improve readability of doc figures in dark mode by @gpauloski in #168

Package

• Extend Ray dependency to Python 3.12 by @gpauloski in #170

New Contributors

• @matthewc2003 made their first contribution in #118

Full Changelog: v0.2.0...v0.2.1

TaPS v0.2.0

Highlights

This release contains a complete overhaul of the TaPS plugin and configuration system.

What's Changed

Breaking Changes

• Replace the plugin/configuration system with new version that is more extensible by @gpauloski in #75
• Rename DAGExecutor to FutureDependencyExecutor by @gpauloski in #77
• Refactor import structure to simplify imports and docs by @gpauloski in #92
• Improve Parsl configuration extensibility by @gpauloski in #94
• Support arbitrary ProxyStore configurations in ProxyTransformerConfig by @gpauloski in #97

New Features

• Add failure injection app by @ClaudiaCumberbatch in #80
• Automatically resolve pathlib.Path types in AppConfig by @gpauloski in #83
• Support multiple config files in CLI with --config by @gpauloski in #84
• Increase logged information and validate TaPS config versions by @gpauloski in #88
• Support configuring environment variables by @gpauloski in #90
• Add object-type filter to the CLI and add support for pattern matching against type names by @gpauloski in #91

Bug Fixes

• Fix exception logging in task callback by @gpauloski in #81
• Fix injected failures not recoverable from on retry by @gpauloski in #95

Improvements

• Rename default transformer filter behavior to "all" by @gpauloski in #87
• Increase timedelta in directory creation check by @gpauloski in #89

Documentation

• Add figures and tables to docs by @gpauloski in #72
• Add guides for configuration, executors, and data management by @gpauloski in #86
• Add guide for custom benchmark scripts by @gpauloski in #96

Package

• Update LICENSE authors by @gpauloski in #70

New Contributors

• @ClaudiaCumberbatch made their first contribution in #80

Full Changelog: v0.1.0...v0.2.0

TaPS v0.1.0

This is the first release of the TaPS package! Check out the docs to learn more!

What's Changed

Breaking Changes

• Create initial package structure by @gpauloski in #1
• Improve configuration and fix CI by @gpauloski in #4
• Add WorkflowExecutor by @gpauloski in #7
• Add simple synthetic benchmark by @gpauloski in #8
• Refactor WorkflowExecutor and improve logging by @gpauloski in #11
• Add the moldesign application and refactor app registration system by @gpauloski in #37
• Add data transformers to CLI by @gpauloski in #45
• Triage minor errors from paper evaluation by @gpauloski in #56
• Refactor TaPS package by @gpauloski in #57
• Refactor applications and update instructions by @gpauloski in #66

New Features

• Add DAG Executor wrapper by @gpauloski in #6
• Add ProcessPoolExecutor support by @gpauloski in #9
• Add data transfomers and basic integration with WorkflowExecutor by @gpauloski in #10
• Add as_completed and wait for TaskFuture by @gpauloski in #27
• Add Cholesky decomposition workflow by @MaximeGonthier in #25
• Mapreduce Workflow by @haochenpan in #24
• Add Dask and Parsl support by @gpauloski in #26
• Federated Learning workflow implementation by @nathaniel-hudson in #28
• Added Montage workflow by @ValHayot in #29
• Assorted usability improvements by @gpauloski in #30
• Add Docking workflow implementation by @ValHayot in #31
• Add the RayExecutor by @gpauloski in #34
• Expand synthetic workflow by @gpauloski in #40
• Only wrap functions once in WorkflowExecutor and fix Globus Compute by @gpauloski in #48
• Add close() to DataTransformer by @gpauloski in #60
• Add {executor} option to run dir by @gpauloski in #61

Bug Fixes

• Partially revert changes in #48 by @gpauloski in #49
• Add missing step in workflow by @ValHayot in #51
• Fix ProxyStore serialization issue with Ray by @gpauloski in #62

Improvements

• Remove upper bound on task times in tests by @gpauloski in #46

Documentation

• Add documentation site by @gpauloski in #5
• Update the creating workflows guide by @gpauloski in #12
• Update README and release guide by @gpauloski in #67

Package

• Change GitHub URL to taps by @gpauloski in #47
• Fix publish workflow and release template by @gpauloski in #68

New Contributors

• @gpauloski made their first contribution in #1
• @pre-commit-ci made their first contribution in #3
• @MaximeGonthier made their first contribution in #25
• @haochenpan made their first contribution in #24
• @nathaniel-hudson made their first contribution in #28
• @ValHayot made their first contribution in #29

Full Changelog: https://github.com/proxystore/taps/commits/v0.1.0