TaPS v0.2.1
Highlights
This release makes a number of quality of life improvements, bugs fixes, and internal changes to how tasks are represented to improve executor compatibility.
What's Changed
Breaking Changes
- Remove
AllFilter
andNullTransformer
and improve breadth/detail of logging by @gpauloski in #146
New Features
- Add monitoring config to Parsl HTEx by @ClaudiaCumberbatch in #106
- Add
manager_selector
to Parsl HTEx config by @matthewc2003 in #118 - Allow multiple Parsl HTEx executors in
ParslHTExConfig
by @ClaudiaCumberbatch in #142 - Add the
@task()
decorator so task functions can be serialized by reference by @gpauloski in #143 - Add
wait_for_workers
flag in Dask Distributed config and executor (#131) by @gpauloski in #144 - Forbid extra fields in engine plugin config types by @gpauloski in #147
- Raise task errors in synthetic bag-of-tasks app by @gpauloski in #148
- Support custom number of warmup tasks and fix last batch size in synthetic app by @gpauloski in #149
- Add
async_resolve
option toProxyTransformer
and makeRunConfig.env_vars
optional by @gpauloski in #150 - Add warning to failures app guide about dill version incompatibility by @gpauloski in #159
- Refactor environment collection and log to file by @gpauloski in #162
Bug Fixes
- Ensure
run_dir
is an absolute path by @gpauloski in #111 - Fix Dask
Future
s getting proxied in chained tasks by @gpauloski in #113 - Log failed tasks in moldesign when resubmitting by @gpauloski in #114
- Record total virtual memory instead of available by @gpauloski in #125
- Fix concurrency bug in
FutureDependencyExecutor
by @gpauloski in #145 - Fix not fully defined pydantic model
Client
of fedlearn app by @gpauloski in #153 - Make child task submission idempotent and thread-safe in
FuturesDependencyExecutor
by @gpauloski in #158 - Fill dill serialization of tasks when using the
failures
app by @gpauloski in #163
Improvements
- Add tests for Cholesky app by @gpauloski in #101
- Add tests for mapreduce app by @gpauloski in #102
- Add tests for montage app by @gpauloski in #104
- Add tests for remaining app configs by @gpauloski in #105
- Refactor
taps.engine
module layout by @gpauloski in #115 - Use non-deprecated Parsl provider for tests by @gpauloski in #128
- Create
Config
docstrings fromField
descriptions by @gpauloski in #137
Documentation
- Fix typo in docs mapreduce example by @gpauloski in #103
- Fix typo in CLI argument for Cholesky example by @gpauloski in #116
- Add FAQ and update Github templates and contributing guide by @gpauloski in #117
- Add TaPS preprint citation by @gpauloski in #129
- Upgrade doc dependencies and templates by @gpauloski in #136
- Update logo, icon, and color palette by @gpauloski in #138
- Update tips for resolving
libsqlite
linking error docking app guide by @gpauloski in #157 - Update citation with official publication by @gpauloski in #166
- Improve readability of doc figures in dark mode by @gpauloski in #168
Package
- Extend Ray dependency to Python 3.12 by @gpauloski in #170
New Contributors
- @matthewc2003 made their first contribution in #118
Full Changelog: v0.2.0...v0.2.1