Skip to content

Acceleration Patcher, new AttentionAndDistributedPacking Plugin (previously ilab), Benchmarking Fixes
Compare
Choose a tag to compare
@fabianlim fabianlim released this 05 Sep 23:53
· 21 commits to main since this release
v0.3.0
c29a8ce

Release

  • framework v0.3, minor version: Acceleration Patcher now provided in framework.
  • aadp v0.1, new_plugin: Replacement of the ilab plugin
  • peft v0.2.0: minor version bump. support all-linear in target_modules
  • foak v0.2.1: patch release: formatting fixes

What's Changed

  • Rectify Missing Dataloader Preparation Call in PaddingFree Plugin Method by @achew010 in #63
  • Rename Plugin to AttentionAndDistributedPacking by @achew010 in #64
  • Add Benchmarking Compatibility to PaddingFree Plugin by @achew010 in #66
  • Benchmarking: Add Response Field to Use Chat Templates Without Response Template by @fabianlim in #68
  • Add Acceleration Patcher and MultiPack Plugin by @fabianlim in #67
  • Fix formatter by @achew010 in #74
  • Allow PaddingFree to work with DataCollatorForCompletionOnlyLM by @fabianlim in #78
  • fixed bug in peft installation for gptqmodel by @achew010 in #81

Full Changelog: v0.2.0...v0.3.0

Contributors

fabianlim and achew010
Assets 2
Loading