Overview
This patch includes support for fine-tuning Llama3 with torchtune as well as various improvements to the library.
New Features & Improvements
Recipes
- Added configuration for Llama2 13B QLoRA (#779)
- Added support for Llama2 70B LoRA (#788)
Models
- Added support for Llama3 (#793)
Utils
- Improvements to Weights & Biases logger (#772, #777)
Documentation
- Added Llama3 tutorial (#793)
- Updated E2E tutorial with instructions for uploading to the Hugging Face Hub (#773)
- Updates to the README (#775, #778, #786)
- Added instructions for installing torchtune nightly (#792)
