Skip to content

Commit

Permalink
Updated documentation for docs/source/reward_trainer.mdx to import th…
Browse files Browse the repository at this point in the history
…e correct Enum for the reward modelling LoRA config (#1092)
  • Loading branch information
cm2435 authored Dec 15, 2023
1 parent 48b3ef0 commit 8140129
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/source/reward_trainer.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ You should pass an `AutoModelForSequenceClassification` model to the [`RewardTra
Just pass a `peft_config` in the keyword arguments of [`RewardTrainer`], and the trainer should automatically take care of converting the model into a PEFT model!

```python
from peft import LoraConfig, task_type
from peft import LoraConfig, TaskType
from transformers import AutoModelForSequenceClassification, AutoTokenizer
from trl import RewardTrainer, RewardConfig

Expand Down

0 comments on commit 8140129

Please sign in to comment.