Skip to content

Commit

Permalink
Update eval_output_logging_callback.py
Browse files Browse the repository at this point in the history
  • Loading branch information
sjawhar authored Jun 14, 2024
1 parent 8fe9fe7 commit d7afd8a
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion llmfoundry/callbacks/eval_output_logging_callback.py
Original file line number Diff line number Diff line change
Expand Up @@ -60,7 +60,7 @@ def eval_batch_end(self, state: State, logger: Logger) -> None:
for input_list in input_ids.tolist():
dataset = state.dataloader.dataset # pyright: ignore[reportGeneralTypeIssues]
depadded_input = [
tok for tok in input_list if tok != dataset.tokenizer.pad_toked_id
tok for tok in input_list if tok != dataset.tokenizer.pad_token_id
]
logged_input.append(dataset.tokenizer.decode(depadded_input))
logging_dict['input'] = logged_input
Expand Down

0 comments on commit d7afd8a

Please sign in to comment.