Skip to content

Commit

Permalink
Fix GPT2 test
Browse files Browse the repository at this point in the history
  • Loading branch information
Rocketknight1 committed Jul 2, 2024
1 parent 1446a25 commit 5e146b2
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions tests/models/gpt2/test_tokenization_gpt2.py
Original file line number Diff line number Diff line change
Expand Up @@ -280,6 +280,7 @@ def test_special_tokens_mask_input_pairs_and_bos_token(self):
@require_jinja
def test_tokenization_for_chat(self):
tokenizer = GPT2Tokenizer.from_pretrained(self.tmpdirname)
tokenizer.chat_template = '{% for message in messages %}{{ message.content }}{{ eos_token }}{% endfor %}'
test_chats = [
[{"role": "system", "content": "You are a helpful chatbot."}, {"role": "user", "content": "Hello!"}],
[
Expand Down

0 comments on commit 5e146b2

Please sign in to comment.