Skip to content

Commit

Permalink
Sped up tests.
Browse files Browse the repository at this point in the history
  • Loading branch information
umarbutler committed May 18, 2024
1 parent 90bf1cc commit a044ff0
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion tests/test_semchunk.py
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ def tiktoken_token_counter(text: str) -> int:
return len(tiktoken_tokenizer.encode(text))

# Test chunking with a variety of chunk sizes.
for chunk_size in {1, 2, 512}:
for chunk_size in {1, 512, 1024}:
# Test chunking with a variety of texts.
for fileid in {'austen-emma.txt', 'carroll-alice.txt', 'shakespeare-macbeth.txt'}:
sample = gutenberg.raw(fileid)
Expand Down

0 comments on commit a044ff0

Please sign in to comment.