Skip to content

Commit

Permalink
Update advancedformatting.md
Browse files Browse the repository at this point in the history
  • Loading branch information
Cohee1207 authored Sep 22, 2023
1 parent ca17dab commit 6e5ff5f
Showing 1 changed file with 0 additions and 26 deletions.
26 changes: 0 additions & 26 deletions Usage/Core Concepts/advancedformatting.md
Original file line number Diff line number Diff line change
Expand Up @@ -94,29 +94,3 @@ Supported APIs:
2. oobabooga's Text Generation WebUI
3. NovelAI
4. OpenAI, including via OpenRouter (max 4 strings)

### Multigen

*This feature provides a pseudo-streaming functionality that conflicts with token streaming. When Multigen is enabled and generation API supports streaming, only Multigen streaming will be used.*

SillyTavern tries to create faster and longer responses by chaining the generation using smaller batches.

#### Default settings

First batch = 50 tokens

Next batches = 30 tokens

#### Algorithm

1. Generate the first batch (if the amount of generation setting is more than batch length).
2. Generate the next batch of tokens until one of the stopping conditions is reached.
3. Append the generated text to the next cycle's prompt.

#### Stopping conditions

1. Generated enough text.
2. The character starts speaking for You.
3. <|endoftext|> token reached.
4. No text generated.
5. Stop sequence generated. (Instruct mode only)

0 comments on commit 6e5ff5f

Please sign in to comment.