Skip to content

Commit

Permalink
fixed bug where kv_self.size is being set wrongly to the buffer size …
Browse files Browse the repository at this point in the history
…instead of the context size
  • Loading branch information
l3utterfly committed Oct 2, 2023
1 parent 9476b01 commit 7d14b33
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion llama.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -7276,7 +7276,7 @@ size_t llama_set_state_data(struct llama_context * ctx, uint8_t * src) {
}

ctx->kv_self.head = kv_ntok;
ctx->kv_self.size = kv_size;
ctx->kv_self.size = n_ctx;
}

const size_t nread = inp - src;
Expand Down

0 comments on commit 7d14b33

Please sign in to comment.