Skip to content
This repository has been archived by the owner on Aug 30, 2024. It is now read-only.

Commit

Permalink
fix llama load error
Browse files Browse the repository at this point in the history
Signed-off-by: intellinjun <[email protected]>
  • Loading branch information
intellinjun committed Feb 23, 2024
1 parent 2abcb14 commit 4a01f65
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion neural_speed/models/llama/llama_utils.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -193,7 +193,7 @@ void Llama::load(model_context* ctx, model_progress_callback progress_callback,

// ffn GEMM

if (ml->verify_tensor(layers_i + ".feed_forward")) {
if (ml->verify_tensor(layers_i + ".feed_forward.w1.weight")) {
layer.ffn[0] = ml->get_tensor(layers_i + ".feed_forward.w1.weight", {n_embd, n_ff}, backend);
layer.ffn[1] = ml->get_tensor(layers_i + ".feed_forward.w2.weight", {n_ff, n_embd}, backend);
layer.ffn[2] = ml->get_tensor(layers_i + ".feed_forward.w3.weight", {n_embd, n_ff}, backend);
Expand Down

0 comments on commit 4a01f65

Please sign in to comment.