What is the problem?

[xinghuan2hao]

Describe the bug

My model won't load.

Is there an existing issue for this?

• I have searched the existing issues

Reproduction

After I select the TheBloke_Chronos-Hermes-13B-SuperHOT-8K-GPTQ model and load it after selecting the llama.cpp in the model loader, I get an error

Screenshot

Logs

Traceback (most recent call last):

File "F:\AI\Text-generation-webui-C\modules\ui_model_menu.py", line 232, in load_model_wrapper


shared.model, shared.tokenizer = load_model(selected_model, loader)

                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "F:\AI\Text-generation-webui-C\modules\models.py", line 93, in load_model


output = load_func_map[loader](model_name)

         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "F:\AI\Text-generation-webui-C\modules\models.py", line 277, in llamacpp_loader


model_file = sorted(Path(f'{shared.args.model_dir}/{model_name}').glob('*.gguf'))[0]

             ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^

System Info

System: WIN11
GPU: Nvidia's 4080 mobile