ctransformers Could not find module #521
Comments
|
I get this too when I try to load any models. I've tried reinstalling the c_transformer bindings but it didn't work. I've also tried deleting anything related to it in the personal_data folder, which reinstalled the binding and reported that it was loaded, but when I try to load a model I get the below error: |
|
I'm getting this same error. No GGUF models are loading whatsoever:
|
|
Hi. Pllease consider using llama_cpp_python binding for the time being. I'll take a look at the ctransformers and try to fix it. I did not use it for ages. |
Expected Behavior
Selected model after downloading it.
Current Behavior
It looks like you we couldn't load the model.
Here is the error message:
Could not find module 'D:\lollms-webui\installer_files\lollms_env\Lib\site-packages\ctransformers\lib\cuda\ctransformers.dll' (or one of its dependencies). Try using the full path with constructor syntax.
Steps to Reproduce
Please provide detailed steps to reproduce the issue.
Additional information:
Console log
Starting LOLLMS Web UI...
" ___ ___ ___ ___ ___ ___ "
" /_\ /\ \ /_\ /_\ /_\ /\ \ "
" /:/ / /::\ \ /:/ / /:/ / /::| | /::\ \ "
" /:/ / /:/:\ \ /:/ / /:/ / /:|:| | /:/\ \ \ "
" /:/ / /:/ :\ \ /:/ / /:/ / /:/|:|| :~\ \ \ "
"/:// /:// :_\ /:// /:// /:/ |::::_\ /\ :\ \ _\ "
":\ \ :\ \ /:/ / :\ \ :\ \ //~~/:/ / :\ :\ // "
" :\ \ :\ /:/ / :\ \ :\ \ /:/ / :\ :_\ "
" :\ \ :/:/ / :\ \ :\ \ /:/ / :/:/ / "
" :_\ ::/ / :_\ :_\ /:/ / ::/ / "
" // // // // // // "
By ParisNeo
Trying to use Configuration at :global_paths_cfg.yaml
global_paths_cfg.yaml not found! Searching in your home folder.
Welcome! It seems this is your first use of the new lollms app.
To make it clear where your data are stored, we now give the user the choice where to put its data.
This allows you to mutualize models which are heavy, between multiple lollms compatible apps.
You can change this at any time using the lollms-settings script or by simply change the content of the global_paths_cfg.yaml file.
Please provide a folder to store your configurations files, your models and your personal data (database, custom personalities etc).
Folder path: (..\personal_data):D:\lollms-webui\personal_data
Selected: D:\lollms-webui\personal_data
Execution path : D:\lollms-webui\lollms-webui
Local zoos folder found
----------------------Paths information-----------------------
personal_path:D:\lollms-webui\personal_data
personal_configuration_path:D:\lollms-webui\personal_data\configs
personal_discussions_path:D:\lollms-webui\personal_data\discussion_databases
personal_skills_path:D:\lollms-webui\personal_data\skill_databases
personal_models_path:D:\lollms-webui\personal_data\models
personal_user_infos_path:D:\lollms-webui\personal_data\user_infos
personal_trainers_path:D:\lollms-webui\personal_data\trainers
personal_trainers_path:D:\lollms-webui\personal_data\trainers\gptqlora
personal_data_path:D:\lollms-webui\personal_data\data
custom_personalities_path:D:\lollms-webui\personal_data\custom_personalities
custom_voices_path:D:\lollms-webui\personal_data\custom_voices
----------------------Zoo information-----------------------
bindings_zoo_path:D:\lollms-webui\lollms-webui\zoos\bindings_zoo
personalities_zoo_path:D:\lollms-webui\lollms-webui\zoos\personalities_zoo
extensions_zoo_path:D:\lollms-webui\lollms-webui\zoos\extensions_zoo
models_zoo_path:D:\lollms-webui\lollms-webui\zoos\models_zoo
Lollms_core found in the app space.
Pulling last lollms_core
fatal: detected dubious ownership in repository at 'D:/lollms-webui/lollms-webui/lollms_core'
'D:/lollms-webui/lollms-webui/lollms_core' is owned by:
'S-1-5-32-544'
but the current user is:
'S-1-5-21-1606981802-1035122992-1208744641-1001'
To add an exception for this directory, call:
safe_store_path found in the app space.
Pulling last safe_store_path
fatal: detected dubious ownership in repository at 'D:/lollms-webui/lollms-webui/utilities/safe_store'
'D:/lollms-webui/lollms-webui/utilities/safe_store' is owned by:
'S-1-5-32-544'
but the current user is:
'S-1-5-21-1606981802-1035122992-1208744641-1001'
To add an exception for this directory, call:
Bindings zoo found in your personal space.
Pulling last bindings zoo
fatal: detected dubious ownership in repository at 'D:/lollms-webui/lollms-webui/zoos/bindings_zoo'
'D:/lollms-webui/lollms-webui/zoos/bindings_zoo' is owned by:
'S-1-5-32-544'
but the current user is:
'S-1-5-21-1606981802-1035122992-1208744641-1001'
To add an exception for this directory, call:
Personalities zoo found in your personal space.
Pulling last personalities zoo
fatal: detected dubious ownership in repository at 'D:/lollms-webui/lollms-webui/zoos/personalities_zoo'
'D:/lollms-webui/lollms-webui/zoos/personalities_zoo' is owned by:
'S-1-5-32-544'
but the current user is:
'S-1-5-21-1606981802-1035122992-1208744641-1001'
To add an exception for this directory, call:
Extensions zoo found in your personal space.
Pulling last Extensions zoo
fatal: detected dubious ownership in repository at 'D:/lollms-webui/lollms-webui/zoos/extensions_zoo'
'D:/lollms-webui/lollms-webui/zoos/extensions_zoo' is owned by:
'S-1-5-32-544'
but the current user is:
'S-1-5-21-1606981802-1035122992-1208744641-1001'
To add an exception for this directory, call:
Models zoo found in your personal space.
Pulling last Models zoo
fatal: detected dubious ownership in repository at 'D:/lollms-webui/lollms-webui/zoos/models_zoo'
'D:/lollms-webui/lollms-webui/zoos/models_zoo' is owned by:
'S-1-5-32-544'
but the current user is:
'S-1-5-21-1606981802-1035122992-1208744641-1001'
To add an exception for this directory, call:
No binding selected
Personality lollms mounted successfully but no model is selected
Checking for updates from D:\lollms-webui\lollms-webui
Checking for updates from D:\lollms-webui\lollms-webui\lollms_core
Checking for updates from D:\lollms-webui\lollms-webui\utilities\safe_store
Checking discussions database... ok
Your personal data is stored here :D:\lollms-webui\personal_data
D:\lollms-webui\installer_files\lollms_env\Lib\site-packages\pydantic_internal_fields.py:151: UserWarning: Field "model_name" has conflict with protected namespace "model_".
You may be able to resolve this warning by setting
model_config['protected_namespaces'] = ().warnings.warn(
INFO: Started server process [12148]
INFO: Waiting for application startup.
INFO: Application startup complete.
INFO: Uvicorn running on http://localhost:9600 (Press CTRL+C to quit)
INFO: ::1:54552 - "GET /socket.io/?EIO=4&transport=polling&t=Owe8LN7 HTTP/1.1" 200 OK
INFO: ::1:54553 - "GET /socket.io/?EIO=4&transport=polling&t=Owe8LN7 HTTP/1.1" 200 OK
INFO: ::1:54552 - "GET /get_lollms_webui_version HTTP/1.1" 200 OK
INFO: ::1:54552 - "GET /get_versionID HTTP/1.1" 200 OK
Client U9zz13XR8kkNFHGuAAAC connected
INFO: ::1:54552 - "POST /socket.io/?EIO=4&transport=polling&t=Owe8LO7&sid=GBwpCgKIkIkvgjFBAAAA HTTP/1.1" 200 OK
INFO: ('::1', 54557) - "WebSocket /socket.io/?EIO=4&transport=websocket&sid=GBwpCgKIkIkvgjFBAAAA" [accepted]
INFO: ::1:54556 - "GET /socket.io/?EIO=4&transport=polling&t=Owe8LO8&sid=GBwpCgKIkIkvgjFBAAAA HTTP/1.1" 200 OK
INFO: ::1:54553 - "GET /socket.io/?EIO=4&transport=polling&t=Owe8LO8&sid=GBwpCgKIkIkvgjFBAAAA HTTP/1.1" 200 OK
INFO: ::1:54556 - "GET /socket.io/?EIO=4&transport=polling&t=Owe8LP2&sid=GBwpCgKIkIkvgjFBAAAA HTTP/1.1" 200 OK
INFO: ::1:54552 - "GET /get_config HTTP/1.1" 200 OK
INFO: ::1:54553 - "GET /socket.io/?EIO=4&transport=polling&t=Owe8LP2&sid=GBwpCgKIkIkvgjFBAAAA HTTP/1.1" 200 OK
INFO: ::1:54552 - "GET /list_databases HTTP/1.1" 200 OK
INFO: ::1:54552 - "GET /list_bindings HTTP/1.1" 200 OK
INFO: ::1:54552 - "GET /disk_usage HTTP/1.1" 200 OK
INFO: ::1:54552 - "GET /ram_usage HTTP/1.1" 200 OK
INFO: ::1:54552 - "GET /vram_usage HTTP/1.1" 200 OK
INFO: ::1:54552 - "GET /list_extensions HTTP/1.1" 200 OK
Listing all personalities
OK
INFO: ::1:54552 - "GET /get_all_personalities HTTP/1.1" 200 OK
INFO: ::1:54552 - "GET /get_available_models HTTP/1.1" 200 OK
INFO: ::1:54552 - "GET /list_models HTTP/1.1" 200 OK
INFO: ::1:54552 - "GET /get_active_model HTTP/1.1" 200 OK
INFO: ::1:54552 - "GET /get_model_status HTTP/1.1" 200 OK
INFO: ::1:54552 - "GET /list_discussions HTTP/1.1" 200 OK
Loading discussion for client U9zz13XR8kkNFHGuAAAC ... ok
INFO: ::1:54552 - "GET /get_current_personality_files_list HTTP/1.1" 200 OK
OK
╔══════════════════════════════════════════════════╗
║ Building mounted Personalities ║
╚══════════════════════════════════════════════════╝
selected model : generic/lollms
╔══════════════════════════════════════════════════╗
║ Done ║
╚══════════════════════════════════════════════════╝
INFO: ::1:54563 - "POST /apply_settings HTTP/1.1" 200 OK
Checking for updates from D:\lollms-webui\lollms-webui
INFO: ::1:54564 - "GET /get_config HTTP/1.1" 200 OK
Listing voices
INFO: ::1:54564 - "GET /user_infos/default_user.svg HTTP/1.1" 400 Bad Request
INFO: ::1:54566 - "GET /list_voices HTTP/1.1" 200 OK
INFO: ::1:54565 - "GET /list_personalities_categories HTTP/1.1" 200 OK
Checking for updates from D:\lollms-webui\lollms-webui\lollms_core
INFO: ::1:54564 - "GET /list_personalities?category=generic HTTP/1.1" 200 OK
INFO: ::1:54566 - "GET /list_extensions_categories HTTP/1.1" 200 OK
INFO: ::1:54565 - "GET /list_personalities_categories HTTP/1.1" 200 OK
INFO: ::1:54564 - "GET /list_extensions_categories HTTP/1.1" 200 OK
INFO: ::1:54564 - "GET /list_extensions?category=bound_extensions HTTP/1.1" 200 OK
Checking for updates from D:\lollms-webui\lollms-webui\utilities\safe_store
INFO: ::1:54563 - "GET /check_update HTTP/1.1" 200 OK
Unmounting binding and model
Installing binding
Collecting pyopencl
Using cached pyopencl-2024.1-cp311-cp311-win_amd64.whl.metadata (4.6 kB)
Requirement already satisfied: numpy in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from pyopencl) (1.26.4)
Collecting pytools>=2021.2.7 (from pyopencl)
Using cached pytools-2024.1.1-py2.py3-none-any.whl.metadata (2.6 kB)
Requirement already satisfied: platformdirs>=2.2.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from pyopencl) (3.10.0)
Using cached pyopencl-2024.1-cp311-cp311-win_amd64.whl (562 kB)
Using cached pytools-2024.1.1-py2.py3-none-any.whl (85 kB)
Installing collected packages: pytools, pyopencl
Successfully installed pyopencl-2024.1 pytools-2024.1.1
Installing Binding
freeing memory
The variable 'AutoModelForCausalLM' does not exist in the local or global namespace.
freed memory
----------------------*
Installing c_transformers
----------------------*
Installing requirements for hardware configuration nvidia-tensorcores
Ignoring aqlm: markers 'platform_system == "Linux"' don't match your environment
Collecting ctransformers==0.2.27+cu121 (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 35))
Downloading https://github.com/jllllll/ctransformers-cuBLAS-wheels/releases/download/AVX2/ctransformers-0.2.27+cu121-py3-none-any.whl (15.5 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 15.5/15.5 MB 24.2 MB/s eta 0:00:00
Collecting accelerate==0.27.* (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 1))
Using cached accelerate-0.27.2-py3-none-any.whl.metadata (18 kB)
Collecting bitsandbytes==0.43.* (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 3))
Using cached bitsandbytes-0.43.0-py3-none-win_amd64.whl.metadata (1.9 kB)
Requirement already satisfied: colorama in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 4)) (0.4.6)
Collecting datasets (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5))
Using cached datasets-2.18.0-py3-none-any.whl.metadata (20 kB)
Collecting einops (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 6))
Using cached einops-0.7.0-py3-none-any.whl.metadata (13 kB)
Collecting gradio==3.50.* (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7))
Using cached gradio-3.50.2-py3-none-any.whl.metadata (17 kB)
Collecting hqq==0.1.5 (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 8))
Using cached hqq-0.1.5-py3-none-any.whl
Collecting jinja2==3.1.2 (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 9))
Using cached Jinja2-3.1.2-py3-none-any.whl.metadata (3.5 kB)
Collecting lm_eval==0.3.0 (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10))
Using cached lm_eval-0.3.0-py3-none-any.whl.metadata (6.8 kB)
Collecting markdown (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 11))
Using cached Markdown-3.6-py3-none-any.whl.metadata (7.0 kB)
Collecting numba==0.59.* (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 12))
Using cached numba-0.59.1-cp311-cp311-win_amd64.whl.metadata (2.8 kB)
Requirement already satisfied: numpy==1.26.* in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 13)) (1.26.4)
Collecting optimum==1.17.* (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 14))
Using cached optimum-1.17.1-py3-none-any.whl.metadata (18 kB)
Requirement already satisfied: pandas in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 15)) (2.2.1)
Collecting peft==0.8.* (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 16))
Using cached peft-0.8.2-py3-none-any.whl.metadata (25 kB)
Requirement already satisfied: Pillow>=9.5.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 17)) (10.3.0)
Requirement already satisfied: pyyaml in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 18)) (6.0.1)
Requirement already satisfied: requests in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 19)) (2.31.0)
Requirement already satisfied: rich in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 20)) (13.7.1)
Requirement already satisfied: safetensors==0.4.* in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 21)) (0.4.2)
Requirement already satisfied: scipy in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 22)) (1.13.0)
Collecting sentencepiece (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 23))
Using cached sentencepiece-0.2.0-cp311-cp311-win_amd64.whl.metadata (8.3 kB)
Collecting tensorboard (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 24))
Using cached tensorboard-2.16.2-py3-none-any.whl.metadata (1.6 kB)
Collecting transformers==4.38.* (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 25))
Using cached transformers-4.38.2-py3-none-any.whl.metadata (130 kB)
Requirement already satisfied: tqdm in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 26)) (4.65.0)
Collecting tqdm (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 26))
Using cached tqdm-4.66.2-py3-none-any.whl.metadata (57 kB)
Collecting wandb (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 27))
Using cached wandb-0.16.6-py3-none-any.whl.metadata (10 kB)
Collecting SpeechRecognition==3.10.0 (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 30))
Using cached SpeechRecognition-3.10.0-py2.py3-none-any.whl.metadata (28 kB)
Collecting flask_cloudflared==0.0.14 (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 31))
Using cached flask_cloudflared-0.0.14-py3-none-any.whl.metadata (4.6 kB)
Collecting sse-starlette==1.6.5 (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 32))
Using cached sse_starlette-1.6.5-py3-none-any.whl.metadata (6.7 kB)
Requirement already satisfied: tiktoken in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from -r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 33)) (0.6.0)
Requirement already satisfied: packaging>=20.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from accelerate==0.27.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 1)) (23.2)
Requirement already satisfied: psutil in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from accelerate==0.27.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 1)) (5.9.8)
Collecting torch>=1.10.0 (from accelerate==0.27.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 1))
Using cached torch-2.2.2-cp311-cp311-win_amd64.whl.metadata (26 kB)
Requirement already satisfied: huggingface-hub in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from accelerate==0.27.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 1)) (0.22.2)
Collecting aiofiles<24.0,>=22.0 (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7))
Using cached aiofiles-23.2.1-py3-none-any.whl.metadata (9.7 kB)
Collecting altair<6.0,>=4.2.0 (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7))
Using cached altair-5.3.0-py3-none-any.whl.metadata (9.2 kB)
Requirement already satisfied: fastapi in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (0.110.1)
Collecting ffmpy (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7))
Using cached ffmpy-0.3.2-py3-none-any.whl
Collecting gradio-client==0.6.1 (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7))
Using cached gradio_client-0.6.1-py3-none-any.whl.metadata (7.1 kB)
Collecting httpx (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7))
Using cached httpx-0.27.0-py3-none-any.whl.metadata (7.2 kB)
Collecting importlib-resources<7.0,>=1.3 (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7))
Using cached importlib_resources-6.4.0-py3-none-any.whl.metadata (3.9 kB)
Collecting markupsafe~=2.0 (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7))
Using cached MarkupSafe-2.1.5-cp311-cp311-win_amd64.whl.metadata (3.1 kB)
Requirement already satisfied: matplotlib~=3.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (3.8.4)
Collecting orjson~=3.0 (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7))
Using cached orjson-3.10.0-cp311-none-win_amd64.whl.metadata (50 kB)
Requirement already satisfied: pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,<3.0.0,>=1.7.4 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (2.6.4)
Collecting pydub (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7))
Using cached pydub-0.25.1-py2.py3-none-any.whl.metadata (1.4 kB)
Requirement already satisfied: python-multipart in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (0.0.9)
Collecting semantic-version~=2.0 (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7))
Using cached semantic_version-2.10.0-py2.py3-none-any.whl.metadata (9.7 kB)
Requirement already satisfied: typing-extensions~=4.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (4.10.0)
Requirement already satisfied: uvicorn>=0.14.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (0.29.0)
Collecting websockets<12.0,>=10.0 (from gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7))
Using cached websockets-11.0.3-cp311-cp311-win_amd64.whl.metadata (6.8 kB)
Collecting timm (from hqq==0.1.5->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 8))
Using cached timm-0.9.16-py3-none-any.whl.metadata (38 kB)
Collecting termcolor (from hqq==0.1.5->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 8))
Using cached termcolor-2.4.0-py3-none-any.whl.metadata (6.1 kB)
Collecting jsonlines (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10))
Using cached jsonlines-4.0.0-py3-none-any.whl.metadata (1.6 kB)
Collecting numexpr (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10))
Using cached numexpr-2.10.0-cp311-cp311-win_amd64.whl.metadata (8.1 kB)
Collecting openai>=0.6.4 (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10))
Using cached openai-1.16.1-py3-none-any.whl.metadata (21 kB)
Collecting pybind11>=2.6.2 (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10))
Using cached pybind11-2.12.0-py3-none-any.whl.metadata (9.5 kB)
Collecting pycountry (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10))
Using cached pycountry-23.12.11-py3-none-any.whl.metadata (12 kB)
Collecting pytablewriter (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10))
Using cached pytablewriter-1.2.0-py3-none-any.whl.metadata (37 kB)
Collecting rouge-score>=0.0.4 (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10))
Using cached rouge_score-0.1.2-py3-none-any.whl
Collecting sacrebleu==1.5.0 (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10))
Using cached sacrebleu-1.5.0-py3-none-any.whl.metadata (1.3 kB)
Requirement already satisfied: scikit-learn>=0.24.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) (1.4.1.post1)
Collecting sqlitedict (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10))
Using cached sqlitedict-2.1.0-py3-none-any.whl
Collecting tqdm-multiprocess (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10))
Using cached tqdm_multiprocess-0.0.11-py3-none-any.whl.metadata (5.7 kB)
Requirement already satisfied: zstandard in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) (0.19.0)
Collecting llvmlite<0.43,>=0.42.0dev0 (from numba==0.59.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 12))
Using cached llvmlite-0.42.0-cp311-cp311-win_amd64.whl.metadata (4.9 kB)
Collecting coloredlogs (from optimum==1.17.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 14))
Using cached coloredlogs-15.0.1-py2.py3-none-any.whl.metadata (12 kB)
Collecting sympy (from optimum==1.17.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 14))
Using cached sympy-1.12-py3-none-any.whl.metadata (12 kB)
Requirement already satisfied: filelock in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from transformers==4.38.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 25)) (3.13.3)
Requirement already satisfied: regex!=2019.12.17 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from transformers==4.38.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 25)) (2023.12.25)
Requirement already satisfied: tokenizers<0.19,>=0.14 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from transformers==4.38.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 25)) (0.15.2)
Collecting Flask>=0.8 (from flask_cloudflared==0.0.14->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 31))
Using cached flask-3.0.2-py3-none-any.whl.metadata (3.6 kB)
Requirement already satisfied: starlette in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from sse-starlette==1.6.5->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 32)) (0.37.2)
Requirement already satisfied: fsspec in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from gradio-client==0.6.1->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (2024.3.1)
Collecting portalocker (from sacrebleu==1.5.0->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10))
Using cached portalocker-2.8.2-py3-none-any.whl.metadata (8.5 kB)
Collecting pyarrow>=12.0.0 (from datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5))
Using cached pyarrow-15.0.2-cp311-cp311-win_amd64.whl.metadata (3.1 kB)
Collecting pyarrow-hotfix (from datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5))
Using cached pyarrow_hotfix-0.6-py3-none-any.whl.metadata (3.6 kB)
Collecting dill<0.3.9,>=0.3.0 (from datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5))
Using cached dill-0.3.8-py3-none-any.whl.metadata (10 kB)
Collecting xxhash (from datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5))
Using cached xxhash-3.4.1-cp311-cp311-win_amd64.whl.metadata (12 kB)
Collecting multiprocess (from datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5))
Using cached multiprocess-0.70.16-py311-none-any.whl.metadata (7.2 kB)
Collecting fsspec (from gradio-client==0.6.1->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7))
Using cached fsspec-2024.2.0-py3-none-any.whl.metadata (6.8 kB)
Requirement already satisfied: aiohttp in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5)) (3.9.3)
Requirement already satisfied: python-dateutil>=2.8.2 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from pandas->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 15)) (2.9.0.post0)
Requirement already satisfied: pytz>=2020.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from pandas->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 15)) (2024.1)
Requirement already satisfied: tzdata>=2022.7 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from pandas->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 15)) (2024.1)
Requirement already satisfied: charset-normalizer<4,>=2 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from requests->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 19)) (2.0.4)
Requirement already satisfied: idna<4,>=2.5 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from requests->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 19)) (3.4)
Requirement already satisfied: urllib3<3,>=1.21.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from requests->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 19)) (2.1.0)
Requirement already satisfied: certifi>=2017.4.17 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from requests->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 19)) (2024.2.2)
Requirement already satisfied: markdown-it-py>=2.2.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from rich->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 20)) (3.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from rich->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 20)) (2.17.2)
Collecting absl-py>=0.4 (from tensorboard->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 24))
Using cached absl_py-2.1.0-py3-none-any.whl.metadata (2.3 kB)
Collecting grpcio>=1.48.2 (from tensorboard->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 24))
Using cached grpcio-1.62.1-cp311-cp311-win_amd64.whl.metadata (4.2 kB)
Collecting protobuf!=4.24.0,>=3.19.6 (from tensorboard->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 24))
Using cached protobuf-5.26.1-cp310-abi3-win_amd64.whl.metadata (592 bytes)
Requirement already satisfied: setuptools>=41.0.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from tensorboard->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 24)) (68.2.2)
Requirement already satisfied: six>1.9 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from tensorboard->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 24)) (1.16.0)
Collecting tensorboard-data-server<0.8.0,>=0.7.0 (from tensorboard->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 24))
Using cached tensorboard_data_server-0.7.2-py3-none-any.whl.metadata (1.1 kB)
Collecting werkzeug>=1.0.1 (from tensorboard->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 24))
Using cached werkzeug-3.0.2-py3-none-any.whl.metadata (4.1 kB)
Requirement already satisfied: Click!=8.0.0,>=7.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from wandb->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 27)) (8.1.7)
Requirement already satisfied: GitPython!=3.1.29,>=1.0.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from wandb->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 27)) (3.1.43)
Collecting sentry-sdk>=1.0.0 (from wandb->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 27))
Using cached sentry_sdk-1.44.1-py2.py3-none-any.whl.metadata (9.9 kB)
Collecting docker-pycreds>=0.4.0 (from wandb->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 27))
Using cached docker_pycreds-0.4.0-py2.py3-none-any.whl.metadata (1.8 kB)
Collecting setproctitle (from wandb->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 27))
Using cached setproctitle-1.3.3-cp311-cp311-win_amd64.whl.metadata (10 kB)
Collecting appdirs>=1.4.3 (from wandb->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 27))
Using cached appdirs-1.4.4-py2.py3-none-any.whl.metadata (9.0 kB)
Collecting protobuf!=4.24.0,>=3.19.6 (from tensorboard->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 24))
Using cached protobuf-4.25.3-cp310-abi3-win_amd64.whl.metadata (541 bytes)
Collecting py-cpuinfo<10.0.0,>=9.0.0 (from ctransformers==0.2.27+cu121->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 35))
Using cached py_cpuinfo-9.0.0-py3-none-any.whl.metadata (794 bytes)
Collecting jsonschema>=3.0 (from altair<6.0,>=4.2.0->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7))
Using cached jsonschema-4.21.1-py3-none-any.whl.metadata (7.8 kB)
Collecting toolz (from altair<6.0,>=4.2.0->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7))
Using cached toolz-0.12.1-py3-none-any.whl.metadata (5.1 kB)
Collecting itsdangerous>=2.1.2 (from Flask>=0.8->flask_cloudflared==0.0.14->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 31))
Using cached itsdangerous-2.1.2-py3-none-any.whl.metadata (2.9 kB)
Collecting blinker>=1.6.2 (from Flask>=0.8->flask_cloudflared==0.0.14->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 31))
Using cached blinker-1.7.0-py3-none-any.whl.metadata (1.9 kB)
Requirement already satisfied: aiosignal>=1.1.2 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from aiohttp->datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5)) (1.3.1)
Requirement already satisfied: attrs>=17.3.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from aiohttp->datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5)) (23.2.0)
Requirement already satisfied: frozenlist>=1.1.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from aiohttp->datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5)) (1.4.1)
Requirement already satisfied: multidict<7.0,>=4.5 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from aiohttp->datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5)) (6.0.5)
Requirement already satisfied: yarl<2.0,>=1.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from aiohttp->datasets->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 5)) (1.9.4)
Requirement already satisfied: gitdb<5,>=4.0.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from GitPython!=3.1.29,>=1.0.0->wandb->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 27)) (4.0.11)
Requirement already satisfied: mdurl~=0.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from markdown-it-py>=2.2.0->rich->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 20)) (0.1.2)
Requirement already satisfied: contourpy>=1.0.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from matplotlib~=3.0->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (1.2.1)
Requirement already satisfied: cycler>=0.10 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from matplotlib~=3.0->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (0.12.1)
Requirement already satisfied: fonttools>=4.22.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from matplotlib~=3.0->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (4.50.0)
Requirement already satisfied: kiwisolver>=1.3.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from matplotlib~=3.0->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (1.4.5)
Requirement already satisfied: pyparsing>=2.3.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from matplotlib~=3.0->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (3.1.2)
Requirement already satisfied: anyio<5,>=3.5.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from openai>=0.6.4->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) (4.3.0)
Requirement already satisfied: distro<2,>=1.7.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from openai>=0.6.4->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) (1.8.0)
Requirement already satisfied: sniffio in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from openai>=0.6.4->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) (1.3.1)
Collecting httpcore==1.* (from httpx->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7))
Using cached httpcore-1.0.5-py3-none-any.whl.metadata (20 kB)
Requirement already satisfied: h11<0.15,>=0.13 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from httpcore==1.->httpx->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (0.14.0)
Requirement already satisfied: annotated-types>=0.4.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,<3.0.0,>=1.7.4->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (0.6.0)
Requirement already satisfied: pydantic-core==2.16.3 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,<3.0.0,>=1.7.4->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7)) (2.16.3)
Collecting nltk (from rouge-score>=0.0.4->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10))
Using cached nltk-3.8.1-py3-none-any.whl.metadata (2.8 kB)
Requirement already satisfied: joblib>=1.2.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from scikit-learn>=0.24.1->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) (1.3.2)
Requirement already satisfied: threadpoolctl>=2.0.0 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from scikit-learn>=0.24.1->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10)) (3.4.0)
Collecting networkx (from torch>=1.10.0->accelerate==0.27.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 1))
Using cached networkx-3.2.1-py3-none-any.whl.metadata (5.2 kB)
Collecting humanfriendly>=9.1 (from coloredlogs->optimum==1.17.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 14))
Using cached humanfriendly-10.0-py2.py3-none-any.whl.metadata (9.2 kB)
Collecting DataProperty<2,>=1.0.1 (from pytablewriter->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10))
Using cached DataProperty-1.0.1-py3-none-any.whl.metadata (11 kB)
Collecting mbstrdecoder<2,>=1.0.0 (from pytablewriter->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10))
Using cached mbstrdecoder-1.1.3-py3-none-any.whl.metadata (4.0 kB)
Collecting pathvalidate<4,>=2.3.0 (from pytablewriter->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10))
Using cached pathvalidate-3.2.0-py3-none-any.whl.metadata (11 kB)
Collecting tabledata<2,>=1.3.1 (from pytablewriter->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10))
Using cached tabledata-1.3.3-py3-none-any.whl.metadata (3.7 kB)
Collecting tcolorpy<1,>=0.0.5 (from pytablewriter->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10))
Using cached tcolorpy-0.1.4-py3-none-any.whl.metadata (5.7 kB)
Collecting typepy<2,>=1.3.2 (from typepy[datetime]<2,>=1.3.2->pytablewriter->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10))
Using cached typepy-1.3.2-py3-none-any.whl.metadata (9.3 kB)
Collecting mpmath>=0.19 (from sympy->optimum==1.17.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 14))
Using cached mpmath-1.3.0-py3-none-any.whl.metadata (8.6 kB)
Collecting torchvision (from timm->hqq==0.1.5->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 8))
Using cached torchvision-0.17.2-cp311-cp311-win_amd64.whl.metadata (6.6 kB)
Requirement already satisfied: smmap<6,>=3.0.1 in d:\lollms-webui\installer_files\lollms_env\lib\site-packages (from gitdb<5,>=4.0.1->GitPython!=3.1.29,>=1.0.0->wandb->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 27)) (5.0.1)
Collecting pyreadline3 (from humanfriendly>=9.1->coloredlogs->optimum==1.17.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 14))
Using cached pyreadline3-3.4.1-py3-none-any.whl.metadata (2.0 kB)
Collecting jsonschema-specifications>=2023.03.6 (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7))
Using cached jsonschema_specifications-2023.12.1-py3-none-any.whl.metadata (3.0 kB)
Collecting referencing>=0.28.4 (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7))
Using cached referencing-0.34.0-py3-none-any.whl.metadata (2.8 kB)
Collecting rpds-py>=0.7.1 (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio==3.50.->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 7))
Using cached rpds_py-0.18.0-cp311-none-win_amd64.whl.metadata (4.2 kB)
Collecting chardet<6,>=3.0.4 (from mbstrdecoder<2,>=1.0.0->pytablewriter->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10))
Using cached chardet-5.2.0-py3-none-any.whl.metadata (3.4 kB)
Collecting pywin32>=226 (from portalocker->sacrebleu==1.5.0->lm_eval==0.3.0->-r D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers\requirements_nvidia.txt (line 10))
Using cached pywin32-306-cp311-cp311-win_amd64.whl.metadata (6.5 kB)
Using cached accelerate-0.27.2-py3-none-any.whl (279 kB)
Using cached bitsandbytes-0.43.0-py3-none-win_amd64.whl (101.6 MB)
Using cached gradio-3.50.2-py3-none-any.whl (20.3 MB)
Using cached Jinja2-3.1.2-py3-none-any.whl (133 kB)
Using cached lm_eval-0.3.0-py3-none-any.whl (178 kB)
Using cached numba-0.59.1-cp311-cp311-win_amd64.whl (2.6 MB)
Using cached optimum-1.17.1-py3-none-any.whl (407 kB)
Using cached peft-0.8.2-py3-none-any.whl (183 kB)
Using cached transformers-4.38.2-py3-none-any.whl (8.5 MB)
Using cached SpeechRecognition-3.10.0-py2.py3-none-any.whl (32.8 MB)
Using cached flask_cloudflared-0.0.14-py3-none-any.whl (6.4 kB)
Using cached sse_starlette-1.6.5-py3-none-any.whl (9.6 kB)
Using cached gradio_client-0.6.1-py3-none-any.whl (299 kB)
Using cached sacrebleu-1.5.0-py3-none-any.whl (65 kB)
Using cached datasets-2.18.0-py3-none-any.whl (510 kB)
Using cached einops-0.7.0-py3-none-any.whl (44 kB)
Using cached Markdown-3.6-py3-none-any.whl (105 kB)
Using cached sentencepiece-0.2.0-cp311-cp311-win_amd64.whl (991 kB)
Using cached tensorboard-2.16.2-py3-none-any.whl (5.5 MB)
Using cached tqdm-4.66.2-py3-none-any.whl (78 kB)
Using cached wandb-0.16.6-py3-none-any.whl (2.2 MB)
Using cached absl_py-2.1.0-py3-none-any.whl (133 kB)
Using cached aiofiles-23.2.1-py3-none-any.whl (15 kB)
Using cached altair-5.3.0-py3-none-any.whl (857 kB)
Using cached appdirs-1.4.4-py2.py3-none-any.whl (9.6 kB)
Using cached dill-0.3.8-py3-none-any.whl (116 kB)
Using cached docker_pycreds-0.4.0-py2.py3-none-any.whl (9.0 kB)
Using cached flask-3.0.2-py3-none-any.whl (101 kB)
Using cached fsspec-2024.2.0-py3-none-any.whl (170 kB)
Using cached grpcio-1.62.1-cp311-cp311-win_amd64.whl (3.8 MB)
Using cached importlib_resources-6.4.0-py3-none-any.whl (38 kB)
Using cached llvmlite-0.42.0-cp311-cp311-win_amd64.whl (28.1 MB)
Using cached MarkupSafe-2.1.5-cp311-cp311-win_amd64.whl (17 kB)
Using cached openai-1.16.1-py3-none-any.whl (266 kB)
Using cached httpx-0.27.0-py3-none-any.whl (75 kB)
Using cached httpcore-1.0.5-py3-none-any.whl (77 kB)
Using cached orjson-3.10.0-cp311-none-win_amd64.whl (139 kB)
Using cached protobuf-4.25.3-cp310-abi3-win_amd64.whl (413 kB)
Using cached py_cpuinfo-9.0.0-py3-none-any.whl (22 kB)
Using cached pyarrow-15.0.2-cp311-cp311-win_amd64.whl (24.8 MB)
Using cached pybind11-2.12.0-py3-none-any.whl (234 kB)
Using cached semantic_version-2.10.0-py2.py3-none-any.whl (15 kB)
Using cached sentry_sdk-1.44.1-py2.py3-none-any.whl (266 kB)
Using cached tensorboard_data_server-0.7.2-py3-none-any.whl (2.4 kB)
Using cached torch-2.2.2-cp311-cp311-win_amd64.whl (198.6 MB)
Using cached websockets-11.0.3-cp311-cp311-win_amd64.whl (124 kB)
Using cached werkzeug-3.0.2-py3-none-any.whl (226 kB)
Using cached coloredlogs-15.0.1-py2.py3-none-any.whl (46 kB)
Using cached jsonlines-4.0.0-py3-none-any.whl (8.7 kB)
Using cached multiprocess-0.70.16-py311-none-any.whl (143 kB)
Using cached numexpr-2.10.0-cp311-cp311-win_amd64.whl (97 kB)
Using cached pyarrow_hotfix-0.6-py3-none-any.whl (7.9 kB)
Using cached pycountry-23.12.11-py3-none-any.whl (6.2 MB)
Using cached pydub-0.25.1-py2.py3-none-any.whl (32 kB)
Using cached pytablewriter-1.2.0-py3-none-any.whl (111 kB)
Using cached setproctitle-1.3.3-cp311-cp311-win_amd64.whl (11 kB)
Using cached sympy-1.12-py3-none-any.whl (5.7 MB)
Using cached termcolor-2.4.0-py3-none-any.whl (7.7 kB)
Using cached timm-0.9.16-py3-none-any.whl (2.2 MB)
Using cached tqdm_multiprocess-0.0.11-py3-none-any.whl (9.8 kB)
Using cached xxhash-3.4.1-cp311-cp311-win_amd64.whl (29 kB)
Using cached blinker-1.7.0-py3-none-any.whl (13 kB)
Using cached DataProperty-1.0.1-py3-none-any.whl (27 kB)
Using cached humanfriendly-10.0-py2.py3-none-any.whl (86 kB)
Using cached itsdangerous-2.1.2-py3-none-any.whl (15 kB)
Using cached jsonschema-4.21.1-py3-none-any.whl (85 kB)
Using cached mbstrdecoder-1.1.3-py3-none-any.whl (7.8 kB)
Using cached mpmath-1.3.0-py3-none-any.whl (536 kB)
Using cached pathvalidate-3.2.0-py3-none-any.whl (23 kB)
Using cached tabledata-1.3.3-py3-none-any.whl (11 kB)
Using cached tcolorpy-0.1.4-py3-none-any.whl (7.9 kB)
Using cached typepy-1.3.2-py3-none-any.whl (31 kB)
Using cached networkx-3.2.1-py3-none-any.whl (1.6 MB)
Using cached nltk-3.8.1-py3-none-any.whl (1.5 MB)
Using cached portalocker-2.8.2-py3-none-any.whl (17 kB)
Using cached toolz-0.12.1-py3-none-any.whl (56 kB)
Using cached torchvision-0.17.2-cp311-cp311-win_amd64.whl (1.2 MB)
Using cached chardet-5.2.0-py3-none-any.whl (199 kB)
Using cached jsonschema_specifications-2023.12.1-py3-none-any.whl (18 kB)
Using cached pywin32-306-cp311-cp311-win_amd64.whl (9.2 MB)
Using cached referencing-0.34.0-py3-none-any.whl (26 kB)
Using cached rpds_py-0.18.0-cp311-none-win_amd64.whl (206 kB)
Using cached pyreadline3-3.4.1-py3-none-any.whl (95 kB)
Installing collected packages: sqlitedict, sentencepiece, pywin32, pyreadline3, pydub, py-cpuinfo, mpmath, ffmpy, appdirs, xxhash, websockets, tqdm, toolz, termcolor, tensorboard-data-server, tcolorpy, sympy, setproctitle, sentry-sdk, semantic-version, rpds-py, pycountry, pybind11, pyarrow-hotfix, pyarrow, protobuf, portalocker, pathvalidate, orjson, numexpr, networkx, markupsafe, markdown, llvmlite, jsonlines, itsdangerous, importlib-resources, humanfriendly, httpcore, grpcio, fsspec, einops, docker-pycreds, dill, chardet, blinker, aiofiles, absl-py, werkzeug, tqdm-multiprocess, SpeechRecognition, sacrebleu, referencing, numba, nltk, multiprocess, mbstrdecoder, jinja2, httpx, coloredlogs, wandb, typepy, torch, tensorboard, sse-starlette, rouge-score, openai, jsonschema-specifications, gradio-client, Flask, ctransformers, transformers, torchvision, jsonschema, flask_cloudflared, datasets, bitsandbytes, accelerate, timm, peft, DataProperty, altair, tabledata, optimum, hqq, gradio, pytablewriter, lm_eval
Attempting uninstall: tqdm
Found existing installation: tqdm 4.65.0
Uninstalling tqdm-4.65.0:
Successfully uninstalled tqdm-4.65.0
Attempting uninstall: fsspec
Found existing installation: fsspec 2024.3.1
Uninstalling fsspec-2024.3.1:
Successfully uninstalled fsspec-2024.3.1
Attempting uninstall: transformers
Found existing installation: transformers 4.39.3
Uninstalling transformers-4.39.3:
Successfully uninstalled transformers-4.39.3
Successfully installed DataProperty-1.0.1 Flask-3.0.2 SpeechRecognition-3.10.0 absl-py-2.1.0 accelerate-0.27.2 aiofiles-23.2.1 altair-5.3.0 appdirs-1.4.4 bitsandbytes-0.43.0 blinker-1.7.0 chardet-5.2.0 coloredlogs-15.0.1 ctransformers-0.2.27+cu121 datasets-2.18.0 dill-0.3.8 docker-pycreds-0.4.0 einops-0.7.0 ffmpy-0.3.2 flask_cloudflared-0.0.14 fsspec-2024.2.0 gradio-3.50.2 gradio-client-0.6.1 grpcio-1.62.1 hqq-0.1.5 httpcore-1.0.5 httpx-0.27.0 humanfriendly-10.0 importlib-resources-6.4.0 itsdangerous-2.1.2 jinja2-3.1.2 jsonlines-4.0.0 jsonschema-4.21.1 jsonschema-specifications-2023.12.1 llvmlite-0.42.0 lm_eval-0.3.0 markdown-3.6 markupsafe-2.1.5 mbstrdecoder-1.1.3 mpmath-1.3.0 multiprocess-0.70.16 networkx-3.2.1 nltk-3.8.1 numba-0.59.1 numexpr-2.10.0 openai-1.16.1 optimum-1.17.1 orjson-3.10.0 pathvalidate-3.2.0 peft-0.8.2 portalocker-2.8.2 protobuf-4.25.3 py-cpuinfo-9.0.0 pyarrow-15.0.2 pyarrow-hotfix-0.6 pybind11-2.12.0 pycountry-23.12.11 pydub-0.25.1 pyreadline3-3.4.1 pytablewriter-1.2.0 pywin32-306 referencing-0.34.0 rouge-score-0.1.2 rpds-py-0.18.0 sacrebleu-1.5.0 semantic-version-2.10.0 sentencepiece-0.2.0 sentry-sdk-1.44.1 setproctitle-1.3.3 sqlitedict-2.1.0 sse-starlette-1.6.5 sympy-1.12 tabledata-1.3.3 tcolorpy-0.1.4 tensorboard-2.16.2 tensorboard-data-server-0.7.2 termcolor-2.4.0 timm-0.9.16 toolz-0.12.1 torch-2.2.2 torchvision-0.17.2 tqdm-4.66.2 tqdm-multiprocess-0.0.11 transformers-4.38.2 typepy-1.3.2 wandb-0.16.6 websockets-11.0.3 werkzeug-3.0.2 xxhash-3.4.1
Installed successfully
Binding installed successfully
INFO: ::1:54567 - "POST /install_binding HTTP/1.1" 200 OK
Disconnected: U9zz13XR8kkNFHGuAAAC
INFO: ::1:54603 - "GET /socket.io/?EIO=4&transport=polling&t=Owe9Hgf HTTP/1.1" 200 OK
INFO: ::1:54604 - "GET /socket.io/?EIO=4&transport=polling&t=Owe9Hgf HTTP/1.1" 200 OK
INFO: ::1:54603 - "GET /get_lollms_webui_version HTTP/1.1" 200 OK
INFO: ::1:54603 - "GET /get_versionID HTTP/1.1" 200 OK
Client SYgi3aAFbaKNpz1LAAAF connected
INFO: ::1:54603 - "POST /socket.io/?EIO=4&transport=polling&t=Owe9Hhb&sid=S_zo7Z6wuxLSuo7ZAAAD HTTP/1.1" 200 OK
INFO: ('::1', 54606) - "WebSocket /socket.io/?EIO=4&transport=websocket&sid=S_zo7Z6wuxLSuo7ZAAAD" [accepted]
INFO: ::1:54605 - "GET /socket.io/?EIO=4&transport=polling&t=Owe9Hhe&sid=S_zo7Z6wuxLSuo7ZAAAD HTTP/1.1" 200 OK
INFO: ::1:54604 - "GET /socket.io/?EIO=4&transport=polling&t=Owe9Hhe&sid=S_zo7Z6wuxLSuo7ZAAAD HTTP/1.1" 200 OK
INFO: ::1:54605 - "GET /get_config HTTP/1.1" 200 OK
INFO: ::1:54605 - "GET /socket.io/?EIO=4&transport=polling&t=Owe9HiV&sid=S_zo7Z6wuxLSuo7ZAAAD HTTP/1.1" 200 OK
INFO: ::1:54605 - "GET /list_databases HTTP/1.1" 200 OK
INFO: ::1:54604 - "GET /socket.io/?EIO=4&transport=polling&t=Owe9HiV&sid=S_zo7Z6wuxLSuo7ZAAAD HTTP/1.1" 200 OK
INFO: ::1:54605 - "GET /list_bindings HTTP/1.1" 200 OK
INFO: ::1:54605 - "GET /disk_usage HTTP/1.1" 200 OK
INFO: ::1:54605 - "GET /ram_usage HTTP/1.1" 200 OK
INFO: ::1:54605 - "GET /vram_usage HTTP/1.1" 200 OK
INFO: ::1:54605 - "GET /list_extensions HTTP/1.1" 200 OK
Listing all personalities
OK
INFO: ::1:54605 - "GET /get_all_personalities HTTP/1.1" 200 OK
INFO: ::1:54605 - "GET /get_available_models HTTP/1.1" 200 OK
INFO: ::1:54605 - "GET /list_models HTTP/1.1" 200 OK
INFO: ::1:54605 - "GET /get_active_model HTTP/1.1" 200 OK
INFO: ::1:54605 - "GET /get_model_status HTTP/1.1" 200 OK
INFO: ::1:54605 - "GET /list_discussions HTTP/1.1" 200 OK
Loading discussion for client SYgi3aAFbaKNpz1LAAAF ... ok
INFO: ::1:54605 - "GET /get_current_personality_files_list HTTP/1.1" 200 OK
Checking for updates from D:\lollms-webui\lollms-webui
INFO: ::1:54662 - "GET /get_config HTTP/1.1" 200 OK
Listing voices
INFO: ::1:54664 - "GET /list_voices HTTP/1.1" 200 OK
INFO: ::1:54662 - "GET /user_infos/default_user.svg HTTP/1.1" 400 Bad Request
INFO: ::1:54663 - "GET /list_personalities_categories HTTP/1.1" 200 OK
Checking for updates from D:\lollms-webui\lollms-webui\lollms_core
Checking for updates from D:\lollms-webui\lollms-webui\utilities\safe_store
INFO: ::1:54662 - "GET /list_extensions_categories HTTP/1.1" 200 OK
INFO: ::1:54663 - "GET /list_personalities_categories HTTP/1.1" 200 OK
INFO: ::1:54663 - "GET /list_personalities?category=generic HTTP/1.1" 200 OK
INFO: ::1:54661 - "GET /check_update HTTP/1.1" 200 OK
INFO: ::1:54663 - "GET /list_extensions_categories HTTP/1.1" 200 OK
INFO: ::1:54663 - "GET /list_extensions?category=bound_extensions HTTP/1.1" 200 OK
Requested updating of setting binding_name to c_transformers
New binding selected : c_transformers
Building model
Model type : llama
Binding loaded successfully
Configuration binding_name updated
INFO: ::1:54668 - "POST /update_setting HTTP/1.1" 200 OK
INFO: ::1:54669 - "GET /get_model_status HTTP/1.1" 200 OK
INFO: ::1:54669 - "GET /get_config HTTP/1.1" 200 OK
Requested updating of setting model_name to None
Changing model to: None
Building model
No model is selected
Configuration model_name updated
INFO: ::1:54669 - "POST /update_setting HTTP/1.1" 200 OK
INFO: ::1:54669 - "GET /get_active_binding_settings HTTP/1.1" 200 OK
Saving configuration
INFO: ::1:54671 - "POST /set_active_binding_settings HTTP/1.1" 200 OK
Binding setting updated successfully
INFO: ::1:54671 - "GET /update_binding_settings HTTP/1.1" 200 OK
Disconnected: SYgi3aAFbaKNpz1LAAAF
INFO: ::1:54671 - "GET /socket.io/?EIO=4&transport=polling&t=OweD9M_ HTTP/1.1" 200 OK
INFO: ::1:54672 - "GET /socket.io/?EIO=4&transport=polling&t=OweD9M_ HTTP/1.1" 200 OK
INFO: ::1:54671 - "GET /get_lollms_webui_version HTTP/1.1" 200 OK
INFO: ::1:54671 - "GET /get_versionID HTTP/1.1" 200 OK
Client xa9lGlmIu2kszQN6AAAI connected
INFO: ::1:54671 - "POST /socket.io/?EIO=4&transport=polling&t=OweD9Nx&sid=_jWOs4-_Hr6EvhNvAAAG HTTP/1.1" 200 OK
INFO: ('::1', 54674) - "WebSocket /socket.io/?EIO=4&transport=websocket&sid=_jWOs4-_Hr6EvhNvAAAG" [accepted]
INFO: ::1:54673 - "GET /socket.io/?EIO=4&transport=polling&t=OweD9Ny&sid=_jWOs4-_Hr6EvhNvAAAG HTTP/1.1" 200 OK
INFO: ::1:54672 - "GET /socket.io/?EIO=4&transport=polling&t=OweD9Ny&sid=_jWOs4-_Hr6EvhNvAAAG HTTP/1.1" 200 OK
INFO: ::1:54673 - "GET /get_config HTTP/1.1" 200 OK
INFO: ::1:54673 - "GET /socket.io/?EIO=4&transport=polling&t=OweD9Os&sid=_jWOs4-_Hr6EvhNvAAAG HTTP/1.1" 200 OK
INFO: ::1:54673 - "GET /list_databases HTTP/1.1" 200 OK
INFO: ::1:54672 - "GET /socket.io/?EIO=4&transport=polling&t=OweD9Os&sid=_jWOs4-Hr6EvhNvAAAG HTTP/1.1" 200 OK
INFO: ::1:54673 - "GET /list_bindings HTTP/1.1" 200 OK
INFO: ::1:54673 - "GET /disk_usage HTTP/1.1" 200 OK
INFO: ::1:54673 - "GET /ram_usage HTTP/1.1" 200 OK
INFO: ::1:54673 - "GET /vram_usage HTTP/1.1" 200 OK
INFO: ::1:54673 - "GET /list_extensions HTTP/1.1" 200 OK
Listing all personalities
OK
INFO: ::1:54673 - "GET /get_all_personalities HTTP/1.1" 200 OK
INFO: ::1:54673 - "GET /get_available_models HTTP/1.1" 200 OK
Listing models
ok
INFO: ::1:54673 - "GET /list_models HTTP/1.1" 200 OK
Getting active model
INFO: ::1:54673 - "GET /get_active_model HTTP/1.1" 200 OK
INFO: ::1:54673 - "GET /get_model_status HTTP/1.1" 200 OK
INFO: ::1:54673 - "GET /list_discussions HTTP/1.1" 200 OK
Loading discussion for client xa9lGlmIu2kszQN6AAAI ... ok
INFO: ::1:54673 - "GET /get_current_personality_files_list HTTP/1.1" 200 OK
Checking for updates from D:\lollms-webui\lollms-webui
INFO: ::1:54675 - "GET /get_config HTTP/1.1" 200 OK
Listing voices
INFO: ::1:54677 - "GET /list_voices HTTP/1.1" 200 OK
INFO: ::1:54675 - "GET /user_infos/default_user.svg HTTP/1.1" 400 Bad Request
INFO: ::1:54676 - "GET /list_personalities_categories HTTP/1.1" 200 OK
Checking for updates from D:\lollms-webui\lollms-webui\lollms_core
INFO: ::1:54675 - "GET /list_extensions_categories HTTP/1.1" 200 OK
Checking for updates from D:\lollms-webui\lollms-webui\utilities\safe_store
INFO: ::1:54675 - "GET /list_personalities?category=generic HTTP/1.1" 200 OK
INFO: ::1:54676 - "GET /list_personalities_categories HTTP/1.1" 200 OK
INFO: ::1:54675 - "GET /list_extensions_categories HTTP/1.1" 200 OK
INFO: ::1:54675 - "GET /list_extensions?category=bound_extensions HTTP/1.1" 200 OK
INFO: ::1:54673 - "GET /check_update HTTP/1.1" 200 OK
Install model triggered
Hugging face model detected
Model install requested
Model path : https://huggingface.co/vilm/Quyen-Pro-v0.1-GGUF/resolve/main/Quyen-Pro-v0.1_Q8_0.gguf
Installation Path : D:\lollms-webui\personal_data\models\gguf\Quyen-Pro-v0.1-GGUF\Quyen-Pro-v0.1_Q8_0.gguf
File downloaded successfully!
INFO: ::1:54823 - "GET /disk_usage HTTP/1.1" 200 OK
Requested updating of setting model_name to Quyen-Pro-v0.1-GGUF
Changing model to: Quyen-Pro-v0.1-GGUF
Building model
Model type : llama
Traceback (most recent call last):
File "d:\lollms-webui\lollms-webui\lollms_core\lollms\server\endpoints\lollms_configuration_infos.py", line 105, in update_setting
lollmsElfServer.model = lollmsElfServer.binding.build_model()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\lollms-webui\lollms-webui\zoos\bindings_zoo\c_transformers_init.py", line 152, in build_model
self.model = AutoModelForCausalLM.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\lollms-webui\installer_files\lollms_env\Lib\site-packages\ctransformers\hub.py", line 175, in from_pretrained
llm = LLM(
^^^^
File "D:\lollms-webui\installer_files\lollms_env\Lib\site-packages\ctransformers\llm.py", line 246, in init
self.lib = load_library(lib, gpu=config.gpu_layers > 0)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\lollms-webui\installer_files\lollms_env\Lib\site-packages\ctransformers\llm.py", line 126, in load_library
lib = CDLL(path)
^^^^^^^^^^
File "D:\lollms-webui\installer_files\lollms_env\Lib\ctypes_init.py", line 376, in init
self._handle = _dlopen(self._name, mode)
^^^^^^^^^^^^^^^^^^^^^^^^^
FileNotFoundError: Could not find module 'D:\lollms-webui\installer_files\lollms_env\Lib\site-packages\ctransformers\lib\cuda\ctransformers.dll' (or one of its dependencies). Try using the full path with constructor syntax.
It looks like you we couldn't load the model.
Here is the error message:
Could not find module 'D:\lollms-webui\installer_files\lollms_env\Lib\site-packages\ctransformers\lib\cuda\ctransformers.dll' (or one of its dependencies). Try using the full path with constructor syntax.
Configuration model_name updated
INFO: ::1:54831 - "POST /update_setting HTTP/1.1" 200 OK
INFO: ::1:54831 - "GET /get_model_status HTTP/1.1" 200 OK
Screenshots
The text was updated successfully, but these errors were encountered: