You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi I have deployed text-generation-webui into VM instance in Google Cloud Platform.
The VM has Ubuntu 20.04 installed and an enough amount of RAM.
Normally I start the server on VM as follows: ./start_linux.sh --api --listen --model mistralai_Mistral-7B-v0.1
Then I type in google shell gcloud compute ssh --zone "europe-west3-c" "myvm" --tunnel-through-iap --project "myproject" -- -NL 5000:localhost:5000 -NL 8080:localhost:7860 -NL 5001:localhost:5001
Then I am able to normally work with GUI - and everything is working well.
For security reasons I need to run the script with certiificate.
Then I again type in google shell gcloud compute ssh --zone "europe-west3-c" "myvm" --tunnel-through-iap --project "myproject" -- -NL 5000:localhost:5000 -NL 8080:localhost:7860 -NL 5001:localhost:5001
Unfortunatelly then something is malfunctioning and I see the following errors when I start GUI preview on port 8080
How can I make the GUI working properly given that I need to use --ssl-keyfile and --ssl-certfile options?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hi I have deployed text-generation-webui into VM instance in Google Cloud Platform.
The VM has Ubuntu 20.04 installed and an enough amount of RAM.
Normally I start the server on VM as follows:
./start_linux.sh --api --listen --model mistralai_Mistral-7B-v0.1
Then I type in google shell
gcloud compute ssh --zone "europe-west3-c" "myvm" --tunnel-through-iap --project "myproject" -- -NL 5000:localhost:5000 -NL 8080:localhost:7860 -NL 5001:localhost:5001
Then I am able to normally work with GUI - and everything is working well.
For security reasons I need to run the script with certiificate.
./start_linux.sh --api --listen --model mistralai_Mistral-7B-v0.1 --ssl-keyfile mykey.key --ssl-certfile mycrt.crt
Then I again type in google shell
gcloud compute ssh --zone "europe-west3-c" "myvm" --tunnel-through-iap --project "myproject" -- -NL 5000:localhost:5000 -NL 8080:localhost:7860 -NL 5001:localhost:5001
Unfortunatelly then something is malfunctioning and I see the following errors when I start GUI preview on port 8080
How can I make the GUI working properly given that I need to use
--ssl-keyfile
and --ssl-certfile
options?Beta Was this translation helpful? Give feedback.
All reactions