Skip to content

Commit

Permalink
fix: update port for openai api server
Browse files Browse the repository at this point in the history
  • Loading branch information
quitrk committed Jun 20, 2024
1 parent 84005f4 commit 33a298a
Show file tree
Hide file tree
Showing 3 changed files with 3 additions and 3 deletions.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -60,7 +60,7 @@ docker restart skynet-web-1

# localhost:8000 for Skynet APIs
# localhost:8001/metrics for Prometheus metrics
# localhost:8002 for llama.cpp web server GUI
# localhost:8003 for llama.cpp web server GUI
```

### Test it from Github Pages
Expand Down
2 changes: 1 addition & 1 deletion compose-dev.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ services:
ports:
- "8000:8000"
- "8001:8001"
- "8002:8002"
- "8003:8003"
redis:
image: "redis:alpine"
platform: linux/amd64
2 changes: 1 addition & 1 deletion skynet/env.py
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ def tobool(val: str | None):

# openai api
openai_api_server_path = os.environ.get('OPENAI_API_SERVER_PATH', '/app/llama.cpp/server')
openai_api_server_port = int(os.environ.get('OPENAI_API_SERVER_PORT', 8002))
openai_api_server_port = int(os.environ.get('OPENAI_API_SERVER_PORT', 8003))
openai_api_base_url = os.environ.get('OPENAI_API_BASE_URL', f'http://localhost:{openai_api_server_port}/v1')

# openai
Expand Down

0 comments on commit 33a298a

Please sign in to comment.