Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

When start local server, use API to access server, and multiple users need to queue up to request API #69

Open
lrfbeyond opened this issue Aug 30, 2024 · 0 comments

Comments

@lrfbeyond
Copy link

After start local server, access the API for chat conversations. If multiple users call the same API at the same time, only the first user can call the API to return data, and the other user needs to wait for the first conversation to complete before the API returns data. Has anyone encountered this situation? How did you solve it?
My environment: Ubuntu22.04, LM version 0.2.31

当启用本地服务后,访问接口进行聊天对话,如果多个用户同时调用同一个API进行对话时,只有第一个用户可以调用接口返回数据,另一个需要等待第一个对话完成后接口才会返回数据。请问大家有没有遇到这种情况,是如何解决的?
我的环境:Ubuntu22.04, LM版本0.2.31

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant