New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

资源监控 #23

Open

aaadrain opened this issue Nov 28, 2024 · 2 comments

Labels

aaadrain commented Nov 28, 2024

希望能开发一下LLM使用的资源监控模块，吞吐量，运行峰值等

shell-nlp added the enhancement label

Owner

shell-nlp commented Nov 28, 2024

ok

Owner

shell-nlp commented Nov 28, 2024

资源监控模块运行峰值可以用nvidia-smi 命令查看
吞吐量等性能指标近期将提供

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment