-
Notifications
You must be signed in to change notification settings - Fork 18
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
cudla import external semaphore FAILED #15
Comments
I can run both modes, but the inference time for each image is 20ms, which is different from what the experiment says, please ask what is the time of your hybrid mode @WangFengtu1996 |
@2yjia I can not understand why I can not run successfully in standalone mode. The inference time is about 17ms ~20ms. when warmup is finished, the inference time is shortened. My platform is nvidia jetson AGX ORIN DK. would you give me some guide that inference in standalone mode? thks. |
@2yjia 我参考了这个issue #7
|
@2yjia 我这边尝试去根据仓库的readme,然后去finetune 模型,导出新的模型,这个流程你走通了么,我在 qat->ptq 这个遇到点问题,缺了输出的这个尺度信息。
|
@2yjia 设备信息, 我们一致么?
|
Software part of jetson-stats 4.2.4 - (c) 2024, Raffaello Bonghi
|
同样的问题,运行程序后生成了noqdq.onnx,我用这个onnx进行推理部署有一定的问题,不知道作者的fp16和int8两个onnx怎么生成的 |
@2yjia 关于我这个问题,你能在解压
|
Hi All, could you try this on Jetpack 6.0 DP+. Thanks! |
cudla import external semaphore FAILED 1
The text was updated successfully, but these errors were encountered: