推理不支持batch的推理
#19
-
您好, 非常感谢您的开源,看您的代码只支持单图的推理,是否考虑batch的批量推理代码的开发 |
Beta Was this translation helpful? Give feedback.
Answered by
SWHL
Jun 10, 2024
Replies: 2 comments 1 reply
-
@SWHL 多谢多谢 |
Beta Was this translation helpful? Give feedback.
1 reply
-
刚才认真看了你的需求,并做了评估。 建议:可以多开几个并发来实现 |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
SWHL
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
刚才认真看了你的需求,并做了评估。
大概思路是:从推理引擎层面考虑,支持batch的推理,需要将多张图做拼接,转为相同shape,才可以batch推理。
但是这样会存在识别结果不准的问题。不同大小的图像,被统一为同样大小一起识别,这势必会对某些图像造成影响。
建议:可以多开几个并发来实现