You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I tried to test LLaVA-v1.5-7b (llava_v1.5_7b) model on TextVQA_VAL and only get about 21.88 accuracy, which is much lower than the 58.2 performance reported in the paper. I understand that the codebase is not aimed to reproduce the exact results but it seems that the gap is too big.
Is there any reason why this happens and any quick fix?
Thanks very much!
The text was updated successfully, but these errors were encountered:
Dear authors,
Thanks for sharing this great codebase.
I tried to test LLaVA-v1.5-7b (
llava_v1.5_7b
) model onTextVQA_VAL
and only get about 21.88 accuracy, which is much lower than the 58.2 performance reported in the paper. I understand that the codebase is not aimed to reproduce the exact results but it seems that the gap is too big.Is there any reason why this happens and any quick fix?
Thanks very much!
The text was updated successfully, but these errors were encountered: