Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluation on refcoco datasets. #18

Open
juxingyiwan opened this issue Feb 19, 2024 · 3 comments
Open

Evaluation on refcoco datasets. #18

juxingyiwan opened this issue Feb 19, 2024 · 3 comments

Comments

@juxingyiwan
Copy link

Dear authors:
I'm really interested in your work. We are reproducing outstanding visual grounding works on refcoco datasets, could you please release evaluation scripts on refcocos?

@liujunzhuo
Copy link

Dear authors: I'm really interested in your work. We are reproducing outstanding visual grounding works on refcoco datasets, could you please release evaluation scripts on refcocos?

Hi,
I have a similar question regarding visual grounding evaluation. I've been using prompts from the paper, like "Please segment the man. (with grounding)," but sometimes end up with multiple targets, and sometimes, there's no <seg>. It's not ideal. Any tips or solutions you've come across?
Also, I'm having issues with batch inference - the results are different when the batch size is not 1. Do you happen to have any insights into this matter?
I appreciate your help!

@ApolloRay
Copy link

same question.

@XuYunqiu
Copy link

same issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants