Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluation script for open-source models #2

Open
joyolee opened this issue Oct 9, 2024 · 1 comment
Open

Evaluation script for open-source models #2

joyolee opened this issue Oct 9, 2024 · 1 comment

Comments

@joyolee
Copy link

joyolee commented Oct 9, 2024

Dear authors,

thank you for the great work in long-context multi-model evaluation. In the code base, I only saw the code for Azure, OpenAI, Gemini, and Anthropic, could you also provide the evaluation script for public models?

Thank you!

@AaronWhy
Copy link
Collaborator

Thank you for the interests! We are going to release the code for open-source models in an upcoming update.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants