Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Maintenance status of matbench #357

Open
1 of 3 tasks
ml-evs opened this issue Nov 8, 2024 · 0 comments
Open
1 of 3 tasks

Maintenance status of matbench #357

ml-evs opened this issue Nov 8, 2024 · 0 comments

Comments

@ml-evs
Copy link
Contributor

ml-evs commented Nov 8, 2024

Code snippet

No response

What happened?

Hi matbench devs, we're thinking of resubmitting a MODNet benchmark for 2024, but would like to query the development status of this repo. Can it still be considered active? I can see there are quite a few outstanding benchmark PRs (#356, #353, #352), plus dependency issues (#269) rearing their heads.

I'd be happy to help out on the maintenance front, but perhaps it would be good to get a couple of developers from other submissions too? Although the benchmarks maybe seen as "old hat" now, there are still lots of papers that refer to them, reporting their own models as SoTA without actually submitting here, or only comparing to a subset of other models...

Let me know what you think -- tagging @hrushikesh-s @ardunn and @computron as the last people involved in this.

Version

latest

Which OS?

  • MacOS
  • Windows
  • Linux

Log output

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant