Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Benchmarking interface for SOTA solvers #168

Open
phstratmann opened this issue Jan 23, 2023 · 0 comments
Open

Benchmarking interface for SOTA solvers #168

phstratmann opened this issue Jan 23, 2023 · 0 comments
Assignees
Labels

Comments

@phstratmann
Copy link
Contributor

User story

As a user, I want to be able to easily run and benchmark QUBO problems on state-of-the-art solvers running on CPU. My goal is to quickly validate that Loihi 2 outperforms alternative solvers and to quantify this outperformance. This feature allows me to check if Loihi 2 is benefitial for my work load, and to create reproducible numbers for sharing with other stakeholders of a project.

Conditions of satisfaction

  • User can run their Lava-defined QUBO workload in QBSolv and Gurobi.
  • Lava returns time to solution for SOTA solver.
  • Lava allows to activate/deactivate running the solver, to measure energy consumption with and without solver routine.

Acceptance tests

  • Test defining an MIS as QUBO class and running it in QBSolv.
  • Test defining an MIS as QUBO class and running it in Gurobi.
  • Test running an MIS in QBSolv and returning the time to solution.
  • Test running an MIS in Gurobi and returning the time to solution.
  • Test running an MIS in QBSolv and deactivating the actual call function.
  • Test running an MIS in Gurobi and deactivating the actual call function.
@phstratmann phstratmann added 1-feature New feature or request 0-needs-review Has to be reviewed. 2-important/not-urgent labels Jan 23, 2023
@phstratmann phstratmann added this to the lava-optimization 0.3.0 milestone Jan 23, 2023
@phstratmann phstratmann self-assigned this Jan 23, 2023
@GaboFGuerra GaboFGuerra removed the 0-needs-review Has to be reviewed. label Jan 24, 2023
@GaboFGuerra GaboFGuerra removed this from the lava-optimization 0.3.0 milestone Feb 16, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants