You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently, when searching using allow_evaluation_errors and all of the programs error out on evaluation (interpret errors out), the return value of synth is marked as a suboptimal_program. This is somewhat confusing because it seems to say that the returned program executed but didn't pass evaluation for some IO examples.
We can either:
add a third enum value to SynthResult like failing_program
Especially because if we have a program failing to run, we might be able to deduce additional constraints to remove programs that would fail for the same reason.
Currently, when searching using
allow_evaluation_errors
and all of the programs error out on evaluation (interpret
errors out), the return value ofsynth
is marked as asuboptimal_program
. This is somewhat confusing because it seems to say that the returned program executed but didn't pass evaluation for some IO examples.We can either:
SynthResult
likefailing_program
HerbSearch.jl/src/search_procedure.jl
Line 10 in 5b315ce
allow_evaluation_errors
might mean that the returnedsuboptimal_program
might have thrown an errorThe text was updated successfully, but these errors were encountered: