You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Ideally, we would like HypoGeniC to be a generic tool that can be applied to any tasks and datasets to generate hypothesis. With the current implementation, it can only support classification tasks because the current reward function takes hypothesis-based inference accuracy and the exploration term.
As an extension, we would like to support arbitrary reward functions, and users of HypoGeniC can choose to use their own reward function / heuristics to evaluate hypothesis.
For example, for text generation tasks, the workflow should be the following:
Initialize some hypothesis with a first batch of examples
Use the generated hypothesis to perform the text generation task.
Compare the generated text and the ground truth text, use a user-defined function to output a quality score of the hypothesis
Use the score in the reward function
The rest of HypoGeniC should work the same.
The text was updated successfully, but these errors were encountered:
Ideally, we would like HypoGeniC to be a generic tool that can be applied to any tasks and datasets to generate hypothesis. With the current implementation, it can only support classification tasks because the current reward function takes hypothesis-based inference accuracy and the exploration term.
As an extension, we would like to support arbitrary reward functions, and users of HypoGeniC can choose to use their own reward function / heuristics to evaluate hypothesis.
For example, for text generation tasks, the workflow should be the following:
The text was updated successfully, but these errors were encountered: