Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Initialize v0.0.3 #24

Merged
merged 14 commits into from
May 29, 2024
Merged

Initialize v0.0.3 #24

merged 14 commits into from
May 29, 2024

Conversation

haonan-li
Copy link
Member

Chang log:

  1. Add restore_claims function to decomposer, to restore the decomposed claims to the original user input.
  2. Add utils/data_class.py which defines the data structure for several intermedia processing function and final output.
  3. Parallel the restore_claims, identify_checkworthiness and query_generation functions to speed up.
  4. Add the token count for all steps.
  5. Change the verification logic from input all evidence together within a single LLM call, to verify the claim by each evidence for each LLM call.
  6. Remove the deterministic output, change the factuality to a number in [0,1], calculated by the judgement with each simple evidence.
  7. Redesign the webpage.

@haonan-li haonan-li merged commit a48dfd3 into main May 29, 2024
1 check failed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants