Skip to content

Commit

Permalink
Merge branch 'master' of github.com:imoneoi/OChat
Browse files Browse the repository at this point in the history
  • Loading branch information
imoneoi committed Jul 2, 2023
2 parents a0b25d0 + c55f7d1 commit d148426
Showing 1 changed file with 12 additions and 0 deletions.
12 changes: 12 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -254,6 +254,18 @@ To visualize and plot the evaluation results, use `ochat/visualization/eval_resu

The same routine as ChatGPT / GPT-4 was used to run other benchmarks or evaluations such as AlpacaEval. Simply run the API server and set the `openai.api_base` of the benchmark program.

## Limitations

**Foundation Model Limitations**
Despite its advanced capabilities, OpenChat is still bound by the limitations inherent in its foundation models. These limitations may impact the model's performance in areas such as:

- Complex reasoning
- Mathematical and arithmetic tasks
- Programming and coding challenges

**Hallucination of Non-existent Information**
OpenChat may sometimes generate information that does not exist or is not accurate, also known as "hallucination". Users should be aware of this possibility and verify any critical information obtained from the model.

## TODO

- [ ] Improving conversation splitting
Expand Down

0 comments on commit d148426

Please sign in to comment.