Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

lora微调后回答并没有按照原数据回答,会出现无中生有的情况 #11

Open
alexhmyang opened this issue Apr 28, 2024 · 0 comments

Comments

@alexhmyang
Copy link

image
上图是主页给出的测试结果

以下是原始训练数据
image

---可以看到,微调后的回答并没有按照原数据回答,会出现无中生有的情况,这在 政务和医疗等对准确性要求很高的领域来说并不安全,所以可以得出结论:微调只是让回答大意不会错,语言风格得以修改,但细节和事实部分需要用rag来实现,单靠lora微调是不行的。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant