New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

💡 [REQUEST] - <title>预训练相关 #672

Open

zhangzhixun1999 opened this issue Nov 18, 2024 · 1 comment

Labels

question

zhangzhixun1999 commented Nov 18, 2024

起始日期 | Start Date

No response

实现PR | Implementation PR

No response

相关Issues | Reference Issues

No response

摘要 | Summary

我想在我自己的domain data上做post pretraining. 可以给出你们的预训练代码吗？想知道预训练具体用的什么方法，损失函数等等

基本示例 | Basic Example

，

缺陷 | Drawbacks

，

未解决问题 | Unresolved questions

No response

zhangzhixun1999 added the question label

Leke-G commented Nov 18, 2024

同蹲预训练代码

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment