chatglm3-6b-32k模型对话出现大量重复性内容 #778
-
我在longchain-chatchat中加载了chatglm3-6b-32k结果出现了大量的重复性内容,甚至出现了全是<|assistant|><|assistant|>输出的情况,请问有人遇到过吗,该如何解决 |
Beta Was this translation helpful? Give feedback.
Answered by
zRzRzRzRzRzRzR
Jan 28, 2024
Replies: 1 comment 4 replies
-
<|assistant|>是模板没有更新吧,chatglm3-6b对应的模板已经更新了 |
Beta Was this translation helpful? Give feedback.
4 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
是最新的模型配置吗,我估计是使用了vllm或者fschat嵌套了错误的内容,不过重复的问题好像是有存在的,可以尝试在调高重复惩罚系数(chatchat没有,你得用transformer手动传入)