Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The loss is always 0 when fine-tuning internlm-xcomposer2d5-7b #1680

Closed
yimuu opened this issue Aug 12, 2024 · 1 comment
Closed

The loss is always 0 when fine-tuning internlm-xcomposer2d5-7b #1680

yimuu opened this issue Aug 12, 2024 · 1 comment

Comments

@yimuu
Copy link

yimuu commented Aug 12, 2024

微调internlm-xcomposer2d5-7b时,损失总是0

@Jintao-Huang
Copy link
Collaborator

拉取一下最新的代码 看看是否还在存在该问题

如果存在 请发一下sh

@Jintao-Huang Jintao-Huang changed the title Loss is aways 0 The loss is always 0 when fine-tuning internlm-xcomposer2d5-7b Aug 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants