Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

训练过程的loss #248

Open
Ulricman opened this issue May 5, 2022 · 2 comments
Open

训练过程的loss #248

Ulricman opened this issue May 5, 2022 · 2 comments

Comments

@Ulricman
Copy link

Ulricman commented May 5, 2022

你好,请问训练过程中loss变化比较剧烈是什么原因呢?
还有就是,想请教以下,如果自己把代码改成batch_size>1的情况,工程量大不大?(还没仔细看代码)

@Ayu000
Copy link

Ayu000 commented May 26, 2022

我跑了很多不同的代码 loss的波动都很剧烈 而且下降特别快

@Ulricman
Copy link
Author

我跑了很多不同的代码 loss的波动都很剧烈 而且下降特别快

我觉得可能是因为batch_size过小导致的?我跑的其中一个代码的batch_size=4, loss变化就没那么剧烈。
屏幕截图 2022-05-26 095434

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants