Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

A question about test_optim_adam_z_memory_check_1 #17

Open
hkr04 opened this issue Oct 1, 2024 · 0 comments
Open

A question about test_optim_adam_z_memory_check_1 #17

hkr04 opened this issue Oct 1, 2024 · 0 comments

Comments

@hkr04
Copy link

hkr04 commented Oct 1, 2024

With my implementation and an old version from others, I got this assertion error:
image
But if I print one of the m, v, grad,it will pass (for both my implementation and another one):
image
Note that I only transform the m and v to ndl.Tensor for once and use the .data in calculation, and I can pass the previous test_optim_sgd_z_memory_check_1.

Could anyone explain this? I'm quite confused why this would influence the count of tensors. Thanks for help :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant