Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
tr7200 committed May 10, 2020
1 parent 59d85d8 commit 0f643df
Showing 1 changed file with 4 additions and 3 deletions.
7 changes: 4 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,9 +30,10 @@ the ablation tests in appendix I.2 uses 1 Monte Carlo sample so this
simplification may not adversely affect variation too badly.
See [here](https://thinklab.com/content/2693564) for more information on the
presentation.
- Unlike the Keras implementation of Adam, the Pytorch code for Vadam performs
bias correction. Bias correction is therefore added here as well, but using
it resulted in numerical instability and code is left commented out.
- Unlike the Keras implementation of Adam, both the Pytorch implementation
of Adam as well as Vadam perform bias correction. Bias correction is
therefore added here as well, but using it resulted in numerical instability
and code is left commented out.

Usage (only required parameter is train_set_size, though prior_prec should
definitely be tuned):
Expand Down

0 comments on commit 0f643df

Please sign in to comment.