diff options
| author | Soumith Chintala <soumith@gmail.com> | 2016-06-09 00:32:50 +0300 |
|---|---|---|
| committer | Soumith Chintala <soumith@gmail.com> | 2016-06-09 00:32:50 +0300 |
| commit | 016dca94bed88cdfd23a6ddddc5a48e9bdb114e5 (patch) | |
| tree | 616b93ed411a9b5e96237f95c18b152180c26e8e | |
| parent | 6759dc8a210b1f93184a23bda9c4ca5eb8c2b71a (diff) | |
| parent | 9c08fde975c5998cc25d5ebf265754486dd5c160 (diff) | |
Merge pull request #117 from andreaskoepf/rmsprop_warmup
Init rmsprop mean square state 'm' with 1 instead 0
| -rw-r--r-- | rmsprop.lua | 2 |
1 files changed, 1 insertions, 1 deletions
diff --git a/rmsprop.lua b/rmsprop.lua index 8947b18..038af21 100644 --- a/rmsprop.lua +++ b/rmsprop.lua @@ -40,7 +40,7 @@ function optim.rmsprop(opfunc, x, config, state) -- (3) initialize mean square values and square gradient storage if not state.m then - state.m = torch.Tensor():typeAs(x):resizeAs(dfdx):zero() + state.m = torch.Tensor():typeAs(x):resizeAs(dfdx):fill(1) state.tmp = torch.Tensor():typeAs(x):resizeAs(dfdx) end |