diff options
| author | Marco Scoffier <github@metm.org> | 2011-10-14 07:12:36 +0400 |
|---|---|---|
| committer | Marco Scoffier <github@metm.org> | 2011-10-14 07:12:36 +0400 |
| commit | d152adae01e2b11529fa7201cf66e13e537ff7c9 (patch) | |
| tree | c87395040b884acea6fa281ac2f4614cc8b7fe7c | |
| parent | 256c081377424e2b4752346b37fc788235102490 (diff) | |
make sure to set learningrates to 1 each time we call diagHessian
| -rw-r--r-- | SGDOptimization.lua | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/SGDOptimization.lua b/SGDOptimization.lua index a0184fa..3837950 100644 --- a/SGDOptimization.lua +++ b/SGDOptimization.lua @@ -86,6 +86,7 @@ function SGD:diagHessian(inputs, targets) nnx.flattenParameters(nnx.getDiagHessianParameters(self.module)) end self.diagHessianParameters:zero() + self.learningRates:fill(1) -- estimate diag hessian over dataset if type(inputs) == 'table' then -- slow for i = 1,#inputs do |