diff options
author | Soumith Chintala <soumith@gmail.com> | 2017-02-08 05:43:39 +0300 |
---|---|---|
committer | GitHub <noreply@github.com> | 2017-02-08 05:43:39 +0300 |
commit | 656c42af1f996e4a5d6aae3b9aeac831ca162241 (patch) | |
tree | 3f78862582af7c42175c9adf0b87025e448b4604 | |
parent | 89ef52a03b1c39c645d96023b8748ef84973d4f6 (diff) | |
parent | 19c8283af4dc4f5ce4441d3a7eb0a3ad02375588 (diff) |
Merge pull request #150 from Amir-Arsalan/patch-1
Update algos.md
-rw-r--r-- | doc/algos.md | 3 |
1 files changed, 3 insertions, 0 deletions
diff --git a/doc/algos.md b/doc/algos.md index a8dba9f..a3013d9 100644 --- a/doc/algos.md +++ b/doc/algos.md @@ -180,6 +180,8 @@ Arguments: * `x`: the initial point * `config`: a table with configuration parameters for the optimizer * `config.learningRate`: learning rate + * `config.learningRateDecay`: learning rate decay + * `config.weightDecay`: weight decay coefficient for regularization * `state`: a table describing the state of the optimizer; after each call the state is modified * `state.paramVariance`: vector of temporal variances of parameters @@ -201,6 +203,7 @@ Arguments: * `config`: a table with configuration parameters for the optimizer * `config.learningRate`: learning rate * `config.learningRateDecay`: learning rate decay + * `config.weightDecay`: weight decay coefficient for regularization * `config.beta1`: first moment coefficient * `config.beta2`: second moment coefficient * `config.epsilon`: for numerical stability |