diff options
| author | Amir Arsalan Soltani <Amir-Arsalan@users.noreply.github.com> | 2017-02-08 04:19:24 +0300 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2017-02-08 04:19:24 +0300 |
| commit | 19c8283af4dc4f5ce4441d3a7eb0a3ad02375588 (patch) | |
| tree | 3f78862582af7c42175c9adf0b87025e448b4604 | |
| parent | 89ef52a03b1c39c645d96023b8748ef84973d4f6 (diff) | |
Update algos.md
| -rw-r--r-- | doc/algos.md | 3 |
1 files changed, 3 insertions, 0 deletions
diff --git a/doc/algos.md b/doc/algos.md index a8dba9f..a3013d9 100644 --- a/doc/algos.md +++ b/doc/algos.md @@ -180,6 +180,8 @@ Arguments: * `x`: the initial point * `config`: a table with configuration parameters for the optimizer * `config.learningRate`: learning rate + * `config.learningRateDecay`: learning rate decay + * `config.weightDecay`: weight decay coefficient for regularization * `state`: a table describing the state of the optimizer; after each call the state is modified * `state.paramVariance`: vector of temporal variances of parameters @@ -201,6 +203,7 @@ Arguments: * `config`: a table with configuration parameters for the optimizer * `config.learningRate`: learning rate * `config.learningRateDecay`: learning rate decay + * `config.weightDecay`: weight decay coefficient for regularization * `config.beta1`: first moment coefficient * `config.beta2`: second moment coefficient * `config.epsilon`: for numerical stability |