Welcome to mirror list, hosted at ThFree Co, Russian Federation.

github.com/clementfarabet/lua---nnx.git - Unnamed repository; edit this file 'description' to name the repository.
summaryrefslogtreecommitdiff
diff options
context:
space:
mode:
authorGaetanMarceauCaron <gaetan.marceau-caron@inria.fr>2016-04-15 17:25:02 +0300
committerGaetanMarceauCaron <gaetan.marceau-caron@inria.fr>2016-04-15 17:25:02 +0300
commitd0befcaecd0bccd38863d7dc29dff919478e5d00 (patch)
tree452802ed8b393c056a251b556502ee692b76a29c
parent4a72160aade7d3c286643dfe270b75810c775ab8 (diff)
minor modif
-rw-r--r--README.md3
1 files changed, 1 insertions, 2 deletions
diff --git a/README.md b/README.md
index c613822..9c6e86d 100644
--- a/README.md
+++ b/README.md
@@ -236,8 +236,7 @@ Two additional arguments are also possible:
* gamma (default=0.01): determine the update rate of the metric for a minibatch setting, i.e., (1-gamma) * oldMetric + gamma newMetric. Smaller minibatches require a smaller gamma. A default value depending on the size of the minibatches is `gamma = 1. - torch.pow(1.-1./nTraining,miniBatchSize)` where `nTraining` is the number of training examples of the dataset and `miniBatchSize` is the number of training examples per minibatch.
* qdFlag (default=true): Whether to use the quasi-diagonal reduction (true) or only the diagonal (false). The former should be better.
-To implement a natural gradient descent, one should also use a module for generating the pseudo-labels.
-
+Replacing Linear by QDRiemmaNNLinear is a straightforward implementation of the outer product gradient descent.
## Requirements