Welcome to mirror list, hosted at ThFree Co, Russian Federation.

github.com/marian-nmt/marian.git - Unnamed repository; edit this file 'description' to name the repository.
summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2021-07-09update version and changelogMarcin Junczys-Dowmunt
2021-07-09Merged PR 19685: Marianize LSH as operators for mmapping and use in QuicksandMartin Junczys-Dowmunt
This PR turns the LSH index and search into a set of operators that live in the expression graph. This makes creation etc. thread-safe (one index per graph) and allows to later implement GPU versions. This allows to mmap the LSH as a Marian parameter since now we only need to turn the index into something that can be saved to disk using the existing tensors. This happens in marian_conv or the equivalent interface function in the Quicksand interface.
2021-07-03Merged PR 19409: Unify LSH and short list interfaceHieu Hoang
This PR unifies the shortlist and LSH interface achieving significant speed-up for the LSH.
2021-07-03remaining commentsMarcin Junczys-Dowmunt
2021-07-03Merge branch 'hihoan/lsh7' of ↵Marcin Junczys-Dowmunt
vs-ssh.visualstudio.com:v3/machinetranslation/Marian/marian-dev into hihoan/lsh7
2021-07-03paperHieu Hoang
2021-07-03remove todoHieu Hoang
2021-07-02credit SLIDEHieu Hoang
2021-07-02marcin's review changesHieu Hoang
2021-07-02lock index before creationHieu Hoang
2021-06-29Merge branch 'master' into hihoan/lsh7Marcin Junczys-Dowmunt
2021-06-29Merge branch 'hihoan/lsh7' of ↵Hieu Hoang
vs-ssh.visualstudio.com:v3/machinetranslation/Marian/marian-dev into hihoan/lsh7
2021-06-29pass shortlist regression testsHieu Hoang
2021-06-29fix compilation errors due to narrow conversionMarcin Junczys-Dowmunt
2021-06-29Merged PR 19597: Enable mpi wrapper to use size larger than MAX_INTMartin Junczys-Dowmunt
Enable mpi wrapper to use size larger than MAX_INT.
2021-06-18changes for reviewHieu Hoang
2021-06-16debugHieu Hoang
2021-06-16update sentencepiece pointer to version with case-awarenessMarcin Junczys-Dowmunt
2021-06-16clean up biasHieu Hoang
2021-06-16lemma Et is optionalHieu Hoang
2021-06-16init vectorHieu Hoang
2021-06-16Merge branch 'hihoan/lsh7' of ↵Hieu Hoang
vs-ssh.visualstudio.com:v3/machinetranslation/Marian/marian-dev into hihoan/lsh7
2021-06-16get lemma size from vocab classHieu Hoang
2021-06-15delete variables altogetherHieu Hoang
2021-06-15'use' variablesHieu Hoang
2021-06-15don't define BLAS_FOUNDHieu Hoang
2021-06-15no need for args in getIndicesExpr(). Deleted debuggingHieu Hoang
2021-06-15reverse batch beam argument orderHieu Hoang
2021-06-15rename broadcast -> createCachedTensorsHieu Hoang
2021-06-15incorrect dimension orderHieu Hoang
2021-06-12no need to broadcastHieu Hoang
2021-06-12don't transpose lastIndices. Works for lsh & slHieu Hoang
2021-06-12don't transpose lastIndices. Works for lshHieu Hoang
2021-06-11debugHieu Hoang
2021-06-11batch-beam -> beam-batchHieu Hoang
2021-06-10origBatchIdx -> currentBatchIdx. Doesn't crash but bad resultsHieu Hoang
2021-06-10debugHieu Hoang
2021-06-10debugHieu Hoang
2021-06-10batch based filtering. COmment out debugHieu Hoang
2021-06-09don't manually broadcast lemmaHieu Hoang
2021-06-09don't manually broadcast weightsHieu Hoang
2021-06-09separate broadcastHieu Hoang
2021-06-09filter & broadcast every word. SL worksHieu Hoang
2021-06-09debugHieu Hoang
2021-06-08reshape cachedShortWt_Hieu Hoang
2021-06-08debugHieu Hoang
2021-06-08reshape cachedShortLemmaEtHieu Hoang
2021-06-08reduce tranform for no-shortlistHieu Hoang
2021-06-08start using bdotHieu Hoang
2021-06-08Merge branch 'mjd/bdot' into hihoan/lsh7Hieu Hoang