Age | Commit message (Collapse) | Author | |
---|---|---|---|
2022-10-05 | Update installation commandHEADmaster | Jaume Zaragoza | |
Latest was forcing source tarball to be used instead of wheel. Tarball is ok but since wheel will be available, prefer to use it. | |||
2022-09-30 | Update Hub client to 0.10 | ZJaume | |
2022-09-28 | Fix download command | Marta Bañón | |
2022-09-23 | Add test suite (#21) | Jaume Zaragoza | |
* Basic test for full model training * Extend full train test * Add train lite test * Ensure reproducibility of frequence noise * Unit test for noise generation * Add Tokenizer class test * Remove old test corpus file * Add classifier tests Download files on pytest setup to the test dir to avoid downloading it every time. Test normal, calibrated and raw modes. * Download models only in classifier test * Delete args object to avoid interference between tests | |||
2022-09-15 | Set SentencePiece seed | ZJaume | |
2022-09-15 | Flatten full model directory (again) | ZJaume | |
2022-09-15 | Fix transformer training | ZJaume | |
Ignore synthetic noise tag when loading data. Don't return tuples in datagen for transformer Fix TokenAndPositionEmbeddings call | |||
2022-09-05 | Look for model and vocab subdirectories when loading | ZJaume | |
2022-09-05 | Fix typo when writing version to metadata | ZJaume | |
2022-08-26 | Remove unused import in __init__.py | ZJaume | |
2022-08-26 | Add regex to requirements | Jaume Zaragoza | |
2022-08-24 | Restore classifier layer loading for old models | ZJaume | |
2022-08-23 | Write current package version to metadata | ZJaume | |
2022-08-23 | Move package version to setup.cfg | ZJaume | |
2022-08-22 | Freeze hardrules version | Jaume Zaragoza | |
2022-08-19 | Don't load Hardrules objects if disabled | ZJaume | |
2022-08-17 | Update glove | ZJaume | |
2022-08-17 | typo | Marta Bañón | |
2022-08-17 | typo | Marta Bañón | |
2022-08-16 | Use bicleaner-ai-glove fork | ZJaume | |
This fork gives compatibility with Python 3.8, 3.9 and 3.10 | |||
2022-08-09 | Restore retrocompatibility with older models | ZJaume | |
2022-08-09 | Fix loading local models | ZJaume | |
2022-08-09 | Speed improvements using padding longest and no max_length | ZJaume | |
2022-07-27 | Update CHANGELOG | ZJaume | |
Add keepchangelog reference and the remaining changes | |||
2022-07-27 | Downloading script improvements | ZJaume | |
- Move script to `bicleaner-ai-download` - Create `bicleaner-ai-download-hf` for HF Hub that is called by the main script. - Update readme with instructions. | |||
2022-07-27 | Install download-pack as bicleaner-ai-download | ZJaume | |
2022-07-27 | Be more informative when model not found | ZJaume | |
2022-07-27 | Remove unset variable | ZJaume | |
2022-07-27 | Download models from HFHub if possible | ZJaume | |
2022-07-27 | Introduce model names | ZJaume | |
2022-07-27 | Remove vocab and model file config values, use only dir | ZJaume | |
2022-07-27 | Flatten the full model directory | ZJaume | |
2022-07-27 | Overwrite XLMRConfig class | ZJaume | |
This makes the classes more compatible with HF API and to be able to load them later more easily. | |||
2022-07-27 | Update CHANGELOG | ZJaume | |
* Reformat to keepchangelog.com style * Remove old Bicleaner changelogs * Add new changes to the unreleased section | |||
2022-07-27 | Update version | ZJaume | |
2022-07-27 | Update hardrules and installation instructions | ZJaume | |
2022-07-25 | Redirect predict progbar to stder in debug mode | ZJaume | |
2022-07-11 | Fix imports in classifier and train | ZJaume | |
2022-07-11 | Introduce BICLEANER_AI_THREADS to control number of threads | ZJaume | |
`--processes` option is now deprecated in favor of the environment variable. The TensorFlow threads is now set prior to initialization to avoid errors. | |||
2022-07-06 | Add requirements.txt to setup.py | Marta Bañón | |
2022-07-06 | README: fix pdf link | Jaume Zaragoza | |
2022-07-06 | README: fix cite format | ZJaume | |
2022-07-06 | Add paper citation to the README | ZJaume | |
2022-07-05 | Redirect all Keras progbars to stderr | ZJaume | |
Seems that Keras developers won't accept writing progbars to stderr, see [here](https://github.com/keras-team/keras/pull/12019) | |||
2022-07-05 | Set inter/intra_op parallelism to 0 by default | ZJaume | |
There's no need of setting it to max cpu, TF will set an optimal value | |||
2022-07-05 | Update HF transformers: allow higher versions | ZJaume | |
2022-07-05 | Add a warning about how to check TF installation | ZJaume | |
2022-07-05 | Change XLMR subclass name to pass HF signature check | ZJaume | |
2022-07-05 | Metrics rename `update_state` | ZJaume | |
2022-07-05 | Update TensorFlow minimum version to 2.6.5 | ZJaume | |