- A
LanguageDetector
can now be built with lazy-loading required language models on demand (default) or with preloading all language models at once by callingLanguageDetectorBuilder.with_preloaded_language_models()
. (#10)
- The Maori language is now supported. Thanks to @eekkaiia for the contribution. (#5)
- Loading and searching the language models has been quite slow so far. Using parallel iterators from the Rayon library, this process is now at least 50% faster, depending on how many CPU cores are available. (#8)
- Accuracy reports are now also generated for the CLD2 library and included in the language detector comparison plots. (#6)
- Lingua could not be used within other projects because of a private serde module that was accidentally tried to be exposed. Thanks to @luananama for reporting this bug. (#9)
- Accidentally, bug #3 was only partially fixed. This has been corrected.
- When trying to create new language models, the
LanguageModelFilesWriter
panicked when it recognized characters in a text corpus that consist of multiple bytes. Thanks to @eekkaiia for reporting this bug. (#3)
This is the very first release of Lingua for Rust. Took me 5 months of hard work in my free time. Hope you find it useful. :)