v0.0.3
More Languages!
This release adds AnalyzerBuilders
for Portuguese, Brazilian Portuguese, and Dutch!
Default Stop Words
You can now use the Lucene default stop words via withDefaultStopWords
. You can also check out what those stop words are with the defaultStopWords
helper.
Adding your own stop words changes from using withStopWords
to withCustomStopWords
.
This feature was contributed by @samspills! 🎉
Breaking Changes
As mentioned above, customizing stop words has changed from withStopWords
to withCustomStopWords
.
Tokenizer.vectorTokenizer
now takes a Resource[F, Analyzer]
instead of a raw Analyzer
, while this is a breaking change we imagine it affects no one, as most usage goes through the AnalyzerBuilder
or AnalyzerPipe
.
What's Changed
- Update munit-cats-effect to 2.0.0-M3 by @scala-steward in #38
- Update fs2-core, fs2-io to 3.3.0 by @scala-steward in #37
- Separate Custom & Default Stop Filters by @samspills in #39
- flake.lock: Update by @valencik in #41
- flake.lock: Update by @valencik in #42
- flake.lock: Update by @valencik in #44
- Update sbt to 1.7.2 by @scala-steward in #48
- Update scalafmt-core to 3.6.0 by @scala-steward in #49
- Update lucene-analysis-common, ... to 9.4.0 by @scala-steward in #46
- Add yet more languages by @valencik in #45
- Add helper function for
defaultStopWords
by @valencik in #50 - Change Tokenizer to take Resource[F, Analyzer] by @valencik in #51
New Contributors
- @samspills made their first contribution in #39
Full Changelog: v0.0.2...v0.0.3