在官方最新源码基础上更改持久化存储对象为反向索引与评分字段 #35
Open
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
1. 持久化存储对象，从原始文档改为反向索引文档与文档评分字段，从而避免程序重启后，需要重新分词、索引的麻烦； 2. 将持久数据库分片数与索引器、排序器的分片数保持一致，即实现一一对应关系，从而保证从数据库可以完美恢复； 3.依然存在的问题：悟空采用的这两中KV数据库，读写速率太慢，严重拖累高并发的特性。
1. 持久化存储对象，从原始文档改为反向索引文档与文档评分字段，从而避免程序重启后，需要重新分词、索引的麻烦； 2. 将持久数据库分片数与索引器、排序器的分片数保持一致，即实现一一对应关系，从而保证从数据库可以完美恢复； 3. 依然存在的问题：悟空采用的这两种KV数据库，读写速率太慢，严重拖累高并发的特性。
增加Goleveldb存储支持
增加Goleveldb存储支持
增加Goleveldb存储支持（修正）
增加Goleveldb支持
Update storage.go
Create ldb_storage.go
|
1、貌似没有merge最新的master 另外change有些大，请split成几个小的request分别提交。 |
|
最近一次更新，我是用你最新源码把我改过的覆盖过的，知道你不能一下接受DocId的类型改变，这个最新的，我只是改了持久化存储 |
|
@huichen 还有，可以邀请你这位大牛来小弟建的这个讨论大数据的群吗？真心希望可以和兄弟你交流大数据方面的东西，而且咱们还算是老乡（^v^） |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
在官方最新源码基础上改进的：