Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question] How can I reduce memory cost when loading index & searching #566

Open
hanqiushi opened this issue Jul 16, 2024 · 0 comments
Open
Labels
question Further information is requested

Comments

@hanqiushi
Copy link

hanqiushi commented Jul 16, 2024

When I run search_memory_index & search_disk_index in https://github.com/microsoft/DiskANN/blob/main/workflows/SSD_index.md , I found the memory cost is no less than other kinds of indexes.
Is there any way I can run load index & search with less memory cost? Thanks

e.g. in search_disk_index, use pq_flash_index.cached_beam_search to search, after test case completed, the memory cost raises about 50MB, which is almost the file size of sift_learn.fbin

@hanqiushi hanqiushi added the question Further information is requested label Jul 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

1 participant