Approximate nearest neighbors suggestion

[saskiabosma]

Hello and thanks a lot for making this open-source !

I was wondering if you had considered the NMSLIB-HNSW approximate nearest neighbor algorithm for use with these embeddings, as according to (here) it is faster than Annoy ?

[vinid]

Hello! thanks so much for the suggestion, I'll take a look at the lib!

[saskiabosma]

There is also Scann that looks even faster, but I haven't tried it. I used NMSLIB-HNSW in the context of searching for neighbours in embeddings space from contrastive learning using the tensorflow-similarity lib, which is similar to this repo's use-case. Tensorflow-similarity doesn't use Scann so maybe there's a subtle blocker !