[ENH] Introduce spann segment and index

[sanketkedia]

Description of changes

• New functionality
  • Added SPANN index and segment writer types
  • Added from_segment() impl

Test plan

• Tests pass locally with pytest for python, yarn test for js, cargo test for rust

Documentation Changes

None

[github-actions]

Reviewer Checklist

Please leverage this checklist to ensure your code review is thorough before approving

Testing, Bugs, Errors, Logs, Documentation

• Can you think of any use case in which the code does not behave as intended? Have they been tested?
• Can you think of any inputs or external events that could break the code? Is user input validated and safe? Have they been tested?
• If appropriate, are there adequate property based tests?
• If appropriate, are there adequate unit tests?
• Should any logging, debugging, tracing information be added or removed?
• Are error messages user-friendly?
• Have all documentation changes needed been made?
• Have all non-obvious changes been commented?

System Compatibility

• Are there any potential impacts on other parts of the system or backward compatibility?
• Does this change intersect with any items on our roadmap, and if so, is there a plan for fitting them together?

Quality

• Is this code of a unexpectedly high quality (Readability, Modularity, Intuitiveness)

[github-actions]

Please tag your PR title with one of: [ENH | BUG | DOC | TST | BLD | PERF | TYP | CLN | CHORE]. See https://docs.trychroma.com/contributing#contributing-code-and-ideas

[sanketkedia]

• [ENH] spann query orchestrator #3219
• [ENH] spann_merge_operator #3218
• [ENH] Brute force distances for a posting list operator #3215
• [ENH] Fetch posting list operator #3214
• [ENH] rng_query_operator #3213
• [ENH] Introduce spann segment reader #3212
• [ENH] Full garbage collection #3194
• [ENH] SPANN: Implement update and delete #3185
• [ENH] Implement append #3182
• [ENH] Implement K Means #3159
• [ENH] implement append, commit and flush for spann segment and index #3084
• [ENH] Introduce spann segment and index #3080 👈 (View in Graphite)
• [CLN] Cleanup hnsw provider to not know about segments #3044
• [ENH] BF writer support reads #3031
• [ENH] Add new value type for spann posting lists #3022
• main

This stack of pull requests is managed by Graphite. Learn more about stacking.

[sanketkedia]

Merge activity

• Dec 4, 2:13 PM EST: A user started a stack merge that includes this pull request via Graphite.
• Dec 4, 2:13 PM EST: A user merged this pull request with Graphite.