Skip to content

Commit

Permalink
Update 0-architecture.md (#961)
Browse files Browse the repository at this point in the history
  • Loading branch information
n-y-kim authored Aug 19, 2024
1 parent 3c0a98c commit 84f9bae
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docsite/posts/index/0-architecture.md
Original file line number Diff line number Diff line change
Expand Up @@ -65,7 +65,7 @@ Our underlying dataframe technology may change over time, but our primary goal i

### LLM Caching

The GraphRAG library was designed with LLM interactions in mind, and a common setback when working with LLM APIs is various errors errors due to network latency, throttling, etc..
The GraphRAG library was designed with LLM interactions in mind, and a common setback when working with LLM APIs is various errors due to network latency, throttling, etc..
Because of these potential error cases, we've added a cache layer around LLM interactions.
When completion requests are made using the same input set (prompt and tuning parameters), we return a cached result if one exists.
This allows our indexer to be more resilient to network issues, to act idempotently, and to provide a more efficient end-user experience.

0 comments on commit 84f9bae

Please sign in to comment.