Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

First round of fixes based on user feedback #290

Merged
merged 6 commits into from
Dec 12, 2024

Conversation

trentfowlercohere
Copy link
Contributor

@trentfowlercohere trentfowlercohere commented Dec 9, 2024

This pull request introduces several updates to the documentation related to text embeddings, reranking, and prompt engineering. The changes aim to provide clearer guidance on handling large queries, managing context length, and truncating prompts.

  • Updated Query Handling: In the fern/pages/text-embeddings/reranking/overview.mdx file, the query in the example has been updated to include double quotes around the query text. This ensures that the query is treated as a string literal, improving code readability and avoiding potential issues with special characters or whitespace.
  • Rerank Model Versions: The fern/pages/text-embeddings/reranking/reranking-best-practices.mdx file now mentions both rerank-v3.5 and rerank-v3.0 models, indicating that both versions are available and trained with a context length of 4096 tokens. This update clarifies the supported model versions and their context length capabilities.
  • Enhanced Prompt Truncation: The fern/pages/text-generation/prompt-engineering/prompt-truncation.mdx file has been modified to provide more detail about the prompt_truncation parameter. It now explains that when set to AUTO, the API will break documents into smaller chunks, rerank them based on relevance, and drop the least relevant documents to fit within the model's context length limit. This enhancement offers a more comprehensive understanding of how the API handles prompt truncation.

@trentfowlercohere trentfowlercohere requested a review from a team as a code owner December 9, 2024 20:14
@trentfowlercohere trentfowlercohere requested a review from a team as a code owner December 10, 2024 21:19
Copy link

Copy link

Copy link

@trentfowlercohere trentfowlercohere merged commit 4d1a9d5 into main Dec 12, 2024
4 checks passed
@trentfowlercohere trentfowlercohere deleted the feedback-fixes-round-1 branch December 12, 2024 17:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants