Skip to content

Issues: michaelfeil/infinity

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

45 Open 144 Closed
45 Open 144 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

torch.OutOfMemoryError: CUDA out of memory. when serving NV-Embed-V2 on 8 40G A100 GPUs
#498 opened Dec 16, 2024 by atanikan
2 of 5 tasks
2
Support for models trained with SetFit for classification
#497 opened Dec 15, 2024 by S1LV3RJ1NX
Binary quantization - evaluate quality
#484 opened Nov 29, 2024 by cduk
1
health endpoint does not really provide insights about healthiness
#483 opened Nov 28, 2024 by bufferoverflow
5 tasks
3
Pass kwargs to encoder
#482 opened Nov 28, 2024 by RichaMax
4
support for dimensions field like in OpenAI text-embedding-3, thanks good first issue Good for newcomers help wanted Extra attention is needed
#476 opened Nov 21, 2024 by ericg108
4
Support for custom SentenceTransformer models
#474 opened Nov 20, 2024 by wwymak
4 tasks
3
Missing Contribution.md file
#433 opened Oct 20, 2024 by yaarAdarsh
3
Abstraction for resolve_torch_dtype_device(dtype: Dtype, device: Device) -> tuple[quantization_type, torch.device, torch.dtype]
#424 opened Oct 14, 2024 by michaelfeil
1
Maintainer: Breaking CI / Python installs help wanted Extra attention is needed
#415 opened Oct 11, 2024 by michaelfeil
1
cli to set max_seq_length = 2048
#411 opened Oct 10, 2024 by Liwan-Chen
1
[Doc] Documentation on how to run infinity on AWS Inf2
#408 opened Oct 8, 2024 by marcomarinodev
14
[Doc] Documentation on how to run infinity on AMD GPU
#400 opened Oct 7, 2024 by tjtanaa
3
Feature : Support SPLADE pooling
#399 opened Oct 7, 2024 by tsensei
2
Better Prometheus metrics: Idea collection thread
#398 opened Oct 5, 2024 by michaelfeil
Add a End-to-end unit test for image embeddings and audio embeddings help wanted Extra attention is needed
#378 opened Sep 24, 2024 by michaelfeil
2
when use engine optimum device tensorrt，startup fail
#372 opened Sep 23, 2024 by weibingo
2 of 4 tasks
5
Reranker dynamic quantization help wanted Extra attention is needed
#363 opened Sep 16, 2024 by rawsh-rubrik
1
jinaai/jina-reranker-v1-*-en does not work with optimum
#362 opened Sep 13, 2024 by rawsh
2 of 4 tasks
1
Issue running cross-encoder onnx model exported with optimum-cli
#361 opened Sep 13, 2024 by rawsh
2 of 4 tasks
2
Write a custom flash-attention function for the deberta model.
#359 opened Sep 12, 2024 by wolfassi123
3 tasks done
1
Question: Support for colbertv2.0 ?
#355 opened Sep 10, 2024 by shatealaboxiaowang
3 tasks
2
Support Integration with KServe help wanted Extra attention is needed
#352 opened Sep 6, 2024 by indranilr
1
Reranker API “top_k” Support
#342 opened Aug 19, 2024 by etwk
5
Add Installation Option to Depend Only on ONNX, Excluding New Torch and CUDA Packages
#332 opened Aug 9, 2024 by bash99
3
ProTip! Exclude everything labeled bug with -label:bug.