Skip to content

Issues: deepjavalibrary/djl

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

150 Open 709 Closed
150 Open 709 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

DJL 0.30 Sagemaker Endpoint Deployment using vllm of quantized model parameter option.quantization is not working bug Something isn't working
#3545 opened Nov 28, 2024 by adi7820
Add support for 'rotary' position embedding type for xml-roberta models enhancement New feature or request
#3536 opened Nov 17, 2024 by Aelentel
Add support for stella_en_400M_v5 and add to model zoo enhancement New feature or request
#3522 opened Nov 15, 2024 by ThiloteE
Rewrite documentation about how to convert a safetensor file and add a model to the model zoo enhancement New feature or request
#3521 opened Nov 15, 2024 by ThiloteE
djl-convert does not produce working model from Huggingface bug Something isn't working
#3518 opened Nov 14, 2024 by AlEscher
11
Suuport for YOLO v11 enhancement New feature or request
#3513 opened Nov 10, 2024 by harikrishnanmurthy
2
I have a pytorch model exported as an onnx format, Which engine should I to set when I use Criteria? During prediction, I use NDManager.newBaseManager to get a NDManager, which engine should NDManager.newBaseManager use?
#3508 opened Oct 30, 2024 by BlackRen09
1
Expose vLLM logprobs in model output enhancement New feature or request
#3491 opened Oct 1, 2024 by CoolFish88
3
TensortRT-LLM compilation parameter overwrite bug Something isn't working
#3489 opened Oct 1, 2024 by CoolFish88
Request for SAM2 Model in ONNX Format and Synset File for Classification Output enhancement New feature or request
#3483 opened Sep 23, 2024 by leleZeng
5
UnsatisfiedLinkError when running examples bug Something isn't working
#3480 opened Sep 19, 2024 by dwctic
3
Please add JPMS/module-info data to this project enhancement New feature or request
#3473 opened Sep 15, 2024 by Siedlerchr
2
Failed to deploy Mistral 8X7b with the latest LMI djl-tensorrtllm container on Sagemaker G5.48xlarge bug Something isn't working
#3445 opened Aug 29, 2024 by gsjoy8888
BAAI/bge-m3 Model: data did not match any variant of untagged enum PreTokenizerWrapper bug Something isn't working
#3438 opened Aug 22, 2024 by iprovalo
2
DJL Error on simple Pytorch binding code bug Something isn't working
#3414 opened Aug 15, 2024 by eix128
4
How to load .pt model in scala? enhancement New feature or request
#3402 opened Aug 10, 2024 by zaryabRiasat
1
Error issue using BatchPredict API
#3401 opened Aug 9, 2024 by suntingfeng
1
Adding ignore_eos_token support in Chat Completions API Schema enhancement New feature or request
#3387 opened Aug 6, 2024 by jiahong-liu
@siddvenk
1
There is an error dialog when i try to load a torchscript model. bug Something isn't working
#3368 opened Jul 30, 2024 by huobingnan
2
Onnxruntime-gpu 1.8.0 killed the process on cpu device bug Something isn't working
#3366 opened Jul 29, 2024 by zaobao
4
OFA-Sys Chinese-CLIP Example enhancement New feature or request
#3363 opened Jul 25, 2024 by heliang230
1
How to serv with 2 model folders? enhancement New feature or request
#3360 opened Jul 22, 2024 by SidneyLann
17
Model conversion process failed when deploying Mixtral 8x22B AWQ with djl-tensorrtllm to Sagemaker bug Something isn't working
#3343 opened Jul 17, 2024 by gsjoy8888
3
Can I load a pytorch pretrained model, and use its block to replace one in my network?
#3278 opened Jun 26, 2024 by kobe2000
1
TimeSeries API Bugs (frequency, context length, FEAT_DYNAMIC_REAL) bug Something isn't working
#3271 opened Jun 22, 2024 by keklol5050
6
ProTip! Add no:assignee to see everything that’s not assigned.