Skip to content
This repository has been archived by the owner on Aug 30, 2024. It is now read-only.
CPP Graph Test

[LLM Runtime] Support 3bits & 4bits GPTQ for gpt-j #285

Sign in to view logs

[LLM Runtime] Support 3bits & 4bits GPTQ for gpt-j

[LLM Runtime] Support 3bits & 4bits GPTQ for gpt-j #285

Run time

Learn about OS pricing on GitHub Actions
Job Run time
CPP-Graph-Workflow (llama-2-7b-chat)
5m 59s
CPP-Graph-Workflow (gptj-6b)
6m 28s
Genreate-Report
12s
12m 39s