Benchmark Nightly #262
zachgkbenchmark-nightly.yml
on: schedule
g5-12xl
/
create-runners
2m 28s
g5-2xl
/
create-runners
2m 37s
g5-48xl
/
create-runners
3m 9s
create-runners
1m 46s
Matrix: handler-performance-test
Matrix: g5-12xl / benchmark_run
Matrix: g5-2xl / benchmark_run
Matrix: g5-48xl / benchmark_run
stop-g6-runners
5s
g5-12xl
/
stop-runners
6s
g5-2xl
/
stop-runners
5s
g5-48xl
/
stop-runners
5s
Annotations
5 errors
|
g5-12xl / benchmark_run (llama2[ENGINE=lmi-dist])
Process completed with exit code 1.
|
|
g5-12xl / benchmark_run (llama3[ENGINE=vllm])
The job was canceled because "llama2_ENGINE_lmi-dist_" failed.
|
|
g5-12xl / benchmark_run (llama2[ENGINE=vllm])
The job was canceled because "llama2_ENGINE_lmi-dist_" failed.
|
|
g5-12xl / benchmark_run (llama3[ENGINE=lmi-dist])
The job was canceled because "llama2_ENGINE_lmi-dist_" failed.
|
|
g5-12xl / benchmark_run (llama3[ENGINE=lmi-dist])
The operation was canceled.
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
llama2[ENGINE=lmi-dist]
|
3.71 MB |
|
|
mistral[ENGINE=lmi-dist]
|
3.73 MB |
|
|
mistral[ENGINE=vllm]
|
11.2 MB |
|
|
mixtral-8x7b[ENGINE=lmi-dist]
|
3.73 MB |
|
|
mixtral-8x7b[ENGINE=vllm]
|
14.9 MB |
|
|
template-g5.12xlarge
|
772 Bytes |
|
|
template-g5.2xlarge
|
830 Bytes |
|
|
template-g5.48xlarge
|
724 Bytes |
|
|
test-TestGPUHandlerPerformance-logs
|
1.16 MB |
|