Skip to content
CI - shark-ai

For bs=1 set kv_cache_type to paged. #1061

Sign in to view logs

For bs=1 set kv_cache_type to paged.

For bs=1 set kv_cache_type to paged. #1061

Run time

Learn about OS pricing on GitHub Actions
Job Run time
Integration Tests - Shortfin LLM Server (3.11)
20m 36s
20m 36s