Skip to content

[Misc] Allow initializing KV cache transfer agent when using third-party library for disaggregated prefill#11480

Open
KuntaiDu wants to merge 3 commits intovllm-project:mainfrom KuntaiDu:kuntai-adjust-need-parallel-group
+9-5

Commits

Commits on Dec 25, 2024