Attempt for cleverer auto batch_prefill values (some simplifications).#2808
Merged
Narsil merged 7 commits intomainfrom update_max_prefill_auto_with_vram_reqsDec 9, 2024
+337-131
Commits
Commits on Dec 8, 2024
Commits on Dec 9, 2024
- committed
- committed
- committed
