Skip to content

[Optimization] Advance parser concurrently with model forward pass #980

[Optimization] Advance parser concurrently with model forward pass

[Optimization] Advance parser concurrently with model forward pass #980

basic-tests-linux-python-latest (llamacpp_phi3_mini_4k_instruct_cpu)  /  run-plain-basic-tests

succeeded Nov 5, 2024 in 8m 55s