[Speculative decoding] Support num_of_seqs
in scheduler and extend CB Benchmark by SD parameters
#2518
Job | Run time |
---|---|
3s | |
3s |
num_of_seqs
in scheduler and extend CB Benchmark by SD parameters
#2518
Job | Run time |
---|---|
3s | |
3s |