[Speculative decoding] Support num_of_seqs
in scheduler and extend CB Benchmark by SD parameters
#2517
Job | Run time |
---|---|
9s | |
9s |
num_of_seqs
in scheduler and extend CB Benchmark by SD parameters
#2517
Job | Run time |
---|---|
9s | |
9s |