To shield the annoying progress bar, we found a way

[snow-wind-001]

To shield the annoying progress bar, we found a way:
/llama-chat/llama/model.py --261
for layer in tqdm(self.layers, desc="flayers",leave=Ture):
replace as :for layer in self.layers:
/llama-chat/llama/generation.py --60
for cur_pos in trange(start_pos, total_len, desc="forward"):
replace as :for cur_pos in range(start_pos, total_len):

[meeeo]

Thanks, but still seems... can we have a chat just like llama.cpp dose?