hello master，BLOOM 模型 目前支持单机多卡训练么，如果支持是

[116705792]

Describe the Question

Please provide a clear and concise description of what the question is.

Describe your attempts

• I walked through the tutorials
• I checked the documentation
• I checked to make sure that this is not a duplicate question

[116705792]

如果支持的话，也是这种形式么？
CUDA_VISIBLE_DEVICES=0,1 torchrun --nproc_per_node 2 training_chatglm_demo.py --do_train --do_predict --num_epochs 20

[shibing624]

是

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.(由于长期不活动，机器人自动关闭此问题，如果需要欢迎提问)