Fix a convergence issues in TP topology caused by incorrect grad_norm.#5411

Merged

conglongli merged 9 commits intomicrosoft:masterfrom inkcherry:tp_grad_fix

Apr 16, 2024

+77-42

Commits on Apr 12, 2024

Commits on Apr 16, 2024