detail of training?

[Cola-any]

Thanks for sharing your excellent work。
I am a little confused about the training details of MoCLE (LLaVA-1.5).
Does MoCLE directly inherit the one-stage pre-trained model state of LLaVA-1.5 and perform instruction fine-tuning as described in your paper? As the paper does not mention two-stage training.