about the training loss curve

[Ideal-Bushgorman]

Hi, thanks for your great work!
Would it be possible to share the training loss curve or logs to better understand how the model converges? It would be very helpful for reproducing the results.

[C0notSilly]

Also wondering about the loss curve. In my case, when working on some AIGC tasks, the loss stays relatively high at the early stage of the training. However, with the loss continuing to decrease, the trained model collapses.

@Devil-Ideal Did you encounter a similar issue in fine-tuning Janus-Pro 1.5B?

[hrz2000]

Sorry for the late reply. PlanGen's training is relatively stable and simple, its text part next-token prediction loss decreases faster and more obviously, for the image part, the fluctuation is relatively large, just like the diffusion loss, this is the reference of the training curve: