Question about lognorm

[jiashenggu]

Hi, great work! The paper mentions lognorm, but I couldn't find the implementation. Could you let me know if it's used in the code? If so, please tell me where I can find it. Thank you very much!

[zhuole1025]

Thanks for your interest! The lognorm schedule is used in our ImageNet models. You can find the implementation here:

Lumina-T2X/Next-DiT-ImageNet/transport/transport.py

Line 111 in 04bb30b

elif self.snr_type == SNRType.LOGNORM:

[jiashenggu]

Thanks for your interest! The lognorm schedule is used in our ImageNet models. You can find the implementation here:

Lumina-T2X/Next-DiT-ImageNet/transport/transport.py

Line 111 in 04bb30b

elif self.snr_type == SNRType.LOGNORM:

Thank you for your response! I'm curious why you only use it in ImageNet.

[zhuole1025]

That's because we tested the lognorm schedule only at the very beginning of our T2I project and found no significant improvements. However, it is worth paying more attention to the schedule for training large-scale flow and diffusion models.