A image generation model from scratch (Due to inavailability of computer units, the model may not get trained efficiently, but research suggest that around 1000 epochs could generate better result)
- This great video by Outlier gives a great indepth explaination of the math behind Diffusion Model as it went through different approaches and paper implementations.
- Residual connections
- Different activation functions like SiLU, GWLU, ...
- BatchNormalization
- GroupNormalization
- Attention Layers