Diffusion Model 背後的數學原理 感謝姜成翰同學大力協助
感謝姜成翰同學大力協助
基本概念 Forward Process Add noise Add noise Reverse Process Denoise Denoise
基本概念 Reverse Process Forward Process Add noise Denoise Denoise Add noise
VAE vs.Diffusion Model VAE Encoder Decoder XN Diffusion Add noise Denoise XN
VAE vs. Diffusion Model VAE Diffusion Encoder Decoder Denoise Add noise X N X N
Denoising Diffusion Probabilistic Models Algorithm 1 Training Algorithm 2 Sampling 1:repeat 1:xr~W(0,I) 2:x0~q(x0) 3:Uniform({1,...,T]) 2:fort=T;...,1 do 4: e~W(0,I) 3:z N(0,I)ift 1,elsez=0 5:Take gradient descent step on 4: x-1=点(x-器(x,)+z Volle-Eo(vaixo+VI-aie,t)l2 5:end for 6:until converged 6:return xo 暗藏玄機！
Denoising Diffusion Probabilistic Models 暗藏玄機!
Training xo:clean image noise Algorithm 1 Training 1:repeat 2:xo ~g(xo)+..sample clean image 3:Uniform({1,...,T}) 4: E~(0,I)..sample a noise 5: Take gradient descent step on Volle co(/arxo v1-arg,t)2 a1,a2…T 6:until converged Noisy image smaller Target Noise Noise predictor
Training 𝑥0: clean image sample clean image sample a noise Noise predictor Target Noise Noisy image 𝛼ത1, 𝛼ത2,… 𝛼ത𝑇 𝜀: noise smaller