diff --git a/Record/DL/Loss.md b/Record/DL/Loss.md index 2b4412d..9ea15b8 100644 --- a/Record/DL/Loss.md +++ b/Record/DL/Loss.md @@ -20,4 +20,7 @@ $$ KL散度有以下性质: 1. 正定性:$D_{KL}(p||q) \ge 0$ 2. 非对称性:$D_{KL}(p||q) \ne D_{KL}(q||p)$ -3. \ No newline at end of file +## 一维高斯分布的KL散度 +$$ +KL(p,q) = \log \frac{\sigma_2}{\sigma_1} + \frac{\sigma_1^2 + (\mu_1 - \mu_2)^2}{2\sigma_2^2} - \frac{1}{2} +$$