vault backup: 2024-04-30 18:23:13

This commit is contained in:
2024-04-30 18:23:13 +08:00
parent d533882f1f
commit a687c67dc3

View File

@@ -20,4 +20,7 @@ $$
KL散度有以下性质
1. 正定性:$D_{KL}(p||q) \ge 0$
2. 非对称性:$D_{KL}(p||q) \ne D_{KL}(q||p)$
3.
## 一维高斯分布的KL散度
$$
KL(p,q) = \log \frac{\sigma_2}{\sigma_1} + \frac{\sigma_1^2 + (\mu_1 - \mu_2)^2}{2\sigma_2^2} - \frac{1}{2}
$$