Rain-Bus/Obsidian
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

vault backup: 2024-04-30 18:23:13

Browse Source
This commit is contained in:
Rain&Bus
2024-04-30 18:23:13 +08:00
parent d533882f1f
commit a687c67dc3
1 changed files with 4 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
Record/DL/Loss.md
View File

@@ -20,4 +20,7 @@ $$
KL散度有以下性质： KL散度有以下性质：
1. 正定性：$D_{KL}(p||q) \ge 0$ 1. 正定性：$D_{KL}(p||q) \ge 0$
2. 非对称性：$D_{KL}(p||q) \ne D_{KL}(q||p)$ 2. 非对称性：$D_{KL}(p||q) \ne D_{KL}(q||p)$
3. ## 一维高斯分布的KL散度
$$
KL(p,q) = \log \frac{\sigma_2}{\sigma_1} + \frac{\sigma_1^2 + (\mu_1 - \mu_2)^2}{2\sigma_2^2} - \frac{1}{2}
$$