From a687c67dc3ee8a45dc6350f8b49aa51e98dbf681 Mon Sep 17 00:00:00 2001 From: Rain&Bus Date: Tue, 30 Apr 2024 18:23:13 +0800 Subject: [PATCH] vault backup: 2024-04-30 18:23:13 --- Record/DL/Loss.md | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/Record/DL/Loss.md b/Record/DL/Loss.md index 2b4412d..9ea15b8 100644 --- a/Record/DL/Loss.md +++ b/Record/DL/Loss.md @@ -20,4 +20,7 @@ $$ KL散度有以下性质: 1. 正定性:$D_{KL}(p||q) \ge 0$ 2. 非对称性:$D_{KL}(p||q) \ne D_{KL}(q||p)$ -3. \ No newline at end of file +## 一维高斯分布的KL散度 +$$ +KL(p,q) = \log \frac{\sigma_2}{\sigma_1} + \frac{\sigma_1^2 + (\mu_1 - \mu_2)^2}{2\sigma_2^2} - \frac{1}{2} +$$