From bc00f2a5d0be72b36a80b4eeaa1349d7825a1a71 Mon Sep 17 00:00:00 2001 From: Claude Date: Sat, 31 Oct 2026 13:54:30 +0000 Subject: [PATCH] Bump macros pin and write the cross-entropy definition with surprisalunderf Co-Authored-By: Claude Sonnet 5.5 Claude-Session: https://claude.ai/code/session_019xfc9mmEbJ5cfXnwuhpxdh --- _subfiles/_def-cross-entropy.qmd | 4 ++-- latex-macros | 2 +- 2 files changed, 3 insertions(+), 3 deletions(-) diff --git a/_subfiles/_def-cross-entropy.qmd b/_subfiles/_def-cross-entropy.qmd index 7de08b69..bb0eed48 100644 --- a/_subfiles/_def-cross-entropy.qmd +++ b/_subfiles/_def-cross-entropy.qmd @@ -9,9 +9,9 @@ The **cross-entropy** of $q$ relative to $p$ is the [expectation](#def-expectation), when $X$ has [distribution](random-variables.qmd#def-cdf) $p$, of the [surprisal](#def-surprisal) (or its [continuous](#def-surprisal-continuous) form) $\surprisal_q$ measured by $q$, -where $\surprisal_q\paren{x} \eqdef -\log q\paren{x}$: +where $\surprisalunderf{q}{x} \eqdef -\log q\paren{x}$: -$$\crossentropyf{p}{q} \eqdef \E{\surprisal_q\paren{X}}.$$ +$$\crossentropyf{p}{q} \eqdef \E{\surprisalunderf{q}{X}}.$$ We take $-\log 0 = \infty$, so when $\P(q(X) = 0) > 0$, diff --git a/latex-macros b/latex-macros index e41d0adb..9e19dbe3 160000 --- a/latex-macros +++ b/latex-macros @@ -1 +1 @@ -Subproject commit e41d0adbab22372b1967030efd0effa25f90f8de +Subproject commit 9e19dbe31ed4eae5c068550425dd5593bf61a45a