Skip to content

Commit 705d73d

Browse files
authored
Merge pull request #319 from JoramSoch/master
added 4 defintions and 5 proofs
2 parents c26d40c + b62e15e commit 705d73d

10 files changed

Lines changed: 650 additions & 0 deletions

File tree

‎D/mean-circ.md‎

Lines changed: 43 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,43 @@
1+
---
2+
layout: definition
3+
mathjax: true
4+
5+
author: "Joram Soch"
6+
affiliation: "OvGU Magdeburg"
7+
e_mail: "joram.soch@ovgu.de"
8+
date: 2026-04-20 16:01:24
9+
10+
title: "Circular expected value"
11+
chapter: "General Theorems"
12+
section: "Probability theory"
13+
topic: "Expected value"
14+
definition: "Circular expected value"
15+
16+
sources:
17+
- authors: "Mardia KV, Jupp PE"
18+
year: 2000
19+
title: "Moments and Measures of Location and Dispersion"
20+
in: "Directional Statistics"
21+
pages: "ch. 3.4, pp. 28-31"
22+
url: "https://onlinelibrary.wiley.com/doi/book/10.1002/9780470316979"
23+
doi: "10.1002/9780470316979"
24+
25+
def_id: "D230"
26+
shortcut: "mean-circ"
27+
username: "JoramSoch"
28+
---
29+
30+
31+
**Definition:** The expected value (or, mean) of a [circular](/D/rvar-circ) [random variable](/D/rvar) $X$ with domain $\mathcal{X} = [0, 2 \pi)$ is defined as the value of $\mu$ satisfying
32+
33+
$$ \label{eq:mean-circ-eq}
34+
\mathrm{E}\left( e^{iX} \right) = r \cdot e^{i\mu}
35+
$$
36+
37+
or, equivalently,
38+
39+
$$ \label{eq:mean-circ}
40+
\mu = \mathrm{E}(X) = \mathrm{atan2}\left( \mathrm{E}(\sin X), \mathrm{E}(\sin X) \right)
41+
$$
42+
43+
where $\sin$ and $\cos$ are the sine and cosine function, respectively, and $\mathrm{atan2}$ is the two-argument arctangent function.

‎D/rvar-circ.md‎

Lines changed: 36 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,36 @@
1+
---
2+
layout: definition
3+
mathjax: true
4+
5+
author: "Joram Soch"
6+
affiliation: "OvGU Magdeburg"
7+
e_mail: "joram.soch@ovgu.de"
8+
date: 2026-04-20 15:18:30
9+
10+
title: "Circular random variable"
11+
chapter: "General Theorems"
12+
section: "Probability theory"
13+
topic: "Random variables"
14+
definition: "Circular random variable"
15+
16+
sources:
17+
- authors: "Wikipedia"
18+
year: 2026
19+
title: "Circular distribution"
20+
in: "Wikipedia, the free encyclopedia"
21+
pages: "retrieved on 2026-04-20"
22+
url: "https://en.wikipedia.org/wiki/Circular_distribution#Examples"
23+
24+
def_id: "D229"
25+
shortcut: "rvar-circ"
26+
username: "JoramSoch"
27+
---
28+
29+
30+
**Definition:** Let $X$ be a [random variable](/D/rvar) with possible outcomes $\mathcal{X}$. Then, $X$ is called a circular random variable, if $\mathcal{X} = [0, 2 \pi)$ and if the [probability density function](/D/pdf) of $X$ satisfies
31+
32+
$$ \label{eq:pdf-circ}
33+
f_X(x + 2 \pi k) = f_X(x)
34+
\quad \text{for all} \quad
35+
k \in \mathbb{Z} \; .
36+
$$

‎D/vm-data.md‎

Lines changed: 34 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,34 @@
1+
---
2+
layout: definition
3+
mathjax: true
4+
5+
author: "Joram Soch"
6+
affiliation: "OvGU Magdeburg"
7+
e_mail: "joram.soch@ovgu.de"
8+
date: 2026-04-23 15:45:22
9+
10+
title: "Univariate von Mises"
11+
chapter: "Statistical Models"
12+
section: "Periodic data"
13+
topic: "Univariate von Mises"
14+
definition: "Definition"
15+
16+
sources:
17+
- authors: "Bishop CM"
18+
year: 2006
19+
title: "Periodic variables"
20+
in: "Pattern Recognition for Machine Learning"
21+
pages: "sect. 2.3.8, p. 108"
22+
url: "http://users.isr.ist.utl.pt/~wurmd/Livros/school/Bishop%20-%20Pattern%20Recognition%20And%20Machine%20Learning%20-%20Springer%20%202006.pdf"
23+
24+
def_id: "D232"
25+
shortcut: "vm-data"
26+
username: "JoramSoch"
27+
---
28+
29+
30+
**Definition:** A univariate von Mises data set is given by a set of real numbers $y = \left\lbrace y_1, \ldots, y_n \right\rbrace$ with $y_i \in [0, 2 \pi), \; i = 1,\ldots,n$, [independent and identically distributed](/D/iid) according to a [von Mises distribution](/D/vm) with unknown circular mean $\mu \in [0, 2 \pi)$ and unknown reciprocal dispersion $\kappa > 0$:
31+
32+
$$ \label{eq:vm}
33+
y_i \sim \mathrm{vM}(\mu, \kappa), \quad i = 1, \ldots, n
34+
$$

‎D/vm.md‎

Lines changed: 46 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,46 @@
1+
---
2+
layout: definition
3+
mathjax: true
4+
5+
author: "Joram Soch"
6+
affiliation: "OvGU Magdeburg"
7+
e_mail: "joram.soch@ovgu.de"
8+
date: 2026-04-21 15:01:45
9+
10+
title: "von Mises distribution"
11+
chapter: "Probability Distributions"
12+
section: "Univariate continuous distributions"
13+
topic: "von Mises distribution"
14+
definition: "Definition"
15+
16+
sources:
17+
- authors: "Bishop CM"
18+
year: 2006
19+
title: "Probability Distributions"
20+
in: "Pattern Recognition for Machine Learning"
21+
pages: "Appendix B, p. 693, eq. B.77"
22+
url: "http://users.isr.ist.utl.pt/~wurmd/Livros/school/Bishop%20-%20Pattern%20Recognition%20And%20Machine%20Learning%20-%20Springer%20%202006.pdf"
23+
24+
def_id: "D231"
25+
shortcut: "vm"
26+
username: "JoramSoch"
27+
---
28+
29+
30+
**Definition:** Let $X$ be a [circular](/D/rvar-circ) [random variable](/D/rvar). Then, $X$ is said to follow a von Mises distribution with circular mean $\mu$ and reciprocal dispersion $\kappa$
31+
32+
$$ \label{eq:vm}
33+
X \sim \mathrm{vM}(\mu, \kappa) \; ,
34+
$$
35+
36+
if and only if its [probability density function](/D/pdf) is given by
37+
38+
$$ \label{eq:vm-pdf}
39+
\mathrm{vM}(x; \mu, \kappa) = \frac{1}{2 \pi I_0(\kappa)} \cdot \exp \left[ \kappa \cos(x-\mu) \right]
40+
$$
41+
42+
where $\mu \in \mathbb{R}$, $\kappa > 0$ and $I_0(\kappa)$ is the zeroth-order modified Bessel function of the first kind:
43+
44+
$$ \label{eq:vm-bessel}
45+
I_0(\kappa) = \frac{1}{2\pi} \int_0^{2\pi} \exp \left[ \kappa \cos(x) \right] \, \mathrm{d}x \; .
46+
$$

‎I/LoC.md‎

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -27,6 +27,7 @@ Templates: **[Proof](/P/-temp-)** – *[Definition](/D/-temp-)*
2727
- *[Constant](/D/const)*
2828
- *[Discrete vs. continuous](/D/rvar-disc)*
2929
- *[Univariate vs. multivariate](/D/rvar-uni)*
30+
- *[Circular random variable](/D/rvar-circ)*
3031
- *[independent and identically distributed](/D/iid)*
3132
### Probability
3233
- *[Probability](/D/prob)*
@@ -128,6 +129,8 @@ Templates: **[Proof](/P/-temp-)** – *[Definition](/D/-temp-)*
128129
- **[Chebyshev's inequality](/P/cheb-ineq)**
129130
- **[Weak law of large numbers](/P/mean-wlln)**
130131
- **[Expected value minimizes squared error](/P/mean-mse)**
132+
- *[Circular expected value](/D/mean-circ)*
133+
- **[Circular sample mean](/D/meancirc-samp)**
131134
- *[Expected value of a random vector](/D/mean-rvec)*
132135
- **[Expectation of a quadratic form](/P/mean-qf)**
133136
- **[Expectation of a bilinear form](/P/mean-blf)**
@@ -520,6 +523,11 @@ Templates: **[Proof](/P/-temp-)** – *[Definition](/D/-temp-)*
520523
- **[Variance](/P/exg-var)**
521524
- **[Skewness](/P/exg-skew)**
522525
- **[Method of moments](/P/exg-mome)**
526+
### von Mises distribution
527+
- *[Definition](/D/vm)*
528+
- **[Relationship to bivariate normal distribution](/P/vm-bvn)**
529+
- **[Probability density function](/P/vm-pdf)**
530+
- **[Full width at half maximum](/P/vm-fwhm)**
523531
## Multivariate continuous distributions
524532
### Multivariate normal distribution
525533
- *[Definition](/D/mvn)*
@@ -806,6 +814,10 @@ Templates: **[Proof](/P/-temp-)** – *[Definition](/D/-temp-)*
806814
### Beta-binomial data
807815
- *[Definition](/D/betabin-data)*
808816
- **[Method of moments](/P/betabin-mome)**
817+
## Periodic data
818+
### Univariate von Mises
819+
- *[Definition](/D/vm-data)*
820+
- **[Maximum likelihood estimation](/P/vm-mle)**
809821
## Categorical data
810822
### Logistic regression
811823
- *[Definition](/D/logreg)*

‎P/meancirc-samp.md‎

Lines changed: 77 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,77 @@
1+
---
2+
layout: proof
3+
mathjax: true
4+
5+
author: "Joram Soch"
6+
affiliation: "OvGU Magdeburg"
7+
e_mail: "joram.soch@ovgu.de"
8+
date: 2026-04-20 16:38:24
9+
10+
title: "Circular sample mean"
11+
chapter: "General Theorems"
12+
section: "Probability theory"
13+
topic: "Expected value"
14+
theorem: "Circular sample mean"
15+
16+
sources:
17+
- authors: "Bishop CM"
18+
year: 2006
19+
title: "Periodic variables"
20+
in: "Pattern Recognition for Machine Learning"
21+
pages: "pp. 105-106, eq. 2.169"
22+
url: "http://users.isr.ist.utl.pt/~wurmd/Livros/school/Bishop%20-%20Pattern%20Recognition%20And%20Machine%20Learning%20-%20Springer%20%202006.pdf"
23+
24+
proof_id: "P533"
25+
shortcut: "meancirc-samp"
26+
username: "JoramSoch"
27+
---
28+
29+
30+
**Theorem:** Let $x = \left\lbrace x_1, \ldots, x_n \right\rbrace$ be a [sample](/D/samp) from a [circular](/D/rvar-circ) [random variable](/D/rvar) $X$. Then, the [sample mean](/D/mean-samp) of $x$ is given by
31+
32+
$$ \label{eq:meancirc-samp}
33+
\bar{x} = \arctan \left( \frac{\sum_{i=1}^n \sin x_i}{\sum_{i=1}^n \cos x_i} \right)
34+
$$
35+
36+
where $\sin$ and $\cos$ are the sine and cosine function, respectively, and $\arctan$ is the arctangent function.
37+
38+
39+
**Proof:** For observations of a [circular random variable](/D/rvar-circ) satisfying
40+
41+
$$ \label{eq:rvar-circ-samp-x}
42+
0 \leq x_i < 2 \pi, \; i = 1,\ldots,n
43+
$$
44+
45+
calculating the [sample mean as the arithmetic mean](/D/mean-samp) is not appropriate as this does not preserve the periodic nature of the random variable.
46+
47+
Instead and [in accordance with the definition of the circular expected value](/D/mean-circ), observation values are transformed to points on the unit circle ($r = 1$):
48+
49+
$$ \label{eq:rvar-circ-samp-y}
50+
y_i = \left[ \begin{matrix} \cos x_i \\ \sin x_i \end{matrix} \right], \; i = 1,\ldots,n \; .
51+
$$
52+
53+
Then, we calculate the [sample mean](/D/mean-samp) of transformed data points
54+
55+
$$ \label{eq:y-mean}
56+
\bar{y}
57+
= \frac{1}{n} \sum_{i=1}^n y_i
58+
= \left[ \begin{matrix} \frac{1}{n} \sum_{i=1}^n \cos x_i \\ \frac{1}{n} \sum_{i=1}^n \sin x_i \end{matrix} \right]
59+
$$
60+
61+
and equating this sample mean with its polar-coordinate representation
62+
63+
$$ \label{eq:y-mean-pc}
64+
\left[ \begin{matrix} \frac{1}{n} \sum_{i=1}^n \cos x_i \\ \frac{1}{n} \sum_{i=1}^n \sin x_i \end{matrix} \right]
65+
= \left[ \begin{matrix} \bar{r} \cos \bar{x} \\ \bar{r} \sin \bar{x} \end{matrix} \right] \; ,
66+
$$
67+
68+
we obtain the solution for $\bar{x}$ by solving the equation system:
69+
70+
$$ \label{eq:x-mean}
71+
\begin{split}
72+
\frac{\bar{r} \sin \bar{x}}{\bar{r} \cos \bar{x}} &= \frac{\frac{1}{n} \sum_{i=1}^n \sin x_i}{\frac{1}{n} \sum_{i=1}^n \cos x_i} \\
73+
\frac{\sin \bar{x}}{\cos \bar{x}} &= \frac{\sum_{i=1}^n \sin x_i}{\sum_{i=1}^n \cos x_i} \\
74+
\tan \bar{x} &= \frac{\sum_{i=1}^n \sin x_i}{\sum_{i=1}^n \cos x_i} \\
75+
\bar{x} &= \arctan \left( \frac{\sum_{i=1}^n \sin x_i}{\sum_{i=1}^n \cos x_i} \right) \; .
76+
\end{split}
77+
$$

0 commit comments

Comments
 (0)