1. Density
The density function of the normal distribution with parameters $\mu$ and $\sigma^2$ is given by:
$$f(x) = \frac{1}{\sqrt{2 \pi \sigma^2}} \, e^{-\frac{(x-\mu)^2} {2 \sigma^2}}, \qquad \text{for all real } x$$
2. Cumulative distribution function
It is symbolized by $F$ and is defined as:
$$F(t) = P(X \leq t) = \int\limits_{-\infty}^t f(x) dx, \qquad \text{for all real } t$$
3. Expected value and variance
If $X$ has a normal distribution with parameters $\mu$ and $\sigma^2$, then:
$$E(X)=\mu, \qquad V(X)=\sigma^2$$
4. Standard normal distribution
The normal distribution with an expected value of 0 and a variance of 1 is called the standard normal. The associated random variable will be symbolized by $Z$.
5. $Z$-Formula
Let $X$ be a random variable that has a normal distribution with parameters $\mu$ and $\sigma^2$. Then, the following variable has a standard normal distribution:
$$Z=\frac{X-\mu}{\sigma}$$
6. Standardization to $Z$
Let $X$ be a random variable that has a normal distribution with parameters $\mu$ and $\sigma^2$. Then, for any real number $t$, the following holds:
$$P(X \leq t) = P\left(Z \leq \frac{t-\mu}{\sigma}\right)$$
7. Quantile
Suppose that $X$ has a normal distribution with mean $\mu$ and standard deviation $\sigma$. For $0 < \alpha < 1$, the symbol $x_\alpha$ is a quantile value of the normal distribution if it satisfies the condition:
$$P(X \geq x_\alpha) = \alpha$$
1. Density
Let $n$ be a natural number. A random variable $X$ has a $t$-distribution with $n$ degrees of freedom when it has the probability density:
$$f(x)= \frac{\Gamma \left(\frac{n+ 1}{2}\right)}{\sqrt{\pi n}\; \Gamma \left(\frac{n}{2}\right)\, \left(1 + \frac{x^2}{n}\right)^{\frac{n +1}{2}}}, \quad x\in \mathbb{R}$$
The density of the $t$-distribution with $n$ degrees of freedom is an even function, whose graphical representation does not differ much from the normal density for large $n$. For $n=1$, the Cauchy density is obtained as a special case.
2. Cumulative distribution function
It is symbolized by $F$ and is defined as:
$$F(t) = P(X \leq t) = \int\limits_{-\infty}^t f(x) dx, \qquad \text{for all real } t$$
3. Expected value and variance
If $X$ has a Student's $t$-distribution with $n$ degrees of freedom, then:
$$E(X)=0, \qquad V(X)=\frac{n}{n-2}, \quad n\geq 3$$
1. Density
Let $n$ be a natural number. A random variable $X$ has a $\chi^2$ (chi-squared) distribution with $n$ degrees of freedom when it has the probability density:
$$f(x)=\begin{cases} 0 & \text{for } x\leq 0 \\ \frac{1}{2^{n/2}\Gamma\left(\frac{n}{2}\right)} x^{\frac{n}{2}-1} e^{-\frac{x}{2}} & \text{for } x>0 \end{cases}$$
For the case $n=2$, the special case is obtained where the $\chi^2$ distribution is the exponential distribution with parameter $\beta=\frac{1}{2}$. Furthermore, comparing them, we obtain that:
$$\chi^2(n) = \gamma\left(\frac{n}{2}, \frac{1}{2}\right)$$
2. Cumulative distribution function
It is symbolized by $F$ and is defined as:
$$F(t) = P(X \leq t) = \int\limits_{-\infty}^t f(x) dx, \qquad \text{for all real } t$$
3. Expected value and variance
If $X$ has a chi-squared distribution with $n$ degrees of freedom, then:
$$E(X)=n, \qquad V(X)=2n$$
1. Density
Let $n$ and $m$ be natural numbers. A random variable $X$ has a Fisher's $F$-distribution with $n$ and $m$ degrees of freedom when it has the probability density:
$$f(x)= \begin{cases} 0 & \text{for } x\leq 0 \\ \frac{\Gamma \left(\frac{n+ m}{2}\right)\,n^{n/2}\, m^{m/2}}{\Gamma\left(\frac{n}{2}\right)\, \Gamma\left(\frac{m}{2}\right)}\, \frac{x^{\frac{m}{2}-1}}{(n+mx)^{(n+m)/2}} & \text{for } x>0 \end{cases}$$
Fisher's $F$-distribution, like the chi-squared, has an asymmetric density function, defined only for non-negative values.
2. Cumulative distribution function
It is symbolized by $F$ and is defined as:
$$F(t) = P(X \leq t) = \int\limits_{-\infty}^t f(x) dx, \qquad \text{for all real } t$$
3. Expected value and variance
If $X$ has a Fisher's $F$-distribution, then:
$$E(X)=\frac{n}{n-2}, \quad n\geq 3$$
$$V(X)=\frac{2n^2(m+n-2)}{m(n-2)^2(n-4)}, \quad n\geq 5$$
1. Density
A random variable $X$ has an exponential distribution if for all $\beta>0$ its density is:
$$f(x;\beta)= \begin{cases} 0 & \text{for } x\leq 0 \\ \beta e^{-\beta x} & \text{for } x>0 \end{cases}$$
2. Cumulative distribution function
It is symbolized by $F$ and is defined as:
$$F(t) = P(X \leq t) = \int\limits_{-\infty}^t f(x) dx, \qquad \text{for all real } t$$
In this case, it has the form:
$$F(t)=\begin{cases} 0 & \text{for } t\leq 0 \\ 1- e^{-\beta t} & \text{for } t>0 \end{cases}$$
3. Expected value and variance
$$E(X)=\frac{1}{\beta}, \qquad V(X)=\frac{1}{\beta^2}$$
1. Density
The density function of the logistic distribution with parameters $\mu$ and $\sigma^2$ is given by:
$$f(x) = \frac{e^{-(x-\mu)^2/\sigma^2}}{\sigma^2 (1 + e^{-(x-\mu)^2/\sigma^2})^2}$$
2. Cumulative distribution function
It is symbolized by $F$ and is defined as:
$$F(t) = P(X \leq t) = \int\limits_{-\infty}^t f(x) dx, \qquad \text{for all real } t$$
In this case, it has the form:
$$F(t) = \frac{1}{1 + e^{-(t-\mu)^2/\sigma^2}}$$
3. Expected value and variance
If $X$ has a logistic distribution, then:
$$E(X)=\mu, \qquad V(X)=\frac{\pi^2\,\sigma^2}{3}$$
The log-normal distribution in its simplest form can be defined as the distribution of a random variable whose logarithm obeys the normal probability density. Let $Y$ be a random variable that is normally distributed with parameters $\mu$ and $\sigma^2$. If $Y=\ln X$ or $X=e^Y$, then $X$ is said to have a log-normal distribution.
1. Density
A random variable $X$ has a log-normal distribution with parameters $\mu$ and $\sigma^2>0$ if its probability density is given by:
$$f(x)= \begin{cases} \frac{1}{x\sqrt{\sigma^2\,\pi}}\exp\left\{-\frac{1}{2\sigma^2}(\ln x - \mu)^2 \right\} & \text{if } x>0 \\ 0 & \text{otherwise} \end{cases}$$
2. Cumulative distribution function
It is symbolized by $F$ and is defined as:
$$F(t) = P(X \leq t) = \int\limits_{-\infty}^t f(x) dx, \qquad \text{for all real } t$$
3. Expected value and variance
If $X$ has a log-normal distribution, then:
$$E(X)=\exp\left\{\mu + \frac{\sigma^2}{2}\right\}, \qquad V(X)=\left[\exp\{\sigma^2\}-1\right]\; \exp\left\{2\mu +\sigma^2\right\}$$
1. Density
A random variable $X$ has a gamma distribution with parameters $\alpha, \beta$ if its density is:
$$f(x;\alpha,\beta) = \begin{cases} 0 & \text{for } x\leq 0, \\ \frac{\beta^\alpha}{\Gamma(\alpha)}\, x^{\alpha-1}\, e^{-\beta x} & \text{for } x>0, \end{cases}$$
2. Cumulative distribution function
It is symbolized by $F$ and is defined as:
$$F(t) = P(X \leq t) = \int\limits_{-\infty}^t f(x) dx, \qquad \text{for all real } t$$
3. Expected value and variance
$$E(X)=\frac{\alpha}{\beta}, \qquad V(X)=\frac{\alpha}{\beta^2}$$
1. Density
A random variable $X$ has a Weibull distribution with parameters $\alpha, \beta>0$ if its probability density is given by:
$$f(x)= \begin{cases} \beta\alpha \left(x \beta\right)^{\alpha-1} \exp\left\{- [x\beta]^{\alpha}\right\} & \text{if } x>0 \\ 0 & \text{otherwise} \end{cases}$$
The parameters $\alpha$ and $\beta$, which completely describe the Weibull density, are of great importance. Here $\alpha$ is a shape parameter and $\beta$ is a scale parameter.
2. Cumulative distribution function
It is symbolized by $F$ and is defined as:
$$F(t) = P(X \leq t) = \int\limits_{-\infty}^t f(x) dx, \qquad \text{for all real } t$$
The corresponding distribution function is given by:
$$F(t)=\begin{cases} 0 & \text{if } t\leq 0 \\ 1- \exp\left\{- (\beta t)^{\alpha}\right\} & \text{if } t>0 \end{cases}$$
3. Expected value and variance
$$E(X)=\frac{1}{\beta}\, \Gamma\left(1+\frac{1}{\alpha}\right)$$
$$V(X)=\frac{1}{\beta^2}\, \left[\Gamma\left(1+\frac{2}{\alpha}\right) - \Gamma^2\left(1+\frac{1}{\alpha}\right)\right]$$
For $x, y >0$, the integral:
$$B(x,y) = \int_0^1 t^{x-1} (1-t)^{y-1} dt$$
exists as an absolutely convergent improper Riemann integral, and therefore, also as a Lebesgue integral. The function $B: (0,\infty)^2\to \mathbb{R}$ is called the Euler beta function.
1. Density
A random variable $X$ has a beta distribution if:
$$f(x)=\begin{cases} \frac{1}{B(\alpha, \beta)}\, x^{\alpha-1}\,(1-x)^{\beta-1} & \text{for } 0
2. Cumulative distribution function
It is symbolized by $F$ and is defined as:
$$F(t) = P(X \leq t) = \int\limits_{-\infty}^t f(x) dx, \qquad \text{for all real } t$$
3. Expected value and variance
If $X$ has a beta distribution, then:
$$E(X)=\frac{\alpha}{\alpha + \beta}$$
$$V(X)=\frac{\alpha \beta}{(\alpha +\beta)^2 \,(\alpha +\beta +1)}$$
4. Properties
Some special cases of the beta distribution are:
$$f(x)=\begin{cases} 2(1-x) & \text{if } 0\leq x\leq 1 \\ 0 & \text{otherwise} \end{cases} \qquad f(x)=\begin{cases} 2x & \text{if } 0\leq x\leq 1 \\ 0 & \text{otherwise} \end{cases}$$