Category: probability and statistics

In this chapter, we will address the two following questions: How do we test if two random variables are independent? How do we estimate the…

We can best explain what logistic regression does by an example problem: Example: Assume that we are As can be seen, logistic regression is a…

Regression is a method for studying the relation between $y$ and $X$, where $X$ is generally considered to be an $k$-dimensional vector, \begin{eqnarray} X=\left[ \begin{array}{c}…

The standard scenario of hypothesis testing is this: We have a pdf at hand representing the “normal” operation of a system, and we know all…

Expectation Maximization Assume we have some observed data $x=(x_1,\ldots,x_n)$. Assume that this data is generated by a probability distribution $p_{\theta}(x,z)$ where the model parameter $\theta$…

k-Means

Parametric Inference