Dulranga's Notes
Semester 3MathematicsApplied StatisticsDistributions

Hyper Geometric Distribution

This distribution is defined to work with experiments where the one after the previous one are dependent on previous ones. Unlike Geometric Distribution, Bernoulli Distribution where Events must be independent of one another, this does not need that property.

In other words, this works when the trials are done without replacement.

Core Idea

We take nn samples from NN population without replacement. Then we observe kk successes in all the samples we took. On the NN population, there are KK successes initially.

We write this as:

X∼Hypergeometric(N,K,n)X \sim \text{Hypergeometric}(N, K, n)

Where:

  • NN = Total population size
  • KK = Total number of success states in the population
  • N−KN - K = Total number of failure states in the population
  • nn = Number of items drawn (sample size)
  • XX = Number of observed successes in the sample

PMF

P(X=k)=(Kk)(N−Kn−k)(Nn)P(X = k) = \frac{\binom{K}{k} \binom{N - K}{n - k}}{\binom{N}{n}}
  • (Kk)\binom{K}{k}: How many ways to choose kk successes out of the KK available.
  • (N−Kn−k)\binom{N - K}{n - k}: How many ways to choose the remaining n−kn - k failures out of the N−KN - K available.
  • (Nn)\binom{N}{n}: Total ways to choose any nn items out of the total NN items.

Properties

Mean (Expected Value)

E[X]=n⋅KNE[X] = n \cdot \frac{K}{N}

Variance

Var(X)=n⋅KN⋅(1−KN)⋅(N−nN−1)\text{Var}(X) = n \cdot \frac{K}{N} \cdot \left(1 - \frac{K}{N}\right) \cdot \left(\frac{N - n}{N - 1}\right)

Convergence Rule

Binomial Distribution is an approximation to Hypergeometric when the population size NN is huge relative to sample size nn

If N>>>>nN >>>> n ,

Hypergeometric(N,K,n)≈Binomial(n,p=KN)\text{Hypergeometric}(N, K, n) \approx \text{Binomial}\left(n, p = \frac{K}{N}\right) p=Number of SuccessesTotal Population=KNp = \frac{\text{Number of Successes}}{\text{Total Population}} = \frac{K}{N}

Mean & Variance relation to Binomial

if we treat, p=KNp=\frac{K}{N}

MetricBinomial Distribution(With Replacement)Hypergeometric Distribution(Without Replacement)Relationship
Mean E[X]\mathbb{E}[X]n⋅pn \cdot pn⋅pn \cdot pIdentical
Variance Var(X)\text{Var}(X)n⋅p(1−p)n \cdot p (1 - p)n⋅p(1−p)⋅(N−nN−1)n \cdot p (1 - p) \cdot \mathbf{\left(\frac{N - n}{N - 1}\right)}Hypergeometric Variance is Smaller
Var(XHypergeometric)=np(1−p)⏟Binomial Variance×(N−nN−1)⏟Finite Population Correction (FPC)\text{Var}(X_{\text{Hypergeometric}}) = \underbrace{n p (1 - p)}_{\text{Binomial Variance}} \times \underbrace{\left( \frac{N - n}{N - 1} \right)}_{\text{Finite Population Correction (FPC)}}

Why the name "Hypergeometric"

This comes from hypergeometric series.

in a Geometric sequence, the next item is a "Constant" multiplication (rr) of previous one.

a,  ar,  ar2,  ar3,  …a, \; ar, \; ar^2, \; ar^3, \; \dots

In a "Hypergeometric" (Beyond geometric) sequence, the next one is multiplied by a "Rational Function"

Termk+1Termk=Polynomial(k)Polynomial(k)\frac{\text{Term}_{k+1}}{\text{Term}_k} = \frac{\text{Polynomial}(k)}{\text{Polynomial}(k)}

When you compute the ratio between consecutive probabilities P(X=k+1)P(X = k+1) and P(X=k)P(X = k) in this distribution:

P(X=k+1)P(X=k)=(K−k)(n−k)(k+1)(N−K−n+k+1)\frac{P(X = k+1)}{P(X = k)} = \frac{(K - k)(n - k)}{(k + 1)(N - K - n + k + 1)}

On this page