Dulranga's Notes
Semester 3MathematicsApplied Statistics

Memorylessness of Distributions

Memorylessness is a property some statistical distributions have. If the future probability of an event only depend on its remaining time, not the time already passed, it has the memorylessness property.

Mathematical Definition

A continuous random variable XX (representing time or lifetime) is memoryless if, for any non-negative real numbers ss and tt:

P(X>s+t∣X>s)=P(X>t)P(X > s + t \mid X > s) = P(X > t)

What This Means:

  • X>sX > s: Given that the event hasn't happened in the first ss units of time.
  • X>s+tX > s + t: The probability that the event takes more than s+ts + t total units of time.
  • P(X>t)P(X > t): Is exactly the same as starting fresh from time 00 and waiting for tt units of time.

Examples

  1. Memoryless Example: Radioactive Decay or Electronic Components Imagine a lightbulb whose failure model is memoryless. The probability that the bulb lasts for 100 hours more, given it has already lasted for 1,000 hours, is identical to the probability that a brand-new bulb lasts for 100 hours. It does not "wear out" or age over time.

  2. NOT Memoryless Example: Human Lifespan or Mechanical Wear A 90-year-old human reaching age 100 has a vastly different probability than a newborn baby reaching age 10. Humans age, accumulate damage, and become more likely to die as time passes. Thus, human lifespan is not memoryless.

Common distributions with Memorylessness

Only Two standard distributions have this property.

TypeDistributionCommon Applications
ContinuousExponential DistributionModeling waiting times between Poisson events (e.g., call center calls, radioactive decay, component failures).
DiscreteGeometric DistributionModeling the number of Bernoulli trials needed until the first success (e.g., flipping a coin until getting heads).

Visualization

When we have new knowledge "given X lasted ss time units", the PDF is no longer same. Mathematically, the new conditional formula for x≥sx \ge s is:

f(x∣X>s)=f(x)P(X>s)f(x \mid X > s) = \frac{f(x)}{P(X > s)}

memorylessness.png https://www.desmos.com/calculator/xaxksndvgx

Note

the g(x)g(x) is just f(x)f(x) shifted to the right. This is only possible on PDFs that have memorylessness property. Note the g(x)g(x) is completely zero to the left. This is due to that is already observed and has a probability of 0 happening. This is due to we have the knowledge about XX lasted ss time units. For example a Uniform Distribution would not give this result. It scales g(x)g(x) up so f(x+l)f(x+l) cannot ever get g(x)g(x)

On this page