Skip to content

Types of distributions ​

Random variable ​

A random variable is a function X:Ω→R such that for every t∈R

{ω∈Ω:X(ω)≤t}={X≤t}

is an event, meaning it is part of the σ-algebra A.

A random variable is discrete if its range is finite or countably infinite.

Expectation ​

The expectation of a discrete random variable is defined by

E(X)=∑j=1∞xj⋅P(X=xj), provided that ∑j=1∞|xj|⋅P(X=xj)<∞

where x1,x2,… are the possible values of X.

Variance and Standard Deviation ​

The variance of a random variable is defined by

Var(X)=E((X−E(X))2)=E(X2)−(E(X))2,

provided that E(X2) is finite (there exist random variables with finite expectation but not well-defined variance).

The square root of Var(X) is called the standard deviation.

Binomial distribution ​

A random variable has binomial distribution with parameters n≥1 and 0<p<1, if

P(X=k)=(nk)pk(1−p)n−kfor all k=0,1,…,n.

Then the expectation of X is np, and its variance is np(1−p).

Key Characteristics:

  • Fixed number of trials ((n)).
  • Two possible outcomes per trial (success or failure).
  • Probability of success ((p)) is constant across trials.
  • Trials are independent.

Random Variable: Number of successes in (n) trials.

Example: Number of heads in 10 coin flips.

Poisson distribution ​

A random variable has Poisson distribution with parameter λ>0, if

P(X=k)=λkk!e−λfor all k=0,1,2,…

Then E(X)=Var(X)=λ.

Key Characteristics:

  • Events occur in a fixed interval of time or space (e.g., hours, area).
  • Events are rare relative to the interval, with no fixed number of trials.
  • Average rate of occurrence (λ) is constant.
  • Events are independent of each other.

Random Variable: Number of events in the interval.

Example: Number of cars passing a point in an hour.

Example 1 ​

Problem

We organize a party, and we know in advance that the number of participants is eight with probability 1/4, nine with probability 1/3 and ten otherwise. Calculate the expected number and the variance of the number of participants.

Solution

Let X be the number of guests. The expectation is as follows by definition:

E(X)=8⋅14+9⋅13+10⋅512=9.17

The variance is as follows:

E(X2)−E(X)2=14·82+13·92+512·102−9.172=84.67−9.172=0.58

The standard deviation: 0.58=0.76

Example 2 ​

Problem

Suppose that the number of downloads of a webpage within an hour has Poisson distribution, and the probability that there are 0 downloads is 1/e2. Suppose furthermore that the number of downloads independent for disjoint time intervals.

a) What is the variance of the number of downloads within an hour?

b) Given that the number of downloads within an hour is at most 1, what is the probability that there are 0 downloads within this hour?

Solution

a) By the definition of the Poisson distribution, we have

P(X=0)=e−λ⇒λ=2

By the properties of the Poisson distribution, we have Var(X)=λ=2.

b) The question is the following conditional probability, which we can calculate by using the definition of this and the definition of the Poisson distribution:

P(X=0|X≤1)=P(X=0,X≤1)P(X≤1)=P(X=0)P(X=0)+P(X=1)=e−2e−2+e−2⋅2=13