This is a concise discussion of the negative binomial distribution. Links to detailed discussion are given below.
A counting distribution is a random variable that only takes on the non-negative integers 0, 1, 2, … The negative binomial distribution is a counting distribution. In the present discussion, is a random variable that follows a negative binomial distribution. This means that the probability that takes on the value is given by one of the following probability functions.
These three functions are called probability functions. We discuss (1) first. In (1), the numbers and are fixed constants. They are called the parameters of the negative binomial distribution. The parameter can be any positive number . The parameter can be any number .
A Natural Interpretation
When the parameter is an integer, (1) has a natural interpretation. Let’s say is a positive integer. Suppose that a coin has the characteristics that when flipped, the probability of getting a head is . Let’s say we keep tossing this coin until we get heads. Then the probability function (1) describes this random phenomenon. The probability in (1) is the probability that the th head is on the th toss. In other words, is the probability that it takes tosses to get heads.
As an illustration, let (a fair coin). Let’s say we flip the coins until the third head. Here’s several probabilities.
A quick note about binomial coefficients. Numbers such as and are called binomial coefficients. In general is defined by the ratio . The number such as is called factorial, which is the product of and all the positive integers below . So is the number .
The above 4 probabilities tell us that in flipping a fair coins, there are 12.5% chance that it takes 3 tosses (0+3) to get three heads, that there is an 18.75% chance that it takes 4 tosses (1 + 3) to get three heads and so on. The sum of these 4 probabilities is 0.65625. So there is a 65.625% chance that it takes at most 6 tosses to get three heads.
Note that in the coin tossing example, the random variable counts the number of tails. Since the goal is to get 3 heads, the number of tosses to achieve the goal would be . Thus the probability of flipping the coin 7 times to get heads would be .
The coin tossing example can be generalized by a random experiment such as this: perform a series of independent trials, where each trial has only two distinct outcomes (for convenience one is called success and the other is called failure). The probability of getting a success in each trial is constant across all the trials. Let be the probability of a success in a trial. Let’s say this experiment stops when successes are obtained. The probability in (1) is the probability that it will take failures to obtain successes. Equivalently, is the probability it will take trials in the experiment to obtain successes.
When the Parameter r Is Not Integer
When the parameter is a positive real number but not an integer, the natural setting of tossing a coin until the th head would not be applicable. However, the negative binomial distribution is still a useful model. It cannot be interpreted as the counting of failures until the th success. It can be used as a model for the count of some type of random occurrences. For example, the number of insurance losses from an insurance contract in a policy period.
To calculate the probability when is not an integer, we need to relax the definition of the binomial coefficient. When is a positive integer, the binomial coefficient is defined as follows:
A further simplification of this calculation is informative.
We can let the last step in the above derivation as the definition for when is just a positive number not necessarily an integer. For example, let and . Then is , which is .
Note that the new definition of the binomial coefficient requires that the bottom number is a positive integer (1 or higher). When , we define . Whenever the bottom number is 0, the value of the binomial coefficient is 1. With this understanding, we calculate a few probabilities for the parameters and .
Compare the negative binomial probabilities between the example of and and the example of and . The two negative binomial distributions have different shapes. In the example of , the probabilities are concentrated in the lower values. About 88% of the probabilities are concentrated at and . On the other hand, in the example of , there are still significant amount of probabilities at for . For this reason, the parameter is called the shape parameter of the negative binomial distribution.
The Other Two Parametrizations
We now discuss the negative binomial distribution as described by (2) and (3). These give the same probabilities as (1), just that one of the parameters is different. The shape parameter is still . In (2), the other parameter is , a positive real number. The rule for relating (2) and (1) would be making and . Otherwise, (2) would work the same way as in (1) in terms of evaluating the probabilities .
Similarly the parameters for (3) would be and where is a positive real number. The parameters and would be related by setting and .
Why would there be a need for the parametrizations of (2) and (3)? Both (2) and (3) arise naturally through the idea of mixture. The negative binomial is a mixture of Poisson distributions with gamma mixing weights. More specifically, mixing Poisson distributions with uncertain mean with following a gamma distribution will produce a negative binomial distribution as described by (2) or (3) depending on the form of the gamma distribution used.
The notion of mixture is applicable in many areas. The notion of mixture distributions and Poisson-gamma mixture in particular are discussed here. Many distributions applicable in actuarial applications are mixture distributions (see here for examples).
Here is a discussion on how Poisson is related to gamma.
Discussion on the negative binomial distribution is found in blog posts in several companion blogs. Here is a detailed discussion of the negative binomial distribution. Further discussions are found here and here.
Dan Ma math
Dan Ma mathematics topics
Daniel Ma mathematics
Daniel Ma mathematics topics