Purpose

The purpose of today’s lab is to introduce tools for sampling from and calculating statistics for different types of distributions in R. The content of the lab will be split into two sections. The first section will focus on binomial distributions and the second section will focus on normal distributions. The Minihacks will test your knowledge of both types of distributions, as well as some distributions that are not discussed in the lab but are nonetheless important.

To quickly navigate to the desired section, click one of the following links:

  1. Binomial Distributions
  2. Normal Distributions
  3. Minihacks

Binomial Distributions

Imagine you are flipping a coin. If it is a fair coin, you would expect a 50% chance of the coin landing on heads and a 50% chance of the coin landing on heads. However, as shown in the animation below, every heads is not always paired with a tails. Sometimes there is a run of heads and sometimes there is a run of tails. Still, we would probably expect that, overall, there would be the same number of heads as tails. In other words, we would expect that if we flipped a single coin 100 times, the most likely outcome would be 50 heads and 50 tails.

As you might recall from class, our intuition about the outcome of the 100 coin flips can be described in terms of a binomial distribution. Essentially, the binomial distribution describes the theoretical probability of obtaining a certain outcome over a number of trials when (1) the outcome on every trial is binary (e.g., a coin landed on a heads or a tails; a dice was either a 6 or not a 6) and the probability of the outcome on every trial is the same (e.g., the probability of getting a heads on flip 1 is the same as the probability of getting a heads on flip 100).

If we plot the probability distribution of the example above, two things are apparent: (1) the most probable outcome of flipping 100 coins is 50 heads and (2) there are additional outcomes that are, although less probable, also possible. For instance, one could even expect to get 0 heads 0.00000000000000000000000000008% of the time.

rbinom

If we want to randomly sample trials from a binomial distribution, we can use the rbinom() function in R. The function takes three arguments. The first argument (n) is the number of trials to sample. If we wanted to flip 2 coins 10 times, we would include the argument n = 10. The second argument (size) is the number of events associated with each trial. If we are flipping 2 coins, we would include size = 2. The third argument (prob) is the probability of success on a given trial. If we consider a heads a success and everything else a failure, we would include the argument prob = 1/2. Putting all of that together, we get rbinom(n = 10, size = 2, prob = 1/2).

rbinom(n = 10, size = 2, prob = 1/2)
##  [1] 0 2 1 1 1 1 0 1 1 1

From the results, we can see we got 0 heads on the first toss of our 2 coins, 2 heads on the second toss our 2 coins, and 1 head on the third through sixth tosses of our 2 coins.

How would we change this if we were flipping 3 coins 10 times?

# your code here

What about rolling 5 6-sided dice 10 times where getting a 6 is considered a successful outcome?

# your code here

What about pulling an Ace out of 1 deck of cards 100 times?

# your code here

dbinom

The function dbinom() gives us the probability of getting any one result. It takes four arguments, but we will only concern ourselves with the first three: (1) x - the number of successful outcomes expected, (2) size - the number of events, and (3) prob - the probability of success on a given event.

To get the probability of getting 1 heads by flipping 2 coins, we could run the following code.

dbinom(x = 1, size = 2, prob = .5)
## [1] 0.5

There is a .50 probability of getting 1 heads when you flip 2 coins. We can investigate why this is the case by looking at the probability of every outcome.

# HT + TH
(.5 * .5) + (.5 * .5)
## [1] 0.5

What’s the probability of getting 1 head when you flip 3 coins?

# your code here

What’s the probability of drawing 2 aces out of a 1 deck of cards (with replacement)?

# your code here

What’s the probability of drawing 0 Aces out of a deck of cards (with replacement)?

# your code here

pbinom

If we want to calculate the cumulative probability of getting a certain result (i.e., the probability of getting a result equal to or less than what we expect), we would use the function pbinom(). Cumulative probability may not sound important, but it is when you consider that a p-value is the probability of getting a result equal to or more extreme than that observed in the sample. The function pbinom() takes essentially the same arguments as dbinom(), but instead of the first argument being called x it is called q.

Returning to the example from above, if we wanted to get the probability of getting 1 or less heads when we flip 2 coins, we would use pbinom(q = 1, size = 2, prob = 1/2).

pbinom(q = 1, size = 2, prob = 1/2)
## [1] 0.75

The result is .75. Again, this makes sense if we look at the probability of every outcome.

# HT + TH + TT
(.5 * .5) + (.5 * .5) + (.5 * .5)
## [1] 0.75

What’s the probability of getting 1 or less heads when flipping 10 coins?

# your code here

What’s the probability of getting 1 or less 6s when rolling 1 dice?

# your code here

The function pbinom() can also take the argument lower.tail (defaults to TRUE). The argument lower.tail is what specifies what side of the probability distribution we should be testing from. In practical terms, it is what decided that we wanted 1 or less heads rather than greather than 1 heads.

For instance, if we wanted to test the probability of getting greater than 1 heads when flipping 2 coins, we would specify lower.tail = FALSE.

pbinom(q = 1, size = 2, prob = 1/2, lower.tail = FALSE)
## [1] 0.25

What’s the probability of getting greater than 3 6s when rolling 9 dice?

# your code here

qbinom

The function qbinom() essentially does the opposite of pbinom. Instead of taking an outcome (q) and returning the cumulative probability, it returns the value that corresponds to the cumulative probability (p).

For instance if we wanted the value for which there is 100% probability of getting that value or less on 10 coin flips, we would enter qbinom(p = 1.00, size = 10, prob = 1/2).

qbinom(p = 1.00, size = 10, prob = 1/2)
## [1] 10

Unsurprisingly, 10 or less heads has a 100% chance of occurring when you flip 10 coins.

With 100 coin flips, what is the number of heads (or less) that has a .50 probability of occurring?

# your code here

With 100 coin flips, what is the number of heads (or less) that has a .25 probability of occurring?

# your code here

With 100 coin flips, what is the number of heads (or greater) that has a .25 probability of occurring?

# your code here

Normal Distributions

Recall from class that a normal distribution is a continuous probability distribution that is defined by a mean (\(\mu\)) and a standard deviation (\(\sigma\)). Whereas the binomial distribution describes the theoretical probability of obtaining a certain outcome over a number of trials when the outcome of every trial is binary, the normal distribution describe the theoretical probability of obtaining a certain outcome from a continuous distribution that has a certain mean (\(\mu\)) and standard deviation (\(\sigma\)).

rnorm

In order to randomly sample observations from a normal distribution, we use the function rnorm(). Similar to rbinom(), rnorm() takes three arguments: (1) n - the number of observations to sample from the normal distribution, (2) mean - the mean of the normal distribution, and (3) sd - the standard deviation of the normal distribution.

Below we sample 5 values from a normal distribution with a mean of 0 and a sd of 1.

x <- rnorm(n = 5, mean = 0, sd = 1)
x
## [1] -0.89691455  0.18484918  1.58784533 -1.13037567 -0.08025176

The five values were -0.8969145, 0.1848492, 1.5878453, -1.13037567 and -0.08025176. Calculating the mean() and sd() of our 5 numbers can serve as a bit of a sanity check.

mean(x)
## [1] -0.06696949
sd(x)
## [1] 1.0749

If we plot a histogram of the data, it doesn’t look normally distributed.

Not to worry! As illustrated in the animation below, many samples do not appear normal until samples of sufficient size are taken from the population.

How would you sample 10 observations from a normal distribution with a mean of 100 and a standard deviation of 10?

# your code here

Are the descriptives for this sample what we would expect?

# your code here

dnorm

The normal distribution counterpart of dbinom() is dnorm(). Similar to rnorm(), it takes a mean (mean) and a standard deviation (sd), but instead of an argument for the number of observations you want to sample (n) you provide it a value (x). As mentioned in class, the probability of any one value in a normal distribution is 0.00 because the total probability of the distribution is 1.00 and there are infinite values in any continuous distribution. The reason dnorm() exists is mostly mathematical, but we can use it to calculate the height of the probability curve for any one value.

dnorm(x = 0, mean = 0, sd = 1)
## [1] 0.3989423

For example, if we enter the value 0 with a mean of 0 and a standard deviation 1, we get 0.3989423

As shown in the plot above, the height of the probability curve at a value of 0 is .399.

Likewise, if we calculate the height of the probability plot at an x value of 1, we see the result 0.2419707.

dnorm(1, mean = 0, sd = 1)
## [1] 0.2419707

Looking at the plotted normal distribution, this is also expected.

What would be the height of the probability line at a value of -1 when the mean is 0 and the sd is 1?

# your code here

pnorm

Like pbinom(), pnorm() tells you the probability of getting a certain value (or less) in a given normal distribution. Once again, you can set the mean and standard deviation of the distribution using mean and sd. Instead of taking its value using the x argument, it takes its argument using the q argument.

If we wanted to calculate the probability of getting a value in the shaded region above, we would use pnorm(q = 0, mean = 0, sd = 1).

pnorm(q = 0, mean = 0, sd = 1)
## [1] 0.5

As would be expected, we have a 50% probability of getting a value in the shaded region of the plot. However, for most of us, it is not easy to try to convert the shaded region under a curve to a probability value. An easier way to visualize it is through the use of a cumulative probability plot, where each shaded ball represents a .01 (1.00%) probability.

If we were to count every shaded ball on the left of the vertical line below, we would see that there are 50 balls to the left of the red line. In other words, there is a 50% probability of getting a 0 or less in our distribution.

So, what’s the probability of getting 40 or less when the mean is 50 and the standard deviation is 10?

Looking at our cumulative probability plot, it looks like 16 balls are on the left of the dashed red line. We can check this with pnorm().

pnorm(q = 40, mean = 50, sd = 10)
## [1] 0.1586553

Looks like the probability of getting a value of 40 or less is slightly less than .16.

We can also work through this mathematically. We expect that 68% of values on a normal distribution will fall between plus or minus one standard deviation. In our example, 40 is one standard deviation below the mean. As such, the probability of getting 40 or a value less than 40 would be \(\frac{1 - 0.68}{2} = \frac{.32}{2} = .16\).

What’s the probability of getting a value of 60 or less, when the mean of the distribution is 30 and the standard deviation is 15?

# your code here

What’s the probability of getting a value greater than -5 when the mean is 0 and the sd is 5?

# your code here

qnorm

Finally, we can use qnorm() to get the value that corresponds to a particular cumulative probability. Once again, we can set the mean (mean) and standard deviation (sd) of the distribution, but we use p to set the target probability.

To get the value or less that has a probability of 0.00135 of occurring in a distribution with a mean of 0 and a standard deviation of 1 is calculated using qnorm(p = .00135, mean = 0, sd = 1).

qnorm(p = .00135, mean = 0, sd = 1)
## [1] -2.999977

As we can see, the value is just about -3.00. This makes sense if we consider that 99.73% of values in a normal distribution are between three standard deviations below and above the mean; probability of getting -3.00 would be \(\frac{1-.9973}{2} = 0.00135\).

What value or less is associated with a .51 cumulative probability in a normal distribution with a mean of 100 and a standard deviation of 10?

# your code here

What value or greater is associated with a .51 probability in a normal distribution with a mean of 100 and a standard deviation of 10?

# your code here

Minihacks

You are welcome to work with a partner or in a small group of 2-3 people. Please feel free to ask the lab leader any questions you might have!

Minihack 1: Binomial Distributions

You are playing Dungeons and Dragons and, to the Dungeon Master’s displeasure, you run immediately to the dragon that is meant to be encountered at the end of her carefully-crafted campaign.

  1. To defeat the dragon, you must roll 5 20-sided dice, and get a 20 on each die. What is the probability of getting this result?
# your code here
  1. Your dungeon master decides to take pity on you. She tells you, if you roll greater than 2 (i.e., 3 or more) 20s she will let you slay the dragon. What is the probability of getting more than 2 20s when rolling 5 20-sided dice?
# your code here
  1. You begin to cry. Between your sobs you tell her you will only roll if the probability is greater than .10. She acquiesces. What number of 20s or greater is associated with a cumulative probability of .10 when rolling 5 20-sided dice?
# your code here

Minihack 2: Normal Distributions

From data released from the Graduate Coffee Drinkers Association (GCDA), you know coffee consumption is normally distributed among graduate students, with the average student drinking 5 cups of coffee per day and 68% of students drinking between 4 and 6 cups of coffee per day (i.e., the distribution has a standard deviation of 1).

  1. What is the probability that a randomly selected graduate student will drink 2 or less cups of coffee per day?
# your code here
  1. Sample 50 graduate students from the distribution three times. Plot each of these samples as a histogram. Are the histograms identical? Why or why not?
# your code here
  1. Ever since finding the data from the GCDA, you have begun to worry about how much coffee you are drinking compared to the average graduate student. Calculate the probability that a graduate student would drink exactly 10 cups of coffee per day.
# your code here
  1. Using your large and highly-caffeinated brain, you remember that the probability of any one value in a continuous distribution is 0.00. Calculate the probability that a graduate student would drink 10 or more cups of coffee a day.
# your code here

Minihack 3: Other Distributions to Extend your Knowledge

  1. A magician accosts you in the street, and demands you think of a number between 1 and 100. You think of 37 and the magician guesses 37. Assuming the choice of numbers follows a uniform distribution, what is the probability that the magician guessed your number at random? Use dunif() to prove your intuition is correct.
# your code here
  1. Shortly after your run in with the magician, an advocate of null hypothesis testing approaches you and demands that you calculate the probability of getting a \(\chi^2\)-value of greater than 3.00 with 10 degrees of freedom. Use pchisq() to calculate the probability.
# your code here
  1. Seeing that their test statistic was non-significant, the null hypothesis tester becomes irate and demands you calculate the probability of getting 3.00 or greater with 10 degrees of freedom from a t-distribution. Google (or use your intuition) to determine how to calculate a cumulative probability from a t-distribution.
# your code here