class: center, middle, inverse, title-slide # Comparing two dependent means --- ## Annoucements * Oral exam questions will be posted soon * Breakout groups today --- ## Previously... * chi-square `\((\chi^2) tests\)` * one-sample _t_-tests --- ### Today Paired-samples _t_-tests --- In **longitudinal research**, the same people provide responses to the same measure on two occasions (the individuals in the two groups are the same). In **paired-sample research**, the individuals in the two groups are different, but they are related and their responses are assumed to be correlated. Examples would be responses by children and their parents, members of couples, twins, etc. In **paired-measures research**, the same people provide responses to two different measures that assess closely related constructs. This resembles longitudinal research, but data collection occurs at one time. All of these are instances of repeated measures designs. --- The advantage of repeated measures designs is that, compared to an independent groups design of the same size, the repeated measures design is **more powerful**. * Two groups are more alike than in simple randomization * The correlated sampling units will have less variability on "nuisance variables" because those are either the same over time (longitudinal) or over measures (paired measures), or very similar over people (paired samples). * Nuisance variables -- anything that isn't relevant to the study. --- Each of these repeated measures problems can be viewed as a transformation of the original two measures into a single measure: a difference score. This reduces the analysis to a one-sample *t*-test on the difference score, with null mean = 0. --- If the repeated measures are `\(X_1\)` and `\(X_2\)`, then their difference is `\(D = X_1 – X_2\)`. This new measure has a mean and standard deviation, like any other single measure, making it appropriate for a one-sample *t*-test. `$$t_{df = N-1} = \frac{\bar{\Delta}-\mu}{\frac{\hat{\sigma}_\Delta}{\sqrt{N}}}$$` .pull-left[ `$$H_0: \bar{\Delta} = \mu$$` `$$H_1: \bar{\Delta} \neq \mu$$` ] .pull-right[ `$$H_0: \bar{\Delta} = 0$$` `$$H_1: \bar{\Delta} \neq 0$$` ] ??? Note here the signal to noise ratios --- ## Example Human-wildlife conflict in urban areas endangers wildlife species. One species under threat is the *Larus argentatus* or herring gull, which is considered a nuisance owing to food-snatching and other behaviors. A [recent study](https://royalsocietypublishing.org/doi/10.1098/rsbl.2019.0405) examined whether herring gull behavior is influenced by human behavior cues and whether this could be used to reduce human-gull conflict. .pull-left[ ] .pull-right[ In this study, experimenters visited coastal towns in the UK and found locations with multiple gulls. They placed a bag of potato chips (250 g) in front of them and measured how long it took gulls to peck at the food. ] --- .pull-left[  In the **Looking At** treatment, the experimenter directed her gaze towards the eye(s) of the gull and turned her head, if necessary, to follow its approach path until the gull completed the trial by pecking at the food bag. ] .pull-right[  In the **Looking Away** treatment, the experimenter turned her head and eyes approximately 60° (randomly left or right) away from the gull and maintained this position until she heard the gull peck at the food bag. ] "We adopted a repeated measures design... We randomly assigned individuals to receive Looking At or Looking Away first, and trial order was counterbalanced across individuals. Second trials commenced 180 s after the completion of the first trial to allow normal behaviour to resume." --- ```r gulls = read.delim(here("data/gulls/pairs.txt")) gulls ``` ``` ## GullID At Away ## 1 FAL01 210 35 ## 2 FAL03 300 80 ## 3 FAL04 6 3 ## 4 PEN03 18 21 ## 5 W120M 47 13 ## 6 W019 25 4 ## 7 PNZ01 4 13 ## 8 PNZ02 9 8 ## 9 STI01 300 18 ## 10 STI02 300 6 ## 11 W186 11 8 ## 12 STI03 4 3 ## 13 STI04 4 6 ## 14 HEL02 12 19 ## 15 NEW01 300 6 ## 16 NEW02 63 16 ## 17 NEW03 300 166 ## 18 PER01 24 66 ## 19 TRU01 300 167 ``` ??? FAL = Falmouth PEN = Penryn --- ### Hypothesis testing Use a paired-samples *t*-test because we have the same gulls in both conditions. -- `\(\large H_0\)`: There is no difference in how long it takes gulls to approach food between conditions. `\(\large H_1\)`: Gulls take longer to approach food in one of the conditions. --- ### Sampling distribution *t*-distribution requires two parameters, a mean and a standard deviation. The mean of our sampling distribution comes from our null hypothesis, so `$$\large \mu = 0$$` Our standard deviation of our sampling distribution is the **standard error of difference scores**. This can be found by 1. calculating difference scores 2. calculating the standard deviation of the difference scores, and 3. dividing the standard deviation by the square root of the number of *pairs* in your study. --- ```r difference = gulls$At - gulls$Away ``` ``` ## [1] 175 220 3 -3 34 21 ``` -- .pull-left[ We can take the mean of this new variable: ```r (m_delta = mean(difference)) ``` ``` ## [1] 83.10526 ``` ] -- .pull-right[ And we can calculate the standard deviation ```r (s_delta = sd(difference)) ``` ``` ## [1] 115.8485 ``` ] -- To calculate the standard error of our difference scores, we simply divide the standard deviation by the square root of the number of *pairs* or, in the case of repeated measures, the number of *subjects*. ```r (se_delta = s_delta/sqrt(nrow(gulls))) ``` ``` ## [1] 26.57747 ``` `$$\frac{\hat{\sigma}_\Delta}{\sqrt{N}} = 26.58$$` --- <!-- --> --- ### Test statistic `$$t_{df = N-1} = \frac{\bar{\Delta}-\mu}{\frac{\hat{\sigma}_\Delta}{\sqrt{N}}}$$` In this case, N refers to the number of pairs, not the total sample size. `$$t_{df = N-1} = \frac{83.11-0}{26.58} = 3.13$$` **Note:** A paired-samples *t*-test is *exactly* the same as a one-sample *t*-test on the difference scores. --- <!-- --> --- Another option is to calculate the area above the absolute value of the test statistic and multiply that by two -- this estimates the probability of finding this test statistic or more extreme. ```r (t_statistic = m_delta/se_delta) ``` ``` ## [1] 3.126906 ``` ```r pt(t_statistic, df = 19-1, lower.tail = F) ``` ``` ## [1] 0.002912942 ``` ```r pt(t_statistic, df = 19-1, lower.tail = F)*2 ``` ``` ## [1] 0.005825884 ``` --- ## t-test functions ```r t.test(x = gulls$At, y = gulls$Away, paired = TRUE) ``` ``` ## ## Paired t-test ## ## data: gulls$At and gulls$Away ## t = 3.1269, df = 18, p-value = 0.005826 ## alternative hypothesis: true difference in means is not equal to 0 ## 95 percent confidence interval: ## 27.26807 138.94246 ## sample estimates: ## mean of the differences ## 83.10526 ``` --- ```r ggpubr::ggpaired(data = gulls, cond1 = "At", cond2 = "Away", line.color = "grey", ylab = "Time to approach (seconds)", title = "Some gulls approach food more quickly when \npeople look away from them") ``` <!-- --> --- ## The variance of difference scores With the raw data, the calculation of the variance of the standard deviation scores `\(\large (\hat{\sigma}_\Delta)\)` is intuitive. Sometimes you will not have access to the raw data, but will want to conduct the test. For example, you read a study that compares a sample of Oregon students to known US benchmarks on several variables using multiple one-sample *t*-tests; you want to know whether OR students respond more to one variable than the other. <table class="table" style="margin-left: auto; margin-right: auto;"> <thead> <tr> <th style="text-align:left;"> </th> <th style="text-align:right;"> N </th> <th style="text-align:right;"> Mean </th> <th style="text-align:right;"> SD </th> </tr> </thead> <tbody> <tr> <td style="text-align:left;"> Importance_reducing_pollution </td> <td style="text-align:right;"> 194 </td> <td style="text-align:right;"> 792.15 </td> <td style="text-align:right;"> 937.03 </td> </tr> <tr> <td style="text-align:left;"> Importance_recycling_rubbish </td> <td style="text-align:right;"> 194 </td> <td style="text-align:right;"> 714.85 </td> <td style="text-align:right;"> 652.65 </td> </tr> </tbody> </table> The correlation between these variables is 0.61. --- It turns out that the mean difference score is the same as the difference in means, so that's an easy part of the calculation. But the calculation of the standard deviation becomes a little more complicated: `$$\large \hat{\sigma}_\Delta = \sqrt{\hat{\sigma}^2_{M_1} + \hat{\sigma}^2_{M_2} - 2r(\hat{\sigma}_{M_1}\hat{\sigma}_{M_2})}$$` ```r sd_1 = 937.03 sd_2 = 652.65 cor_12 = .61 var_d = sd_1^2 + sd_2^2 -2*cor_12*sd_1*sd_2 sqrt(var_d) ``` ``` ## [1] 746.9157 ``` --- Now you have all the information you need for the statistical test! ```r (t = (792.15-714.85)/(746.92/sqrt(194))) ``` ``` ## [1] 1.441472 ``` ```r pt(t, df = 193, lower.tail = F)*2 ``` ``` ## [1] 0.1510719 ``` <!-- --> ??? Useful for meta-analysis or getting more information from articles you read. What else can this equation tell us? * What happens if the two variables are highly correlated with each other? --- `$$\large \hat{\sigma}_\Delta = \sqrt{\hat{\sigma}^2_{M_1} + \hat{\sigma}^2_{M_2} - 2r(\hat{\sigma}_{M_1}\hat{\sigma}_{M_2})}$$` What happens if `\(\large r\)` is large and positive? -- What happens if `\(\large r\)` is small and positive? -- What happens if `\(\large r\)` is negative? --- ## Assumptions * Independence (between pairs) * Normality **Note:** These are the same assumptions as a one-sample *t*-test. --- class: inverse ### Next time... * Independent samples _t_-tests ### But first, breakout groups!