How to Read Academic Research Quiz 2
This (sample) difference could have easily occurred even if the two (population) groups were the same
The two groups do not differ in the population
The two groups do not differ in the sample
This (sample) difference could have easily occurred even if the two (population) groups were the completely different
We can’t confidently tell the effect of this item
We can’t tell if the population groups that differ based on this item also differ in the outcome variable
The population groups that differ based on this item do not differ in the outcome variable
This (sample) difference could have easily occurred even if the population showed no difference
The true population value is within 95% of the range of this confidence interval
This confidence interval is within 95% of the true population
The mean of the sample is within 95% of the mean of the confidence interval
If you kept taking random samples, 95% of the time the sample value would appear inside the confidence interval associated with each sample
If you kept taking random samples, 95% of the time the true (population) value would appear inside the confidence interval associated with each sample
All of them
None of them
About 5
About 95
About 20
Multiple comparisons
Statistical significance
Lying bastards
Statistical magnitude
Correlation
Because the relationship is likely due to random chance
Because even if the relationship exists, the effect of the relationship might be so small that we don’t care
Because the relationship is likely impaired by multiple comparison
Because highly significant relationships cannot actually have very small magnitude
Because practical importance requires statistical significance
The associated variable is negatively related to the outcome
The associated variable has an opposite relationship with the outcome as compared with another significant positive variable
The associated variable is probably more strongly negative in its association with the outcome than another variable with a much smaller negative coefficient where both variables have similar standard error
The associated variable causes the outcome
When in the sample, the variable of interest is higher when the outcome variable is lower
When in the sample, the variable of interest is lower when the outcome variable is higher
When in the sample, the variable of interest is higher when the outcome variable is higher
When in the sample, the variable of interest is lower when the outcome variable is lower
Never
Google scholar
Web of Science
Econ Lit
Blackboard
Psychtoolbox
The chance that the association found was due to an unusual random sample from a population in which there was no underlying association
The chance that the association found has practical significance
The chance that the association found was due to an unusual random sample from a population in which there was an underlying association
The magnitude of the underlying association
If there is a causal relationship between the significant factor and the measured outcome
There is greater than a 5% chance that the result was caused by an unusual random sample where there was no actual (population) difference
There is less than a .05% chance that the result was caused by an unusual random sample where there was no actual (population) difference
There is less than a .05% chance that the result was caused by an unusual random sample where there was no actual (population) difference
There is less than a 5% chance that the result was caused by an unusual random sample where there was no actual (population) difference
There is a causal relationship between the significant factor and the measured outcome