Statistical Notes
Statistical Notes
Effect size is a quantitative measure that reflects the magnitude of an effect or the strength of a
relationship in inferential analysis. Unlike hypothesis tests that primarily focus on whether an
effect exists (typically through p-values), effect size provides more information about the size of
the effect, which is crucial for understanding the practical significance of results.
There are different types of effect sizes, depending on the type of analysis being conducted:
Effect sizes help researchers and practitioners understand how substantial an impact is, making
it easier to assess the relevance and applicability of the findings in real-world scenarios. It also
allows for better comparisons across studies since it standardizes the measurement of effects,
facilitating meta-analyses and further research.
Significant Level
A 5% significance level in hypothesis testing, often denoted as α = 0.05, indicates that you are
willing to accept a 5% chance of incorrectly rejecting the null hypothesis when it is actually true.
This is commonly referred to as a Type I error.
If the p-value obtained from your analysis is less than or equal to 0.05, you reject the
null hypothesis, implying that the results are statistically significant. This means that
there is less than a 5% probability that the observed results occurred by random
chance alone.
If the p-value is greater than 0.05, you do not reject the null hypothesis, suggesting that
there is not enough evidence to conclude that an effect or relationship exists.
The choice of a 5% significance level is conventional, but researchers may choose different
thresholds (such as 0.01 or 0.10) depending on the context, the field of study, or the specific
consequences of making an error.
Effect Relations
In a quasi-experimental study that includes a control group and an
intervention group, the term "effect relation" generally refers to the
relationship between the treatment or intervention applied to the
experimental group and the outcomes measured in both groups. It
essentially describes how the intervention is expected to impact the results
compared to the outcomes in the control group, which does not receive the
intervention.