rates of the final t test that were considerably larger than α = .05 (Figure 1A). Moreover, the violation of the significance level increased with sample size and αpre. For example, for n = 30, the observed Type I error rates of the two-sample t test turned out to be 10.8% for αpre = .005 and even 17.0% for αpre = .100, whereas the unconditional Type I error rate was 4.7%. If the underlying distribution was uniform, the conditional Type I error rates declined below the nominal level, particularly as samples became larger and preliminary significance levels increased (Figure 1B). For normally distributed populations, conditional and unconditional Type I error rates
roughly followed the nominal significance level (Figure 1C). For pairs in which at least one sample had not passed
the pretest for normality, we conducted Mann-Whitney’s U test. The estimated conditional Type I error probabilities
are summarized in Table 1 (right): For exponential samples, only a negligible tendency towards conservative
decisions was observed, but samples from the uniform distribution, and, to a lesser extent, samples from the normal distribution proved problematic. In contrast to the pattern observed for the conditional t test, however,
the nominal significance level was mostly violated in small samples and numerically low significance levels of
the pretest (e.g., αpre = .005).
rates of the final t test that were considerably larger than α = .05 (Figure 1A). Moreover, the violation of the significance level increased with sample size and αpre. For example, for n = 30, the observed Type I error rates of the two-sample t test turned out to be 10.8% for αpre = .005 and even 17.0% for αpre = .100, whereas the unconditional Type I error rate was 4.7%. If the underlying distribution was uniform, the conditional Type I error rates declined below the nominal level, particularly as samples became larger and preliminary significance levels increased (Figure 1B). For normally distributed populations, conditional and unconditional Type I error ratesroughly followed the nominal significance level (Figure 1C). For pairs in which at least one sample had not passedthe pretest for normality, we conducted Mann-Whitney’s U test. The estimated conditional Type I error probabilitiesare summarized in Table 1 (right): For exponential samples, only a negligible tendency towards conservativedecisions was observed, but samples from the uniform distribution, and, to a lesser extent, samples from the normal distribution proved problematic. In contrast to the pattern observed for the conditional t test, however,the nominal significance level was mostly violated in small samples and numerically low significance levels ofthe pretest (e.g., αpre = .005).
การแปล กรุณารอสักครู่..
