How do confidence intervals overlap

Note that a 0. Table 6 presents the results of Robertson and Preisler's ratio method for comparing LDs. One should note that, at least from this simulation, their method tends to reject too frequently when comparing LD 50 s, but seems to work well at the other LDs exhibited. Simulation results using two inverse confidence intervals from probit regressions performed on the same population.

An analysis of the powers of the proposed method using an adjusted fiducial alpha of 0. Different ratios of slopes of two models were generated, and the probability of rejecting the hypothesis that the LDs were the same calculated for each method. As can be seen in Table 7 , the method of comparing fiducial limits is not as powerful as the ratio method.

As the differences in slopes of the two probit regressions get larger and hence, the differences in LDs , the ratio method becomes more likely to detect these differences relative to the method of comparing fiducial limits. Simulation results comparing powers of ratio test to use of fiducial limits to test differences in LD 50s, LD 90s and LD99s in probit regressions.

These are the results of 1, pairs of simulated data sets. Error rates of 0. Ratio column refers to the ratio of one probit regression slope to the other probit regression slope. The intercepts of the two regressions are held constant. Large slope ratios reflect large differences in LDs. Caution should be exercised when the results of an experiment are displayed with confidence or standard error intervals.

Whether or not these intervals overlap does not imply the statistical significance of the parameters of interest. However, the ratio test provided in Robertson and Preisler should be used to test effective doses since it has been demonstrated to be a more powerful method of comparison. High resistance of field populations of the cotton aphid Aphis gossypii Glover Homoptera: Aphididae to pyretthroid insecticides in Pakistan.

Journal of Economic Entomology 96 : - Google Scholar. Studies on the effect of deltamethrin on the numbers of epigeal predatory arthropods.

Pesticide Science 16 : - Browne RH. On visual assessment of the significance of a mean difference. Biometrics , 35 : - Identifying key cereal aphid predators by molecular gut analysis. Molecular Ecology 9 : - Croft BA. Arthropod Biological Control Agents and Pesticides. John Wiley and Sons. Food production, population growth, and the environment. Science : - Poisoning of Canada geese in Texas by parathion sprayed for control of Russian wheat aphid. Journal of Wildlife Disease 27 : - The graphical presentation of a collection of means.

Journal of the Royal Statistical Society A : - Determination of prey antigen half-life in Polistes metricus using a monoclonal antibody-based immunodot assay. Entomologia Experimentalis et Applicata 68 : 1 - 7. Gupta RC Ma S. Testing the equality of the coefficient of variation in k normal populations. Communications in Statistics 25 : - Infectivity studies of a new baculovirus isolate for the control of diamondback moth Lepidoptera:Plutellidae. Journal of Economic Entomology 92 : - Matacham EJ Hawkes C.

Field assessment of the effects of deltamethrin on polyphagous predators in winter wheat. Payton ME. Confidence intervals for the coefficient of variation. Testing statistical hypotheses using standard error bars and confidence intervals.

Communications in Soil Science and Plant Analysis 31 : - Genetics of esterase mediated insecticide resistance in the aphid Schizaphis graminum. Heredity 81 : 14 - Pesticide Bioassays with Arthropods.

CRC Press. SAS Institute Inc. Schenker N Gentleman JF. On judging the significance of differences by examining overlap between confidence intervals. The American Statistician 55 : - Description of three isozyme polymorphisms associated with insecticide resistance in greenbug Homoptera: Aphididae populations. Journal of Economic Entomology 89 : 46 - Susceptibility of leafrollers Lepidoptera: Tortricidae from organic and conventional orchards to azinphosmethyl, Spinosa, and Bacillus thuringiensis.

Vangel MG. Confidence intervals for a normal coefficient of variation. The American Statistician 50 : 21 - Modelling the coefficient of variation in factorial experiments. Communications in Statistics-Theory and Methods 31 : - Oxford University Press is a department of the University of Oxford. It furthers the University's objective of excellence in research, scholarship, and education by publishing worldwide.

Sign In or Create an Account. Sign In. Advanced Search. However, the opposite is not necessarily true. What is the significance of the t-test P-value? The P-value in this case is less than 0. With statistics, we can analyze a small sample to make inferences about the entire population.

But there are a few situations where you should avoid making inferences about a population that the sample does not represent:. To avoid these situations, define the population before sampling and take a sample that truly represents the population. Correlation between two variables does not mean that one variable causes a change in the other, especially if correlation statistics are the only statistics you are using in your data analysis.

For example, data analysis has shown a strong positive correlation between shirt size and shoe size. As shirt size goes up, so does shoe size. Does this mean that wearing big shirts causes you to wear bigger shoes? Of course not! Tall people tend to wear bigger clothes and shoes. Take a look at this scatterplot that shows that HIV antibody false negative rates are correlated with patient age:. Does this show that the HIV antibody test does not work as well on older patients?

Well, maybe …. Below you see that patient age and days elapsed between at-risk exposure and test are correlated:. Older patients got tested faster … before the HIV antibodies were able to fully develop and show a positive test result. Intentionally or not, the media frequently imply that a study has revealed some cause-and-effect relationship, even when the study's authors detail precisely the limitations of their research. It's important to remember that using statistics, we can find a statistically significant difference that has no discernible effect in the "real world.

And you can waste a lot of time and money trying to "correct" a statistically significant difference that doesn't matter. In this article we focus on an invalid method to assess effect modification, which is often used in articles in health sciences journals [ 6 ], namely concluding that there is no effect modification if the confidence intervals of the subgroups are overlapping [ 7 — 9 ]. In other words, if the confidence intervals are overlapping, the difference in effect estimates between the two subgroups is judged to be statistically insignificant.

If the effect estimates are not independent, the correlation coefficient between the effect estimates can also be accounted for Supplementary material, formula 3. To arrive at a type 1 error probability of 0. If the effect estimates are not independent, the correlation coefficient should be taken into account Supplementary material, formula Adapting the level of the confidence interval can be especially useful for graphical presentations, for example in meta-analyses [ 10 ].

However, it is necessary to explicitly and clearly state which percentage confidence interval is calculated and its meaning should be thoroughly explained to the reader. The assumption used in the formulas presented in the appendices is that the effect estimators in the subgroups are normally distributed. Assuming that epidemiologic effect measures, such as the odds ratio, risk ratio, hazard ratio and risk difference, follow a normal distribution, the methods presented can also be used for these epidemiologic measures.

Note that the assumption for normality is generally unreasonable in small samples, but a satisfactory approximation in large samples. As an example, imagine a large randomized controlled trial that investigates the effect of some intervention on mortality and that includes 10, men and 5, women. Besides the main effect of treatment, the researchers are interested in assessing whether the treatment effect is different for men and women.

Suppose that the risk ratio in men is 0. The confidence intervals are partly overlapping, which the researchers may wrongly interpret as no effect modification by sex. A confidence level of Now, the confidence intervals do not overlap, so the p-value is at least smaller than 0.

This confirms our earlier observation of statistically significant effect modification. This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author s and source are credited.

National Center for Biotechnology Information , U. European Journal of Epidemiology.