High type II error and interpretation inconsistencies when attempting to refute transgenerational epigenetic inheritance
© Guerrero-Bosagna. 2016
Received: 12 January 2016
Accepted: 10 May 2016
Published: 12 July 2016
A recently published article in Genome Biology attempts to refute important aspects of the phenomenon of transgenerational epigenetic inheritance (TEI). An alternative explanation of the data is offered here, showing that TEI is indeed not contradicted.
Please see related Correspondence article: www.dx.doi.org/10.1186/s13059-016-0981-5 and related Research article: http://genomebiology.biomedcentral.com/articles/10.1186/s13059-015-0619-z
A growing number of publications report the existence of transgenerational epigenetic inheritance (TEI). TEI is based on environmentally-induced epigenomic changes in the germ line that affect the somatic and/or germ line epigenomes of individuals in subsequent generations, as well as their phenotypes . Evidence of TEI is available since the first report in 2005  and has emerged from a variety of model organisms, including rodents, fish, and invertebrates . Also, reports of disease phenotypes being transgenerationally transmitted in humans  make TEI of wide interest for current and future human health .
Due to the relatively recent description of the phenomenon of TEI and the complexity of the molecular mechanisms involved, it is not surprising that many knowledge gaps remain. The group of Dr. Szabó recently published a study in Genome Biology  conducted in mice and well designed to address some major questions in the process of TEI. These include “how are environmentally-induced germ line epigenomic changes maintained in subsequent generations?” and “how do environmentally-induced epigenomic changes observed in the mature sperm correlate with epigenomic marks in fetal germ cells?” Pregnant mice were exposed to environmental toxicants previously shown to induce TEI (e.g. BPA [7–10], DHEP , and vinclozolin [2, 8, 12, 13]). Germ line DNA methylation was then assessed in the immediate offspring (G1) and their descendants (G2). Based on their data, the authors’ main conclusion was that there is no evidence for TEI at the level of germ line DNA methylation because changes in DNA methylation “are not found in the germ cells of the subsequent generation.”
The present correspondence aims at offering an alternative explanation of the data presented by Iqbal et al. , in order to clarify that no data in that paper contradicts current evidence on the process of TEI. Upon careful reading of the article, it is apparent that the main conclusions are not supported by the results. Moreover, the results indeed provide evidence for TEI. Other authors have recently criticized aspects of the manuscript  that are not covered in this correspondence [14, 15]). Here, important methodological issues are discussed such as: (1) the high type II error observed, which relates to the low number of animals used in the DNA methylation comparison (2 controls versus 2 treatments); and (2) the inconsistency between the data shown and the conclusions drawn.
Number of individuals used for comparisons
The number of individual samples used in the study  (not shown in the “Methods” section, but only in the legends of Figure 3 and Additional file 10) indicates “n = 3” (possibly meaning 3 controls versus 3 treatments) for fetal male germ cells (MGC) comparisons and “n = 2” (possibly meaning 2 controls versus 2 treatments) for sperm comparisons. The MIRA-chip signals of the 2 versus 2 (sperm) or 3 versus 3 (MGC) comparisons are shown in their Figure 8 and Additional figure 9. One important consequence of using such low numbers of individuals for comparisons is that it does not allow for a powerful enough statistical testing in order to detect differences among groups, leading to a substantial increase in type II error.
Power analysis for 2 vs. 2 comparisons using the ssize R script
Type II error (%)
The main conclusion from this table is that the 2 versus 2 comparisons are under-powered to detect even twofold changes. In such cases, the type II error gives a 76.6 % chance of not detecting changes. This level is far from the accepted standard, which is a ~20 % chance of not finding effects. Therefore, all the analyses that include sperm samples, i.e. those performing 2 versus 2 comparisons, are under-powered to detect either small (20 %) or large (100 %) changes in DNA methylation.
As for the 3 versus 3 comparisons, Table 1 in Dr. Szabó’s response shows that in order to detect a 20 % change in methylation (a fairly common rate of change), 14 individuals would have been needed in order to obtain a power of 0.8. My conclusion is that although the 3 versus 3 comparisons seem sufficient to detect a 50 % change in methylation, they are also under-powered to detect common changes such as 20 %.
Another consequence of studying a small number of individuals is specifically related to epigenetic analyses. Epigenetic variation exists between animals so that variability in methylation patterns will occur among individuals in the same gene. When a population of animals is affected by an environmental stimulus, not all individuals will be affected to the same extent, similarly to what occurs for physiological parameters in response to environmental disturbances.
Variability in DNA methylation changes observed among individuals can only be detected when a sufficient number of individuals is studied. In a 2 versus 2 animal testing design (as used in ), there is an enormous chance that non-responsive or less-responsive individuals are compared, leading to the erroneous conclusion that no change occurs due to the treatment.
Sufficient statistical power is especially important in studies that aim at refuting previous findings. Based on the current data evaluation, my conclusion is that the DNA methylation analyses presented in the Iqbal et al. study  does not have sufficient power to refute the aspects of TEI in question. The fact that few genes were found altered is strongly dependent on the low power of the experiments. Moreover, it is also important to consider that even if a few changes are found, they can still be of biological relevance.
Inconsistencies between the results and the conclusions drawn
Interestingly, even with the low number of individuals used for the comparisons, important differences were detected representing transgenerational transmission of germ line epigenetic changes. These, however, are not apparent due to the way the data are presented in their Table 3.
These data clearly show numerous genes altered in the germ line in both generations tested, with some of them being common between them. Furthermore, these changes are observed with all the exposures tested. In my opinion, these results, together with the high type II error derived from the low number of individuals tested, do not support the main conclusions of the Iqbal et al. paper  regarding not finding evidence for TEI in their study. Even though the majority of the changes observed are not the same in each generation, they are still indicative of a transgenerational epigenomic effect in the germ line.
About our previous research in TEI
A very last point relates to Dr. Szabó’s criticisms of our previous work regarding sample pooling and reproducibility of our findings. In regards to pooling samples, this is a very common and statistically valid method to account for biological variability in procedures of high cost [17, 18]. By pooling, the values obtained are equivalent to arithmetical averages [17, 18]. With regards to the reproducibility, this was so paramount in our studies that candidate genes were selected only after they have appeared as significantly changed in all three of the comparative hybridization comparisons performed. Moreover, afterwards candidates were tested with other local DNA methylation techniques such as pyrosequencing, bisulphite sequencing, or MeDIP-qPCR [12, 19]. A candidate gene was called true only after passing all these filters.
Type II error acquires special relevance in studies attempting to refute previous findings. Even though Dr. Szabó criticizes the power in our previous studies (which indeed included a higher number of individuals within the pooled samples), our main aim was not to refute previous findings, rather to provide reliable evidence for transgenerational changes in DNA methylation. As described above, we reported genes after they have passed many layers of confirmation, which makes the statistical possibility that these are “random effects” very low. However, underpowered experiments will probably not detect these differences, since most of them are below 20 % changes in DNA methylation. With regards to the relevance of small changes in DNA methylation, it is up to the reader to evaluate their biological importance. In my personal opinion, the biological effects of such changes in DNA methylation, especially when combined gene actions are considered, should not be overlooked.
CGB greatly appreciates support by the ERC grant GeneWell.
The author declares that he has no competing interests.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Skinner MK, Manikkam M, Guerrero-Bosagna C. Epigenetic transgenerational actions of environmental factors in disease etiology. Trends Endocrinol Metab. 2010;21:214–22.View ArticlePubMedPubMed CentralGoogle Scholar
- Anway MD, Cupp AS, Uzumcu M, Skinner MK. Epigenetic transgenerational actions of endocrine disruptors and male fertility. Science. 2005;308:1466–9.View ArticlePubMedGoogle Scholar
- Guerrero-Bosagna C. Transgenerational epigenetic inheritance: past exposures, future diseases. In: Rosenfeld C, editor. The epigenome and developmental origins of health and disease. London and Oxford (UK); Waltham, MA and San Diego, CA (USA): Elsevier; 2015. p. 425–437.Google Scholar
- Pembrey M, Saffery R, Bygren LO, Network in Epigenetic Epidemiology, Network in Epigenetic Epidemiology. Human transgenerational responses to early-life experience: potential impact on development, health and biomedical research. J Med Genet. 2014;51:563–72.View ArticlePubMedPubMed CentralGoogle Scholar
- Guerrero-Bosagna C, Jensen P. Globalization, climate change, and transgenerational epigenetic inheritance: will our descendants be at risk? Clin Epigenetics. 2015;7:8.View ArticlePubMedPubMed CentralGoogle Scholar
- Iqbal K, Tran DA, Li AX, Warden C, Bai AY, Singh P, et al. Deleterious effects of endocrine disruptors are corrected in the mammalian germline by epigenome reprogramming. Genome Biol. 2015;16:59.View ArticlePubMedPubMed CentralGoogle Scholar
- Bhandari RK, vom Saal FS, Tillitt DE. Transgenerational effects from early developmental exposures to bisphenol A or 17alpha-ethinylestradiol in medaka. Oryzias latipes Sci Rep. 2015;5:9303.View ArticlePubMedGoogle Scholar
- Manikkam M, Guerrero-Bosagna C, Tracey R, Haque MM, Skinner MK. Transgenerational actions of environmental compounds on reproductive disease and identification of epigenetic biomarkers of ancestral exposures. PLoS One. 2012;7:e31901.View ArticlePubMedPubMed CentralGoogle Scholar
- Manikkam M, Tracey R, Guerrero-Bosagna C, Skinner MK. Plastics derived endocrine disruptors (BPA, DEHP and DBP) induce epigenetic transgenerational inheritance of obesity, reproductive disease and sperm epimutations. PLoS One. 2013;8:e55387.View ArticlePubMedPubMed CentralGoogle Scholar
- Salian S, Doshi T, Vanage G. Impairment in protein expression profile of testicular steroid receptor coregulators in male rat offspring perinatally exposed to Bisphenol A. Life Sci. 2009;85:11–8.View ArticlePubMedGoogle Scholar
- Doyle TJ, Bowman JL, Windell VL, McLean DJ, Kim KH. Transgenerational effects of di-(2-ethylhexyl) phthalate on testicular germ cell associations and spermatogonial stem cells in mice. Biol Reprod. 2013;88:112.View ArticlePubMedPubMed CentralGoogle Scholar
- Guerrero-Bosagna C, Covert TR, Haque MM, Settles M, Nilsson EE, Anway MD, et al. Epigenetic transgenerational inheritance of vinclozolin induced mouse adult onset disease and associated sperm epigenome biomarkers. Reprod Toxicol. 2012;34:694–707.View ArticlePubMedPubMed CentralGoogle Scholar
- Stouder C, Paoloni-Giacobino A. Transgenerational effects of the endocrine disruptor vinclozolin on the methylation pattern of imprinted genes in the mouse sperm. Reproduction. 2010;139:373–9.View ArticlePubMedGoogle Scholar
- Sharma A. Variable directionality of gene expression changes does not constitute negative evidence of epigenetic inheritance. Environ Epigen. 2015;1:1–5.View ArticleGoogle Scholar
- Nadeau JH. The nature of evidence for and against epigenetic inheritance. Genome Biol. 2015;16:137.View ArticlePubMedPubMed CentralGoogle Scholar
- Warnes GR, Liu P, Li F. ssize: estimate microarray sample size. R package version 1.46.0. 2012. https://www.bioconductor.org/packages/release/bioc/html/ssize.html.
- Peng X, Wood CL, Blalock EM, Chen KC, Landfield PW, Stromberg AJ. Statistical implications of pooling RNA samples for microarray experiments. BMC Bioinformatics. 2003;4:26.View ArticlePubMedPubMed CentralGoogle Scholar
- Zhang W, Carriquiry A, Nettleton D, Dekkers JC. Pooling mRNA in microarray experiments and its effect on power. Bioinformatics. 2007;23:1217–24.View ArticlePubMedGoogle Scholar
- Guerrero-Bosagna C, Settles M, Lucker B, Skinner MK. Epigenetic transgenerational actions of vinclozolin on promoter regions of the sperm epigenome. PLoS One. 2010;5:e13100.View ArticlePubMedPubMed CentralGoogle Scholar