Skip to main content

High type II error and interpretation inconsistencies when attempting to refute transgenerational epigenetic inheritance

Abstract

A recently published article in Genome Biology attempts to refute important aspects of the phenomenon of transgenerational epigenetic inheritance (TEI). An alternative explanation of the data is offered here, showing that TEI is indeed not contradicted.

Please see related Correspondence article: www.dx.doi.org/10.1186/s13059-016-0981-5 and related Research article: http://genomebiology.biomedcentral.com/articles/10.1186/s13059-015-0619-z

A growing number of publications report the existence of transgenerational epigenetic inheritance (TEI). TEI is based on environmentally-induced epigenomic changes in the germ line that affect the somatic and/or germ line epigenomes of individuals in subsequent generations, as well as their phenotypes [1]. Evidence of TEI is available since the first report in 2005 [2] and has emerged from a variety of model organisms, including rodents, fish, and invertebrates [3]. Also, reports of disease phenotypes being transgenerationally transmitted in humans [4] make TEI of wide interest for current and future human health [5].

Due to the relatively recent description of the phenomenon of TEI and the complexity of the molecular mechanisms involved, it is not surprising that many knowledge gaps remain. The group of Dr. Szabó recently published a study in Genome Biology [6] conducted in mice and well designed to address some major questions in the process of TEI. These include “how are environmentally-induced germ line epigenomic changes maintained in subsequent generations?” and “how do environmentally-induced epigenomic changes observed in the mature sperm correlate with epigenomic marks in fetal germ cells?” Pregnant mice were exposed to environmental toxicants previously shown to induce TEI (e.g. BPA [710], DHEP [11], and vinclozolin [2, 8, 12, 13]). Germ line DNA methylation was then assessed in the immediate offspring (G1) and their descendants (G2). Based on their data, the authors’ main conclusion was that there is no evidence for TEI at the level of germ line DNA methylation because changes in DNA methylation “are not found in the germ cells of the subsequent generation.”

The present correspondence aims at offering an alternative explanation of the data presented by Iqbal et al. [6], in order to clarify that no data in that paper contradicts current evidence on the process of TEI. Upon careful reading of the article, it is apparent that the main conclusions are not supported by the results. Moreover, the results indeed provide evidence for TEI. Other authors have recently criticized aspects of the manuscript [6] that are not covered in this correspondence [14, 15]). Here, important methodological issues are discussed such as: (1) the high type II error observed, which relates to the low number of animals used in the DNA methylation comparison (2 controls versus 2 treatments); and (2) the inconsistency between the data shown and the conclusions drawn.

Number of individuals used for comparisons

The number of individual samples used in the study [6] (not shown in the “Methods” section, but only in the legends of Figure 3 and Additional file 10) indicates “n = 3” (possibly meaning 3 controls versus 3 treatments) for fetal male germ cells (MGC) comparisons and “n = 2” (possibly meaning 2 controls versus 2 treatments) for sperm comparisons. The MIRA-chip signals of the 2 versus 2 (sperm) or 3 versus 3 (MGC) comparisons are shown in their Figure 8 and Additional figure 9. One important consequence of using such low numbers of individuals for comparisons is that it does not allow for a powerful enough statistical testing in order to detect differences among groups, leading to a substantial increase in type II error.

A post hoc power analysis was performed with the ssize R package [16], employing an average of the standard deviations provided by Dr. Szabó and the same FDR rate (0.05) used for power calculations by her group. The results are shown in Table 1.

Table 1 Power analysis for 2 vs. 2 comparisons using the ssize R script

The main conclusion from this table is that the 2 versus 2 comparisons are under-powered to detect even twofold changes. In such cases, the type II error gives a 76.6 % chance of not detecting changes. This level is far from the accepted standard, which is a ~20 % chance of not finding effects. Therefore, all the analyses that include sperm samples, i.e. those performing 2 versus 2 comparisons, are under-powered to detect either small (20 %) or large (100 %) changes in DNA methylation.

As for the 3 versus 3 comparisons, Table 1 in Dr. Szabó’s response shows that in order to detect a 20 % change in methylation (a fairly common rate of change), 14 individuals would have been needed in order to obtain a power of 0.8. My conclusion is that although the 3 versus 3 comparisons seem sufficient to detect a 50 % change in methylation, they are also under-powered to detect common changes such as 20 %.

Another consequence of studying a small number of individuals is specifically related to epigenetic analyses. Epigenetic variation exists between animals so that variability in methylation patterns will occur among individuals in the same gene. When a population of animals is affected by an environmental stimulus, not all individuals will be affected to the same extent, similarly to what occurs for physiological parameters in response to environmental disturbances.

Variability in DNA methylation changes observed among individuals can only be detected when a sufficient number of individuals is studied. In a 2 versus 2 animal testing design (as used in [6]), there is an enormous chance that non-responsive or less-responsive individuals are compared, leading to the erroneous conclusion that no change occurs due to the treatment.

Sufficient statistical power is especially important in studies that aim at refuting previous findings. Based on the current data evaluation, my conclusion is that the DNA methylation analyses presented in the Iqbal et al. study [6] does not have sufficient power to refute the aspects of TEI in question. The fact that few genes were found altered is strongly dependent on the low power of the experiments. Moreover, it is also important to consider that even if a few changes are found, they can still be of biological relevance.

Inconsistencies between the results and the conclusions drawn

Interestingly, even with the low number of individuals used for the comparisons, important differences were detected representing transgenerational transmission of germ line epigenetic changes. These, however, are not apparent due to the way the data are presented in their Table 3.

Venn diagram representations shown here (Fig. 1) are built using the same data shown in their Table 3 [6]. The intersection between the G1 and G2 generation balloons shows the number of common genes epigenetically altered in these two generations in response to the different exposures. The genes altered with the same direction of methylation change in both generations are shown in parenthesis.

Fig. 1
figure 1

Venn diagram representations built using the same data shown in Table 3 of Iqbal et al.’s study [6]. Numbers inside the balloons represent the genes with altered DNA methylation in each generation (G1 or G2), in sperm or MGC, in response to each exposure tested (BPA, DEHP, or vinclozolin). The intersections between the G1 and G2 generation balloons show the number of common genes epigenetically altered in these two generations in response to the different exposures

Figure 2 shows a similar comparison but focuses on the common genes altered in DNA methylation between MGC and testis, for each generation.

Fig. 2
figure 2

Venn diagram representations built using the same data shown in Table 3 of Iqbal et al.’s study [6]. Numbers inside the balloons represent the genes with altered DNA methylation in each generation (G1 or G2), in sperm or MGC, in response to vinclozolin exposure. The intersection between the “MGC” and “Sperm” balloons shows the number of common genes epigenetically altered in these two differentiation stages, in each generation. DNA methylation alterations in exactly the same direction in “MGC” and “Sperm” are shown in parenthesis

These data clearly show numerous genes altered in the germ line in both generations tested, with some of them being common between them. Furthermore, these changes are observed with all the exposures tested. In my opinion, these results, together with the high type II error derived from the low number of individuals tested, do not support the main conclusions of the Iqbal et al. paper [6] regarding not finding evidence for TEI in their study. Even though the majority of the changes observed are not the same in each generation, they are still indicative of a transgenerational epigenomic effect in the germ line.

About our previous research in TEI

A very last point relates to Dr. Szabó’s criticisms of our previous work regarding sample pooling and reproducibility of our findings. In regards to pooling samples, this is a very common and statistically valid method to account for biological variability in procedures of high cost [17, 18]. By pooling, the values obtained are equivalent to arithmetical averages [17, 18]. With regards to the reproducibility, this was so paramount in our studies that candidate genes were selected only after they have appeared as significantly changed in all three of the comparative hybridization comparisons performed. Moreover, afterwards candidates were tested with other local DNA methylation techniques such as pyrosequencing, bisulphite sequencing, or MeDIP-qPCR [12, 19]. A candidate gene was called true only after passing all these filters.

Type II error acquires special relevance in studies attempting to refute previous findings. Even though Dr. Szabó criticizes the power in our previous studies (which indeed included a higher number of individuals within the pooled samples), our main aim was not to refute previous findings, rather to provide reliable evidence for transgenerational changes in DNA methylation. As described above, we reported genes after they have passed many layers of confirmation, which makes the statistical possibility that these are “random effects” very low. However, underpowered experiments will probably not detect these differences, since most of them are below 20 % changes in DNA methylation. With regards to the relevance of small changes in DNA methylation, it is up to the reader to evaluate their biological importance. In my personal opinion, the biological effects of such changes in DNA methylation, especially when combined gene actions are considered, should not be overlooked.

References

  1. Skinner MK, Manikkam M, Guerrero-Bosagna C. Epigenetic transgenerational actions of environmental factors in disease etiology. Trends Endocrinol Metab. 2010;21:214–22.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  2. Anway MD, Cupp AS, Uzumcu M, Skinner MK. Epigenetic transgenerational actions of endocrine disruptors and male fertility. Science. 2005;308:1466–9.

    Article  CAS  PubMed  Google Scholar 

  3. Guerrero-Bosagna C. Transgenerational epigenetic inheritance: past exposures, future diseases. In: Rosenfeld C, editor. The epigenome and developmental origins of health and disease. London and Oxford (UK); Waltham, MA and San Diego, CA (USA): Elsevier; 2015. p. 425–437.

  4. Pembrey M, Saffery R, Bygren LO, Network in Epigenetic Epidemiology, Network in Epigenetic Epidemiology. Human transgenerational responses to early-life experience: potential impact on development, health and biomedical research. J Med Genet. 2014;51:563–72.

    Article  PubMed  PubMed Central  Google Scholar 

  5. Guerrero-Bosagna C, Jensen P. Globalization, climate change, and transgenerational epigenetic inheritance: will our descendants be at risk? Clin Epigenetics. 2015;7:8.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Iqbal K, Tran DA, Li AX, Warden C, Bai AY, Singh P, et al. Deleterious effects of endocrine disruptors are corrected in the mammalian germline by epigenome reprogramming. Genome Biol. 2015;16:59.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Bhandari RK, vom Saal FS, Tillitt DE. Transgenerational effects from early developmental exposures to bisphenol A or 17alpha-ethinylestradiol in medaka. Oryzias latipes Sci Rep. 2015;5:9303.

    Article  CAS  PubMed  Google Scholar 

  8. Manikkam M, Guerrero-Bosagna C, Tracey R, Haque MM, Skinner MK. Transgenerational actions of environmental compounds on reproductive disease and identification of epigenetic biomarkers of ancestral exposures. PLoS One. 2012;7:e31901.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  9. Manikkam M, Tracey R, Guerrero-Bosagna C, Skinner MK. Plastics derived endocrine disruptors (BPA, DEHP and DBP) induce epigenetic transgenerational inheritance of obesity, reproductive disease and sperm epimutations. PLoS One. 2013;8:e55387.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  10. Salian S, Doshi T, Vanage G. Impairment in protein expression profile of testicular steroid receptor coregulators in male rat offspring perinatally exposed to Bisphenol A. Life Sci. 2009;85:11–8.

    Article  CAS  PubMed  Google Scholar 

  11. Doyle TJ, Bowman JL, Windell VL, McLean DJ, Kim KH. Transgenerational effects of di-(2-ethylhexyl) phthalate on testicular germ cell associations and spermatogonial stem cells in mice. Biol Reprod. 2013;88:112.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Guerrero-Bosagna C, Covert TR, Haque MM, Settles M, Nilsson EE, Anway MD, et al. Epigenetic transgenerational inheritance of vinclozolin induced mouse adult onset disease and associated sperm epigenome biomarkers. Reprod Toxicol. 2012;34:694–707.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  13. Stouder C, Paoloni-Giacobino A. Transgenerational effects of the endocrine disruptor vinclozolin on the methylation pattern of imprinted genes in the mouse sperm. Reproduction. 2010;139:373–9.

    Article  CAS  PubMed  Google Scholar 

  14. Sharma A. Variable directionality of gene expression changes does not constitute negative evidence of epigenetic inheritance. Environ Epigen. 2015;1:1–5.

    Article  Google Scholar 

  15. Nadeau JH. The nature of evidence for and against epigenetic inheritance. Genome Biol. 2015;16:137.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Warnes GR, Liu P, Li F. ssize: estimate microarray sample size. R package version 1.46.0. 2012. https://www.bioconductor.org/packages/release/bioc/html/ssize.html.

  17. Peng X, Wood CL, Blalock EM, Chen KC, Landfield PW, Stromberg AJ. Statistical implications of pooling RNA samples for microarray experiments. BMC Bioinformatics. 2003;4:26.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Zhang W, Carriquiry A, Nettleton D, Dekkers JC. Pooling mRNA in microarray experiments and its effect on power. Bioinformatics. 2007;23:1217–24.

    Article  CAS  PubMed  Google Scholar 

  19. Guerrero-Bosagna C, Settles M, Lucker B, Skinner MK. Epigenetic transgenerational actions of vinclozolin on promoter regions of the sperm epigenome. PLoS One. 2010;5:e13100.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

CGB greatly appreciates support by the ERC grant GeneWell.

Competing interests

The author declares that he has no competing interests.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Carlos Guerrero-Bosagna.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Guerrero-Bosagna, C. High type II error and interpretation inconsistencies when attempting to refute transgenerational epigenetic inheritance. Genome Biol 17, 153 (2016). https://doi.org/10.1186/s13059-016-0982-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13059-016-0982-4

Keywords