- Open Access
Correcting for cell-type effects in DNA methylation studies: reference-based method outperforms latent variable approaches in empirical studies
Genome Biology volume 18, Article number: 24 (2017)
Based on an extensive simulation study, McGregor and colleagues recently recommended the use of surrogate variable analysis (SVA) to control for the confounding effects of cell-type heterogeneity in DNA methylation association studies in scenarios where no cell-type proportions are available. As their recommendation was mainly based on simulated data, we sought to replicate findings in two large-scale empirical studies. In our empirical data, SVA did not fully correct for cell-type effects, its performance was somewhat unstable, and it carried a risk of missing true signals caused by removing variation that might be linked to actual disease processes. By contrast, a reference-based correction method performed well and did not show these limitations. A disadvantage of this approach is that if reference methylomes are not (publicly) available, they will need to be generated once for a small set of samples. However, given the notable risk we observed for cell-type confounding, we argue that, to avoid introducing false-positive findings into the literature, it could be well worth making this investment.
Please see related Correspondence article: https://genomebiology.biomedcentral.com/articles/10/1186/s13059-017-1149-7 and related Research article: https://genomebiology.biomedcentral.com/articles/10.1186/s13059-016-0935-y
Tissues often consist of multiple cell types that show different methylation patterns. In association studies, these differences can cause spurious findings when the relative abundance of the cell types is related to the outcome of interest. The inclusion of cell-type proportions as covariates will prevent such false positives. To avoid performing cell counts on all subjects in the study, these proportions can be estimated by using a small set of reference methylomes obtained using DNA from sorted cells . However, reference methylomes might not always be (publicly) available and or be difficult to generate. In these scenarios, latent variables obtained by a decomposition of the methylation data can be used as a proxy for cell-type proportions. McGregor et al.  performed an extensive simulation study comparing one reference-based and seven latent variable methods. Although not always the best method, the reference-based method performed well. For scenarios where no reference is available, the authors recommended the use of surrogate variable analysis (SVA) , which performed adequately in all simulation scenarios.
As the recommendation by McGregor and colleagues  was based mainly on simulated data, we studied SVA in two large-scale empirical studies. The first involved 1149 Dutch subjects (825 cases with depression and 324 controls) aged 18–65 years  and the second 1448 Swedish subjects (774 schizophrenia cases and 674 controls) aged 25–92 years [5, 6]. Using whole-blood samples from six US subjects, cell populations were isolated by positive selection using EasySep™ kits (Stemcell Technologies), which apply magnetic nanoparticles coated with antibodies against a particular surface antigen (CD molecules). Specifically, we used CD3, CD19, CD20, CD14, and CD15 to isolate all common cell types in blood. All methylation data were generated using methyl-CG binding domain sequencing (MBD-seq) [7, 8], but the schizophrenia study was conducted on an older sequencing platform with a slightly different laboratory protocol. We used a permutation test to examine whether our top methylome-wide association study (MWAS) results were enriched for sites showing significant methylation differences among cell types. The MBD-seq procedure assays almost all 28 million common CpGs in the human genome. As the SVA package could not process all sites simultaneously, it was performed on 12 randomly selected subsets of 100,000 CpG sites.
Table 1 indicates that, if no cell-type correction is applied, MWAS findings show a greater than sixfold enrichment of CpG sites exhibiting cell-type differences in methylation. This was consistent with the significant case-control differences in estimated cell-type proportions (across cell types/studies, the median P value was 8.0 × 10–5) and stresses the need to control for this confounder. The enrichment disappears when using the reference-based method. By contrast, significant enrichment remained after SVA correction in all studied scenarios. The performance of SVA was associated with the number of surrogate variables (SVs), which varied considerably across the 12 randomly selected CpG subsets within each study. However, even when as many as 84 SVs were included, SVA failed to control for more-subtle cell-type effects. To enable a simultaneous analysis of all sites, analyses were repeated using principal component analysis (PCA) , which also corrects for cell types by using latent variables. However, this did not improve results.
The use of a reference-based method ensures that only variation linked to differences in cell-type proportions is eliminated. SVA can eliminate any general source of variation in the methylation data. This carries the risk of missing true signals when some SVs capture part of the disease processes (e.g., a pathway). Table 1 reports additional variance explained by SVs in case-control status compared with a multiple-regression model that included technical covariates, age/sex, and cell-type proportions. Depending on the number of SVs, the additional variance ranged from 1 to 9%. This illustrates the risk of SVA potentially eliminating true signals in a MWAS. To mitigate this risk, one could avoid regressing out SVs associated with the case-control status. However, as cell-type proportions are related to both case-control status and SVs, such a modified analysis might be even less effective in controlling for cell-type effects.
With empirical data, SVA did not adequately correct for cell-type effects, had somewhat unstable performance, and carried a risk of missing true disease signals. The PCA suggested that these limitations might not be specific to SVA but are inherent to the use of latent variables—that is, whereas these corrections assume that cell-type heterogeneity impacts many sites, cell-type effects seem more subtle and cannot be fully captured by just the main latent variables. For this reason, we expect our findings to generalize to methylation platforms other than MBD-seq. By contrast, the reference-based method was superior in all respects. If reference methylomes are not (publicly) available for a given tissue and methylation assay, they will need to be generated once for a small set of samples. However, given the notable risk we observed for cell-type confounding, to avoid introducing false-positive findings into the literature it could be well worth making this investment.
Methyl-CG binding domain sequencing
Methylome-wide association study
Principal component analysis
Surrogate variable analysis
Houseman EA, Accomando WP, Koestler DC, Christensen BC, Marsit CJ, Nelson HH, et al. DNA methylation arrays as surrogate measures of cell mixture distribution. BMC Bioinformatics. 2012;13:86.
McGregor K, Bernatsky S, Colmegna I, Hudson M, Pastinen T, Labbe A, et al. An evaluation of methods correcting for cell-type heterogeneity in DNA methylation studies. Genome Biol. 2016;17:84.
Leek JT, Storey JD. Capturing heterogeneity in gene expression studies by surrogate variable analysis. PLoS Genet. 2007;3:1724–35.
Penninx BW, Beekman AT, Smit JH, Zitman FG, Nolen WA, Spinhoven P, et al. The Netherlands study of depression and anxiety (NESDA): rationales, objectives and methods. Int J Methods Psychiatr Res. 2008;17:121–40.
Ripke S, O'Dushlaine C, Chambert K, Moran JL, Kahler AK, Akterin S, et al. Genome-wide association analysis identifies 13 new risk loci for schizophrenia. Nat Genet. 2013;45:1150–9.
Aberg KA, McClay JL, Nerella S, Clark S, Kumar G, Chen W, et al. Methylome-wide association study of schizophrenia: identifying blood biomarker signatures of environmental insults. JAMA Psychiat. 2014;71:255–64.
Aberg KA, McClay JL, Nerella S, Xie LY, Clark SL, Hudson AD, et al. MBD-seq as a cost-effective approach for methylome-wide association studies: demonstration in 1500 case--control samples. Epigenomics. 2012;4:605–21.
Aberg KA, Xie L, Chan RF, Zhao M, Pandey AK, Kumar G, et al. Evaluation of methyl-binding domain based enrichment approaches revisited. PLoS One. 2015;10:e0132205.
Chen W, Gao G, Nerella S, Hultman CM, Magnusson PK, Sullivan PF, et al. MethylPCA: a toolkit to control for confounders in methylome-wide association studies. BMC Bioinformatics. 2013;14:74.
This research was supported by the National Institute of Mental Health (grants R03MH102723 to KAA and R01MH104576, R01MH099110, and RC2MH089996 to EJCGvdO). MWH received salary support from the National Institute on Drug Abuse (2R25DA026119).
Availability of data and materials
Data available from the Dryad Digital Repository: http://datadryad.org/resource/doi:10.5061/dryad.bv376. The Swedish MWAS data are available from dbGAP (study accession phs000608.v1.p1).
MWH, AAS, KAA, and EJCGvdO designed the experiments. KAA oversaw the laboratory work where MZ performed cell sorting and LY and RFC contributed to sequencing. MWH, AAS, SLC, GK, and EJCGvdO analyzed the data. GvG, PKEM, RJ, and LKMH curated the phenotype information. BWJHP and CMH provided clinical input on the samples. EJCGvdO and MWH prepared the manuscript. All authors discussed the results and contributed to editing the paper. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Hattab, M.W., Shabalin, A.A., Clark, S.L. et al. Correcting for cell-type effects in DNA methylation studies: reference-based method outperforms latent variable approaches in empirical studies. Genome Biol 18, 24 (2017). https://doi.org/10.1186/s13059-017-1148-8
- True Signal
- Methylation Data
- Extensive Simulation Study
- Latent Variable Approach
- Surrogate Variable Analysis