Tumor immune microenvironment characterization in clear cell renal cell carcinoma identifies prognostic and immunotherapeutically relevant messenger RNA signatures
- Yasin Şenbabaoğlu1, 15Email author,
- Ron S. Gejman2, 14,
- Andrew G. Winer3,
- Ming Liu4,
- Eliezer M. Van Allen5,
- Guillermo de Velasco5,
- Diana Miao5,
- Irina Ostrovnaya6,
- Esther Drill6,
- Augustin Luna1,
- Nils Weinhold1,
- William Lee1, 7,
- Brandon J. Manley3,
- Danny N. Khalil13,
- Samuel D. Kaffenberger3,
- Yingbei Chen8,
- Ludmila Danilova9, 10,
- Martin H. Voss11,
- Jonathan A. Coleman3,
- Paul Russo3,
- Victor E. Reuter8,
- Timothy A. Chan7, 12, 14,
- Emily H. Cheng8, 12,
- David A. Scheinberg2, 13, 14,
- Ming O. Li4,
- Toni K. Choueiri5,
- James J. Hsieh†11, 12,
- Chris Sander†1 and
- A. Ari Hakimi†1, 3Email author
© The Author(s). 2016
Received: 1 August 2016
Accepted: 26 October 2016
Published: 17 November 2016
The Erratum to this article has been published in Genome Biology 2017 18:46
Tumor-infiltrating immune cells have been linked to prognosis and response to immunotherapy; however, the levels of distinct immune cell subsets and the signals that draw them into a tumor, such as the expression of antigen presenting machinery genes, remain poorly characterized. Here, we employ a gene expression-based computational method to profile the infiltration levels of 24 immune cell populations in 19 cancer types.
We compare cancer types using an immune infiltration score and a T cell infiltration score and find that clear cell renal cell carcinoma (ccRCC) is among the highest for both scores. Using immune infiltration profiles as well as transcriptomic and proteomic datasets, we characterize three groups of ccRCC tumors: T cell enriched, heterogeneously infiltrated, and non-infiltrated. We observe that the immunogenicity of ccRCC tumors cannot be explained by mutation load or neo-antigen load, but is highly correlated with MHC class I antigen presenting machinery expression (APM). We explore the prognostic value of distinct T cell subsets and show in two cohorts that Th17 cells and CD8+ T/Treg ratio are associated with improved survival, whereas Th2 cells and Tregs are associated with negative outcomes. Investigation of the association of immune infiltration patterns with the subclonal architecture of tumors shows that both APM and T cell levels are negatively associated with subclone number.
Our analysis sheds light on the immune infiltration patterns of 19 human cancers and unravels mRNA signatures with prognostic utility and immunotherapeutic biomarker potential in ccRCC.
Tumors are complex environments, composed of transformed cells as well as stromal and immune infiltrates. Tumor-infiltrating cells can demonstrate either tumor-suppressive or tumor-promoting effects, depending on the cancer type or the tumor model. For instance, regulatory T cells (Tregs) and tumor associated macrophages (TAMs) have been associated with pro-tumor functions [1–3], whereas CD8+ T cells have been associated with improved clinical outcomes and response to immunotherapy [4–8]. Antitumor activity of antigen-specific CD8+ T cells may underlie the efficacy of immune checkpoint blockade therapy [9–11] as such CD8+ T cells have been shown to increase in quantity and activity after treatment with these drugs.
CD8+ T cells are activated by peptide antigens presented on major histocompatibility class I (MHC-I) molecules. A CD8+ T cell can proliferate when its T cell receptor (TCR) recognizes antigens presented by MHC-I on a target cell, leading to an antigen-specific immune response that kills antigen-bearing cells . All nucleated cells express antigen presenting machinery (APM) genes that code for MHC-I subunits and proteins necessary to process antigens and load them onto MHC-I. The APM genes can be upregulated by type II interferon (IFNγ), which is secreted by activated CD8+ T cells and other immune infiltrates. Upregulation of APM genes can lead to a cytotoxic feed-forward loop: more antigen presentation increases the number of T cells that find their cognate antigens, which in turn increases IFNγ release, antigen presentation, and cytotoxicity. Yet identification of CD8+ T cells alone is not sufficient to characterize the cytotoxic potential of the complex tumor microenvironment. The net inflammatory nature of the tumor can better be understood by quantifying the infiltration levels of diverse immune cell types.
Tumor immune infiltrates have largely been characterized by tissue-based approaches such as immunohistochemistry (IHC) and flow cytometry. These approaches are limited by a number of factors including the number of cell types that can be assayed simultaneously and the amount of tissue required. Computational techniques applied to gene expression profiles of bulk tumors can rapidly provide a broader perspective on the intratumoral immune landscape [13, 14]. Single sample gene set enrichment analysis (ssGSEA) has previously been successfully implemented to profile the overall immune and stromal infiltration levels across multiple cancer types . Deconvolution methods such as CIBERSORT  and DeconRNA-Seq  have also recently been developed, but either have not yet been validated for RNA sequencing (RNA-Seq) data or require reference expression vectors for each individual tumor-infiltrating immune cell population that are currently unavailable.
Clear cell renal cell carcinoma (ccRCC) has been shown to be a highly immune-infiltrated tumor in multiple clinical and genomic studies [15, 18]. A recent study found that cytolytic activity index (CYT), defined as the geometric average of GZMA and PRF1 expression, was the highest in ccRCC when compared to 17 other human cancers . The spontaneous regression seen in up to 1% of ccRCC cases is also thought to be largely immune-mediated . Additionally, ccRCC was historically one of the first malignancies to respond to immunotherapy and continues to be among the most responsive [20–23]. However, the mechanisms underlying high immune infiltration, spontaneous remissions, and response to immunotherapy in this malignancy remain poorly understood.
The success of immune checkpoint blockade in melanoma and non-small cell lung carcinoma (NSCLC) has largely been attributed to the high mutation burden in these tumors [10, 11]. A higher number of tumor mutations is expected to result in greater numbers of MHC binding neo-antigens, which have been proposed to drive tumor immune-infiltration and response to immunotherapy [9, 10, 13, 24–26]. However, the modest mutation load of ccRCC compared with other immunotherapy-responsive tumor types  challenges the notion that neo-antigens alone can drive immune infiltration and response to immunotherapy in these tumors.
As depicted in the workflow in Additional file 1: Figure S1a, we employed 24 immune cell type-specific gene signatures from Bindea et al.  (Additional file 1: Figure S1b) to computationally infer the infiltration levels in tumor samples (Step 1). We validated the gene signatures and our inference methodology using a ccRCC cohort from our institution (Step 2). We then defined a T cell infiltration score (TIS), an overall immune infiltration score (IIS), and an APM score to highlight the immune response differences between ccRCC  and 18 other tumor types profiled by The Cancer Genome Atlas (TCGA) research network (Step 3). Next, we characterized the immune-infiltration patterns in ccRCC patients by using the levels of 24 immune cells, angiogenesis, and expression of immunotherapeutic targets such as PD-1, PD-L1, and CTLA-4 (Step 4). We then interrogated the impact of geographic intratumoral heterogeneity and clonality on immune infiltration. Next, we investigated a suite of mechanisms that could potentially drive tumor immune-infiltration and explain the observed infiltration patterns in ccRCC. We validated our findings in an independent multi-platform ccRCC dataset  (Step 5). Finally, in a small series of Nivolumab-treated patients, we observed that our signatures correlate with response to checkpoint blockade therapy in ccRCC (Step 6). This integrative study utilizing rich whole-exome, whole-transcriptome, proteomic, and clinical data substantially improves our understanding of the tumor microenvironment in ccRCC and establishes an approach that can easily be extended to other human cancers.
In silico decomposition of the tumor-immune microenvironment
We quantified the relative tumor infiltration levels of 24 immune cell types by interrogating expression levels of genes in published signature gene lists . The signatures we used comprised a diverse set of adaptive and innate immune cell types and contained 509 genes in total (Additional file 2: Table S1). Of these genes, 98.4% (501) were used uniquely in only one signature (Additional file 1: Figure S2). Due to the interconnectedness between immune cell infiltration and the antigen presenting machinery (APM), we also defined a seven-gene APM signature that consisted of MHC class I genes (HLA-A/B/C, B2M) and genes involved in processing and loading antigens (TAP1, TAP2, and TAPBP). Messenger RNA (mRNA)-based scores for these signatures were computed separately for each sample using ssGSEA . ssGSEA measures the per sample overexpression level of a particular gene list by comparing the ranks of the genes in the gene list with those of all other genes.
We employed this approach to computationally assess the infiltration levels of immune cell types and APM gene expression levels in 7567 tumor and 633 normal samples from 19 different cancer types profiled by TCGA (Additional file 2: Table S2). To achieve a more focused view of the immune infiltration landscape in human cancers, we defined two aggregate scores: (1) the overall immune infiltration score (IIS) from both adaptive and innate immune cell scores; and (2) the T cell infiltration score (TIS) from nine T cell scores (CD8+ T, Th1, Th2, Th17, Treg, T effector memory, T central memory, T helper, and T cells) (see “Methods”). We computed the TIS and IIS of each sample in the study as the sum of the relevant individual scores.
Validation of the immune cell scoring methodology
Immune cell gene signatures were established by Bindea et al.  using three gene expression datasets [31–33] generated from sorted immune cell populations. Before validating these signatures on independent datasets, we first sought to confirm their discriminatory power on the datasets used to establish them and asked whether the expression of these genes separated immune cell populations into groups that were consistent with hematopoietic lineages. To this end, we obtained the microarray expression values for these genes, normalized with GCRMA  and corrected for batch effects using ComBat  (Additional file 1: Figure S3, see “Methods”). We then computed the principal components (PCs) of the batch-effect corrected dataset as a linear combination of the sorted immune cell types. This PC analysis successfully separated the cells into groups consistent with their hematopoietic lineage, suggesting adequate discrimination power for the signature genes (Additional file 1: Figure S4). More specifically, PC1 and PC2 achieved the separation of the following four groups: (1) macrophages and dendritic cells (DC); (2) B cells, NK cells (CD56dim and CD56 bright), CD8+, and CD4+ T cells; (3) Th1, Th2, T gamma delta, and T follicular helper cells; (4) mast cells, neutrophils, and eosinophils. The separation between CD8+ and CD4+ T cells was greatly enhanced if batch effect correction and PC analysis were performed with only the signatures genes of sorted T cell subpopulations (Additional file 1: Figure S5, see “Methods”).
The second in vitro validation test involved comparing mRNA-based ssGSEA scores with levels of immunofluorescence(IF)-stained immune cells from 10 MSKCC primary ccRCC tumors (see “Methods” for sample preparation). IF staining was performed for three immune cell types that are extensively studied with immunohistochemistry: CD8+ T cells (anti-CD8 antibody), natural killer (NK) cells (anti-CD56 antibody), and regulatory T cells (Tregs) (anti-FOXP3 antibody). Notwithstanding that IF is a semi-quantitative technique, we observed significant correlations between IF immune cell infiltration estimates and ssGSEA scores (Fig. 1c). The Spearman correlation for the NK, Treg and CD8+ T cell populations were 0.631 (p = 0.025), 0.639 (p = 0.023), and 0.4998 (p = 0.071), respectively. Higher correlation levels may be precluded by the spatial heterogeneity of immune cell infiltrates and random sampling effects between the tissue sections used for IF staining and RNA-Seq.
The second in silico test involved the validation of the two aggregate scores: IIS and TIS. IIS was validated with leukocyte fractions computationally inferred from available TCGA DNA methylation data in 13 cancer types (see “Methods”). The fractions obtained using this orthogonal data type were highly concordant with the RNA-Seq based IIS. Out of 13 tumor types, 10 exhibited Spearman correlations greater than 0.6 and all 13 had highly significant p values (Fig. 2b, Additional file 1: Figure S6 left column). As expected, IIS levels were often strongly negatively correlated with tumor purity as inferred by ABSOLUTE  (Additional file 1: Figure S6 right column). The other aggregate score utilized in this study, TIS, was validated with T cell receptor (TCR) beta chain abundance data computationally inferred from RNA-Seq data in . Out of the 19 tested cancer types, 17 had highly significant correlation values (brain cancers GBM and LGG did not), the majority of which were greater than 0.6 (Fig. 2c, Additional file 1: Figure S7).
We attempted to compare the immune cell scores from CIBERSORT  with our ssGSEA scores (see “Methods”) even though CIBERSORT has not yet been validated for RNA-Seq data. We observed that CIBERSORT returned zero for the majority of samples in multiple cell types, whereas ssGSEA by design returns approximately Gaussian values for any signature. This difference coupled with the differences in cell sorting strategies led to poor or moderate correlations for the majority of immune cell populations (Additional file 2: Table S9). In cases where CIBERSORT did not return zeroes and Bindea et al. were attempting to describe the same cells, we observed relatively stronger levels of concordance (CD8 T cells, T follicular helper cells, and Tregs; Pearson r = 0.725, 0.395, 0.353; p value = 6.9e-33, 1.2e-8, 4.6e-7 respectively) (Additional file 2: Table S9).
These independent validation results show that our in silico decomposition is a reliable method to infer immune infiltration levels in tumor samples.
The T cell infiltration spectrum across 19 human cancer types
Missense mutations within tumor cells are a known source of neo-antigens that can initiate a T cell dependent immune response . Previous studies have reported a significant correlation between “total number of mutations” and cytolytic activity index (CYT) in a pan-cancer context . However, synonymous mutations do not give rise to neo-antigens, therefore the correlations between “number of missense mutations” and CYT are more relevant to study when investigating the immunogenicity of tumor types. We observed that, across 18 cancer types, only glioma and stomach adenocarcinoma had significant correlations between CYT and number of missense mutations after correction for multiple hypothesis testing (Additional file 1: Figure S10c). When only the 5th to the 95th percentile of the missense mutation counts was used as implemented in , the number of cancer types with significant CYT versus mutation count correlations increased to a modest four (Additional file 1: Figure S10d).
Consistent with CYT findings, we also observed a lack of consistent positive pan-cancer correlations between TIS levels in tumors and the corresponding numbers of somatic missense mutations (Fig. 3b, top left panel). On the contrary, there was a greater number of tumor types with significant negative correlations between these two variables; an observation which held true for CD8, central memory and effector memory T cells as well (Fig. 3b). One notable exception was colorectal adenocarcinoma (COADREAD) where the hypermutated subpopulation had elevated levels of TIS (r = 0.303, p value = 3.6 × 10–7, n = 271)  (Fig. 3a). It is not obvious whether the negative correlations arise due to a direct relationship between mutated neoepitopes and T cells or due to an unknown confounding variable. We speculate that immunoedited  tumors which have gone through equilibrium and escape can lead to divergence in the association between mutation burden and T cell infiltration. For instance, tumors which acquire the ability to suppress T cell activation may continue to accumulate mutations as immune infiltration decreases.
In contrast to CD8 and memory T cells, Th2 and Treg cell levels generally showed a positive correlation with mutation load (Fig. 3b). These correlations could be indicative of an immunosuppressive environment enriched in Treg and/or Th2 cells where tumors have escaped elimination by the immune system despite bearing a large number of potentially immunogenic mutations.
Interestingly, a comparison of the APM expression between the tumor and normal tissue for kidney (clear cell, chromophobe, and papillary sub-histologies) and non-small cell lung tumors (adenocarcinoma and squamous cell) revealed that the tumor-normal difference was highly significant for ccRCC (q = 3.1 × 10–38, Mann–Whitney test) and papillary RCC (q = 2.7 × 10–13, Mann–Whitney test) but not significant for other tumor types (Fig. 4b). Notably, the tumor-normal difference for the APM score was the most pronounced in ccRCC compared with 14 other cancer types (Additional file 1: Figure S11) (no normal samples were available in the TCGA dataset for the other cancers). APM expression of ccRCC tumors did not show a positive association with either grade (Spearman r = –0.11, p = 0.02, n = 421) or stage (Spearman r = –0.14, p = 0.004, n = 422). Moreover, the grade-specific and stage-specific differences of APM expression levels were weak (p = 0.0704 and 0.0037, respectively, ANOVA) (Additional file 1: Figure S12). These results indicate that APM upregulation in ccRCC is likely an intrinsic ccRCC phenomenon and not dependent of tumor necrosis or other features associated with aggressive disease.
In a survey of the other immune cell types, we found that the unique features of ccRCC immune infiltration extends to high levels of CD8+ T cells, plasmacytoid DCs (pDC), T cells, cytotoxic cells, and neutrophils; and low levels of Th2 and Treg cells compared with the other 18 cancer types (Additional file 1: Figure S13).
Immune-infiltrate decomposition in ccRCC reveals three distinct patient clusters
In our effort to characterize the microenvironment of ccRCC tumors, we expanded our repertoire of 24 immune cell types to also include an angiogenesis signature  (Additional file 2: Table S1) and immunotherapeutic targets PD-1 (PDCD1), PD-L1 (CD274), and CTLA-4 (CTLA4). Angiogenesis is well established to be a characteristic component of immune inflammation  and ccRCC is known to have high angiogenic capacity due to constitutive activation of the hypoxia-inducible factor pathway . We confirmed the high angiogenesis levels in ccRCC via a comparison against 18 other tumor types explored in this study (Additional file 1: Figure S13).
An orthogonal measurement of tumor purity by the DNA-based ABSOLUTE algorithm  confirmed that the non-infiltrated group was the purest cluster (mean 0.640) and the T cell enriched group was the least pure cluster (mean 0.436) (p < 2 × 10–16, ANOVA). We then assessed the stromal content of samples using the RNA-based ESTIMATE algorithm  and investigated its association with the clusters. We found that the non-infiltrated cluster demonstrated the lowest stromal scores whereas the heterogeneous and T cell enriched clusters displayed mixed degrees of stromal content (p = 4 × 10–7, ANOVA).
In order to validate that the three immune infiltration clusters are not unique to the TCGA ccRCC cohort, we utilized a separate publicly available dataset of 101 ccRCC tumors for which comparable multi-platform data were available  and refer to it as the SATO dataset from here on. A random forest classifier was trained on the TCGA cohort using the ssGSEA scores of 28 immune-related variables. This classifier was used to predict the immune infiltration class for each SATO patient (see “Methods”). The heatmap of the same 28 immune features in the SATO dataset confirmed the existence of the three classes as well as the elevated expression levels of APM, granzyme B, and interferon-gamma in the T cell enriched cluster (Additional file 1: Figure S14a).
To further characterize the clusters’ unique molecular features, we next performed an unbiased analysis of differential gene and protein expression between the clusters. We excluded the signature genes and performed pathway analysis  for the genes significantly overexpressed in one of the clusters (q < 5 × 10–5, Mann–Whitney test). We observed that the T cell enriched group had significant overexpression of both adaptive and innate immunity genes (Fig. 5b and Additional file 2: Table S4A). On the other hand, the non-infiltrated group had significant overexpression of metabolism-related and mitochondria-related genes (Additional file 2: Table S4B), while the heterogeneously infiltrated group had overexpression of angiogenesis-related genes (Additional file 2: Table S4C) (q < 5 × 10–5, Mann–Whitney test). These findings were again validated in the SATO dataset (Additional file 1: Figure S14b, Additional file 2: Table S5A–C). We next utilized the TCGA reverse phase protein array (RPPA) dataset for the differential protein expression analysis. We consistently observed overexpression of immune-related proteins, such as Lck and Syk, for the T cell enriched group; and an overexpression of angiogenesis-related proteins, such as Smad1 [45, 46] and c-Kit [47–49], for the heterogeneously infiltrated group (q < 0.01, Mann–Whitney test) (Fig. 5c). A proteomic dataset for the SATO cohort was not available.
PCA on the ccRCC immune infiltration scores showed that the three clusters defined above cannot be explained by a one-dimensional infiltration gradient and most likely reflect distinct biology (Fig. 5d). Even though non-infiltrated and heterogeneously infiltrated tumors are not as well distinguished from each other as they are from the T cell enriched group, the evidence from differential gene and protein expression analyses indicate that these clusters are likely distinct as they have unique biology with respect to pathways such as those in angiogenesis and mitochondria/metabolism.
The T cell enriched cluster in the TCGA dataset exhibited two subclusters, here termed TCa (n = 39, 60%) and TCb (n = 26, 40%) (Additional file 1: Figure S15a), with different immune cell infiltration and gene expression profiles. Gene set enrichment analysis with DAVID  and ClueGO  revealed that the genes overexpressed in TCa (q < 5 × 10–5, Mann–Whitney test) were associated with metabolic and mitochondrial processes (Additional file 1: Figure S15b, Additional file 2: Table S5A). The genes overexpressed in TCb (q < 5 × 10–5, Mann–Whitney test) were enriched for processes related to cell cycle, extracellular matrix (ECM), and cellular proliferation (Additional file 1: Figure S15b, Additional file 2: Table S5B). We also found that these two subclusters had prognostic differences (Additional file 1: Figure S15c), with the TCb patients having worse cancer-specific survival than the TCa patients (p = 0.0162, log-rank test). Moreover, the TCb subcluster had significantly higher macrophage infiltration (p = 5.7 × 10–4) and stromal score (p = 4.6 × 10–4, Mann–Whitney test) with a moderate correlation between these two variables (Spearman r = 0.418, p = 5.8 × 10–4, n = 65). This correlation generalized to the entire TCGA ccRCC cohort (Spearman r = 0.561, p < 2 × 10–16, n = 415), suggesting the possibility of macrophage recruitment by stromal cells  (Additional file 1: Figure S16). These results confirm the biologically distinct characteristics of the TCa and TCb subclusters within the T cell enriched group.
T cell infiltration levels are associated with clinical outcomes
We found that tumor immune-infiltration in ccRCC was associated with distinct clinicopathologic features. Male patients (p = 0.018), higher stage (p = 0.006), and higher grade (p = 0.003) tumors were over-represented in the T cell enriched class compared to the non-infiltrated and heterogeneously-infiltrated groups (Fisher’s exact test). We next investigated the univariate significance of each T cell subset and angiogenesis as a predictor of cancer-specific survival. Cox proportional-hazards regression showed that, in both the TCGA (n = 415) and SATO (n = 101) datasets, the levels of Th17 cells and angiogenesis were strongly associated with favorable outcomes, whereas Th2 and Treg cells were associated with adverse outcomes (Fig. 6b) consistent with previous reports [18, 41, 52–55]. To optimize prognostic discrimination, we explored Th17 ratios with other immune subtypes and identified the Th17/Th2 ratio as the most predictive in both the TCGA and SATO cohorts (Fig. 6b, c). Moreover, we observed that CD8+ T cell levels alone were not significantly associated with improved survival in the TCGA cohort, but the frequently used CD8+ T/Treg ratio was (Fig. 6b, c).
Additional analyses demonstrated that previously identified prognostic features such as tumor stage and molecular ccRCC subtype (ccA/ccB)  were associated with similarly prognostic immune infiltration scores. In particular, Treg and Th17 infiltration levels had negative and positive association, respectively, with tumor stage (q = 6.1 × 10–8 for both, ANOVA) (Additional file 1: Figure S17). Treg and Th2 infiltration levels were higher in ccB (n = 175) subtype tumors (q = 3.9 × 10–9 and 1.2 × 10–8, Mann–Whitney test) compared with ccA (n = 205), which was previously shown to have better prognosis relative to ccB  (Additional file 1: Figure S18). In contrast, Th17 and CD8+ T cell infiltration levels were higher in ccA tumors (q = 2.8 × 10–12 and 5.8 × 10–6, Mann–Whitney test).
Association of immune infiltration patterns with intratumor heterogeneity and subclonality
T cell receptor β-chain (TCRb) read counts from ultra-deep TCR sequencing and total T cell counts from immunohistochemistry (IHC) were also available for a subset of the GERLINGER microarray samples (n = 6)  (Additional file 2: Table S7). These two types of T cell abundance estimates have previously been shown to have a statistically significant correlation across 14 samples , despite RMH002-R6 being a strong outlier in terms of IHC-based T cell counts. We observed that the significance of the correlation was lost when the analysis was restricted to the six samples that also had microarray data (Fig. 7b, left panel) regardless of whether RMH002-R6 was included in the correlation computation (p = 0.15 and 0.089 with and without RMH002-R6, respectively). However, the ssGSEA-based TIS had at least borderline significant correlation with both of these variables despite the small number of samples (p = 0.047 for the correlation with IHC-based T cell counts and 0.057 for the correlation with total TCRb read counts) (Fig. 7b, middle and right panels). Moreover, the scatter plots with TIS interestingly showed that the IHC-based T cell count for RMH002-R6 was not an outlier (Fig. 7b, middle panel), but the total TCRb read count for the same sample was (Fig. 7b, right panel) (p value increases from 0.057 to 0.021 for the correlation between TIS and total TCRb read count when RMH002-R6 is removed). This finding suggested that the discordance of the T cell abundance estimates for this sample may not be due to an over-representation of T cells in the FFPE section as speculated in , but may be due to an underperformance of the steps involved in ultra-deep sequencing of TCRb reads from bulk tumor DNA. Yet, this is not certain as spatial heterogeneity of T cell infiltrates and random sampling effects confound all such comparisons.
A recent study on NSCLC reported an inverse relationship between T cell infiltration and subclonal architecture . We performed clonality assessment on the TCGA ccRCC cohort using SciClone  (see “Clonality assessment” in “Methods”); and consistent with the NSCLC study, found that more clonal tumors (i.e. tumors with fewer subclones) had higher levels of CD8+ T cells, cytotoxic cells, APM, and TIS (Fig. 7c). Clonality for the SATO ccRCC cohort was also assessed using SciClone (see “Methods”) and the trends for the inverse association between immune infiltration and subclonal architecture were recapitulated in this dataset although p values did not reach significance and the trends were rather modest (Additional file 1: Figure S19). Both the TCGA and SATO results held true even when the immune scores were adjusted for purity (Additional file 1: Figure S20).
Baseline elevation in TIS and APM in ccRCC patients responding to nivolumab
Association of immune infiltration with genomic alterations and neo-antigens
In light of our evidence suggesting the presence of immunologically distinct subsets of ccRCC tumors, we investigated mutation load and recurrent genomic alterations as potential drivers of the observed T cell infiltration. The tumors from the non-infiltrated class harbored slightly more somatic missense mutations than the T cell enriched class (the median number of somatic missense mutations in the non-infiltrated group was 36.5 versus 33 in the T cell enriched group; q = 0.07, ANOVA). Out of the 11 driver genes commonly mutated in ccRCC, only PBRM1 was mutated at significantly different rates between the three populations (Additional file 1: Figure S21a; higher in non-enriched versus T cell enriched q = 0.04; higher in heterogeneous versus T cell enriched q = 0.04; Fisher’s exact). However, this observation was not validated in the SATO dataset. None of the common arm-level CNVs observed in ccRCC tumors were found at different rates between the three groups (Additional file 1: Figure S21b).
Cancer neo-antigens have been demonstrated to drive T cell infiltration of tumors in murine models of cancer [38, 61]. We hypothesized that the abundance or quality of cancer neo-antigens might differ between our tumor classes. To address this theory, we determined the HLA-A, HLA-B, and HLA-C alleles of each ccRCC TCGA patient using OptiType . We then predicted the protein alterations expected to result from missense mutations in each tumor and identified those predicted to bind to MHC-I molecules (see “Methods”). We found no significant difference in the median MHC-I binding count (Additional file 1: Figure S22a) or median binding affinity (Additional file 1: Figure S22b) of neo-antigens between the three classes of TCGA tumors. We also found no significant difference in the fraction of tumors with non-silent somatic mutations in an expanded set of APM genes (Additional file 2: Table S8A-C). These results suggest that factors other than genomic alterations may be contributing to the immune infiltration of ccRCC tumors.
ImmunExplorer web application
We have created a publicly available web application (http://kidneyimmune.chenghsiehlab.org/) that allows users to interactively visualize and perform integrated analysis of immune cell type levels, RNA-Seq, and clinical outcomes from the TCGA and Sato ccRCC datasets.
In this analysis, we present a computational approach based on overexpression of gene signatures for profiling the immune infiltration patterns in bulk tumor samples. Our methodology is different from deconvolution methods such as CIBERSORT  and DeconRNA-Seq  in that no regression or quadratic programming is involved, and only the ranks of the genes are used to infer relative cell levels. Hence, our approach does not “deconvolve” the mRNA expression data, but simply “decomposes” the immune infiltrate in the tumor microenvironment into levels of individual immune cell populations.
Compared to CIBERSORT and DeconRNA-Seq, our decomposition method has the advantages of (1) being compatible with both microarray and RNA-Seq platforms, and (2) not requiring reference expression vectors, which actually reduce the robustness of a method due to the fact that even small changes in the reference vectors may lead to substantial differences in the output when the deconvolution goal is cast into an optimization problem as in CIBERSORT and DeconRNA-Seq. Immune cell reference expression vectors are highly structured, static snapshots of the transcriptional programs of cell populations, and are highly likely to show inter-laboratory differences due to immune cells’ stimulation method, polarization state, activation state, exhaustion, or anergy. In contrast, the most abundantly expressed genes for a given cell type show little difference across different conditions. Therefore, gene signatures as in our approach offer a flexible yet principled approach to arrive at robust results.
One caveat to gene signatures is that two of them are defined by only a single gene in this study: Tregs (FOXP3) and pDCs (IL3RA). Decomposition of immune cell types with only few signatures genes is likely to be less robust than for immune cell types with many signature genes. Nevertheless, we observed that the pDC score was highly correlated with the angiogenesis score (a 40-gene signature) across many cancer types (Additional file 1: Figure S25) and this association has a known mechanism whereby pDCs induce angiogenesis . Also, we were able to validate the Treg scores with immunofluorescence. Therefore, we feel confident that, despite the small number of genes, these signatures are tracking the intended cells.
Our results highlighted the immunotherapy-responsive tumors ccRCC and LUAD as having the highest T cell infiltration median. Moreover, ccRCC, but not LUAD, demonstrated significant upregulation of antigen presentation machinery in comparison with adjacent normal tissue. Preliminary evidence emerging from clinical trials of immune checkpoint blockade therapy suggests that high mutation burdens may be predictive of good responses in NSCLC and melanoma [10, 11]. However, ccRCC is another immunotherapy-responsive tumor despite bearing orders of magnitudes fewer mutations than NSCLC and melanoma. Our data suggest that ccRCC tumors may be responsive to checkpoint blockade because of a potent pre-existing immune infiltration and overall elevated level of antigen presentation and recognition.
Immune checkpoint blockade is generally thought to function by augmenting the activity of T cells subsequent to their priming by activated antigen presenting cells . This suggests that “upstream” immunologic events (such as the stimulation of antigen presenting machinery) occur at baseline, resulting in primed anti-tumor T cells that are, in turn, made capable of controlling tumor growth upon treatment with immune checkpoint blockade. It is thus tempting to speculate that such events (resulting in effective antigen presentation) could be used to screen candidates for immunotherapy in the future. Our results on treatment response to the anti-PD-1 mAb nivolumab (Fig. 8) suggest the hypothesis that a pre-treatment analysis of antigen presenting machinery, and the corresponding T cell infiltrate, could be one method of achieving this. Given that PD-1 blocking mAbs are approved for a growing list of diverse cancers, such results could be applicable well beyond ccRCC.
Unsupervised clustering of ccRCC tumors using immune infiltration levels revealed three clusters of differentially infiltrated tumors, which were subsequently validated in an independent cohort. In particular, we found that the T cell enriched cluster was characterized by high expression levels of immune-response related genes including the immune checkpoint genes PD-1, PD-L1, and CTLA-4. Interestingly, a recent study also identified an aggressive, sunitinib-resistant molecular subtype of metastatic ccRCC with cellular and molecular characteristics similar to the T cell enriched tumors discovered here . These findings across several cohorts of ccRCC patients suggest that a subset of ccRCC tumors may be both highly immune-infiltrated and immunosuppressed, as indicated by elevated expression of immune-checkpoint surface markers. Our findings also underscore the prognostic significance of specific T cell subsets, consistent with previous tissue-based studies of ccRCC and other tumor types .
Our in-depth analysis including driver mutations, CNVs, mutation burden, and neo-antigens was not able to identify any molecular mechanisms for the differential immune infiltration in ccRCC clusters. However, the lack of association between immune infiltration and predicted MHC-I binding tumor neo-antigens does not rule out neo-antigens as a driver of immune infiltration. Further, computational techniques for the prediction of immunogenic neo-antigens are not yet mature: most studies focusing on immunogenic epitopes remedy this shortcoming by using a combination of computational, biochemical, and cellular techniques. Others have suggested that the clonality of neo-antigens may drive immune recognition  and we consistently observed an inverse correlation between intratumor heterogeneity and immune infiltration in multiple datasets. An important caveat of the clonality analysis is that spatially segregated clones cannot be identified in the TCGA dataset. Overall, our results suggest that genetic alterations, mutation burden, and predicted neo-antigens currently provide an incomplete explanation for the degree of immune infiltration in ccRCC.
Our results illustrate the utility of ssGSEA for inferring immune infiltration levels in tumor specimens. The methodology in this study could directly be extended to the investigation of immune infiltration and its potential drivers in other tumor types and in various clinical settings including response to checkpoint blockade.
In this study, we report that ccRCC is the most highly T cell infiltrated tumor type when compared with 18 other malignancies, and that the TIS as well as the expression levels of MHC class I APM have potential utility as biomarkers of response to PD-1 blockade therapy. It has previously been shown that ccRCC is an exception to the rule among immunotherapeutically responsive cancer types in that ccRCC has only a modest mutation load . Here, we show for the first time that another unique feature of ccRCC is the upregulation of APM expression in tumor samples compared to adjacent normal tissue.
Our finding that the high T cell infiltration in the tumor persists throughout different geographic regions has possible translational relevance in terms of relying on a single core biopsy to characterize a tumor immune profile. We also present evidence that immune infiltration is negatively associated with number of subclones (lower ITH) in ccRCC, a finding consistent with a recent study  that observed the same phenomenon in lung carcinomas.
Ultimately, our approach enables the determination of a diverse array of immune infiltration patterns from small amounts of tissue such as biopsy samples; a strategy which could easily be incorporated into the clinical and trial setting.
Gene and protein expression data
The pancan normalized gene-level RNA-Seq data for the TCGA cohorts were downloaded from the UC Santa Cruz Cancer Genomics Browser  (https://genome-cancer.ucsc.edu/). These cohorts consisted of adrenocortical cancer (ACC, N tumor = 79, N normal = 0), bladder urothelial carcinoma (BLCA, N tumor = 407, N normal = 19), lower grade glioma (LGG, N tumor = 530, N normal = 0), breast invasive carcinoma (BRCA, N tumor = 1097, N normal = 113), cervical and endocervical cancer (CESC, N tumor = 305, N normal = 3), colon and rectum adenocarcinoma (COADREAD, N tumor = 383, N normal = 50), glioblastoma multiforme (GBM, N tumor = 167, N normal = 5), head and neck squamous cell carcinoma (HNSC N tumor = 521, N normal = 43), kidney chromophobe (KICH, N tumor = 66, N normal = 25), kidney clear cell carcinoma (KIRC, N tumor = 530, N normal = 72), kidney papillary cell carcinoma (KIRP, N tumor = 291, N normal = 32), liver hepatocellular carcinoma (LIHC, N tumor = 373, N normal = 50), lung adenocarcinoma (LUAD, N tumor = 510, N normal = 58), lung squamous cell carcinoma (LUSC, N tumor = 502, N normal = 51), ovarian serous cystadenocarcinoma (OVCA, N tumor = 266, N normal = 0), prostate adenocarcinoma (PRAD, N tumor = 498, N normal = 52), skin cutaneous melanoma (SKCM, N tumor = 472, N normal = 1), thyroid carcinoma (THCA, N tumor = 513, N normal = 59), and uterine carcinosarcoma (UCS, N tumor = 57, N normal = 0).
TCGA ccRCC-specific analyses were performed with the KIRC datasets downloaded from Firebrowse (http://firebrowse.org). RSEM-normalized gene level data and reverse phase protein array (RPPA) data were used for gene and protein expression analyses, respectively. Samples that had RNA-Seq, mutation and clinical data (n = 415) were included in the discovery phase of the immune infiltration clusters.
The Sato et al.  Agilent microarray gene expression dataset was downloaded from ArrayExpress (http://www.ebi.ac.uk/arrayexpress/experiments/E-MTAB-1980/) and all samples (n = 101) were included in the analysis. The probe identifiers in the Agilent platform were mapped to HGNC gene symbols and the arithmetic mean across identifiers was used for cases where multiple Agilent identifiers mapped to a single HGNC symbol.
The Gerlinger et al.  Affymetrix Human Gene 1.0 ST microarray gene expression dataset was obtained via personal communication with the authors on 10 November 2014. This dataset includes 56 tumor and six normal samples from nine ccRCC patients. All samples were included in our analysis. The probe sets in this Affymetrix platform were mapped to HGNC gene symbols and the geometric mean across probe sets was used for cases where multiple probe sets mapped to a single HGNC symbol.
Pre-treatment biopsies of six metastatic ccRCC patients were obtained and RNA-Seq datasets were generated. Reads were aligned with TopHat . Gene quantification was performed with RNA-SeQC . Stratification of the patients was based on objective response to nivolumab by RECIST criteria.
TCGA mutation data
PANCAN mutation calls were downloaded from the BROAD Firehose’s stddata_2015_02_04 dataset (http://gdac.broadinstitute.org/). Additional COADREAD mutation calls were obtained from the MSKCC cBio portal  via personal communication. These mutation calls were used for all analyses, excluding neo-antigen analysis.
Clinical data for the TCGA dataset were obtained from the supplementary files of the ccRCC marker paper  (KIRC + Clinical + Data + Jul-31-2012). Vital status was determined from the field “Composite Vital status.” Clinical data for the SATO dataset were obtained through direct communication with the authors. Purity values for SATO samples were computed based on the levels of chromosome 3p loss.
Marker genes for immune cell types were obtained from Bindea et al. . Angiogenesis marker genes were obtained from Masiero et al. . A signature of antigen presentation was created based on genes exclusively involved in processing and presentation of antigens on MHC . All signature genes are listed in Additional file 2: Table S1.
Implementation of ssGSEA
Infiltration levels for immune cell types and activity levels for angiogenesis and antigen presentation were quantified using the ssGSEA  implementation in R package gsva . ssGSEA is a rank-based method that computes an overexpression measure for a gene list of interest relative to all other genes in the genome. Normalized RNA-Seq or microarray datasets mentioned above were provided as input without further processing (i.e. no standardization or log transformation). A typical execution is gsva(data, list_of_signatures, method=”ssgsea”). The output for each signature is a near-Gaussian list of decimals that can be used in visualization/statistical analysis without further processing.
Aggregate TIS and IIS scores
The ssGSEA scores for each individual immune cell type were standardized across all tumor and normal samples in the investigated 19 tumor types (n = 8200). The TIS was defined as the mean of the standardized values for the following T cell subsets: CD8 T, T helper, T, T central and effector memory, Th1, Th2, Th17, and Treg cells. T gamma delta and T follicular helper cells were excluded from TIS and IIS because public gene expression maps from healthy tissues show that certain genes in the T gamma delta signature (C1orf61, FEZ1) and the T follicular helper signature (B3GAT1, HEY1, CHGB, CDK5R1) are expressed at elevated levels in healthy brain tissue , which is consistent with previous studies that reported the expression of some T cell specific genes in healthy brain .
The overall immune infiltration score for a sample was similarly defined as the mean of the standardized values for macrophages, DC subsets (total, plasmacytoid, immature, activated), B cells, cytotoxic cells, eosinophils, mast cells, neutrophils, NK cell subsets (total, CD56bright, CD56dim), and all T cell subsets used in the computation of TIS.
Flow cytometry and RNA-Seq profiling for in vitro validation of gene signatures
We obtained ccRCC patient specimens at MSKCC and sorted tumor-associated macrophages (n = 4), NK CD16+ cells (n = 2), CD8+ T cells (n = 5), and CD4+ T cells (n = 3) using the sorting markers CD45+ CD3– CD56– CD14+, CD45+ CD3– CD56+ CD16+, CD45+ CD3+ CD8+, and CD45+ CD3+ CD4+, respectively. CD45– non-immune cells were also sorted from one ccRCC specimen. The antibodies used for cell sorting were: CD14 (HCD14; Biolegend #325608), CD8a (HIT8a; Biolegend #300926), CD45 (2D1; eBioscience 11-9459-42), CD4 (SK3; eBioscience 8048-0047-025), CD16 (3G8; Biolegend 302008), CD56 (HCD56; Biolegend 318318), and CD3 (7D6; Invitrogen MHCD0317).
RNA-Seq data for each sample were generated using an Ion Proton system. FASTQ files were mapped to the target genome using the rnaStar aligner  that maps reads genomically and resolves reads across splice junctions. We used the two-pass mapping method outlined in Engström et al.  in which the reads are mapped twice. The first mapping pass uses a list of known annotated junctions from Ensemble. Novel junctions found in the first pass are then added to the known junctions and a second mapping pass is done. After mapping, we computed the expression count matrix from the mapped reads using HTSeq  and one of several possible gene model databases. The raw count matrix generated by HTSeq was then normalized using the R/Bioconductor package DESeq .
This dataset is deposited in Gene Expression Omnibus with accession number GSE84697.
Multiplex immunofluorescence staining and RNA-seq profiling for in vitro validation of immune cell scores
Unstained pathologic slides of 10 renal tumors from previously untreated patients who underwent either radical or partial nephrectomy for sporadic, resectable ccRCC were obtained and reviewed by a genitourinary pathologist. Paraffin-embedded tissue sections were de-waxed with xylene and rehydrated by gradient ethanol solutions. Antigen retrieval was then performed and the sections were subsequently blocked by bovine serum albumin plus serum with the addition of mouse monoclonal anti-human CD8 (Dako, clone C8/144B, catalogue #M7103 ), CD56 (Thermo scientific, clone 56C04, catalogue #MS-1149-P1 ) and FOXP3 (Abcam, clone 236A/E7, catalogue #ab20034 ). The sections were incubated with HRP-conjugated anti-mouse antibodies. TSA plus kits (Perkin Elmer) were used according to the manufacturer’s instructions. Finally, a Leica upright confocal microscope was used to capture images. In order to quantify the degree of cellular infiltration, the individual positive cells for CD56, CD8, and FOXP3 were counted in three representative regions of each tumor. The ratio of CD56, CD8, and FOXP3 positive cells versus total cells (DAPI-stained) were determined.
RNA-Seq was performed for all samples and raw output BAMs were converted back to FASTQ using PICARD Sam2Fastq. Maps were then mapped to the human genome using STAR aligner . The genome used was HG19 with junctions from ENSEMBL (GRCh37.69_ENSEMBL) and a read overhang of 49. Then any unmapped reads were mapped to HG19 using BWA MEM (version 0.7.5a). The two mapped BAMs were then merged and sorted and gene level counts were computed using htseq-count (options -s y -m intersection-strict) and the same gene models as used in the mapping step . This dataset was previously deposited in Gene Expression Omnibus with accession number GSE74734 .
In silico validation of the ssGSEA immune cell scoring methodology using simulated mixing proportions
- (1)Generating reference mRNA expression vectors for tumor-infiltrating immune cells
Few expression profiles of tumor-infiltrating immune cell populations exist in the literature. Thus, we utilized the four key immune cell populations and one non-immune cell population (CD45–) we sorted from ccRCC tumor specimens, performed RNA-Seq, and generated novel reference mRNA expression vectors defined as the mean of the RNA-Seq readout for each gene across the samples (4 macrophage, 2 NK CD16+, 5 CD8+ T, 3 CD4+ T samples, and 1 CD45– non-immune sample).
- (2)Generating in silico mixtures with simulated mixing proportions:
The “clean” dataset
The cell types that we have a reference gene expression vector for are macrophages, NK cells, CD8+, and CD4+ T cells, and the non-immune CD45– cells. An in silico mixture that would realistically simulate the gene expression profile of the tumor microenvironment can be obtained by linearly combining the immune cell reference expression vectors with that of non-immune CD45– cells. We created 200 such in silico mixture samples by randomly generating mixing proportions from a Uniform(0,1) distribution (point (5) below) and then computing linear combinations of 20,032 genes in the reference expression vectors of the five cell types. This dataset of 200 in silico samples and 20,032 genes constitutes the noiseless dataset that will be referred to as the “clean” dataset from here on.
The “noisy” datasets
Since the RNA-Seq readout from a tumor specimen may include both biological and technical noise, we tested the performance of our decomposition pipeline in “noisy” datasets as well as in the “clean” dataset. We tested 10 different noise levels ranging from a slightly noisy SNR of 10:1 to an extremely noisy setting of SNR 1:1. For an S:1 noise level, we added Gaussian noise to each gene in a “clean” sample with mean 0 and standard deviation equal to the mRNA readout of the gene divided by S. Each one of the 10 noisy datasets again has 200 samples and 20,032 genes.
- (3)Measuring the performance of the ssGSEA methodology:
We implemented our ssGSEA decomposition pipeline on both the “clean” and the noisy datasets with the signatures for “macrophages,” “NK cells,” “CD8 + T cells,” and “T helper cells.” The Bindea et al.  signature set did not have a signature for CD4+ T cells, but had an umbrella signature for T helper cells that would be valid for all CD4+ T cells. We then computed the Spearman correlation between the inferred levels (ssGSEA scores) of these cell types in the 200 samples and the known mixing proportions from the simulations. Note that the decomposition on even the “clean” dataset has an “impurity” component as the expression from CD45– cells is also integrated into the mixture samples. The Spearman correlations were stable and above 0.6 for all four cell types in a long SNR range from 9:1 to 4:1 (Fig. 2a).
Comparing the four cell types, the correlation values are the highest for NK cells (greater than 0.8 until SNR 4:1) and the lowest for CD4+ T cells. The high number of polarization and activation states in the sorted CD4+ T cells might be creating challenges against obtaining a CD4+ reference expression profile that will universally be highly robust. However, the deficiency in performance is only in relation to the other three cell types; the bootstrap p values for the CD4+ T cell Spearman correlations are statistically significant (α = 0.05) as explained below.
- (4)Obtaining bootstrap p values for the observed Spearman correlations:
Even though the point estimates for the Spearman correlations as computed in point (2) above remain high in noisy settings, this does not provide information regarding the significance of the point estimates. To this end, we simulated an empirical null distribution for these correlation values by generating 1000 random gene signatures for each one of the four cell types (macrophages, NK cells, CD8+ T cells, and T helper cells) for a total of 4000 random signatures. The number of genes in each random signature was equal to the number of genes in the corresponding “real” signature. Thus, each random signature for macrophages, NK cells, CD8+ T cells, and T helper cells, respectively, contained 33, 35, 37, and 24 genes randomly chosen from the 20,032 genes in the RNA-Seq dataset.
We next ran ssGSEA on both the “clean” and the noisy datasets 1000 times, where each run was performed with a different set of random signatures for the four cell types. Thus, each run yielded 200 inferred values for a particular cell type, which were then used to compute the Spearman correlation with the true mixing proportions. The 1000 Spearman correlations obtained in this way formed the empirical null distribution for that cell type. The p value for each observed Spearman correlation was computed as the fraction of correlations from random signatures that were as large as or larger than the observed correlation (Additional file 1: Figure S23).
- (5)The algorithm for generating mixing proportions:
Objective: Simulate five random numbers that follow the Uniform(0,1) distribution and sum to 1.
Note: If X ~ U(0,1), then PDF(x) = 1 and CDF(x) = x
Step 1: Generate four random numbers from CDF(x), i.e. U(0,1).
Step 2: Sort the four random numbers in ascending fashion
Step 3: Compute the differences between consecutive numbers (three difference values for four random numbers)
Return: The smallest random number is the first mixing proportion. The differences between consecutive random numbers form mixing proportions 2, 3, and 4. The last mixing proportion is the difference between 1 and the largest random number.
Orthogonal validation of IIS with methylation-based leukocyte fractions
We estimated the fraction of leukocytes using the assumption that the beta value of a tumor sample i in a DNA methylation probe k is a weighted arithmetic mean of representative values from (1) leukocytes and (2) cancer cells. To make the estimation more robust, we accounted only for those probes (the leukocyte methylation signature) where the leukocyte and tumor methylation difference was extreme. We used a similar approach as described in Carter et al. . All probes were ranked by the difference between mean beta values in leukocyte and tumor samples. The leukocyte methylation signature consisted of the top 1000 probes Lh (leukocyte high methylated probes) and the bottom 1000 probes Ll (leukocyte low methylated probes).
Let Tik denote the beta value for a probe k in a tumor sample i. Let Bk be a representative value of leukocyte methylation and equal the average beta value of leukocyte samples for each probe. Let Tk be a representative value of tumor methylation and equal the minimum observed beta value across all tumor samples for the Lh probes and the maximum for the Ll probes. Thus Tk represents the methylation level of the theoretically purest tumor sample. Then, the fraction f ik of the leukocyte component for sample i and probe k is given by the following: Tik = Bkf ik + Tk(1 - f ik ), hence f ik = (Tik - Tk)/(Bk - Tk). The leukocyte fraction f i for a sample is then calculated as the mode (e.g. argmax of the density) of the estimated distribution of all f ik for the leukocyte methylation signature. The reference DNA methylation levels for leukocytes were derived by Reinius et al.  from the DNA methylation profile of peripheral blood mononuclear cells (PBMCs) in six healthy donors.
Principal component test for Bindea et al. signatures
PC separation of all immune cell types: we reduced the GCRMA-normalized dataset to the signature genes by mapping the Affymetrix U133A probeset identifiers to HGNC symbols with the R biomaRt package  and filtering out the zero variance probesets. A total of 840 probesets remained, corresponding to the 501 unique genes used in the immune cell signatures. A PCA on the normalized and reduced dataset revealed batch effects from the three data sources (Additional file 1: Figure S3, top panel). We corrected for batch effects using the non-parametric option in ComBat  (Additional file 1: Figure S3, bottom panel) and subsequently performed PCA on the 46 samples to investigate the separation of immune cell types by the first two PCs (Fig. 1a).
PC separation of six T cell subpopulations: we reduced the GCRMA-normalized dataset to the 19 T cell subpopulation samples and only the T cell related signature genes in a similar manner to point (1). A total of 400 probesets remained, corresponding to the 225 unique T cell subpopulation signature genes. Batch effects were corrected using the non-parametric option in ComBat  and PCA was subsequently performed on the 19 samples to investigate the separation of T cell subpopulations (Additional file 1: Figure S5).
Comparison between CIBERSORT and ssGSEA immune scores
We obtained CIBERSORT values for the TCGA KIRC cohort using the web tool https://cibersort.stanford.edu/ on 26 August 2016. The RNA-Seq dataset was provided as input and the algorithm was run with 1000 permutations (the highest option available). The quantile normalization (QN) option was disabled as the RSEM pipeline for TCGA RNA-Seq datasets included QN. Samples with a global p value > 0.05 were removed and the remaining 194 samples were used in the comparison with ssGSEA. We calculated the Pearson correlation between Bindea et al. signatures and CIBERSORT values for all relevant cell types (Additional file 2: Table S9).
The number of subclones for TCGA and SATO ccRCC samples was calculated using the R package SciClone (version 1.0.7)  with default parameters. For SATO samples, the depth of coverage was assumed to be at least 100×. Three of the SATO samples had an insufficient number of copy-number neutral variants.
HLA typing and HLA-binding neoepitope prediction
Whole-exome sequences for the TCGA KIRC tumors were downloaded using cgquery (https://gdc.cancer.gov/). Whole-exome sequences for the SATO dataset were downloaded from the European Genome-phenome Archive (https://www.ebi.ac.uk/ega/studies/EGAS00001000509). BAM files containing whole-exome sequences from normal and/or tumor samples were processed to obtain fastq files. Reads that aligned to HLA-A, HLA-B, or HLA-C genes using RazerS3  (http://www.seqan.de/projects/razers/) were passed as input to OptiType v1.0  (https://github.com/FRED-2/OptiType). Discrepancies in HLA typing were resolved by consensus or exclusion. A MAF files containing missense mutations for each TCGA patient was obtained from cBioPortal (http://www.cbioportal.org/). A MAF file containing missense mutations for each SATO patient was obtained from the publication . Samtools (v 0.1.19) and snpEff (v3. 5C) were used to identify the protein context surrounding each missense mutation from a canonical set of human transcripts in (Hg GRCh37.74). All 9 and 10-mers overlapping the missense mutations were extracted and NetMHCPan  was used to predict their affinity to alleles of MHC-I.
Two-sided Mann–Whitney and Fisher’s exact tests were performed with the R functions wilcox.test and fisher.test, respectively. These tests are appropriate as they are non-parametric (distribution-free). One-way ANOVA tests were performed with the R function aov for purity, stromal infiltration, and immune infiltration scores. This test is appropriate as the variance of the scores is similar between the immune infiltration clusters and ssGSEA scores from gsva  are approximately normal. P values were adjusted for multiple hypothesis testing using the R function p.adjust with the “fdr” option.
The unsupervised clustering for tumor samples, immune cell types, genes, and proteins was performed with hierarchical clustering, Ward linkage, and Euclidean distance.
Random forest prediction of immune infiltration class for SATO patients
A random forest classifier was trained on the TCGA cohort of 415 patients with 10,000 trees and otherwise default values in the R package randomForest . Training error on the TCGA cohort was 0%. This classifier was applied to the ssGSEA scores of the SATO and GERLINGER cohorts to obtain class predictions. The random forest R object and the code to predict the class of a new sample are available upon request.
P values in Fig. 6b were obtained from univariate Cox proportional-hazards regression models using the R package survival. Chi-square test statistics in Kaplan–Meier curves (Fig. 6a, c, Additional file 1: Figure S15c) were computed using log-rank tests.
Ratio of cell counts
ssGSEA-based infiltration scores do not follow a discrete count distribution, but are unimodal and approximately normal . Therefore, ratios of cell counts cannot be determined by simple division of the ssGSEA scores. However, if a and b represent two cell counts, the log of the ratio a/b is equal to log(a) – log(b). Thus, the difference of two ssGSEA scores represents a ratio of cell counts. The CD8+ T/Treg and Th17/Th2 ratios in Fig. 6b and c denote the numeric difference between the ssGSEA scores for these cell types.
AAH was supported by the MSKCC Department of Surgery Faculty Research Award. AGW was supported by the Stephen P. Hanson Family Fund Fellowship in Kidney Cancer. AAH, AGW, SDK, PR, and JAC were supported by the Sidney Kimmel Center for Prostate and Urologic Cancers. RSG was supported by a Ruth L. Kirschstein F30 individual fellowship from the NCI (F30 CA200327-02) and a Medical Scientist Training Program grant from the National Institute of General Medical Sciences of the National Institutes of Health under award number: T32GM007739 to the Weill Cornell/Rockefeller/Sloan-Kettering Tri-Institutional MD-PhD Program. IO was supported in part by the Core Grant P30 CA008748. YBC was supported by Cycle for Survival of MSKCC. LD was supported by RBRF (13-04-40279-H). DAS was supported by RO1CA55349 and P01CA23766. SDK was supported by T32CA082088-15. MOL was supported by MSK Translational Kidney Cancer Research Program and Geoffrey Beene Cancer Research Center. CS and YŞ were supported by NRNB P41GM103504 and GDAC U24CA143840.
Availability of data and materials
The ImmunExplorer web application is available at http://kidneyimmune.chenghsiehlab.org/.
The RNA-Seq dataset from tumor-associated sorted immune cell populations is deposited in Gene Expression Omnibus with accession number GSE84697.
Study design: AAH, CS, JJH, YS, AGW. DAS, MOL. Data collection: YS, RSG, AGW, ML, EMVA, GDV. DM, NW, WL, BJM, SDK, YC, LD, MHV, JAC, PR, VER, TAC, EHC, TKC. Data analysis: YS, RSG, AGW, ML, DM, IO, ED, AL, BJM. Writing manuscript: YS, RSG, AGW, DNK, AAH, CS, JJH, DAS, MOL. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Ethics approval and consent to participate
Institutional review board approved the study (protocol IRB #89-076) and all patients have given written informed consent prior to inclusion in the project. Experimental methods in this study comply with the Declaration of Helsinki.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Nishikawa H, Sakaguchi S. Regulatory T cells in cancer immunotherapy. Curr Opin Immunol. 2014;27:1–7.View ArticlePubMedGoogle Scholar
- Noy R, Pollard JW. Tumor-associated macrophages: from mechanisms to therapy. Immunity. 2014;41:49–61.View ArticlePubMedPubMed CentralGoogle Scholar
- De Palma M, Lewis CE. Macrophage regulation of tumor responses to anticancer therapies. Cancer Cell. 2013;23:277–86.View ArticlePubMedGoogle Scholar
- Galon J, Costes A, Sanchez-Cabo F, Kirilovsky A, Mlecnik B, Lagorce-Pages C, et al. Type, density, and location of immune cells within human colorectal tumors predict clinical outcome. Science. 2006;313:1960–4.View ArticlePubMedGoogle Scholar
- Galon J, Fridman WH, Pages F. The adaptive immunologic microenvironment in colorectal cancer: a novel perspective. Cancer Res. 2007;67:1883–6.View ArticlePubMedGoogle Scholar
- Pages F, Kirilovsky A, Mlecnik B, Asslaber M, Tosolini M, Bindea G, et al. In situ cytotoxic and memory T cells predict outcome in patients with early-stage colorectal cancer. J Clin Oncol. 2009;27:5944–51.View ArticlePubMedGoogle Scholar
- Tumeh PC, Harview CL, Yearley JH, Shintaku IP, Taylor EJ, Robert L, et al. PD-1 blockade induces responses by inhibiting adaptive immune resistance. Nature. 2014;515:568–71.View ArticlePubMedPubMed CentralGoogle Scholar
- Gajewski TF, Schreiber H, Fu Y-X. Innate and adaptive immune cells in the tumor microenvironment. Nat Immunol. 2013;14:1014–22.View ArticlePubMedPubMed CentralGoogle Scholar
- van Rooij N, van Buuren MM, Philips D, Velds A, Toebes M, Heemskerk B, et al. Tumor exome analysis reveals neoantigen-specific T-cell reactivity in an ipilimumab-responsive melanoma. J Clin Oncol. 2013;31:e439–42.View ArticlePubMedGoogle Scholar
- Snyder A, Makarov V, Merghoub T, Yuan J, Zaretsky JM, Desrichard A, et al. Genetic basis for clinical response to CTLA-4 blockade in melanoma. N Engl J Med. 2014;371:2189–99.View ArticlePubMedPubMed CentralGoogle Scholar
- Rizvi NA, Hellmann MD, Snyder A, Kvistborg P, Makarov V, Havel JJ, et al. Mutational landscape determines sensitivity to PD-1 blockade in non-small cell lung cancer. Science. 2015;348:124–8.View ArticlePubMedPubMed CentralGoogle Scholar
- Neefjes J, Jongsma ML, Paul P, Bakke O. Towards a systems understanding of MHC class I and MHC class II antigen presentation. Nat Rev Immunol. 2011;11:823–36.PubMedGoogle Scholar
- Rooney MS, Shukla SA, Wu CJ, Getz G, Hacohen N. Molecular and genetic properties of tumors associated with local immune cytolytic activity. Cell. 2015;160:48–61.View ArticlePubMedPubMed CentralGoogle Scholar
- Bindea G, Mlecnik B, Tosolini M, Kirilovsky A, Waldner M, Obenauf AC, et al. Spatiotemporal dynamics of intratumoral immune cells reveal the immune landscape in human cancer. Immunity. 2013;39:782–95.View ArticlePubMedGoogle Scholar
- Yoshihara K, Shahmoradgoli M, Martinez E, Vegesna R, Kim H, Torres-Garcia W, et al. Inferring tumour purity and stromal and immune cell admixture from expression data. Nat Commun. 2013;4:2612.View ArticlePubMedPubMed CentralGoogle Scholar
- Newman AM, Liu CL, Green MR, Gentles AJ, Feng W, Xu Y, et al. Robust enumeration of cell subsets from tissue expression profiles. Nat Methods. 2015;12:453–7.View ArticlePubMedPubMed CentralGoogle Scholar
- Gong T, Szustakowski JD. DeconRNASeq: a statistical framework for deconvolution of heterogeneous tissue samples based on mRNA-Seq data. Bioinformatics. 2013;29:1083–5.View ArticlePubMedGoogle Scholar
- Thompson RH, Dong H, Lohse CM, Leibovich BC, Blute ML, Cheville JC, et al. PD-1 is expressed by tumor-infiltrating immune cells and is associated with poor outcome for patients with renal cell carcinoma. Clin Cancer Res. 2007;13:1757–61.View ArticlePubMedGoogle Scholar
- Janiszewska AD, Poletajew S, Wasiutynski A. Spontaneous regression of renal cell carcinoma. Contemp Oncol (Pozn). 2013;17:123–7.Google Scholar
- Atkins MB, Regan M, McDermott D. Update on the role of interleukin 2 and other cytokines in the treatment of patients with stage IV renal carcinoma. Clin Cancer Res. 2004;10:6342s–6.View ArticlePubMedGoogle Scholar
- Escudier B. Emerging immunotherapies for renal cell carcinoma. Ann Oncol. 2012;23 Suppl 8:viii35–40.View ArticlePubMedGoogle Scholar
- Topalian SL, Hodi FS, Brahmer JR, Gettinger SN, Smith DC, McDermott DF, et al. Safety, Activity, and Immune Correlates of Anti–PD-1 Antibody in Cancer. N Engl J Med. 2012;366:2443–54.View ArticlePubMedPubMed CentralGoogle Scholar
- Herbst RS, Soria J-C, Kowanetz M, Fine GD, Hamid O, Gordon MS, et al. Predictive correlates of response to the anti-PD-L1 antibody MPDL3280A in cancer patients. Nature. 2014;515:563–7.View ArticlePubMedPubMed CentralGoogle Scholar
- Gubin MM, Zhang X, Schuster H, Caron E, Ward JP, Noguchi T, et al. Checkpoint blockade cancer immunotherapy targets tumour-specific mutant antigens. Nature. 2014;515:577–81.View ArticlePubMedPubMed CentralGoogle Scholar
- Igarashi T, Takahashi H, Tobe T, Suzuki H, Mizoguchi K, Nakatsu HO, et al. Effect of tumor-infiltrating lymphocyte subsets on prognosis and susceptibility to interferon therapy in patients with renal cell carcinoma. Urol Int. 2002;69:51–6.View ArticlePubMedGoogle Scholar
- Yadav M, Jhunjhunwala S, Phung QT, Lupardus P, Tanguay J, Bumbaca S, et al. Predicting immunogenic tumour mutations by combining mass spectrometry and exome sequencing. Nature. 2014;515:572–6.View ArticlePubMedGoogle Scholar
- Lawrence MS, Stojanov P, Polak P, Kryukov GV, Cibulskis K, Sivachenko A, et al. Mutational heterogeneity in cancer and the search for new cancer-associated genes. Nature. 2013;499:214–8.View ArticlePubMedPubMed CentralGoogle Scholar
- The Cancer Genome Atlas Research Network. Comprehensive molecular characterization of clear cell renal cell carcinoma. Nature. 2013;499:43–9.View ArticlePubMed CentralGoogle Scholar
- Sato Y, Yoshizato T, Shiraishi Y, Maekawa S, Okuno Y, Kamura T, et al. Integrated molecular analysis of clear-cell renal cell carcinoma. Nat Genet. 2013;45:860–7.View ArticlePubMedGoogle Scholar
- Barbie DA, Tamayo P, Boehm JS, Kim SY, Moody SE, Dunn IF, et al. Systematic RNA interference reveals that oncogenic KRAS-driven cancers require TBK1. Nature. 2009;462:108–12.View ArticlePubMedPubMed CentralGoogle Scholar
- Chtanova T, Newton R, Liu SM, Weininger L, Young TR, Silva DG, et al. Identification of T cell-restricted genes, and signatures for different T cell responses, using a comprehensive collection of microarray datasets. J Immunol. 2005;175:7837–47.View ArticlePubMedGoogle Scholar
- Hyrcza MD, Kovacs C, Loutfy M, Halpenny R, Heisler L, Yang S, et al. Distinct transcriptional profiles in ex vivo CD4+ and CD8+ T cells are established early in human immunodeficiency virus type 1 infection and are characterized by a chronic interferon response as well as extensive transcriptional changes in CD8+ T cells. J Virol. 2007;81:3477–86.View ArticlePubMedPubMed CentralGoogle Scholar
- Wendt K, Wilk E, Buyny S, Buer J, Schmidt RE, Jacobs R. Gene and protein characteristics reflect functional diversity of CD56dim and CD56bright NK cells. J Leukoc Biol. 2006;80:1529–41.View ArticlePubMedGoogle Scholar
- Wu Z, Irizarry RA, Gentleman R, Martinez-Murillo F, Spencer F. A model-based background adjustment for oligonucleotide expression arrays. J Am Stat Assoc. 2004;99:909–17.View ArticleGoogle Scholar
- Johnson WE, Li C, Rabinovic A. Adjusting batch effects in microarray expression data using empirical Bayes methods. Biostatistics. 2007;8:118–27.View ArticlePubMedGoogle Scholar
- Carter SL, Cibulskis K, Helman E, McKenna A, Shen H, Zack T, et al. Absolute quantification of somatic DNA alterations in human cancer. Nat Biotechnol. 2012;30:413–21.View ArticlePubMedPubMed CentralGoogle Scholar
- Brown SD, Raeburn LA, Holt RA. Profiling tissue-resident T cell repertoires by RNA sequencing. Genome Med. 2015;7:125.View ArticlePubMedPubMed CentralGoogle Scholar
- Matsushita H, Vesely MD, Koboldt DC, Rickert CG, Uppaluri R, Magrini VJ, et al. Cancer exome analysis reveals a T-cell-dependent mechanism of cancer immunoediting. Nature. 2012;482:400–4.View ArticlePubMedPubMed CentralGoogle Scholar
- Mlecnik B, Bindea G, Angell HK, Maby P, Angelova M, Tougeron D, et al. Integrative analyses of colorectal cancer show immunoscore is a stronger predictor of patient survival than microsatellite instability. Immunity. 2016;44:698–711.View ArticlePubMedGoogle Scholar
- Dunn GP, Old LJ, Schreiber RD. The three Es of cancer immunoediting. Annu Rev Immunol. 2004;22:329–60.View ArticlePubMedGoogle Scholar
- Masiero M, Simões Filipa C, Han Hee D, Snell C, Peterkin T, Bridges E, et al. A core human primary tumor angiogenesis signature identifies the endothelial orphan receptor ELTD1 as a key regulator of angiogenesis. Cancer Cell. 2013;24:229–41.View ArticlePubMedPubMed CentralGoogle Scholar
- Folkman J. Angiogenesis in cancer, vascular, rheumatoid and other disease. Nat Med. 1995;1:27–30.View ArticlePubMedGoogle Scholar
- Baldewijns MM, van Vlodrop IJH, Vermeulen PB, Soetekouw PMMB, van Engeland M, de Bruïne AP. VHL and HIF signalling in renal cell carcinogenesis. J Pathol. 2010;221:125–38.View ArticlePubMedGoogle Scholar
- da Huang W, Sherman BT, Lempicki RA. Systematic and integrative analysis of large gene lists using DAVID bioinformatics resources. Nat Protoc. 2009;4:44–57.View ArticleGoogle Scholar
- Zhu Q, Kim YH, Wang D, Oh SP, Luo K. SnoN facilitates ALK1-Smad1/5 signaling during embryonic angiogenesis. J Cell Biol. 2013;202:937–50.View ArticlePubMedPubMed CentralGoogle Scholar
- Icli B, Wara AK, Moslehi J, Sun X, Plovie E, Cahill M, et al. MicroRNA-26a regulates pathological and physiological angiogenesis by targeting BMP/SMAD1 signaling. Circ Res. 2013;113:1231–41.View ArticlePubMedPubMed CentralGoogle Scholar
- Sun L, Hui A-M, Su Q, Vortmeyer A, Kotliarov Y, Pastorino S, et al. Neuronal and glioma-derived stem cell factor induces angiogenesis within the brain. Cancer Cell. 2006;9:287–300.View ArticlePubMedGoogle Scholar
- Elmasri H, Ghelfi E, Yu C-W, Traphagen S, Cernadas M, Cao H, et al. Endothelial cell-fatty acid binding protein 4 promotes angiogenesis: role of stem cell factor/c-kit pathway. Angiogenesis. 2012;15:457–68.View ArticlePubMedPubMed CentralGoogle Scholar
- Patruno R, Marech I, Zizzo N, Ammendola M, Nardulli P, Gadaleta C, et al. C-Kit expression, angiogenesis, and grading in canine mast cell tumour: a unique model to study C-Kit driven human malignancies. Biomed Res Int. 2014;2014:8.View ArticleGoogle Scholar
- Bindea G, Mlecnik B, Hackl H, Charoentong P, Tosolini M, Kirilovsky A, et al. ClueGO: a Cytoscape plug-in to decipher functionally grouped gene ontology and pathway annotation networks. Bioinformatics. 2009;25:1091–3.View ArticlePubMedPubMed CentralGoogle Scholar
- Ren G, Zhao X, Wang Y, Zhang X, Chen X, Xu C, et al. CCR2-dependent recruitment of macrophages by tumor-educated mesenchymal stromal cells promotes tumor development and is mimicked by TNFα. Cell Stem Cell. 2012;11:812–24.View ArticlePubMedPubMed CentralGoogle Scholar
- Kryczek I, Banerjee M, Cheng P, Vatan L, Szeliga W, Wei S, et al. Phenotype, distribution, generation, and functional and clinical relevance of Th17 cells in the human tumor environments. Blood. 2009;114:1141–9.View ArticlePubMedPubMed CentralGoogle Scholar
- Li L, Yang C, Zhao Z, Xu B, Zheng M, Zhang C, et al. Skewed T-helper (Th)1/2- and Th17/T regulatorycell balances in patients with renal cell carcinoma. Mol Med Rep. 2015;11:947–53.PubMedGoogle Scholar
- Tatsumi T, Kierstead LS, Ranieri E, Gesualdo L, Schena FP, Finke JH, et al. Disease-associated bias in T helper type 1 (Th1)/Th2 CD4(+) T cell responses against MAGE-6 in HLA-DRB10401(+) patients with renal cell carcinoma or melanoma. J Exp Med. 2002;196:619–28.View ArticlePubMedPubMed CentralGoogle Scholar
- Zou W, Restifo NP. T(H)17 cells in tumour immunity and immunotherapy. Nat Rev Immunol. 2010;10:248–56.View ArticlePubMedPubMed CentralGoogle Scholar
- Brannon AR, Reddy A, Seiler M, Arreola A, Moore DT, Pruthi RS, et al. Molecular stratification of clear cell renal cell carcinoma by consensus clustering reveals distinct subtypes and survival patterns. Genes Cancer. 2010;1:152–63.View ArticlePubMedPubMed CentralGoogle Scholar
- Gerlinger M, Horswell S, Larkin J, Rowan AJ, Salm MP, Varela I, et al. Genomic architecture and evolution of clear cell renal cell carcinomas defined by multiregion sequencing. Nat Genet. 2014;46:225–33.View ArticlePubMedPubMed CentralGoogle Scholar
- Gerlinger M, Quezada SA, Peggs KS, Furness AJ, Fisher R, Marafioti T, et al. Ultra-deep T cell receptor sequencing reveals the complexity and intratumour heterogeneity of T cell clones in renal cell carcinomas. J Pathol. 2013;231:424–32.View ArticlePubMedPubMed CentralGoogle Scholar
- McGranahan N, Furness AJ, Rosenthal R, Ramskov S, Lyngaa R, Saini SK, et al. Clonal neoantigens elicit T cell immunoreactivity and sensitivity to immune checkpoint blockade. Science. 2016;351:1463–9.View ArticlePubMedPubMed CentralGoogle Scholar
- Miller CA, White BS, Dees ND, Griffith M, Welch JS, Griffith OL, et al. SciClone: inferring clonal architecture and tracking the spatial and temporal patterns of tumor evolution. PLoS Comput Biol. 2014;10:e1003665.View ArticlePubMedPubMed CentralGoogle Scholar
- DuPage M, Mazumdar C, Schmidt LM, Cheung AF, Jacks T. Expression of tumour-specific antigens underlies cancer immunoediting. Nature. 2012;482:405–9.View ArticlePubMedPubMed CentralGoogle Scholar
- Szolek A, Schubert B, Mohr C, Sturm M, Feldhahn M, Kohlbacher O. OptiType: precision HLA typing from next-generation sequencing data. Bioinformatics. 2014;30:3310–6.View ArticlePubMedPubMed CentralGoogle Scholar
- Curiel TJ, Cheng P, Mottram P, Alvarez X, Moons L, Evdemon-Hogan M, et al. Dendritic cell subsets differentially regulate angiogenesis in human ovarian cancer. Cancer Res. 2004;64:5535–8.View ArticlePubMedGoogle Scholar
- Chen DS, Mellman I. Oncology meets immunology: the cancer-immunity cycle. Immunity. 2013;39:1–10.View ArticlePubMedGoogle Scholar
- Beuselinck B, Job S, Becht E, Karadimou A, Verkarre V, Couchy G, et al. Molecular subtypes of clear cell renal cell carcinoma are associated with sunitinib response in the metastatic setting. Clin Cancer Res. 2015;21:1329–39.View ArticlePubMedGoogle Scholar
- Webster WS, Lohse CM, Thompson RH, Dong H, Frigola X, Dicks DL, et al. Mononuclear cell infiltration in clear-cell renal cell carcinoma independently predicts patient survival. Cancer. 2006;107:46–53.View ArticlePubMedGoogle Scholar
- Cline MS, Craft B, Swatloski T, Goldman M, Ma S, Haussler D, et al. Exploring TCGA Pan-Cancer Data at the UCSC Cancer Genomics Browser. Sci Rep. 2013;3:2652.View ArticlePubMedPubMed CentralGoogle Scholar
- Trapnell C, Pachter L, Salzberg SL. TopHat: discovering splice junctions with RNA-Seq. Bioinformatics. 2009;25:1105–11.View ArticlePubMedPubMed CentralGoogle Scholar
- DeLuca DS, Levin JZ, Sivachenko A, Fennell T, Nazaire MD, Williams C, et al. RNA-SeQC: RNA-seq metrics for quality control and process optimization. Bioinformatics. 2012;28:1530–2.View ArticlePubMedPubMed CentralGoogle Scholar
- Gao J, Aksoy BA, Dogrusoz U, Dresdner G, Gross B, Sumer SO, et al. Integrative analysis of complex cancer genomics and clinical profiles using the cBioPortal. Sci Signal. 2013;6:pl1.View ArticlePubMedPubMed CentralGoogle Scholar
- Hanzelmann S, Castelo R, Guinney J. GSVA: gene set variation analysis for microarray and RNA-seq data. BMC Bioinformatics. 2013;14:7.View ArticlePubMedPubMed CentralGoogle Scholar
- Wu C, Orozco C, Boyer J, Leglise M, Goodale J, Batalov S, et al. BioGPS: an extensible and customizable portal for querying and organizing gene annotation resources. Genome Biol. 2009;10:R130.View ArticlePubMedPubMed CentralGoogle Scholar
- Dobin A, Davis CA, Schlesinger F, Drenkow J, Zaleski C, Jha S, Batut P, et al. STAR: ultrafast universal RNA-seq aligner. Bioinformatics. 2013;29:15–21.View ArticlePubMedGoogle Scholar
- Engstrom PG, Steijger T, Sipos B, Grant GR, Kahles A, Ratsch G, et al. Systematic evaluation of spliced alignment programs for RNA-seq data. Nat Methods. 2013;10:1185–91.View ArticlePubMedPubMed CentralGoogle Scholar
- Anders S, Pyl PT, Huber W. HTSeq--a Python framework to work with high-throughput sequencing data. Bioinformatics. 2015;31:166–9.View ArticlePubMedGoogle Scholar
- Anders S, Huber W. Differential expression analysis for sequence count data. Genome Biol. 2010;11:R106.View ArticlePubMedPubMed CentralGoogle Scholar
- Mason DY, Cordell JL, Gaulard P, Tse AG, Brown MH. Immunohistological detection of human cytotoxic/suppressor T cells using antibodies to a CD8 peptide sequence. J Clin Pathol. 1992;45:1084–8.View ArticlePubMedPubMed CentralGoogle Scholar
- Schol DJ, Mooi WJ, van der Gugten AA, Wagenaar SS, Hilgers J. Monoclonal antibody 123C3, identifying small cell carcinoma phenotype in lung tumours, recognizes mainly, but not exclusively, endocrine and neuron-supporting normal tissues. Int J Cancer Suppl. 1988;2:34–40.View ArticlePubMedGoogle Scholar
- Tan B, Anaka M, Deb S, Freyer C, Ebert LM, Chueh AC, et al. FOXP3 over-expression inhibits melanoma tumorigenesis via effects on proliferation and apoptosis. Oncotarget. 2014;5:264–76.View ArticlePubMedGoogle Scholar
- Hakimi AA, Reznik E, Lee CH, Creighton CJ, Brannon AR, Luna A, et al. An integrated metabolic atlas of clear cell renal cell carcinoma. Cancer Cell. 2016;29:104–16.View ArticlePubMedPubMed CentralGoogle Scholar
- Reinius LE, Acevedo N, Joerink M, Pershagen G, Dahlen SE, Greco D, et al. Differential DNA methylation in purified human blood cells: implications for cell lineage and studies on disease susceptibility. PLoS One. 2012;7:e41361.View ArticlePubMedPubMed CentralGoogle Scholar
- Durinck S, Spellman PT, Birney E, Huber W. Mapping identifiers for the integration of genomic datasets with the R/Bioconductor package biomaRt. Nat Protoc. 2009;4:1184–91.View ArticlePubMedPubMed CentralGoogle Scholar
- Weese D, Holtgrewe M, Reinert K. RazerS 3: faster, fully sensitive read mapping. Bioinformatics. 2012;28:2592–9.View ArticlePubMedGoogle Scholar
- Hoof I, Peters B, Sidney J, Pedersen LE, Sette A, Lund O, et al. NetMHCpan, a method for MHC class I binding prediction beyond humans. Immunogenetics. 2009;61:1–13.View ArticlePubMedGoogle Scholar
- Svetnik V, Liaw A, Tong C, Culberson JC, Sheridan RP, Feuston BP. Random forest: a classification and regression tool for compound classification and QSAR modeling. J Chem Inf Comput Sci. 2003;43:1947–58.View ArticlePubMedGoogle Scholar