 Method
 Open Access
FOCS: a novel method for analyzing enhancer and gene activity patterns infers an extensive enhancer–promoter map
 Tom Aharon Hait^{1, 3},
 David Amar^{1, 2},
 Ron Shamir†^{1}Email author and
 Ran Elkon†^{3, 4}Email author
Received: 23 October 2017
Accepted: 13 April 2018
Published: 1 May 2018
Abstract
Recent sequencing technologies enable joint quantification of promoters and their enhancer regions, allowing inference of enhancer–promoter links. We show that current enhancer–promoter inference methods produce a high rate of false positive links. We introduce FOCS, a new inference method, and by benchmarking against ChIAPET, HiChIP, and eQTL data show that it results in lower false discovery rates and at the same time higher inference power. By applying FOCS to 2630 samples taken from ENCODE, Roadmap Epigenomics, FANTOM5, and a new compendium of GROseq samples, we provide extensive enhancer–promotor maps (http://acgt.cs.tau.ac.il/focs). We illustrate the usability of our maps for deriving biological hypotheses.
Keywords
Background
Deciphering the regulatory role of the noncoding part of the human genome is a major challenge. With the completion of the sequencing of the genome, efforts have shifted over the past decade towards understanding the epigenome. These efforts aim at understanding regulatory mechanisms outside the proteincoding sequences that allow the production of thousands of different cell types from the same DNA blueprint. Enhancer elements that distally control the activity of target promoters play critical roles in this process. Consequently, largescale epigenomic projects set out to identify all the cisregulatory elements that are encoded in the genome. Prominent among them is the ENCODE consortium [1, 2], which applied a variety of epigenomics techniques to a large panel of human cell lines. Profiling epigenetic marks of regulatory activity (including DHSseq profiling of DNase I hypersensitive sites (DHSs), which is accepted as a common feature of all active elements), ENCODE collectively identified hundreds of thousands of putative regulatory elements in the genome [2]. As ENCODE analyses were mainly applied to cancer cell lines, a followup project, the Roadmap Epigenomics, applied similar analyses to a large collection of human primary cells and tissues, in order to establish more physiological maps of common and cell typespecific putative regulatory elements [3]. Given the plethora of candidate enhancer regions called by these projects, the next pressing challenge is to identify which of them is actually functional and map them to the genes they regulate. A naïve approach that is still widely used in genomic studies links enhancers to their nearest genes. Yet, emerging indications suggest that up to 50% of enhancers cross over their most proximal gene and control a more distal one [4]. A common approach that improves this naïve enhancer–promoter (E–P) mapping is based on pairwise correlation between activity patterns of promoters (P) and putative enhancers (E), and identifies E–P pairs, located within a distance limit, that show highly correlated patterns across many samples [2, 3]. However, this approach does not take into account interactions among multiple enhancers that control the same target promoter. Furthermore, Pearson correlation, which is typically applied for this task, is highly sensitive to outliers and thus prone to false positives.
Improved detection of functional enhancers is offered by a recently discovered class of noncoding transcripts, named enhancer RNAs (eRNAs) [5]. eRNAs are mostly transcribed bidirectionally from regions of enhancers that are actively engaged in transcriptional regulation [5] (reviewed in [6, 7]), and, importantly, changes in eRNA expression at specific enhancer regions in response to different stimuli correlate both with changes in the amount of epigenetic marks at these enhancers and with the expression of their target genes [8–11]. Most eRNAs are not polyadenylated and are typically expressed at low levels due to their instability (reviewed in [12]). Therefore, eRNAs are not readily detected by standard RNAseq protocols, but can be effectively measured by global runon sequencing (GROseq), a technique that measures production rates of all nascent RNAs in a cell [8–10, 13, 14], or by capanalysis of gene expression (CAGE) followed by sequencing [4, 15, 16]. Utilizing eRNA expression as a mark of enhancer activity, the FANTOM5 consortium recently generated an atlas of predicted enhancers in a large panel of human cancer and primary cell lines and tissues [4]. This study too used pairwise correlation (in this case, calculated between expression levels of an eRNA and a gene whose transcription start site (TSS) is within a distance limit from it) to infer E–P links. Regression analysis was applied to characterize the configuration of promoter regulation by enhancers [4]. However, since all samples were used for training the regression models, this analysis is prone to overfitting and thus the predictive power of the derived models on new samples is unclear.
Here, we present FOCS (FDRcorrected OLS with Crossvalidation and Shrinkage), a novel procedure for inference of E–P links based on correlated activity patterns across many samples from heterogeneous sources. FOCS uses a crossvalidation scheme in which regression models are learnt on a training set of samples and then evaluated on leftout samples from other cell types. The models are subjected to a new statistical validation scheme that is tailored for zeroinflated data. Finally, validated models are optimally reduced to derive the most important E–P links. We applied FOCS on massive genomic datasets recorded by ENCODE, Roadmap Epigenomics, and FANTOM5, and on a large compendium of eRNA and gene expression profiles that we compiled from publicly available GROseq datasets. We demonstrate that FOCS outperforms extant methods in terms of concordance with E–P interactions identified by ChIAPET, HiChIP, and eQTL data. Collectively, applying FOCS to these four data resources, we inferred ~ 300,000 crossvalidated E–P interactions spanning ~ 16,000 known genes. FOCS and our predicted E–P maps are publicly available at http://acgt.cs.tau.ac.il/focs.
Results
The FOCS procedure for predicting E–P links
We set out to develop an improved statistical framework for prediction of E–P links based on their correlated activity patterns measured over many cell types. As a test case, we first focused on ENCODE’s DHS profiles [2], which constitute 208 samples measured in 106 different cell lines (“Methods”) [2]. This rich resource was previously used to infer E–P links based on pairwise correlation between DHS patterns of promoters and enhancers located within a distance of ±500 kbp. Out of ~ 42 million (M) pairwise comparisons, ~ 1.6 M pairs showed Pearson’s correlation > 0.7 and were regarded as putatively functional E–P links [2]. However, Pearson’s correlation is sensitive to outliers and thus may be prone to high rates of false positive predictions. This is especially exacerbated in cases of sparse data (zero inflation), which are prevalent in enhancer activity patterns, as many of the enhancers are active only in a limited set of conditions. In addition, the combinatorial nature of transcriptional regulation in which a promoter is regulated by multiple enhancers is not considered by such a pairwise approach.
We implemented and evaluated three alternative regression methods: ordinary least squares (OLS), generalized linear model with the negative binomial distribution (GLM.NB) [17], and zeroinflated negative binomial (ZINB) [18]. GLM.NB accounts for unequal meanvariance relationships within subpopulations of replicates. ZINB is similar to GLM.NB but also accounts for excess of samples with zero entries (“Methods”). For each promoter and regression method, the learning phase yields an activity vector, containing the promoter’s activity in each sample as predicted when it was left out. FOCS applies two nonparametric tests, tailored for zeroinflated data, to evaluate the ability of the inferred models (consisting of the k nearest enhancers) to predict the activity of the target promoter in the leftout samples. The first test is a “binary test” in which samples are divided into two sets, positive and negative, containing the samples in which the promoter was active or not, respectively, based on their measured signal (we used a signal threshold of 1.0 RPKM for this classification). Then, the Wilcoxon signedrank test is used to compare the predicted promoter activities between these two sets (Fig. 1). The second test is an “activity level test”, which examines the agreement between the predicted and observed promoter’s activities using Spearman’s correlation. In this test, only the positive samples (that is, samples in which the measured promoter signal is ≥ 1.0 RPKM) are considered. Gene models with good predictive power should discriminate well between positive and negative samples (the binary test) and preserve the original activity ranks of the positive samples (the activity level test), and models that pass these tests are regarded as statistically crossvalidated. Of note, these two validation tests evaluate each promoter model nonparametrically without assuming any underlying distribution on the data when inferring significance. Next, FOCS corrects the p values obtained by these tests for multiple testing using the Benjamini–Yekutieli (BY) FDR procedure [19] with qvalue < 0.1. The BY FDR procedure takes into account possible positive dependencies between tests while the more frequently used Benjamini–Hochberg (BH) FDR procedure [20] assumes the tests are independent.
FOCS results for ENCODE DHS epigenomic data
The configuration of promoter regulation by enhancers
A promoter’s model produced by OLS regression contains all k variables (i.e., enhancers), where each variable is assigned a significance level (p value) reflecting its statistical strength. Next, to focus on the most informative E–P interactions, FOCS seeks the strongest enhancers in each model. To this end, FOCS derives, per promoter, an optimally reduced model by applying model shrinkage (“Methods”). Lassobased shrinkage was previously used for this task [4]. Here, we chose elasticnet (enet) approach, which combines Lasso and Ridge regularizations, since in cases of highly correlated variables (i.e., the enhancers), Lasso tends to select a single variable while Ridge gives them more equal coefficients (“Methods”). In this analysis too, we included the 70,465 models that passed the activity level test. Figure 3c shows the distribution of the number of enhancers that were included in the enetreduced models. On average, each promoter was linked to 2.4 enhancers. Inclusion frequency decreased with E–P distance: the most proximal enhancer was included in 63% of the models while the tenth enhancer was included in only 16% of them (Fig. 3d). Here too, the graph reaches a plateau and enhancers 6–10 show very similar inclusion frequencies. Additional file 1: Figure S2A, B show the distribution of the actual E–P distance for the enhancers considered by FOCS and Additional file 1: Figure S2C shows the inclusion frequency as a function of this distance. Regulatory elements located less than 5 kb from their target promoter have markedly higher inclusion frequency. To estimate false positive rate among enhancers included in our final enetreduced models, we randomly selected 10,000 promoter models from the 70,465 models that passed the CV step, and added to each one of them an additional 11th enhancer randomly selected from a different chromosome. We then applied enet on these 10,000 models. Notably, the random enhancer was retained in only seven out of the 10,000 models, which is significantly lower than the inclusion frequency we observed for any E–P distance bin (Additional file 1: Figure S2C), indicating a low false positive rate also among the long distance E–P links inferred by FOCS.
Comparison of performance of FOCS and extant methods using external validation resources
Number of inferred promoter models obtained by four alternative methods on the ENCODE DHS dataset
Method type  Number of promoter models  Number of E–P links  Number of unique enhancers 

Pairwise (r ≥ 0.7)+ FDR  39,372  139,170  53,950 
OLSLASSO (R^{2} ≥ 0.5)^{a}  39,368  122,064  74,104 
OLSenet (R^{2} ≥ 0.5)^{a}  39,407  150,158  85,926 
FOCS  70,465  167,988  92,603 
FOCS performance on additional largescale datasets
Having demonstrated FOCS proficiency in predicting E–P links on the ENCODE DHS data, we next wished to expand the scope of our E–P mapping. We therefore applied FOCS to three additional largescale genomic datasets: (1) DHS profiles measured by the Roadmap Epigenomics project, consisting of 350 samples from 73 different cell types and tissues; and (2) FANTOM5 CAGE data that measured expression profiles in 1827 samples from 600 human cell lines and primary cells. The analysis of FANTOM5 data uses eRNA and TSS expression levels for estimating the activity of enhancers and promoters, respectively (“Methods”). (3) A GROseq compendium that we compiled. Building on eRNAs as quantitative markers of enhancer activity and the effectiveness of the GROseq technique in detecting eRNA expression [23], we compiled a large compendium of eRNA and gene expression profiles from publicly available GROseq datasets, spanning a total of 245 samples measured on 23 different human cell lines (“Methods”).
We applied to these datasets the same procedure that we applied above to the ENCODE data. In the analysis of these datasets, OLS yielded more validated models than the other regression methods on the Roadmap Epigenomics and GROseq datasets (as was the case in the ENCODE DHS data (Fig. 2a, b)), while GLM.NB and ZINB produced more models on FANTOM5 (Additional file 1: Figure S3AC and Table S1). The performance of GLM.NB and ZINB on the FANTOM5 dataset is probably due to the high fraction of zero entries in the count matrix of this dataset (~ 54%) compared to ENCODE, Roadmap, and GROseq data matrices (8, 4, and 19%, respectively). As OLS performed better on most datasets, all the results reported below are based on OLS. The numbers of promoter models that passed each validation test in each dataset are provided in Additional file 1: Figure S4A–C. The effect of CV is presented in Additional file 1: Figure S5A–C. In these datasets too, many of the models with a high coefficient of determination (R^{2} ≥ 0.5) when trained on all samples had low predictive power on novel samples (\( {R}_{CV}^2<0.25 \)) (Empirical FDR 16, 20, and 22% in Roadmap, FANTOM5, and GROseq, respectively; Additional file 1: Figure S5), demonstrating the utility of CV in alleviating overfitting and thus reducing false positive models.
We next examined the relative contribution of each of the ten participating enhancers to the validated models, and in these datasets too, the most proximal enhancers had the highest role, but more distal ones made very similar contributions (Additional file 1: Figure S6A). In terms of explained fraction of the observed variability in promoter activity, 41 and 84% of the models that passed both tests in the Roadmap Epigenomics and GROseq datasets, respectively, had R^{2} ≥ 0.5, but only 11% of the validated models reached this performance in the FANTOM5 dataset (Additional file 1: Figure S6B), probably due to its exceptionally sparse data matrix. Last, FOCS applied enet model shrinkage to the models that passed the validation tests (the number of validated models and E–P links derived by FOCS on each dataset is summarized in Additional file 1: Table S2). In the optimally reduced models, each promoter was linked, on average, to 3.2, 2.8, and 3.6 enhancers in the Roadmap, FANTOM5, and GROseq datasets, respectively (Additional file 1: Figure S7A), and inclusion frequency decreased with E–P distance (Additional file 1: Figures S7B and S8). Finally, benchmarking against RNAPII ChIAPET, YY1 HiChIP, and eQTL data, for most comparisons, FOCS outperformed the alternative methods for E–P mapping by yielding many more E–P predictions at similar external validation rates (Additional file 1: Figure S9 and Table S3). Collectively, we provide a rich resource of predicted E–P mapping that covers 16,349 known genes, 113,653 promoters, 181,236 enhancers, and 302,050 crossvalidated E–P links.
Discussion
In this study we present FOCS, a novel statistical framework for predicting E–P interactions based on activity patterns derived from largescale omic datasets. Applying FOCS to four different genomic data sources, we derived an extensive resource of statistically crossvalidated E–P links. Our E–P mapping resource further illuminates different facets of transcriptional regulation. First, a common naïve practice is to map enhancers to their nearest promoters. In FOCS predicted E–P links, ~ 26% of the enhancers are mapped to a promoter that is not the closest one (Additional file 1: Figure S10). Second, intronic enhancers are very common; 70% of the predicted E–P links involve an intronic enhancer (Additional file 1: Table S2). Third, while in the shrunken models each promoter was linked to, on average, ~ 3 enhancers, many promoters were linked to a single dominant enhancer and some were linked to a very high number of enhancers (8–10).
We also observed that while the vast majority (~ 90%) of enhancers in FOCSderived models had positive Pearson and Spearman correlation with the activity pattern of their target promoters, the models also included cases of negative correlation, suggesting that the regulatory element functions as a repressor (Additional file 1: Figure S13). Finally, the activity level test in FOCS, computed using the Spearman correlation, can also account for promoter models where the relationship between the enhancer and promoter activity patterns is not linear, perhaps explaining the R^{2} < 0.5 values observed in the majority of FANTOM5 and Roadmap models (Additional file 1: Figure S6B).
An aspect that we did not consider in our analysis is the constraints imposed on transcriptional regulation by the 3D organization of the genome. Recent findings indicate that most E–P interactions are limited by chromosomal territories called topologically associated domains [25, 26]. Further research is needed to better elucidate this connection between 3D organization and E–P links and to better understand to what extent such constraints are universally or differentially imposed in different cell types.
Biological interpretation of our analysis of DHS data (ENCODE and Roadmap Epigenomics datasets) implicitly assumes that transcription rate at promoters is positively related with promoter DHS signal. We therefore examined DHS–expression correlations in cell lines for which both DHS and RNAseq data were available in the ENCODE project (17 cell lines in total). In all cases, we observed high Spearman but low Pearson correlations (Additional file 1: Figure S14), indicating a strong monotonic but nonlinear relationship.
The leavecelltypeout scheme applied by FOCS is conservative and ensures that the inferred models have predictive power in diverse cellular contexts. However, it will not infer models for genes whose expression is strictly cell typespecific. Analyzing larger numbers of diverse cell types containing related cell types, we expect a lower chance of missing gene models that are cell typespecific.
While our manuscript was under review another novel method for inference of E–P interactions, called JEME, was introduced [27]. Unlike FOCS, JEME (and the previously published TargetFinder [28]) makes cell typespecific predictions and combines different omic data types within the same model.
Our broad compendium of E–P interactions can greatly assist the functional interpretation of genetic variants that are associated with disease susceptibility, as the majority (~ 90%) of the variants detected by genomewide association studies are located in noncoding sequences [29]. Similarly, it can help in the interpretation of recurrent noncoding somatic mutations (SMs) in cancer genomes. SM hotspots in regulatory regions are detected at an accelerated pace with the rapid accumulation of wholegenome sequencing (WGS) of tumor samples [30, 31]. Additionally, the predicted E–P links can be integrated into and boost bioinformatics pipelines that seek DNA motifs in regulatory elements that putatively regulate sets of coexpressed genes. Overall, the FOCS method and the compendium we provide hold promise for advancing our understanding of the noncoding regulatory genome.
Conclusions

FOCS predicts ~ 1.5fold more E–P links (n = 302,050) compared to the standard pairwise method with Pearson coefficient r > 0.7 (n = 204,276). On average over all datasets, FOCS E–P links show a higher support rate by external validation resources compared to the commonly used pairwise method (r > 0.7). These results demonstrate the improved prediction power and control of false positive E–P links.

FOCS uses two nonparametric tests to examine the robustness of each promoter model. Using these tests we can correct for multiple promoter models and use them when it is suspected that there is no linear relationship between the E–P activity patterns. Previous methods used the Pearson correlation test (or, equivalently R^{2} values) assuming linearity between enhancer and promoter activity patterns.

FOCS is capable of detecting repressor–promoter (RP) links, which result from negative Spearman correlation between R–P activity patterns. R–P links are less known and are also of high interest.

We provide a new compendium of eRNA and gene expression patterns based on 245 GROseq profiles from 23 different cell types. This compendium can be used as a genomewide resource of enhancer activity in a diverse panel of cell lines.
Methods
ENCODE DHS data preprocessing
DHS peak locations of enhancers and promoters were taken from a master list of 2,890,742 unique, nonoverlapping DHS segments [2] (ftp://ftp.ebi.ac.uk/pub/databases/ensembl/encode/integration_data_jan2011/byDataType/openchrom/jan2011/combined_peaks/multitissue.master.ntypes.simple.hg19.bed).
We extracted from the master list the set of known (n = 68,762) and novel (n = 44,853) promoter–DHS peaks taken from ftp://ftp.ebi.ac.uk/pub/databases/ensembl/encode/integration_data_jan2011/byDataType/openchrom/jan2011/promoter_predictions.
The remaining (n = 2,777,127) nonpromoter–DHS peaks in the master list were considered as putative regulatory elements, collectively referred to here as enhancer elements. To create enhancer/promoter signal matrices, we used the BAM files of 208 UW DNaseseq samples (106 cell types) from the Gene Expression Omnibus (GEO) dataset GSE29692 [2, 29, 32]. The number of reads mapped within each DHS peak was counted using BEDTools utilities [33]. To reduce our FOCS running time we focused only on promoters/enhancers with signal ≥ 1 RPKM in at least 30 samples, resulting in 92,909 promoters and 408,802 putative enhancers.
We defined for each promoter the set of k = 10 candidate enhancers located within a window of 1 Mb (±500 kb upstream/downstream of the promoter’s center position). We mapped promoters to annotated genes using GencodeV10 TSS annotations (ftp://genome.crg.es/pub/Encode/data_analysis/TSS/Gencodev10_TSS_May2012.gff.gz); 54,650 promoters (out of 92,909) were linked to annotated TSSs.
Roadmap epigenomic DHS data preprocessing
To create enhancer/promoter signal matrices, we used the aligned reads (BED files) of 350 UW DNaseseq samples (73 cell types) from GEO dataset GSE18927 [29, 32, 34–36]. The number of reads mapped within each DHS peak was counted using the BEDTools utilities [33]. We focused only on promoters/enhancers with signal ≥ 1 RPKM in at least one sample, resulting in 32,629 promoters and 470,549 putative enhancers.
We defined for each promoter the set of k = 10 candidate enhancers located within a window of ±500 kb. We mapped promoters to annotated genes using GencodeV10 TSS annotations (ftp://genome.crg.es/pub/Encode/data_analysis/TSS/Gencodev10_TSS_May2012.gff.gz) [37]; 17,941 (out of 32,629) promoters were linked to annotated TSSs.
FANTOM5 data preprocessing
Promoter (CAGE tags peak phase 1 and 2) and enhancer (human permissive enhancers phase 1 and 2; n = 65,423) expression matrices (counts and normalized) covering 1827 samples (600 cell types) were downloaded from FANTOM5 DB (http://fantom.gsc.riken.jp/). As in the FANTOM5 paper [4] we focused on promoters with expression ≥ 1 TPM (tags per million) in at least one sample, resulting in 56,290 promoters annotated with 26,489 RefSeq TSSs within ±500 bp. We defined for each promoter the set of k = 10 candidate enhancers located within a window of ±250 kb from the promoter’s TSS. The choice of smaller window here was done for consistency with the FANTOM5 choices.
GROseq data preprocessing
We downloaded raw sequence data of 245 GROseq samples from the Gene Expression Omnibus (GEO) database (Additional file 3: Table S5). See Additional file 1: Supplemental Methods for further processing details. We defined for each gene the set of k = 10 candidate enhancers located within a window of ±500 kb from its TSS.
FOCS model implementation
The input to FOCS is two activity matrices, one for enhancers (M_{ e }) and the other for promoters (M_{ p }), measured across the same samples. Activity is measured by DHS signal in ENCODE and Roadmap data, and by expression level in FANTOM5 and GROseq data. Samples were labeled with a celltype label out of C cell types. The output of FOCS is predicted E–P links.
First, FOCS builds for each promoter an OLS regression model based on the k enhancers whose center positions are closest to the promoter’s center position (in ENCODE, Roadmap, and FANTOM5) or TSS (in GROseq). Formally, let y_{ p } be the promoter p normalized activity pattern (measured in counts per million (CPM); y_{ p } is a row from M_{ p }) and let X_{ p } be the normalized activity matrix of the corresponding k enhancers (CPM; k rows from M_{ e }). We build an OLS linear regression model y_{p} = X_{p}β_{p} + ε_{p}, where ε_{p} is a vector that denotes the errors of the model and β_{p} is the (k + 1) x 1 vector of coefficients (including the intercept) to be estimated.
Second, FOCS performs leavecelltypeout crossvalidation (LCTO CV) by training the promoter model based on samples from C − 1 cell types and testing the predicted promoter activity of the samples from the leftout cell type. This step is repeated C times. The result is a vector of predicted activity values \( {y}_p^{model} \) for all samples.
FOCS tests the predicted activity values using two validation tests. (1) The binary test examines whether \( {y}_p^{model} \) discriminates between the samples in which p was active (observed activity y_{ p } ≥ 1 RPKM) and the samples in which p was inactive (y_{ p } < 1 RPKM). (2) The activity level test calculates, for the active samples, the significance of the Spearman correlation between \( {y}_p^{model} \) and y_{ p }. Spearman correlation compares the ranks of the original and predicted activities. We obtain two vectors of p values, one for each test, of length n (the number of promoter models).
Third, to correct for multiple testing, FOCS applies on each p value vector the Benjamini–Yekutieli (BY) FDR procedure [19]. Promoter models with qvalue ≤0.1 in either both tests or in the activity level test were included in further analyses. In GROseq analysis, we also included models that passed only the binary test (m = 2580) since 57% of them had R^{2} ≥ 0.5 (Additional file 1: Figure S6B). For promoters that passed these CV tests final models are trained again using all samples.
FOCS next selects informative enhancers for each final promoter model. The enhancer selection step is described in Additional file 1: Supplemental Methods.
Alternative regression methods
We compared the performance of the OLS method with GLM.NB and ZINB regression methods. We repeated the FOCS steps but in the first step, instead of OLS we applied the GLM.NB or ZINB method (see Additional file 1: Supplemental Methods for details).
FANTOM5 E–P linking using OLS regression was followed by Lasso shrinkage (defined as OLSLASSO) as described in [4] (see Additional file 1: Supplemental Methods for details).
GO enrichment analysis
GO enrichments were calculated using topGO R package [38] (algorithm = “classic”, statistic = “fisher”, minimum GO set size = 10). We split the genes into target and background sets using their enhancer bin sets. Genes belonging to bins with 1–3/1–4/4–10/5–10 enhancers were considered as the target set and compared to all genes from all bins as the background set. Correction for multiple testing was performed using the BH procedure [20].
External validation of predicted E–P links
We used three external data resources for validating FOCS E–P link predictions: (1) RNAPII ChIA–PET interactions; (2) YY1HiChIP interactions; and (3) eQTL SNPs.
We downloaded 922,997 ChIAPET interactions (assayed with RNAPІІ, on four cell lines: MCF7, HCT116, K562, and HelaS3) from the Chromatin–Chromatin Spatial Interaction (CCSI) database [39] (GEO accession numbers of the original ChIAPET samples are provided in Additional file 3: Table S6). We used the liftOver tool (from Kent utils package provided by UCSC) to transform the genomic coordinates of the interactions from hg38 to hg19. HiChIP interactions mediated by YY1 TF (HCT116, Jurkat, and K562 cell types) were taken from [21] (GEO accession id GSE99521). As done in [21], we retained 911,190 YY1HiChIP highconfidence interactions (Origami probability> 0.9). For eQTL SNPs, we used the significant SNP–gene pairs from GTEx analysis V6 and V6p builds; 2,283,827 unique eQTL SNPs covering 44 different tissues were downloaded from the GTEx portal [22].
We used 1kbp intervals (±500 bp upstream/downstream) for the promoters (relative to the center position in ENCODE/Roadmap/FNATOM5 or to the TSS position in GROseq) and the enhancers (±500 bp from the enhancer center). An E–P pair is considered supported by a particular capture interaction if both the promoter and enhancer intervals overlap different anchors of an interaction. An E–P pair is considered supported by an eQTL SNP if the SNP is located within the enhancer’s interval and is associated with the expression of the promoter’s gene. For each predicted E–P pair we checked if the promoter and enhancer intervals are supported by capture interactions and eQTL data. We then measured the fraction of E–P pairs supported by these data resources. See Additional file 1: Supplemental Methods for the significance calculation of the empirical p value.
Statistical tests, visualization, and tools used
All computational analyses and visualizations were done in the R statistical language environment [40]. We used the twosided Wilcoxon ranksum test implemented in wilcox.test() function to compute the significance of the binary test. We used the cor.test() function to compute the significance of the Spearman correlation in the activity level test. Spearman/Pearson correlations were computed using the cor() function. To correct for multiple testing we used the p.adjust() function (method = ‘BY’). We used the GenomicRanges package [41] for finding overlaps between genomic positions. We used rtracklayer [42] and GenomicInteractions [43] packages to import/export genomic positions. Counting reads in genomic positions was calculated using BEDTools [33]. OLS models were created using the lm() function in the stat package [40]. GLM.NB models were created using the glm.nb() function in the MASS package [44]. ZINB models were created using the zeroinfl() function in the pscl package [45]. Graphs were made using graphics [40], ggplot2 [46], gplots [47], and the UCSC genome browser (https://genome.ucsc.edu/).
Declarations
Funding
T.A.H. and D.A. were supported in part by fellowships from the Edmond J. Safra Center for Bioinformatics at Tel Aviv University. R.S. is supported by the Israeli Science Foundation (Grant 317/13) and the Bella Walter Memorial Fund of the Israel Cancer Association. R.E. is supported by the Israeli Cancer Association, with the generous assistance of the ICA Netherlands friends. R.E. is a Faculty Fellow of the Edmond J. Safra Center for Bioinformatics at Tel Aviv University.
Availability of data and materials

Materials (code and data) are available at http://acgt.cs.tau.ac.il/focs.

The code for reproducing FOCS output and figures is available at https://github.com/ShamirLab/FOCS (under BSD 3Clause “New” or “Revised” license) and at https://doi.org/10.5281/zenodo.1165278 (under BSD 3Clause “New” or “Revised” license).

The database of FOCS is available at http://acgt.cs.tau.ac.il/focs/download.html.

ENCODE DNaseseq samples (106 cell types) were downloaded from GEO dataset GSE29692 [2, 29, 32].

Roadmap Epigenomics DNaseseq samples (73 cell types) were downloaded from GEO dataset GSE18927 [29, 32, 34–36].

FANTOM5 CAGE data were downloaded from http://fantom.gsc.riken.jp/ [4].

GEO accession numbers of the analyzed GROseq datasets are listed in Additional file 3: Table S5.
Review history
The review history of this article is available in Additional file 4.
Authors’ contributions
TAH, RE, and RS designed the research. TAH and DA developed the computational method. TAH performed the analyses, parsed the ENCODE, Roadmap, and FANTOM5 data, and assembled the GROseq compendium. All authors analyzed the data and wrote the manuscript. All authors read and approved the final manuscript.
Competing interests
The authors declare that they have no competing interests.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
Authors’ Affiliations
References
 Consortium EP, et al. An integrated encyclopedia of DNA elements in the human genome. Nature. 2012;489:57–74.View ArticleGoogle Scholar
 Thurman RE, Rynes E, Humbert R, Vierstra J, Maurano MT, Haugen E, et al. The accessible chromatin landscape of the human genome. Nature. 2012;489:75–82.View ArticlePubMedPubMed CentralGoogle Scholar
 Consortium RE, Kundaje A, Meuleman W, Ernst J, Bilenky M, Yen A, et al. Integrative analysis of 111 reference human epigenomes. Nature. 2015;518:317–30. Available from: http://www.ncbi.nlm.nih.gov/pubmed/25693563 View ArticleGoogle Scholar
 Andersson R, Gebhard C, MiguelEscalada I, Hoof I, Bornholdt J, Boyd M, et al. An atlas of active enhancers across human cell types and tissues. Nature. 2014;507:455–61.View ArticlePubMedPubMed CentralGoogle Scholar
 Kim TK, Hemberg M, Gray JM, Costa AM, Bear DM, Wu J, et al. Widespread transcription at neuronal activityregulated enhancers. Nature. 2010;465:182–7.View ArticlePubMedPubMed CentralGoogle Scholar
 Shlyueva D, Stampfel G, Stark A. Transcriptional enhancers: from properties to genomewide predictions. Nat Rev Genet. 2014;15:272–86. Available from: http://www.ncbi.nlm.nih.gov/pubmed/24614317 View ArticlePubMedGoogle Scholar
 Elkon R, Agami R. Characterization of noncoding regulatory DNA in the human genome. Nat Biotechnol. 2017;35:732.View ArticlePubMedGoogle Scholar
 Hah N, Danko CG, Core L, Waterfall JJ, Siepel A, Lis JT. A rapid, extensive, and transient transcriptional response to estrogen signaling in breast cancer cells. Cell. 2011;145:622–34. Available from: http://dx.doi.org/10.1016/j.cell.2011.03.042.View ArticlePubMedPubMed CentralGoogle Scholar
 Hah N, Murakami S, Nagari A, Danko CG, Kraus WL. Enhancer transcripts mark active estrogen receptor binding sites. 2013;1210–1223.Google Scholar
 Li W, Notani D, Ma Q, Tanasa B, Nunez E, Chen AY, et al. Functional importance of eRNAs for estrogendependent transcriptional activation events. Nature. 2013;498:516.View ArticlePubMedPubMed CentralGoogle Scholar
 Melo CA, Drost J, Wijchers PJ, van de Werken H, de Wit E, Vrielink JAFO, et al. eRNAs are required for p53dependent enhancer activity and gene transcription. Mol Cell. 2013;49:524–35.View ArticlePubMedGoogle Scholar
 Andersson R, Sandelin A, Danko CG. A unified architecture of transcriptional regulatory elements. Trends Genet. 2015;31:426–33.View ArticlePubMedGoogle Scholar
 Léveillé N, Melo CA, Rooijers K, DiazLagares A, Melo SA, Korkmaz G, et al. Genomewide profiling of p53regulated enhancer RNAs uncovers a subset of enhancers controlled by a lncRNA. Nat Commun. 2015;6Google Scholar
 Core LJ, Waterfall JJ, Lis JT. Nascent RNA sequencing reveals widespread pausing and divergent initiation at human promoters. Science. 2008;322:1845–8.View ArticlePubMedPubMed CentralGoogle Scholar
 Shiraki T, Kondo S, Katayama S, Waki K, Kasukawa T, Kawaji H, et al. Cap analysis gene expression for highthroughput analysis of transcriptional starting point and identification of promoter usage. Proc Natl Acad Sci. 2003;100:15776–81.View ArticlePubMedPubMed CentralGoogle Scholar
 Wu H, Nord AS, Akiyama JA, Shoukry M, Afzal V, Rubin EM, et al. Tissuespecific RNA expression marks distantacting developmental enhancers. PLoS Genet. 2014;10:e1004610.View ArticlePubMedPubMed CentralGoogle Scholar
 Lawless JF. Negative binomial and mixed Poisson regression. Can J Stat. 1987;15:209–25.View ArticleGoogle Scholar
 Greene WH. Accounting for excess zeros and sample selection in Poisson and negative binomial regression models. 1994;Google Scholar
 Benjamini Y, Yekutieli D. The control of the false discovery rate in multiple testing under dependency. Ann Stat. 2001:1165–88.Google Scholar
 Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B. 1995:289–300.Google Scholar
 Weintraub AS, Li CH, Zamudio AV, Sigova AA, Hannett NM, Day DS, et al. YY1 is a structural regulator of enhancerpromoter loops. Cell. 2017;171:1573–1579.e28.View ArticlePubMedGoogle Scholar
 GTEx Consortium. The GenotypeTissue Expression (GTEx) pilot analysis: Multitissue gene regulation in humans. Science. 2015;348:648–60.View ArticlePubMed CentralGoogle Scholar
 Danko CG, Hyland SL, Core LJ, Martins AL, Waters CT, Lee HW, et al. Identification of active transcriptional regulatory elements from GROseq data. Nat Methods. 2015;12:433–8.View ArticlePubMedPubMed CentralGoogle Scholar
 Eisenberg E, Levanon EY. Human housekeeping genes , revisited. Trends Genet. 2013;29:569–74. Available from: http://dx.doi.org/10.1016/j.tig.2013.05.010View ArticlePubMedGoogle Scholar
 Rao SSP, Huntley MH, Durand NC, Stamenova EK, Bochkov ID, Robinson JT, et al. A 3D map of the human genome at kilobase resolution reveals principles of chromatin looping. Cell. 2014;159:1665–80.View ArticlePubMedPubMed CentralGoogle Scholar
 Tang Z, Luo OJ, Li X, Zheng M, Zhu JJ, Szalaj P, et al. CTCFmediated human 3D genome architecture reveals chromatin topology for transcription. Cell. 2015;163:1611–27.View ArticlePubMedPubMed CentralGoogle Scholar
 Cao Q, Anyansi C, Hu X, Xu L, Xiong L, Tang W, et al. Reconstruction of enhancer – target networks in 935 samples of human primary cells , tissues and cell lines. 2017;Google Scholar
 Whalen S, Truty RM, Pollard KS. Enhancer–promoter interactions are encoded by complex genomic signatures on looping chromatin. 2016;48Google Scholar
 Maurano MT, Humbert R, Rynes E, Thurman RE, Haugen E, Wang H, et al. Systematic localization of common diseaseassociated variation in regulatory DNA. Science. 2012;337:1190–5.View ArticlePubMedPubMed CentralGoogle Scholar
 Melton C, Reuter JA, Spacek DV, Snyder M. Recurrent somatic mutations in regulatory regions of human cancer genomes. Nat Genet. 2015;47:710–6.View ArticlePubMedPubMed CentralGoogle Scholar
 Weinhold N, Jacobsen A, Schultz N, Sander C, Lee W. Genomewide analysis of noncoding regulatory mutations in cancer. Nat Genet. 2014;46:1160–5.View ArticlePubMedPubMed CentralGoogle Scholar
 Polak P, Lawrence MS, Haugen E, Stoletzki N, Stojanov P, Thurman RE, et al. Reduced local mutation density in regulatory DNA of cancer genomes is linked to DNA repair. Nat Biotechnol. 2014;32:71.View ArticlePubMedGoogle Scholar
 Quinlan AR, Hall IM. BEDTools : a flexible suite of utilities for comparing genomic features. 2010;26:841–2.Google Scholar
 Bernstein BE, Stamatoyannopoulos JA, Costello JF, Ren B, Milosavljevic A, Meissner A, et al. The NIH roadmap epigenomics mapping consortium. Nat Biotechnol. 2010;28:1045–8.View ArticlePubMedPubMed CentralGoogle Scholar
 Neph S, Vierstra J, Stergachis AB, Reynolds AP, Haugen E, Vernot B, et al. An expansive human regulatory lexicon encoded in transcription factor footprints. Nature. 2012;489:83–90.View ArticlePubMedPubMed CentralGoogle Scholar
 Schultz MD, He Y, Whitaker JW, Hariharan M, Mukamel EA, Leung D, et al. Human body epigenome maps reveal noncanonical DNA methylation variation. Nature. 2015;523:212.View ArticlePubMedPubMed CentralGoogle Scholar
 Harrow J, Frankish A, Gonzalez JM, Tapanari E, Diekhans M, Kokocinski F, et al. GENCODE: the reference human genome annotation for The ENCODE Project. Genome Res. 2012;22:1760–74.View ArticlePubMedPubMed CentralGoogle Scholar
 Alexa A, Rahnenfuhrer J. topGO: Enrichment Analysis for Gene Ontology. R package version 2.28.0; 2016.Google Scholar
 Xie X, Ma W, Songyang Z, Luo Z, Huang J, Dai Z, et al. Original article CCSI : a database providing chromatin–chromatin spatial interaction information; 2016. p. 1–7.Google Scholar
 R Core Team. R: A Language and Environment for Statistical Computing. Vienna; 2017. Available from: https://www.rproject.org/
 Aboyoun P, Carlson M, Lawrence M, Huber W, Gentleman R, Morgan MT, et al. Software for computing and annotating genomic ranges. 2013;9:1–10.Google Scholar
 Lawrence M, Gentleman R, Carey V. rtracklayer: an R package for interfacing with genome browsers. Bioinformatics. 2009;25:1841–2.View ArticlePubMedPubMed CentralGoogle Scholar
 Harmston, N., IngSimmons, E., Perry, M., et al. GenomicInteractions: R package for handling genomic interaction data.. 2015. Available from: https://github.com/ComputationalRegulatoryGenomicsICL/GenomicInteractions/.Google Scholar
 Venables WN, Ripley BD. Modern applied statistics with S. 4th ed. New York; 2002.Google Scholar
 Zeileis A, Kleiber C, Jackman S. Regression models for count data in R. J Stat Softw. 2008;27:1–25.Google Scholar
 Wickham H. ggplot2: elegant graphics for data analysis. New York: SpringerVerlag; 2009. Available from: http://ggplot2.org View ArticleGoogle Scholar
 Warnes GR, Bolker B, Bonebakker L, Gentleman R, Liaw WHA, Lumley T, et al. gplots: various R programming tools for plotting data. 2016. Available from: https://cran.rproject.org/package=gplots.Google Scholar