EpiExplorer: live exploration and global analysis of large epigenomic datasets
© Halachev et al.; licensee BioMed Central Ltd. 2012
Received: 23 April 2012
Accepted: 3 October 2012
Published: 3 October 2012
Epigenome mapping consortia are generating resources of tremendous value for studying epigenetic regulation. To maximize their utility and impact, new tools are needed that facilitate interactive analysis of epigenome datasets. Here we describe EpiExplorer, a web tool for exploring genome and epigenome data on a genomic scale. We demonstrate EpiExplorer's utility by describing a hypothesis-generating analysis of DNA hydroxymethylation in relation to public reference maps of the human epigenome. All EpiExplorer analyses are performed dynamically within seconds, using an efficient and versatile text indexing scheme that we introduce to bioinformatics. EpiExplorer is available at http://epiexplorer.mpi-inf.mpg.de.
Understanding gene regulation is an important goal in biomedical research. Historically, much of what we know about regulatory mechanisms has been discovered by mechanism-focused studies on a small set of model genes [1, 2]. High-throughput genomic mapping technologies have recently emerged as a complementary approach ; and large-scale community projects are now generating comprehensive maps of genetic and epigenetic regulation for the human and mouse genomes [4–7]. Substantial potential for discovery lies in better connecting mechanism-focused studies to the wealth of functional genomics and epigenomics data that are being generated. A handful of pilot studies highlight the value of combining high-throughput and mechanism-focused research (for example, in [8–10]), but few research groups are equally proficient in bioinformatics, large-scale genomics and in-depth functional analysis to conduct highly integrated studies of gene regulation. A new generation of software tools could bridge this gap by enabling user-friendly navigation and analysis of large genomic databases.
Genome browsers are currently the only software tools for navigating through genome data that are widely used, not only by bioinformaticians but also by biomedical researchers with little computational background. The strength of web tools such as the UCSC Genome Browser , Ensembl  and the WashU Human Epigenome Browser  lies in their intuitive interface, which allows users to browse through the genome by representing it as a one-dimensional map with various annotation tracks. This approach is powerful for visualizing individual gene loci, but the key concept of genomics - investigating many genomic regions in concert - tends to get lost when working with genome browsers only. Therefore, complementary tools are needed that handle the complexity of large genomic datasets while maintaining the interactive and user-friendly character of genome browsers.
Existing tools do not fully address this need. For example, the UCSC Table Browser  and Ensembl BioMarts  provide user-friendly support for selecting and downloading sets of genomic regions, but the analysis of the downloaded data needs to be performed locally using command-line tools, including BEDTools  and R/Bioconductor . Workflow tools such as Galaxy , Taverna  and the Genomic HyperBrowser  combine user-friendliness and flexibility, but they require careful planning and tend to be too slow for performing truly interactive and exploratory analyses. Finally, enrichment analysis servers such as GREAT  and EpiGRAPH  are powerful tools for identifying significant associations in large biological datasets, but they lack the flexibility to explore the observed enrichments in a dynamic and interactive fashion.
With EpiExplorer, we have developed a web server that combines the interactive nature of genome browsers with the region-based analytical approach of Galaxy, enabling users to casually explore large-scale genomic datasets in search of interesting functional associations. EpiExplorer does not aim to replace any existing tool; instead it facilitates dynamic integration with tools such as the UCSC Genome Browser, Galaxy and the Genomic HyperBrowser. Neither does EpiExplorer restrict the user as to how to search for relevant associations in the data - as enrichment analysis tools do with their stringent statistical framework. Instead, EpiExplorer's key strength lies in supporting exploratory hypothesis generation using a broad range of genomic analyses performed in real time over the Internet. Such exploratory analyses often provide a first indication of relevant associations that are worth following up by in-depth statistical analysis using other software tools or by experimental validation in the wet lab.
Software and applications
A method and software for genome-wide exploration and live analysis of large epigenomic datasets
The EpiExplorer web server provides an interactive gateway for exploring large-scale reference maps of the human and mouse genome. EpiExplorer is built around default and user-uploaded genomic region sets, which are supplied as BED files. Before uploading data for EpiExplorer analysis, it is often useful to preprocess raw data with application-specific tools. For example, ChIP-seq data may be preprocessed with Cistrome  in order to derive a list of high-confidence peaks for the transcription factor or epigenetic mark of interest. Similarly, RNA-seq data may be preprocessed using Galaxy  in order to identify genomic regions that are differentially transcribed between two cell types.
Once the most meaningful BED file representation of the dataset of interest has been obtained, this list of genomic regions can be uploaded into EpiExplorer and interactively explored for hypothesis generation and visual analysis. The uploaded genomic regions are internally annotated with a wide range of genomic attributes, which enables visualization, analysis and filtering in real time. Five types of genomic regions are available in EpiExplorer by default, namely CpG islands, gene promoters, transcription start sites, predicted enhancer elements and a map of 5-kb tiling regions spanning the entire genome. Furthermore, EpiExplorer's default genomic attribute database includes chromatin and transcription factor binding data from the ENCODE project , epigenome data from the Roadmap Epigenomics Initiative , gene annotations from Gene Ontology  and Online Mendelian Inheritance in Man (OMIM) , and genome annotations from the UCSC Genome Browser . Importantly, EpiExplorer makes it easy for users to upload their own sets of genomic regions and to use them with the same flexibility as any of EpiExplorer's default region sets.
We validated the utility of EpiExplorer by studying the genome and epigenome characteristics of CpG islands, which is a well-understood topic . As outlined in a case study (see Text S1 and Figure S1 in Additional file 1) and its corresponding online tutorial on the supplementary website , EpiExplorer makes it easy to rediscover the distinctive epigenetic characteristics of CpG islands, which have previously been studied using computational and experimental methods [28–31]. The entire analysis can be performed in less than ten minutes without any bioinformatic training, guided by EpiExplorer's context-specific visualizations.
Connecting a new epigenetic mark to large-scale reference maps of the human epigenome
To assess the utility of EpiExplorer for exploratory analysis and hypothesis generation in a more advanced setting, we investigated a recently discovered epigenetic mark. 5-Hydroxymethylcytosine (5hmC) is a chemical variant of normal (that is, non-hydroxylated) cytosine methylation. It was first observed in embryonic stem (ES) cells and in certain types of neurons [32, 33]. The conversion of cytosine methylation into 5hmC is catalyzed by proteins of the TET family. One TET protein (TET2) is frequently mutated in myeloid cancers , underlining the biomedical relevance of studying the role of 5hmC in gene regulation.
To assess whether the association of 5hmC hotspots with H3K4me1 peaks indeed constitutes a relevant enrichment, we performed the same comparison for a randomized control set. EpiExplorer automatically calculates such control sets for user-uploaded region sets, which is done by reshuffling the genomic positions while retaining the overall number of regions and the distribution of region sizes. Visual comparison shows that the overlap between 5hmC hotspots and H3K4me1 peaks is indeed fourfold higher than expected by chance (Figure 1b), constituting a strong enrichment with potential biological implications. This enrichment is much more pronounced for H3K4me1 in ES cells than for other tissues, supporting the specificity of the observed association. We could further validate this association using EpiExplorer's neighborhood plot, which uses a similar concept as in the WashU Human Epigenome Browser  and in EpiChIP  in order to visualize the shared epigenomic neighborhood among a set of regions (Figure 1c). When plotting the levels of H3K4me1 methylation in the vicinity of 5hmC hotspots across the genome, we again observed a much stronger enrichment for ES cells than for H3K4me1 data from other tissues. Furthermore, when we compared the 5hmC hotspots with a comprehensive catalog of epigenetic states , we detected striking enrichment for several classes of enhancer elements (Figure 1d). In summary, these results suggest the hypothesis that a specific association may exist between 5hmC and H3K4me1-marked enhancer elements in human ES cells.
Given the presumed role of 5hmC in the erasure of DNA methylation [40, 41], we also investigated the distribution of normal (that is, non-hydroxylated) cytosine methylation among 5hmC hotspots, again in comparison with the randomized control set. To that end, we use the ability of EpiExplorer to work on dynamically refined subsets of the data and filter the set of 5hmC hotspots down to those regions for which we also have sufficient DNA methylation data. The results show that 5hmC hotspots are rarely unmethylated but frequently associated with moderate levels of DNA methylation in the range of 20% to 50% (Figure 1e), which is consistent with significant but incomplete demethylation activity occurring at the majority of 5hmC hotspots. This observation is also supported by a recent report describing enrichment of 5hmC and enhancer activity in genomic regions with intermediate DNA methylation . Finally, we use EpiExplorer to perform a Gene Ontology analysis for those genes that are located in close vicinity of 5hmC hotspots (Figure 1f). The 5hmC-associated genes are enriched for specific annotation terms related to gene regulation and development, including 'regulation of signal transduction', 'cell differentiation' and 'anatomical structure morphogenesis'.
Taken together, these EpiExplorer analyses suggest testable hypotheses about the role of 5hmC in human ES cells. For example, active DNA demethylation - with 5hmC as an intermediate - may protect developmental enhancers from gaining DNA methylation in undifferentiated cells. This mechanism may help ES cells retain their developmental potential in the presence of high levels of DNA methyltransferase activity. In addition, active DNA methylation could help avoid the accumulation of cancer-associated epigenetic alterations in undifferentiated cells, given that the sites of such alterations frequently overlap with developmental regulator elements . To provide further support for these hypotheses, we can export the analyzed data from EpiExplorer to the Genomic HyperBrowser and perform more rigorous statistical testing than is possible within EpiExplorer. And most importantly, it will be necessary to confirm biological significance by in-depth functional dissection of the interplay between 5hmC and H3K4me1 at developmental enhancers. Such wet-lab studies are laborious to conduct and inherently limited to a small number of candidate genes or genomic regions, thus requiring careful selection of the most relevant candidates. EpiExplorer can help guide the selection of suitable regions for functional follow-up, as illustrated in the following case study.
Interactive identification and prioritization of candidate regions using EpiExplorer
First, we inspect the length distribution of 5hmC hotspots (Figure 2a) and retain only those hotspots with a minimum length of 1 kb, which removes spurious peaks that are occasionally introduced by short repetitive elements in the genomic DNA sequence. Second, we filter for a detection significance of 10-30 or better in order to focus the analysis on the most clear-cut 5hmC hotspots (Figure 2b). Third, we require evidence of an enhancer-associated chromatin signature and retain only those 5hmC hotspots that overlap with H3K4me1 peaks (Figure 2c). Fourth, in order to maximize relevance of the candidate regions for drawing conclusions about gene regulation, we restrict the analysis to genomic regions located in the vicinity of genes that are annotated with Gene Ontology terms containing the word 'regulation' (Figure 2d). Fifth, we import an additional dataset of 5hmC hotspots in human ES cells  into EpiExplorer and retain only those hotspots that are present in both datasets (Figure 2e). Because these two 5hmC datasets were obtained using different experimental methods, our selection of consensus hotspots should effectively remove technical artifacts of either dataset. Sixth, to be able to robustly select 5hmC hotspots with intermediate DNA methylation levels in the last step, we discard those regions for which insufficient bisulfite sequencing coverage is available from the Roadmap Epigenomics datasets (Figure 2f). Seventh and last, we focus the analysis on those regions that exhibit moderate levels of DNA methylation because it is plausible to hypothesize that the epigenetic state of these regions might be the result of significant but incomplete levels of active DNA demethylation (Figure 2g). Each of these filtering steps is interactively performed using EpiExplorer. Together they bring the original list of 82,221 5hmC hotspots down to 16 regions that fulfill all criteria and constitute strong candidates for a mechanistic study exploring the association between 5hmC and H3K4me1-marked enhancer elements (Figure 2h).
To facilitate follow-up research, EpiExplorer provides extensive functionality for data export and visualization using external tools. First, every genomic region set in EpiExplorer can be exported and visualized as a custom track in the UCSC Genome Browser , which is usually a good starting point for designing locus-specific experiments. Second, the results generated by EpiExplorer can be transferred to Galaxy  in order to perform sequence motif search, primer design and a number of other useful analyses that facilitate wet-lab experimental planning. Third, export to the Genomic HyperBrowser  can provide the starting point for additional statistical analyses performed online. Fourth, it is possible to export and download all region sets as text files for customized analysis with spreadsheet software (for example, Excel) or statistical analysis tools (for example, R).
Concepts and algorithms
EpiExplorer's response time and memory footprint across thousands of actual user analyses
CpG islands (specific)
Transcription start sites
Gene promoters (-5kb to 1kb)
5hmC hotspots (Szulwach )
Genome-wide tiling regions (5kb)
Number of genomic regions
Preprocessing time (h)
Search index size (MB)
Mean query time (s)
95th percentile query time (s)
Percent queries completed in ≤2 s
In order to utilize these powerful text search operations for genomic analyses, we developed an encoding scheme that translates heterogeneous genome and epigenome datasets into a semi-structured text format (Figure S2 in Additional file 1). Each genomic region (such as a CpG island or 5hmC hotspot) is represented by a text document containing keywords for all its annotation features; and we use CompleteSearch to create a search index for the collection of text documents representing the regions of each user-uploaded dataset. EpiExplorer keywords are structured hierarchically, which enables efficient analyses through prefix search at various levels of granularity. For example, the term overlap:histones:H3K4me3 selects all regions that overlap with an H3K4me3 peak in any tissue, while the more specific term overlap:histones:H3K4me3:H1hESC selects only those regions that overlap with an H3K4me3 peak in ES cells. Furthermore, we can perform autocompletion queries such as overlap:histones:H3K4me3:*, which returns the number of regions that overlap with an H3K4me3 peak separately for each tissue. EpiExplorer also encodes various numeric scores (such as overlap ratios and DNA methylation levels), which are specifically encoded for prefix text search as described in the Materials and methods section. Overall, the use of the CompleteSearch engine for semi-structured text search confers a level of flexibility, efficiency and scalability that would not be easy to achieve with a simple text-tagging approach or with a relational database management system. And despite our extensive reliance on text search, the user never has to formulate any textual search phrases - they are dynamically constructed based on the user interaction with EpiExplorer's graphical frontend.
Toward the goal of interactively exploring large epigenomic datasets, EpiExplorer borrows key concepts from interactive web search. In contrast to genome browsers, which implement browse-and-zoom navigation similar to that of map viewing software, EpiExplorer was inspired by the interactive filter-and-refine workflow of web search engines: Most web searches start broadly (for example, with the search term 'epigenetics') and are then refined iteratively (for example, with the additional terms 'bioinformatic', 'software' and 'tools') until relevant websites show up among the top hits. EpiExplorer supports the same kind of exploratory search by making it easy to dynamically filter genomic region sets and by providing instant feedback in the form of graphical results summaries. Just like web search engines EpiExplorer is highly fault-tolerant, and it allows users to change any aspect of an analysis (for example, thresholds or filtering criteria) at any time without having to repeat previous steps.
The interactive nature of such analyses depends on fast response times, as any delay tends to stifle the creative act of live data exploration. For this reason, we designed and optimized EpiExplorer to complete complex genome-wide analyses in seconds, rather than the minutes or hours that are the norm for existing genome analysis toolkits (for example, Galaxy , Genomic HyperBrowser  and EpiGRAPH ). This level of runtime performance was achieved by utilizing an indexing algorithm that was originally developed for text search; and we anticipate that this design principle of EpiExplorer - to encode complex analyses into ultrafast text search queries - will be broadly applicable for interactive analysis of biomedical datasets (for example, for annotating disease-associated genotypes and in the interpretation of personal genomes).
Importantly, EpiExplorer is closely interconnected with other web-based tools, which allowed us to focus EpiExplorer on data exploration and hypothesis generation while relocating data preprocessing and in-depth statistical analysis to specialized tools such as Cistrome  and the Genomic HyperBrowser . We illustrated EpiExplorer's utility for interactive data exploration by a case study of hydroxymethylation in relation to public reference epigenome datasets, which recreates and extends results from a recently published paper  in ten minutes of analysis time (detailed tutorials are available from the supplementary website ). With this example in mind, we are optimistic that EpiExplorer will help bridge the 'digital divide' in biomedical research and constitute a step toward making large-scale epigenome datasets more useful and readily explorable for researchers with little or no bioinformatic experience.
Materials and methods
Textual encoding of binary and categorical genomic attributes
EpiExplorer internally represents each genomic region as a text file that encodes region-specific annotations in a semi-structured text format. For binary and categorical attributes (such as a region's association with an H3K4me1 peak or a 5hmC hotspot), the key concept is overlap. Two genomic regions are treated as overlapping if they have at least one base pair in common, and it is often plausible to assume that region sets that overlap more frequently than expected by chance are involved in similar biological processes (for example, co-binding of functionally related transcription factors). To effectively handle such data in the context of text search, we define the prefix overlap: followed by an annotation identifier. For example, the word overlap:genes indicates that the current region overlaps with the body of a gene, overlap:conserved encodes the overlap with a conserved element, and overlap:CGI denotes overlap with a CpG island. Using CompleteSearch's prefix search functionality, it we can efficiently retrieve all completions of a given prefix. For example, the query overlap:* retrieves all possible completions of the prefix overlap:, reporting the number of regions for each completion (see Figure 3 for an example). In this way, overlap information for a large number of genome and epigenome attributes can be obtained via a single text search query that is almost always answered within seconds (Table 1). Furthermore, the general overlap query overlap:* can be refined according to the hierarchical structure of the encoding scheme. For example, the word overlap:histones:H3K4me3:* retrieves an overlap summary of the H3K4me3 mark for all cell types included in EpiExplorer, whereas overlap:histones:H3K4me3:ES only obtains the regions that overlap with an H3K4me3 peak in ES cells.
Textual encoding of numeric genomic attributes
Many genomic attributes are numeric - for example, the CpG content or the distance to a neighboring gene. To be able to perform efficient text search on these attributes, we limit their numerical precision (number of digits) to a fixed number and use a binning scheme when necessary. We can then incorporate numeric score values into the textual encoding scheme by creating words such as dnaseq:freq:CG:010, which indicates that a genomic region exhibits a CpG frequency of 0.010 (1.0%). This textual encoding allows EpiExplorer to retrieve the distribution of CpG frequencies in a set of regions using the prefix query dnaseq:freq:CG:*, which facilitates the efficient plotting of histograms. Using CompleteSearch's range query feature, it is also straightforward to obtain all genomic regions with numeric attributes that fall into a certain range. For example, the query dnaseq:freq:CG:010--dnaseq:freq:CG:050 retrieves only those regions that have a CpG frequency of at least 1% and not more than 5%. Beyond region score attributes, additional numeric attributes supported by EpiExplorer include overlap ratios for filtering on the percent overlap between genomic regions as well as distances to neighboring genomic elements, which enable filtering steps such as 'identify all regions within 20 kb from the nearest gene'. Binary, categorical and numeric queries can be combined and iteratively refined in arbitrary ways. For example, the query overlap:CGI dnaseq:freq:CG:010--dnaseq:freq:CG:050 retrieves all regions that overlap with CpG islands and exhibit a CpG frequency in the range of 1% to 5%.
Integration of gene-centric textual annotations
In addition to binary, categorical and numeric attributes, EpiExplorer also incorporates textual information that is associated with genes, which includes Gene Ontology terms and OMIM phenotypes. As these annotations are already in text format, they can be used directly as keywords in the text search index. However, because these textual annotations can be lengthy and often apply to multiple genomic regions overlapping with the same gene, it is not ideal to store them directly in the description of each region. Instead, EpiExplorer maintains genes and their textual annotations as separate documents and stores only the gene identifier in the annotation of every overlapping genomic region. For example, if a region overlaps with the BRCA2 gene, EpiExplorer will add the word gene:BRCA2 to the document that represents the region, while the lengthy textual annotations of BRCA2 are stored in a separate document named gene:BRCA2. To answer text search queries that include these gene annotations, EpiExplorer makes use of the database JOIN feature that is supported by CompleteSearch. This way, the results from a region-based search and the results from a gene-based search can be combined in a single query, and only the matches are returned for visualization.
Dynamic visualization of search results and region sets
EpiExplorer visualizes the results of a text search using five types of dynamically generated diagrams.
The bar chart
The bar chart (see Figure 1a for an example) reports the percentage overlap of a selected region set with genomic regions of different types. Using the EpiExplorer control menu, it is straightforward to restrict a region set to those regions that overlap (or do not overlap) with another type of genomic regions shown in this diagram.
The area chart
The area chart (see Figure 1e for an example) is essentially a histogram, which summarizes the distribution of numeric attributes with a relatively narrow value range. The control menu provides a dynamic slider that can be used to restrict the selection to a subset of regions within a user-specified value range.
The pie chart
The pie chart (see Figure 2a for an example) is shown in addition to the area chart to summarize the distribution of numeric attributes that may span a wide value range. In this case, clicking any segment of the pie chart opens a zoomed-in area chart specific for the genomic regions that fall into the selected value range.
The neighborhood chart
The neighborhood chart (see Figure 1c for an example) illustrates the distribution of genome-wide maps - such as histone marks and transcription factor binding sites - in the vicinity of the selected region set. Average levels of overlap are calculated over all genomic regions in the set.
The bubble chart
The bubble chart (see Figure S1B in Additional file 1 for an example) plots the percentage of genomic regions that overlap with a given annotation (y-axis) against the total genome coverage of this type of annotation (x-axis). In this context, the genome coverage provides an indication of the expected overlap, highlighting annotations with substantially different overlap percentages. When used in comparison mode, an additional dimension is added to the bubble chart to represent the overlap of the annotations with the control set.
The enrichment chart
The enrichment chart (see Figure 1f for an example) summarizes gene-centric textual information in the form of a table and a word cloud. In the word cloud, the font size is scaled by the enrichment ratio, which is calculated relative to random expectation. Clicking on any annotation term refines the search to include only those regions that are associated with a gene carrying the corresponding annotation.
Annotation of genomic region sets
EpiExplorer makes no conceptual distinction between default and user-uploaded region sets. Every feature that is available for default region sets can also be used on custom data. Upon upload, new region sets are automatically annotated with a broad range of genome and epigenome attributes that are maintained in EpiExplorer's annotation database (see Table S1 in Additional file 2 for a complete list). The user can also select custom region sets as annotations for other user-uploaded region sets. The current version of EpiExplorer provides full support for the human genome assemblies hg18/NCBI36 and hg19/GRCh37, as well as for the mouse genome assembly mm9/NCBIM37. By default, EpiExplorer annotates every region with its chromosomal position, region length, strand and score attributes (if included in the uploaded BED file), and with annotations of ten different types: DNA sequence composition, histone modifications, transcription factor binding sites, DNaseI hypersensitive sites, DNA methylation, chromatin state segmentation, CpG islands, evolutionary conservation, repeat elements and gene-associated attributes. These annotations are derived from the following sources: (i) DNA sequence composition attributes are calculated directly from the genomic DNA sequence, which was downloaded from the UCSC Genome Browser . (ii) Histone modification data have been generated as part of the ENCODE project  and were obtained from the UCSC Genome Browser . We used preprocessed peak regions for 11 histone modifications and chromatin marks (H3K4me1, H3K4me2, H3K4me3, H3K9ac, H3K9me1, H3K27ac, H3K27me3, H3K36me3, H4K20me1, CTCF and Pol2) in nine cell lines (GM12878, H1hESC, HepG2, HMEC, HSMM, HUVEC, K562, NHEK and NHLF; described in more detail in the ENCODE documentation . (iii) Experimental data for transcription factor binding have also been generated as part of the ENCODE project and were obtained from the UCSC Genome Browser. We used preprocessed peaks for 33 transcription factors (AP2alpha, AP2gamma, ATF3, BDP1, BRF1, BRF2, cFos, cJun, cMyc, E2F1, E2F4, E2F6, GATA1, GATA2, GTF2B, HELFe, junD, MAX, NFE2, NFKB, Pol2, Pol3, Rad21, RPC155, SETDB1, SIRT6, TFIIIC110, TR4, XRCC4, YY1, ZNF263, ZNF274 and ZZZ3) in at least one cell line. (iv) DNA methylation data have been generated and preprocessed in the context of the Roadmap Epigenomics initiative  as described previously [53, 54]. They include ten tissue types: ES cells, fetal brain, fetal heart, fetal kidney, fetal lung, fibroblasts, hematopoietic progenitor cells, skeletal muscle, smooth muscle and stomach mucosa. (v) Chromatin segmentation data were obtained from a recent paper describing a hidden Markov model segmentation of histone modification data from the ENCODE project . (vi) DNaseI hypersensitive sites were also obtained from the ENCODE project. (vii) CpG island annotations were downloaded from the UCSC Genome Browser ('CpG islands (specific)') and from the CgiHunter website ('CpG islands (sensitive)') . (viii) Evolutionary conservation data were obtained from the phastCons annotation track of the UCSC Genome Browser . (ix) Repeat element annotations were obtained from the RepeatMasker annotation track in the UCSC Genome Browser . (x) Gene-associated attributes were retrieved via Ensembl Biomart  and include the gene name, textual description as well as annotations from the Gene Ontology  and OMIM  databases.
EpiExplorer provides a number of advanced features that are not essential for first-time users but can provide substantial added value when using EpiExplorer routinely for exploring genome and epigenome datasets.
To assess whether the association between a region set and an annotation attribute is biologically relevant, it is often helpful to repeat the comparison for a randomized control set. Such control sets are automatically generated when custom region sets are uploaded into EpiExplorer, simply by reshuffling the genomic position of all regions in the dataset. In addition, the user can select any region set that is available within EpiExplorer for use as a control set. Once a control set has been selected, it is automatically included as a reference (in grey) in all bar and area charts. Although the control set functionality does not replace statistical testing in a strict sense (which can be performed via EpiExplorer's export function to the Genomic HyperBrowser as illustrated in the corresponding tutorial on the supplementary website ), this feature is often informative for exploratory research because it provides the user with a visual intuition of the strength of association between genomic attributes.
Flexible OR refinements
While the combination of search terms with AND is considered standard for search engines, the CompleteSearch engine also supports OR queries. This feature gives the user additional flexibility for performing complex combinations of analyses. For example, the query dnameth:ES:ratio:00--dnameth:ES:ratio:33|dnameth:ES:ratio:66--dnameth:ES:ratio:99 selects all regions that are mostly unmethylated or mostly methylated.
EpiExplorer was developed with the paradigms of reproducible research in mind , and it provides several ways of documenting an analysis. Each user-uploaded region set is assigned a unique identifier that also serves as a password for accessing this dataset. Sharing this identifier with other researchers enables them to analyze the same dataset in EpiExplorer without any need for copying or transferring datasets. Furthermore, at any point in an EpiExplorer analysis, an identifying URL can be obtained that dynamically recreates the analysis and allows the user to follow up on the results without affecting the original analysis snapshot. Because all steps of an EpiExplorer analysis are documented in the control menu, the snapshot functionality ensures that EpiExplorer analyses are readily reproducible. This point is illustrated by the tutorials on the supplementary website , which provide a URL for each step of the analysis that automatically recreates the results when pasted into a web browser. EpiExplorer also supports the export of any region set as a downloadable BED file, its visualization as custom tracks in the UCSC Genome Browser and Ensembl, and the transfer into Galaxy and Galaxy-powered tools such as the Genomic HyperBrowser for further analysis; and it provides lists of gene identifiers for export to gene set tools such as DAVID and Gene Set Enrichment Analysis (GSEA). Every custom dataset, refinement and visualization is accessible only to its creator (unless explicitly shared with other researchers) and protected by strong identifiers functioning as passwords, thus ensuring the privacy of data and analyses. More information on export functionality, data sharing and confidentiality are provided in the tutorials on the supplementary website .
EpiExplorer was designed for performance, in order to enable interactive exploration of large genome and epigenome datasets. Table 1 underlines this point by summarizing EpiExplorer's runtime performance and resource consumption for its five default region sets as well as for the user-uploaded set of 5hmC hotspots. The preprocessing time needed to annotate and index user-uploaded datasets is usually on the order of minutes to hours (depending on the size of the region set); but it has to be performed only once when a genomic region set is first uploaded into EpiExplorer, and the user can activate e-mail notification and/or actively check for progress of the calculation. The size of the resulting index structure is typically on the order of few hundred megabytes. Once an index structure has been created, it takes very limited resources for the EpiExplorer server to perform analyses on the corresponding region set. We evaluated the performance of EpiExplorer by measuring the CompleteSearch response times on thousands of queries that were run during the preparation of this paper. For every region set, we measured the average query time, the time in which 95% of queries were processed, and the percentage of queries that required less than 2 seconds (Table 1). The results show that the average query time for each region set is consistently below 1 second, and that 95% of all analyses even for the largest region set completed in less than 4 seconds, which makes the dynamic exploration of datasets via EpiExplorer a continuous and interactive process for the users.
To be able to handle the wave of epigenome data that are being produced by international consortia, EpiExplorer was designed to scale to high user load and to be readily extensible with additional datasets. Because of the parallel nature of the computation-heavy backend, performance bottlenecks resulting from increasing user load can be resolved simply by adding more compute nodes for the backend. Furthermore, due to dynamic loading of backend instances, only parts of the indices of those region sets that are actively used need to be kept in memory, while additional user datasets are quickly reloaded from hard disk when a user accesses them. In its current version, EpiExplorer already handles hundreds of genome and epigenome annotations (Table S1 in Additional file 2) and hundreds of custom datasets, even though we are not currently utilizing all the parallelization options that the EpiExplorer architecture provides.
Incorporating new datasets into EpiExplorer is straightforward and can be done by any user, provided that the data are available in (or can be converted to) one of several supported data types, namely genomic regions with or without a quantitative score and optionally including additional annotations such as strand information. For example, adding a new histone modification requires just a few mouse clicks in the frontend and less than an hour of computation time for the middleware and backend. Adding support for new genome assemblies is also relatively straightforward though not fully automated, as it requires minor modifications of the frontend and middleware. Finally, the textual encoding behind EpiExplorer is flexible enough to incorporate conceptually new data types (for example, three-dimensional genomic interaction maps that link two or more genomic regions together), which would require modifications in the middleware's annotation mapping component and the implementation of new diagram types (for example, Circos plots) in the frontend. The source code of EpiExplorer is freely available for download from the support menu on EpiExplorer's supplementary website .
The supplementary website  provides additional material describing in detail how EpiExplorer can be used to recreate all analyses described in this paper. Specifically, the website includes dataset identifiers for loading the 5hmC hotspots into EpiExplorer and slideshow tutorials that provide a general introduction into EpiExplorer as well as a step-by-step description of how Figure 1, Figure 2 and Figure S1 were created.
Online Mendelian Inheritance in Man.
We would like to thank Laura Tolosi, Yassen Assenov, Lars Feuerbach, Joachim Büch, Georg Friedrich and Fabian Müller for advice and technical support, members of the BLUEPRINT and Roadmap Epigenomics consortia for helpful discussions, the members of the Bast group for supporting the CompleteSearch engine and all producers of genome and epigenome maps for making their data publicly available online. This work was performed in the context of the European Union's Seventh Framework Programme (FP7/2007-2013) grant agreement HEALTH-F2-2007-200620 (CANCERDIP) and grant agreement No. 282510 (BLUEPRINT), and in the context of the Cluster of Excellence on 'Multimodal Computing and Interaction'. Direct funding was provided by the Max Planck Society.
- Mitchell PJ, Tjian R: Transcriptional regulation in mammalian cells by sequence-specific DNA binding proteins. Science. 1989, 245: 371-378. 10.1126/science.2667136.PubMedView ArticleGoogle Scholar
- Orkin SH: Globin gene regulation and switching: circa 1990. Cell. 1990, 63: 665-672. 10.1016/0092-8674(90)90133-Y.PubMedView ArticleGoogle Scholar
- Hawkins RD, Hon GC, Ren B: Next-generation genomics: an integrative approach. Nat Rev Genet. 2010, 11: 476-486.PubMedPubMed CentralGoogle Scholar
- Adams D, Altucci L, Antonarakis SE, Ballesteros J, Beck S, Bird A, Bock C, Boehm B, Campo E, Caricasole A, Dahl F, Dermitzakis ET, Enver T, Esteller M, Estivill X, Ferguson-Smith A, Fitzgibbon J, Flicek P, Giehl C, Graf T, Grosveld F, Guigo R, Gut I, Helin K, Jarvius J, Kuppers R, Lehrach H, Lengauer T, Lernmark A, Leslie D, et al: BLUEPRINT to decode the epigenetic signature written in blood. Nat Biotechnol. 2012, 30: 224-226. 10.1038/nbt.2153.PubMedView ArticleGoogle Scholar
- Bernstein BE, Stamatoyannopoulos JA, Costello JF, Ren B, Milosavljevic A, Meissner A, Kellis M, Marra MA, Beaudet AL, Ecker JR, Farnham PJ, Hirst M, Lander ES, Mikkelsen TS, Thomson JA: The NIH Roadmap Epigenomics Mapping Consortium. Nat Biotechnol. 2010, 28: 1045-1048. 10.1038/nbt1010-1045.PubMedPubMed CentralView ArticleGoogle Scholar
- ENCODE Project Consortium: The ENCODE (ENCyclopedia Of DNA Elements) Project. Science. 2004, 306: 636-640.View ArticleGoogle Scholar
- Satterlee JS, Schubeler D, Ng HH: Tackling the epigenome: challenges and opportunities for collaboration. Nat Biotechnol. 2010, 28: 1039-1044. 10.1038/nbt1010-1039.PubMedView ArticleGoogle Scholar
- Huarte M, Guttman M, Feldser D, Garber M, Koziol MJ, Kenzelmann-Broz D, Khalil AM, Zuk O, Amit I, Rabani M, Attardi LD, Regev A, Lander ES, Jacks T, Rinn JL: A large intergenic noncoding RNA induced by p53 mediates global gene repression in the p53 response. Cell. 2010, 142: 409-419. 10.1016/j.cell.2010.06.040.PubMedPubMed CentralView ArticleGoogle Scholar
- Mikkelsen TS, Xu Z, Zhang X, Wang L, Gimble JM, Lander ES, Rosen ED: Comparative epigenomic analysis of murine and human adipogenesis. Cell. 2010, 143: 156-169. 10.1016/j.cell.2010.09.006.PubMedPubMed CentralView ArticleGoogle Scholar
- Musunuru K, Strong A, Frank-Kamenetsky M, Lee NE, Ahfeldt T, Sachs KV, Li X, Li H, Kuperwasser N, Ruda VM, Pirruccello JP, Muchmore B, Prokunina-Olsson L, Hall JL, Schadt EE, Morales CR, Lund-Katz S, Phillips MC, Wong J, Cantley W, Racie T, Ejebe KG, Orho-Melander M, Melander O, Koteliansky V, Fitzgerald K, Krauss RM, Cowan CA, Kathiresan S, Rader DJ: From noncoding variant to phenotype via SORT1 at the 1p13 cholesterol locus. Nature. 2010, 466: 714-719. 10.1038/nature09266.PubMedPubMed CentralView ArticleGoogle Scholar
- Karolchik D, Kuhn RM, Baertsch R, Barber GP, Clawson H, Diekhans M, Giardine B, Harte RA, Hinrichs AS, Hsu F, Kober KM, Miller W, Pedersen JS, Pohl A, Raney BJ, Rhead B, Rosenbloom KR, Smith KE, Stanke M, Thakkapallayil A, Trumbower H, Wang T, Zweig AS, Haussler D, Kent WJ: The UCSC Genome Browser Database: 2008 update. Nucleic Acids Res. 2008, 36: D773-779.PubMedPubMed CentralView ArticleGoogle Scholar
- Flicek P, Aken BL, Beal K, Ballester B, Caccamo M, Chen Y, Clarke L, Coates G, Cunningham F, Cutts T, Down T, Dyer SC, Eyre T, Fitzgerald S, Fernandez-Banet J, Graf S, Haider S, Hammond M, Holland R, Howe KL, Howe K, Johnson N, Jenkinson A, Kahari A, Keefe D, Kokocinski F, Kulesha E, Lawson D, Longden I, Megy K, et al: Ensembl 2008. Nucleic Acids Res. 2008, 36: D707-714.PubMedPubMed CentralView ArticleGoogle Scholar
- Zhou X, Maricque B, Xie M, Li D, Sundaram V, Martin EA, Koebbe BC, Nielsen C, Hirst M, Farnham P, Kuhn RM, Zhu J, Smirnov I, Kent WJ, Haussler D, Madden PA, Costello JF, Wang T: The Human Epigenome Browser at Washington University. Nat Methods. 2011, 8: 989-990. 10.1038/nmeth.1772.PubMedPubMed CentralView ArticleGoogle Scholar
- Karolchik D, Hinrichs AS, Furey TS, Roskin KM, Sugnet CW, Haussler D, Kent WJ: The UCSC Table Browser data retrieval tool. Nucleic Acids Res. 2004, 32: D493-496. 10.1093/nar/gkh103.PubMedPubMed CentralView ArticleGoogle Scholar
- Kinsella RJ, Kahari A, Haider S, Zamora J, Proctor G, Spudich G, Almeida-King J, Staines D, Derwent P, Kerhornou A, Kersey P, Flicek P: Ensembl BioMarts: a hub for data retrieval across taxonomic space. Database (Oxford). 2011, 2011: bar030-View ArticleGoogle Scholar
- Quinlan AR, Hall IM: BEDTools: a flexible suite of utilities for comparing genomic features. Bioinformatics. 2010, 26: 841-842. 10.1093/bioinformatics/btq033.PubMedPubMed CentralView ArticleGoogle Scholar
- Gentleman RC, Carey VJ, Bates DM, Bolstad B, Dettling M, Dudoit S, Ellis B, Gautier L, Ge Y, Gentry J, Hornik K, Hothorn T, Huber W, Iacus S, Irizarry R, Leisch F, Li C, Maechler M, Rossini AJ, Sawitzki G, Smith C, Smyth G, Tierney L, Yang JY, Zhang J: Bioconductor: open software development for computational biology and bioinformatics. Genome Biol. 2004, 5: R80-10.1186/gb-2004-5-10-r80.PubMedPubMed CentralView ArticleGoogle Scholar
- Goecks J, Nekrutenko A, Taylor J: Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences. Genome Biol. 2010, 11: R86-10.1186/gb-2010-11-8-r86.PubMedPubMed CentralView ArticleGoogle Scholar
- Hull D, Wolstencroft K, Stevens R, Goble C, Pocock MR, Li P, Oinn T: Taverna: a tool for building and running workflows of services. Nucleic Acids Res. 2006, 34: W729-732. 10.1093/nar/gkl320.PubMedPubMed CentralView ArticleGoogle Scholar
- Sandve GK, Gundersen S, Rydbeck H, Glad IK, Holden L, Holden M, Liestol K, Clancy T, Ferkingstad E, Johansen M, Nygaard V, Tostesen E, Frigessi A, Hovig E: The Genomic HyperBrowser: inferential genomics at the sequence level. Genome Biol. 2010, 11: R121-10.1186/gb-2010-11-12-r121.PubMedPubMed CentralView ArticleGoogle Scholar
- McLean CY, Bristor D, Hiller M, Clarke SL, Schaar BT, Lowe CB, Wenger AM, Bejerano G: GREAT improves functional interpretation of cis-regulatory regions. Nat Biotechnol. 2010, 28: 495-501. 10.1038/nbt.1630.PubMedView ArticleGoogle Scholar
- Bock C, Halachev K, Büch J, Lengauer T: EpiGRAPH: User-friendly software for statistical analysis and prediction of (epi-) genomic data. Genome Biol. 2009, 10: R14-10.1186/gb-2009-10-2-r14.PubMedPubMed CentralView ArticleGoogle Scholar
- Liu T, Ortiz JA, Taing L, Meyer CA, Lee B, Zhang Y, Shin H, Wong SS, Ma J, Lei Y, Pape UJ, Poidinger M, Chen Y, Yeung K, Brown M, Turpaz Y, Liu XS: Cistrome: an integrative platform for transcriptional regulation studies. Genome Biol. 2011, 12: R83-10.1186/gb-2011-12-8-r83.PubMedPubMed CentralView ArticleGoogle Scholar
- Ashburner M, Ball CA, Blake JA, Botstein D, Butler H, Cherry JM, Davis AP, Dolinski K, Dwight SS, Eppig JT, Harris MA, Hill DP, Issel-Tarver L, Kasarskis A, Lewis S, Matese JC, Richardson JE, Ringwald M, Rubin GM, Sherlock G: Gene ontology: tool for the unification of biology. The Gene Ontology Consortium. Nat Genet. 2000, 25: 25-29. 10.1038/75556.PubMedPubMed CentralView ArticleGoogle Scholar
- Hamosh A, Scott AF, Amberger JS, Bocchini CA, McKusick VA: Online Mendelian Inheritance in Man (OMIM), a knowledgebase of human genes and genetic disorders. Nucleic Acids Res. 2005, 33: D514-517.PubMedPubMed CentralView ArticleGoogle Scholar
- Deaton AM, Bird A: CpG islands and the regulation of transcription. Genes Dev. 2011, 25: 1010-1022. 10.1101/gad.2037511.PubMedPubMed CentralView ArticleGoogle Scholar
- EpiExplorer: supplementary information. [http://epiexplorer.mpi-inf.mpg.de/supplementary/]
- Bock C, Walter J, Paulsen M, Lengauer T: CpG island mapping by epigenome prediction. PLoS Comput Biol. 2007, 3: e110-10.1371/journal.pcbi.0030110.PubMedPubMed CentralView ArticleGoogle Scholar
- Cohen NM, Kenigsberg E, Tanay A: Primate CpG islands are maintained by heterogeneous evolutionary regimes involving minimal selection. Cell. 2011, 145: 773-786. 10.1016/j.cell.2011.04.024.PubMedView ArticleGoogle Scholar
- ENCODE Project Consortium: Identification and analysis of functional elements in 1% of the human genome by the ENCODE pilot project. Nature. 2007, 447: 799-816. 10.1038/nature05874.View ArticleGoogle Scholar
- Weber M, Hellmann I, Stadler MB, Ramos L, Pääbo S, Rebhan M, Schübeler D: Distribution, silencing potential and evolutionary impact of promoter DNA methylation in the human genome. Nat Genet. 2007, 39: 457-466. 10.1038/ng1990.PubMedView ArticleGoogle Scholar
- Kriaucionis S, Heintz N: The nuclear DNA base 5-hydroxymethylcytosine is present in Purkinje neurons and the brain. Science. 2009, 324: 929-930. 10.1126/science.1169786.PubMedPubMed CentralView ArticleGoogle Scholar
- Tahiliani M, Koh KP, Shen Y, Pastor WA, Bandukwala H, Brudno Y, Agarwal S, Iyer LM, Liu DR, Aravind L, Rao A: Conversion of 5-methylcytosine to 5-hydroxymethylcytosine in mammalian DNA by MLL partner TET1. Science. 2009, 324: 930-935. 10.1126/science.1170116.PubMedPubMed CentralView ArticleGoogle Scholar
- Delhommeau F, Dupont S, Della Valle V, James C, Trannoy S, Masse A, Kosmider O, Le Couedic JP, Robert F, Alberdi A, Lecluse Y, Plo I, Dreyfus FJ, Marzac C, Casadevall N, Lacombe C, Romana SP, Dessen P, Soulier J, Viguie F, Fontenay M, Vainchenker W, Bernard OA: Mutation in TET2 in myeloid cancers. N Engl J Med. 2009, 360: 2289-2301. 10.1056/NEJMoa0810069.PubMedView ArticleGoogle Scholar
- Szulwach KE, Li X, Li Y, Song CX, Han JW, Kim S, Namburi S, Hermetz K, Kim JJ, Rudd MK, Yoon YS, Ren B, He C, Jin P: Integrating 5-hydroxymethylcytosine into the epigenomic landscape of human embryonic stem cells. PLoS Genet. 2011, 7: e1002154-10.1371/journal.pgen.1002154.PubMedPubMed CentralView ArticleGoogle Scholar
- Heintzman ND, Hon GC, Hawkins RD, Kheradpour P, Stark A, Harp LF, Ye Z, Lee LK, Stuart RK, Ching CW, Ching KA, Antosiewicz-Bourget JE, Liu H, Zhang X, Green RD, Lobanenkov VV, Stewart R, Thomson JA, Crawford GE, Kellis M, Ren B: Histone modifications at human enhancers reflect global cell-type-specific gene expression. Nature. 2009, 459: 108-112. 10.1038/nature07829.PubMedPubMed CentralView ArticleGoogle Scholar
- Kouzarides T: Chromatin modifications and their function. Cell. 2007, 128: 693-705. 10.1016/j.cell.2007.02.005.PubMedView ArticleGoogle Scholar
- Hebenstreit D, Gu M, Haider S, Turner DJ, Lio P, Teichmann SA: EpiChIP: gene-by-gene quantification of epigenetic modification levels. Nucleic Acids Res. 2011, 39: e27-10.1093/nar/gkq1226.PubMedPubMed CentralView ArticleGoogle Scholar
- Ernst J, Kheradpour P, Mikkelsen TS, Shoresh N, Ward LD, Epstein CB, Zhang X, Wang L, Issner R, Coyne M, Ku M, Durham T, Kellis M, Bernstein BE: Mapping and analysis of chromatin state dynamics in nine human cell types. Nature. 2011, 473: 43-49. 10.1038/nature09906.PubMedPubMed CentralView ArticleGoogle Scholar
- Mohr F, Dohner K, Buske C, Rawat VP: TET genes: new players in DNA demethylation and important determinants for stemness. Exp Hematol. 2011, 39: 272-281. 10.1016/j.exphem.2010.12.004.PubMedView ArticleGoogle Scholar
- Münzel M, Globisch D, Carell T: 5-Hydroxymethylcytosine, the sixth base of the genome. Angew Chem Int Ed Engl. 2011, 50: 6460-6468. 10.1002/anie.201101547.PubMedView ArticleGoogle Scholar
- Stadler MB, Murr R, Burger L, Ivanek R, Lienert F, Scholer A, Wirbelauer C, Oakeley EJ, Gaidatzis D, Tiwari VK, Schubeler D: DNA-binding factors shape the mouse methylome at distal regulatory regions. Nature. 2011, 480: 490-495.PubMedGoogle Scholar
- De Carvalho DD, You JS, Jones PA: DNA methylation and cellular reprogramming. Trends Cell Biol. 2010, 20: 609-617. 10.1016/j.tcb.2010.08.003.PubMedPubMed CentralView ArticleGoogle Scholar
- Stroud H, Feng S, Morey Kinney S, Pradhan S, Jacobsen SE: 5-Hydroxymethylcytosine is associated with enhancers and gene bodies in human embryonic stem cells. Genome Biol. 2011, 12: R54-10.1186/gb-2011-12-6-r54.PubMedPubMed CentralView ArticleGoogle Scholar
- Hearst M: Search User Interfaces. 2009, Cambridge, New York: Cambridge University PressView ArticleGoogle Scholar
- Tunkelang D: Faceted Search. 2009, San Rafael, CA: Morgan & Claypool PublishersGoogle Scholar
- Bast H, Weber I: The CompleteSearch engine: interactive, efficient, and towards IR & DB integration. CIDR 2007, Third Biennial Conference on Innovative Data Systems Research: 7-10 January 2007; Asilomar, CA, USA. 2007, 88-95. [http://www.cidrdb.org/cidr2007/index.html]→[http://www.cidrdb.org/2007Proceedings.zip]Google Scholar
- jQuery. [http://jquery.org/]
- Google Chart Tools. [http://code.google.com/apis/chart/]
- Raney BJ, Cline MS, Rosenbloom KR, Dreszer TR, Learned K, Barber GP, Meyer LR, Sloan CA, Malladi VS, Roskin KM, Suh BB, Hinrichs AS, Clawson H, Zweig AS, Kirkup V, Fujita PA, Rhead B, Smith KE, Pohl A, Kuhn RM, Karolchik D, Haussler D, Kent WJ: ENCODE whole-genome data in the UCSC genome browser (2011 update). Nucleic Acids Res. 2011, 39: D871-875. 10.1093/nar/gkq1017.PubMedPubMed CentralView ArticleGoogle Scholar
- ENCODE Common Cell Types. [http://genome.ucsc.edu/ENCODE/cellTypes.html]
- Human Epigenome Atlas. [http://www.epigenomeatlas.org/]
- Bock C, Tomazou EM, Brinkman AB, Müller F, Simmer F, Gu H, Jäger N, Gnirke A, Stunnenberg HG, Meissner A: Quantitative comparison of genome-wide DNA methylation mapping technologies. Nat Biotechnol. 2010, 28: 1106-1114. 10.1038/nbt.1681.PubMedPubMed CentralView ArticleGoogle Scholar
- Gu H, Bock C, Mikkelsen TS, Jäger N, Smith ZD, Tomazou E, Gnirke A, Lander ES, Meissner A: Genome-scale DNA methylation mapping of clinical samples at single-nucleotide resolution. Nat Methods. 2010, 7: 133-136. 10.1038/nmeth.1414.PubMedPubMed CentralView ArticleGoogle Scholar
- CgiHunter. [http://cgihunter.bioinf.mpi-inf.mpg.de/]
- Siepel A, Bejerano G, Pedersen JS, Hinrichs AS, Hou M, Rosenbloom K, Clawson H, Spieth J, Hillier LW, Richards S, Weinstock GM, Wilson RK, Gibbs RA, Kent WJ, Miller W, Haussler D: Evolutionarily conserved elements in vertebrate, insect, worm, and yeast genomes. Genome Res. 2005, 15: 1034-1050. 10.1101/gr.3715005.PubMedPubMed CentralView ArticleGoogle Scholar
- RepeatMasker Open-3.0. [http://www.repeatmasker.org/]
- Kasprzyk A, Keefe D, Smedley D, London D, Spooner W, Melsopp C, Hammond M, Rocca-Serra P, Cox T, Birney E: EnsMart: a generic system for fast and flexible access to biological data. Genome Res. 2004, 14: 160-169.PubMedPubMed CentralView ArticleGoogle Scholar
- Gentleman R, Lang DT: Statistical analyses and reproducible research. Bioconductor Project Working Papers. 2004, Paper 2, [http://www.bepress.com/bioconductor/paper2]Google Scholar
- Myers RM, Stamatoyannopoulos J, Snyder M, Dunham I, Hardison RC, Bernstein BE, Gingeras TR, Kent WJ, Birney E, Wold B, Crawford GE: A user's guide to the encyclopedia of DNA elements (ENCODE). PLoS Biol. 2011, 9: e1001046-10.1371/journal.pbio.1001046.View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.