A quantitative literature-curated gold standard for kinase-substrate pairs
- Sara Sharifpoor†1, 2,
- Alex N Nguyen Ba†3, 4,
- Ji-Young Young1, 2,
- Dewald van Dyk1, 2,
- Helena Friesen1,
- Alison C Douglas1, 2,
- Christoph F Kurat1, 2,
- Yolanda T Chong1, 2,
- Karen Founk1, 2,
- Alan M Moses3, 4Email author and
- Brenda J Andrews1, 2Email author
© Sharifpoor et al.; licensee BioMed Central Ltd. 2011
Received: 20 January 2011
Accepted: 14 April 2011
Published: 14 April 2011
We describe the Yeast Kinase Interaction Database (KID, http://www.moseslab.csb.utoronto.ca/KID/), which contains high- and low-throughput data relevant to phosphorylation events. KID includes 6,225 low-throughput and 21,990 high-throughput interactions, from greater than 35,000 experiments. By quantitatively integrating these data, we identified 517 high-confidence kinase-substrate pairs that we consider a gold standard. We show that this gold standard can be used to assess published high-throughput datasets, suggesting that it will enable similar rigorous assessments in the future.
Protein kinases constitute one of the largest protein families, accounting for approximately 2% of eukaryotic genomes. Kinases catalyze the transfer of phosphate groups to proteins, thereby influencing their activity, localization, stability, conformation and/or ability to interact with other proteins . The yeast genome encodes 127 protein kinases, 20 of which are required for cellular viability [2, 3]. At least 30% of the yeast proteome  is estimated to be phosphorylated, yet only a small portion of these phosphorylation events have been associated with their cognate kinase . In fact, PhosphoGRID database (v.1.0) reported over 5,000 phosphorylation sites in 2010, amongst 1,500 proteins in both high-throughput (HTP) and low-throughput (LTP) datasets in yeast, 90% of which have not been associated with either a function or a regulatory kinase . Since many phosphorylation events are highly transient or occur in the context of specific physiological conditions, it is difficult to capture kinase-substrate interactions. Furthermore, redundancy and promiscuity of protein kinases (particularly in vitro) can often complicate biochemical analysis.
Many targeted and HTP approaches have been used to link kinases and substrates in budding yeast, including: the use of analogue-sensitive kinase alleles for in vitro phosphorylation assays [7, 8]; the interrogation of proteome chips with purified kinases to identify rosters of proteins phosphorylated in vitro [5, 9]; affinity purification to discover kinase-associated proteins [10–13]; systematic genetic screens to identify genes that functionally interact with kinases [14–16]. Given the differences in the ability of large-scale datasets to capture kinase-substrate relationships and the number of different experimental approaches used to associate kinases with their targets, there is a requirement for both accurate quality assessment for HTP datasets through assembly of reliable gold standards and systematic data integration of information in the literature with HTP datasets.
Significant efforts have been made in this regard, including: PhosphoELM, a database of experimentally verified phosphorylation sites in all eukaryotic proteins [17, 18]; PhosphoSite, a literature-curated database that compiles post-translational modifications with a focus on phosphorylation in all organisms ; NetworKIN , a database that integrates consensus substrate motifs of human kinases with in vivo phosphorylation sites, protein-protein interaction networks and kinase domain sequences in order to quantitatively predict cellular kinase-substrate relationships; and PhosphoGRID, which includes information from the literature on in vivo phosphorylation sites for all yeast proteins and assigns the appropriate kinase or phosphatase responsible for each phosphorylated residue . All of these databases focus on consensus sites and phosphorylated residues. However, there is also considerable experimental information about kinase-substrate relationships at the protein level that is not easily represented in these databases. On the other hand, databases such as BioGRID [21, 22], which stores all protein and genetic interactions, do not represent the additional specific biochemical experiments that are performed in order to determine kinase-substrate relationships.
We sought to systematically amalgamate interaction information from many experimental approaches - genetic, biochemical and physical - with the specific goal of defining a bona fide interaction between kinases and substrates. We reasoned that a database designed to compile a reliable gold standard for kinase-substrate interactions would require: 1) a means of distinguishing upstream and downstream interactors of kinases, kinase activators and regulatory subunits or co-activators and complex components; 2) a measure of the directionality of genetic interactions involving kinases (for example, suppression, dosage lethality and dosage suppression); 3) a means of including a quantitative measure of the significance of a biochemical interaction; 4) a method for producing a score that reflects the quality of the evidence in the literature supporting a kinase-substrate relationship.
To address these issues, we developed Yeast KID, the first literature-curated database for kinases that integrates a series of HTP and LTP, genetic, physical, and biochemical experimental evidence with the goal of establishing known kinase-substrate relationships. KID enables not only the assembly of tailored gold standards of kinase-target pairs, but also provides a ranked score for assessing the quantity and quality of evidence supporting each pair. KID features a user-friendly interface that amalgamates all genetic, physical, and biochemical HTP data involving yeast kinases, providing easy access for integrative analysis and more complex bioinformatic approaches to study kinase pathways.
Results and discussion
The KID database uses a web interface where kinases and their interacting genes/proteins are connected through a distinct PMID, displayed as a checkmark (Figure S1 in Additional file 2). Interactors and kinases are displayed in the first and second columns of the table, respectively, while the remaining columns represent experimental categories. The interface includes a color box (left side of display) that allows selection of interactions in one or more experimental categories (same color, OR) or overlapping interactions of two or more categories (different color, AND), with inclusion of additional categories (light green) or exclusion of specific categories (white). We incorporated AND logic for multiple color sets such that (blue OR blue) AND (green OR green) would select the overlap between all interactions selected in either blue category with any of the interactions colored in either green category (Figure S1 in Additional file 2). Each category can be singularly selected or removed, allowing for overlap analysis between datasets individually, or in combination. The complete dataset can be downloaded by clicking on the 'Search' button, without indicating any kinase, gene or KID score threshold in the score box. Definitions of all experimental categories and the functions of each button can be viewed directly on the site by clicking on a bubble icon close to each category or function.
Interface for queries and searches
We designed the KID interface to facilitate searches for a variety of interactions relevant to kinase biology. All searches can exploit the color box system to include multiple queries with specific experimental output displays, either individually or in combination (Figure S1 in Additional file 2). For example, all interactions pertaining to one or more kinases can be queried using the 'Search' button. Using this application, all interactions for all kinases in the query ID will be displayed in alphabetical order and with the relevant PMID. Overlapping interactions involving specified kinases or the kinases associated with a list of genes/proteins can be acquired using the 'Compute Kinase Overlap' or the 'Compute Gene Overlap' buttons, respectively.
The number entered in the 'Score' box in the KID interface determines the lower threshold of display. The score is a measure of the strength of evidence associating a kinase-substrate pair, and is arbitrarily set to -5 as the default (see below for more information about the KID score). We recommend using KID scores corresponding to a P < 0.01 (currently 6.73) for high quality kinase-substrate gold standards and P < 0.05 (currently 4.72) for less stringent lists of kinase-substrate pairs. KID automatically sorts the output interactions of a search from the highest to lowest scoring kinase-substrate pair, except for overlap searches involving multiple kinases or genes, as noted above. Each search creates tab-delimited (.txt) and Cytoscape-compatible  network files that can be downloaded for other forms of visualization. All evidence for each kinase-gene/protein pair is presented via a green checkmark that, when clicked, displays the PMID, first author information and more detailed curator notes (Figure S1 in Additional file 2). A unique feature of the KID interface is the capacity to perform detailed searches using specific experimental categories.
The KID score
The variety of different experimental approaches used in defining a kinase-substrate pair creates a challenge in accurately associating a substrate with a particular kinase . In fact, many kinase-substrate pairs are supported by a small number of experiments that are not usually consistent across kinases or substrates. For example, some proteins are difficult to purify for in vitro kinase assays, while other bona fide substrates fail to show a phosphorylation-dependent change in mobility following SDS-PAGE. Hence, there is a need for a quantitative approach that defines confidence in kinase-substrate pairs based on the quality and quantity of experimental evidence of different types.
One approach to combining experimental evidence is the sum of the total number of interactions, used in the unified database, BioGRID [21, 22]. Also, BioGRID has recently reported a new scoring system, which assigns more value to physical rather than genetic interactions (1.5 points for physical and 1 point for genetic) [21, 22]. Although generally useful, we reasoned that this approach may not be optimized for scoring kinase-substrate relationships for a number of reasons: 1) it is unclear whether the number of experiments supporting a particular kinase-gene/protein connection is a useful measure of whether a protein is an in vivo kinase substrate; 2) databases such as BioGRID include more general experimental categories in their curation method that apply to all genes, rather than specific phosphorylation assays, and may not be of sufficient specificity to accurately assess a kinase-substrate relationship; 3) a larger weight for physical rather than genetic interactions may not be appropriate for the typically transient physical interactions associated with kinases and their substrates .
We addressed these issues in Yeast KID by including a hierarchical classification of experimental categories, specifically designed to be relevant for kinase-substrate interactions (Figure S2 in Additional file 2). Using a positive training set of well-defined kinase-substrate pairs, we computed log-likelihood ratios that summarize the weight for each experimental category (Table S3 in Additional file 1, Figure S3 in Additional file 2; see Materials and methods). These weights are then summed to give a KID score that represents a measure of the strength of existing evidence in the literature supporting a kinase-substrate relationship. The weight of each experimental category will change as more interactions are entered (Figure S3 in Additional file 2).
Based on the data currently in KID, most HTP categories had a small but significant contribution to the KID score, except for the in vitro phosphorylation category, which made a large contribution. This bias likely reflects large datasets describing in vitro targets for the well studied Pho85 and Cdc28 cyclin-dependent protein kinases (Cdks), which have been surveyed for in vitro substrates using analogue-sensitive alleles [7, 8]. By contrast, many LTP categories performed well in identifying kinase-substrate pairs from our training set, with the highest scoring categories being in vitro kinase assays, site-directed mutagenesis, in vitro phosphorylation site mapping and phospho-shifts, all biochemical assays of the enzymatic activity of a kinase. However, no single category contributes sufficiently to the score to call a kinase-target pair at the stringent cutoff, which reflects the intuition of experts that no single currently available experimental method is sufficient to conclusively define kinase-substrate relationships.
To compare the KID score to other possible scoring schemes, we compared the performance of the following scoring methods in predicting kinase-substrate pairs using the positive training set: 1) the number of interactions reported in BioGRID [21, 22]; 2) the BioGRID general scoring scheme [21, 22]; 3) the number of interactions reported in Yeast KID; and 4) the KID score. Performance was tested by calculating ROC and precision-recall curves (Figure 2a, b). We note that the precision appears low, but the expected precision of a random classifier in these data is <1 × 10-4. This analysis shows that, by using a score based on the phosphorylation-specific and more detailed curation, Yeast KID performs better at identifying the positive training set (Figure 2). Specifically, BioGRID identified 25% of kinase-substrate pairs in our positive training set, while KID identified 90% of known targets (< 2% false positive rate). Furthermore, while counting the number of interactions in KID performs moderately well, the KID score is still more sensitive in identifying a kinase-substrate pair against a set of random pairs.
We next plotted the top kinase-interacting pairs reported in BioGRID against the top pairs reported in Yeast KID, to ask whether the same pairs were identified. While there was overlap amongst the top interactions in both databases, the two scores identified distinct kinase-interacting pairs; 248 interactions were shared amongst the top 517 pairs in both databases. Together with the higher predictive performance of the KID score (Figure 2), we conclude that the top scoring interactions in Yeast KID most likely identify a more confident gold-standard set of protein kinase-substrate interactions than could be identified from more general interaction databases.
We note that the KID score is highly dependent on the initial positive training set and only calculates the likelihood that an interaction belongs to the initial positive training set as opposed to a random pair from our database. In theory, the larger and the more accurate the initial positive training set, the more confidence we have that the score accurately reflects the strength of evidence supporting a kinase-target pair. We carefully chose the positive training set by including over 120 kinase-target pairs representing 20% of the stringent gold-standard pairs reported in this study, with coverage of 40 kinases in order to minimize the scoring bias. However, the score cannot account for internal biases in published experiments. For example, more labor-intensive assays are obviously less represented in publications. Also, there may be a bias for well-studied kinase-target pairs. In a similar vein, interactions that are tested but result in negative outcomes are often not represented in publications and are not curated. Also, inevitable inconsistency in coverage of data from each publication during the curation process may contribute to variability in the KID ranking. Thus, the KID score displays a relative rather than absolute ranking, which is dependent on the initial positive training set (Table S3 in Additional file 1). Finally, the KID score is most likely a conservative measure for evidence supporting a kinase-substrate pair because uncharacterized kinase-target pairs may exist among the kinase-substrate interactions that we assume to be negative. This means that the KID score is most likely an underestimate of the strength of evidence supporting a kinase-substrate pair in comparison to random pairs in the space of all possible interactions.
Defining a gold-standard kinase-substrate set using KID scores
We next compared the quality of our gold standard to a recently compiled list of yeast kinase-substrate pairs used to analyze genetic interaction data, obtained from assessing genetic interactions between kinases, phosphatases and selected regulators . Results of this analysis are depicted as a Venn diagram in Figure 3b. The two lists overlapped by 58% (301 kinase-substrate pairs) while 139 pairs scored too low in KID to be considered a gold-standard kinase-substrate pair. We failed to identify 103 interactions in the Fiedler et al.  standard during our curation process. Since PMIDs were not reported for this dataset, it was difficult for us to reconcile these results. There were 123 interactions in Fiedler et al.  that belong to the 19 kinases that were not curated for LTP interactions in KID. The low overlap between the two gold standards highlights the importance of systematic curations in conjunction with appropriate scoring schemes in defining a useful benchmark for quality assessment of HTP datasets.
The KID score quantification can be used to rank targets of kinases that fall below the stringent cutoff. For example, many kinase-gene pairs that we curated fall below our stringent cutoff, but the relationship is supported by many lines of evidence. Further characterization of the candidate genes with high KID scores (through complementary experimentation according to pre-existing data in KID) may confirm novel targets of kinases. Since the KID score is a relative ratio for kinase-gene/protein pairs and provides a ranking scheme, it can predict the likelihood that one gene is regulated by one kinase versus all other kinases. The KID provides a means to quantify literature-curated evidence connecting kinases and other proteins for target prediction.
Comparison of HTP assays in the coverage of interaction space and in identifying gold standard kinase-substrate pairs
One important application of a kinase-gold standard is assessment of the quality of HTP datasets. Recently, a systematic comparison of HTP and LTP experiments using physical interaction data as a test case  revealed that HTP physical interaction datasets are comparable in quality to their LTP counterparts. We performed a similar analysis comparing HTP and LTP kinase interaction data from each of physical, genetic, biochemical and localization experiments curated in Yeast KID, both individually and as a whole.
Overlap between genetic, biochemical and physical interaction datasets
Despite the high enrichment of HTP genetic, physical and biochemical assays for LTP data of the same type, many LTP interactions were not captured by the HTP methods, suggesting that HTP and LTP datasets generally have different coverage of the interaction space. The lack of overlap may also reflect the technical nature of HTP assays, which typically survey all kinases under the same conditions, rather than directed approaches, which involve experiments functionally tailored to the kinase of interest. Only a handful of genes were present in all three sets of HTP data, suggesting differential coverage by the three types of HTP data as well (Figure 4b). While LTP data had more overlapping pairs between genetic, physical and biochemical assays, the reported data comprise only a fraction of the total data present in the literature.
Assessment of all HTP datasets in identifying the KID gold-standard set
Overall, phosphorylation and physical interaction datasets performed better than genetic interaction datasets in identifying the KID gold-standard kinase-substrate pairs. Although correlations of genome-wide genetic interaction profiles (synthetic genetic array (SGA) correlations)  and HTP synthetic dosage lethal (SDL) screens (Sharifpoor et al: Functional wiring of the yeast kinome revealed by global genetic network motif analysis, submitted) are enriched for gold-standard kinase-substrate pairs, other genetic datasets alone are not informative in defining these relationships . Since kinase-substrate relationships involve a direct physical interaction, it stands to reason that biochemical and physical interaction assays are more likely to directly identify links between kinases and their targets. Also, genetic interaction datasets are currently largely populated with synthetic lethal interactions, which often identify genes that function in parallel pathways, and not substrates in the same pathway .
Clustering kinases based on their functional targets
While yeast kinases have been previously classified based on their sequence similarity [2, 33], there has been no systematic attempt to quantitatively classify kinases based on their targets. Since KID scores are relative across all kinase-gene/protein pairs, we reasoned that by calculating the correlations of all kinase pairs, we could functionally classify groups of kinases involved in similar processes based on their targets. We used only binary values to calculate correlations between the kinases in the gold standard in our analysis; two kinases were correlated if they shared the same target(s). Therefore, the correlation analysis considers only the most confident targets of a kinase, rather than all possible targets. The magnitude of the KID score was not used for correlation assessment.
Our correlation analysis discovers known functional relationships involving kinases. For example, the organization of the network suggests that the Snf1 kinase links transcription to glucose signaling, consistent with the well-established role of Snf1 in regulating transcriptional repression at promoters of genes required for growth on non-fermentable carbon sources [34–36]. Also, the network revealed multiple links between the high osmolarity glycerol pathway (required for growth on osmotic stress) and the cell wall integrity pathway, consistent with the high level of cross-talk known to occur between the two regulatory pathways in vivo . For example, multiple genes show dependency on both the Slt2 and Hog1 kinases that regulate cell wall integrity- and high osmolarity glycerol-responsive genes, respectively. Our functional analysis shows that they also share multiple targets and corroborates previous reports that suggest a model whereby Slt2 phosphorylation is dependent on the Hog1-activating kinase Pbs2 [38–40].
We next tested whether highly correlated kinases are more likely to be functionally involved in the same biological processes . We plotted an edge-weighted network diagram of all correlated kinases and searched for functional similarity of nodes within a proximal cluster using Gene Ontology terms (Figure 6). To define subclusters for functional analysis, we reorganized the network, placing each node in the closest subcluster based on correlation values. We saw that the calculated correlations are an excellent measure of functional similarity for kinase pairs (Figure 6), defining specific functional categories, further confirming that our ranking system is a valid relative score for functional kinase-substrate pairs.
KID can be used to assess and compare the quality of new HTP approaches in identifying kinase-substrate pairs, LTP interactions of the same type, and the overlap with other HTP and LTP approaches. In addition, using the sophisticated search functions, filtering methods and user-friendly outputs, KID will provide a universal search system and repository for all datasets in HTP and LTP literature pertaining to yeast kinases.
Materials and methods
We defined 31 different types of experimental evidence relevant to defining kinase targets in a hierarchically classified format, first by high-throughput or low-throughput categories, then subclassified by physical, biochemical, genetic and phenotypic evidence (Figure S2 in Additional file 2). Data inputted for all HTP categories were extracted in bulk from the corresponding publications, while the LTP evidence, pertaining to specific phosphorylation assays, was inputted directly by a group of expert curators (Figure 1).
We extracted relevant articles for each individual kinase from PubMed by historically searching through every article published pertaining to the query kinase. We then compared our information with data from BioGRID, to extract additional publications that may have been missed during our curation process. Over 5,000 publications were surveyed up to August 2010 for LTP kinase interactions and all entries were inputted with the corresponding PMIDs. Curations were also performed based on definitions for the experimental evidence described on the website under each specific category (Figure S1 in Additional file 2).
Bidirectional interactions (for example, physical interactions, synthetic lethal interactions) were entered in both directions, while unidirectional interactions (for example, biochemical interactions, synthetic suppression) were only entered where a phenotype was clearly linked to a specific kinase. Evidence for interactions between kinases and other genes or proteins was entered with associated PMIDs ('kinase-gene interaction'), including the first author and year of publication. Directionality was added as notes where required (for example, dosage lethality) and specific allelic interactions and experimental design were also described in more detail in the notes section by the curator. Biochemical data regarding upstream regulators of kinases was not curated. If data pertaining to a conclusion were not shown in the publication or supplementary material, the evidence was not considered valid for entry into the database. Where there was more than one publication supporting the same interaction, each PMID was entered separately. For cyclin-dependent kinases with multiple regulatory subunits, the associated cyclin was also curated if specified in the literature. Each curator was supplied with detailed guidelines to maintain consistency and was assigned a set of kinases for literature curations. However, in the event that a publication included information for more than one kinase or between a kinase-pair, data were entered in KID for all kinases from a single paper to minimize curation errors through internal cross-checks.
Quality assessment for each experimental category and definition of KID scores
To assess the quality of each individual experimental category in identifying kinase-substrate pairs, we used a simple scoring method that evaluates the likelihood that a category of interest identifies a true kinase-substrate pair as opposed to a false positive. We assembled a positive training set of kinase-substrate interactions, chosen by the curators based on the following criteria from low-throughput literature: 1) a defined physical interaction between the kinase-substrate pair; 2) the ability of the kinase to phosphorylate the substrate in vitro; 3) the ability of the kinase to phosphorylate the substrate in vivo; and 4) whether the site or effect of the phosphorylation event was known (Table S3 in Additional file 1). The positive training set includes 121 interactions for 40 kinases and is not biased for any particular experimental category. We compared the frequency of interactions in each experimental category to the frequency expected in a negative training set, which we defined to be kinase-protein interactions that are unlikely to represent bona fide kinase-substrate interactions. To do so, we had to compute the frequency of an experimental data point in each category in a set of proteins that are not substrates. Because we rarely know the proteins that are not substrates of a particular kinase, defining a negative set is a challenge. To obtain the number of experimental data points, we conservatively used all the experimental data found in KID that were not part of the positive training set. To compute the relative frequency in the negative training set, we needed to divide this value by the size of the negative training set. In principle, this would be the total interaction space (all kinases multiplied by all genes) minus the set of all bona fide protein-kinase substrate interactions. In practice, however, most datasets do not sample the entire interaction space (for example, HTP in vitro kinase assays) and the negative set must be normalized to reflect this. Therefore, we considered the HTP negative training set size to be a fifth of the total interaction space (one-fifth times the number of kinases multiplied by the number of genes). The negative training set size for the LTP categories must also be adjusted using the same rationale since LTP experiments have sampled even less of the entire interaction space. To determine the size of the LTP negative training set, we calculated the ratio of the number of interactions shown by LTP experiments to the number of interactions shown by HTP experiments, and reduced the negative training set size for the LTP categories by this ratio (HTP negative training set multiplied by the ratio). Therefore, we are assuming that HTP and LTP experiments have equivalent power to detect kinase-substrate interactions, but that HTP experiments explore a much larger space. By performing these adjustments on the negative training sets, we believe that the score represents a relatively unbiased measure of enrichment of the success of each category in identifying our positive training set.
where xi, j = 1 when the ith experiment was reported for the jth putative kinase-substrate pair.
In order to calculate P-values for the scored interactions, we randomized the evidence in each experimental category in the database and scored the randomized database. The resulting score distribution was used to obtain P-values.
In Figure 2, for the ROC curve with BioGRID, we have only considered positives that were present in either dataset when calculating the true positive rate.
In Figure 5, although the fold enrichment for each dataset is similar to our scoring scheme, no estimate of the sampled interaction space is required because most datasets indicate the number of tested interactions, except for physical interaction data collected using mass spectrometry techniques, for which we assumed full coverage. The negative training set size has been adjusted to match their reported interaction space coverage (number of tested kinases multiplied by number of tested genes). We note that the scoring for each experimental category is an estimate while the enrichment for each dataset is exact.
Figure S6 in Additional file 2 summarizes the overall schema for KID, which has a back-end and front-end composition. The back-end is managed through an in-house user control panel administrated by multiple curators. Curators use a relational database schema that enforces consistent entries, such that each individual can automatically observe previous entries by other curators for any kinase-gene/protein pair. The system allows for direct modification, removal or addition of more experimental evidence and internal cross-validation by curators. Curated interactions are then compiled in a single interaction table that, upon data entry or modification, is used to automatically calibrate the score function for each category and to generate whole database backups. Also, each curator modification is automatically logged for administrative purposes. The front-end of the database queries the relational database schema via Ajax to allow rapid feedback of requested information. The query system allows the whole database to be filtered based on multiple entries in various combinations (Figure S1 in Additional file 2). The query is then parsed by the server to identify the requested set of interactions, which are in turn directly displayed by the KID interface. This generated output can be downloaded as a tab-delimited copy or Cytoscape-compatible network file, or directly displayed as an interaction network using Cytoscapeweb . A list of all database interactions can be viewed in Additional file 3.
Correlations of kinases based on their targets
We compiled the targets of all the kinases within our gold standard (stringent cutoff) and performed an all-by-all comparison using Pearson's correlation coefficient. The correlation cutoff represents a P-value of 0.05 in the t-test statistics. Results from the correlation comparisons were then subjected to a graphical analysis using an edge-weighted scheme in Cytoscape . Functional enrichment analysis was performed using FunSpec, a web-based cluster interpreter for yeast .
Kinase Interaction Database
receiver operating characteristic.
This work was supported by grants from the Canadian Cancer Society Research Institute (formerly the National Cancer Institute of Canada) to BJA, the Canadian Institutes for Health Research (grant GMX-211012 to BJA and Charles Boone) and the National Science and Engineering Research Council to AMM. ANNB is supported by an Ontario Graduate Scholarship and SS was supported by a University of Toronto Open Fellowship. CFK was supported by the European Molecular Biology Organization long term fellowship. Infrastructure for this research was supported by grants from the Canadian Foundation for Innovation grant to AMM, BJA and Charles Boone. We thank Dr Nick Provart for providing access to his server and Michael Costanzo, Charles Boone, Timothy Hughes and Andy Lai for useful discussions.
- Manning G, Whyte DB, Martinez R, Hunter T, Sudarsanam S: The protein kinase complement of the human genome. Science. 2002, 298: 1912-1934. 10.1126/science.1075762.PubMedView ArticleGoogle Scholar
- Rubenstein EM, Schmidt MC: Mechanisms regulating the protein kinases of Saccharomyces cerevisiae. Eukaryot Cell. 2007, 6: 571-583. 10.1128/EC.00026-07.PubMedPubMed CentralView ArticleGoogle Scholar
- Giaever G, Chu AM, Ni L, Connelly C, Riles L, Véronneau S, Dow S, Lucau-Danila A, Anderson K, André B, Arkin AP, Astromoff A, El-Bakkoury M, Bangham R, Benito R, Brachat S, Campanaro S, Curtiss M, Davis K, Deutschbauer A, Entian KD, Flaherty P, Foury F, Garfinkel DJ, Gerstein M, Gotte D, Güldener U, Hegemann JH, Hempel S, Herman Z, et al: Functional profiling of the Saccharomyces cerevisiae genome. Nature. 2002, 418: 387-391. 10.1038/nature00935.PubMedView ArticleGoogle Scholar
- Cohen P: Protein kinases--the major drug targets of the twenty-first century?. Nat Rev Drug Discov. 2002, 1: 309-315. 10.1038/nrd773.PubMedView ArticleGoogle Scholar
- Ptacek J, Devgan G, Michaud G, Zhu H, Zhu X, Fasolo J, Guo H, Jona G, Breitkreutz A, Sopko R, McCartney RR, Schmidt MC, Rachidi N, Lee SJ, Mah AS, Meng L, Stark MJ, Stern DF, De Virgilio C, Tyers M, Andrews B, Gerstein M, Schweitzer B, Predki PF, Snyder M: Global analysis of protein phosphorylation in yeast. Nature. 2005, 438: 679-684. 10.1038/nature04187.PubMedView ArticleGoogle Scholar
- Stark C, Su TC, Breitkreutz A, Lourenco P, Dahabieh M, Breitkreutz BJ, Tyers M, Sadowski I: PhosphoGRID: a database of experimentally verified in vivo protein phosphorylation sites from the budding yeast Saccharomyces cerevisiae. Database (Oxford). 2010, 2010: bap026-View ArticleGoogle Scholar
- Ubersax JA, Woodbury EL, Quang PN, Paraz M, Blethrow JD, Shah K, Shokat KM, Morgan DO: Targets of the cyclin-dependent kinase Cdk1. Nature. 2003, 425: 859-864. 10.1038/nature02062.PubMedView ArticleGoogle Scholar
- Dephoure N, Howson RW, Blethrow JD, Shokat KM, O'Shea EK: Combining chemical genetics and proteomics to identify protein kinase substrates. Proc Natl Acad Sci USA. 2005, 102: 17940-17945. 10.1073/pnas.0509080102.PubMedPubMed CentralView ArticleGoogle Scholar
- Mok J, Kim PM, Lam HY, Piccirillo S, Zhou X, Jeschke GR, Sheridan DL, Parker SA, Desai V, Jwa M, Cameroni E, Niu H, Good M, Remenyi A, Ma JL, Sheu YJ, Sassi HE, Sopko R, Chan CS, De Virgilio C, Hollingsworth NM, Lim WA, Stern DF, Stillman B, Andrews BJ, Gerstein MB, Snyder M, Turk BE: Deciphering protein kinase specificity through large-scale analysis of yeast phosphorylation site motifs. Sci Signal. 2010, 3: ra12-10.1126/scisignal.2000482.PubMedPubMed CentralView ArticleGoogle Scholar
- Krogan NJ, Cagney G, Yu H, Zhong G, Guo X, Ignatchenko A, Li J, Pu S, Datta N, Tikuisis AP, Punna T, Peregrín-Alvarez JM, Shales M, Zhang X, Davey M, Robinson MD, Paccanaro A, Bray JE, Sheung A, Beattie B, Richards DP, Canadien V, Lalev A, Mena F, Wong P, Starostine A, Canete MM, Vlasblom J, Wu S, Orsi C, et al: Global landscape of protein complexes in the yeast Saccharomyces cerevisiae. Nature. 2006, 440: 637-643. 10.1038/nature04670.PubMedView ArticleGoogle Scholar
- Gavin AC, Bösche M, Krause R, Grandi P, Marzioch M, Bauer A, Schultz J, Rick JM, Michon AM, Cruciat CM, Remor M, Höfert C, Schelder M, Brajenovic M, Ruffner H, Merino A, Klein K, Hudak M, Dickson D, Rudi T, Gnau V, Bauch A, Bastuck S, Huhse B, Leutwein C, Heurtier MA, Copley RR, Edelmann A, Querfurth E, Rybin V, et al: Functional organization of the yeast proteome by systematic analysis of protein complexes. Nature. 2002, 415: 141-147. 10.1038/415141a.PubMedView ArticleGoogle Scholar
- Gavin AC, Aloy P, Grandi P, Krause R, Boesche M, Marzioch M, Rau C, Jensen LJ, Bastuck S, Dümpelfeld B, Edelmann A, Heurtier MA, Hoffman V, Hoefert C, Klein K, Hudak M, Michon AM, Schelder M, Schirle M, Remor M, Rudi T, Hooper S, Bauer A, Bouwmeester T, Casari G, Drewes G, Neubauer G, Rick JM, Kuster B, Bork P, et al: Proteome survey reveals modularity of the yeast cell machinery. Nature. 2006, 440: 631-636. 10.1038/nature04532.PubMedView ArticleGoogle Scholar
- Breitkreutz A, Choi H, Sharom JR, Boucher L, Neduva V, Larsen B, Lin ZY, Breitkreutz BJ, Stark C, Liu G, Ahn J, Dewar-Darch D, Reguly T, Tang X, Almeida R, Qin ZS, Pawson T, Gingras AC, Nesvizhskii AI, Tyers M: A global protein kinase and phosphatase interaction network in yeast. Science. 2010, 328: 1043-1046. 10.1126/science.1176495.PubMedPubMed CentralView ArticleGoogle Scholar
- Sopko R, Huang D, Preston N, Chua G, Papp B, Kafadar K, Snyder M, Oliver SG, Cyert M, Hughes TR, Boone C, Andrews B: Mapping pathways and phenotypes by systematic gene overexpression. Mol Cell. 2006, 21: 319-330. 10.1016/j.molcel.2005.12.011.PubMedView ArticleGoogle Scholar
- Fiedler D, Braberg H, Mehta M, Chechik G, Cagney G, Mukherjee P, Silva AC, Shales M, Collins SR, van Wageningen S, Kemmeren P, Holstege FC, Weissman JS, Keogh MC, Koller D, Shokat KM, Krogan NJ: Functional organization of the S. cerevisiae phosphorylation network. Cell. 2009, 136: 952-963. 10.1016/j.cell.2008.12.039.PubMedPubMed CentralView ArticleGoogle Scholar
- Costanzo M, Baryshnikova A, Bellay J, Kim Y, Spear ED, Sevier CS, Ding H, Koh JL, Toufighi K, Mostafavi S, Prinz J, St Onge RP, VanderSluis B, Makhnevych T, Vizeacoumar FJ, Alizadeh S, Bahr S, Brost RL, Chen Y, Cokol M, Deshpande R, Li Z, Lin ZY, Liang W, Marback M, Paw J, San Luis BJ, Shuteriqi E, Tong AH, van Dyk N, et al: The genetic landscape of a cell. Science. 2010, 327: 425-431. 10.1126/science.1180823.PubMedView ArticleGoogle Scholar
- Diella F, Gould CM, Chica C, Via A, Gibson TJ: Phospho.ELM: a database of phosphorylation sites--update 2008. Nucleic Acids Res. 2008, 36: D240-244.PubMedPubMed CentralView ArticleGoogle Scholar
- Diella F, Cameron S, Gemund C, Linding R, Via A, Kuster B, Sicheritz-Ponten T, Blom N, Gibson TJ: Phospho.ELM: a database of experimentally verified phosphorylation sites in eukaryotic proteins. BMC Bioinformatics. 2004, 5: 79-10.1186/1471-2105-5-79.PubMedPubMed CentralView ArticleGoogle Scholar
- Hornbeck PV, Chabra I, Kornhauser JM, Skrzypek E, Zhang B: PhosphoSite: a bioinformatics resource dedicated to physiological protein phosphorylation. Proteomics. 2004, 4: 1551-1561. 10.1002/pmic.200300772.PubMedView ArticleGoogle Scholar
- Linding R, Jensen LJ, Pasculescu A, Olhovsky M, Colwill K, Bork P, Yaffe MB, Pawson T: NetworKIN: a resource for exploring cellular phosphorylation networks. Nucleic Acids Res. 2008, 36: D695-699.PubMedPubMed CentralView ArticleGoogle Scholar
- Breitkreutz BJ, Stark C, Reguly T, Boucher L, Breitkreutz A, Livstone M, Oughtred R, Lackner DH, Bähler J, Wood V, Dolinski K, Tyers M: The BioGRID Interaction Database: 2008 update. Nucleic Acids Res. 2008, 36: D637-640.PubMedPubMed CentralView ArticleGoogle Scholar
- Stark C, Breitkreutz BJ, Reguly T, Boucher L, Breitkreutz A, Tyers M: BioGRID: a general repository for interaction datasets. Nucleic Acids Res. 2006, 34: D535-539. 10.1093/nar/gkj109.PubMedPubMed CentralView ArticleGoogle Scholar
- Shannon P, Markiel A, Ozier O, Baliga NS, Wang JT, Ramage D, Amin N, Schwikowski B, Ideker T: Cytoscape: a software environment for integrated models of biomolecular interaction networks. Genome Res. 2003, 13: 2498-2504. 10.1101/gr.1239303.PubMedPubMed CentralView ArticleGoogle Scholar
- Sopko R, Andrews BJ: Linking the kinome and phosphorylome--a comprehensive review of approaches to find kinase targets. Mol Biosyst. 2008, 4: 920-933. 10.1039/b801724g.PubMedView ArticleGoogle Scholar
- Breitkreutz A, Choi H, Sharom JR, Boucher L, Neduva V, Larsen B, Lin ZY, Breitkreutz BJ, Stark C, Liu G, Ahn J, Dewar-Darch D, Reguly T, Tang X, Almeida R, Qin ZS, Pawson T, Gingras AC, Nesvizhskii AI, Tyers M: A global protein kinase and phosphatase interaction network in yeast. Science. 2010, 328: 1043-1046. 10.1126/science.1176495.PubMedPubMed CentralView ArticleGoogle Scholar
- Enserink JM, Kolodner RD: An overview of Cdk1-controlled targets and processes. Cell Div. 2010, 5: 11-10.1186/1747-1028-5-11.PubMedPubMed CentralView ArticleGoogle Scholar
- Yu H, Braun P, Yildirim MA, Lemmens I, Venkatesan K, Sahalie J, Hirozane-Kishikawa T, Gebreab F, Li N, Simonis N, Hao T, Rual JF, Dricot A, Vazquez A, Murray RR, Simon C, Tardivo L, Tam S, Svrzikapa N, Fan C, de Smet AS, Motyl A, Hudson ME, Park J, Xin X, Cusick ME, Moore T, Boone C, Snyder M, Roth FP, et al: High-quality binary protein interaction map of the yeast interactome network. Science. 2008, 322: 104-110. 10.1126/science.1158684.PubMedPubMed CentralView ArticleGoogle Scholar
- Holt LJ, Tuch BB, Villen J, Johnson AD, Gygi SP, Morgan DO: Global analysis of Cdk1 substrate phosphorylation sites provides insights into evolution. Science. 2009, 325: 1682-1686. 10.1126/science.1172867.PubMedPubMed CentralView ArticleGoogle Scholar
- Huh WK, Falvo JV, Gerke LC, Carroll AS, Howson RW, Weissman JS, O'Shea EK: Global analysis of protein localization in budding yeast. Nature. 2003, 425: 686-691. 10.1038/nature02026.PubMedView ArticleGoogle Scholar
- Uetz P, Giot L, Cagney G, Mansfield TA, Judson RS, Knight JR, Lockshon D, Narayan V, Srinivasan M, Pochart P, Qureshi-Emili A, Li Y, Godwin B, Conover D, Kalbfleisch T, Vijayadamodar G, Yang M, Johnston M, Fields S, Rothberg JM: A comprehensive analysis of protein-protein interactions in Saccharomyces cerevisiae. Nature. 2000, 403: 623-627. 10.1038/35001009.PubMedView ArticleGoogle Scholar
- Tarassov K, Messier V, Landry CR, Radinovic S, Serna Molina MM, Shames I, Malitskaya Y, Vogel J, Bussey H, Michnick SW: An in vivo map of the yeast protein interactome. Science. 2008, 320: 1465-1470. 10.1126/science.1153878.PubMedView ArticleGoogle Scholar
- Ho Y, Gruhler A, Heilbut A, Bader GD, Moore L, Adams SL, Millar A, Taylor P, Bennett K, Boutilier K, Yang L, Wolting C, Donaldson I, Schandorff S, Shewnarane J, Vo M, Taggart J, Goudreault M, Muskat B, Alfarano C, Dewar D, Lin Z, Michalickova K, Willems AR, Sassi H, Nielsen PA, Rasmussen KJ, Andersen JR, Johansen LE, Hansen LH, et al: Systematic identification of protein complexes in Saccharomyces cerevisiae by mass spectrometry. Nature. 2002, 415: 180-183. 10.1038/415180a.PubMedView ArticleGoogle Scholar
- Hunter T, Plowman GD: The protein kinases of budding yeast: six score and more. Trends Biochem Sci. 1997, 22: 18-22.PubMedView ArticleGoogle Scholar
- Treitel MA, Kuchin S, Carlson M: Snf1 protein kinase regulates phosphorylation of the Mig1 repressor in Saccharomyces cerevisiae. Mol Cell Biol. 1998, 18: 6273-6280.PubMedPubMed CentralView ArticleGoogle Scholar
- Smith FC, Davies SP, Wilson WA, Carling D, Hardie DG: The SNF1 kinase complex from Saccharomyces cerevisiae phosphorylates the transcriptional repressor protein Mig1p in vitro at four sites within or near regulatory domain 1. FEBS Lett. 1999, 453: 219-223. 10.1016/S0014-5793(99)00725-5.PubMedView ArticleGoogle Scholar
- Papamichos-Chronakis M, Gligoris T, Tzamarias D: The Snf1 kinase controls glucose repression in yeast by modulating interactions between the Mig1 repressor and the Cyc8-Tup1 co-repressor. EMBO Rep. 2004, 5: 368-372. 10.1038/sj.embor.7400120.PubMedPubMed CentralView ArticleGoogle Scholar
- Rodriguez-Pena JM, Garcia R, Nombela C, Arroyo J: The high-osmolarity glycerol (HOG) and cell wall integrity (CWI) signalling pathways interplay: a yeast dialogue between MAPK routes. Yeast. 2010, 27: 495-502. 10.1002/yea.1792.PubMedView ArticleGoogle Scholar
- Bermejo C, Rodriguez E, Garcia R, Rodriguez-Pena JM, Rodriguez de la Concepcion ML, Rivas C, Arias P, Nombela C, Posas F, Arroyo J: The sequential activation of the yeast HOG and SLT2 pathways is required for cell survival to cell wall stress. Mol Biol Cell. 2008, 19: 1113-1124.PubMedPubMed CentralView ArticleGoogle Scholar
- Garcia R, Rodriguez-Pena JM, Bermejo C, Nombela C, Arroyo J: The high osmotic response and cell wall integrity pathways cooperate to regulate transcriptional responses to zymolyase-induced cell wall stress in Saccharomyces cerevisiae. J Biol Chem. 2009, 284: 10901-10911. 10.1074/jbc.M808693200.PubMedPubMed CentralView ArticleGoogle Scholar
- Garcia-Rodriguez LJ, Valle R, Duran A, Roncero C: Cell integrity signaling activation in response to hyperosmotic shock in yeast. FEBS Lett. 2005, 579: 6186-6190. 10.1016/j.febslet.2005.10.001.PubMedView ArticleGoogle Scholar
- Robinson MD, Grigull J, Mohammad N, Hughes TR: FunSpec: a web-based cluster interpreter for yeast. BMC Bioinformatics. 2002, 3: 35-10.1186/1471-2105-3-35.PubMedPubMed CentralView ArticleGoogle Scholar
- Lopes CT, Franz M, Kazi F, Donaldson SL, Morris Q, Bader GD: Cytoscape Web: an interactive web-based network browser. Bioinformatics. 2010, 26: 2347-2348. 10.1093/bioinformatics/btq430.PubMedPubMed CentralView ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.