TY - JOUR AU - Zappia, L. AU - Phipson, B. AU - Oshlack, A. PY - 2018 DA - 2018// TI - Exploring the single-cell RNA-seq analysis landscape with the scRNA-tools database JO - PLoS Comput Biol VL - 14 UR - https://doi.org/10.1371/journal.pcbi.1006245 DO - 10.1371/journal.pcbi.1006245 ID - Zappia2018 ER - TY - JOUR AU - Boulesteix, A. -. L. AU - Binder, H. AU - Abrahamowicz, M. AU - Sauerbrei, W. PY - 2018 DA - 2018// TI - On the necessity and design of studies comparing statistical methods JO - Biom J VL - 60 UR - https://doi.org/10.1002/bimj.201700129 DO - 10.1002/bimj.201700129 ID - Boulesteix2018 ER - TY - JOUR AU - Boulesteix, A. -. L. AU - Lauer, S. AU - Eugster, M. J. A. PY - 2013 DA - 2013// TI - A plea for neutral comparison studies in computational sciences JO - PLoS One VL - 8 UR - https://doi.org/10.1371/journal.pone.0061562 DO - 10.1371/journal.pone.0061562 ID - Boulesteix2013 ER - TY - JOUR AU - Peters, B. AU - Brenner, S. E. AU - Wang, E. AU - Slonim, D. AU - Kann, M. G. PY - 2018 DA - 2018// TI - Putting benchmarks in their rightful place: the heart of computational biology JO - PLoS Comput Biol VL - 14 UR - https://doi.org/10.1371/journal.pcbi.1006494 DO - 10.1371/journal.pcbi.1006494 ID - Peters2018 ER - TY - JOUR AU - Boulesteix, A. -. L. PY - 2015 DA - 2015// TI - Ten simple rules for reducing overoptimistic reporting in methodological computational research JO - PLoS Comput Biol VL - 11 UR - https://doi.org/10.1371/journal.pcbi.1004191 DO - 10.1371/journal.pcbi.1004191 ID - Boulesteix2015 ER - TY - JOUR AU - Zheng, S. PY - 2017 DA - 2017// TI - Benchmarking: contexts and details matter JO - Genome Biol VL - 18 UR - https://doi.org/10.1186/s13059-017-1258-3 DO - 10.1186/s13059-017-1258-3 ID - Zheng2017 ER - TY - JOUR AU - Mangul, S. AU - Martin, L. S. AU - Hill, B. L. AU - Lam, A. K. -. M. AU - Distler, M. G. AU - Zelikovsky, A. PY - 2019 DA - 2019// TI - Systematic benchmarking of omics computational tools JO - Nat Commun VL - 10 UR - https://doi.org/10.1038/s41467-019-09406-4 DO - 10.1038/s41467-019-09406-4 ID - Mangul2019 ER - TY - JOUR AU - Norel, R. AU - Rice, J. J. AU - Stolovitzky, G. PY - 2011 DA - 2011// TI - The self-assessment trap: can we all be better than average? JO - Mol Syst Biol VL - 7 UR - https://doi.org/10.1038/msb.2011.70 DO - 10.1038/msb.2011.70 ID - Norel2011 ER - TY - JOUR AU - Aniba, M. R. AU - Poch, O. AU - Thompson, J. D. PY - 2010 DA - 2010// TI - Issues in bioinformatics benchmarking: the case study of multiple sequence alignment JO - Nucleic Acids Res VL - 38 UR - https://doi.org/10.1093/nar/gkq625 DO - 10.1093/nar/gkq625 ID - Aniba2010 ER - TY - JOUR AU - Boulesteix, A. -. L. AU - Wilson, R. AU - Hapfelmeier, A. PY - 2017 DA - 2017// TI - Towards evidence-based computational statistics: lessons from clinical research on the role and design of real-data benchmark studies JO - BMC Med Res Methodol VL - 17 UR - https://doi.org/10.1186/s12874-017-0417-2 DO - 10.1186/s12874-017-0417-2 ID - Boulesteix2017 ER - TY - JOUR AU - Boulesteix, A. -. L. AU - Hable, R. AU - Lauer, S. AU - Eugster, M. J. A. PY - 2015 DA - 2015// TI - A statistical framework for hypothesis testing in real data comparison studies JO - Am Stat VL - 69 UR - https://doi.org/10.1080/00031305.2015.1005128 DO - 10.1080/00031305.2015.1005128 ID - Boulesteix2015 ER - TY - JOUR AU - Morris, T. P. AU - White, I. R. AU - Crowther, M. J. PY - 2019 DA - 2019// TI - Using simulation studies to evaluate statistical methods JO - Stat Med VL - 38 UR - https://doi.org/10.1002/sim.8086 DO - 10.1002/sim.8086 ID - Morris2019 ER - TY - JOUR AU - Gardner, P. P. AU - Watson, R. J. AU - Morgan, X. C. AU - Draper, J. L. AU - Finn, R. D. AU - Morales, S. E. PY - 2019 DA - 2019// TI - Identifying accurate metagenome and amplicon software via a meta-analysis of sequence to taxonomy benchmarking studies JO - PeerJ. VL - 7 UR - https://doi.org/10.7717/peerj.6160 DO - 10.7717/peerj.6160 ID - Gardner2019 ER - TY - STD TI - Gardner PP, Paterson JM, Ashari-Ghomi F, Umu SU, McGimpsey S, Pawlik A. A meta-analysis of bioinformatics software benchmarks reveals that publication-bias unduly influences software accuracy. bioRxiv. 2017:092205. ID - ref14 ER - TY - JOUR AU - Evangelou, E. AU - Ioannidis, J. P. A. PY - 2013 DA - 2013// TI - Meta-analysis methods for genome-wide association studies and beyond JO - Nat Rev Genet VL - 14 UR - https://doi.org/10.1038/nrg3472 DO - 10.1038/nrg3472 ID - Evangelou2013 ER - TY - JOUR AU - Hong, F. AU - Breitling, R. PY - 2008 DA - 2008// TI - A comparison of meta-analysis methods for detecting differentially expressed genes in microarray experiments JO - Bioinformatics. VL - 24 UR - https://doi.org/10.1093/bioinformatics/btm620 DO - 10.1093/bioinformatics/btm620 ID - Hong2008 ER - TY - JOUR AU - Boutros, P. C. AU - Margolin, A. A. AU - Stuart, J. M. AU - Califano, A. AU - Stolovitzky, G. PY - 2014 DA - 2014// TI - Toward better benchmarking: challenge-based methods assessment in cancer genomics JO - Genome Biol VL - 15 UR - https://doi.org/10.1186/s13059-014-0462-7 DO - 10.1186/s13059-014-0462-7 ID - Boutros2014 ER - TY - JOUR AU - Friedberg, I. AU - Wass, M. N. AU - Mooney, S. D. AU - Radivojac, P. PY - 2015 DA - 2015// TI - Ten simple rules for a community computational challenge JO - PLoS Comput Biol VL - 11 UR - https://doi.org/10.1371/journal.pcbi.1004150 DO - 10.1371/journal.pcbi.1004150 ID - Friedberg2015 ER - TY - JOUR AU - Mechelen, I. AU - Boulesteix, A. -. L. AU - Dangl, R. AU - Dean, N. AU - Guyon, I. AU - Hennig, C. PY - 2018 DA - 2018// TI - Benchmarking in cluster analysis: A white paper JO - arXiv VL - 1809 ID - Mechelen2018 ER - TY - JOUR AU - Angers-Loustau, A. AU - Petrillo, M. AU - Bengtsson-Palme, J. AU - Berendonk, T. AU - Blais, B. AU - Chan, K. -. G. PY - 2018 DA - 2018// TI - The challenges of designing a benchmark strategy for bioinformatics pipelines in the identification of antimicrobial resistance determinants using next generation sequencing technologies JO - F1000Res. VL - 7 UR - https://doi.org/10.12688/f1000research.14509.2 DO - 10.12688/f1000research.14509.2 ID - Angers-Loustau2018 ER - TY - JOUR AU - Ioannidis, J. P. A. PY - 2018 DA - 2018// TI - Meta-research: why research on research matters JO - PLoS Biol VL - 16 UR - https://doi.org/10.1371/journal.pbio.2005468 DO - 10.1371/journal.pbio.2005468 ID - Ioannidis2018 ER - TY - JOUR AU - Weber, L. M. AU - Nowicka, M. AU - Soneson, C. AU - Robinson, M. D. PY - 2019 DA - 2019// TI - Diffcyt: differential discovery in high-dimensional cytometry via high-resolution clustering JO - Commun Biol VL - 2 UR - https://doi.org/10.1038/s42003-019-0415-5 DO - 10.1038/s42003-019-0415-5 ID - Weber2019 ER - TY - JOUR AU - Nowicka, M. AU - Robinson, M. D. PY - 2016 DA - 2016// TI - DRIMSeq: a Dirichlet-multinomial framework for multivariate count outcomes in genomics JO - F1000Res. VL - 5 UR - https://doi.org/10.12688/f1000research.8900.2 DO - 10.12688/f1000research.8900.2 ID - Nowicka2016 ER - TY - JOUR AU - Levine, J. H. AU - Simonds, E. F. AU - Bendall, S. C. AU - Davis, K. L. AU - Amir, E. -. A. D. AU - Tadmor, M. D. PY - 2015 DA - 2015// TI - Data-driven phenotypic dissection of AML reveals progenitor-like cells that correlate with prognosis JO - Cell. VL - 162 UR - https://doi.org/10.1016/j.cell.2015.05.047 DO - 10.1016/j.cell.2015.05.047 ID - Levine2015 ER - TY - JOUR AU - Zhou, X. AU - Lindsay, H. AU - Robinson, M. D. PY - 2014 DA - 2014// TI - Robustly detecting differential expression in RNA sequencing data using observation weights JO - Nucleic Acids Res VL - 42 UR - https://doi.org/10.1093/nar/gku310 DO - 10.1093/nar/gku310 ID - Zhou2014 ER - TY - JOUR AU - Law, C. W. AU - Chen, Y. AU - Shi, W. AU - Smyth, G. K. PY - 2014 DA - 2014// TI - Voom: precision weights unlock linear model analysis tools for RNA-seq read counts JO - Genome Biol VL - 15 UR - https://doi.org/10.1186/gb-2014-15-2-r29 DO - 10.1186/gb-2014-15-2-r29 ID - Law2014 ER - TY - JOUR AU - Saelens, W. AU - Cannoodt, R. AU - Todorov, H. AU - Saeys, Y. PY - 2019 DA - 2019// TI - A comparison of single-cell trajectory inference methods JO - Nat Biotechnol VL - 37 UR - https://doi.org/10.1038/s41587-019-0071-9 DO - 10.1038/s41587-019-0071-9 ID - Saelens2019 ER - TY - JOUR AU - Duò, A. AU - Robinson, M. D. AU - Soneson, C. PY - 2018 DA - 2018// TI - A systematic performance evaluation of clustering methods for single-cell RNA-seq data JO - F1000Res. VL - 7 UR - https://doi.org/10.12688/f1000research.15666.1 DO - 10.12688/f1000research.15666.1 ID - Duò2018 ER - TY - JOUR AU - Soneson, C. AU - Robinson, M. D. PY - 2018 DA - 2018// TI - Bias, robustness and scalability in single-cell differential expression analysis JO - Nat Methods VL - 15 UR - https://doi.org/10.1038/nmeth.4612 DO - 10.1038/nmeth.4612 ID - Soneson2018 ER - TY - JOUR AU - Saelens, W. AU - Cannoodt, R. AU - Saeys, Y. PY - 2018 DA - 2018// TI - A comprehensive evaluation of module detection methods for gene expression data JO - Nat Commun VL - 9 UR - https://doi.org/10.1038/s41467-018-03424-4 DO - 10.1038/s41467-018-03424-4 ID - Saelens2018 ER - TY - JOUR AU - Weber, L. M. AU - Robinson, M. D. PY - 2016 DA - 2016// TI - Comparison of clustering methods for high-dimensional single-cell flow and mass cytometry data JO - Cytometry Part A. VL - 89A UR - https://doi.org/10.1002/cyto.a.23030 DO - 10.1002/cyto.a.23030 ID - Weber2016 ER - TY - JOUR AU - Korthauer, K. AU - Kimes, P. K. AU - Duvallet, C. AU - Reyes, A. AU - Subramanian, A. AU - Teng, M. PY - 2019 DA - 2019// TI - A practical guide to methods controlling false discovery rates JO - Genome Biol VL - 20 UR - https://doi.org/10.1186/s13059-019-1716-1 DO - 10.1186/s13059-019-1716-1 ID - Korthauer2019 ER - TY - JOUR AU - Freytag, S. AU - Tian, L. AU - Lönnstedt, I. AU - Ng, M. AU - Bahlo, M. PY - 2018 DA - 2018// TI - Comparison of clustering tools in R for medium-sized 10x genomics single-cell RNA-sequencing data JO - F1000Research. VL - 7 UR - https://doi.org/10.12688/f1000research.15809.1 DO - 10.12688/f1000research.15809.1 ID - Freytag2018 ER - TY - JOUR AU - Baruzzo, G. AU - Hayer, K. E. AU - Kim, E. J. AU - Camillo, B. AU - FitzGerald, G. A. AU - Grant, G. R. PY - 2017 DA - 2017// TI - Simulation-based comprehensive benchmarking of RNA-seq aligners JO - Nat Methods VL - 14 UR - https://doi.org/10.1038/nmeth.4106 DO - 10.1038/nmeth.4106 ID - Baruzzo2017 ER - TY - JOUR AU - Kanitz, A. AU - Gypas, F. AU - Gruber, A. J. AU - Gruber, A. R. AU - Martin, G. AU - Zavolan, M. PY - 2015 DA - 2015// TI - Comparative assessment of methods for the computational inference of transcript isoform abundance from RNA-seq data JO - Genome Biol VL - 16 UR - https://doi.org/10.1186/s13059-015-0702-5 DO - 10.1186/s13059-015-0702-5 ID - Kanitz2015 ER - TY - JOUR AU - Soneson, C. AU - Delorenzi, M. PY - 2013 DA - 2013// TI - A comparison of methods for differential expression analysis of RNA-seq data JO - BMC Bioinformatics VL - 14 UR - https://doi.org/10.1186/1471-2105-14-91 DO - 10.1186/1471-2105-14-91 ID - Soneson2013 ER - TY - JOUR AU - Rapaport, F. AU - Khanin, R. AU - Liang, Y. AU - Pirun, M. AU - Krek, A. AU - Zumbo, P. PY - 2013 DA - 2013// TI - Comprehensive evaluation of differential gene expression analysis methods for RNA-seq data JO - Genome Biol VL - 14 UR - https://doi.org/10.1186/gb-2013-14-9-r95 DO - 10.1186/gb-2013-14-9-r95 ID - Rapaport2013 ER - TY - JOUR AU - Dillies, M. -. A. AU - Rau, A. AU - Aubert, J. AU - Hennequet-Antier, C. AU - Jeanmougin, M. AU - Servant, N. PY - 2012 DA - 2012// TI - A comprehensive evaluation of normalization methods for Illumina high-throughput RNA sequencing data analysis JO - Brief Bioinform VL - 14 UR - https://doi.org/10.1093/bib/bbs046 DO - 10.1093/bib/bbs046 ID - Dillies2012 ER - TY - JOUR AU - Sage, D. AU - Kirshner, H. AU - Pengo, T. AU - Stuurman, N. AU - Min, J. AU - Manley, S. PY - 2015 DA - 2015// TI - Quantitative evaluation of software packages for single-molecule localization microscopy JO - Nat Methods VL - 12 UR - https://doi.org/10.1038/nmeth.3442 DO - 10.1038/nmeth.3442 ID - Sage2015 ER - TY - JOUR AU - Weirauch, M. T. AU - Cote, A. AU - Norel, R. AU - Annala, M. AU - Zhao, Y. AU - Riley, T. R. PY - 2013 DA - 2013// TI - Evaluation of methods for modeling transcription factor sequence specificity JO - Nat Biotechnol VL - 31 UR - https://doi.org/10.1038/nbt.2486 DO - 10.1038/nbt.2486 ID - Weirauch2013 ER - TY - JOUR AU - Costello, J. C. AU - Heiser, L. M. AU - Georgii, E. AU - Gönen, M. AU - Menden, M. P. AU - Wang, N. J. PY - 2014 DA - 2014// TI - A community effort to assess and improve drug sensitivity prediction algorithms JO - Nat Biotechnol VL - 32 UR - https://doi.org/10.1038/nbt.2877 DO - 10.1038/nbt.2877 ID - Costello2014 ER - TY - JOUR AU - Küffner, R. AU - Zach, N. AU - Norel, R. AU - Hawe, J. AU - Schoenfeld, D. AU - Wang, L. PY - 2015 DA - 2015// TI - Crowdsourced analysis of clinical trial data to predict amyotrophic lateral sclerosis progression JO - Nat Biotechnol VL - 33 UR - https://doi.org/10.1038/nbt.3051 DO - 10.1038/nbt.3051 ID - Küffner2015 ER - TY - JOUR AU - Ewing, A. D. AU - Houlahan, K. E. AU - Hu, Y. AU - Ellrott, K. AU - Caloian, C. AU - Yamaguchi, T. N. PY - 2015 DA - 2015// TI - Combining tumor genome simulation with crowdsourcing to benchmark somatic single-nucleotide-variant detection JO - Nat Methods VL - 12 UR - https://doi.org/10.1038/nmeth.3407 DO - 10.1038/nmeth.3407 ID - Ewing2015 ER - TY - JOUR AU - Hill, S. M. AU - Heiser, L. M. AU - Cokelaer, T. AU - Unger, M. AU - Nesser, N. K. AU - Carlin, D. E. PY - 2016 DA - 2016// TI - Inferring causal molecular networks: empirical assessment through a community-based effort JO - Nat Methods VL - 13 UR - https://doi.org/10.1038/nmeth.3773 DO - 10.1038/nmeth.3773 ID - Hill2016 ER - TY - JOUR AU - Aghaeepour, N. AU - Finak, G. PY - 2013 DA - 2013// TI - The FlowCAP Consortium, the DREAM Consortium, Hoos H, Mosmann TR, et al. critical assessment of automated flow cytometry data analysis techniques JO - Nat Methods VL - 10 UR - https://doi.org/10.1038/nmeth.2365 DO - 10.1038/nmeth.2365 ID - Aghaeepour2013 ER - TY - JOUR AU - Aghaeepour, N. AU - Chattopadhyay, P. AU - Chikina, M. AU - Dhaene, T. AU - Gassen, S. AU - Kursa, M. PY - 2016 DA - 2016// TI - A benchmark for evaluation of algorithms for identification of cellular correlates of clinical outcomes JO - Cytometry Part A. VL - 89A UR - https://doi.org/10.1002/cyto.a.22732 DO - 10.1002/cyto.a.22732 ID - Aghaeepour2016 ER - TY - JOUR AU - Moult, J. AU - Fidelis, K. AU - Kryshtafovych, A. AU - Schwede, T. AU - Tramontano, A. PY - 2018 DA - 2018// TI - Critical assessment of methods of protein structure prediction (CASP) — round XII JO - Proteins. VL - 86 UR - https://doi.org/10.1002/prot.25415 DO - 10.1002/prot.25415 ID - Moult2018 ER - TY - JOUR AU - Moult, J. AU - Fidelis, K. AU - Kryshtafovych, A. AU - Schwede, T. AU - Tramontano, A. PY - 2016 DA - 2016// TI - Critical assessment of methods of protein structure prediction: Progress and new directions in round XI JO - Proteins. VL - 84 UR - https://doi.org/10.1002/prot.25064 DO - 10.1002/prot.25064 ID - Moult2016 ER - TY - JOUR AU - Sczyrba, A. AU - Hofmann, P. AU - Belmann, P. AU - Koslicki, D. AU - Janssen, S. AU - Dröge, J. PY - 2017 DA - 2017// TI - Critical assessment of metagenome interpretation—a benchmark of metagenomics software JO - Nat Methods VL - 14 UR - https://doi.org/10.1038/nmeth.4458 DO - 10.1038/nmeth.4458 ID - Sczyrba2017 ER - TY - JOUR AU - Earl, D. AU - Bradnam, K. AU - St John, J. AU - Darling, A. AU - Lin, D. AU - Fass, J. PY - 2011 DA - 2011// TI - Assemblathon 1: a competitive assessment of de novo short read assembly methods JO - Genome Res VL - 21 UR - https://doi.org/10.1101/gr.126599.111 DO - 10.1101/gr.126599.111 ID - Earl2011 ER - TY - JOUR AU - Bradnam, K. R. AU - Fass, J. N. AU - Alexandrov, A. AU - Baranay, P. AU - Bechner, M. AU - Birol, I. PY - 2013 DA - 2013// TI - Assemblathon 2: evaluating de novo methods of genome assembly in three vertebrate species JO - GigaScience. VL - 2 UR - https://doi.org/10.1186/2047-217X-2-10 DO - 10.1186/2047-217X-2-10 ID - Bradnam2013 ER - TY - JOUR AU - Consortium, M. A. Q. C. PY - 2006 DA - 2006// TI - The MicroArray quality control (MAQC) project shows inter- and intraplatform reproducibility of gene expression measurements JO - Nature Biotechnol. VL - 24 UR - https://doi.org/10.1038/nbt1239 DO - 10.1038/nbt1239 ID - Consortium2006 ER - TY - JOUR AU - Consortium, M. A. Q. C. PY - 2010 DA - 2010// TI - The microarray quality control (MAQC)-II study of common practices for the development and validation of microarray-based predictive models JO - Nature Biotechnol VL - 28 UR - https://doi.org/10.1038/nbt.1665 DO - 10.1038/nbt.1665 ID - Consortium2010 ER - TY - JOUR PY - 2014 DA - 2014// TI - A comprehensive assessment of RNA-seq accuracy, reproducibility and information content by the sequencing quality control Consortium JO - Nat Biotechnol VL - 32 UR - https://doi.org/10.1038/nbt.2957 DO - 10.1038/nbt.2957 ID - ref54 ER - TY - JOUR AU - Krusche, P. AU - Trigg, L. AU - Boutros, P. C. AU - Mason, C. E. AU - Vega, F. M. AU - Moore, B. L. PY - 2019 DA - 2019// TI - Best practices for benchmarking germline small-variant calls in human genomes JO - Nature Biotechnol. VL - 37 UR - https://doi.org/10.1038/s41587-019-0054-x DO - 10.1038/s41587-019-0054-x ID - Krusche2019 ER - TY - JOUR AU - Soneson, C. AU - Robinson, M. D. PY - 2016 DA - 2016// TI - iCOBRA: open, reproducible, standardized and live method benchmarking JO - Nat Methods VL - 13 UR - https://doi.org/10.1038/nmeth.3805 DO - 10.1038/nmeth.3805 ID - Soneson2016 ER - TY - JOUR AU - Soneson, C. AU - Robinson, M. D. PY - 2017 DA - 2017// TI - Towards unified quality verification of synthetic count data with countsimQC JO - Bioinformatics. VL - 34 UR - https://doi.org/10.1093/bioinformatics/btx631 DO - 10.1093/bioinformatics/btx631 ID - Soneson2017 ER - TY - STD TI - Korthauer K, Chakraborty S, Benjamini Y, Irizarry RA. Detection and accurate false discovery rate control of differentially methylated regions from whole genome bisulfite sequencing. Biostatistics. 2018:1–17. ID - ref58 ER - TY - JOUR AU - Caboche, S. AU - Audebert, C. AU - Lemoine, Y. AU - Hot, D. PY - 2014 DA - 2014// TI - Comparison of mapping algorithms used in high-throughput sequencing: application to ion torrent data JO - BMC Genomics VL - 15 UR - https://doi.org/10.1186/1471-2164-15-264 DO - 10.1186/1471-2164-15-264 ID - Caboche2014 ER - TY - JOUR AU - Grimm, D. G. AU - Azencott, C. -. A. AU - Aicheler, F. AU - Gieraths, U. AU - MacArthur, D. G. AU - Samocha, K. E. PY - 2015 DA - 2015// TI - The evaluation of tools used to predict the impact of missense variants is hindered by two types of circularity JO - Hum Mutat VL - 36 UR - https://doi.org/10.1002/humu.22768 DO - 10.1002/humu.22768 ID - Grimm2015 ER - TY - JOUR AU - Jelizarow, M. AU - Guillemot, V. AU - Tenenhaus, A. AU - Strimmer, K. AU - Boulesteix, A. -. L. PY - 2010 DA - 2010// TI - Over-optimism in bioinformatics: an illustration JO - Bioinformatics. VL - 26 UR - https://doi.org/10.1093/bioinformatics/btq323 DO - 10.1093/bioinformatics/btq323 ID - Jelizarow2010 ER - TY - JOUR AU - Jiang, L. AU - Schlesinger, F. AU - Davis, C. A. AU - Zhang, Y. AU - Li, R. AU - Salit, M. PY - 2011 DA - 2011// TI - Synthetic spike-in standards for RNA-seq experiments JO - Genome Res VL - 21 UR - https://doi.org/10.1101/gr.121095.111 DO - 10.1101/gr.121095.111 ID - Jiang2011 ER - TY - JOUR AU - Garalde, D. R. AU - Snell, E. A. AU - Jachimowicz, D. AU - Sipos, B. AU - Lloyd, J. H. AU - Bruce, M. PY - 2018 DA - 2018// TI - Highly parallel direct RNA sequencing on an array of nanopores JO - Nat Methods VL - 15 UR - https://doi.org/10.1038/nmeth.4577 DO - 10.1038/nmeth.4577 ID - Garalde2018 ER - TY - JOUR AU - Fang, F. AU - Hodges, E. AU - Molaro, A. AU - Dean, M. AU - Hannon, G. J. AU - Smith, A. D. PY - 2012 DA - 2012// TI - Genomic landscape of human allele-specific DNA methylation JO - Proc Natl Acad Sci U S A VL - 109 UR - https://doi.org/10.1073/pnas.1201310109 DO - 10.1073/pnas.1201310109 ID - Fang2012 ER - TY - JOUR PY - 2018 DA - 2018// TI - Single-cell transcriptomics of 20 mouse organs creates a tabula Muris JO - Nature. VL - 562 UR - https://doi.org/10.1038/s41586-018-0590-4 DO - 10.1038/s41586-018-0590-4 ID - ref65 ER - TY - JOUR AU - Zheng, G. X. Y. AU - Terry, J. M. AU - Belgrader, P. AU - Ryvkin, P. AU - Bent, Z. W. AU - Wilson, R. PY - 2017 DA - 2017// TI - Massively parallel digital transcriptional profiling of single cells JO - Nat Commun VL - 8 UR - https://doi.org/10.1038/ncomms14049 DO - 10.1038/ncomms14049 ID - Zheng2017 ER - TY - JOUR AU - Tian, L. AU - Dong, X. AU - Freytag, S. AU - Lê Cao, K. -. A. AU - Su, S. AU - JalalAbadi, A. PY - 2019 DA - 2019// TI - Benchmarking single cell RNA-sequencing analysis pipelines using mixture control experiments JO - Nat Methods VL - 16 UR - https://doi.org/10.1038/s41592-019-0425-8 DO - 10.1038/s41592-019-0425-8 ID - Tian2019 ER - TY - JOUR AU - Arvaniti, E. AU - Claassen, M. PY - 2017 DA - 2017// TI - Sensitive detection of rare disease-associated cell subsets via representation learning JO - Nat Commun VL - 8 UR - https://doi.org/10.1038/ncomms14825 DO - 10.1038/ncomms14825 ID - Arvaniti2017 ER - TY - JOUR AU - Rigaill, G. AU - Balzergue, S. AU - Brunaud, V. AU - Blondet, E. AU - Rau, A. AU - Rogier, O. PY - 2018 DA - 2018// TI - Synthetic data sets for the identification of key ingredients for RNA-seq differential analysis JO - Brief Bioinform VL - 19 ID - Rigaill2018 ER - TY - JOUR AU - Löwes, B. AU - Chauve, C. AU - Ponty, Y. AU - Giegerich, R. PY - 2017 DA - 2017// TI - The BRaliBase dent — a tale of benchmark design and interpretation JO - Brief Bioinform VL - 18 ID - Löwes2017 ER - TY - JOUR AU - Couronné, R. AU - Probst, P. AU - Boulesteix, A. -. L. PY - 2018 DA - 2018// TI - Random forest versus logistic regression: a large-scale benchmark experiment JO - BMC Bioinform VL - 19 UR - https://doi.org/10.1186/s12859-018-2264-5 DO - 10.1186/s12859-018-2264-5 ID - Couronné2018 ER - TY - JOUR AU - Schneider, J. AU - Hapfelmeier, A. AU - Thöres, S. AU - Obermeier, A. AU - Schulz, C. AU - Pförringer, D. PY - 2016 DA - 2016// TI - Mortality risk for acute cholangitis (MAC): a risk prediction model for in-hospital mortality in patients with acute cholangitis JO - BMC Gastroenterol VL - 16 UR - https://doi.org/10.1186/s12876-016-0428-1 DO - 10.1186/s12876-016-0428-1 ID - Schneider2016 ER - TY - JOUR AU - Hu, Q. AU - Greene, C. S. PY - 2019 DA - 2019// TI - Parameter tuning is a key part of dimensionality reduction via deep variational autoencoders for single cell RNA transcriptomics JO - Pac Symp Biocomput VL - 24 ID - Hu2019 ER - TY - STD TI - Vaquero-Garcia J, Norton S, Barash Y. LeafCutter vs. MAJIQ and comparing software in the fast moving field of genomics. bioRxiv. 2018:463927. ID - ref74 ER - TY - JOUR AU - Wiwie, C. AU - Baumbach, J. AU - Röttger, R. PY - 2015 DA - 2015// TI - Comparing the performance of biomedical clustering methods JO - Nat Methods VL - 12 UR - https://doi.org/10.1038/nmeth.3583 DO - 10.1038/nmeth.3583 ID - Wiwie2015 ER - TY - JOUR AU - Saito, T. AU - Rehmsmeier, M. PY - 2015 DA - 2015// TI - The precision-recall plot is more informative than the ROC plot when evaluating binary classifiers on imbalanced datasets JO - PLoS One VL - 10 UR - https://doi.org/10.1371/journal.pone.0118432 DO - 10.1371/journal.pone.0118432 ID - Saito2015 ER - TY - JOUR AU - Powers, D. M. W. PY - 2015 DA - 2015// TI - Visualization of tradeoff in evaluation: from precision-recall & PN to LIFT, ROC & BIRD JO - arXiv VL - 1505 ID - Powers2015 ER - TY - JOUR AU - Soneson, C. AU - Love, M. I. AU - Robinson, M. D. PY - 2016 DA - 2016// TI - Differential analyses for RNA-seq: transcript-level estimates improve gene-level inferences JO - F1000Res. VL - 4 UR - https://doi.org/10.12688/f1000research.7563.2 DO - 10.12688/f1000research.7563.2 ID - Soneson2016 ER - TY - JOUR AU - Lindgreen, S. AU - Adair, K. L. AU - Gardner, P. P. PY - 2016 DA - 2016// TI - An evaluation of the accuracy and speed of metagenome analysis tools JO - Sci Rep VL - 6 UR - https://doi.org/10.1038/srep19233 DO - 10.1038/srep19233 ID - Lindgreen2016 ER - TY - JOUR AU - Gurevich, A. AU - Saveliev, V. AU - Vyahhi, N. AU - Tesler, G. PY - 2013 DA - 2013// TI - QUAST: quality assessment tool for genome assemblies JO - Bioinformatics. VL - 29 UR - https://doi.org/10.1093/bioinformatics/btt086 DO - 10.1093/bioinformatics/btt086 ID - Gurevich2013 ER - TY - JOUR AU - Narzisi, G. AU - Mishra, B. PY - 2011 DA - 2011// TI - Comparing de novo genome assembly: the long and short of it JO - PLoS One VL - 6 UR - https://doi.org/10.1371/journal.pone.0019175 DO - 10.1371/journal.pone.0019175 ID - Narzisi2011 ER - TY - STD TI - Schreiber J, Singh R, Bilmes J, Noble WS. A pitfall for machine learning methods aiming to predict across cell types. bioRxiv. 2019:512434. ID - ref82 ER - TY - JOUR AU - Bischl, B. AU - Schiffner, J. AU - Weihs, C. PY - 2013 DA - 2013// TI - Benchmarking local classification methods JO - Comput Stat VL - 28 UR - https://doi.org/10.1007/s00180-013-0420-y DO - 10.1007/s00180-013-0420-y ID - Bischl2013 ER - TY - JOUR AU - Mangul, S. AU - Martin, L. S. AU - Eskin, E. AU - Blekhman, R. PY - 2019 DA - 2019// TI - Improving the usability and archival stability of bioinformatics software JO - Genome Biol VL - 20 UR - https://doi.org/10.1186/s13059-019-1649-8 DO - 10.1186/s13059-019-1649-8 ID - Mangul2019 ER - TY - STD TI - Mangul S, Mosqueiro T, Abdill RJ, Duong D, Mitchell K, Sarwal V, et al. Challenges and recommendations to improve installability and archival stability of omics computational tools. bioRxiv. 2019:452532. ID - ref85 ER - TY - JOUR AU - Freyhult, E. K. AU - Bollback, J. P. AU - Gardner, P. P. PY - 2007 DA - 2007// TI - Exploring genomic dark matter: a critical assessment of the performance of homology search methods on noncoding RNA JO - Genome Res VL - 17 UR - https://doi.org/10.1101/gr.5890907 DO - 10.1101/gr.5890907 ID - Freyhult2007 ER - TY - JOUR AU - Bokulich, N. A. AU - Rideout, J. R. AU - Mercurio, W. G. AU - Shiffer, A. AU - Wolfe, B. AU - Maurice, C. F. PY - 2016 DA - 2016// TI - Mockrobiota: a public resource for microbiome bioinformatics benchmarking JO - mSystems. VL - 1 UR - https://doi.org/10.1128/mSystems.00062-16 DO - 10.1128/mSystems.00062-16 ID - Bokulich2016 ER - TY - JOUR AU - Conchúir, S. O. AU - Barlow, K. A. AU - Pache, R. A. AU - Ollikainen, N. AU - Kundert, K. AU - O’Meara, M. J. PY - 2015 DA - 2015// TI - A web resource for standardized benchmark datasets, metrics, and Rosetta protocols for macromolecular modeling and design JO - PLoS One VL - 10 UR - https://doi.org/10.1371/journal.pone.0130433 DO - 10.1371/journal.pone.0130433 ID - Conchúir2015 ER - TY - JOUR AU - Cope, L. M. AU - Irizarry, R. A. AU - Jaffee, H. A. AU - Wu, Z. AU - Speed, T. P. PY - 2004 DA - 2004// TI - A benchmark for Affymetrix GeneChip expression measures JO - Bioinformatics. VL - 20 UR - https://doi.org/10.1093/bioinformatics/btg410 DO - 10.1093/bioinformatics/btg410 ID - Cope2004 ER - TY - JOUR AU - Irizarry, R. A. AU - Wu, Z. AU - Jaffee, H. A. PY - 2006 DA - 2006// TI - Comparison of Affymetrix GeneChip expression measures JO - Bioinformatics. VL - 22 UR - https://doi.org/10.1093/bioinformatics/btk046 DO - 10.1093/bioinformatics/btk046 ID - Irizarry2006 ER - TY - STD TI - Barton M. nucleotid.es: an assembler catalogue. http://nucleotid.es/. Accessed 4 June 2019. UR - http://nucleotid.es/ ID - ref91 ER - TY - JOUR AU - Ioannidis, J. P. A. PY - 2005 DA - 2005// TI - Why most published research findings are false JO - PLoS Med VL - 2 UR - https://doi.org/10.1371/journal.pmed.0020124 DO - 10.1371/journal.pmed.0020124 ID - Ioannidis2005 ER - TY - JOUR AU - Peng, R. D. PY - 2011 DA - 2011// TI - Reproducible research in computational science JO - Science. VL - 334 UR - https://doi.org/10.1126/science.1213847 DO - 10.1126/science.1213847 ID - Peng2011 ER - TY - JOUR AU - Zhou, X. AU - Robinson, M. D. PY - 2015 DA - 2015// TI - Do count-based differential expression methods perform poorly when genes are expressed in only one condition? JO - Genome Biol VL - 16 UR - https://doi.org/10.1186/s13059-015-0781-3 DO - 10.1186/s13059-015-0781-3 ID - Zhou2015 ER - TY - JOUR AU - Zhou, X. AU - Oshlack, A. AU - Robinson, M. D. PY - 2013 DA - 2013// TI - miRNA-Seq normalization comparisons need improvement JO - RNA. VL - 19 UR - https://doi.org/10.1261/rna.037895.112 DO - 10.1261/rna.037895.112 ID - Zhou2013 ER - TY - JOUR AU - Hofner, B. AU - Schmid, M. AU - Edler, L. PY - 2016 DA - 2016// TI - Reproducible research in statistics: a review and guidelines for the biometrical journal JO - Biom J VL - 58 UR - https://doi.org/10.1002/bimj.201500156 DO - 10.1002/bimj.201500156 ID - Hofner2016 ER - TY - STD TI - Boulesteix A-L, Janitza S, Hornung R, Probst P, Busen H, Hapfelmeier A. Making complex prediction rules applicable for readers: current practice in random forest literature and recommendations. Biom J. 2018. https://doi.org/10.1002/bimj.201700243. ID - ref97 ER - TY - JOUR AU - Afgan, E. AU - Baker, D. AU - Batut, B. AU - Beek, M. AU - Bouvier, D. AU - Čech, M. PY - 2018 DA - 2018// TI - The galaxy platform for accessible, reproducible and collaborative biomedical analyses: 2018 update JO - Nucleic Acids Res VL - 46 UR - https://doi.org/10.1093/nar/gky379 DO - 10.1093/nar/gky379 ID - Afgan2018 ER - TY - JOUR AU - Kimes, P. K. AU - Reyes, A. PY - 2019 DA - 2019// TI - Reproducible and replicable comparisons using SummarizedBenchmark JO - Bioinformatics. VL - 35 UR - https://doi.org/10.1093/bioinformatics/bty627 DO - 10.1093/bioinformatics/bty627 ID - Kimes2019 ER - TY - JOUR AU - Finak, G. AU - Mayer, B. AU - Fulp, W. AU - Obrecht, P. AU - Sato, A. AU - Chung, E. PY - 2018 DA - 2018// TI - DataPackageR: reproducible data preprocessing, standardization and sharing using R/Bioconductor for collaborative data analysis JO - Gates Open Res VL - 2 UR - https://doi.org/10.12688/gatesopenres.12832.2 DO - 10.12688/gatesopenres.12832.2 ID - Finak2018 ER - TY - STD TI - Blischak J, Carbonetto P, Stephens M. Workflowr: organized + reproducible + shareable data science in R. https://jdblischak.github.io/workflowr/. Accessed 4 June 2019. UR - https://jdblischak.github.io/workflowr/ ID - ref101 ER - TY - STD TI - Wang G, Stephens M, Carbonetto P. DSC: Dynamic Statistical Comparisons https://stephenslab.github.io/dsc-wiki/index.html. Accessed 4 June 2019. UR - https://stephenslab.github.io/dsc-wiki/index.html ID - ref102 ER - TY - JOUR AU - Vanschoren, J. AU - Rijn, J. N. AU - Bischl, B. AU - Torgo, L. PY - 2014 DA - 2014// TI - OpenML: networked science in machine learning JO - SIGKDD Explor VL - 15 UR - https://doi.org/10.1145/2641190.2641198 DO - 10.1145/2641190.2641198 ID - Vanschoren2014 ER - TY - JOUR AU - Köster, J. AU - Rahmann, S. PY - 2012 DA - 2012// TI - Snakemake — a scalable bioinformatics workflow engine JO - Bioinformatics. VL - 28 UR - https://doi.org/10.1093/bioinformatics/bts480 DO - 10.1093/bioinformatics/bts480 ID - Köster2012 ER - TY - JOUR AU - Grüning, B. AU - Dale, R. AU - Sjödin, A. AU - Chapman, B. A. AU - Rowe, J. AU - Tomkins-Tinch, C. H. PY - 2018 DA - 2018// TI - Bioconda: sustainable and comprehensive software distribution for the life sciences JO - Nat Methods VL - 15 UR - https://doi.org/10.1038/s41592-018-0046-7 DO - 10.1038/s41592-018-0046-7 ID - Grüning2018 ER - TY - JOUR AU - Kolesnikov, N. AU - Hastings, E. AU - Keays, M. AU - Melnichuk, O. AU - Tang, Y. A. AU - Williams, E. PY - 2015 DA - 2015// TI - ArrayExpress update — simplifying data submissions JO - Nucleic Acids Res VL - 43 UR - https://doi.org/10.1093/nar/gku1057 DO - 10.1093/nar/gku1057 ID - Kolesnikov2015 ER - TY - JOUR AU - Barrett, T. AU - Wilhite, S. E. AU - Ledoux, P. AU - Evangelista, C. AU - Kim, I. F. AU - Tomashevsky, M. PY - 2013 DA - 2013// TI - NCBI GEO: archive for functional genomics data sets — update JO - Nucleic Acids Res VL - 41 UR - https://doi.org/10.1093/nar/gks1193 DO - 10.1093/nar/gks1193 ID - Barrett2013 ER - TY - JOUR AU - Spidlen, J. AU - Breuer, K. AU - Rosenberg, C. AU - Kotecha, N. AU - Brinkman, R. R. PY - 2012 DA - 2012// TI - FlowRepository: a resource of annotated flow cytometry datasets associated with peer-reviewed publications JO - Cytometry Part A VL - 81A UR - https://doi.org/10.1002/cyto.a.22106 DO - 10.1002/cyto.a.22106 ID - Spidlen2012 ER - TY - JOUR AU - Sandve, G. K. AU - Nekrutenko, A. AU - Taylor, J. AU - Hovig, E. PY - 2013 DA - 2013// TI - Ten simple rules for reproducible computational research JO - PLoS Comput Biol VL - 9 UR - https://doi.org/10.1371/journal.pcbi.1003285 DO - 10.1371/journal.pcbi.1003285 ID - Sandve2013 ER -