Skip to main content

Table 5 Performance metrics for the assessment of cross-platform transferability of signature genes of k-NN models based on the SEQC NB data

From: An investigation of biomarkers derived from legacy microarray data for their utility in the RNA-seq era

Direction Endpoint Gene set Microarray models Is predict microarray validation samples RNA-Seq models predict RNA-Seq validation samples T-index
Accuracy AUC Accuracy AUC
Mean 95% CI Mean 95% CI Mean 95% CI Mean 95% CI
From microarray to RNA-Seq A* A 0.732 0.667-0.775 0.708 0.645-0.758 0.728 0.653-0.771 0.696 0.627-0.746 0.729
B 0.721 0.655-0.759 0.691 0.631-0.733 0.714 0.647-0.759 0.678 0.614-0.726 0.716
C 0.696 0.639-0.735 0.664 0.609-0.704 0.702 0.654-0.747 0.670 0.631-0.713 0.700
B* A 0.780 0.747-0.811 0.667 0.615-0.72 0.787 0.755-0.815 0.648 0.601-0.694 0.786
B 0.777 0.743-0.807 0.643 0.585-0.704 0.794 0.755-0.827 0.659 0.580-0.725 0.791
C 0.789 0.739-0.827 0.678 0.613-0.732 0.788 0.747-0.819 0.660 0.620-0.711 0.788
C* A 0.978 0.971-0.992 0.978 0.971-0.992 0.992 0.992-0.992 0.992 0.992-0.992 0.992
B 0.989 0.983-0.992 0.989 0.984-0.992 0.989 0.983-0.992 0.989 0.984-0.992 0.989
C 0.931 0.900-0.954 0.935 0.905-0.958 0.988 0.975-0.992 0.988 0.976-0.992 0.984
D* A 0.934 0.882-0.971 0.920 0.863-0.962 0.921 0.882-0956 0.895 0.848-0.940 0.921
B 0.947 0.824-0.978 0.938 0.798-0.973 0.933 0.772-0.978 0.915 0.737-0.967 0.934
C 0.915 0.838-0.956 0.911 0.841-0.961 0.921 0.853-0.963 0.914 0.840-0.956 0.920
E* A 0.624 0.533-0.700 0.534 0.463-0.615 0.606 0.522-0.689 0.537 0.460-0.617 0.612
B 0.562 0.478-0.623 0.507 0.417-0.588 0.569 0.500-0.633 0.519 0.443-0.595 0.566
C 0.607 0.511-0.689 0.513 0.437-0.603 0.599 0.511-0.689 0.515 0.438-0.603 0.602
F* A 0.513 0.444-0.589 0.513 0.446-0.585 0.510 0.433-0.589 0.510 0.426-0.589 0.511
B 0.507 0.456-0.567 0.511 0.452-0.572 0.490 0.422-0.556 0.498 0.431-0.562 0.498
C 0.532 0.456-0.611 0.534 0.460-0.609 0.527 0.444-0.611 0.531 0.448-0.611 0.529
From RNA-Seq to microarray A* A 0.701 0.614-0.759 0.669 0.590-0.732 0.709 0.643-0.759 0.671 0.603-0.727 0.703
B 0.680 0.584-0.741 0.644 0.543-0.708 0.693 0.604-0.747 0.651 0.568-0.710 0.684
C 0.719 0.647-0.767 0.691 0.618-0.748 0.730 0.648-0.771 0.698 0.621-0.743 0.722
B* A 0.775 0.715-0.819 0.662 0.576-0.737 0.775 0.733-0.811 0.640 0.579-0.696 0.775
B 0.777 0.715-0.819 0.639 0.552-0.713 0.785 0.735-0.825 0.640 0.566-0.718 0.778
C 0.792 0.749-0.823 0.681 0.621-0.757 0.790 0.753-0.819 0.659 0.606-0.728 0.791
C* A 0.971 0.967-0.992 0.972 0.969-0.992 0.984 0.983-0.992 0.985 0.984-0.992 0.971
B 0.939 0.900-0.950 0.943 0.901-0.954 0.990 0.988-0.992 0.990 0.988-0.992 0.939
C 0.987 0.975-0.992 0.987 0.975-0.992 0.987 0.971-0.992 0.987 0.972-0.992 0.987
D* A 0.914 0.809-0.971 0.899 0.792-0.957 0.927 0.868-0.963 0.910 0.841-0.951 0.915
B 0.918 0.838-0.963 0.907 0.825-0.962 0.928 0.860-0.971 0.908 0.836-0.957 0.918
C 0.937 0.875-0.978 0.923 0.853-0.973 0.933 0.882-0.971 0.913 0.882-0.962 0.937
E* A 0.598 0.456-0.689 0.506 0.414-0.606 0.598 0.444-0.700 0.522 0.400-0.630 0.598
B 0612 0.511-0.700 0.513 0.432-0.602 0.588 0.489-0.678 0.510 0.415-0.613 0.603
C 0.582 0.478-0.667 0.512 0.412-0.633 0.596 0.500-0.689 0.522 0.432-0.615 0.587
F* A 0.507 0.433-0.600 0.502 0.421-0.590 0.498 0.400-0.600 0.496 0.406-0.597 0.503
B 0.500 0.411-0.595 0.503 0.414-0.596 0.493 0.400-0.589 0.503 0.411-0.601 0.496
C 0.523 0.456-0.600 0.527 0.452-0.602 0.498 0.405-0.578 0.505 0.411-0.59 0.511
  1. A*: A_EFS_All; B*: B_OS_All; C*: C_SEX_All; D*: D_FAV_All; E*: E_EFS_HR; F*: F_OS_HR; AUC: Area under ROC curve; CI: Confidence interval; 95% CI was calculated from the bootstrap estimation. The upper-right and lower-left regions are for the untrained models built using cross-platform transferred signature genes, while the upper-left and lower-right regions are for the models originally trained.