Abstract
Due to limited amount of experimental validation datasets, data analysis methods for identifying differential expression based on high-throughput expression profiling technologies such as microarray and RNA-seq cannot be statistically validated properly, and thus guidelines for selecting an appropriate method are lacking. We applied mRNA spike-in approaches to develop a comprehensive set of experimental benchmark data and used it to evaluate various methods for identification of differential expression. Our results show that using the median log ratio to identify differential expression is superior to more complex and popular methods such as modified t-statistics. The median log ratio method is robust that a reasonably high accuracy of identification of differentially expressed genes can be achieved even for data with a small number of replicates and strong experimental variation between replicates. Machine learning for classification of differential expression based on the benchmark dataset indicates the existence of even more accurate methods for identification of differential expression. With this dataset, it can be also demonstrated that the methods prediction of false discovery rate based on a small number of replicates could be very inaccurate.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Yang, H., Haddad, H., Tomas, C., Alsaker, K., Papoutsakis, E.T.: A segmental nearest neighbor normalization and gene identification method gives superior results for DNA-array analysis. Proc. Natl. Acad. Sci. USA 100, 1122–1127 (2003)
Hsiao, A., Worrall, D.S., Olefsky, J.M., Subramaniam, S.: Variance-modeled posterior inference of microarray data: detecting gene-expression changes in 3T3-L1 adipocytes. Bioinformatics 20, 3108–3127 (2004)
Tusher, V.G., Tibshirani, R., Chu, G.: Significance analysis of microarrays applied to the ionizing radiation response. Proc. Natl. Acad. Sci. USA 98, 5116–5121 (2001)
Broberg, P.: Statistical methods for ranking differentially expressed genes. Genome Biol. 4, R41 (2003)
Mazurek, U., Owczarek, A., Nowakowska-Zajdel, E., Wierzgon, J., Grochowska-Niedworok, E., Kokot, T., Muc-Wierzgon, M.: Statistical analysis of differential gene expression in colorectal cancer using CLEAR-test. J. Biol. Regul Homeost. Agents 25, 279–283 (2011)
Vaes, E., Khan, M., Mombaerts, P.: Statistical analysis of differential gene expression relative to a fold change threshold on NanoString data of mouse odorant receptor genes. BMC Bioinformatics 15, 39 (2014)
Rapaport, F., Khanin, R., Liang, Y., Pirun, M., Krek, A., Zumbo, P., Mason, C.E., Socci, N.D., Betel, D.: Comprehensive evaluation of differential gene expression analysis methods for RNA-seq data. Genome Biol. 14, R95 (2013)
Chua, S.W., Vijayakumar, P., Nissom, P., Yam, C.Y., Wong, V.T., Yang, H.: A novel normalization method for effective removal of systematic variation in microarray data. Nuclei Acid Research 34, e38 (2006)
Tomas, C., Alsaker, K., Bonarius, H., Hendriksen, W., Yang, H., Beamish, J.A., Paredes, C., Papoutsakis, E.T.: DNA array-based transcriptional analysis of asporogenous, nonsolventogenic Clostridium acetobutylicum strains SKO1 and M5. J. Bacteriol. 185, 4539–4547 (2003)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Yang, H. (2016). Systematic Evaluation of Gene Expression Data Analysis Methods Using Benchmark Data. In: Saberi Mohamad, M., Rocha, M., Fdez-Riverola, F., DomÃnguez Mayo, F., De Paz, J. (eds) 10th International Conference on Practical Applications of Computational Biology & Bioinformatics. PACBB 2016. Advances in Intelligent Systems and Computing, vol 477. Springer, Cham. https://doi.org/10.1007/978-3-319-40126-3_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-40126-3_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-40125-6
Online ISBN: 978-3-319-40126-3
eBook Packages: EngineeringEngineering (R0)