A comparison of dimensionality reduction methods for large biological data

Abstract

Large-scale data often suffer from the curse of dimensionality and the constraints associated with it; therefore, dimensionality reduc- tion methods are often performed prior to most machine learning pipelines. In this paper, we directly compare autoencoders perfor- mance as a dimensionality reduction technique (via the latent space) to other established methods: PCA, LASSO, and t-SNE. To do so, we use four distinct datasets that vary in the types of features, meta- data, labels, and size to robustly compare different methods. We test prediction capability using both Support Vector Machines (SVM) and Random Forests (RF). Significantly, we conclude that autoen- coders are an equivalent dimensionality reduction architecture to the previously established methods, and often outperform them in both prediction accuracy and time performance when condensing large, sparse datasets. CCS CONCEPTS •Computing methodologies → Feature selection; Cross-validation; Supervised learning by classification; Learning latent repre- sentations; Classification and regression trees; Support vector machines.