Performance evaluation of dimensionality reduction techniques on high dimensional data

Abstract

With a large amount of data being generated each day, the task on analyzing and making inferences from data is becoming an increasingly challenging task. One of the major challenges is the curse of dimensionality which is dealt with by using several popular dimensionality reduction techniques such as ICA, PCA, NMF etc. In this work, we make a systematic performance evaluation of the efficiency and effectiveness of various dimensionality reduction techniques. We present a rigorous evaluation of various techniques benchmarked on real-world datasets. This work is intended to assist data science practitioners to select the most suitable dimensionality reduction technique based on the trade-off between the corresponding effectiveness and efficiency. �2019 IEEE.