doiSerbia

A supervised manifold learning method

Li Zuojin (College of Automation, Chongqing University, Shapingba District, Chongqing, China)
Shi Weiren (College of Automation, Chongqing University, Shapingba District, Chongqing, China)
Shi Xin (College of Automation, Chongqing University, Shapingba District, Chongqing, China)
Zhong Zhi (The Smartech Institute, Room Anhui Building, Futian District, Shenzhen, China)

The Locally Linear Embedding (LLE) algorithm is an unsupervised nonlinear dimensionality-reduction method, which reports a low recognition rate in classification because it gives no consideration to the label information of sample distribution. In this paper, a classification method of supervised LLE (SLLE) based on Linear Discriminant Analysis (LDA) is proposed. First, samples are classified according to their label values, and low dimensional features of intraclass data are expressed through LLE manifold learning. Then, the base vectors in Fisher subspace of the low dimensional features are generated through LDA learning. This method increases inter-class variation, and decreases the intra-class variation when samples are projected to the Fisher subspace. Hence, the samples of different labels can be recognized, and the recognition rate and robustness of the LLE learning are improved. Experiments on handwritten digit recognition show that the proposed method is featuring high recognition rate.

Keywords: manifold learning, locally linear embedding, fisher subspace, manifold perception