Fuzziness-based active learning framework to enhance hyperspectral image classification performance for discriminative and generative classifiers

Muhammad Ahmad; Stanislav Protasov; Adil Mehmood Khan; Rasheed Hussain; Asad Masood Khattak; Wajahat Ali Khan

doi:10.1371/journal.pone.0188996

Abstract

Hyperspectral image classification with a limited number of training samples without loss of accuracy is desirable, as collecting such data is often expensive and time-consuming. However, classifiers trained with limited samples usually end up with a large generalization error. To overcome the said problem, we propose a fuzziness-based active learning framework (FALF), in which we implement the idea of selecting optimal training samples to enhance generalization performance for two different kinds of classifiers, discriminative and generative (e.g. SVM and KNN). The optimal samples are selected by first estimating the boundary of each class and then calculating the fuzziness-based distance between each sample and the estimated class boundaries. Those samples that are at smaller distances from the boundaries and have higher fuzziness are chosen as target candidates for the training set. Through detailed experimentation on three publically available datasets, we showed that when trained with the proposed sample selection framework, both classifiers achieved higher classification accuracy and lower processing time with the small amount of training data as opposed to the case where the training samples were selected randomly. Our experiments demonstrate the effectiveness of our proposed method, which equates favorably with the state-of-the-art methods.

Citation: Ahmad M, Protasov S, Khan AM, Hussain R, Khattak AM, Khan WA (2018) Fuzziness-based active learning framework to enhance hyperspectral image classification performance for discriminative and generative classifiers. PLoS ONE 13(1): e0188996. https://doi.org/10.1371/journal.pone.0188996

Editor: Leonie Anna Mueck, PLOS, UNITED KINGDOM

Received: March 6, 2017; Accepted: November 16, 2017; Published: January 5, 2018

Copyright: © 2018 Ahmad et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Data Availability: All relevant data sets and ground truths are available within the Supporting Information information files or online at https://engineering.purdue.edu/~biehl/MultiSpec/hyperspectral.html.

Funding: This work was mainly supported by a grant from Kyung Hee University in 2017 (KHU-20170724) to WAK and was partially supported by the Zayed University Research Initiative Fund (# R17057) to AMK. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Competing interests: The authors have declared that no competing interests exist.

Introduction

Remote sensing is a mature field of science and extensively studied to extract the meaningful information from earth surface or objects of interest based on their radiance acquired by the given sensors at short or medium distance [1] [2]. One of the types of remote sensing is hyperspectral sensing also referred to as “hyperspectral imaging”. Hyperspectral imaging has been widely employed in real life applications such as pharmaceutical and food process for quality control and monitoring, forensic (Ink mismatches detection or segmentation in forensic document analysis), industrial, biomedical, and biometric applications such as face detection and recognition [3]. Additionally, in recent years, hyperspectral imaging has also been studied in a wide range of urban, environmental, mineral exploration, and security-related applications.

Nowadays, researchers are broadly studying hyperspectral image classification techniques for the case of a limited number of training samples, both with and without reducing the dimensionality of hyperspectral data. In this regard, the recent works [4] [5] [6] [7] [8] demonstrate that the choice of classification approach is important future research direction. Therefore, we discuss some of the main supervised and semi-supervised hyperspectral image classification techniques and their challenges.

Supervised learning techniques, which require class label information, have been widely studied for hyperspectral image classification [9]; however, these learning models face various challenges for hyperspectral image classification including but not limited to, high dimensionality of hyperspectral data and an insufficient number of labeled training samples for learning the Model [3] [10]. Collecting a large number of labeled training samples is time-intensive, challenging, and expensive because the labels of training samples are selected through human-machine interaction [11].

To cope with the issues that are discussed above, several techniques have been developed. These include discriminant analysis algorithms with different discriminant functions (e.g. nearest neighbor, linear and nonlinear functions) [12] [13], feature-mining [14], decision trees, and subspace-nature approaches [15]. The goal of subspace-nature and feature-mining approaches is to reduce the high dimensionality of hyperspectral data to better utilize the limited accessibility of the labeled training samples. The main problem of discriminant analysis is its sensitivity to the “Hughes phenomenon” [16]. The kernel based methods, like support vector machines (SVMs), have also been used to deal with the Hughes phenomenon or curse of dimensionality [17] [18] [19].

To some extent, semi-supervised approaches have addressed the problem of a limited number of labeled training samples by generating the labels though machine-machine interaction. The primary assumption of semi-supervised classification methods is that the newly labeled samples for learning can be generated with a certain degree of confidence from a set of limited available labeled training samples without considerable cost and efforts [20] [21]. Semi-supervised techniques have been significantly improved in recent years. For example, in [22] Bruzzone et al. proposed “transductive SVMs”, in [23], Camps-Valls et al. proposed a “graph-based method to exploit the importance of labeled training samples” and in [24], Velasco-Forero et al. proposed a “composite kernel in graph-based classification method”. In [25], Tuia et al. proposed a “semi-supervised SVM using cluster kernels method”, whereas in [26], Li et al. explained a “semi-supervised approach which uses a spatial-multi-level logistic prior method”. In [27], Bruzzone et al. proposed a “context sensitive semi-supervised SVM method” and Munoz-Mari et al. presented two semi-supervised single-class SVM methods in [28]. Their first technique models the data marginal distribution with graph-Laplacian built with both labeled and unlabeled training samples, whereas the other technique is used for the modification of the SVM cost function, which massively penalizes the errors made when wrongly classifying the samples for the target class. The algorithm proposed in [29] is based on a sample selection bias problem in contrast to [29], [30] where the authors proposed an SVM with a linear combination of two kernels (likelihood and base kernels). The works [31] and [32] done by Rattle, et al. and Munoz-Mari et al. respectively, exploited a similar concept using a neural network as the baseline classification algorithm. To generate the land-cover maps, they adopted a semi-automatic technique using active queries concept.

All the techniques discussed above assume that the labeled training samples are limited in number, and these methods enlarge the initial training set by efficiently exploiting the unlabeled samples to address the “ill-posed problem”. However, to achieve the desired results, several vital requirements need to be met. For example, the quantity of the generated data should not be too large such that it may increase the computational complexity, and the samples should be properly selected to avoid any confusion in correctly classifying the unseen samples. Above all, the obtained samples and their class labels must be obtained without substantial cost and time.

Active learning techniques can be used to overcome the above-mentioned issues. In general, active learning techniques are referred to as a special subcategory of semi-supervised learning techniques [33] [34]. Without loss of generality, in active learning, the learning model actively requests the user for class information. To this end, the most recent developments are “hybrid active-learning [35]” and “active learning in a single pass-context [36]”, which combine the concepts of adaptive and incremental learning from the field of traditional and online machine-learning. These breakthroughs have resulted in a significant number of different active-learning methods such as reported in [11] [26] [33] [36] [37] [38] [49] [50] [51] [52] [53].

In general, the additional labeled samples are selected randomly or by using some information criteria or source of information to query the samples and their class information. Random selection of the training samples is more-often subjective and tends to bring redundancy into the classifiers. Furthermore, it reduces the generalization performance of the classifiers. Moreover, the number of samples required to learn a model can be much lower than the number of used samples. In such scenarios, there is a risk that the learning model may get overwhelmed because of the uninformative samples queried by the learning model.

To this end, in this work, an active learning framework using a single sample view critical-class-oriented query is proposed for hyperspectral image classification. We call this scheme fuzziness-based active learning framework (FALF). In FALF, the classifier comes with an integrated data acquisition module that ranks unlabeled samples based on their confidence for the future query that has the maximum learning utility. Thus, the proposed framework aims to achieve the maximum potential of the learning model using both labeled and unlabeled data, whereas the amount of training data can be kept to a minimum by focusing only on the most informative training samples. This process leads to a better utilization of information in the data, while considerably minimizing the cost of labeled data collection and improving the generalization performance of the classifiers.

The primary goal of FALF is to focus on selecting difficult samples for the hyperspectral classification task. In conjunction with “Discriminative” and “Generative” classifiers, hardly predicted sample pairs are first identified by using the instability of classification boundary. A category level guidance for which sample should be queried next is then provided to the active querier. Samples with higher fuzziness and lower distance to the class boundaries are considered as the difficult samples and are queried first. This strategy of identifying the most informative samples is based on the hypothesis that, the samples that are far from class boundaries have a lower risk of being misclassified as compared to the samples that are closer. Moreover, two selection approaches are implemented and compared. The first approach randomly selects samples based on their entire fuzziness magnitude; whereas the second approach incorporates only the hardly predicted samples from higher fuzziness magnitude group.

These methods are developed for a single sample-based critical class query strategy. The experiments are conducted on both AVIRIS and ROSIS-03 hyperspectral data sets. Classification performance was superior to the state-of-the-art active learning methods. It is worth mentioning that the proposed framework is a two-fold process in which learning is first done in a fully supervised fashion, and then semi-supervised learning is used to select the appropriate candidates for the training set. Furthermore, traditional active learning methodologies add new samples to the training data with their original labels, whereas in the proposed framework, the new samples are added in a semi-supervised fashion with their predicted class labels.

To summarize, the primary contributions of our work are as follows:

Designing and implementing a new fuzziness-based active learning framework to select the optimal training samples to enhance the classifier’s generalization performance for hyperspectral image classification.
Validation of the effectiveness of the proposed framework for two different kinds of classifiers on three publicly available datasets (both AVIRIS and ROSIS-03 datasets).
Investigating the potential of the proposed framework to reduce the classification time while maintaining a good accuracy under high dimensionality.

Materials and methods

The main idea of this work is to employ and retain the relationship between misclassification rate of boundary samples and fuzziness for each class to select samples for the training set. The important steps of our proposed algorithm are summarized below:

Randomly select 5% of labeled training samples from each class.
Train Support Vector Machine (SVM) and Fuzzy K-Nearest Neighbor (FKNN) on randomly selected samples and test them for the rest of the samples.
Record the fuzzy membership matrix.
Calculate the fuzziness from fuzzy membership matrix for each sample and estimate the distance between the sample and the boundary.
Based on the threshold of fuzziness magnitude, divide the samples into two subgroups as lower and higher fuzziness magnitude groups.
Determine the correct rate of classification and misclassification (i.e., TP and FP) for each class in both groups individually.
(A): Pick 5% of the hardest correctly predicted samples, i.e. the samples with higher fuzziness and lower distance to the boundary. OR (B): Randomly select 5% of the correctly predicted samples, without taking into account their fuzziness and distance from the class boundary. (Step 5), i.e. the samples with high/lower fuzziness and lower/higher distance to the boundary.
Retrain the classifiers after adding the selected samples back into the original training set using step 7 (A) or (B), individually, and predict the rest of the samples and determine the accuracy respectively.

It is to be noted that step 7 (A) and (B) are two alternative ways to select the samples. In general active learning approaches, the samples are selected through step 7 (B), but we propose to select the samples using step 7 (A) and compare the accuracies obtained by both ways in experimental and results section.

The intuition behind selecting the hardest correctly predicted samples using step 7 (A) is that such samples contain the most information about boundaries rather than the samples with lower fuzziness in magnitude. The threshold value between lower and higher fuzziness is set by trial and error. The proposed methodology significantly boosts the performance of the classifier for hyperspectral image classification not only in terms of accuracies but also reduce the classification time.

Here we will theoretically explain the procedure for estimating the boundary of each class, and then how to build a relation between the samples and the estimated boundaries to select the target samples.

Boundary extraction

Generally, there are two kinds of classifiers: those that use some specific formula to estimate class boundaries (discriminative), and others that use some distribution for the same task (generative). For example, [39] [40] [41] used locus approximation on some sample distributions to estimate the class boundary; whereas [42] used an analytical formula. Fuzzy K-Nearest Neighbors (FKNN’s) and Support Vector Machines (SVM’s) are two representatives of the aforementioned types.

Before we discuss the boundary extraction process for both classifiers, it is helpful to understand the concept of a fuzzy membership function, because we seek the output of each classifier in the form of fuzzy membership grades.

Memberships function

Let us assume a set of N sample vectors {r₁, r₂, r₃, …, r_N}, and a fuzzy partition of these N sample vectors represents each sample vector’s degree of membership to each of the C classes. The fuzzy C partitions have certain characteristics as defined below: and where μ_ij ∈ [0, 1], and μ_ij = μ_i(r_j) is a function that represents the membership (a value in [0, 1]) for the j^th sample r_j, to the i^th partition, i ∈ 1, 2, 3, …, C, and j ∈ 1, 2, 3, …, N.

Support Vector Machine (SVM)

SVM aims to find the optimal hyperplane according to the maximization of the margin on the training data. In SVM, data is mapped from the input space into a high dimensional feature space using an implicit function; such mapping is directly associated with a kernel function , which satisfies . In the kernel function the terms r_i and r_j denotes the i^th and j^th training samples respectively. The mathematical hypothesis of SVM is given by: (1)

In above equation c_i is the i^th class label, b and α_i are unknown parameters which are determined by quadratic programming. Furthermore, α_i is a vector of non-negative Lagrange multipliers; therefore, the solution vector α_i is sparse and the samples r_i which correspond to nonzero α_i are called support vectors. Thus, the samples r_i corresponding to α_i = 0 have no contribution to the construction of the optimal hyperplane. From the literature, one can find several extensions of SVM [42] and open tools such as LIBSVM [43] which has produced acceptable performance in hyperspectral image classification. As we explained, SVM has limitations in training using a large number of samples in terms of time and computations. In order to cope with these difficulties, we can take advantage of fuzzy class membership to filter the samples based on fuzziness magnitude. In this work, we use the class membership as expressed in [44].

Fuzzy K-Nearest Neighbors (FKNN)

FKNN produces the output as a vector of class memberships where each component of the sample vector strictly belongs to the closed interval [0, 1]. If the component of a sample vector is equal to 0 or 1, then the algorithm behaves like a common KNN. FKNN search is similar to the traditional KNN search. In traditional KNN, each sample can only belong to one class, which is the majority class in KNN search, whereas in FKNN, a sample can belong to multiple classes with different membership degrees associated with these classes. FKNN can be summarized in the following steps:

First find K nearest neighbors r_j, j ∈ 1, 2, 3, …., K, of the given sample r using Euclidean distance function from the set of the samples.
Evaluate the membership function values for each class. FKNN obtains the membership of a sample as: (2) In the above equation ‖r − r_j‖ is the Euclidean distance and μ_i(r_j) is the membership value of the point r_j for the i^th class. The parameter m controls the effective magnitude of the distance of the prototype neighbors from the sample under process [40]. The value of m can also be updated through cross-validation along with the value of K, where K is the number of neighbors.
The class of sample r_j is chosen by the given formula: (3) where C is the total number of classes; therefore the decision boundary is locus expressed by (4), where is the permutation of μ_i in decreasing order.
(4)

Based on the two different classifiers’ boundary extraction process as discussed above, we can conclude that the estimated class boundary strongly depends on the criteria of classification algorithm even for identical training samples. The discussion of FKNN indicates that the boundary extraction process cannot be explicitly expressed the same way as that of the formula-based classification methods, such as SVM. Thus, it is not easy to identify whether a training sample is far from or close to the classification boundary, especially when the classification boundary cannot be expressed as a mathematical formula. Therefore, the difference between the actual and found classification boundary is considered as an important index for evaluating the generalization capability of any classification technique.

In this work, we initialize the learning model with a specific percentage of randomly selected samples, but one can control the size of samples by adjusting neighbors when assigning fuzzy class memberships to the training samples r_i; therefore, the training set is mapped to a fuzzy training sample as (r_(1,….,N), l_(1,…,N), μ_(1,….,N)), where each membership value is assigned independently.

Fuzziness relation between the samples and boundary

In the above sections, we describe the process to extract the boundary of each class, but now the problem at hand is how to identify whether the said sample is close or away from the class boundary. In order to cope with the said problem, let us assume the output of a classifier for a specific sample is a fuzzy vector in which the component should be a specific number within the closed interval [0, 1]. The set of these numbers represent the fuzzy membership grades of the individual sample fit into the corresponding class.

For readers’ ease, let us consider the distance between the class boundary and the sample with output (μ_i, μ_j)^T can be estimated using Eq (5), which we will further incorporate with fuzziness properties. The said phenomenon is explained in the form of the corollary; (5)

However, for better understanding, it is important to explain the concept of fuzziness.

Fuzziness properties.

Consider a mapping R to the closed interval [0, 1] which is a fuzzy set on R and the mapping is denoted as F(R). The fuzziness from the fuzzy membership set can be calculated as E: F(R) → [0, 1] or generally it can be expressed as E: [0, 1]^R → R⁺, which satisfies the following axioms as defined in [39] [45] [46]:

E(μ) = 0 if and only if μ is a crisp set,
E(μ) attains its maximum value if and only if μ(r) = 0.5 for all r ∈ R,
if μ ≼ σ then E(μ) ≽ E(σ), where μ ≼ σ ⇔ min(0.5, μ(r)) ≥ min(0.5, σ(r) and max(0.5, μ(r)) ≤ max(0.5, σ(r),
where E(μ) = 1 = μ(r), and
E(μ ∪ σ) + E(μ ∩ σ) = E(μ) + E(σ)

Axiom 3 is known as sharpened order, where μ and σ are fuzzy subsets of a crisp set, where μ ≼ σ means μ is less sharpened than σ and hence μ has more fuzziness than σ. Since F(R) is not totally ordered, so there are many pairs of fuzzy sets that are not comparable under ≼ but on the contrary, a measure of fuzziness provides a total order.

Measuring fuzziness.

Consider a fuzzy set R = {μ_{(1,2,3,…,n)}}, then the fuzziness of R can be define as, The above expression attains its maximum when the membership degree of each sample is equal to 0.5 and minimum when every sample absolutely falls into the fuzzy set or not. In this work, the term fuzziness is a kind of cognitive uncertainty.

We further extend it as a fuzzy partition of the given training samples that assigns the membership degree of each sample to C classes as M = (μ_ij)_C*P, where μ_ij = μ_i(r_j) is the membership of the j^th sample r_j belonging to the i^th class. The elements of the membership matrix should follow the properties defined in the above section. Therefore, the membership matrix upon P training samples is attained once the training procedure completes. For the j^th sample, the classifier produces an output vector represented as a fuzzy set (μ_j = μ_1j, μ_2j, μ_3j, μ_Cj)^T, so by the above equation the fuzziness of the classifier can be written as:

Finally, a membership matrix upon P training samples for C classes can be defined as: (6)

The above expression defines the training fuzziness. In hyperspectral space, a classifier’s fuzziness is computed as the averaged fuzziness over the entire hyperspectral space. However, the fuzziness for the testing phase is unknown. For any supervised and semi-supervised classification problem, there is a premise, “the training samples have a distribution identical to the distribution of samples in the entire space”. Therefore, the above equation can be used to calculate a classifier’s fuzziness. The following corollary gives further insight into the fuzziness relation between samples and boundary.

Corollary.

Suppose a binary class problem with two samples (r_i, r_j) and distances (d_i, d_j), where d_i is the distance between classification boundary r_i and sample, and d_j is the distance between boundary r_j and sample.

Furthermore, α and β are outputs of the classifier on samples r_i and r_j. According to [39], if d_i is less than d_j, then the fuzziness of α should be greater than β; which means that the fuzziness of r_i is no less than that of r_j. The said phenomena is further explained in Fig 1.

Download:

Fig 1. Sample distance from boundary.

https://doi.org/10.1371/journal.pone.0188996.g001

To prove the statement, let us assume that the outputs of the classifier on r_i and r_j are in the form of α = (α₁, α₂)^T and β = (β₁, β₂)^T, respectively. Therefore, by Eqs (4) and (5), the boundary and the distance between boundary and sample with the output (α₁, α₂)^T can be estimated as r∣α₁(r) = α₂(r) = 0.5 and |α₁ − 0.5| + |α₂ − 0.5|. By the above definition, we can find the distances for each membership value as:

In addition, by using the above relations, we can further observe the right threshold value to identify a sample either close to or away from the boundary. Let us assume that α₁ ≥ α₂ and β₁ ≥ β₂. This implies that α₁ ≥ 0.5 and β₁ ≥ 0.5, which results in d_i = 2(α₁ − 0.5) and d_j = 2(β₁ − 0.5). Based on our assumption, d_i is less than d_j, therefore α₁ < β₁. Thus, the sharpened order axiom α₁ ≼ β₁ satisfies the inequality of fuzziness as E(α₁) > E(β₁) but by definition, we know that E(α₁) ≥ E(α₂) and E(β₁) ≥ E(β₂), therefore, we can conclude that, E(α) > E(β).

The above mathematical evidence shows that the samples far from the classification boundary have low fuzziness as compared to the samples that are near to the classification boundary. This phenomenon is relatively simple and it is easy in a binary class problem with linearly separable samples to judge for each sample whether it is near to or away from classification boundary with some threshold value. The problem becomes trickier in case of complex boundaries with nonlinear mixtures. In such situations, we have three possibilities:

The samples actually belong to the region where they are supposed to be; with high or low fuzziness,
The samples belong to the other region where they are not supposed to be; with high or low fuzziness, and
Homogeneous mixtures, i.e. non-distinguishable regions without any prerequisite conditions to make them distinguishable.

The first two cases belong to heterogeneous-type mixtures, and can easily be solved, but the third case is trickier. To cope with the third case, we suggest measuring the correct rate of classification and misclassification from each class while considering the fuzziness subgroups. This can also be solved by applying any filter, which will recursively pass the same distribution of samples at once based on their class.

System validation

Hyperspectral image classification with an optimal number of labeled training samples is one of the fundamental and challenging tasks. In practice, the availability of labeled training samples is often insufficient for hyperspectral image classification, and in such scenarios, the classification methods generally either overwhelmed with uninformative samples or suffer due to the undersampling problem. Thus, in this work, we investigate the above-mentioned classifiers performance as a function of a different number of training samples size, varying from a minimum of 5% to a maximum of 25% per class (i.e., 5%, 10%, 15%, 20%, and 25%).

Experimental setup

In all experiments, the parameters of the classifier are chosen as those that provide the best training accuracy. To avoid any bias, all the experiments are done within the same fixed settings which maximize the training accuracies. All the initializing parameters are evaluated in the first few experiments. When the parameters remain unchanged, the evaluation of the optimal parameters is stopped and selected for further experiments. We implemented SVM with a Polynomial kernel function and FKNN with 10 as the number of nearest neighbors and the Euclidean distance function.

In all experiments, the terms SVM and FKNN refer to the classifiers trained on samples selected using step 7(B), whereas the terms PSVM and PFKNN are used for the cases where the classifiers are trained using the samples selected using step 7(A) as explained in the methodology section. To this end, the first goal is to compare the performance of PSVM and PFKNN against that of SVM and FKNN, respectively. The second goal is to compare the performance of PSVM, PFKNN, FKNN, and SVM with state-of-the-art active learning frameworks.

The Kappa (κ) coefficient and overall accuracy are analyzed using a five-fold cross-validation process, related to a different number of training samples for all three datasets. It is worth noting that the training accuracy is not 100% and might include some error in terms of fuzziness estimation. All the experiments are carried out using MATLAB (2014b) on Intel^® Core^™ i5 CPU 3.20 GHz with 8 GB of RAM and the Machine is the 64-bit operating system.

Experimental datasets

The performance of the proposed FALF method is validated on three widely used publicly available hyperspectral datasets using two different classifiers with two different ways to select the target samples.

The ROSIS-03 optical sensor acquired the Pavia University (PU) and Pavia Centre (PC) data over the urban area of northern Italy. The PU and PC datasets consist of 610*340 and 1096*710 samples with 115 and 102 bands respectively. For the PU data, 12 noisy bands were removed prior to the analysis and the remaining 103 bands were used in our experiments. The ground truths differentiate 9 different classes in both datasets.

The third dataset was acquired by the Airborne Visible Infrared Imaging Spectrometer (AVIRIS) sensor. The Indian Pines (IP) dataset consists of 145*145 samples and 220 spectral bands with a spatial resolution of 20-m and a spectral range from 0.4–2.5 Î¼m. Twenty noisy bands were removed prior to the analysis whereas the remaining 200 bands were used in our experimental setup. The removed bands are 104–108, 150–163, and 220. Indian Pines dataset consists of 16 classes. All three datasets can be freely obtained from [47] [48].

Experimental results

The Kappa (κ) coefficient and overall accuracies are considered as the evaluation metrics since these are widely used in existing works. The kappa coefficient is obtained by using the expressions given below [49].

(7)

In the above equations, N is the total number of samples, Ψ_k represents the number of correctly predicted samples in the given class, ∑_k Ψ_k is the sum of the number of correctly predicted samples, σ_k is the actual number of samples belonging to the given class, and φ_k is the number of samples that have been correctly predicted into the given class [49].

The average performance comparison of the proposed algorithm with each classifier is shown in Figs 2 and 3. These figures show the average classification accuracy and kappa coefficient analysis for both classifiers trained by randomly selected samples (Step 7(B)), and the same classifiers trained by using hardest predicted samples (Step 7(A)).

Download:

Fig 2. Overall classification accuracy for PSVM, SVM, PFKNN and FKNN for both Indian Pines, Pavia University, and Pavia Centre datasets.

https://doi.org/10.1371/journal.pone.0188996.g002

Download:

Fig 3. Kappa coefficient for PSVM, SVM, PFKNN and FKNN for both Indian Pines, Pavia University, and Pavia Centre datasets.

https://doi.org/10.1371/journal.pone.0188996.g003

As explained earlier, we set the minimum training sample size as 5% for the first experiment and in each experiment, we increase the size with 5% newly selected samples. In the extreme case, the sample size is not more than 25% of the entire population. Based on the analysis is shown in Figs 2 and 3, for the IP and PU datasets, the PSVM classifier outperforms the rest of the classifiers. From different observations with a different number of training samples, there is a slight improvement using SVM and FKNN but PFKNN improves the accuracy impressively when we increase the size of training samples from 5% to 10% in both IP and PU datasets.

Fig 4 shows the average computational time for our first experiment. These results show that for a different number of training samples processed by PSVM, it exhibits almost identical computational cost for the same datasets, which indicates that the quantity of hardest predicted samples slightly influences the computational time of PSVM as compared to SVM. On the other hand, PFKNN obtained almost the same or a slightly lower computational time as compared to FKNN for all datasets in different experiments. In both experiments, the comparison between randomly selected samples and the hardest predicted samples has been shown for the IP and PU datasets. Moreover, the PC dataset is used to show the performance only for hardly predicted samples.

Download:

Fig 4. Computational time for PSVM, SVM, PFKNN and FKNN for both Indian Pines, Pavia University, and Pavia Centre datasets.

https://doi.org/10.1371/journal.pone.0188996.g004

As shown in Fig 4, the computational cost gradually increases as the size of data increases in the PC dataset. Therefore, it is crucial to deal with such high computational time. Certain possible solutions can be applied to solve this problem. For example, one approach is to split the dataset into small regions and then build a separate classifier for each of the sub-regions. However, for this strategy to work well, there is another problem of how to conduct the data splitting such that it does not minimize the classification performance.

Figs 5 and 6 show the classification maps for the PU and IP datasets respectively. The complete hypotheses on both datasets processed by the proposed FALF method to select the most informative samples to retrain the classifier, and the same classifier, trained on randomly selected samples, have been shown. Fig 7 presents the validation of our proposed model on the PC dataset. These figures show the complete performance assessment on experimental results with profound improvement. As shown in the figures, the classification maps generated by adopting the FALF framework are less noisy and more accurate than the maps generated by the same classifiers on randomly selected training samples.

Download:

Fig 5. Classification maps of Pavia University (PU) with different number of training samples i.e. 5%, 10%, 15%, 20%, and 25% to train FKNN, SVM, PFKNN, and PSVM respectively.

https://doi.org/10.1371/journal.pone.0188996.g005

Download:

Fig 6. Classification maps of Indian Pines (IP) with different number of training samples i.e. 5%, 10%, 15%, 20%, and 25% to train FKNN, SVM, PFKNN, and PSVM respectively.

https://doi.org/10.1371/journal.pone.0188996.g006

Download:

Fig 7. Classification maps of Pavia Centre (PC) with different number of training samples i.e. 5%, 10%, 15%, 20%, and 25% to train PFKNN, and PSVM.

https://doi.org/10.1371/journal.pone.0188996.g007

For the trusted external judgments and for statistical analysis of any classification problem, true positive (TP), true negative (TN), false positive (FP), and false negative (FN) are usually compared. In this regard, we have made several judgments that are presented in Tables 1, 2 and 3, which show average statistics for all experimental datasets with a different number of training samples for each classifier.

Download:

Table 1. Indian Pines.

https://doi.org/10.1371/journal.pone.0188996.t001

Download:

Table 2. Pavia University.

https://doi.org/10.1371/journal.pone.0188996.t002

Download:

Table 3. Pavia Centre.

https://doi.org/10.1371/journal.pone.0188996.t003

We have abbreviated the test names in Tables 1, 2 and 3 as PPV = Positive Predictive Value, FDR = False Discovery Rate, FOR = False Omission Rate, and LRN = Likelihood Ratio for Negative or False Test. Positive predictive values are the scores of the positive statistical results based on TP and TN values. PPV shows the performance of a statistical measure, and we use it to confirm the probability of positive and negative results. A higher value of PPV indicates that a few positive results are a false positive.

FOR and FDR is a statistical method used in multiple hypothesis testing to correct for multiple comparisons. It measures the proportion of false negatives that are incorrectly rejected. FOR is computed by using FN and TP; it can also be computed by taking the complement of negative predictive values (NPVs). FDR measures the proportion of actual positives that are incorrectly identified and is computed by using FP and TP.

For class-based classification judgments, we have done two statistical analysis, which is presented in Figs 8 and 9, in which we show the average statistics for all classes with a different number of training samples for each classifier. Figs 8 and 9 show the sensitivity and specificity of classification analysis on all three datasets for each class. PFKNN and PSVM have quite similar behavior for different classes, as one can see from the figures.

Download:

Fig 8. Sensitivity for each class classification analysis on Indian Pines, Pavia University, and Pavia Centre, for both PFKNN and PSVM for all three datasets.

https://doi.org/10.1371/journal.pone.0188996.g008

Download:

Fig 9. Specificity for each class classification analysis on Indian Pines, Pavia University, and Pavia Centre, for both PFKNN and PSVM for all three datasets.

https://doi.org/10.1371/journal.pone.0188996.g009

The summary classes for classification are as follows. Indian Pines: classes 1 to 16 are ““Alfalfa”, “Corn Notill”, “Corn Mintel”, “Corn”, “Grass Pasture”, “Grass Trees”, “Grass Pasture Mowed”, “Hay Windrowed”, “Oats”, “Soybean Notill”, “Soybean Mintel”, “Soybean Clean”, “Wheat”, “Woods”, “Buildings Grass Trees Drives” and “Stone Steel Towers””.

Pavia University: classes 1 to 9 are, ““Asphalt”, “Meadows”, “Gravel”, “Trees”, “Painted Metal Sheets”, “Bare Soil”, “Bitumen”, “Self-Blocking Bricks” and “Shadows””.

Pavia Centre: classes 1 to 9 are, ““Water”, “Trees”, “Asphalt”, “Self-Blocking Bricks”, “Bitumen”, “Tiles”, “Shadows”, “Meadows”, and “Bare Soil””.

Comparison with state-of-the-art

To evaluate the performance of our proposed framework, the following state-of-the-art methods are compared. All competing methods are evaluated on two publicly available real hyperspectral datasets and the average performance of 5-fold cross validation is presented. The detailed performance comparison of the proposed algorithm with state-of-the-art methods defined below is presented in Tables 4 and 5. From these tables, we can see that the proposed framework outperforms the state-of-the-art active learning frameworks because of our careful sample selection using a twofold learning hierarchy. In traditional active learning frameworks, the supervisor selects the samples in an iterative fashion, whereas the proposed model systematically selects the samples by machine-machine interaction without involving any supervisor, in computationally efficient fashion for high-dimensional hyperspectral datasets.

Download:

Table 4. Indian Pines dataset.

https://doi.org/10.1371/journal.pone.0188996.t004

Download:

Table 5. Pavia University dataset.

https://doi.org/10.1371/journal.pone.0188996.t005

Multinomial Logistic Regression with Active Learning [26]
Active Learning framework using hierarchical segmentation [50]
Spatial Coherence Batch Mode Active Learning [51]
Spectral-Spatial Classification using Loopy Belief Propagation and Active Learning [52]

Discussion

We can find many classical active learning frameworks in the literature that are similar to the proposed framework. For example, the work proposed by Lughofer in [36] focused on online learning and it was specifically designed for “an on-line single-pass setting in which the data stream samples arrive continuously”. Such kind of methods does not allow classifier re-training for the next round of sample selection. Furthermore, Lughofer uses the close concepts of conflict and ignorance. Conflict models how close a query point is to the actual decision boundary and ignorance represents the distance between a new query point and the training samples seen so far. Our membership concept is conceptually close to these indicators, but we are able to consider both the distance from the class boundary and in-class variance inside one parameter. In addition, unlike [36], we implemented and validated our active learning approach for hyperspectral image classification problem.

In contrast to [36], Nie et al. proposed another active learning framework in [53], in which the authors focused only on early active learning strategies, i.e., solving the early stage experimental design problem. The Transductive Experimental Design (TED) method was proposed to select the data points, and for this, the authors propose a novel robust active learning approach using the structured sparsity-inducing norms to relax the NP-hard objective to the convex formulation. Thus their framework only focused on selecting an optimal set of initial samples to kick-start the active learning procedure. However, the benefit of our framework is that it shows state-of-the-art performance independent of how the initial samples are selected. Of course, the framework proposed by Nie et al. can be easily integrated with our framework to be executed instead of executing the first step of our algorithm.

In our work, we start evaluating our hypotheses from 5% of randomly selected training samples and we demonstrate that randomly adding more samples (step 7(B)) back into the training set slightly increases accuracy but the classifiers become computationally complex. Therefore, we decided to separate the set of samples that were most difficult to predict in our first phase of classification (The samples between the ranges of 0.7–1.0 in fuzziness magnitude). We then fuse a specific percentage of these hardly predicted samples back into the original training set to retrain the classifier from scratch for better generalization and classification performance on those samples which were initially misclassified.

It is worth noting from experiments that adding hardly predicted samples back into the training set improves the performance on those samples that were misclassified in the first phase. For the IP and PU datasets, we have experimentally proved that randomly adding samples back into the training set does not provide the desired accuracy, but that by adding the samples back into the training set selected by the proposed FALF framework boosts the performance of the classifier. We further validate our hypotheses on the PC dataset which also produces good accuracy in a computationally efficient way.

A second most important factor involved in the training and testing phase is computational time, which is significantly improved for both classifiers. Therefore, to make the model efficient and quick, we fuse the most difficult and informative samples back into the training set to retrain the classifier in each experiment. The classification accuracy and Kappa (κ) test results are significantly improved as we can see from Figs 2 to 9. Tables 1, 2 and 3 present the average statistical test results on predicted samples, which show the model’s ability to correctly classify the unseen samples from each class.

To experimentally observe a sufficient quantity of training samples for each classifier, we evaluated the hypothesis as explained earlier. Based on the experimental results, we conclude that the 10% samples obtained by the proposed FALF framework are good enough to produce the acceptable accuracy for hyperspectral image classification with minimum computational cost.

Conclusion

Hyperspectral image classification with a limited number of training samples is a challenging problem. To improve the classification performance for such cases, this paper proposed the idea of retraining the classifier using most informative samples. These samples are identified by first estimating the boundary of each class and then calculating the fuzziness-based distance between each sample and the estimated class boundaries. The hardest correctly classified samples with smaller distances and higher fuzziness are selected as appropriate candidates for the training set to retrain the classifier.

Through several experiments, we show that for an image classification task we can start with only 5% of the training samples and then use the proposed FALF framework to select only a small amount of new samples to train the classifier from scratch, which significantly boosts the classifier’s generalization performance on unseen samples.

It is worth noting is that the proposed method is not classifier sensitive, i.e. the derived relation holds if we change the classification model, such as locus approximation to an analytical formula-based classifier.

Supporting information

S1 File. The Indian Pines (corrected) dataset, consisting of 145*145 samples and 220 spectral bands with a spatial resolution of 20 m and a spectral range of 0.4–2.5 Î¼m.

Twenty noisy bands were removed prior to the analysis, whereas the remaining 200 bands were used in our experimental setup. The removed bands are 104–108, 150–163, and 220. The original Indian Pines dataset is available online at [47] [48].

https://doi.org/10.1371/journal.pone.0188996.s001

(TXT)

S2 File. The original Indian Pines ground truths consist of 16 classes.

The ground truth classes and the number of samples per class (class name-number of samples) are as follows: ““Alfalfa-46”, “Corn Notill-1428”, “Corn-Mintel-830”, “Corn-237”, “Grass Pasture-483”, “Grass Trees-730”, “Grass Pasture Mowed-28”, “Hay Windrowed-478”, “Oats-20”, “Soybean Notill-972”, “Soybean Mintel-2455”, “Soybean Clean-593”, “Wheat-205”, “Woods-1265”, “Buildings Grass Trees Drives-386” and “Stone Steel Towers-93””. The ground truths are freely available at [47] [48].

https://doi.org/10.1371/journal.pone.0188996.s002

(TXT)

S3 File. This file contains MATLAB code for reshaping and rewriting of the original Indian Pines dataset and ground truths into text files as per journal requirements.

https://doi.org/10.1371/journal.pone.0188996.s003

(M)

Acknowledgments

We thank Academic Editor, Senior Editor Renee Hoch, and Division Editor Leonie Mueck for comments that greatly improved the manuscript. We would also like to thank three anonymous reviewers for their intensive insights. This work was mainly supported by a grant from Kyung Hee University in 2017 (KHU-20170724) to WAK and was partially supported by the Zayed University Research Initiative Fund (# R17057) to AMK.

References

1. Camps VG, Benediktsson JA, Bruzzone L, and Chanussot J. Introduction to the issue on Advances in Remote Sensing Image Processing. IEEE Journal of Selected Topics in Signal Processing, vol. 5(3), pp. 365–369, 2011.
- View Article
- Google Scholar
2. Ahmad M, Bashir AK, and Khan AM. Metric Similarity Regularizer to Enhance Pixel Similarity Performance for Hyperspectral Unmixing. Elsevier Optik—International Journal for Light and Electron Optics, vol. 140, pp. 86–95, 2017.
- View Article
- Google Scholar
3. Land GDA. Signal Theory Methods in Multispectral Remote Sensing. Wiley, 2003.
4. Dias JB, Plaza A, Camps VG, Scheunders P, Nasrabadi NM, and Chanussot J. Hyperspectral Remote Sensing Data Analysis and Future Challenges. IEEE Geoscience and Remote Sensing Magazine, vol. 1(2), pp. 6–36, 583, 2013.
- View Article
- Google Scholar
5. Alajlan N, Bazi Y, Melgani F, and Yager RR. Fusion of Supervised and Unsupervised Learning Paradigms for Improved Classification of Hyperspectral Images. Information Science, vol. 217, pp. 39–55, 2012.
- View Article
- Google Scholar
6. Ahmad M, Khan AM, and Hussain R. Graph-based Spatial-Spectral Feature Learning for Hyperspectral Image Classification. IET Image Processing, vol. 11(12), pp. 1310–1316, 2017.
- View Article
- Google Scholar
7. Bazi Y, and Melgani F. Toward an Optimal SVM Classification System for Hyperspectral Remote Sensing Images. IEEE Transactions on Geoscience and Remote Sensing, vol. 44(11), pp. 3374–3385, 2006.
- View Article
- Google Scholar
8. Ahmad M, Khan AM, Hussain R, Protasov S, Chow F, and Khattak AM. Unsupervised geometrical feature learning from hyperspectral data. In proc. of IEEE Symposium Series on Computational Intelligence (IEEE-SSCI), pp. 1–6, 2016.
9. Plaza A, Benediktsson JA, Boardman JW, Brazile J, Bruzzone L, Camps VG, Chanussot J, Fauvel M, Gamba P, Gualtieri A, and Mattia . Recent Advances in Techniques for Hyperspectral Image Processing. Remote Sensing and Environmental, Imaging Spectroscopy Special Issue, vol. 113, pp. 110–122, 2009.
- View Article
- Google Scholar
10. Bovolo F, Bruzzone L, and Carlin L. A Novel Technique for Sub-Pixel Image Classification Based on Support Vector Machine. IEEE Transactions on Image Processing, vol. 19(11), pp. 2983–2999, 2010.
- View Article
- Google Scholar
11. Tuia D, Volpi M, Copa L, Kanevski M, and Munoz MJ. A Survey of Active Learning Algorithms for Supervised Remote Sensing Image Classification IEEE Journal of Selected Topics Signal Processing, vol. 5(3), pp. 606–617, 2011.
- View Article
- Google Scholar
12. Siddiqi MH, Seok WL, and Khan AM. Weed Image Classification using Wavelet Transform, Stepwise Linear Discriminant Analysis, and Support Vector Machines for an Automatic Spray Control System. Journal of information science and engineering, vol. 30, pp. 1253–1270, 2014.
- View Article
- Google Scholar
13. Ahmad M, Khan AM, Brown JA, Protasov S, and Khattak AM. Gait fingerprinting-based user identification on smartphones. International Joint Conference on Neural Networks (IJCNN) in conjunction with world congress on computational intelligence (WCCI), pp. 3060–3067, 2016.
14. Dias JB, Plaza A, Dobigeon N, Parente M, Du Q, Gader P, and Chanussot J. Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-based Approaches. IEEE Journal of Selected Topics on Applied Earth Observations and Remote Sensing, vol. 5(2) pp. 354–379, 2012.
- View Article
- Google Scholar
15. Dias JB, and Nascimento J. Hyperspectral Subspace Identification. IEEE Transactions on Geoscience and Remote Sensing, vol. 46(8), pp. 2435–2445, 2008.
- View Article
- Google Scholar
16. Bandos TV, Bruzzone L, and Camps VG. Classification of Hyperspectral Images with Regularized Linear Discriminant Analysis. IEEE Transactions on Geoscience and Remote Sensing, vol. 47(3), pp. 862–873, 2009.
- View Article
- Google Scholar
17. Melgani F, and Bruzzone L. Classification of Hyperspectral Remote-Sensing Images with Support Vector Machines. IEEE Transactions on Geoscience and Remote Sensing, vol. 42(8), pp. 1778–1790, 2004.
- View Article
- Google Scholar
18. Camps VG, and Bruzzone L. Kernel-Based Methods for Hyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing, vol. 439(6), pp. 1351–1362, 2005.
- View Article
- Google Scholar
19. Scholkopf B, and Smola A. Learning with Kernels: Support Vector Machines, Regularization, Optimization and Beyond. Cambridge, MA: MIT Press, 2002.
20. Camps VG, Tuia D, Gomez CL, Jimenez S, and Malo J. Remote Sensing Image Processing. Synthesis Lectures on Image, Video, and Multimedia Processing. Morgan and Claypool, 2011.
21. Dopido I, Li J, Marp PR, Plaza A, Dias JB, and Benediktsson JA. Semi-Supervised Self Learning for Hyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing, vol. 51(7), pp. 4032–4044, 2013.
- View Article
- Google Scholar
22. Bruzzone L, Chi M, and Marconcini M. A novel transductive SVM for the Semi Supervised Classification of Remote Sensing Images. IEEE Transactions on Geoscience and Remote Sensing, vol. 44(11), pp. 3363–3373, 2006.
- View Article
- Google Scholar
23. Camps VG, Marsheva TVB, and Zhou D. Semi-Supervised Graph-based Hyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing, vol. 45(10), pp. 3044–3054, 2007.
- View Article
- Google Scholar
24. Velasco FS, and Manian V. Improving Hyperspectral Image Classification Using Spatial Preprocessing. IEEE Geoscience and Remote Sensing Letters, vol. 6(2), pp. 297–301, 2009.
- View Article
- Google Scholar
25. Tuia D, and Camps VG. Semi-Supervised Remote Sensing Image Classification with Cluster Kernels. IEEE Geoscience and Remote Sensing Letters, vol. 6(2), pp. 224–228, 2009.
- View Article
- Google Scholar
26. Li J, Dias JB, and Plaza A. Semi-Supervised Hyperspectral Image Segmentation Using Multinomial Logistic Regression with Active Learning. IEEE Transactions on Geoscience and Remote Sensing, vol. 48(11), pp. 4085–4098, 2010.
- View Article
- Google Scholar
27. Bruzzone L, and Persello C. A Novel Context-Sensitive Semi Supervised SVM Classifier Robust to Mislabeled Training Samples. IEEE Transactions on Geoscience and Remote Sensing, vol. 47(7), pp. 2142–2154, 2009.
- View Article
- Google Scholar
28. Munoz MJ, Bovolo F, Gomez CL, Bruzzone L, and Camps VG. Semi Supervised One-Class Support Vector Machines for Classification of Remote Sensing Data. IEEE Transactions on Geoscience and Remote Sensing, vol. 48(8), pp. 3188–3197, 2010.
- View Article
- Google Scholar
29. Gomez CL, Camps VG, Bruzzone L, and Calpe MJ. Mean MAP Kernel Methods for Semi Supervised Cloud Classification. IEEE Transactions on Geoscience and Remote Sensing, vol.48(1), pp. 207–220, 2010.
- View Article
- Google Scholar
30. Tuia D, and Camps VG. Urban Image Classification with Semi Supervised Multi-Scale Cluster Kernels. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 4(1), pp. 65–74, 2011.
- View Article
- Google Scholar
31. Rattle F, Camps VG., and Weston J. Semi Supervised Neural Networks for Efficient Hyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing, vol. 48(5), pp. 2271–2282, 2010.
- View Article
- Google Scholar
32. Munoz MJ, Tuia D, and Camps VG. Semi Supervised Classification of Remote Sensing Images with Active Queries. IEEE Transactions on Geoscience and Remote Sensing, vol. 50(10), pp. 3751–3763, 2012.
- View Article
- Google Scholar
33. Burr S. Active Learning Literature Survey. Computer Sciences Technical Report 1648, University of Wisconsin-Madison, 2010.
34. Rubens N, Kaplan D, and Sugiyama M. Active learning in recommender systems. Recommender systems handbook 2nd edition, Springer, 2016.
35. lugger E. Hybrid active learning for reducing the annotation efforts of operation in classification systems. Journal of Pattern Recognition, vol 45(2), pp. 884–896, 2012.
- View Article
- Google Scholar
36. Lughofer E. Single-pass active learning with conflict and ignorance. Journal of evolving systems, vol. 3(4), pp. 251–271, 2012.
- View Article
- Google Scholar
37. Bouneffouf D, Laroche R, Urvoy T, Feraud R, and Allesiardo R. Contextual bandit for active learning active Thompson sampling In proc. of the 21st International Conference on Neural Information Processing, 2014.
38. Bouneffouf D. Exponentiated gradient exploration for active learning Journal of Computers, vol. 5(1), pp. 1–12, 2016.
- View Article
- Google Scholar
39. Wang XZ, Jie XH, Li Y, Hua Q, Ru DC, and Pedrycz W. A Study on Relationship between Generalization Abilities and Fuzziness of Base Classifiers in Ensemble Learning. IEEE Transactions on Fuzzy Systems, vol.23(5), pp. 1638–1654, 2014.
- View Article
- Google Scholar
40. Keller JM, Gray MR, and Givens JA. A Fuzzy K-nearest Neighbor Algorithm. IEEE Transactions on Systems, Man, and Cybernetics, vol. 15(4), pp. 580–585, 1985.
- View Article
- Google Scholar
41. Ruiz P, Mateos J, Camps VG, Molina R, and Katsaggelos AK. Bayesian Active Remote Sensing Image Classification. IEEE Transactions on Geoscience and Remote Sensing, vol. 52(4), pp. 2186–2196, 2013.
- View Article
- Google Scholar
42. Moewes C, and Kruse R. On the usefulness of fuzzy SVMs and the extraction of fuzzy rules from SVMs In proc. of 7th Conference of the European Society for Fuzzy Logic and Technology (EUSFLAT) and LFA, 2011.
43. Chang CC, and Lin CJ. LIBSVM: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology, vol. 2(3), pp. 1–39, 2011. Software available at http://www.csie.ntu.edu.tw/cjlin/libsvm, date of access, 2016.
- View Article
- Google Scholar
44. Sohn S, and Dagli CH. Advantages of Using Fuzzy Class Memberships in Self-Organizing Map and Support Vector Machines. In proc. of International Joint Conference on Neural Networks (IJCNN), vol. 3, pp. 1886–1890, 2001.
45. De LA, and Termini S. A Definition of a Non-Probabilistic Entropy in the Setting of Fuzzy Sets Theory. Journal of Information and Control, vol. 20, pp.301–312, 1972.
- View Article
- Google Scholar
46. Yeung DS, and Tsang E. Measures of Fuzziness under Different uses of Fuzzy Sets. Advances in Computational Intelligence Communications in Computer and Information Science, vol. 298, pp. 25–34, 2012.
- View Article
- Google Scholar
47. http://www.ehu.eus/ccwintco/index.php?title=GIC-experimental-databases. Online access year 2016.
48. Baumgardner MF, Biehl LL, and Landgrebe DA. 220 Band AVIRIS Hyperspectral Image Data Set: June 12, 1992 Indian Pine Test Site 3. Purdue University Research Repository. 2015, https://purr.purdue.edu/publications/1947/1
49. Gu Y, Wang C, You D, Zhang Y, Wang S, and Zhang Y. Representative Multiple Kernel Learning for Classification in Hyperspectral Imagery. IEEE Transactions on Geosciences and Remote Sensing, vol. 50(7), pp. 2852–2865, 2012.
- View Article
- Google Scholar
50. Zhang Z, Pasolli E, Crawford MM, and Tilton JC. An Active Learning Framework for Hyperspectral Image Classification using Hierarchical Segmentation. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 9(2), pp. 640–654, 2016.
- View Article
- Google Scholar
51. Shi Q, Du B, and Zhang L. Spatial Coherence-Based Batch-Mode Active Learning for Remote Sensing Image Classification. IEEE Transactions on Image Processing, vol. 24(7), pp. 2037–2050, 2015.
- View Article
- Google Scholar
52. Li J, Dias JB, and Plaza A. Spectral-Spatial Classification of Hyperspectral Data using Loopy Belief Propagation and Active Learning. IEEE Transactions on Geoscience and remote sensing, vol. 51(2), pp. 844–856, 2013.
- View Article
- Google Scholar
53. Nie F, Wang H, Huang H, and Ding C. Early Active Learning via Robust Representation and Structured Sparsity. 23rd International Joint Conference on Artificial Intelligence (IJCAI), pp. 1572–1578, 2013.

[ref1] 1. Camps VG, Benediktsson JA, Bruzzone L, and Chanussot J. Introduction to the issue on Advances in Remote Sensing Image Processing. IEEE Journal of Selected Topics in Signal Processing, vol. 5(3), pp. 365–369, 2011.
View Article
Google Scholar

[2] View Article

[3] Google Scholar

[ref2] 2. Ahmad M, Bashir AK, and Khan AM. Metric Similarity Regularizer to Enhance Pixel Similarity Performance for Hyperspectral Unmixing. Elsevier Optik—International Journal for Light and Electron Optics, vol. 140, pp. 86–95, 2017.
View Article
Google Scholar

[5] View Article

[6] Google Scholar

[ref3] 3. Land GDA. Signal Theory Methods in Multispectral Remote Sensing. Wiley, 2003.

[ref4] 4. Dias JB, Plaza A, Camps VG, Scheunders P, Nasrabadi NM, and Chanussot J. Hyperspectral Remote Sensing Data Analysis and Future Challenges. IEEE Geoscience and Remote Sensing Magazine, vol. 1(2), pp. 6–36, 583, 2013.
View Article
Google Scholar

[9] View Article

[10] Google Scholar

[ref5] 5. Alajlan N, Bazi Y, Melgani F, and Yager RR. Fusion of Supervised and Unsupervised Learning Paradigms for Improved Classification of Hyperspectral Images. Information Science, vol. 217, pp. 39–55, 2012.
View Article
Google Scholar

[12] View Article

[13] Google Scholar

[ref6] 6. Ahmad M, Khan AM, and Hussain R. Graph-based Spatial-Spectral Feature Learning for Hyperspectral Image Classification. IET Image Processing, vol. 11(12), pp. 1310–1316, 2017.
View Article
Google Scholar

[15] View Article

[16] Google Scholar

[ref7] 7. Bazi Y, and Melgani F. Toward an Optimal SVM Classification System for Hyperspectral Remote Sensing Images. IEEE Transactions on Geoscience and Remote Sensing, vol. 44(11), pp. 3374–3385, 2006.
View Article
Google Scholar

[18] View Article

[19] Google Scholar

[ref8] 8. Ahmad M, Khan AM, Hussain R, Protasov S, Chow F, and Khattak AM. Unsupervised geometrical feature learning from hyperspectral data. In proc. of IEEE Symposium Series on Computational Intelligence (IEEE-SSCI), pp. 1–6, 2016.

[ref9] 9. Plaza A, Benediktsson JA, Boardman JW, Brazile J, Bruzzone L, Camps VG, Chanussot J, Fauvel M, Gamba P, Gualtieri A, and Mattia . Recent Advances in Techniques for Hyperspectral Image Processing. Remote Sensing and Environmental, Imaging Spectroscopy Special Issue, vol. 113, pp. 110–122, 2009.
View Article
Google Scholar

[22] View Article

[23] Google Scholar

[ref10] 10. Bovolo F, Bruzzone L, and Carlin L. A Novel Technique for Sub-Pixel Image Classification Based on Support Vector Machine. IEEE Transactions on Image Processing, vol. 19(11), pp. 2983–2999, 2010.
View Article
Google Scholar

[25] View Article

[26] Google Scholar

[ref11] 11. Tuia D, Volpi M, Copa L, Kanevski M, and Munoz MJ. A Survey of Active Learning Algorithms for Supervised Remote Sensing Image Classification IEEE Journal of Selected Topics Signal Processing, vol. 5(3), pp. 606–617, 2011.
View Article
Google Scholar

[28] View Article

[29] Google Scholar

[ref12] 12. Siddiqi MH, Seok WL, and Khan AM. Weed Image Classification using Wavelet Transform, Stepwise Linear Discriminant Analysis, and Support Vector Machines for an Automatic Spray Control System. Journal of information science and engineering, vol. 30, pp. 1253–1270, 2014.
View Article
Google Scholar

[31] View Article

[32] Google Scholar

[ref13] 13. Ahmad M, Khan AM, Brown JA, Protasov S, and Khattak AM. Gait fingerprinting-based user identification on smartphones. International Joint Conference on Neural Networks (IJCNN) in conjunction with world congress on computational intelligence (WCCI), pp. 3060–3067, 2016.

[ref14] 14. Dias JB, Plaza A, Dobigeon N, Parente M, Du Q, Gader P, and Chanussot J. Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-based Approaches. IEEE Journal of Selected Topics on Applied Earth Observations and Remote Sensing, vol. 5(2) pp. 354–379, 2012.
View Article
Google Scholar

[35] View Article

[36] Google Scholar

[ref15] 15. Dias JB, and Nascimento J. Hyperspectral Subspace Identification. IEEE Transactions on Geoscience and Remote Sensing, vol. 46(8), pp. 2435–2445, 2008.
View Article
Google Scholar

[38] View Article

[39] Google Scholar

[ref16] 16. Bandos TV, Bruzzone L, and Camps VG. Classification of Hyperspectral Images with Regularized Linear Discriminant Analysis. IEEE Transactions on Geoscience and Remote Sensing, vol. 47(3), pp. 862–873, 2009.
View Article
Google Scholar

[41] View Article

[42] Google Scholar

[ref17] 17. Melgani F, and Bruzzone L. Classification of Hyperspectral Remote-Sensing Images with Support Vector Machines. IEEE Transactions on Geoscience and Remote Sensing, vol. 42(8), pp. 1778–1790, 2004.
View Article
Google Scholar

[44] View Article

[45] Google Scholar

[ref18] 18. Camps VG, and Bruzzone L. Kernel-Based Methods for Hyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing, vol. 439(6), pp. 1351–1362, 2005.
View Article
Google Scholar

[47] View Article

[48] Google Scholar

[ref19] 19. Scholkopf B, and Smola A. Learning with Kernels: Support Vector Machines, Regularization, Optimization and Beyond. Cambridge, MA: MIT Press, 2002.

[ref20] 20. Camps VG, Tuia D, Gomez CL, Jimenez S, and Malo J. Remote Sensing Image Processing. Synthesis Lectures on Image, Video, and Multimedia Processing. Morgan and Claypool, 2011.

[ref21] 21. Dopido I, Li J, Marp PR, Plaza A, Dias JB, and Benediktsson JA. Semi-Supervised Self Learning for Hyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing, vol. 51(7), pp. 4032–4044, 2013.
View Article
Google Scholar

[52] View Article

[53] Google Scholar

[ref22] 22. Bruzzone L, Chi M, and Marconcini M. A novel transductive SVM for the Semi Supervised Classification of Remote Sensing Images. IEEE Transactions on Geoscience and Remote Sensing, vol. 44(11), pp. 3363–3373, 2006.
View Article
Google Scholar

[55] View Article

[56] Google Scholar

[ref23] 23. Camps VG, Marsheva TVB, and Zhou D. Semi-Supervised Graph-based Hyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing, vol. 45(10), pp. 3044–3054, 2007.
View Article
Google Scholar

[58] View Article

[59] Google Scholar

[ref24] 24. Velasco FS, and Manian V. Improving Hyperspectral Image Classification Using Spatial Preprocessing. IEEE Geoscience and Remote Sensing Letters, vol. 6(2), pp. 297–301, 2009.
View Article
Google Scholar

[61] View Article

[62] Google Scholar

[ref25] 25. Tuia D, and Camps VG. Semi-Supervised Remote Sensing Image Classification with Cluster Kernels. IEEE Geoscience and Remote Sensing Letters, vol. 6(2), pp. 224–228, 2009.
View Article
Google Scholar

[64] View Article

[65] Google Scholar

[ref26] 26. Li J, Dias JB, and Plaza A. Semi-Supervised Hyperspectral Image Segmentation Using Multinomial Logistic Regression with Active Learning. IEEE Transactions on Geoscience and Remote Sensing, vol. 48(11), pp. 4085–4098, 2010.
View Article
Google Scholar

[67] View Article

[68] Google Scholar

[ref27] 27. Bruzzone L, and Persello C. A Novel Context-Sensitive Semi Supervised SVM Classifier Robust to Mislabeled Training Samples. IEEE Transactions on Geoscience and Remote Sensing, vol. 47(7), pp. 2142–2154, 2009.
View Article
Google Scholar

[70] View Article

[71] Google Scholar

[ref28] 28. Munoz MJ, Bovolo F, Gomez CL, Bruzzone L, and Camps VG. Semi Supervised One-Class Support Vector Machines for Classification of Remote Sensing Data. IEEE Transactions on Geoscience and Remote Sensing, vol. 48(8), pp. 3188–3197, 2010.
View Article
Google Scholar

[73] View Article

[74] Google Scholar

[ref29] 29. Gomez CL, Camps VG, Bruzzone L, and Calpe MJ. Mean MAP Kernel Methods for Semi Supervised Cloud Classification. IEEE Transactions on Geoscience and Remote Sensing, vol.48(1), pp. 207–220, 2010.
View Article
Google Scholar

[76] View Article

[77] Google Scholar

[ref30] 30. Tuia D, and Camps VG. Urban Image Classification with Semi Supervised Multi-Scale Cluster Kernels. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 4(1), pp. 65–74, 2011.
View Article
Google Scholar

[79] View Article

[80] Google Scholar

[ref31] 31. Rattle F, Camps VG., and Weston J. Semi Supervised Neural Networks for Efficient Hyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing, vol. 48(5), pp. 2271–2282, 2010.
View Article
Google Scholar

[82] View Article

[83] Google Scholar

[ref32] 32. Munoz MJ, Tuia D, and Camps VG. Semi Supervised Classification of Remote Sensing Images with Active Queries. IEEE Transactions on Geoscience and Remote Sensing, vol. 50(10), pp. 3751–3763, 2012.
View Article
Google Scholar

[85] View Article

[86] Google Scholar

[ref33] 33. Burr S. Active Learning Literature Survey. Computer Sciences Technical Report 1648, University of Wisconsin-Madison, 2010.

[ref34] 34. Rubens N, Kaplan D, and Sugiyama M. Active learning in recommender systems. Recommender systems handbook 2nd edition, Springer, 2016.

[ref35] 35. lugger E. Hybrid active learning for reducing the annotation efforts of operation in classification systems. Journal of Pattern Recognition, vol 45(2), pp. 884–896, 2012.
View Article
Google Scholar

[90] View Article

[91] Google Scholar

[ref36] 36. Lughofer E. Single-pass active learning with conflict and ignorance. Journal of evolving systems, vol. 3(4), pp. 251–271, 2012.
View Article
Google Scholar

[93] View Article

[94] Google Scholar

[ref37] 37. Bouneffouf D, Laroche R, Urvoy T, Feraud R, and Allesiardo R. Contextual bandit for active learning active Thompson sampling In proc. of the 21st International Conference on Neural Information Processing, 2014.

[ref38] 38. Bouneffouf D. Exponentiated gradient exploration for active learning Journal of Computers, vol. 5(1), pp. 1–12, 2016.
View Article
Google Scholar

[97] View Article

[98] Google Scholar

[ref39] 39. Wang XZ, Jie XH, Li Y, Hua Q, Ru DC, and Pedrycz W. A Study on Relationship between Generalization Abilities and Fuzziness of Base Classifiers in Ensemble Learning. IEEE Transactions on Fuzzy Systems, vol.23(5), pp. 1638–1654, 2014.
View Article
Google Scholar

[100] View Article

[101] Google Scholar

[ref40] 40. Keller JM, Gray MR, and Givens JA. A Fuzzy K-nearest Neighbor Algorithm. IEEE Transactions on Systems, Man, and Cybernetics, vol. 15(4), pp. 580–585, 1985.
View Article
Google Scholar

[103] View Article

[104] Google Scholar

[ref41] 41. Ruiz P, Mateos J, Camps VG, Molina R, and Katsaggelos AK. Bayesian Active Remote Sensing Image Classification. IEEE Transactions on Geoscience and Remote Sensing, vol. 52(4), pp. 2186–2196, 2013.
View Article
Google Scholar

[106] View Article

[107] Google Scholar

[ref42] 42. Moewes C, and Kruse R. On the usefulness of fuzzy SVMs and the extraction of fuzzy rules from SVMs In proc. of 7th Conference of the European Society for Fuzzy Logic and Technology (EUSFLAT) and LFA, 2011.

[ref43] 43. Chang CC, and Lin CJ. LIBSVM: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology, vol. 2(3), pp. 1–39, 2011. Software available at http://www.csie.ntu.edu.tw/cjlin/libsvm, date of access, 2016.
View Article
Google Scholar

[110] View Article

[111] Google Scholar

[ref44] 44. Sohn S, and Dagli CH. Advantages of Using Fuzzy Class Memberships in Self-Organizing Map and Support Vector Machines. In proc. of International Joint Conference on Neural Networks (IJCNN), vol. 3, pp. 1886–1890, 2001.

[ref45] 45. De LA, and Termini S. A Definition of a Non-Probabilistic Entropy in the Setting of Fuzzy Sets Theory. Journal of Information and Control, vol. 20, pp.301–312, 1972.
View Article
Google Scholar

[114] View Article

[115] Google Scholar

[ref46] 46. Yeung DS, and Tsang E. Measures of Fuzziness under Different uses of Fuzzy Sets. Advances in Computational Intelligence Communications in Computer and Information Science, vol. 298, pp. 25–34, 2012.
View Article
Google Scholar

[117] View Article

[118] Google Scholar

[ref47] 47. http://www.ehu.eus/ccwintco/index.php?title=GIC-experimental-databases. Online access year 2016.

[ref48] 48. Baumgardner MF, Biehl LL, and Landgrebe DA. 220 Band AVIRIS Hyperspectral Image Data Set: June 12, 1992 Indian Pine Test Site 3. Purdue University Research Repository. 2015, https://purr.purdue.edu/publications/1947/1

[ref49] 49. Gu Y, Wang C, You D, Zhang Y, Wang S, and Zhang Y. Representative Multiple Kernel Learning for Classification in Hyperspectral Imagery. IEEE Transactions on Geosciences and Remote Sensing, vol. 50(7), pp. 2852–2865, 2012.
View Article
Google Scholar

[122] View Article

[123] Google Scholar

[ref50] 50. Zhang Z, Pasolli E, Crawford MM, and Tilton JC. An Active Learning Framework for Hyperspectral Image Classification using Hierarchical Segmentation. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 9(2), pp. 640–654, 2016.
View Article
Google Scholar

[125] View Article

[126] Google Scholar

[ref51] 51. Shi Q, Du B, and Zhang L. Spatial Coherence-Based Batch-Mode Active Learning for Remote Sensing Image Classification. IEEE Transactions on Image Processing, vol. 24(7), pp. 2037–2050, 2015.
View Article
Google Scholar

[128] View Article

[129] Google Scholar

[ref52] 52. Li J, Dias JB, and Plaza A. Spectral-Spatial Classification of Hyperspectral Data using Loopy Belief Propagation and Active Learning. IEEE Transactions on Geoscience and remote sensing, vol. 51(2), pp. 844–856, 2013.
View Article
Google Scholar

[131] View Article

[132] Google Scholar

[ref53] 53. Nie F, Wang H, Huang H, and Ding C. Early Active Learning via Robust Representation and Structured Sparsity. 23rd International Joint Conference on Artificial Intelligence (IJCAI), pp. 1572–1578, 2013.

Figures

Abstract

Introduction

Materials and methods

Boundary extraction

Memberships function

Support Vector Machine (SVM)

Fuzzy K-Nearest Neighbors (FKNN)

Fuzziness relation between the samples and boundary

Fuzziness properties.

Measuring fuzziness.

Corollary.

System validation

Experimental setup

Experimental datasets

Experimental results

Comparison with state-of-the-art

Discussion

Conclusion

Supporting information

S1 File. The Indian Pines (corrected) dataset, consisting of 145*145 samples and 220 spectral bands with a spatial resolution of 20 m and a spectral range of 0.4–2.5 Î¼m.

S2 File. The original Indian Pines ground truths consist of 16 classes.

S3 File. This file contains MATLAB code for reshaping and rewriting of the original Indian Pines dataset and ground truths into text files as per journal requirements.

Acknowledgments

References