Next Article in Journal
Exchange-Traded Funds on European Markets: Has Critical Mass been Reached? Implications for Financial Systems
Previous Article in Journal
Generic Entanglement Entropy for Quantum States with Symmetry
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Multiscale Entropy Feature Extraction Method of Running Power Equipment Sound

1
Department of Automation, North China Electricity Power University, Baoding 071003, China
2
Department of Computer, North China Electricity Power University, Baoding 071003, China
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Entropy 2020, 22(6), 685; https://doi.org/10.3390/e22060685
Submission received: 27 May 2020 / Revised: 16 June 2020 / Accepted: 17 June 2020 / Published: 19 June 2020

Abstract

:
The equipment condition monitoring based on computer hearing is a new pattern recognition approach, and the system formed by it has the advantages of noncontact and strong early warning abilities. Extracting effective features from the sound data of the running power equipment help to improve the equipment monitoring accuracy. However, the sound of running equipment often has the characteristics of serious noise, non-linearity and instationary, which makes it difficult to extract features. To solve this problem, a feature extraction method based on the improved complementary ensemble empirical mode decomposition with adaptive noise (ICEEMDAN) and multiscale improved permutation entropy (MIPE) is proposed. Firstly, the ICEEMDAN is utilized to obtain a group of intrinsic mode functions (IMFs) from the sound of running power equipment. The noise IMFs are then identified and eliminated through mutual information (MI) and mean mutual information (meanMI) of IMFs. Next, the normalized mutual information (norMI) and MIPE are calculated respectively, and norMI is utilized to weigh the corresponding MIPE result. Finally, based on the separability criterion, the weighted MIPE results are feature-dimensionally reduced to obtain the multiscale entropy feature of the sound. The experimental results show that the classification accuracies of the method under the conditions of no noise and 5 dB reach 96.7% and 89.9%, respectively. In practice, the proposed method has higher reliability and stability for the sound feature extraction of the running power equipment.

1. Introduction

As the basic unit of a power system, the power equipment is of great importance and its operation status affects the safety, stability, and efficiency of the power grid. With the increase of power equipment, the possibility of equipment failure and the resulting loss rises accordingly. Therefore, it has become an important research issue to study safer and more effective state monitoring methods, so as to improve the monitoring sensitivity, realize fault warning, and improve the generalization of fault diagnosis systems [1,2,3].
In recent years, the state monitoring and fault diagnosis technology for power equipment with modern information technology has been vigorously promoted, and many kinds of equipment operation information have been applied to various fields [4]. The researchers studied different forms of equipment condition monitoring and fault warning from the aspects of equipment images [5,6,7,8], electromagnetic waves [9], ultrasonic waves [10,11], temperature [12,13], pressure [14] and vibration signals [15,16,17]. However, the development of equipment fault is a slow and nonlinear process, and the influencing factors are also multi-dimensional, complex, and changeable. In fact, these factors are not sensitive to the change of low load, making it a challenge to obtain timely and accurate early warning. Besides, the application of the information above often requires multiple sensors for contact measurement and the information collected is especially dependent on the location of the sensors, which brings great difficulties for equipment maintenance and adaption to the harsh environment and high load variation in the power plant. In view of this, many efforts have been made to get new detection information.
As another research field of artificial intelligence at present, computer hearing develops rapidly, but most of the progress focuses on the speech recognition technology, while the application in the power system has not been paid attention to [2,18]. The nonstationary noise generated by operation is the main information source of computer hearing in power equipment condition monitoring. The sound information has the advantages of wide sources, non-contact measurement, real-time monitoring, and strong fault warning ability, almost comparable to all current state detection parameters [19]. Moreover, the sound of running power equipment contains a lot of characteristic information, which helps to improve the detection and classification accuracy significantly. Therefore, it is extremely important to study the sound feature extraction technology for running power equipment [20,21].
Due to the coupling effect of operating noise between the power equipment, the acquired sound is often high noisy and nonlinear, making it difficult to extract effective features from such a complex signal. Many efforts had been done to study the mechanism of running equipment sound by simulation and experiment [22,23,24,25], frequency spectrum analysis [26,27,28], and wavelet analysis methods [29,30,31]. However, these methods are incapable of adaptively analyzing and eliminating the noise interference between the devices [32]. Hence, the empirical mode decomposition (EMD) [33] was utilized to remove the noise in the equipment sound. EMD, proposed by Huang, is an adaptive decomposition method for nonlinear and non-stationary signals. It is data-driven and parameter-free when decomposing a time series adaptively into a group of intrinsic mode functions (IMFs). The IMFs can be classified into noise IMFs and signal IMFs according to different center frequencies. However, a serious defect of the EMD is the mode mixing, which means that signals with different center frequencies will appear in the same mode. In order to overcome this problem, the ensemble empirical mode decomposition (EEMD) was proposed by Wu and Huang in 2009 [34]. The EEMD can effectively solve the mode mixing by adding white Gaussian noise, but it also generates two problems. Firstly, the reconstructed signal inevitably contains residual noise. Secondly, the different ways of adding noise to the signal will result in a different number of modes. In light of this, the complementary ensemble empirical mode decomposition with adaptive noise (CEEMDAN) was proposed [35]. Due to its powerful complex signal analysis capability, CEEMDAN is favored in different fields such as fault diagnosis [36,37,38], seismology [39], traffic flow prediction [40], and medicine [41,42]. However, CEEMDAN may produce some spurious modes in the early stage of decomposition [43]. Colominas et al. proposed an improved complementary ensemble empirical mode decomposition with adaptive noise (ICEEMDAN), which is an improved version of CEEMDAN [43]. ICEEMDAN calculates the local mean of the original signal to obtain each mode. By using ICEEMDAN, not only can the noise in the mode be reduced, but also the residual spurious modes problem caused by signal overlap can be reduced.
Entropy theory has shown a remarkable effect extracting the characteristic information of nonlinear and non-stationary signals in power equipment [38]. Various entropy algorithms have been put forward, including the sample entropy (SE) [44], fuzzy entropy (FE) [45], and permutation entropy (PE) [46]. Among them, PE becomes popular in the industrial field due to its convenient calculation and simple theory [47]. Nevertheless, there are two problems: (1) PE is sensitive to small changes in signal and susceptible to noise. (2) the entropy estimation results obtained by PE are liable to be affected by equalities in the signal. In order to solve the above problems, Chen Z et al. proposed the improved permutation entropy (IPE) [48]. By using a uniform quantification (UQ) operator to symbolize the signal, the algorithm not only improves the measurement accuracy of signal complexity but also makes noise interference more robust. The signals generated from complex systems usually exhibit multiscale structures [49], but the entropy algorithms above are all single-scale based. On account of this, Costa et al. [49] proposed a coarse-graining process, and it can be combined with an arbitrary entropy estimation algorithm for multiscale analysis. Combining the coarse-graining process with IPE, the multiscale improved permutation entropy (MIPE) can be obtained [48].
Since the mode decomposition-based and entropy-based techniques have a lot of advantages in processing complex time series, in this paper, a feature extraction method combining normalized mutual information (norMI) and separability criterion is proposed based on ICEEMDAN and MIPE to process the sound of running power equipment in this paper. The proposed method firstly eliminates the noise of the acoustic signals. Compared with the existing feature extraction technologies, it mines the multiscale characteristics of the sound based on ICEEMDAN and MIPE. Moreover, norMI is employed to weight MIPE results, which takes the importance of signal IMFs into account and makes use of the separability criterion to extract effective features and reduce dimensions from the weighted MIPE results. In such a way, the aim of revealing the inherent nonlinear feature of the sound without any noise interference can be achieved.
The rest of the paper is organized as follows: the proposed feature extraction theory is described in Section 2; the simulation and experimental results are provided in Section 3 and Section 4 respectively; and the paper is concluded in Section 5.

2. Algorithm

2.1. ICEEMDAN

The flowchart of the ICEEMDAN algorithm is shown in Figure 1.
Given a composite signal x ( t ) , t represents the sampling sequence of the composite signal. Let E k ( · ) be the kth IMF obtained by EMD and define M ( · ) as the operator to calculate the local mean of a signal, and the ICEEMDAN algorithm is described as follows:
(1)
Calculate E 1 ( x ) = x M ( x ) . For x i ( t ) = x ( t ) + β 0 E 1 ( ω ( i ) ) , i = 1 , 2 , , I , the first residue is obtained by r 1 = M x i ( t ) ¯ , where ω ( i ) denotes ith added white Gaussian noise with zero mean and unit variance, I is the predefined ensemble sizes denoting the number of added ω ( i ) , and M x i ( t ) ¯ denotes the action of averaging throughout the realizations of M x i ( t ) , i = 1 , 2 , , I .
(2)
The first mode can be written as IMF 1 = x r 1 .
(3)
Calculated the second residue by r 2 = M r 1 + β 1 E 2 ω ( i ) ¯ , and the second mode can be expressed as IMF 2 = r 1 r 2 .
(4)
For j = 3 , 4 , 5 , , J , the jth residue and jth mode can be obtained by r j = M r j 1 + β j 1 E j ω ( i ) ¯ and IMF j = r j 1 r j respectively, where J is the number of IMFs.
(5)
Repeat Step (4) until all IMFs are obtained.
The constant β j 1 is selected to adjust the signal-to-noise ratio (SNR) between the residual noise and the added noise. For j = 1 , β 0 = ε 0 s t d ( x ) / s t d ( E 1 ( ω ( i ) ) ) , where s t d ( · ) represents the operator of standard deviation (SD) and ε 0 is the reciprocal of the expected SNR between the input signal x ( t ) and the first added noise [43]. For j 2 , β j = ε 0 s t d ( r j ) .

2.2. Mutual Information, Mean Mutual Information and Normalized Mutual Information

The mutual information (MI) between two discrete random variables X and Y can be expressed as:
MI ( X , Y ) = y Y x X p ( x , y ) log p ( x , y ) p ( x ) p ( y )
where p ( x ) and p ( y ) represent the probability density function of X and Y respectively, and p ( x , y ) denotes their joint probability density function. The mutual information is a measure of the correlation between two random variables [50]. If X and Y are independent, MI ( X , Y ) = 0 . Generally, the signal IMFs are more correlated with the original signal than the noise IMFs. Therefore, the mutual information can be used as an indicator to distinguish the signal IMFs from IMFs. The proposed method adopts the mean mutual information (meanMI) as a standard to compare the correlation between IMF and the original signal, which can be calculated as:
meanMI = 1 J j = 1 J MI IMF j , x
where J denotes the number of IMFs decomposed from the original signal. If the MI of signal IMFs is larger than meanMI, it can be called a signal IMF.
In order to calculate the weighted MIPE (refer to Section 2.5), the norMI of each signal IMF is defined as:
norMI i = MI IMF i , x l P MI IMF l , x , i = 1 , 2 , , P
where P denotes the number of signal IMFs.

2.3. MIPE

Given a time series x ( i ) , 1 i N and the time scale factor s, the subsequence y i s can be calculated by the coarse-graining process, expressed as:
y j s = 1 s i = ( j 1 ) s + 1 j s x ( i ) , 1 j N s
Given the embedding dimension m and the time delay t, the embedding vectors z s of y i s are defined as:
z s = y j s , y j + t s , , y j + ( m 1 ) t s ,
where j = 1 , 2 , , N / s ( m 1 ) t . Then, the embedded vector is symbolized based on the uniform quantization (UQ) operator in Reference [51]. The UQ operator can be represented as:
UQ ( x ) = 0 x min x Δ 1 Δ x 2 Δ L 1 ( L 1 ) Δ x x max
where x is the input series, x min and x max the minimum and maximum values of x respectively, L is the predefined discretization level, and the procedure parameter Δ = ( x max x min ) / L . Obviously, for the input series x, the UQ operator can produce an integer sequence ranging from 0 to L 1 .
Based on Equation (6), the initial column vector of the embedded vector z s is symbolized to obtain the symbolized sequence s y m 1 s , and then all column vectors of the embedded vector z s are symbolized based on the following equation:
s y m k s = s y m 1 s + z k s z 1 s Δ , 2 k m
Next, similar to PE, each s y m l s ( 1 l L m ) corresponds to the pattern π l , and the probability distribution p l of π l can be calculated. Here π l denotes lth permutations of all permutations. These permutations are considered as the possible order types of L different numbers. The normalized IPE on scale factor s is written as:
H I P E s ( m , t , L , s ) = l = 1 h p l s × ln p l s ln L m
where 1 h L m , and ln ( L m ) is the maximum value of H I P E s which will be reached only when the patterns have a uniform distribution.
The MIPE vector can be computed by traversing all scale factors from 1 to s. The pseudo-code of MIPE is given in Algorithm 1.
Algorithm 1: Extract multiscale improved permutation entropy (MIPE) vector form time series.
Entropy 22 00685 i001

2.4. Separability Criterion

Suppose the finite feature vectors contain N samples belonging to C classes, and the sample number of the i-th class is N i , 1 i C . The interclass discrete matrix S B and the intra-class discrete matrix S W can be represented by Equations (9) and (10), respectively, and the separable criterion value (SC) can be expressed by Equation (11):
S B = i = 1 C N i N m i m m i m T
S W = i = 1 C N i N E i
S C = t r S W 1 · S B ,
where m i is the mean value of the i-th-class sample feature vectors, m is the mean of all sample feature vectors, E i is the covariance matrix of the i-th-class sample feature vectors, and t r ( · ) is an operator to compute the trace of a matrix. S B and S W respectively represent the inter-class distance and intra-class distance of the sample feature vectors. The larger the inter-class distance and the smaller the intra-class distance, the larger SC is; that is, the classes are more separable. By quantifying the separability criterion, the effective information in the feature vectors can be effectively identified and reduced [52].

2.5. Proposed Feature Extraction Method

The detailed flowchart of the proposed feature extraction method is shown in Figure 2. The specific steps of the algorithm are as follows:
(1)
Decompose the input signal by the ICEEMDAN algorithm to obtain a group of IMFs.
(2)
Calculate MI and meanMI of IMFs, and the signal IMFs can be identified by comparing MI of each IMF with meanMI (MI > meanMI).
(3)
Calculate norMI and MIPE of each signal IMF, respectively.
(4)
Use NorMI as the weight coefficient to weigh the corresponding MIPE results, and the weighted MIPE results are defined as the weighted sum.
(5)
Extract the multiscale entropy feature vector by applying the separability criterion for dimension reduction to the weighted MIPE results.

3. Algorithm Simulation

3.1. Analysis on Artificial Signal Based on ICEEMDAN

In this section, the performance of ICEEMDAN on an artificial signal will be analyzed. The signal was generated by Equation (12), where the number of sampling points of each signal was 1000 ( 1 n 1000 ) . s 1 ( n ) and s 2 ( n ) are the two source signals to be decomposed, s 3 ( n ) are the cosine noise, S ( n ) are the mixed artificial signals, and ω ( n ) denotes the white Gaussian noise with zero mean and unit variance.
s 1 ( n ) = sin ( 2 π · 0.20 ( n 201 ) ) 201 n 350 cos ( 2 π · 0.26 ( n 501 ) ) 501 n 750 0 other s 2 ( n ) = sin ( 2 π · 0.05 ( n 1 ) ) s 3 ( n ) = cos ( 2 π · 0.5 ( n 1 ) ) S ( n ) = s 1 ( n ) + s 2 ( n ) + 0.001 × s 3 ( n ) + ω ( n )
The source signal waveform of the artificial signal is shown in Figure 3a. The analysis results of ICEEMDAN, CEEMDAN, EEMD, and EMD are shown in Figure 3b–e, respectively. To evaluate the algorithm, the added noise amplitude ε 0 and the ensemble sizes I were selected as 0.2 and 100, respectively; the maximum number of iterations was 10,000. The following studies will use the same parameters. Due to the limitations of EMD [34], it can be seen from Figure 3e that the mode mixing occurred in EMD. From IMF3 to IMF8, each IMF had no fixed central frequency. Comparing Figure 3d with Figure 3e, the mode mixing problem of EEMD is improved, but the mode mixing still exists at some signal mutation positions (n = 200, 350, 500, and 750). As can be seen from Figure 3c that although the IMFs (IMF1 and IMF4) obtained by CEEMDAN were similar to the source signal, it generated spurious modes such as IMF2 and IMF3. The decomposition results of ICEEMDAN were consistent with the actual situation, which shows the superiority of this algorithm. Therefore, ICEEMDAN is used to decompose the acoustic signal of the electric equipment in this paper.

3.2. Analysis on Chaotic Signals Based on MIPE

In order to verify the effectiveness of the method proposed in Section 2.3, the entropy feature extraction was carried out on four typical chaotic signals, the Lorenz chaotic system, namely the Rossler chaotic system, the Duffing chaotic system, and the Chen chaotic system. For the given appropriate parameters, these four systems have chaotic characteristics. The Lorenz system can be expressed as:
x ˙ = a ( x y ) y ˙ = x z + c x y z ˙ = x y b z ,
where a = 10, b = 8/3, and c = 28.
The Rossler system can be expressed as:
x ˙ = y z y ˙ = x + a y z ˙ = x z c z + b ,
where a = 0.2, b = 0.2, and c = 5.7.
The Duffing system can be expressed as:
x ˙ = y y ˙ = b x + a y y 3 ,
where a = 0.82 and b = −0.5.
The Chen system can be expressed as:
x ˙ = a ( y x ) y ˙ = ( c a ) x x z + c y z ˙ = x y b z ,
where a = 35, b = 3, and c = 28.
The random number generator was used to set the initial values of each chaotic system, and these equations were integrated by using a fourth-order Runge–Kutta method with a fixed step size of 0.01. The X component signal with a length of 2048 points was selected as the chaotic signal. The time-domain waveforms of Lorenz, Rossler, Duffing, and Chen are shown in Figure 4.
For comparison, the multiscale sample entropy (MSE) [49], multiscale fuzzy entropy (MFE) [53], multiscale replacement entropy (MPE) [54] and MIPE were selected to analyze these four chaotic systems. According to [48], the parameters were set as follows: the embedding dimension m = 4 , the time delay t = 1 , the discrete level L = 4 , and the time scale s = 10 . The following studies used the same parameters. The analysis results are shown in Figure 5. The entropy results tended to increase with the increase of the time scale, which is reasonable. With the increase of the coarse-graining process, the change in the unit data length rose, increasing the data randomness. The comparison in Figure 5 shows that the MSE is difficult to distinguish the Lorenz, Rossler, and Duffing systems. For a small time scale, MFE and MPE cannot distinguish the Rossler system from Duffing chaotic systems, while MIPE can distinguish all chaotic signals. MIPE has a strong ability to classify multiscale complexity signals. Therefore, MIPE was utilized to extract the entropy characteristics of running power equipment sound in this paper.

4. Feature Extraction of Power Equipment Sound

In this section, the proposed feature extraction algorithm is used to analyze the sound of actual power equipment. The audio data used in this paper came from four types of key power equipment measured in a power plant under the same conditions. Type A, B, C, and D respectively represent the feeder connecting shaft, induced fan blade, coal grinder, and circulating water pump. For each type of electrical equipment, we acquired 50 samples of 1.5 s duration. The sampling frequency of each sample is 16 kHz. The sound waveforms of four power equipment are shown in Figure 6.

4.1. Feature Extraction Based on ICEEMDAN and MIPE

The effectiveness of the proposed feature extraction method is verified and demonstrated in this subsection. As shown in Figure 7, ICEEMDAN was used to decompose randomly selected experimental data to produce a group of IMFs with different center frequencies. For clarity, only the first ten IMFs are demonstrated. Figure 8 shows the MI of each IMF and the original signal, where the dashed line of the corresponding color represents the corresponding meanMI to distinguish the signal IMFs.
After eliminating the noise IMFs, the norMI and MIPE of each signal IMFs were calculated. Then norMI was used to weight the corresponding MIPE results. The weighted MIPE results took into account the importance of each signal IMFs. The multiscale MIPE results of the four power devices obtained through an average of 50 sets of experimental data are shown in Figure 9. The scale factor was selected as s = 1–30, and the error bars represent the SD of the weighted MIPE values.
The separability criterion was used to analyze each dimension of the weighted MIPE results. The distribution of SC is shown in Figure 10, where the black dashed line represents the mean value of 30 SCs. For the separability criterion larger than the mean of separability criterion value, the feature can be defined as an effective one. Comparing Figure 9 with Figure 10, it can be seen that the separability criterion distribution had a positive correlation with the dispersion degree of the weighted MIPE result. The SC was large when these four types of weighted MIPE results were significantly different. Hence, it is obvious that the dimension reduction extraction based on the separability criterion is effective.
The multiscale entropy feature vector was obtained after the feature dimension reduction, as shown in Figure 11. For different types of running power equipment sound, the entropy feature vectors are clearly different, indicating that the extracted features are effective for power equipment classification. Moreover, the error bar on each scale factor is low, proving the reliability of the proposed method.
For comparison, the same experimental data were analyzed using the feature extraction method in [48,55]. The feature extraction results of MIPE [48] are shown in Figure 12a, where the mean value of IPE and its standard deviation error is drawn. The IPE values of type B and C overlap in contrast with that in Figure 11. In particular, the IPE values of the four types of signals all overlap and are difficult to distinguish when s > 6 . The reason lies in the lack of noise elimination before the MIPE calculation, and the results are influenced by the noise, which becomes larger with the coarse-graining process. The analysis results of CEEMDAN-PE [55] are demonstrated in Figure 12b, where the abscissa represents the different types of samples and the ordinate represents the PE value. The parameters of the algorithm were set as same as those in [55]. Because CEEMDAN-PE was based on a single scale, the relationship between entropy and time scale was discarded. It can be seen from Figure 12b that the PE values of type B and type C are close to each other. The results of type A overlap with those of other types, making them difficult to be distinguished.
To study the effect of the feature extraction method above under a noisy condition, the white Gaussian noise was added into the running power equipment sound to produce different SNR conditions. As shown in Figure 13, the methods mentioned above were applied to extract features for the sound signal under the condition of 0 dB. Compared with the effect shown in Figure 11 and Figure 12, CEEMDAN-PE, which is based on a single scale, becomes invalid due to noise interference. The results of type A, type B, and type C overlap more, greatly increasing the difficulty and accuracy of classification. Similarly, due to the lack of effective de-noising process, the performance of MIPE declined rapidly, and the differentiation of MIPE of each type decreased. Especially when s = 1–5, SD of the sample data increased significantly, which reduces the robustness of the classification. On the contrary, the added noise has little influence on results obtained by the proposed method, which proves its credibility.

4.2. Classification of Power Equipment

In order to verify the feature extraction method, a widely applied classifier—support vector machine (SVM)—was used to process the features extracted in Section 4.1. For each type of power equipment, 25 zero noise samples were randomly selected for training and the remaining 25 samples were used for validation. We repeated this ten times, and took the average of the results as the classification results, as listed in Table 1. To study the role of the separability criterion in the proposed algorithm, the classification accuracy of the weighted MIPE feature vectors without feature dimensionality reduction was calculated. As shown in Table 1, the classification accuracy of the weighted MIPE feature vector and the proposed method was higher than other feature extraction methods, whether the noise was added or not. Moreover, the separability criterion can significantly improve the classification accuracy and enhance the robustness of the algorithm under serious-noise conditions.
As can be seen from Table 1, the classification accuracy is in good agreement with the feature extraction results in Section 4.1. For a clean signal, the proposed method achieved an accuracy rate of 96.7%, 12.1%, and 27.8% higher than that of MIPE and CEEMDAN-PE, respectively. The SNR decreasing to 5 dB, the classification accuracy of the proposed method declined to 89.9%, while the classification accuracy of MIPE and CEEMDAN-PE dropped to 52.2% and 65.8%, respectively. As the SNR dropped to 0 dB, the classification accuracy of MIPE and CEEMDAN-PE algorithms dropped to 46.6% and 64.9% respectively. In contrast, the proposed method still had a classification accuracy of 92.7%.
Comparing the classification results of MIPE and CEEMDAN-PE, the MIPE performance declined rapidly under high noise conditions due to the lack of the de-noising process. Similarly, for the classification rate of a clean signal, the effective entropy algorithm helps to extract the nonlinear features in the signal and significantly improves the classification accuracy. The results above prove the validity of the algorithm from another angle.

5. Conclusions

A separability criterion is proposed to extract effective features from the sound of running power equipment. Compared with the existing feature extraction technology, it is based on multiple scales and removes noise before calculating MIPE. Moreover, the proposed method uses norMI to weight MIPE results, which takes into account the importance of signal IMFs and utilizes the separability criterion to extract effective features and reduce dimensions of the weighted MIPE results. In this way, the robustness and accuracy of the equipment classification are improved significantly. The validation of the proposed algorithm is proved by analyzing acoustics signals measured from four types of electrical equipment, which demonstrates more precise identifications and higher sensitivity than the MIPE and CEEMDAN-PE. Therefore, the proposed method is more reliable and suitable for the entropy feature extraction for the running power equipment sound in practice, and it provides a supplement to monitoring techniques for electrical equipment.

Author Contributions

Conceptualization, methodology and reviewing, Y.Z.; writing and editing, X.Y.; data curation, Y.P.; software, X.W.; investigation, K.B. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded in part by National Natural Science Foundation of China under Grant 61773160, and 61871182; and in part by the Natural Science Foundation of Beijing under Grant 4192055.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
EMDEmpirical Mode Decomposition
IMFIntrinsic Mode Function
EEMDEnsemble Empirical Mode Decomposition
CEEMDANComplementary Ensemble Empirical Mode Decomposition with Ddaptive Noise
ICEEMDANImproved Complementary Ensemble Empirical Mode Decomposition with Ddaptive Noise
SESample Entropy
FEFuzzy Entropy
PEPermutation Entropy
IPEImproved Permutation Entropy
UQUniform Quantification
MIPEMultiscale Improved Permutation Entropy
norMINormalized Mutual Information
SNRSignal-to-Noise Ratio
SDStandard Deviation
MIMutual Information
meanMIMean Mutual Information
SCSeparable Criterion Value
MSEMultiscale Sample Entropy
MFEMultiscale Fuzzy Entropy
MPEMultiscale Permutation Entropy
SVMSupport Vector Machine

References

  1. Basak, D.; Tiwari, A.; Das, S. Fault diagnosis and condition monitoring of electrical machines-A Review. In Proceedings of the 2006 IEEE International Conference on Industrial Technology, Mumbai, India, 15–17 December 2006; pp. 3061–3066. [Google Scholar]
  2. Zhai, Y.J.; Yang, X.; Peng, Y.N.; Wang, X.Y. Review of Research on State Monitoring of Electrical Equipment Based on Computer Hearing. Guangdong Electr. Power 2019, 32, 24–32. [Google Scholar]
  3. Zheng, Z.; Xin, G. Fault Feature Extraction of Hydraulic Pumps Based on Symplectic Geometry Mode Decomposition and Power Spectral Entropy. Entropy 2019, 21, 476. [Google Scholar] [CrossRef] [Green Version]
  4. Zhang, L.; Yang, C.; Li, S.Y.; Zhang, L.J.; Shen, J. Multi-dimensional state monitoring and fault diagnosis of 500 kV Transformer. Power Syst. Big Data 2018, 21, 67–73. [Google Scholar]
  5. Yang, L. Discussion on Online Monitoring and Condition Based Maintenance Technology for Power Primary Equipment. Telecom Power Technol. 2018, 35, 62–64. [Google Scholar]
  6. Yu, Y.; Cao, H.; Wang, Z.; Li, Y.; Li, K.; Xie, S. Texture-and-shape based active contour model for insulator segmentation. IEEE Access 2019, 7, 78706–78714. [Google Scholar] [CrossRef]
  7. Pernebayeva, D.; Bagheri, M.; James, A. High voltage insulator surface evaluation using image processing. In Proceedings of the 2017 International Symposium on Electrical Insulating Materials(ISEIM), Toyohashi, Japan, 11–15 September 2017; pp. 520–523. [Google Scholar]
  8. Gong, X.; Yao, Q.; Wang, M.; Lin, Y. A Deep Learning Approach for Oriented Electrical Equipment Detection in Thermal Images. IEEE Access 2018, 6, 41590–41597. [Google Scholar] [CrossRef]
  9. Vasile, C.; Ioana, C. Arc fault detection & localization by electromagnetic-acoustic remote sensing. In Proceedings of the IOP Conference Series: Materials Science and Engineering, St. Gilles-les-Bains, Reunion, 10–13 October 2016; p. 012009. [Google Scholar]
  10. Du, G.; Xiong, J.; Zhang, R.B. Research on GIS bus fault location based on pulse voltage and ultrasonic detection. Guangdong Electr. Power 2019, 32, 115–122. [Google Scholar]
  11. Zhang, X.; Zhang, Y. Application of ultrasonic testing technology in insulation diagnosis of power equipment. Autom. Instrum. 2017, 12, 71. [Google Scholar]
  12. Boubendir, S.; Larbi, S.; Bennacer, R. Numerical study of the thermo-hydrodynamic lubrication phenomena in porous journal bearings. Tribol. Int. 2011, 44, 1–8. [Google Scholar] [CrossRef]
  13. Mao, K.; Li, W.; Hooke, C.J.; Walton, D. Polymer gear surface thermal wear and its performance prediction. Tribol. Int. 2010, 43, 433–439. [Google Scholar] [CrossRef]
  14. Guozhi, Z.; Zhang, X.; Xingrong, H.; Jia, Y.; Tang, J.; Yue, Z.; Yuan, T.; Zhenze, L. On-line monitoring of partial discharge of less-oil immersed electric equipment based on pressure and UHF. IEEE Access 2019, 7, 11178–11186. [Google Scholar] [CrossRef]
  15. Balan, H.; Varodi, T.; Buzdugan, M.I.; Munteanu, R.A. Monitoring power breakers using vibro acoustic techniques. In Proceeding of the 2016 International Conference on Applied and Theoretical Electricity (ICATE 2016), Craiova, Romania, 6–8 October 2016; pp. 1–6. [Google Scholar]
  16. Long, X.; Yang, P.; Guo, H.; Zhao, Z.; Wu, X. A CBA-KELM-based recognition method for fault diagnosis of wind turbines with time-domain analysis and multisensor data fusion. Shock Vib. 2019, 2019. [Google Scholar] [CrossRef] [Green Version]
  17. Yang, F.; Kou, Z.; Wu, J.; Li, T. Application of mutual information-sample entropy based MED-ICEEMDAN De-noising scheme for weak fault diagnosis of hoist bearing. Entropy 2018, 20, 667. [Google Scholar] [CrossRef] [Green Version]
  18. Lyon, R.F. Machine hearing: An emerging field [exploratory dsp]. IEEE Signal Process. Mag. 2010, 27, 131–139. [Google Scholar] [CrossRef]
  19. Zaporozhets, A.; Eremenko, V.; Serhiienko, R.; Ivanov, S. Development of an intelligent system for diagnosing the technical condition of the heat power equipment. In Proceedings of the 2018 IEEE 13th International Scientific and Technical Conference on Computer Sciences and Information Technologies (CSIT), Lviv, Ukraine, 11–14 September 2018; pp. 48–51. [Google Scholar]
  20. Wu, X.W.; Zhou, X.W.; Hu, S.; Peng, J.W.; Ying, L.M. Noise measurement and analysis of the main power apparatus in a 500 kV substation. Environ. Eng. 2016, 34, 1137–1140. [Google Scholar]
  21. Wu, X.W.; Du, X.W.; Sun, X. Fault Analysis of Construction Machinery Hydraulic System Based on Noise. J. North China Inst. Water Conserv. Hydroelectr. Power 2012, 33, 86–88. [Google Scholar]
  22. Mei, Y.M.; Gu, W.F.; Zhu, X.Y.; Zhu, B. Noise Analysis and Signal Processing in the Turbine Valve Closing Test. Electr. Power 2019, 52, 154–160. [Google Scholar]
  23. Yan, J.Z.; Zhou, J.; Ji, C.N.; Wang, D.G.; Li, S.C.; Wang, Y.; Qiao, G.L. Preliminary Study on Cracking Defect Detection of the Fan Blades based on Aerodynamic Noise. Instrum. Anal. Monit. 2018, 34, 1–6. [Google Scholar]
  24. Wang, G.Y.; Xing, L.L. Design and Implementation of Corona Audible Noise Signal Detecting System of High Voltage Transmission Line. Chin. J. Electron. Devices 2017, 40, 918–924. [Google Scholar]
  25. Hu, S.; Hao, J.B.; Luo, Z.Q.; Sun, B.; Meng, Z.H.; Wu, X.W.; Tang, Q. A Diagnosis Method for Hydraulic Generator Fault Based on Noise Frequency Band Extraction. Large Electr. Mach. Hydraul. Turbine 2017, 45, 25–29. [Google Scholar]
  26. Wei, W.D.; Chen, D.Z.; Hou, X.G.; Hu, S.Y.; Hu, W.M.; Zhang, D. Fault Diagnosis of Broken Rotor Bars of Asynchronous Motors Based on Stator Winding Signal Current and Noise Signal. Electr. Mach. Control Appl. 2015, 42, 69–72. [Google Scholar]
  27. Ma, C.L.; Xie, R.B.; Zhao, L.H.; Li, Z.P.; Xu, S.R. Characteristic analysis of transformer audible acoustic signals. Power Syst. Big Data 2018, 21, 18–26. [Google Scholar]
  28. Cheng, L. Fan’s Fault Diagnosis by Noise Frequency Spectrum. Nondestruct. Test. 2002, 25, 162–163. [Google Scholar]
  29. Rao, J.G.; Gu, G.M. Wind Turbine Blade Damage Identification Based on Harmonic Wavelet Packet and Support Vector Machine. Fiber Reinf. Plast./Compos. 2014, 41, 37–41. [Google Scholar]
  30. Fu, L.H.; Wang, P.; Hu, G.Z. Method to Eliminate Noise in On-Line PD Monitoring System of Transformer Based on Wavelet Analysis. Transformer 2005, 42, 44–47. [Google Scholar]
  31. Shen, X.B.; Wang, M.; Chen, R. The Application of Wavelet Packet Filter in GIS Partial Discharge On-line Monitoring System. Digit. Technol. Appl. 2017, 8, 81–83. [Google Scholar]
  32. Shu, C.; Jin, X.; Li, Z.P.; Zhouyang, J.R.; Fan, S.W. Noise Diagnosis Method of Distribution Transformer Discharge Fault Based on CEEMDAN. High Volt. Eng. 2018, 44, 2603–2611. [Google Scholar]
  33. Huang, N.E.; Shen, Z.; Long, S.R.; Wu, M.C.; Shih, H.H.; Zheng, Q.; Yen, N.C.; Tung, C.C.; Liu, H.H. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proc. R. Soc. Lond. Ser. A Math. Phys. Eng. Sci. 1998, 454, 903–995. [Google Scholar] [CrossRef]
  34. Wu, Z.; Huang, N.E. Ensemble empirical mode decomposition: A noise-assisted data analysis method. Adv. Adapt. Data Anal. 2009, 1, 1–41. [Google Scholar] [CrossRef]
  35. Yeh, J.R.; Shieh, J.S.; Huang, N.E. Complementary ensemble empirical mode decomposition: A novel noise enhanced data analysis method. Adv. Adapt. Data Anal. 2010, 2, 135–156. [Google Scholar] [CrossRef]
  36. Tian, S.; Bian, X.; Tang, Z.; Yang, K.; Li, L. Fault Diagnosis of Gas Pressure Regulators Based on CEEMDAN and Feature Clustering. IEEE Access 2019, 7, 132492–132502. [Google Scholar] [CrossRef]
  37. Gao, W.; Wai, R.J.; Qiao, S.P.; Guo, M.F. Mechanical faults diagnosis of high-voltage circuit breaker via hybrid features and integrated extreme learning machine. IEEE Access 2019, 7, 60091–60103. [Google Scholar] [CrossRef]
  38. Zhao, S.T.; Ma, L.; Zhu, J.P.; Li, J.P.; Zhao, H. Mechanical fault diagnosis of high voltage circuit breaker based on CEEMDAN sample entropy and FWA-SVM. Electr. Power Autom. Equip. 2020, 40, 181–186. [Google Scholar]
  39. Liu, X.; Song, Q.H. CEEMDAN adaptive threshold denoising algorithm in application to seismic direction. J. Chongqing Univ. 2019, 42, 95–104. [Google Scholar]
  40. Lu, W.; Rui, Y.; Yi, Z.; Ran, B.; Gu, Y. A Hybrid Model for Lane-Level Traffic Flow Forecasting Based on Complete Ensemble Empirical Mode Decomposition and Extreme Gradient Boosting. IEEE Access 2020, 8, 42042–42054. [Google Scholar] [CrossRef]
  41. Fuentealba, P.; Illanes, A.; Ortmeier, F. Cardiotocographic Signal Feature Extraction Through CEEMDAN and Time-Varying Autoregressive Spectral-Based Analysis for Fetal Welfare Assessment. IEEE Access 2019, 7, 159754–159772. [Google Scholar] [CrossRef]
  42. Luo, Z.Z.; Yan, Z.H.; Fu, W.D. Electroencephalogram Artifact Filtering Method of Single Channel EEG Based on CEEMDAN-ICA. Chin. J. Sens. Actuators 2018, 31, 1211–1216. [Google Scholar]
  43. Torres, M.E.; Colominas, M.A.; Schlotthauer, G.; Flandrin, P. A complete ensemble empirical mode decomposition with adaptive noise. In Proceedings of the 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2011), Prague, Czech Republic, 22–27 May 2011; pp. 4144–4147. [Google Scholar]
  44. Richman, J.S.; Moorman, J.R. Physiological time-series analysis using approximate entropy and sample entropy. Am. J. Physiol.-Heart Circ. Physiol. 2000, 278, H2039–H2049. [Google Scholar] [CrossRef] [Green Version]
  45. Chen, W.; Zhuang, J.; Yu, W.; Wang, Z. Measuring complexity using fuzzyen, apen, and sampen. Med. Eng. Phys. 2009, 31, 61–68. [Google Scholar] [CrossRef]
  46. Bandt, C.; Pompe, B. Permutation entropy: A natural complexity measure for time series. Phys. Rev. Lett. 2002, 88, 174102. [Google Scholar] [CrossRef]
  47. Li, Y.; Li, G.; Yang, Y.; Liang, X.; Xu, M. A fault diagnosis scheme for planetary gearboxes using adaptive multi-scale morphology filter and modified hierarchical permutation entropy. Mech. Syst. Signal Process. 2018, 105, 319–337. [Google Scholar] [CrossRef]
  48. Chen, Z.; Li, Y.; Liang, H.; Yu, J. Improved permutation entropy for measuring complexity of time series under noisy condition. Complexity 2019, 2019. [Google Scholar] [CrossRef] [Green Version]
  49. Costa, M.; Goldberger, A.L.; Peng, C.K. Multiscale entropy analysis of biological signals. Phys. Rev. E 2005, 71, 021906. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  50. Kvålseth, T.O. On normalized mutual information: Measure derivations and properties. Entropy 2017, 19, 631. [Google Scholar] [CrossRef] [Green Version]
  51. Porta, A.; Faes, L.; Masé, M.; D’addio, G.; Pinna, G.; Maestri, R.; Montano, N.; Furlan, R.; Guzzetti, S.; Nollo, G. An integrated approach based on uniform quantization for the evaluation of complexity of short-term heart period variability: Application to 24 h Holter recordings in healthy and heart failure humans. Chaos Interdiscip. J. Nonlinear Sci. 2007, 17, 015117. [Google Scholar] [CrossRef]
  52. Ji, H.; Bang, S. Feature selection for multi-class classification using pairwise class discriminatory measure and covering concept. Electron. Lett. 2000, 36, 524–525. [Google Scholar] [CrossRef]
  53. Zhao, H.; Sun, M.; Deng, W.; Yang, X. A new feature extraction method based on EEMD and multi-scale fuzzy entropy for motor bearing. Entropy 2017, 19, 14. [Google Scholar] [CrossRef] [Green Version]
  54. Du, W.; Guo, X.; Wang, Z.; Wang, J.; Yu, M.; Li, C.; Wang, G.; Wang, L.; Guo, H.; Zhou, J. A New Fuzzy Logic Classifier Based on Multiscale Permutation Entropy and Its Application in Bearing Fault Diagnosis. Entropy 2020, 22, 27. [Google Scholar] [CrossRef] [Green Version]
  55. Jiang, L.; Tan, H.; Li, X.; Chen, L.; Yang, D. CEEMDAN-Based Permutation Entropy: A Suitable Feature for the Fault Identification of Spiral-Bevel Gears. Shock Vib. 2019, 2019, 1–13. [Google Scholar] [CrossRef]
Figure 1. Flowchart of improved complementary ensemble empirical mode decomposition with adaptive noise (ICEEMDAN).
Figure 1. Flowchart of improved complementary ensemble empirical mode decomposition with adaptive noise (ICEEMDAN).
Entropy 22 00685 g001
Figure 2. Flowchart of proposed feature extraction method.
Figure 2. Flowchart of proposed feature extraction method.
Entropy 22 00685 g002
Figure 3. Artificial signal and decomposition results: (a) waveform of the artificial signal; (b) ICEEMDAN; (c) CEEMDAN; (d) EEMD; and (e) EMD.
Figure 3. Artificial signal and decomposition results: (a) waveform of the artificial signal; (b) ICEEMDAN; (c) CEEMDAN; (d) EEMD; and (e) EMD.
Entropy 22 00685 g003aEntropy 22 00685 g003b
Figure 4. Timing diagrams of (a) Lorenz; (b) Rossler; (c) Duffing; and (d) Chen.
Figure 4. Timing diagrams of (a) Lorenz; (b) Rossler; (c) Duffing; and (d) Chen.
Entropy 22 00685 g004
Figure 5. Entropy analysis results of chaotic systems: (a) multiscale sample entropy (MSE); (b) multiscale fuzzy entropy (MFE); (c) multiscale replacement entropy (MPE); and (d) multiscale improved permutation entropy (MIPE).
Figure 5. Entropy analysis results of chaotic systems: (a) multiscale sample entropy (MSE); (b) multiscale fuzzy entropy (MFE); (c) multiscale replacement entropy (MPE); and (d) multiscale improved permutation entropy (MIPE).
Entropy 22 00685 g005
Figure 6. Sound waveform of four types of running power equipment.
Figure 6. Sound waveform of four types of running power equipment.
Entropy 22 00685 g006
Figure 7. ICEEMDAN analysis results of four types: (a) Type A; (b) Type B; (c) Type C; and (d) Type D.
Figure 7. ICEEMDAN analysis results of four types: (a) Type A; (b) Type B; (c) Type C; and (d) Type D.
Entropy 22 00685 g007
Figure 8. MI and meanMI of four types of sound.
Figure 8. MI and meanMI of four types of sound.
Entropy 22 00685 g008
Figure 9. Weighted MIPE results.
Figure 9. Weighted MIPE results.
Entropy 22 00685 g009
Figure 10. Distribution of separable criterion.
Figure 10. Distribution of separable criterion.
Entropy 22 00685 g010
Figure 11. The multiscale entropy feature vector of four types of running power equipment sound.
Figure 11. The multiscale entropy feature vector of four types of running power equipment sound.
Entropy 22 00685 g011
Figure 12. Analysis results of other feature extraction methods: (a) MIPE; and (b) CEEMDAN-PE.
Figure 12. Analysis results of other feature extraction methods: (a) MIPE; and (b) CEEMDAN-PE.
Entropy 22 00685 g012
Figure 13. Feature extraction results under 0 dB condition: (a) the proposed method; (b) MIPE; and (c) CEEMDAN-permutation entropy (PE).
Figure 13. Feature extraction results under 0 dB condition: (a) the proposed method; (b) MIPE; and (c) CEEMDAN-permutation entropy (PE).
Entropy 22 00685 g013
Table 1. Classification accuracy for four types of power equipment by support vector machine (SVM).
Table 1. Classification accuracy for four types of power equipment by support vector machine (SVM).
MethodClean Signal5 dB0 dB
The proposed method96.7%89.9%92.7%
Weighted MIPE93.8%81.3%67.2%
MIPE [48]84.6%52.2%46.6%
CEEMDAN-PE [55]68.9%65.8%64.9%

Share and Cite

MDPI and ACS Style

Zhai, Y.; Yang, X.; Peng, Y.; Wang, X.; Bai, K. Multiscale Entropy Feature Extraction Method of Running Power Equipment Sound. Entropy 2020, 22, 685. https://doi.org/10.3390/e22060685

AMA Style

Zhai Y, Yang X, Peng Y, Wang X, Bai K. Multiscale Entropy Feature Extraction Method of Running Power Equipment Sound. Entropy. 2020; 22(6):685. https://doi.org/10.3390/e22060685

Chicago/Turabian Style

Zhai, Yongjie, Xu Yang, Yani Peng, Xinying Wang, and Kang Bai. 2020. "Multiscale Entropy Feature Extraction Method of Running Power Equipment Sound" Entropy 22, no. 6: 685. https://doi.org/10.3390/e22060685

APA Style

Zhai, Y., Yang, X., Peng, Y., Wang, X., & Bai, K. (2020). Multiscale Entropy Feature Extraction Method of Running Power Equipment Sound. Entropy, 22(6), 685. https://doi.org/10.3390/e22060685

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop