Next Article in Journal
Robust Null Broadening Beamforming Based on Covariance Matrix Reconstruction via Virtual Interference Sources
Previous Article in Journal
A Time-efficient Multi-Protocol Probe Scheme for Fine-grain IoT Device Identification
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Reliable Prognosis Approach for Degradation Evaluation of Rolling Bearing Using MCLSTM

School of Mechanical Engineering, Dalian University of Technology, Dalian 116024, China
*
Author to whom correspondence should be addressed.
Submission received: 7 March 2020 / Revised: 24 March 2020 / Accepted: 25 March 2020 / Published: 27 March 2020
(This article belongs to the Section Fault Diagnosis & Sensors)

Abstract

:
Prognostics and health management technology (PHM), a measure to ensure the reliability and safety of the operation of industrial machinery, has attracted attention and application adequately. However, how to use the monitored information to evaluate the degradation of rolling bearings is a significant issue for its predictive maintenance and autonomic logistics. This work presents a reliable health prognosis approach to estimate the health indicator (HI) and remaining useful life (RUL) of rolling bearings. Firstly, to accurately capture the degradation process, a novel health index (HI) is constructed based on correlation kurtosis for different iteration periods and a Gaussian process latency variable model (GPLVM). Then, a multiple convolutional long short-term memory (MCLSTM) network is proposed to predict HI values and RUL values. Finally, we perform experimental datasets of rolling bearings, demonstrating that the presented method surpasses other state-of-the-art prognosis approaches. The results also confirm the feasibility of the presented method in industrial machinery.

1. Introduction

Since the development of manufacturing technology, the structure of machinery tends to be integrated, complicated and intelligent; meanwhile, health management technology of mechanical equipment has received increasing research attention [1,2,3]. The core problem of health management is how to predict the remaining useful life (RUL) through the monitoring data accurately, and then determine the optimal maintenance opportunity. By minimizing the economic cost or risk of equipment failure, condition-based predictive maintenance and autonomous maintenance can be realized [4]. Therefore, it is still a great challenge for RUL prediction research of rolling bearings based on vibration data [5,6].
Nowadays, the RUL prediction methods of rolling bearings can be divided into two categories, i.e., model-based and data-driven approaches. Model-based approaches are mainly based on fracture mechanics, damage mechanics, stress, strain and other methods [7,8,9]. El-Tawil et al. [10] developed a prognostic methodology based on nonlinear damage to predict the RUL of the system. Pu et al. [11] studied the effect of sliding motion on the contact fatigue life of bearings. Wang et al. [12] investigated a hybrid prognosis approach for machine condition prognosis of bearings in a wind turbine. Cubillo et al. [13] presented a potential physics based on the prediction model for rotating machinery to describe the degradation process of the machinery. Chadli et al. [14] developed a novel method based on the design of distributed state estimation and fault detection and isolation filters, and its effectiveness was illustrated by a numerical example. Qian et al. [15] presented a modified Paris crack growth model to describethe bearings’ defect propagation on a slow-time scale, and phase space warping was enhanced by a multi-dimensional auto-regression model for RUL prediction. Chadli et al. [16] studied a polynomial fuzzy filter to solve the issues of fault detection. The model-based approaches can get deep into the essence of the target machine and get more accurate prediction results when predicting the degradation trend and remaining useful life. However, in the majority of engineering applications, it is difficult to establish a specific mathematical model that reflects the mechanical and physical laws of performance degradation.
The data-driven approaches can genuinely reflect the dynamic behavior of the monitoring object, and it is easy to adjust the model parameters and update the trend of performance degradation, which makes it develop and apply [17,18] rapidly. In general, data-driven RUL prediction includes four main processes [7]: data acquisition, feature extraction, degradation behavior learning and RUL estimation. An online performance evaluation method was proposed to predict the remaining life of a turbine [19]. Javed et al. [20] developed a novel approach using wavelet extreme-learning for RUL estimation task of bearings. Liu et al. [21] proposed an integrated framework to track the degradation state of bearings. With the development of sensor technology, data explosion has become a new problem of bearing remaining life prediction, which has made artificial intelligence technology develop rapidly in recent years. Zhang et al. [22] constructed a long short-term memory (LSTM) network to predict the RUL of mechanical equipment and verified the advantages of LSTM in RUL prediction by using C-MAPSS datasets. Zhao et al. [23] presented a recurrent neural network (RNN) means for RUL prediction based on trend characteristics, and the effect of the presented method outperformed the other latest methods. Wang et al. [24] proposed a novel recurrent convolutional neural network for RUL prediction of rolling element bearings and milling cutters. Chen et al. [25] employed a new gated recurrent unit, and the C-MAPSS datasets verified the robustness of the proposed method. Although these methods are widely used in machinery prognostics, they have their drawbacks. The deep learning model is still insufficient to extract the spatial and temporal characteristics of time series data. However, the recurrent neural network can effectively obtain the temporal characteristics, but ignores the spatial characteristics of time series data.
To solve the aforementioned problems, the current paper presents a novel estimation method for health indicator (HI) and RUL prediction of rolling bearings. Firstly, the correlation kurtosis of different iteration periods is extracted from the frequency-domain data, and then a novel HI is obtained by a Gaussian process latency variable model (GPLVM). Following that, a prognosis model, the so-called multiple convolutional long short-term memory (MCLSTM), is proposed to predict future HI and the RUL. Finally, the feasibility of the present approaches was validated by bearing experiment datasets.
The main contributions of this paper are summarized as follows:
(1) A special HI is constructed based on correlation kurtosis for different iteration periods and GPLVM. The HI can effectively depict the degradation process of rolling bearing.
(2) A novel deep prognosis network, i.e., MCLSTM, is presented to mine the temporal–spatial correlation of rolling bearing, which improves the accuracy of the HI and RUL estimations considerably.
(3) We verify the capability of the proposed approach based on experimental datasets of rolling bearing. The results show that MCLSTM achieved better performance than the state-of-the-art prognosis approaches.
The remainder of the paper provides a theoretical background in Section 2. Section 3 presents the proposed deep learning model for prediction. The experimental results and thorough discussion are given in Section 4. Finally, Section 5 concludes the whole work.

2. Theoretical Background

2.1. HI Construct

In the field of fault diagnosis, kurtosis is an essential index to detect the health condition of mechanical equipment [26], which can be defined as follows:
K u r t o s i s = 1 n n = 1 N x n 4 ( 1 n n = 1 N x n 2 ) 2
where x denotes the signal sequence, n denotes the sampling points. However, kurtosis is difficult to reflect the intensity of the specific periodic pulse signal in the vibration signal. To tackle this problem, correlation kurtosis (CK) [27] is proposed based on the kurtosis.
C K M ( T ) = n = 1 N ( m = 0 M x n m T ) 2 ( n = 1 N x n 2 ) M + 1
where N denotes the number of sampling points of the signal, M denotes the number of the shift cycles, and T denotes the sensitive cycles. When T = 0 and M = 1 , Equation (2) is equal to Equation (1). It can be found from Equation (2) that the CK has the characteristics of the periodic correlation function.
Fourier transform the time-domain signal x ( t ) to frequency-domain signal y ( t ) . Then calculate the CK value at different offset points, which can be formulated as:
y ( t ) = - + x ( t ) exp ( i ω t ) d t
F C K T M ( T ) = n = 1 N ( m = 0 M y n m T ) 2 ( n = 1 N y n 2 ) M + 1
As Equation (4) shows, T and M are unknown variables. If the number of offset points T is regarded as a variable, and M is defined as specific values, then a multi-dimensional matrix of CK values can be calculated by Equation (4).

2.2. Gaussian Process Latency Variable Model

Dimension disaster is a prevalent problem in statistics and machine learning [28]. Due to the high dimensionality of the data, a complex calculation is indispensable in the data processing. Therefore, it is vital to discover an excellent dimensionality reduction which can obtain the potential low dimensional structure information from high dimensional data [29]. GPLVM, a flexible Bayesian nonparametric model, has been applied to dimensionality reduction of the signal in the past few decades [30].
GPLVM assumes that the observed dataset Y = [ y 1 , y 2 , , y N ] T R D is composed of n d-dimension data; the q-dimension dataset X = [ x 1 , x 2 , , x N ] T R Q is obtained after dimension reduction. Then, the ith training sample is defined as follows [29]:
y i = f ( x i ) + ε
where f denotes the nonlinear function with Gaussian process(GP) prior f ~ G P ( 0 , K ) , ε denotes the noise with Gaussian distribution ε ~ N ( 0 , δ 2 ) .
By using the Bayes theorem and integrating f , then we can know the marginal likelihood p ( Y | X , θ ) , which is formulated as:
p ( Y | X , θ ) = j = 1 D 1 ( 2 π ) 1 2 | K | 1 2 e 1 2 y : , j T K 1 y : , j
where K denotes the kernel function, θ denotes the hyper-parameters of both kernel function and noise, and y : , j denotes the jth column of matrix Y .
The object function of GPLVM can also be derived from probabilistic principal component analysis (PPCA). In PPCA, we assume that the parameter matrix W follows a prior Gaussian distribution [30], which is expressed as:
p ( W ) = i = 1 D N ( w i | 0 , I )
After that, we can obtain the marginal likelihood probability by integrating out W , which can be described as follows:
p ( Y | X , β ) = d = 1 D N ( y : , d | 0 , X X T + β 1 I )
As Equation (8) shows, GPLVM can be equivalent to PPCA by replacing X X T in Equation (8) with a kernel matrix K [31].

2.3. LSTM Theory

As an improved recurrent neural network, LSTM neural network overcomes the drawbacks of an exploding gradient or the vanishing of RNN [32]. Additionally, it has a strong ability to capture the dynamic characteristic through cycles in sequential data. Moreover, LSTM adds a memory cell structure to the neurons in the hidden layer, which reduces the number of unknowns significantly.
In Figure 1, the LSTM hidden layer cell structure is presented, which can be made up of memory cell, input gate, output gate and forget gate. Among them, the memory cell remembers the activation value over any time intervals, and three gates regulate the input and output of information flow to the unit [33]. The update functions are formulated as follows:
{ i t = σ ( W h i h t 1 + W x i x t + W c i c t 1 + b i ) f t = σ ( W h f h t 1 + W x f x t + W c f c t 1 + b f ) c ˜ t = tanh ( W h c h t 1 + W x c x t + b c ) c t = f t c t 1 + i t c ˜ t o t = σ ( W h o h t 1 + W x o x t + W co c t + b o ) h t = o t tanh ( c t )
where denotes the Hadamard product; σ denotes the sigmoid function; i t , f t , c t and o t denote the outputs of input gate, forgetting gate, memory cell and output gate, respectively; W x i , W h i and W c i denote the weight matrix of input information, last time output and memory cell to input gate, respectively; W x f , W h f and W c f denote the weight matrix of input information, last time output and memory cell to forgetting gate, respectively; W x o , W h o and W c o denote the weight matrix of input information, last time output and memory cell to output gate, respectively; b i , b f , b c and b o denote the bias of input information, forgetting information, memory cell and last time output, respectively and tanh ( ) denotes the hyperbolic tangent function.

2.4. Architecture of the Proposed Network

Inspired by the receptive field of mammalian visual cortex cells, Convolutional neural networks (CNN) is a feedforward neural network in deep learning models. The convolutional layer and pooling layer are two critical layers of convolution neural network. In most cases, a convolutional layer is a useful tool for extracting sophisticated high-dimensional input features [34], and the pooling layer can reduce the space size of the input convolution layer and avoid overfitting of the network. CNN has a strong ability to extract features from the input, and it is widely applied in the field of image processing and text recognition [35,36].
As a deep learning model unit, convolutional long short-term memory (ConvLSTM) combined CNN and LSTM is specially designed for spatiotemporal sequence [37] and the structure is shown in Figure 2. LSTM has shown considerable power in dealing with temporal correlation issues, but it contains too much spatial redundancy. To overcome the limits, ConvLSTM integrates convolutional operation in the input-to-state and state-to-state transitions. Furthermore, ConvLSTM offers an outstanding generalization by increasing computational power, and the update functions are expressed as [38]:
{ i t = σ ( W h i * h t 1 + W x i * x t + W c i c t 1 + b i ) f t = σ ( W h f * h t 1 + W x f * x t + W c f c t 1 + b f ) c ˜ t = tanh ( W h c * h t 1 + W x c * x t + b c ) c t = f t c t 1 + i t c ˜ t o t = σ ( W h o * h t 1 + W x o * x t + W co c t + b 0 ) h t = o t tanh ( c t )
As Equation (10) shows, all notations in Equation (10) are the same as those in Equation (9). The difference between them is that the i t , f t , and c t are all calculated by convolutional operation, i.e., .
Due to the time–space correlation of the vibration signal in the degradation process of rolling bearing, a new prognosis model based on MCLSTM is proposed. Specifically, the MCLSTM is constructed by stacking multiple ConvLSTM units, and then batch normalization [39] technology is added between each ConvLSTM layer. After that, a dense layer is employed. Finally, the regression layer is built on the last layer.

3. The Proposed Framework

To evaluate the rolling bearings degradation, a novel prognosis approach is presented in this paper. Firstly, HI is carefully designed by correlation kurtosis for different iteration periods and GPLVM. Then, a novel prognosis network, i.e., MCLSTM is constructed by stacking multiple hidden layers. At last, experimental results confirm the feasibility and superiority of the presented method. The detailed steps of the proposed approaches are illustrated and the corresponding flowchart is shown in Figure 3.
(1) Data acquisition: The accelerometer is placed in the horizontal and vertical directions of the test bearing, and obtained the whole life experimental data of the rolling bearing. The sampling frequency of experimental data is 20 kHz, the sampling interval is 10 min, and the rotation speed is 2000rpm.
(2) HI designed: The correlation kurtosis values of frequency domain signals with different iteration periods by Equation (4) are calculated from the experimental data. GPLVM is utilized for fusing the correlation kurtosis of the different iteration periods, and the low dimensional sensitive features are selected as the HI of rolling bearing.
(3) Proposed neural network: The prognostics neural network is constructed by stacking multiple ConvLSTM units, and batch normalization technology is added between each ConvLSTM layer. The last two layers are the dense layer and regression layer. The network parameters are set as: the number of iterations is 200, the convolution kernel size is 3 × 3 the activation is sigmoid, the filter is 64, the loss function is mean square error, the optimizer is Adam.
(4) HI and RUL prediction: The designed HI is input into the proposed neural network to predict the future HI and RUL of rolling bearings. As a result, the health status of rolling bearings is evaluated, and the maintenance plan is provided with reference.

4. Case Verification

4.1. Data Description

In our case, a full-life-cycle experimental datasets of rolling bearings is indispensable to verify the feasibility of the proposed method. The experimental datasets were carried out on an accelerated aging platform by the center for Intelligent Maintenance Systems (IMS) [40], and the test rig structure is displayed in Figure 4. The test rig consists of four bearings of type Rexnord za-2115, mechanical spring system and motor. The mechanical spring system imposes radial load to the shaft and bearing, and the motor drives the test bearing to run. Two accelerometers were placed in the horizontal and vertical directions of each bearing to pick up vibration data. The sampling frequency of vibration data was 20 kHz, the sampling interval was 10 min, and the rotation speed was 2000rpm. Under the same experimental conditions, three groups of experiments were carried out, and each of which collected the vibration signal of four bearings from the normal to failure. In this paper, the experimental data of bearing 1 (outer ring failure) in the second group of experiments were selected for analysis, including 984 groups of vibration signals.

4.2. Evaluation Indexes

For the sake of confirming the performance of the presented method, appropriate evaluation indexes are required. In this paper, we selected four indexes to judge the performance of the different models for remaining useful life estimation of rolling bearings, including the root mean square error (RMSE), the mean absolute percentage error (MAPE), mean absolute error (MAE) and the R-Square. The evaluation indexes are described as:
R M S E = 1 N i = 1 N ( y i - y ^ i ) 2
M A P E = 1 m i = 1 m | y i y ^ i y i |
M A E = 1 m i = 1 m | ( y i y ^ i ) |
R S q u a r e = 1 i = 1 m ( y i y ^ i ) 2 i = 1 m ( y i y ¯ i ) 2
where y i and y ^ i denotes the actual value and predicted value. y ¯ denotes the mean value of the actual values. m denotes the total number of testing samples.

4.3. Health Stage Division Analysis

In this part, the health stage division is analyzed. To cope with the problem of RUL prediction, it is crucial to capture the degradation tendency from historical information. In this paper, we constructed a novel HI to describe the trend of bearing performance degradation. The time-domain waveform of the test rolling bearing is exhibited in Figure 5a. It can be observed that the amplitude of the vibration data starts to increase at about 7000 min. With the aggravation of the bearing fault, the amplitude of the vibration signal also increases until the experiment is stopped. As shown in Figure 5b, at the beginning of the bearing operation, the HI cure is stable without fluctuation. The HI value gradually rises, which can be observed at 5350 min, indicating incipient degradation of bearing. Then, there are prominent peaks and valleys in the curve. The peaks indicate that the degree of bearing wear has reached the maximum value at this stage. Subsequently, the curve begins to decline, which is the so-called healing phenomenon. The failure point of the rolling bearing gradually wears out and becomes smooth under the impact of the influence of impact force, which makes the HI curve decrease. According to the above analysis, we can determine the bearing damage evolution process through the HI curve and then estimate the current degradation stage of the bearing. Therefore, in this paper, we divide the stage of bearing performance degradation into four types: normal stage (stage 1), initial degradation (stage 2), moderate degradation (stage 3), and severe degradation (stage 4).
To further verify the inferences, we selected different stage vibration data for time-domain analysis and envelope demodulation analysis. Figure 6 shows the analysis results on the various stage data. Obviously, it can be observed in Figure 6 that there are obvious differences in the time domain waveform, and we can further analyze this through the envelope demodulation waveform. In the envelope demodulation waveform, we cannot find the characteristic fault amplitude at 550 min (Figure 6a), and the bearing is healthy. When the bearing runs to the 5350 min (Figure 6b), we can find the envelope amplitude appears 231.5 Hz, i.e., the characteristic frequency of outer ring fault and its second frequency, which indicates that the bearing has failed. With the operation time increase, the amplitude of fault characteristic frequency continues to increase, and the bearing degradation is further intensified. It should be noted that the amplitudes of 230.7 and 460.8 Hz in envelope demodulation waveform have nearly the same at 7040 and 8500 min, respectively (Figure 6c and Figure 6d). Simultaneously, we can also observe that the HI values of these two time points are approximately the same, which verifies the feasibility and necessity of HI.

4.4. RUL Prediction

In this section, some factors that may affect the prediction performance of MCLSTM are discussed in detail, including the iteration times and optimizer. Then, HI prediction value started from different time points are further discussed. At last, the performance of the proposed method for RUL estimation is analyzed.
(1) Effect of the number of iterations: The number of iterations is a critical hyper parameter in network structure, whose size may affect the computational cost of the proposed method. In this paper, we directly use multiple stacked units to form a prediction model, in which the filter is valued of 64, and the convolution kernel size is set to 3 × 3. The relationship between the loss function, i.e., prediction error and the number of iterations is shown in Figure 7. It can be observed that when the number of iterations is 200, the prediction error is already small enough. When the number of iterations is 200, the loss curve shows no fluctuation. In Figure 8, MAPE and operation time of different numbers of iterations are calculated, respectively. We can draw several conclusions: 1) As the number of iterations increases, the MAPE value decreases, indicating that the prediction performance is better. 2) As the number of iterations increases, the prediction model training time increases, but the time gap is only a few seconds. In total, it is proper that the number of iterations of the prediction model is 200.
(2) Effect of the optimizer: When the model updates the network weight and bias parameters, the choice of the optimizer directly affects the accuracy of the prediction results. It is critical to choose the optimizer of the prediction model when updating the model weights and bias parameters. We choose four typical optimizers (Adam, RmsProp, Adagrad and SGD) to train the prediction model. Furthermore, the values of MAE, RMSE, R-Square, MAPE and training time are calculated to verify the performance of the prognostic model, respectively. From Table 1, it can be seen that the Adam optimizer has better performance compared with the other optimizers, and the optimizer for model training is Adam in this paper.
(3) HI and RUL prediction: In this part, the HI and RUL prediction of rolling bearing is conducted. In Section 4.3, we divided the bearing full-life signals into four stages and used the proposed prediction model to predict the future HI. We input the previous samples at this time as training data into the model randomly, and the remaining samples are regarded as testing to detect the model capacity. It can be seen from Figure 9 that the prediction starts from three different moments when T = 5350 min, T = 7040 min and T = 8500 min, respectively, and we can conclude that the proposed model can accurately predict the trend change of future HI. The RUL prediction results demonstrated in Figure 10, the blue curve is a 20% confidence interval of the actual value, and we can see that the error between the predicted value and the actual value is small.

4.5. Comparison with Other Methods

In this part, three state-of-the-art approaches are implemented to predict HI and RUL of the bearing vibration signals for comparison, which includes BPNN, LSTM and GRU. The structure of these methods are chosen as 10-5-1, 64-10-1, and 64-10-1, respectively, and the learning rate is chosen as 0.001, and the number of iterations is chosen as 200. Figure 11 exhibits the HI prediction results of the four methods. It should be noted that the proposed method achieves the outstanding predictive performance, and the predicted HI is closer to the actual values than other approaches. In Figure 12, the curves of the proposed method, LSTM, and GRU mostly lie in the confidence interval, while the curves of BPNN overstepping the boundary in the later prediction stage. This indicates that the presented method outperforms the other three models, GRU slightly better than the LSTM, and BPNN has the maximum deviation.
Afterwards, as tabulated in Table 2 and Table 3, the demonstrated results give further details. Table 2 shows the results of estimated RUL values at different times. It is clearly seen that the proposed method provides more accurate estimation results compared with other approaches. In Table 3, it can be summarized that the proposed prognostics model has shown an excellent prognostic performance compared with the other three approaches at different stages, according to the evaluation indicators of MAE, RMSE, R-Square and MAPE.

5. Conclusions

The reliable prognosis technique for rolling bearing predictive maintenance and autonomic logistics is urgently needed in the industry. To address the important issues, we provided a reliable prognosis approach for degradation evaluation of rolling bearing in this study. The correlation kurtosis for different iteration periods and GPLVM is adopted to extract the special HI. Following this, a prognostics model, i.e., MCLSTM, is constructed and utilized for predicting future HI and RUL. The proposed MCLSTM is experimentally validated using the full-life-cycle vibration dataset of a rolling bearing. Through a comparison of different classical deep learning methods, the results validate that the proposed approach was more robust and effective than other approaches for HI and RUL estimation.
It should be noted that more extensive studies and complex operating conditions will validate the feasibility and effectiveness of the presented method in future work. In addition, the time to start prediction and threshold determination are both significant and challenging in HI and RUL prediction.

Author Contributions

The work presented in this paper was completed with collaboration among all authors. Conceptualization, G.H. and M.Z.; Formal analysis, J.O.; Funding acquisition, H.L. and Y.Z.; Methodology, G.H.; Supervision, H.L.; Writing – original draft, G.H. and J.O.; Writing – review & editing, G.H. and H.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Science and Technology Major Special Plan Project of Liaoning Province (Project No. 2019JH1/10100019), National Natural Science Foundation of China (No. U1808214 and No.51875082), Key R & D projects of Ningxia Hui Autonomous Region (No.2018BDE02045).

Conflicts of Interest

The authors declare that there is no conflict of interest in the publication of this article. Again, the author states that there is no commercial or corporate interest in this submission.

References

  1. Reniers, J.M.; Mulder, G.; Ober-Blobaum, S.; Howey, D.A. Improving optimal control of grid-connected lithium-ion batteries through more accurate battery and degradation modelling. J. Power Sources 2018, 379, 91–102. [Google Scholar] [CrossRef] [Green Version]
  2. Sohaib, M.; Kim, C.H.; Kim, J.M. A hybrid feature model and deep-learning-based bearing fault diagnosis. Sensors 2017, 17, 2876. [Google Scholar] [CrossRef] [Green Version]
  3. Aouaouda, S.; Chadli, M. Robust fault tolerant controller design for Takagi-Sugeno systems under input saturation. Int. J. Syst. Sci. 2019, 50, 1163–1178. [Google Scholar] [CrossRef]
  4. Bhardwaj, U.; Teixeira, A.P.; Soares, C.G. Reliability prediction of an offshore wind turbine gearbox. Renew. Energy 2019, 141, 693–706. [Google Scholar] [CrossRef]
  5. Liao, L.; Kottig, F. Review of hybrid prognostics approaches for remaining useful life prediction of engineered systems, and an application to battery life prediction. IEEE Trans. Reliab. 2014, 63, 191–207. [Google Scholar] [CrossRef]
  6. Zhao, B.F.; Xie, L.Y.; Bai, X.; Ren, J.G.; Li, H.Y.; Zhang, S.J. A multi-axial low-cycle fatigue life prediction model considering effects of additional hardening. Fatigue Fract. Eng. Mater. Struct. 2018, 41, 1488–1503. [Google Scholar] [CrossRef]
  7. Lei, Y.; Li, N.; Guo, L.; Li, N.; Yan, T.; Lin, J. Machinery health prognostics: A systematic review from data acquisition to RUL prediction. Mech. Syst. Signal Proc. 2018, 104, 799–834. [Google Scholar] [CrossRef]
  8. Lei, Y.; Li, N.; Gontarz, S.; Lin, J.; Radkowski, S.; Dybala, J. A model-based method for remaining useful life prediction of machinery. IEEE Trans. Reliab. 2016, 65, 1314–1326. [Google Scholar] [CrossRef]
  9. Wertz, J.; Shen, M.H.; Scott-Emuakpor, O.; George, T.; Cross, C. An energy-based torsional-shear fatigue lifing method. Exp. Mech. 2012, 52, 705–715. [Google Scholar] [CrossRef]
  10. El-Tawil, K.; Jaoude, A.A. Stochastic and nonlinear-based prognostic model. Syst. Sci. Control Eng. 2013, 1, 66–81. [Google Scholar] [CrossRef] [Green Version]
  11. Pu, W.; Zhu, D.; Wang, J.; Wang, Q.J. Rolling-sliding contact fatigue of surfaces with sinusoidal roughness. Int. J. Fatigue 2016, 90, 57–68. [Google Scholar] [CrossRef] [Green Version]
  12. Wang, J.; Gao, R.X.; Yuan, Z.; Fan, Z.; Zhang, L. A joint particle filter and expectation maximization approach to machine condition prognosis. J. Intell. Manuf. 2016, 1–7. [Google Scholar] [CrossRef]
  13. Cubillo, A.; Perinpanayagam, S.; Esperon-Miguez, M. A review of physics-based models in prognostics: Application to gears and bearings of rotating machinery. Adv. Mech. Eng. 2016, 8, 1–21. [Google Scholar] [CrossRef] [Green Version]
  14. Chadli, M.; Davoodi, M.; Meskin, N. Distributed state estimation, fault detection and isolation filter design for heterogeneous multi-agent linear parameter-varying systems. IET Control Theory Appl. 2017, 11, 254–262. [Google Scholar] [CrossRef]
  15. Qian, Y.; Yan, R.; Gao, R.X. A multi-time scale approach to remaining useful life prediction in rolling bearing. Mech. Syst. Signal Process. 2017, 83, 549–567. [Google Scholar] [CrossRef] [Green Version]
  16. Chen, Y.; Peng, G.; Xie, C.; Zhang, W.; Li, C.; Liu, S. ACDIN: Bridging the gap between artificial and real bearing damages for bearing fault diagnosis. Neurocomputing 2018, 294, 61–71. [Google Scholar] [CrossRef]
  17. Chadli, A.; Chadli, M.; Ding, S.X.; Braiek, N. Design of robust fuzzy fault detection filter for polynomial fuzzy systems with new finite frequency specifications. Automatica 2018, 29, 42–54. [Google Scholar]
  18. Zhu, Z.; Peng, G.; Chen, Y.; Gao, H. A convolutional neural network based on a capsule network with strong generalization for bearing fault diagnosis. Neurocomputing 2019, 323, 62–75. [Google Scholar] [CrossRef]
  19. Hu, Y.; Baraldi, P.; Di Maio, F.; Zio, E. Online performance assessment method for a model-based prognostic approach. IEEE Trans. Reliab. 2016, 65, 718–735. [Google Scholar] [CrossRef] [Green Version]
  20. Javed, K.; Gouriveau, R.; Zerhouni, N.; Nectoux, P. Enabling health monitoring approach based on vibration data for accurate prognostics. IEEE Trans. Ind. Electron. 2015, 62, 647–656. [Google Scholar] [CrossRef] [Green Version]
  21. Liu, X.; Song, P.; Yang, C.; Hao, C.; Peng, W. Prognostics and health management of bearings based on logarithmic linear recursive least-squares and recursive maximum likelihood estimation. IEEE Trans. Ind. Electron. 2018, 62, 1549–1558. [Google Scholar] [CrossRef]
  22. Zhang, J.; Wang, P.; Yan, R.; Gao, R.X. Long short-term memory for machine remaining life prediction. J. Manuf. Syst. 2018, 48, 78–86. [Google Scholar] [CrossRef]
  23. Zhao, S.; Zhang, Y.; Wang, S.; Zhou, B.; Cheng, C. A recurrent neural network approach for remaining useful life prediction utilizing a novel trend features construction method. Measurement 2019, 146, 279–288. [Google Scholar] [CrossRef]
  24. Wang, B.; Lei, Y.; Yan, T.; Li, N.; Guo, L. Recurrent convolutional neural network: A new framework for remaining useful life prediction of machinery. Neurocomputing 2020, 379, 117–129. [Google Scholar] [CrossRef]
  25. Chen, J.; Jing, H.; Chang, Y.; Liu, Q. Gate recurrent unit based recurrent neural network for remaining useful life prediction of nonlinear deterioration process. Reliab. Eng. Syst. Saf. 2019, 185, 372–382. [Google Scholar] [CrossRef]
  26. Laha, S.K. Enhancement of fault diagnosis of rolling element bearing using maximum kurtosis fast nonlocal means denoising. Measurement 2017, 100, 157–163. [Google Scholar] [CrossRef]
  27. Wang, Y.; Xiang, J.; Markert, R.; Liang, M. Spectral kurtosis for fault detection, diagnosis and prognostics of rotating machines: A review with applications. Mech. Sys. Signal Proc. 2016, 66, 679–698. [Google Scholar] [CrossRef]
  28. Nema, S.; Sahar, H. Data dimensional reduction and principal components analysis. Procedia Comput. Sci. 2019, 163, 292–299. [Google Scholar]
  29. Lawrence, N. Probabilistic Non-linear principal component analysis with Gaussian process latent variable models. J. Mach. Learn. Res. 2005, 6, 1783–1816. [Google Scholar]
  30. Li, P.; Chen, S. A review on Gaussian process latent variable models. CAAI Trans. Intell. Technol. 2016, 1, 366–376. [Google Scholar] [CrossRef]
  31. Zhu, Z.; Zhang, J.; Zou, J.; Deng, C. Multi-kernel Gaussian process latent variable regression model for high-dimensional sequential data modeling. Neurocomputing 2019, 133, 422–432. [Google Scholar] [CrossRef]
  32. Lei, J.; Liu, C.; Jiang, D. Fault diagnosis of wind turbine based on Long Short-term memory networks. Renew. Energy 2019, 133, 422–432. [Google Scholar] [CrossRef]
  33. Cabrera, D.; Guamán, A.; Zhang, S.; Cerradab, M.; Sánchezb, R.; Cevallosc, J.; Long, J.; Li, C. Bayesian approach and time series dimensionality reduction to LSTM-based model-building for fault diagnosis of a reciprocating compressor. Neurocomputing 2020, 380, 51–66. [Google Scholar] [CrossRef]
  34. Hu, M.; Wang, H.; Wang, X.; Yang, J.; Wang, R. Video facial emotion recognition based on local enhanced motion history image and CNN-CTSLSTM networks. J. Vis. Commun. Image Represent. 2019, 59, 176–185. [Google Scholar] [CrossRef]
  35. Chen, X.; Wang, T.; Zhu, Y.; Jin, L.; Luo, C. Adaptive embedding gate for attention-based scene text recognition. Neurocomputing 2020, 381, 261–271. [Google Scholar] [CrossRef]
  36. Lecun, Y.; Bottou, L.; Bengio, Y.; Haffner, P. Gradient-based learning applied to document recognition. Proc. IEEE 1998, 86, 2278–2324. [Google Scholar] [CrossRef] [Green Version]
  37. Trifa, A.; Sbai, A.H.; Chaari, W.L. Enhancing assessment of personalized multi-agent system through convlstm. Procedia Comput. Sci. 2017, 112, 249–259. [Google Scholar] [CrossRef]
  38. Zhi, Z.; Alexander, Y.S.; Qian, Y.; Qi, O. A deep learning approach to anomaly detection in geological carbon sequestration sites using pressure measurements. J. Hydrol. 2019, 573, 885–894. [Google Scholar]
  39. Wang, J.; Li, S.; An, Z.; Jiang, X.; Qian, W.; Ji, S. Batch-normalized deep neural networks for achieving fast intelligent fault diagnosis of machines. Neurocomputing 2019, 329, 53–65. [Google Scholar] [CrossRef]
  40. Jaouher, B.A.; Brigitte, C.; Lotfi, S.; Simon, M.; Farhat, F. Accurate bearing remaining useful life prediction based on Weibull distribution and artificial neural network. Mech. Syst. Signal Proc. 2015, 56, 150–172. [Google Scholar]
Figure 1. Long short-term memory (LSTM) hidden layer cell structure.
Figure 1. Long short-term memory (LSTM) hidden layer cell structure.
Sensors 20 01864 g001
Figure 2. The ConvLSTM structure.
Figure 2. The ConvLSTM structure.
Sensors 20 01864 g002
Figure 3. A flowchart of the proposed method.
Figure 3. A flowchart of the proposed method.
Sensors 20 01864 g003
Figure 4. Test rig of Intelligent Maintenance Systems (IMS).
Figure 4. Test rig of Intelligent Maintenance Systems (IMS).
Sensors 20 01864 g004
Figure 5. (a) Time-domain waveform of bearing, (b) health stage division of bearing.
Figure 5. (a) Time-domain waveform of bearing, (b) health stage division of bearing.
Sensors 20 01864 g005
Figure 6. Time domain and envelope analysis of signals at different stages, (a) T = 550 min. (b) T = 5350 min, (c) T = 7040 min, (b) T = 8500min.
Figure 6. Time domain and envelope analysis of signals at different stages, (a) T = 550 min. (b) T = 5350 min, (c) T = 7040 min, (b) T = 8500min.
Sensors 20 01864 g006
Figure 7. The loss-iteration times.
Figure 7. The loss-iteration times.
Sensors 20 01864 g007
Figure 8. Influence of iterative times.
Figure 8. Influence of iterative times.
Sensors 20 01864 g008
Figure 9. HI prediction start from different times, (a) T = 5350 min, (b) T = 7040 min, (c) T = 8500 min.
Figure 9. HI prediction start from different times, (a) T = 5350 min, (b) T = 7040 min, (c) T = 8500 min.
Sensors 20 01864 g009
Figure 10. Remaining useful life (RUL) prediction of the proposed method.
Figure 10. Remaining useful life (RUL) prediction of the proposed method.
Sensors 20 01864 g010
Figure 11. HI prediction results of different methods.
Figure 11. HI prediction results of different methods.
Sensors 20 01864 g011
Figure 12. RUL prediction results of different methods.
Figure 12. RUL prediction results of different methods.
Sensors 20 01864 g012
Table 1. Evaluation indexes of different optimizers.
Table 1. Evaluation indexes of different optimizers.
OptimizerMAERMSER-SquareMAPETraining Time(s)
Adam 7.90 × 10 6 7.91 × 10 3 0.9991.25719.07
RmsProp 4.41 × 10 3 4.41 × 10 3 −2.336289.6316.86
Adagrad 6.47 × 10 3 9.01 × 10 5 0.9187118.416.88
SGD 3.83 × 10 3 4.38 × 10 3 −2.336944.7117.15
Table 2. Estimated RUL results of the four approaches.
Table 2. Estimated RUL results of the four approaches.
MethodInspection TimeActual RULEstimated RULPrediction Error
GRU540444448.2−0.009
704280283.1−0.011
98223.788−0.894
LSTM540444462.6−0.004
704280289.3−0.033
98224.117−1.058
BPNN540444472.5−0.064
704280329.1−0.175
98228.335−3.167
The proposed method540444446.00.004
704280280.8−0.0028
98221.5530.2235
Table 3. Performance comparison of four prognostic methods at different stage.
Table 3. Performance comparison of four prognostic methods at different stage.
MethodStart Forecast timeMAERMSER-SquareMAPE
GRU5356.8667.3350.96540.19
70514.8917.100.95458.51
85020.6825.280.96958.22
LSTM53513.8817.680.98244.76
70515.8618.220.948762.79
85015.2416.160.83287.23
BPNN53547.5449.270.86289.78
705149.9151.7−2.550389.6
850106.2106.7−6.285471.1
The proposed method5350.91611.1530.999inf
7050.7260.7660.999inf
8501.9582.2040.997inf

Share and Cite

MDPI and ACS Style

Huang, G.; Li, H.; Ou, J.; Zhang, Y.; Zhang, M. A Reliable Prognosis Approach for Degradation Evaluation of Rolling Bearing Using MCLSTM. Sensors 2020, 20, 1864. https://doi.org/10.3390/s20071864

AMA Style

Huang G, Li H, Ou J, Zhang Y, Zhang M. A Reliable Prognosis Approach for Degradation Evaluation of Rolling Bearing Using MCLSTM. Sensors. 2020; 20(7):1864. https://doi.org/10.3390/s20071864

Chicago/Turabian Style

Huang, Gangjin, Hongkun Li, Jiayu Ou, Yuanliang Zhang, and Mingliang Zhang. 2020. "A Reliable Prognosis Approach for Degradation Evaluation of Rolling Bearing Using MCLSTM" Sensors 20, no. 7: 1864. https://doi.org/10.3390/s20071864

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop