Training of deep neural networks based on distance measures using RMSProp

T Kurbiel, S Khaleghian - arXiv preprint arXiv:1708.01911, 2017 - arxiv.org
… were only sparsely used in the past since they are hard to train when usingusing Root
Mean Square Propagation (RMSProp) it is possible to efficiently learn multi-layer neural networks

An efficient optimization technique for training deep neural networks

F Mehmood, S Ahmad, TK Whangbo - Mathematics, 2023 - mdpi.com
… In this study, we removed the additional hyper-parameter from RMSProp and observed that
… and results obtained during training and testing the deep neural network. Table 2 consists of …

Model-free renewable scenario generation using generative adversarial networks

Y Chen, Y Wang, D Kirschen… - IEEE Transactions on …, 2018 - ieeexplore.ieee.org
… the deep neural networkstraining procedure. All models in this paper are trained using
RmsProp … All weights for neurons in neural networks were initialized from a centered Normal …

LSTM for anomaly-based network intrusion detection

SA Althubiti, EM Jones, K Roy - … telecommunication networks …, 2018 - ieeexplore.ieee.org
… CIDDS dataset and apply a deep learning approach, Long-Short… using deep neural network
to classify attacks in IoT networks [5]. … In this study, we found rmsprop optimizer is suitable for …

Deep neural networks to predict diabetic retinopathy

TR Gadekallu, N Khare, S Bhattacharya… - Journal of Ambient …, 2023 - Springer
… The present study uses principal component analysis based deep neural network model using
… For backpropagation the Root mean square propagation (RMSprop) error was used. The …

Improving the robustness of deep neural networks via stability training

S Zheng, Y Song, T Leung… - Proceedings of the ieee …, 2016 - cv-foundation.org
… the network using mini-batch stochastic gradient descent with momentum, dropout [10],
RMSprop and batch normalization [2]. To tune the hyperparameters, we used a grid search, …

Solving inverse problems in stochastic models using deep neural networks and adversarial training

K Xu, E Darve - Computer Methods in Applied Mechanics and …, 2021 - Elsevier
… with a generative deep neural network (DNN). The goal is then to estimate the weights and
biases of the DNN. … L-BFGS-B converges faster and is more stable than ADAM and RMSProp. …

Detection of Schizophrenia in brain MR images based on segmented ventricle region and deep belief networks

M Latha, G Kavitha - Neural Computing and Applications, 2019 - Springer
… Thus, the DBN with RMSProp learning-based classification … , the pre-trained network is
refined by supervised training to … of a deep neural network with the values of pre-trained DBN …

[HTML][HTML] Prediction of tumor lymph node metastasis using wasserstein distance-based generative adversarial networks combing with neural architecture search for …

Y Wang, S Zhang - Mathematics, 2023 - mdpi.com
… , RMSProp as the optimizer algorithm, no convolutional layer set … , which are distance measures
of distributions compared to … automatic search convolutional neural networks to avoid the …

A survey on training issues in chili leaf diseases identification using deep learning techniques

KR Kanaparthi, SS Ilango - Procedia Computer Science, 2023 - Elsevier
… But it suggested that the applicability of RMSPROP is good for training the Chili Dataset, …
convolutional neural networks based multiclass plant disease detection and classification using