Optimal learning rates for Clifford neurons

S Buchholz, K Tachibana, EMS Hitzer - … 9-13, 2007, Proceedings, Part I 17, 2007 - Springer
S Buchholz, K Tachibana, EMS Hitzer
Artificial Neural Networks–ICANN 2007: 17th International Conference, Porto …, 2007Springer
Neural computation in Clifford algebras, which include familiar complex numbers and
quaternions as special cases, has recently become an active research field. As always,
neurons are the atoms of computation. The paper provides a general notion for the Hessian
matrix of Clifford neurons of an arbitrary algebra. This new result on the dynamics of Clifford
neurons then allows the computation of optimal learning rates. A thorough discussion of
error surfaces together with simulation results for different neurons is also provided. The …
Abstract
Neural computation in Clifford algebras, which include familiar complex numbers and quaternions as special cases, has recently become an active research field. As always, neurons are the atoms of computation. The paper provides a general notion for the Hessian matrix of Clifford neurons of an arbitrary algebra. This new result on the dynamics of Clifford neurons then allows the computation of optimal learning rates. A thorough discussion of error surfaces together with simulation results for different neurons is also provided. The presented contents should give rise to very efficient second–order training methods for Clifford Multi-layer perceptrons in the future.
Springer
Showing the best result for this search. See all results