Paper 2020/904

A Comparison of Weight Initializers in Deep Learning-based Side-channel Analysis

Huimin Li, Marina Krček, and Guilherme Perin

Abstract

The usage of deep learning in profiled side-channel analysis requires a careful selection of neural network hyperparameters. In recent publications, different network architectures have been presented as efficient profiled methods against protected AES implementations. Indeed, completely different convolutional neural network models have presented similar performance against public side-channel traces databases. In this work, we analyze how weight initializers' choice influences deep neural networks' performance in the profiled side-channel analysis. Our results show that different weight initializers provide radically different behavior. We observe that even high-performing initializers can reach significantly different performance when conducting multiple training phases. Finally, we found that this hyperparameter is more dependent on the choice of dataset than other, commonly examined, hyperparameters. When evaluating the connections with other hyperparameters, the biggest connection is observed with activation functions.

Metadata
Available format(s)
PDF
Category
Applications
Publication info
Preprint. MINOR revision.
Keywords
Weight initializationDeep learningSide-channel Analysis
Contact author(s)
h li-7 @ tudelft nl
m krcek @ tudelft nl
g perin @ tudelft nl
History
2020-08-19: revised
2020-07-18: received
See all versions
Short URL
https://ia.cr/2020/904
License
Creative Commons Attribution
CC BY

BibTeX

@misc{cryptoeprint:2020/904,
      author = {Huimin Li and Marina Krček and Guilherme Perin},
      title = {A Comparison of Weight Initializers in Deep Learning-based Side-channel Analysis},
      howpublished = {Cryptology {ePrint} Archive, Paper 2020/904},
      year = {2020},
      url = {https://eprint.iacr.org/2020/904}
}
Note: In order to protect the privacy of readers, eprint.iacr.org does not use cookies or embedded third party content.