Pruning Deep Neural Networks Neurons for Improved Robustness against Adversarial Examples 


Vol. 50,  No. 7, pp. 588-597, Jul.  2023
10.5626/JOK.2023.50.7.588


PDF

  Abstract

Deep Neural Networks (DNNs) have a security vulnerability to adversarial examples, which can result in incorrect classification of the DNNs results. In this paper, we assume that the activation patterns of DNNs will differ between normal data and adversarial examples. We propose a revision that prunes neurons that are activated only in the adversarial examples but not in the normal data, by identifying such neurons in the DNNs. We conducted adversarial revision using various adversarial examples generation techniques and used MNIST and CIFAR-10 datasets. The DNNs neurons that were pruned using the MNIST datasets achieved adversarial revision performance that increased up to 100% and 70.20% depending on the pruning method (label-wise and all-label pruning) while maintaining classification accuracy of normal data at above 99%. In contrast, the CIFAR-10 datasets showed a decreased classification accuracy for normal data, but the adversarial revision performance increased up to 99.37% and 47.61% depending on the pruning method. In addition, the efficiency of the proposed pruning-based adversarial revision performance was confirmed through a comparative analysis with adversarial training methods.


  Statistics
Cumulative Counts from November, 2022
Multiple requests among the same browser session are counted as one view. If you mouse over a chart, the values of data points will be shown.


  Cite this article

[IEEE Style]

G. Lim, G. Ko, S. Lee, S. Son, "Pruning Deep Neural Networks Neurons for Improved Robustness against Adversarial Examples," Journal of KIISE, JOK, vol. 50, no. 7, pp. 588-597, 2023. DOI: 10.5626/JOK.2023.50.7.588.


[ACM Style]

Gyumin Lim, Gihyuk Ko, Suyoung Lee, and Sooel Son. 2023. Pruning Deep Neural Networks Neurons for Improved Robustness against Adversarial Examples. Journal of KIISE, JOK, 50, 7, (2023), 588-597. DOI: 10.5626/JOK.2023.50.7.588.


[KCI Style]

임규민, 고기혁, 이수영, 손수엘, "적대적 예시에 대한 향상된 견고성을 위한 심층신경망 뉴런 가지치기," 한국정보과학회 논문지, 제50권, 제7호, 588~597쪽, 2023. DOI: 10.5626/JOK.2023.50.7.588.


[Endnote/Zotero/Mendeley (RIS)]  Download


[BibTeX]  Download



Search




Journal of KIISE

  • ISSN : 2383-630X(Print)
  • ISSN : 2383-6296(Electronic)
  • KCI Accredited Journal

Editorial Office

  • Tel. +82-2-588-9240
  • Fax. +82-2-521-1352
  • E-mail. chwoo@kiise.or.kr