Comparison of BERT-based Model Performance in CBCA Criteria Classification 


Vol. 49,  No. 9, pp. 727-734, Sep.  2022
10.5626/JOK.2022.49.9.727


PDF

  Abstract

In the case of child sex crimes, the victim"s statement plays a critical role in determining the existence or innocence of the case, so the Supreme Prosecutors" Office classifies the statement into a total of 19 criteria according to Criteria-Based Content Analysis (CBCA), a victim"s statement analysis technique. However, this may differ in criteria classification according to the subjective opinion of the statement analyst. Thus, in this paper, two major classification methods were applied and analyzed to present an criteria classification model using BERT and RoBERTa. The two methods comprise of a method of classifying the entire criterion at the same time, as well as method of dividing it into four groups, and then classifying the criteria within the group secondarily. The experiment classified statements into 16 criteria of CBCA and performed comparative analysis using several pre-trained models. As a result of the classification, the former classification method performed better than the latter classification method in 13 of the total 16 criteria, and the latter method was effective in three criteria with a relatively insufficient number of training data. Additionally, the RoBERTa-based model performed better than the BERT-based model in 15 of the 16 criteria, and the BERT model, which was pre-trained using only Korean conversational colloquial language, classified the remaining one criterion uniquely. This paper shows that the proposed model, which was pre-trained using interactive colloquial data is effective in classifying children"s statement sentences.


  Statistics
Cumulative Counts from November, 2022
Multiple requests among the same browser session are counted as one view. If you mouse over a chart, the values of data points will be shown.


  Cite this article

[IEEE Style]

J. Shin, J. Shin, E. Jo, Y. Yoon, J. Jung, "Comparison of BERT-based Model Performance in CBCA Criteria Classification," Journal of KIISE, JOK, vol. 49, no. 9, pp. 727-734, 2022. DOI: 10.5626/JOK.2022.49.9.727.


[ACM Style]

Junho Shin, Jungsoo Shin, Eunkyung Jo, Yeohoon Yoon, and Jaehee Jung. 2022. Comparison of BERT-based Model Performance in CBCA Criteria Classification. Journal of KIISE, JOK, 49, 9, (2022), 727-734. DOI: 10.5626/JOK.2022.49.9.727.


[KCI Style]

신준호, 신정수, 조은경, 윤여훈, 정재희, "CBCA 준거 분류에서의 BERT 기반 모델 성능 비교," 한국정보과학회 논문지, 제49권, 제9호, 727~734쪽, 2022. DOI: 10.5626/JOK.2022.49.9.727.


[Endnote/Zotero/Mendeley (RIS)]  Download


[BibTeX]  Download



Search




Journal of KIISE

  • ISSN : 2383-630X(Print)
  • ISSN : 2383-6296(Electronic)
  • KCI Accredited Journal

Editorial Office

  • Tel. +82-2-588-9240
  • Fax. +82-2-521-1352
  • E-mail. chwoo@kiise.or.kr