Digital Library[ Search Result ]
Comparative Analysis of Accuracy and Stability of Software Reliability Estimation Models based on Recurrent Neural Networks
Taehyoun Kim, Duksan Ryu, Jongmoon Baik
http://doi.org/10.5626/JOK.2023.50.8.688
Existing studies on software reliability estimation based on recurrent neural networks have used networks to create one model under the same conditions and evaluated the accuracy of the model. However, due to the randomness of artificial neural networks, such recurrent neural networks can generate different training results of models even under the same conditions, which can lead to inaccurate software reliability estimation. Therefore, this paper compares and analyzes which recurrent neural networks could estimate software reliability more stably and accurately. We estimated software reliability in eight real projects using three representative recurrent neural networks and compared and analyzed the performances of these models in terms of accuracy and stability. As a result, Long Short-Term Memory showed the most stable and accurate software reliability estimation performance. A more accurate and stable software reliability estimation model is expected to be selected based on the results of this study.
C++ based Deep Learning Open Source Framework WICWIU.v3 that Supports Natural Language and Time-series Data Processing
Junseok Oh, Chanhyo Lee, Okkyun Koo, Injung Kim
http://doi.org/10.5626/JOK.2023.50.4.313
WICWIU is the first open-source deep learning framework developed by Korean university. In this work, we developed WICWIU.v3 that includes features for natural language and time-series data processing. WICWIU was designed for C++ environment, and supports GPU-based parallel processing, and has excellent readability and extensibility, allowing users to easily add new features. In addition to WICWIU.v1 and v2 that focus on image processing models, such as convolutional neural networks (CNN) and general adversarial networks (GAN), WICWIU.v3 provides classes and functions for natural language and time-series data processing, such as recurrent neural networks (RNN), including LSTM (Long Short-Term Memory Networks) and GRU (Gated Recurrent Units), attention modules, and Transformers. We validated the newly added functions for natural language and time-series data by implementing a machine translator and a text generator with WICWIU.v3.
Improving Performance of Recurrent Neural Network based Recommendations by Utilizing Personal Preferences
Dong Shin Lim, Yong Jun Yang, Shin Cho
http://doi.org/10.5626/JOK.2021.48.11.1211
As the amount of content provided on the platform surged, a recommendation system became an essential element of the platform. The collaborative filtering technique is a widely used recommendation system in academia and industry, but it also has a limitation because it relies on quantitative information from consumers such as ratings and purchase history. To overcome this shortcoming, various studies have been done in a bid to improve its performance by collecting qualitative information such as review data in a model. Recently, some studies that applied recurrent neural networks showed better performance than the existing recommendation system by using time-series behavioral data only, but studies that reflect each customer"s preference in the recommendation model have not yet been made. In this paper, an improved recommendation model was presented by calculating a preference matrix based on customer log data and learning it in a recurrent neural network through an embedding vector. It was confirmed that the prediction performance was improved compared to the existing recurrent neural network recommendation model.
A Knowledge Graph Embedding-based Ensemble Model for Link Prediction
http://doi.org/10.5626/JOK.2020.47.5.473
Knowledge bases often suffer from their limited applicability due to missing information in their entities and relations. Link prediction has been investigated to complete the missing information and makes a knowledge base more useful. The existing studies on link prediction often rely on knowledge graph embedding and have shown trade-off in their performance. In this paper, we propose an ensemble model for knowledge graph embedding to improve quality of link prediction. The proposed model combines multiple knowledge graph embeddings that have unique characteristics. In this way, the ensemble model is able to consider various aspects of the entries within a knowledge base and reduce the variation of accuracy depending on hyper-parameters. Our experiment shows that the proposed model outperforms other knowledge graph embedding methods by 13.5% on WN18 and FB15K dataset.
Variational Recurrent Neural Networks with Relational Memory Core Architectures
Geon-Hyeong Kim, Seokin Seo, Shinhyung Kim, Kee-Eung Kim
http://doi.org/10.5626/JOK.2020.47.2.189
Recurrent neural networks are designed to model sequential data and learn generative models for sequential data. Therefore, VRNNs (variational recurrent neural networks), which incorporate the elements of VAE (variational autoencoder) into RNN (recurrent neural network), represent complex data distribution. Meanwhile, the relationship between inputs in each sequence has been attributed to RMC (relational memory core), which introduces self-attention-based memory architecture into RNN memory cell. In this paper, we propose a VRMC (variational relation memory core) model to introduce a relational memory core architecture into VRNN. Further, by investigating the music data generated, we showed that VRMC was better than in previous studies and more effective for modeling sequential data.
The analysis of Loan status and Comparison of Default Prediction Performances based on Personal Credit Information Sample Database
http://doi.org/10.5626/JOK.2019.46.7.627
In this paper, we analyze the status of loans and defaults and present statistical data according to the borrower"s gender, age, month, etc. by using the personal credit information sample database offered as a trial service from Korea Credit Information Services. In addition, since domestic and foreign banks are paying attention to minimize the loss caused by default of the borrower, we used the personal credit information sample database to create a predicting model of borrower default and evaluated the model performance. To predict the default for a certain month, the borrower"s demographic information and loan information for the previous six months were processed to generate characteristic data, and a default prediction model was created using Recurrent Neural Network and machine learning algorithm. Based on the performance of each model, Recurrent Neural Network was showed as the model to demonstrate the best performance with Recall of 0.96 and AUC of 0.85 for the default borrower.
Design of Photovoltaic Power Generation Prediction Model with Recurrent Neural Network
Hanho Kim, Haesung Tak, Hwan-gue Cho
http://doi.org/10.5626/JOK.2019.46.6.506
The Smart Grid predicts the power generation amount of renewable energy and enables efficient power generation and consumption. Existing PV power generation prediction studies have rarely applied and compared recurrent neural network techniques that are superior to time series. Furthermore, in the reported studies, there is no consideration of the length of past data used for learning, leading to lowered prediction performance of the model. In this study, we used the embedded variable selection techniques to find the factors influencing PV power generation. Subsequently, experiments were carried out to insert various past data length into the recurrent neural networks (RNN, LSTM, GRU). We found the optimal prediction factors and designed a prediction model based on the outcomes of the experiments. The designed PV power generation prediction model shows better prediction performance compared to other factor settings. In addition, better performance based on the prediction rate is confirmed in the present study as compared with the existing researches.
Sentence Similarity Prediction based on Siamese CNN-Bidirectional LSTM with Self-attention
Mintae Kim, Yeongtaek Oh, Wooju Kim
http://doi.org/10.5626/JOK.2019.46.3.241
A deep learning model for semantic similarity between sentences was presented. In general, most of the models for measuring similarity word use level or morpheme level embedding. However, the attempt to apply either word use or morpheme level embedding results in higher complexity of the model due to the large size of the dictionary. To solve this problem, a Siamese CNN-Bidirectional LSTM model that utilizes phonemes instead of words or morphemes and combines long short term memory (LSTM) with 1D convolution neural networks with various window lengths that bind phonemes is proposed. For evaluation, we compared our model with Manhattan LSTM (MaLSTM) which shows good performance in measuring similarity between similar questions in the Naver Q&A dataset (similar to Kaggle Quora Question Pair).
Effect Scene Detection using Multimodal Deep Learning Models
Jeongseon Lim, Mikyung Han, Hyunjin Yoon
http://doi.org/10.5626/JOK.2018.45.12.1250
A conventional movie can be converted into a 4D movie by identifying effect scenes. In order to automate this process, in this paper, we propose a multimodal deep learning model that detects effect scenes using both visual and audio features of a movie. We have classified effect/non-effect scenes using audio-based Convolutional Recurrent Neural Network (CRNN) model and video-based Long Short-term Memory (LSTM) and Multilayer Perceptron (MLP) model. Also, we have implemented feature-level fusion. In addition, based on our own observation that effects typically occur during non-dialog scenes, we further detected non-dialog scenes using audio-based Convolutional Neural Network (CNN) model. Subsequently, the prediction scores of audio-visual effect scene classification and audio-based non-dialog classification models were combined. Finally, we detected sequences of effect scenes of the entire movie using prediction score of the input window. Experiments using real-world 4D movies demonstrate that the proposed multimodal deep learning model outperforms unimodal models in terms of effect scene detection accuracy.
Improving Recurrent Neural Network based Recommendations by Utilizing Embedding Matrix
Myung Ha Kwon, Sung Eon Kong, Yong Suk Choi
http://doi.org/10.5626/JOK.2018.45.7.659
Recurrent neural networks(RNNs) have recently been successfully applied to recommendation tasks. RNNs were adopted by session-based recommendation, which recommends items by the records only within a session, and a movie recommendation that recommends movies to the users by analyzing the consumption records collected through multiple accesses to the websites. The new approaches showed improvements over traditional approaches for both tasks where only implicit feedback such as clicks or purchase records are available. In this work, we propose the application of weight-tying to improve the existing movie recommendation model based on RNNs. We also perform experiments with an incremental recommendation method to more precisely evaluate the performance of recommendation models.
Search
Journal of KIISE
- ISSN : 2383-630X(Print)
- ISSN : 2383-6296(Electronic)
- KCI Accredited Journal
Editorial Office
- Tel. +82-2-588-9240
- Fax. +82-2-521-1352
- E-mail. chwoo@kiise.or.kr