Digital Library[ Search Result ]
SMERT: Single-stream Multimodal BERT for Sentiment Analysis and Emotion Detection
Kyeonghun Kim, Jinuk Park, Jieun Lee, Sanghyun Park
http://doi.org/10.5626/JOK.2021.48.10.1122
Sentiment Analysis is defined as a task that analyzes subjective opinion or propensity and, Emotion Detection is the task that finds emotions such as ‘happy’ or ‘sad’ from text data. Multimodal data refers to the appearance of image and voice data in addition to text data. In prior research, RNN or cross-transformer models were used, however, RNN models have long-term dependency problems. Also, since cross-transformer models could not capture the attribute of modalities, they got worse results. To solve those problems, we propose SMERT based on a single-stream transformer ran on a single network. SMERT can get joint representation for Sentiment Analysis and Emotion Detection. Besides, we use BERT tasks which are improved to utilize for multimodal data. To present the proposed model, we verify the superiority of SMERT through a comparative experiment on the combination of modalities using the CMU-MOSEI dataset and various evaluation metrics.
Denoising Multivariate Time Series Modeling for Multi-step Time Series Prediction
Jungsoo Hong, Jinuk Park, Jieun Lee, Kyeonghun Kim, Seung-Kyun Hong, Sanghyun Park
http://doi.org/10.5626/JOK.2021.48.8.892
The research field of time series forecasting predicts the future time point using seasonality in time series. In the industrial environment, since decision-making through continuous perspective prediction of the future is important, multi-step time series forecasting is necessary. However, multi-step prediction is highly unstable because of its dependency on predicted value of previous time prediction result. Therefore, the traditional time series forecasting makes a statistical prediction for the single time point. To address this limitation, we propose a novel encoder-decoder based neural network named ‘DTSNet’ which predicts multi-step time points for multivariate time series. To stabilize multi-step prediction, we exploit positional encoding to enhance representation for time point and propose a novel denoising training method. Moreover, we propose dual attention to resolve long-term dependencies and modeling complex patterns in time series, and we adopt multi-head strategy at linear projection layer for variable-specific modeling. To verify the performance improvement of our approach, we compare and analyze it with baseline models, and we demonstrate the proposed methods through comparison tests, such as, component ablation study and denoising degree experiment.
Prediction of Fine Dust in Gyeonggi-do Industrial Complex using Machine Learning Methods
Dong-Jun Won, Sun-Kyum Kim, Yeonghun Kim, Gyuwon Song
http://doi.org/10.5626/JOK.2021.48.7.764
Recently, research on fine dust has been conducted through various prediction techniques. However, currently the research focused on PM10 concentration prediction, and thus it is necessary to develop a model capable of predicting PM2.5 concentration. In this paper, we have collected air quality, weather, and traffic of the Banwol Shihwa National Industrial Complex in the recent two years. The significance of the variable been identified through correlation analysis and regression analysis among PM2.5 and PM10, SO₂, NO₂, CO, O₃, temperature, humidity, wind direction, wind speed, precipitation, road section vehicle speed for each vehicle. Next, the data has been used to predict PM2.5 concentration based on time in the industrial complex. Through the artificial intelligence techniques, Random Forest, XGBoost, LightGBM, Deep neural network and Voting models, PM2.5 concentration industrial complexes been predicted on an hourly basis, and comparative analysis been conducted based on RMSE. As a result of prediction, RMSE was 6.27, 6.41, 6.22, 6.64, and 6.12, respectively, and each technique showed very high performance compared to 10.77 of the technique predicted by Air Korea.
Hybrid Recommendation System of Qualitative Information Based on Content Similarity and Social Affinity Analysis
Recommendation systems play a significant role in providing personalized information to users, with enhanced satisfaction and reduced information overload. Since the mid-1990s, many studies have been conducted on recommendation systems, but few have examined the recommendations of information from people in the online social networking environment. In this paper, we present a hybrid recommendation method that combines both the traditional system of content-based techniques to improve specialization, and the recently developed system of social network-based techniques to best overcome a few limitations of the traditional techniques, such as the cold-start problem. By suggesting a state-of-the-art method, this research will help users in online social networks view more personalized information with less effort than before.
Search
Journal of KIISE
- ISSN : 2383-630X(Print)
- ISSN : 2383-6296(Electronic)
- KCI Accredited Journal
Editorial Office
- Tel. +82-2-588-9240
- Fax. +82-2-521-1352
- E-mail. chwoo@kiise.or.kr