Digital Library[ Search Result ]
TwinAMFNet : Twin Attention-based Multi-modal Fusion Network for 3D Semantic Segmentation
Jaegeun Yoon, Jiyeon Jeon, Kwangho Song
http://doi.org/10.5626/JOK.2023.50.9.784
Recently, with the increase in the number of accidents due to misrecognition in autonomous driving, interest in 3D semantic segmentation based on sensor fusion using multi-modal sensors has increased. Accordingly, this study introduces TwinAMFNet, a novel 3D semantic segmentation neural network through sensor fusion of RGB cameras and LiDAR. The proposed neural network includes a twin neural network that processes RGB images and point cloud projection images projected on a 2D coordinate plane and through an attention-based fusion module for feature step fusion in the encoder and decoder. The proposed method shows improvement of further extended object and boundary classification. As a result, the proposed neural network recorded approximately 68% performance in 3D semantic segmentation based on mIoU, and showed approximately 4.5% improved performance compared to the ones reported in the existing studies.
Person Re-Identification Using an Attention Pyramid for Local Multiscale Feature Embedding Extracted from a Person’s Image
http://doi.org/10.5626/JOK.2021.48.12.1305
In this paper, a person re-identification scheme using the dual pyramid adapting attention mechanisms to extract more elaborate local feature embedding by excluding the noises caused by the unnecessary backgrounds in person’s image is proposed. With the dual pyramid of local and scale ones, the spatial attention is used to suppress the noise effects caused by unnecessary backgrounds, and the channel attention is used to emphasize the relatively important multiscale features when the local feature embedding is constructed. In the experiments, the proposed scheme was compared with other cases in which the attention module is not used for each pyramid to confirm the optimal configuration and compared based on the rank-1 accuracy with the state-of-the-art studies for the person re-identification. According to the experimental results, the proposed method showed a maximum rank-1 accuracy of 99.4%, which is higher by at least about 0.2% and at most by about 13.8% than previous works.
A Recognition of Violence Using Mobile Sensor Fusion in Intelligent Video Surveillance Systems
HyunIn Cha, KwangHo Song, Yoo-Sung Kim
http://doi.org/10.5626/JOK.2018.45.6.533
In this paper, we propose a violence recognition model by reflecting features extracted by concurrent and continuous action in intelligent CCTV through detecting group ROI(Region of Interest) from image. And then, proposed model uses extracted motion information obtained by using Dense Optical Flow algorithm in ROI and fusing of the acceleration and angular velocity information obtained from the inertial measurement unit of the mobile device possessed by actor. Experiments were performed to evaluate the reduction of the computation time of the proposed model and improvement of the performance degradation due to the occlusion. Result of experiment, the execution time was about 51 times faster and the accuracy of recognition of violence was improved by 11% compared to previous research methods. Therefore, the proposed model can overcome the problem of real-time failure due to excessive computation and can solve the problem of invisibility due to occlusion by actor in the image in recognition of violence.
Automatic Keyword Extraction using Hierarchical Graph Model Based on Word Co-occurrences
Keyword extraction can be utilized in text mining of massive documents for efficient extraction of subject or related words from the document. In this study, we proposed a hierarchical graph model based on the co-occurrence relationship, the intrinsic dependency relationship between words, and common sub-word in a single document. In addition, the enhanced TextRank algorithm that can reflect the influences of outgoing edges as well as those of incoming edges is proposed. Subsequently a novel keyword extraction scheme using the proposed hierarchical graph model and the enhanced TextRank algorithm is proposed to extract representative keywords from a single document. In the experiments, various evaluation methods were applied to the various subject documents in order to verify the accuracy and adaptability of the proposed scheme. As the results, the proposed scheme showed better performance than the previous schemes.
Search
Journal of KIISE
- ISSN : 2383-630X(Print)
- ISSN : 2383-6296(Electronic)
- KCI Accredited Journal
Editorial Office
- Tel. +82-2-588-9240
- Fax. +82-2-521-1352
- E-mail. chwoo@kiise.or.kr