Digital Library[ Search Result ]
Prediction of Antibiotic Resistance to Ciprofloxacin in Patients with Upper Urinary Tract Infection through Exploratory Data Analysis and Machine Learning
http://doi.org/10.5626/JOK.2023.50.3.263
Emergency medicine physicians use an empirical treatment strategy to select antibiotics before clinically confirming an antibiotic resistance profile for a patient with a urinary tract infection. Empirical treatment is a challenging task in the context of concern for increased antibiotic resistance of urinary tract pathogens in the community. As a single-institution retrospective study, this study proposed a method for predicting antibiotic resistance using a machine learning algorithm for patients diagnosed with upper urinary tract infection in the emergency department. First, we selected significant predictors using statistical test methods and a game theory based SHAP (SHapley Additive exPlanation), respectively. Next, we compared four classifier performances and proposed an algorithm to assist decision-making in empirical treatment by adjusting the prediction probability threshold. As a result, the SVM classifier using predictors selected through SHAP (65% of the total) showed the highest AUROC (0.775) among all conditions used in the experiment. By adjusting the predictive probability threshold in the SVM, we achieved classification accuracy with a specificity that was 3.9 times higher than empirical treatment while preserving the sensitivity of the doctor"s empirical treatment at 98%.
A Pre-processing Method for Learning Data Using eXplainable Artificial Intelligence
Changhong Lee, Jaemin Lee, Donghyun Kim, Jongdeok Kim
http://doi.org/10.5626/JOK.2023.50.2.133
Artificial intelligence model generation proceeds to the stages of learning data processing, model learning, and model evaluation. Data pre-processing techniques for creating quality learning data contribute many of the methods for improving model accuracy. Existing pre-processing techniques tend to rely heavily on the experience of model generators. If pre-processing is performed based on experience, it is difficult to explain the basis for selecting the corresponding pre-processing technique. However, the reason why generators are forced to rely on experience is that the learning model becomes huge and complicated to a level that is difficult for humans to interpret. Therefore, research is being conducted to explain the operation method of the model by introducing eXplainable AI. In this paper, we propose a learning data pre-processing system using eXplainable AI. The system operation process is trained with data that has not been pre-processed, the learned model is analyzed using eXplainable AI, and the data pre-processing is repeated based on that information. Finally, we will improve the model performance, explain pre-processing reliability, and show the practicality of the system.
An Empirical Study on Defects in Open Source Artificial Intelligence Applications
Yoon Ho Choi, Changgong Lee, Jaechang Nam
http://doi.org/10.5626/JOK.2022.49.8.633
The differences between the programming paradigm of applications using artificial intelligence (AI) and traditional applications may show different results in detecting, understanding, analyzing, and fixing defects. In this study, we collect defects that have been reported in open source AI applications and identify common causes of the defects to understand and analyze them in AI-based systems. To this end, we analyze the defects of ten open-source AI applications archived on GitHub by inspecting 1,205 issues and defect-fixing code changes that had been reported, found, and fixed. We classified the defects into 20 categories based on their causes, which are found in at least five out of ten projects. We expect that the result of this study will provide useful information in software quality assurance approaches such as fault localization and patch suggestion.
GPT-2 for Knowledge Graph Completion
http://doi.org/10.5626/JOK.2021.48.12.1281
Knowledge graphs become an important resource in many artificial intelligence (AI) tasks. Many studies are being conducted to complete the incomplete knowledge graph. Among them, interest in research that knowledge completion by link prediction and relation prediction is increasing. The most talked-about language models in AI natural language processing include BERT and GPT-2, among which KG-BERT wants to solve knowledge completion problems with BERT. In this paper, we wanted to solve the problem of knowledge completion by utilizing GPT-2, which is the biggest recent issue in the language model of AI. Triple information-based knowledge completion and path-triple-based knowledge completion were proposed and explained as methods to solve the knowledge completion problem using the GPT-2 language model. The model proposed in this paper was defined as KG-GPT2, and experiments were conducted by comparing the link prediction and relationship prediction results of TransE, TransR, KG-BERT, and KG-GPT2 to evaluate knowledge completion performance. For link prediction, WN18RR, FB15k-237, and UMLS datasets were used, and for relation prediction, FB15K was used. As a result of the experiment, in the case of link prediction in the path- triple-based knowledge completion of KG-GPT2, the best performance was recorded for all experimental datasets except UMLS. In the path-triple-based knowledge completion of KG-GPT2, the model"s relationship prediction work also recorded the best performance for the FB15K dataset.
Prediction of Fine Dust in Gyeonggi-do Industrial Complex using Machine Learning Methods
Dong-Jun Won, Sun-Kyum Kim, Yeonghun Kim, Gyuwon Song
http://doi.org/10.5626/JOK.2021.48.7.764
Recently, research on fine dust has been conducted through various prediction techniques. However, currently the research focused on PM10 concentration prediction, and thus it is necessary to develop a model capable of predicting PM2.5 concentration. In this paper, we have collected air quality, weather, and traffic of the Banwol Shihwa National Industrial Complex in the recent two years. The significance of the variable been identified through correlation analysis and regression analysis among PM2.5 and PM10, SO₂, NO₂, CO, O₃, temperature, humidity, wind direction, wind speed, precipitation, road section vehicle speed for each vehicle. Next, the data has been used to predict PM2.5 concentration based on time in the industrial complex. Through the artificial intelligence techniques, Random Forest, XGBoost, LightGBM, Deep neural network and Voting models, PM2.5 concentration industrial complexes been predicted on an hourly basis, and comparative analysis been conducted based on RMSE. As a result of prediction, RMSE was 6.27, 6.41, 6.22, 6.64, and 6.12, respectively, and each technique showed very high performance compared to 10.77 of the technique predicted by Air Korea.
Knowledge Completion System through Learning the Relationship between Query and Knowledge Graph
Min-Sung Kim, Min-Ho Lee, Wan-Gon Lee, Young-Tack Park
http://doi.org/10.5626/JOK.2021.48.6.649
The knowledge graph is a network comprising of relationships between the entities. In a knowledge graph, there exists a problem of missing or incorrect relationship connection with the specific entities. Numerous studies have proposed learning methods using artificial neural networks based on natural language embedding to solve the problems of the incomplete knowledge graph. Various knowledge graph completion systems are being studied using these methods. In this paper, a system that infers missing knowledge using specific queries and knowledge graphs is proposed. First, a topic is automatically extracted from a query, and topic embedding is obtained from the knowledge graph embedding module. Next, a new triple is inferred by learning the relationship between the topic from the knowledge graph and the query by using Query embedding and knowledge graph embedding. Through this method, the missing knowledge was inferred and the predicate embedding of the knowledge graph related to a specific query was used for good performance. Also, an experiment was conducted using the MetaQA dataset to prove the better performance of the proposed method compared with the existing methods. For the experiment, we used a knowledge graph having movies as a domain. Based on the assumption of the entire knowledge graph and the missing knowledge graph, we experimented on the knowledge graph in which 50% of the triples were randomly omitted. Apparently, better performance than the existing method was obtained.
Development and Application of Guidelines for Compliance with IEC 62304 International Standards for AI Medical Device Software
DongYeop Kim, Ye-Seul Park, Byungjeong Lee, Jung-Won Lee
http://doi.org/10.5626/JOK.2021.48.1.71
Medical device software developers must implement the processes required by IEC 62304, the international standard for medical device software life-cycle processes, and they must also have a large amount of artifacts to obtain a license. Recently, AI medical device software based on medical images has been actively developed, and since it is treated as standalone software, it must be approved in accordance with IEC 62304 for medical device software. The international standard for AI technology is currently in the discussion stage, and the developer should arbitrarily establish the life-cycle process of AI medical device software, and by matching the specifications of IEC 62304, the performance and safety of AI products will be evaluated. It is unclear which quality management technique should be used to produce the best artifact. This paper provides a quality control technique for fulfilling the scope and requirements of IEC 62304 compliance for AI medical device software in the form of guidelines. These guidelines are also applied to actual AI products to check their potential use in real applications.
Anomaly Detection by a Surveillance System through the Combination of C3D and Object-centric Motion Information
Seulgi Park, Myungduk Hong, Geunsik Jo
http://doi.org/10.5626/JOK.2021.48.1.91
In the existing closed-circuit television (CCTV) videos, the deep learning-based anomaly detection reported in the literature detected anomalies using only the object"s action value. For this reason, it is difficult to extract the action value of an object depending upon the situation, and there is a problem that information is reduced over time. Since the cause of abnormalities in CCTV videos involves several factors such as frame complexity and information according to time series analysis, there is a limit to detecting an abnormality using only the action value of the object. To solve this problem, in this paper, we designed a new deep learning-based anomaly detection model that combined optical flow with C3D to use various feature values centered on the objects. The proposed anomaly detection model used the UCF-Crime dataset, and the experimental results achieved an area under the curve (AUC) of 76.44. Compared to previous studies, this study worked more effectively in fast-moving videos such as explosions. Finally, we concluded that it was appropriate to use the information according to different feature values and time series analysis considering various aspects of the behavior of an object when designing an anomaly detection model.
Survey on Feature Attribution Methods in Explainable AI
Gihyuk Ko, Gyumin Lim, Homook Cho
http://doi.org/10.5626/JOK.2020.47.12.1181
As artificial intelligence (AI)-based technologies are increasingly being used in areas that can have big socioeconomic effects, there is a growing effort to explain decisions made by AI models. One important direction in such eXplainable AI (XAI) is the ‘feature attribution’ method, which explains AI models by assigning a contribution score to each input feature. In this work, we surveyed nine recently developed feature attribution methods and categorized them using four different criteria. Based on the categorizations, we found that the current methods focused only on specific settings such as generating local, white-box explanations of neural networks and lacked theoretical foundations such as axiomatic definitions. We suggest future research directions toward a unified feature attribution method based on our findings.
A Comparative Study of Machine Learning Algorithms for Diagnosis of Ischemic Heart Disease
Pyoung-Woo Park, Min-Koo Kim, Hong-Seok Lim, Duk-Yong Yoon, Seok-Won Lee
http://doi.org/10.5626/JOK.2018.45.4.376
In recent years, studies on artificial intelligence have been actively conducted, and artificial intelligence technology supports accurate and efficient decision-making for mankind. Also, the accumulation of medical knowledge and related data is accelerating, and studies on diagnosis of diseases through artificial intelligence technology are being carried out briskly. In this study, I chose a representative cardiovascular disease, specifically ischemic heart disease, as a research domain, and analyzed the available algorithms comparing effective approaches in the medical expert system for diagnosis of the disease. Concretely, the purpose of the study is to assist medical experts and physicians based on the initial patient record data, help them to explain the cause of ischemic heart disease, and minimize unnecessary related tests. In addition, the experimental data can be configured so that medical professionals can use them as learning models, thereby maximizing their experience and knowledge efficiently.
Search
Journal of KIISE
- ISSN : 2383-630X(Print)
- ISSN : 2383-6296(Electronic)
- KCI Accredited Journal
Editorial Office
- Tel. +82-2-588-9240
- Fax. +82-2-521-1352
- E-mail. chwoo@kiise.or.kr