TY  - JOUR
T1  - Enhancing Passage Selection and Answer Generation in FiD Systems Using Relevance Gating
AU  - Choi, Seung-ho 
AU  - Park, Shihyun 
AU  - Kim, Minsang 
AU  - Park, Chansol 
AU  - Wang, Junho 
AU  - Kim, Ji-Yoon 
AU  - Kim, Bong-Su 
JO  - Journal of KIISE, JOK
PY  - 2025
DA  - 2025/1/14
DO  - 10.5626/JOK.2025.52.5.385
KW  - ODQA
KW  - RAG
KW  - encoder-decoder language model
KW  - question-answering model
AB  - In this paper, we proposed a novel approach to enhance the performance of the Fusion-in-Decoder (FiD) model in open-domain question answering systems. The FiD model operates by independently encoding multiple passages and then combining them during the decoding stage to generate answers. However, this method has the drawback of not filtering out passages containing unnecessary information, thereby placing an excessive burden on the decoder. To address this issue, we introduced a Relevance Gate inspired by the forget gate of Long Short-Term Memory (LSTM). This gate can evaluate the relevance of each passage in parallel, selectively transmitting information to the decoder, thereby significantly improving the accuracy and efficiency of answer generation. Additionally, we applied a new activation function suitable for open-domain question answering systems instead of the sigmoid function to ensure the model's stability.