Evaluating Table QA with Generative Language Models 


Vol. 51,  No. 10, pp. 892-899, Oct.  2024
10.5626/JOK.2024.51.10.892


PDF

  Abstract

Tables in documents can be described as collections of information that condense and aggregate important data. Research on table question answering techniques focusing on querying such tables is underway, with studies utilizing language models showing promising results. This study applied an emerging generative language model technology to table question answering, examining outcomes based on changes in the language model and prompts. It analyzed results using methods suitable for short-answer and generative outcomes. Applying our custom-developed EXAONE 1.7B model to the KorWiki dataset yielded an EM of 92.49 and an F1 score of 94.81. This demonstrates that fine-tuning smaller models can achieve better performance than larger models such as GPT-4. Additionally, the EXAONE 25B model exhibited the best performance among tested models on the KorQuAD2Table dataset.


  Statistics
Cumulative Counts from November, 2022
Multiple requests among the same browser session are counted as one view. If you mouse over a chart, the values of data points will be shown.


  Cite this article

[IEEE Style]

K. Min, J. Choi, M. Sim, M. Park, S. J. Choi, "Evaluating Table QA with Generative Language Models," Journal of KIISE, JOK, vol. 51, no. 10, pp. 892-899, 2024. DOI: 10.5626/JOK.2024.51.10.892.


[ACM Style]

Kyungkoo Min, Jooyoung Choi, Myoseop Sim, Minjun Park, and Stanley Jungkyu Choi. 2024. Evaluating Table QA with Generative Language Models. Journal of KIISE, JOK, 51, 10, (2024), 892-899. DOI: 10.5626/JOK.2024.51.10.892.


[KCI Style]

민경구, 최주영, 심묘섭, 박민준, 최정규, "생성형 언어모델을 이용한 테이블 질의응답 평가," 한국정보과학회 논문지, 제51권, 제10호, 892~899쪽, 2024. DOI: 10.5626/JOK.2024.51.10.892.


[Endnote/Zotero/Mendeley (RIS)]  Download


[BibTeX]  Download



Search




Journal of KIISE

  • ISSN : 2383-630X(Print)
  • ISSN : 2383-6296(Electronic)
  • KCI Accredited Journal

Editorial Office

  • Tel. +82-2-588-9240
  • Fax. +82-2-521-1352
  • E-mail. chwoo@kiise.or.kr