Layout Code Generation using Large Multimodal Models 


Vol. 52,  No. 8, pp. 677-687, Aug.  2025
10.5626/JOK.2025.52.8.677


PDF

  Abstract

GUI layout generation entails the analysis and organization of user interface components into structured formats. This paper introduces a novel method that leverages Large Multimodal Models (LMMs) to transform GUI layout images into structured code. The proposed framework enables LMMs to effectively comprehend both the visual and structural attributes of GUI images and produce the corresponding layout code without requiring additional training. The method begins by extracting feature vectors from an input image, followed by retrieving similar examples and applying visual and spatial augmentation techniques to create few-shot prompts. Importantly, it selects augmented examples that are least similar to the input image, encouraging the model to generalize and better capture the semantic relationship between the image and its associated code. Experimental results indicate that our approach outperforms existing text-based prompting methods in both quantitative and qualitative evaluations. This work offers a practical and effective strategy for GUI code generation using LMMs and underscores the potential of multimodal prompting in layout generation tasks.


  Statistics
Cumulative Counts from November, 2022
Multiple requests among the same browser session are counted as one view. If you mouse over a chart, the values of data points will be shown.


  Cite this article

[IEEE Style]

Y. Choi, J. Na, D. Lee, J. Lee, "Layout Code Generation using Large Multimodal Models," Journal of KIISE, JOK, vol. 52, no. 8, pp. 677-687, 2025. DOI: 10.5626/JOK.2025.52.8.677.


[ACM Style]

Yangsoo Choi, Jeongwoo Na, Dongcheol Lee, and Jongwuk Lee. 2025. Layout Code Generation using Large Multimodal Models. Journal of KIISE, JOK, 52, 8, (2025), 677-687. DOI: 10.5626/JOK.2025.52.8.677.


[KCI Style]

최양수, 나정우, 이동철, 이종욱, "거대 멀티모달 모델을 활용한 레이아웃 코드 생성," 한국정보과학회 논문지, 제52권, 제8호, 677~687쪽, 2025. DOI: 10.5626/JOK.2025.52.8.677.


[Endnote/Zotero/Mendeley (RIS)]  Download


[BibTeX]  Download



Search




Journal of KIISE

  • ISSN : 2383-630X(Print)
  • ISSN : 2383-6296(Electronic)
  • KCI Accredited Journal

Editorial Office

  • Tel. +82-2-588-9240
  • Fax. +82-2-521-1352
  • E-mail. chwoo@kiise.or.kr