Ontology Construction for Interoperability and Scalability of Human-Object Interaction Datasets

Aryoung Kim, Sangbaek Lee, Kyuchul Lee

http://doi.org/10.5626/JOK.2021.48.8.947

Human behavior can be expressed through actions and objects. In order to understand the human behavior, the interaction with objects must be considered, as well as human behavior. The Human-Object Interaction (HOI) can be expressed in rich and varied ways. As detailed representations were required, large-scale datasets were generated. However, as they were written in different file formats and expression methods, decreasing interoperability between each other made it difficult to add, modify, or delete new objects or relationships. In this paper, we constructed a HOI ontology which can be utilized in the field of HOI research. We designed ontology to express the relationship between humans and objects. We then developed a method of instance generation and extension for interoperability support between HOI datasets. The design of the ontology allowed clear identification and expression of extracted information. Moreover, the extension method provided semantic interoperability so that new objects or relationships could be continuously extended to the HOI ontology.