文章摘要

徐雷,王晓光.叙事型图像语义标注模型研究[J].中国图书馆学报,2017,43(5):70~83
叙事型图像语义标注模型研究
Narrative Image Annotation Ontology for Semantic Web
投稿时间:2017-04-25  
DOI:
中文关键词: 叙事型图像  故事情节  语义描述  图像标注
英文关键词: Narrative image  Story plot  Semantic description  Image annotation
基金项目:
作者单位E-mail
徐雷 武汉大学信息资源研究中心 湖北 武汉 430072  
王晓光 武汉大学信息资源研究中心 湖北 武汉 430072 whu_wxg@126.com,whu_wxg@126.com 
摘要点击次数: 2933
全文下载次数: 924
中文摘要:
      由于叙事型图像对时空语义信息表达的特殊性,目前叙事相关的语义模型并不适合直接用于该类型图像的语义标注。针对这一问题,本文设计了一个适用于叙事型图像的深度语义标注本体模型。该模型借助模块化本体设计思想,结合开放标注协同框架(OAC),以情节、实体、活动、情境为核心,解决了叙事型图像时空信息组织表达以及叙事模型和标注信息映射的问题。使用嵌入该标注模型的图像语义标注工具,对敦煌壁画进行语义标注实验,验证了该模型的可靠性和可用性。但是叙事型图像中情节的划分存在不同的见解,给情节提取和标注带来了不确定性,这是图像深度语义标注面临的挑战。图8。表1。参考文献22。
英文摘要:

    Narrative image is one type of visual literature resources that intends to tell stories. In face of its obscure and abstract nature,existing narrative-relevant semantic models appear inadequate for its semantic annotation and description. To address the issue,this paper designs an ontology model for deep semantic annotation applicable for narrative images.

    The model resorts to the design thought as in modular ontology,integrates with Open Annotation Collaboration(OAC)framework,and takes plot,entity,dynamics and context as its core. The model addresses issues such as the organization and representation of spatio-temporal information in narrative images,and the mapping between narrative model and annotation information.

    Plot lies at the core of the framework. Each plot takes place in a specific context and involves some entities,while different plots are semantically related in terms of sequence or overlap. In a specific plot annotation area within an image,a dynamics is normally used to present dynamic features of the plot. The descriptive framework,as a whole,is an abstract semantic annotation model and accomplishes the semantic description and annotation by mapping annotated objects onto the abstract model. Plot constitutes the core of the annotation framework and corresponds to the Body of OAC in image annotation.

    In detail,temporal semantic relations between plots contain nextplot,lastplot,overlaps,meets,starts,during,finishes,equal. In addition to the above relations,other obscure and abstract spatio-temporal semantic relations can also be identified in plots. This paper places TemporalSpatialEntity under the category of Entity. To meet the need for annotation of spatio-temporal information in narrative images,this paper divides TemporalSpatialEntity into Place and TemporalThing,which are respectively further divided into two types-Concrete(ConcretePlace,ConcreteTemporalThing)and Abstract(AbstractPlace,AbstractTemporalThing). Dynamics is another indispensable element in the model. As a core sub-category in the process of annotation,Action has two object properties,namely hasActor and hasRecipient;the former being the agent of the action while the latter the patient. At the same time,Dynamics can also have a type(DyanmicsType). Context is a special item in the plot annotation of narrative images,and it provides the annotation model with additional extension ability. Instead of being directly accessible from image,information involved in context is hidden behind the image,yet helpful in understanding the image.

    To represent the complex relations of overlap between different annotated areas within an image,this paper puts forward OAC extended vocabularies,including no-overlap,complete-overlap,inclusiveness,and partial-overlap. In the end,this paper performs a semantic annotation experiment on Dunhuang narrative murals,using an image semantic annotation tool embedded with the model,and the annotation data is converted and stored in the form of RDF triples. The experiment verifies the model's reliability and applicability. 8 figs. 1 tab. 22 refs.

查看全文   查看/发表评论  下载PDF阅读器