陈涛,刘炜,孙逊,朱庆华,赵宇翔.IIIF与AI作用下的文化遗产应用研究新模态[J].中国图书馆学报,2021,47(2):67~78
New Modality of Applied Research on Cultural Heritage under the Action of IIIF and AI
IIIF与AI作用下的文化遗产应用研究新模态
Received:April 21, 2020  Revised:August 24, 2020
DOI:
Key words:International Image Interoperability Framework  Linked data  Digital humanities  Knowledge graphArtificial Intelligence
中文关键词:  国际图像互操作框架  关联数据  数字人文  知识图谱  人工智能
基金项目:本文系国家社会科学基金项目“数字人文中图像文本资源的语义化建设与开放图谱构建研究”(编号:19BTQ024)的研究成果之一
Author NameAffiliation
CHEN Tao 上海图书馆/ 上海科学技术情报研究所 上海 200031 
LIU Wei 上海图书馆/ 上海科学技术情报研究所 上海 200031 
SUN Xun 上海交通大学钱学森图书馆 上海 200030 
ZHU Qinghua 南京大学信息管理学院 江苏 南京 210023 
ZHAO Yuxiang 南京理工大学经济管理学院信息管理系 江苏 南京 210094 
Hits: 1093
Download times: 593
Abstract:
Culture Heritages are non renewable and precious resources. “How to make the cultural relics collected in museums,the heritage displayed on the vast land,and characters written in ancient books all come alive” is a proposition that all mankind should think and study. The International Image Interoperability Framework (IIIF) has developed a series of standard API interfaces that aim to ensure the interoperability and accessibility of global image resources storage.
Based on the open data five star model,the paper first proposes a five star model for open images,“image online”,“high quality images”,“annotated images”,“open standards”,and “semantic connection”. Among them,the former three stars focus on the “readable” characteristics of images,and the last two stars focus on “availability” feature. Subsequently,based on the two major technologies of IIIF framework and Artificial Intelligence (AI),the paper proposes a technical framework for the deep application of image resources in cultural heritage. In the framework,the IIIF part is mainly responsible for the organization and presentation of image resources through the four published API interface standards,while the AI technologies can be used to realize the recognition and comprehension of image contents. Specifically,the IIIF Image API specifies a web service that returns an image in response to a standard HTTP or HTTPS request. The IIIF Presentation API is to provide the information necessary to allow a rich,online viewing environment. The IIIF Search API lays out the interoperability mechanism for searching annotation content within a single IIIF resource. And the IIIF Authentication API describes a set of workflows for guiding the user through an existing access control system. In AI implementation part,digitalization mainly realizes the reorganization of different image resources. Different technologies need to be adopted according to the type of image,text image and non text image,in textualization. Conceptualization is to identify and extract entities from textual content. Through semantic connection,the semantic annotation,knowledge association and content enhancement of image resources can be realized. From the perspective of application,smart application explores the realization of semantic services and in depth application of images through knowledge graphs.
In the case part,the paper uses semantic technologies such as IIIF,linked data,graph database,and ontology to build IIIF IIP system,an immersion style interactive platform,which includes the process of publishing,annotation,linking and reuse of image resources. And this platform supports the online interaction of ultra high definition and super giant image resources with billions of pixels,and explores an ecological way that allows cultural heritage to “release,connect and live”. At the end,the paper takes part of the flower related collection resources of Vincent Van Gogh's works,published by different collection institutions,as an example to verify the feasibility of the implementation plan and technical path of the paper,which will play a good guidance and reference for the dissemination and research of traditional cultures.
Although the IIIF framework is still being improved,it does not affect the technology that has become a hot spot pursued by cultural heritage institutions. The combination of IIIF and AI will usher in a new era of digital humanities research and jointly help the effective protection,inheritance and research of image resources in cultural heritage. 10 figs. 1 tab. 24 refs.
中文摘要:
      文化遗产是不可再生的珍贵资源,“如何让收藏在博物馆里的文物、陈列在广阔大地上的遗产、书写在古籍里的文字都活起来”是全人类应该思考和研究的命题。国际图像互操作框架(IIIF)旨在确保全球图像资源存储的互操作性和可获取性,它赋予了文化遗产新的生命,带来了文化遗产应用的新模态。文章首先定义了开放图像的五星模型,并指出只有符合开放标准和语义关联的图像资源才是“活”的资源。随后,给出了IIIF和AI两者相结合的系统框架,为文化遗产中的图像资源从数字化到文本化、数据化再到语义化、智慧化的转变理出一个可行的技术方案;方案中IIIF部分主要负责图像的组织与呈现,AI技术用来解决图像内容的识别与理解。此外,还构建了IIIF-IIP沉浸式交互平台,实现了图像资源的发布、注释、关联、复用全流程,探索出一条让文化遗产“放出来、连起来、活起来”的生态之路。最后,文章以不同馆藏机构发布的梵高作品中与花相关的部分藏品资源为例,验证了文中实施方案和技术路线的可行性。图10。表1。参考文献24。
View Full Text   View/Add Comment  Download reader