陆彩女,顾立平.软件级别计量:概念辨析与应用途径[J].中国图书馆学报,2022,48(4):116~129
Software Level Metrics: Concepts and Future Applications
软件级别计量:概念辨析与应用途径
Received:January 04, 2022  
DOI:
Key words:Software level metrics  Software citation  Software mentions  Altmetrics  Open scienceOpen source software  Academic evaluation
中文关键词:  软件级别计量  软件引用  软件提及  Altmetrics  开放科学  开源软件  学术评价
基金项目:
Author NameAffiliation
LU Cainü 中国科学院上海药物研究所信息中心 上海 201203 
GU Liping 中国科学院上海药物研究所信息中心 上海 201203 
Hits: 490
Download times: 399
Abstract:
In the open science and open source environment,the importance of research data and pieces of software and source code which are used to create research data in scientific research has been increasingly recognized and valued by many scholars and organizations. However,the visibility problem of software and source code in academic publications is severe. For example,software havent been cited or referenced or styles of software references or citations arent standardized,resulting in that the roles of software developers,optimizers,and maintainers havent been attached great importance in scientific research. Therefore,it is important and urgent to evaluate the academic impact of software and source code in a quantitative way and incorporate them into the academic assessment system. This study proposes the concept of software level metrics and gives the definition of software level metrics to evaluate the academic influence of software and source code quantitively to identify the contribution of software developers and maintainers in scientific research.
Based on known theories and practices,this study combs several measurement methods and indicators and their inherent problems for software level metrics and divides the indicators into 3 types: usage statistics indicators,bibliometric indicators and supplementary measurement indicators. The usage statistics indicators include the number of downloads,the number of registered users,the number of reuses and degree of dependence. The bibliometric indicators include the number of citations and the number of mentions in academic publications. Supplementary measurement indicators include the number of comments and the number of mentions in social network systems,etc. Among them,software citation and software mention in academic publications are two more important indicators in software level metrics. This study briefly summarizes four refined indicators of software citation and software mention,which are: 1) software mention #1-name mention; 2) software mention #2-URL mention; 3) software citation #1-citing papers; 4) software citation #2-citing URL or DOI or RRID. Then,this paper presents a practical example of software level metrics on three types of software: the proprietary software,open source software and non commercial software. It is confirmed through the example that software citation #1-citating papers is more common in academic publications than the other 3 indicators of software citation and software mention. Finally,this study simply outlines the possible application scenarios of software level metrics,including: 1) Assisting researchers in academic software search and discovery; 2) Assisting funding agencies or reviewers in project funding assessment and project conclusion review in a more comprehensive manner; 3) Promoting code development and optimization and scholarly awarding all of the persons and websites in the lifecycle of software; 4) For libraries and librarians to preserve software and develop new types of knowledge services,such as innovating academic assessment services; 5) Effectively carrying out personal study for citizens. 2 figs. 5 tabs. 83 refs.
中文摘要:
      在开放科学与开放源代码运动下,大多数科研人员都认识到了软件及软件源代码在科学研究中的作用。软件不只是研究工具,用于支持研究结果与研究数据的重现与验证,还是一种创造性研究产出,其学术价值得到了部分研究资助机构的承认。用量化的方式评价软件的学术影响力并将软件纳入学术评价体系,愈发重要和紧迫。软件级别计量就是通过量化指标来评价软件的学术影响力,旨在识别软件和软件源代码以及软件开发人员的学术贡献。软件级别计量指标包括但不限于软件引用次数、软件提及次数、软件下载次数、Altmetrics等,其中软件引用次数、软件提及次数是软件级别计量的两个重要方面。笔者剖析了当前软件级别计量测度指标存在的问题,包括数据获取难、无统一标准、易被操纵等;简要提出了未来软件级别计量的可能应用途径,如辅助研究软件发现、完善研究评估与贡献识别、促进软件长期保存等。图书馆可充分发挥知识服务中心的角色,在做好学术软件长期保存的同时,提供新型知识服务。图2。表5。参考文献83。
View Full Text   View/Add Comment  Download reader