赵蓉英,郭凤娇,谭洁.基于Altmetrics的学术论文影响力评价研究——以汉语言文学学科为例[J].中国图书馆学报,2016,42(1):96~108
Evaluation of Academic Papers Impact Based on Altmetrics: A Case Study of Chinese Language and Literature
基于Altmetrics的学术论文影响力评价研究——以汉语言文学学科为例
Received:July 07, 2015  Revised:July 27, 2015
DOI:10.13530/j.cnki.jlis.150031
Key words:Altmetrics  Academic papers  Evaluation model
中文关键词:  Altmetrics  学术论文  评价模型
基金项目:
Author NameAffiliation
ZHAO Rongying 武汉大学信息管理学院 湖北 武汉 430072 
GUO Fengjiao 武汉大学信息管理学院 湖北 武汉 430072 
TAN Jie 武汉大学信息管理学院 湖北 武汉 430072 
Hits: 2981
Download times: 2108
Abstract:
Traditional evaluation of academic papers impact is done by analyzing the phenomenon of paper citations. With the development of web 20,the online communication is used by more and more researchers to acquire,spread and share research achievements. Altmetrics was born under this background. In this paper,evaluation model based on Altmetrics was constructed to evaluate the influence of academic papers. We hope that it not only overcomes the shortcomings of traditional evaluation methods,but also evaluates the academic papers impact more comprehensively and scientifically by combining with the characteristics of the academic exchanges in the network environment.
In this paper,problems existing in the current study of Altmetrics evaluation indicators were first summarized. Secondly,aiming at the shortcomings and deficiencies of related research,an evaluation model flowchart of academic papers impact based on Altmetrics was constructed,combining with the existing evaluation indicators. Then,all the relevant journal articles about Chinese Language and Literature published in 2012 from Mendeley were selected as the sample documents. Altmetrics Explore and SPSS were used to acquire,analyze and process the data. Synthetically using the correlation analysis and principal component analysis,we quantitatively analyzed and selected evaluation indicators from the existing indicators. Indicators were determined by factor analysis and weights were assigned according to the score coefficient matrix of each principal component. Empirical studies had shown the feasibility and rationality of the evaluation model.
By the comparative analysis with the traditional citation indicators,we find that Altmetrics indicators have consistency in the evaluation results with the citations and h index,but there are still some differences. Altmetrics evaluation indicators are mainly used to measure the controlled readership of academic papers,the depth of social communication of traditional media and interactions produced by recommendations,comments,etcIt is in favor of social influence and social attention,and less involved in academic impact. Therefore,evaluation of academic papers impact based on Altmetrics is a complement to traditional evaluation based on citation indicators,and cannot completely replace the traditional evaluation methods.
The feasibility and rationality of the evaluation model based on Altmetrics were verified in this article. A comprehensive model uniting Altmetrics indicators and citation indicators can both measure the social influence and academic impact of academic papers. We look forward to selecting more rational Altmetrics indicators and citation indicators to design a better comprehensive evaluation model,making the evaluation of academic papers impact more comprehensive and effective.
中文摘要:
      本文借助Altmetric Explorer和SPSS统计分析软件获取和分析处理数据,综合运用相关性分析法和主成分分析法,对现有Altmetrics评价指标进行定量分析和选取,设计和构建基于Altmetrics的学术论文影响力评价框架及模型,并通过实证研究证明评价模型的可行性。通过与传统引文指标评价方法的对比分析,发现Altmetrics评价指标同传统的引文指标在评价结果上既具有一致性也存在差异,Altmetrics测度的影响力偏向社会影响力及社会关注度,较少涉及表征论文质量的学术影响力。基于Altmetrics的学术论文影响力评价对传统的基于文献计量学的学术论文影响力评价有所补充。图6。表12。参考文献15。
View Full Text   View/Add Comment  Download reader