论文标题
几个指标的收敛有效性,通过专家对物理论文的里程碑分配来衡量破坏性
Convergent validity of several indicators measuring disruptiveness with milestone assignments to physics papers by experts
论文作者
论文摘要
这项研究着重于最近引入的指标类型,该指标测量了科学中的破坏性。破坏性的研究通过开放新线条与当前的研究线不同。在当前的研究中,我们包括了最初提出的这种新型类型的指标(Wu,Wang和Evans,2019年),以及具有DI1:DI5,DI1N,DI5N和DEP的几种变体。由于指标应衡量他们建议测量的内容,因此我们研究了指标的收敛有效性。我们使用了一份里程碑论文的列表,这些论文由物理审查信的编辑选择和发表,并研究了该人(基于专家的列表)是否与几个中断指标的变体的值有关,并且 - 如果是 - 哪些变体显示与专家判断的最高相关性。我们使用了Bivariate统计数据,多个回归模型和(COARSEDENDENS)的确切指标(CONCRETIND SURCETIND(CORMENTISTER)的指标(CONCRENTINDERINGITISTINER)对其进行了调查(CRONSENTINDERCONTIND)。与编辑人员的里程碑分配不同。最初提出的干扰指数(DI1),而是Bornmann,Devarakonda,Tekles,Tekles和Chacko(2019年)在此研究中介绍了Dep Varang,walt -walt,and anu the Buntoble,bortman and the the the the -nu,
This study focuses on a recently introduced type of indicator measuring disruptiveness in science. Disruptive research diverges from current lines of research by opening up new lines. In the current study, we included the initially proposed indicator of this new type (Wu, Wang, & Evans, 2019) and several variants with DI1: DI5, DI1n, DI5n, and DEP. Since indicators should measure what they propose to measure, we investigated the convergent validity of the indicators. We used a list of milestone papers, selected and published by editors of Physical Review Letters, and investigated whether this human (experts - based list is related to values of the several disruption indicators variants and - if so - which variants show the highest correlation with expert judgements. We used bivariate statistics, multiple regression models, and (coarsened) exact matching (CEM) to investigate the convergent validity of the indicators. The results show that the indicators correlate differently with the milestone paper assignments by the editors. It is not the initially proposed disruption index that performed best (DI1), but the variant DI5 which has been introduced by Bornmann, Devarakonda, Tekles, and Chacko (2019). In the CEM analysis of this study, the DEP variant - introduced by Bu, Waltman, and Huang (2019) - also showed favorable results.