4: Replication Metrics
[Develop] metrics to identify what is worth replicating Other Information:
Even if valuation of replication increased, it is not feasible—or advisable—to replicate everything. The resources required
would undermine innovation. A solution to this is to develop metrics for identifying replication value (RV)—what effects are
more worthwhile to replicate than others? The Open Science Collaboration (2012b) is developing an RV metric based on the citation
impact of a finding and the precision of the existing evidence of the effect. It is more important to replicate findings with
a high RV because they are becoming highly influential, and yet their truth value is still not precisely determined. Other
metrics might be developed as well. Such metrics could provide guidance to researchers for research priorities, to reviewers
for gauging the "importance" of the replication attempt, and to editors who could, for example, establish an RV threshold
that their journal would consider as sufficiently important to publish in its pages.
Objective(s):
|
