5: Crowd Sourcing
Crowd sourcing replication efforts Other Information:
Individual scientists and laboratories may be interested in conducting replications but not have sufficient resources available
for them. It may be easier to conduct replications by crowd sourcing them with multiple contributors.
Stakeholder(s):
- Open Science Collaboration: For example, in 2011, the Open Science Collaboration began investigating the reproducibility of psychological science by identifying
a target sample of studies from published articles from 2008 in three prominent journals: the Journal of Personality and Social
Psychology, the Journal of Experimental Psychology: Learning, Memory, and Cognition, and Psychological Science (Carpenter,
2012; Yong, 2012). Individuals and teams selected a study from the eligible sample and followed a standardized protocol. In
the aggregate, the results were intended to facilitate understanding of the reproducibility rate and factors that predict
reproducibility.
- Journal of Personality and Social Psychology
- Journal of Experimental Psychology
- Open Science Collaborators: Further, as an open project, many collaborators could join and make small contributions that accumulate into a large-scale
investigation. The same concept can be incorporated into replications of singular findings. Some important findings are difficult
to replicate because of resource constraints. Feasibility could be enhanced by spreading the data collection effort across
multiple laboratories.
Objective(s):
|