and as a consequence, just within the last year or so, the most prestigious psychology journals are beginning to ask authors of papers on new experimental research to show replication across at least two distinct data sets. This, in turn, is driving more collaboration among researchers at different research centers. It's a long overdue development, one in accord with best practice in science,
which is the most prestigious psychology journal published in the United States, I have been told at the University of Minnesota behavior genetics "journal club" that replication across more than one data set is becoming a tacit requirement for publication in most of the better journals. Perhaps that guideline will eventually be made explicit for all of the better journals.)
A lot of psychology journals have been burned by that over the years,
http://chronicle.com/blogs/percolator/is-psychology-about-to...
http://simplystatistics.org/post/21326470429/replication-psy...
http://scholarlykitchen.sspnet.org/2012/04/26/reproducibilit...
and as a consequence, just within the last year or so, the most prestigious psychology journals are beginning to ask authors of papers on new experimental research to show replication across at least two distinct data sets. This, in turn, is driving more collaboration among researchers at different research centers. It's a long overdue development, one in accord with best practice in science,
http://norvig.com/experiment-design.html
and I hope this practice spreads to most disciplines that publish new research reports in the major journals of the discipline.
(Although the requirement for prepublication replication is not explicitly mentioned in the publication guidelines of Psychological Bulletin,
http://www.apa.org/pubs/journals/bul/index.aspx
which is the most prestigious psychology journal published in the United States, I have been told at the University of Minnesota behavior genetics "journal club" that replication across more than one data set is becoming a tacit requirement for publication in most of the better journals. Perhaps that guideline will eventually be made explicit for all of the better journals.)