World Library  
Flag as Inappropriate
Email this Article

Replication of results

Article Id: WHEBN0020963481
Reproduction Date:

Title: Replication of results  
Author: World Heritage Encyclopedia
Language: English
Subject: Cold fusion, Scientific skepticism
Collection:
Publisher: World Heritage Encyclopedia
Publication
Date:
 

Replication of results

Reproducibility is the ability of an entire experiment or study to be reproduced, either by the researcher or by someone else working independently. It is one of the main principles of the scientific method and relies on ceteribus paribus. The result values are said to be commensurate if they are obtained (in distinct experimental trials) according to the same reproducible experimental description and procedure. The basic idea can be seen in Aristotle's dictum that there is no scientific knowledge of the individual, where the word used for individual in Greek had the connotation of the idiosyncratic, or wholly isolated occurrence. Thus all knowledge, all science, necessarily involves the formation of general concepts and the invocation of their corresponding symbols in language (cf. Turner).

Aristotle′s conception about the knowledge of the individual being considered unscientific is due to lack of the field of statistics in his time, so he could not appeal to statistical averaging of the individual.

Reproducibility also refers to the degree of agreement between measurements or observations conducted on replicate specimens in different locations by different people, as part of the precision of a test method.[1]

Reproducible data

Reproducibility is one component of the precision of a measurement or test method. The other component is repeatability which is the degree of agreement of tests or measurements on replicate specimens by the same observer in the same laboratory. Both repeatability and reproducibility are usually reported as a standard deviation. A reproducibility limit is the value below which the difference between two test results obtained under reproducibility conditions may be expected to occur with a probability of approximately 0.95 (95%).[2]

Reproducibility is determined from controlled interlaboratory test programs or a Measurement systems analysis.[3][4]

Reproducible research

The term reproducible research refers to the idea that the ultimate product of academic research is the paper along with the full computational environment used to produce the results in the paper such as the code, data, etc. that can be used to reproduce the results and create new work based on the research.[5][6][7]

Psychology has recently seen a renewal of internal concerns about irreproducible results. Researchers explained in a 2006 study that, of 249 data sets from American Psychology Association (APA) empirical articles, 73% of contacted authors did not respond with their data over a 6-month period.[8] The first author published a paper in 2012 suggesting researchers should publish data along with their works, releasing a dataset alongside as a demonstration.[9]

Reproducible research is key to new discoveries in pharmacology. A Phase I discovery will be followed by Phase II reproductions as a drug develops towards commercial production. In recent decades Phase II success has fallen from 28% to 18%. A 2011 study found that 65% of medical studies were inconsistent when re-tested, and only 6% were completely reproducible.[10]

In 2012, a survey done for Nature found that 47 out of 53 medical research papers on the subject of cancer were irreproducible.[11] John P. A. Ioannidis writes, "While currently there is unilateral emphasis on 'first' discoveries, there should be as much emphasis on replication of discoveries."[12] The Nature study was itself reproduced in the journal PLOS ONE, which confirmed that a majority of cancer researchers surveyed had been unable to reproduce a result. Attempts to reproduce studies often strained relationships with the laboratories that were first to publish.[13]

An easily repeatable scientific experiment is desirable, but it is not considered necessary to establish the scientific validity of a claim. For example, the cloning of animals is difficult to repeat, but has been reproduced by various teams working independently, and is a well established research domain. Failure to reproduce a claim does not necessarily mean that the claim is wrong.

Noteworthy irreproducible results

Hideyo Noguchi became famous for correctly identifying the bacterial agent of syphilis, but also claimed that he could culture this agent in his laboratory. Nobody else has been able to produce this latter result.

In March 1989, University of Utah chemists Stanley Pons and Martin Fleischmann reported the production of excess heat that could only be explained by a nuclear process ("cold fusion"). The report was astounding given the simplicity of the equipment: it was essentially an electrolysis cell containing heavy water and a palladium cathode which rapidly absorbed the deuterium produced during electrolysis. The news media reported on the experiments widely, and it was a front-page item on many newspapers around the world (see science by press conference). Over the next several months others tried to replicate the experiment, but were unsuccessful.

Nikola Tesla claimed as early as 1899 to have used a high frequency current to light gas-filled lamps from over 25 miles (40 km) away without using wires. In 1904 he built Wardenclyffe Tower on Long Island to demonstrate means to send and receive power without connecting wires. The facility was never fully operational and was not completed due to economic problems.[14]

See also

References

  • Turner, William (1903), History of Philosophy, Ginn and Company, Boston, MA, "Aristotle".
  • International Union of Pure and Applied Chemistry

External links

  • Reproducible Research in Computational Science
  • Guidelines for Evaluating and Expressing the Uncertainty of NIST Measurement Results; appendix D
  • Definition of reproducibility in the IUPAC Gold Book
  • Detailed article on Reproducibility
  • Reproducible Research Planet
  • ReproducibleResearch.net
  • cTuning.org - reproducible research and experimentation in computer engineering
This article was sourced from Creative Commons Attribution-ShareAlike License; additional terms may apply. World Heritage Encyclopedia content is assembled from numerous content providers, Open Access Publishing, and in compliance with The Fair Access to Science and Technology Research Act (FASTR), Wikimedia Foundation, Inc., Public Library of Science, The Encyclopedia of Life, Open Book Publishers (OBP), PubMed, U.S. National Library of Medicine, National Center for Biotechnology Information, U.S. National Library of Medicine, National Institutes of Health (NIH), U.S. Department of Health & Human Services, and USA.gov, which sources content from all federal, state, local, tribal, and territorial government publication portals (.gov, .mil, .edu). Funding for USA.gov and content contributors is made possible from the U.S. Congress, E-Government Act of 2002.
 
Crowd sourced content that is contributed to World Heritage Encyclopedia is peer reviewed and edited by our editorial staff to ensure quality scholarly research articles.
 
By using this site, you agree to the Terms of Use and Privacy Policy. World Heritage Encyclopedia™ is a registered trademark of the World Public Library Association, a non-profit organization.
 


Copyright © World Library Foundation. All rights reserved. eBooks from Project Gutenberg are sponsored by the World Library Foundation,
a 501c(4) Member's Support Non-Profit Organization, and is NOT affiliated with any governmental agency or department.