aboutsummaryrefslogtreecommitdiff
diff options
context:
space:
mode:
authorMohammad Akhlaghi <mohammad@akhlaghi.org>2020-04-15 21:45:47 +0100
committerMohammad Akhlaghi <mohammad@akhlaghi.org>2020-04-15 21:45:47 +0100
commit4f834ecbcd03de1c00785882cab96b70b9c69c6a (patch)
treeb67e175eaf127542f73bf4eaed961aa706f7f785
parent10fa40e8550c7a699c9d4a4382b72843ed6a1cdf (diff)
A single word correction
In the introduction I had mistakenly put "metadata" instead of "workflow", its corrected with this commit.
-rw-r--r--paper.tex2
1 files changed, 1 insertions, 1 deletions
diff --git a/paper.tex b/paper.tex
index c4d1cf4..abedeb5 100644
--- a/paper.tex
+++ b/paper.tex
@@ -115,7 +115,7 @@ The status in other fields, where workflows are not commonly shared, is highly l
Nature is already a black box which we are trying hard to unlock.
Not being able to experiment on the methods of other researchers is a self-imposed back box over it.
-The completeness of a paper's published metadata (usually within the ``Methods'' section) can be measured by the ability to reproduce the result without needing to contact the authors.
+The completeness of a paper's published workflow (usually within the ``Methods'' section) can be measured by the ability to reproduce the result without needing to contact the authors.
Several studies have attempted to answer this with different levels of detail. For example, \citet{allen18} found that roughly half of the papers in astrophysics do not even mention the names of any analysis software, while \citet{menke20} found this fraction has greatly improved in medical/biological field and is currently above $80\%$.
\citet{ioannidis2009} attempted to reproduce 18 published results by two independent groups, but fully succeeded in only 2 of them and partially in 6.
\citet{chang15} attempted to reproduce 67 papers in well-regarded journals in Economics with data and code: only 22 could be reproduced without contacting authors, and more than half could not be replicated at all. \tonote{DVG: even after contacting the authors?}