diff options
| -rw-r--r-- | paper.tex | 8 |
1 files changed, 4 insertions, 4 deletions
@@ -53,18 +53,18 @@ %% Abstract % max 250 words for CiSE {\noindent\mpregular %% CONTEXT - Many reproducible workflow solutions have been proposed over the recent decades. - Most use the high-level technologies that were popular when they were created, providing an immediate solution which is unlikely to be sustainable in the long term. + Many reproducible workflow solutions have been proposed over recent decades. + Most use the high-level technologies that were popular when they were created, providing an immediate solution that is unlikely to be sustainable in the long term. Decades later, scientists lack the resources to rewrite their projects, while still being accountable for their results. This creates generational gaps, which, together with technological obsolescence, impede reproducibility and building upon previous work. %% AIM We aim to introduce a set of criteria to address this problem and to demonstrate their practicality. %% METHOD - The criteria have been tested in several research publications and can be summarized as: completeness (no dependency beyond a POSIX-compatible operating system, no administrator privileges, no network connection and storage primarily in plain-text); modular design; linking analysis with narrative, temporal provenance; scalability; and free-and-open-source software. + The criteria have been tested in several research publications and can be summarized as: completeness (no dependency beyond a POSIX-compatible operating system, no administrator privileges, no network connection and storage primarily in plain-text); modular design; linking analysis with narrative; temporal provenance; scalability; and free-and-open-source software. %% RESULTS Through an implementation, called "Maneage" (managing+lineage), we find that storing the project in machine-actionable and human-readable plain-text, enables version-control, cheap archiving, automatic parsing to extract data provenance, and peer-reviewable verification. Furthermore, we show that these criteria are not limited to long-term reproducibility but also provide immediate, fast short-term reproducibility. - %%CONCLUSION + %% CONCLUSION We conclude that requiring longevity from solutions is realistic. We discuss the benefits of these criteria for scientific progress. |