Reproducibility of Computational Workflows in Applied Research

Abstract

A workflow that runs once on the machine that produced it is not a result. We examine what a reproducible computational pipeline requires in practice - pinned environments, addressable inputs, and a record of every transformation - and report what happened when we attempted to re-execute a sample of published analyses.