What is it about?
An extension to the open benchmark framework proposed by opencollbench. The extension makes it possible to run unknown algorithms proposed by others without putting the system at risk and, at the same time, keep the results comparable as intended by the original framework
Featured Image
Photo by Ferenc Almasi on Unsplash
Why is it important?
The replication crisis has become an issue in the scientific community. Results are often not reproducible due to missing codes/data, missing instructions, or incompatible hardware/software.
Perspectives
I hope this article will push the idea for the open benchmark to make the results of the proposed authors reproducible and comparable with others.
Toni Tan
University of Bremen
Read the Original
This page is a summary of: A Framework for Safe Execution of User-Uploaded Algorithms, November 2022, ACM (Association for Computing Machinery),
DOI: 10.1145/3564533.3564560.
You can read the full text:
Resources
Contributors
The following have contributed to this page
