Experimental studies are prevalent in Evolutionary Computation (EC), and concerns about the reproducibility and replicability of such studies have increased in recent times, reflecting similar concerns in other scientific fields. In this article, we suggest a classification of different types of reproducibility that refines the badge system of the Association of Computing Machinery (ACM) adopted by TELO. We discuss, within the context of EC, the different types of reproducibility as well as the concepts of artifact and measurement, which are crucial for claiming reproducibility. We identify cultural and technical obstacles to reproducibility in the EC field. Finally, we provide guidelines and suggest tools that may help to overcome some of these reproducibility obstacles.
翻译:实验性研究在进化计算(EC)中很普遍,对此类研究的可复制性和可复制性的关切近年来有所增加,反映了其他科学领域的类似关切。在本条中,我们建议对不同类型的可复制性进行分类,以完善TELO通过的计算机机械协会(ACM)的徽章制度。我们在EC范围内讨论不同类型的可复制性以及对于要求可复制性至关重要的文物和测量概念。我们查明了妨碍在EC领域再复制的文化和技术障碍。最后,我们提供了指导方针和建议工具,可能有助于克服其中一些可复制性障碍。