Publication
On Reproducible Implementations in Unsupervised Concept Drift Detection Algorithms Research
Daniel Lukats; Frederic Theodor Stahl
In: Artificial Intelligence XL - SGAI 2023, International Conference on Innovative Techniques and Applications of Artificial Intelligence. SGAI International Conference on Innovative Techniques and Applications of Artificial Intelligence (AI-2023), December 12-14, Cambridge, United Kingdom, Pages 204-209, Lecture Notes in Computer Science (LNCS, volume 14381), Vol. 14381, Springer Nature Switzerland AG, Basel, 11/2023.
Abstract
In order to create reproducible experimentation and algorithms in machine learning and data mining research, reproducible descriptions of the algorithms are needed. These can be in the form of source code, pseudo code and prose. Efforts in academia commonly focus on accessibility of source code. Based on an internal study reproducing unsupervised concept drift detectors, this work argues that a publication’s content is equally important and highlights common issues affecting attempts at implementing unsupervised concept drift detectors. These include major issues prohibiting implementation entirely, as well as minor issues, which demand increased effort from the developer. The paper proposes the use of a checklist as a consistent tool to ensure better quality and reproducible publications of algorithms. The issues highlighted in this work could mark a starting point, although future work is required to ensure representation of more diverse areas of research in artificial intelligence.