Evaluating the Evaluation of Process Matching Techniques

Tom Thaler, Philip Hake, Peter Fettke, Peter Loos

In: Leena Suhl , Dennis Kundisch (Hrsg.). Tagungsband der Multikonferenz Wirtschaftsinformatik. Multikonferenz Wirtschaftsinformatik (MKWI-14) February 26-28 Paderborn Germany Universität Paderborn 2/2014.


The matching of different process models and their nodes plays an important role, as shown in the manifold matching techniques developed during the last years. A well-established approach for the determination of those techniques’ quality is the consideration of precision and recall values related to a reference matching. Nevertheless, it is remarkable that it is not clear, what such a reference matching should be and how to reach a general acceptance. As developing a reference matching requires the decision and a consensus on what a matching should represent, we conceptualize that task as a decision problem, which can be well-structured or even ill-structured. The paper evaluates the evaluation of process matching techniques by theoretical argumentations and in terms of inquiring the process of reference matching development. Based on the results, the authors propose some guidelines containing the three phases idea, definition and criteria supporting that task.

Deutsches Forschungszentrum für Künstliche Intelligenz
German Research Center for Artificial Intelligence