Table of Contents

Conformance and Evaluation

Conformance analysis and Process model evaluation have many things in common. The main difference is that, usually, in conformance analysis on model is given and the match should be assessed, while Process model evaluation accounts for the fact that many models are possible with the same, or very similar, behavior (“Which one is the best?”).

Conformance Analysis

Conformance analysis requires, in addition to an event log, some a-priori model. This model may be handcrafted or obtained through process discovery. Whatever its source, ProM provides various ways of checking whether reality conforms to such a model. For example, there may be a process model indicating that purchase orders of more than one million Euro require two checks. Another example is the checking of the so-called “four-eyes principle”. Conformance analysis may be used to detect deviations, to locate and explain these deviations, and to measure the severity of these deviations.

Process Model Evaluation

To compare the results obtained from different process discovery algorithms, or to simply find out how well the discovered model captures the observed behavior (how many cases are actually covered etc.), evaluation techniques are needed.

Other Kinds of Comparison