Skip to content

Metrics policies

Platform has the following policies for calculating the overall metrics for a set of documents, that are the metrics for an experiment:

  • Micro metrics: the matches of all the documents are summed, thus producing the summations for TP, FP, FN.
  • Macro metrics: each metric is given by the average of the values ​​of the micro metrics on the individual resources (for example, macro precision is the average of the micro precision of all classes / categories).
  • Sample average metrics: each metric is given by the average of the metrics on the respective documents (excluding those with undefined metrics).
  • Weighted average metrics: each metric is given by the weighted average of the metrics on the respective documents, where the weight of each document is given by its number of annotations (as before, it is necessary to exclude the documents with the undefined metric).