Skip to content

Experiments quality

Overview

To view the quality of an experiment:

  1. Go to the experiments dashboard.
  2. Select the experiment from the Experiments panel.

Or:

  1. Select Statistics from the Experiments drop-down menu,
  2. Select the experiment from the Experiments panel.

The Statistics sub-panel—displayed by default—shows a set of statistical information about an experiment.

Information about the experiment

In the upper side tab you can see the experiment details, such as:

  • Experiment name
  • Engine type
  • Performance date
  • User who performed the experiment
  • Analyzed documents
  • Documents with extractions
  • Documents with annotations
  • Training library
  • ML Model type in case of ML Engine
  • Matching strategy

Read the quality

The quality measurements are displayed in Micro Average, Macro Average, Sample Average and Weighted Average metrics.

The metrics in focus is selected in the Settings window, Experiments tab. The specific metrics icon is also displayed in the experiment card.

Analytics on classes in Micro metrics

In the lower tab side, for each Class, the following items are displayed in the Micro metrics sub-tab:

  • Ext. (Number of extractions)
  • Ann. (Number of annotations)
  • TP (True Positive)
  • FP (False Positive)
  • FN (False Negative)
  • Precision
  • Recall
  • F-measure

Sort the classes

To sort the classes according to a specific item, select the column header.

Check the top and worst extractions of a class

To check the top and worst extractions of a specific class, select the related expanding icon .

The orange line represents the number of documents with extractions of a value, while the violet one the number of documents with annotations of a value.

To open the search bar, hover over the class and select Search.

You will see the Documents statistics tab with the filtered list of documents according to the concept in focus.

Show the classes in resources

To show a selected class in the Resources tab, select Show in resources.

Check the document with metrics

To check the documents quality results, select the Document with metrics sub-tab in the lower tab side.

For each document, the following items are displayed:

  • Document validated mark (if the document is validated)
  • Ext. (Number of extractions)
  • Ann. (Number of annotations)
  • TP (True Positive)
  • FP (False Positive)
  • FN (False Negative)
  • Precision
  • Recall
  • F-measure

View and hide the annotated items

To view the annotated items for a document, select the expanding icon .

Sort the documents

To sort the documents according to an item, select the column header.

Add annotations

To add annotations to a document, hover over the document of interest and select Annotate document .

Then, follow the annotation procedure.

Open a document in detail view

To open a document in detail view, hove rover the document of interest and select Open document .

When there, select Annotate documents to start annotating.

Check the not annotated documents

To check the not annotated documents, select the Not annotated documents sub-tab in the lower tab side.

For each document the extractions counts are displayed.

View and hide the annotated items

To view the annotated items for a document, select the expanding icon .

Sort the documents

To sort the documents according to an item, select the column header.

Add annotations

To add annotations to a document, hover over the document of interest and select Annotate document .

Then, follow the annotation procedure.

Open a document in detail view

To open a document in detail view, hover over the document of interest and select Open document .

While in there, select Annotate documents to start annotating the document in the detail view of the Documents tab.

Filter documents with extractions

  • Select Only documents with extractions for positive filtering.
  • Double-click Only documents with extractions for negative filtering.
  • Select Only documents with extractions or double-click Only documents with extractions to turn off the filter.

Delete the experiment

To delete the experiment, select Delete .