Experiments quality

To view the quality of an experiment:

Go to the experiments dashboard.
Select the experiment from the Experiments panel.

Or:

Select last experiment Statistics from the Experiments drop-down menu,
Select the experiment from the Experiments panel.

The Statistics sub-panel—displayed by default—shows a set of statistical information about an experiment.

Information about the experiment

In the upper side tab, you can see experiment details, such as:

Experiment name
Performance date
User who performed the experiment
Engine type
Analyzed documents
Documents with recognized categories
Documents with annotations
Training library
ML Model type in case of ML Engine

Read the quality

To visually read the experiment quality measurements, such as: Precision, Recall, and F-measure, check the charts in the middle side tab.

The quality measurements are displayed in Micro Average, Macro Average, Sampled average and Weighted Average metrics.

The metrics in focus is selected in the Settings window, Experiments tab. The specific metrics icon is also displayed in the experiment card.

Analytics on resources

In the lower tab part, Micro metrics sub-tab the following items are displayed for each category:

Hits
Ann. (Number of annotations)
TP (True Positive)
FP (False Positive)
FN (False Negative)
Precision
Recall
F-measure

Sort the resources

To sort the categories according to a specific item, select the column header.

Search

To open the search bar, hover over the category and select Search .

You will see the Documents statistics tab with the filtered list of documents according to the category in focus.

Show the categories in Resources

To show the selected category in the Resources tab, hover over the category and elect Show in resources .

Show info

To show additional information about a category, such as its broader category and the annotations, hover over the category and select .

Documents quality results

Annotated documents

In the lower tab side, select the Annotated documents sub-tab.

For each document, the following items are displayed:

Document validated mark (if the document is validated)
Hits
Ann. (Number of annotations)
TP (True Positive)
FP (False Positive)
FN (False Negative)
Precision
Recall
F-measure

Sort the documents

To sort the documents according to a specific item, select the column header.

To add annotations

To add annotations to a document, hover over the document of interest and select Annotate document . Then, follow the annotation procedure.

Open a document in detail view

To open a document in detail view, hover over the document of interest and select Open document .

Check the annotations or the hits in a document

To check the annotations or the hits in a document, select the expanding icon .

Note

The annotations or the hits chips are displayed according to the following code colors:

= True Positive
= False Positive
= False Negative

Not annotated documents

In the lower tab side (C), select the Not annotated documents sub-tab.

The list shows the not annotated documents that get resulting categories from the experiments and they are displayed with a blue chip .

To annotate a document

To annotate a document, hover over the document of interest and select Annotate document and then follow the annotation procedure.

Open a document in detail view

To open a document in detail view, hover the mouse over the document of interest and select Open document .

When there, select Annotate documents to start annotating.

Filter documents with extractions

Select Only documents with extractions for positive filtering.
Double-click Only documents with extractions for negative filtering.
Select Only documents with extractions or double-click Only documents with extractions to turn off the filter.