Skip to content

Experiments quality

Overview

To view the quality of an experiment:

  1. Go to the experiments dashboard.

Or:

  1. From the Experiments drop-down menu, select last experiment Statistics.
  2. From the Experiments panel, select the experiment you want.

The Statistics sub-panel—displayed by default—shows a set of statistical information about a selected experiment.

Information about the experiment

On the upper side, you can see the experiment details, such as:

  • Experiment name
  • Engine type
  • Number of documents in the library
  • Analyzed documents
  • Documents with extractions
  • Documents with annotations

Edit experiment name

To edit the experiment name, hover over its name and select the pencil icon .

Delete the experiment

To delete the experiment, select Delete .

Read the quality measurements

To visually read the experiment quality measurements, such as: Precision, Recall, and F-measure, check the charts in the middle side tab.

The quality measurements are displayed in:

  • Micro Average
  • Macro Average
  • Sample average
  • Weighted Average

The metric in focus is selected in the Settings window, Experiments tab. The specific metric icon is also displayed in the experiment card.

Analytics on concepts in Micro metrics

In the lower tab part, the following items are displayed for each concept:

  • Hits
  • Ann. (Number of annotations)
  • TP (True Positive)
  • FP (False Positive)
  • FN (False Negative)
  • Precision
  • Recall
  • F-Measure

Sort the resources

To sort the concepts based on a specific item, select the related arrows beside the column header.

To open the search bar, hover over the concept and select Search . You will see the Documents statistics tab with the filtered list of documents based on the concept in focus.

Show the concept in resources

To show the selected concept in the Resources tab, hover over the concept and select Show in resources .

Show the concept info

To show the selected concept info, hover over the concept and select Information about this Concept .

In the pop-up window, the following items are displayed:

  • The broader concept (if any)
  • The preferred label
  • The alternative labels (if any)
  • The related concepts (if any)

Check document quality results

Annotated documents

The Documents with metrics sub-panel lists all the annotated documents of your project.

  • Select the expanding arrow to view all extracted concepts in the document.
  • Select the collapsing arrow to collapse all concepts.

For each document, the following items are displayed:

  • Document validated mark (if the document is validated).
  • Ext. (Number of extractions)
  • Ann. (Number of annotations)
  • TP (True Positive)
  • FP (False Positive)
  • FN (False Negative)
  • Precision
  • Recall
  • F-Measure

Sort the documents

To sort the documents based on a specific item, select the related arrows beside the column header.

Open a document and add annotations

To open a document in detail view based on a selected experiment in focus, hover over it and select Open document . The document will open in the detail view.

In the selected experiment, Experiment 15, the value mouse has ten single false positive occurrences in the document Mouse 2.txt.

What you see is a record of the document before the latest experiment was performed in comparison with the selected one.

In this view, annotation is not possible. To annotate, select Annotate documents from the toolbar beside the document name. This is what you will see:

As you can see, the latest experiment—Experiment 16— is in focus and the values of mouse are now true positives. This means that after Experiment 15 and before Experiment 16 the values mouse have been turned into true positives.

An alternative to see this view while in the experiment dashboard with an experiment in focus is:

  1. In the Documents with metrics sub-tab, hover over a document.
  2. Select Annotate document .

Filter validated documents

To filter validated documents, select Only validated documents to get the filter criteria:

  • = no filtering.
  • = only validated documents.
  • = only not validated documents.

Not annotated documents

The Not annotated documents sub-panel lists all the unannotated documents of your project.

  • Select the expanding arrow to view all possible annotations and extractions of the document.
  • Select the collapsing arrow to collapse them.

This sub-panel has two columns:

  • Document, listing the documents
  • Ext. (Extractions), the number of extractions

Sort the documents

To sort the documents based on a specific item, select the related arrows beside the column header.

To add annotations

To add annotations to a document, hover over the document of interest and select Annotate document . You'll see the detail view of the Documents tab.

Open a document in detail view and annotate it

To open a document in detail view, hover over the document of interest and select Open document . You'll see the Documents statistics sub-tab.

To annotate it, select Annotate documents .

Filter documents with extractions

Click the icon beside Only documents with extractions until it turns into one of the following forms:

  • to select the positive filter, that means only documents with extractions.
  • to select the negative filter, that means documents without extractions.
  • means no filter.

Information about models

To read information about the models, select the sub-panel Models.

Activity log

To read information about the logs, select the Activity log sub-panel.