Manage annotations

Overview

Annotating a document means tagging it with one or more categories included in the taxonomy.

This action is critical, in fact it "teaches" the categorization models to "learn" from these examples and therefore to give the models the ability to "predict" similar categorizations.

Annotations should be done for all the information resources before generating the categorization model, according to the principle: "no annotations, no categorizations".

Annotations should also be done in the set of test documents, especially after experiments that return resulting categories, because they are necessary for a measurement of the categorization quality, that is, if the model has actually learned to categorize.

You can manage annotations in the Documents tab.

The Main topics strip, at the top of the document in the detail view, can be a hint for proper annotations.

Warning

The annotation features are disabled in documents in a language other than the one selected for the project.

Annotate a document

Annotating a document means to manually select a category for a text. The selected category is visually represented by an indigo chip . It is an operation initially performed in the training library, but it is also important for the test library.

After an annotation or a change, an icon suggests a page refresh.

Note

A colored dot beside the category in the Taxonomy panel in the list view represents the population count.

= Less than 6 documents annotated for the category.
= Between 6 and 20 documents annotated for the category.
No dots = more than 20 annotations

Annotate a document in the list view

Select or hover over the document preview.
Select Add category or Add category if the preview document is selected.
Enter the category name, then press Enter.

Info

A suggestion is displayed if the first two chars you are entering are included in a taxonomy category and an alert if they are not included.

Tip

Use the Taxonomy panel on the right side to check if a category is in the taxonomy. You can also search for it using the search bar placed above the taxonomy itself.

Or:

Select the documents you want to annotate, multiple selections with CTRL+CLICK and SHIFT+CLICK are allowed.
Drag the documents in the desired category displayed in the Taxonomy panel on the right side or select Annotate documents (add-cat-v.png) in the toolbar and enter the category in Annotate documents.

Tip

If you think that the displayed text is not enough to decide the category of the annotation, select show more or switch to the detail view.

Annotate in immersive view or in Pdf document view

Select Add category
Enter the category name, then press Enter.

Or:

Drag a category from the Taxonomy panel into the text.

Annotate a document in the detail view

Select a document from the left panel list or consider the opened one.
Select Add category .
Enter the category name, then press Enter.

Or:

Drag a category from the Taxonomy panel into the text.

After manual annotations, the Ann annotation counter displays the annotation count.

Annotate suggestions coming from the Building magic Taxonomy procedure

If you create the taxonomy with the Building magic Taxonomy procedure, the documents have annotations suggestions displayed with a dashed outline.

To find suggestions for a category, enter $SUG and the category name in the search bar .
To hide the suggestions, in the list view, select Hide suggestions .
To show suggestions, in the list view, select Show suggestions .
To annotate the document categories, the procedure is the same as already described, but the chip visualization is different .

Annotate resulting categories

Annotating categories in a document means confirming or rejecting categories resulting from an experiment, or even change the already annotated ones. This is an operation that is performed generally in the test library and after running an experiment.

Suggested resulting categories are represented by a blue chip:

In detail view, the category counter Cat shows the number of resulting categories. The resulting categories visualization depends on the used engine type in the experiment.

With AutoML Categorization:

With Explainable Categorization or CPK:

In this case, in addition to the category, the frequency and the hits number that triggered the category are displayed.

Select the chip to check the score and display the annotation bar.

Select the hits number to highlight the hits that triggered the category in the text.

To annotate a category, in list and detail view:

Select the category chip.
Select Annotate .

If you annotate resulting categories, the chips switch to the green color that represents the true positive TP.

Automatically the other possible returned categories are turned into orange chips that represent false positives FP. It is possible to annotate them too if desired.

The annotation counter Ann is then updated accordingly.

Annotate all the categories in the detail view

To annotate all the categories of the document in the detail view, select Annotate all categories .

Annotate suggestions coming from the Building magic Taxonomy procedure in the Resources tab

Select Show suggested documents
Select Expand to expand the Suggested Annotations Documents panel.
Click the suggestion, a widget is displayed.
Select Annotate.

Remove an annotation or a category

To remove an annotation or a category in list or detail view:

Select the annotation.
Select Remove .

Remove all the categories in detail view

In detail view, if you want to remove all the categories from a document, select Remove all categories .

Replace an annotation

To replace an annotation:

Select the annotation.
Select Replace .
Enter the new category name, then press Enter.

Show the resources for a specific annotation or category

To show the resources for a specific annotation or category:

Select the annotation.
Select Show resources .

The Resources tab displays the category in the taxonomy.

Show the overall annotations for that specific annotation category

To show the overall annotations for that specific annotation category:

Select the annotation.
Select Show info .