Create a categorization project

Platform provides the following ways to create a new categorization project:

• A four step Categorization wizard.
• Importing a CPK.

Create a categorization project with the Categorization wizard

The wizard procedure depends on the number of items already present in the dashboard.

1. Go to the main dashboard.

If there are no projects or corpora created

2. Select the Categorization project card.

Or:

2. Select the plus button and then Categorization project. This creation procedure is always available.

If there are other existing projects or corpora but not categorization projects

2. Select Categorization in the left menu, then Create your first project.

If there are other existing categorization projects

2. Select Categorization in the left menu, then select New Categorization project in the Create project area.

Or:

2. Select New Categorization project in the Create item area.

Common preliminary steps

3. In the New Categorization project dialog, enter the mandatory categorization project name in Project name, select the technology version from the Tech version drop-down menu and enter the optional description in Description.
4. Select Create.

First step: Project language

In the Project language page, select the project language for your analysis engine, then Next.

Second step: Project resources

In the Project resources page:

1. Select Create project Taxonomy to create the taxonomy from scratch, then Next.
2. In the Create Taxonomy window, enter a category and then press Enter to add the next one. When done, select Next.
3. The taxonomy is then displayed in the Resources tab. It is possible to edit it. Select Next to go on.

Or:

1. Select Import Taxonomy to import an existing taxonomy in XML format.
2. Select an XML file from the file system.
3. The taxonomy is then displayed in the Resources tab. It is possible to edit it. Select Next to go on.

Or:

1. Select Building magic Taxonomy where related documents are grouped and automatically categorized, then select Next.
2. Select the project library as described in Third step: Project library .

3. In the Magic Taxonomy dialog, switch Manual configuration if you want to set the number of nodes and the mode, such as Strict mode or Soft mode.

   Info

   The creation algorithm automatically suggests the documents annotations.

4. Select Next. The taxonomy is then displayed in the Resources tab. It is possible to edit it.

5. Select Next to go directly to the Fourth step: Summary .

Third step: Project library

During this step, available only for Create project Taxonomy or Import Taxonomy procedures, you provide one of the libraries needed to train and test the ML model. More libraries can be added later.

In the Project library dialog:

1. Enter the library name in Library name (optional step).

2. Select:

   • Generic library to create a generic library.

   Or:

   • Training library to create a training library.

   Or:

   • Test library to create a test library.

3. Select Next to go on.

4. In Corpora and folders, select the source for the library. You can select an existing corpus or upload documents from the file system.

   If you choose an existing corpus:

   • Select the corpus, then select Next.

     Info

     If you want to use a corpus, you can use these tools to find it:

     • Use the search bar to look for a corpus. Your search must contain at least three characters.
     • Select Show table view to view your corpora in a table format.
     • Select Show card view to view your corpora in a card format.
     • When in card view, you can sort items by selecting one of the options from the drop-down menu.
     • When in table view, you can sort items by selecting the desired column header.

     The information displayed in the existing corpora is the same displayed in the Corpus info sub-panel of the main dashboard.

     Warning

     Corpora displayed are related to the Tech version selected previously in the the New Categorization project dialog.

   If you choose to upload documents:

   1. Select Upload > Add files to add the files you need. Multiple selection is allowed.
   2. In the Settings tab:
      1. Switch on Pdf document view to process with the expert.ai Extract technology and view the PDF files in order to work on them in their original format. If not switched, all the documents are converted with the Apache Tika toolkit and used as txt files.
      1. Select or deselect Enable or disable table and title detection to enable or disable table and title detection.
      2. Select or deselect Enable or disable OCR extraction to enable or disable OCR extraction.
      2. Switch off Autodetect language to disable automatic language detection. Select the preferred language manually from the Select language drop-down list.
      3. Switch off Autodetect encoding to disable the automatic character encoding detection. Select manually the preferred encoding from the Select encoding drop-down list.
      4. Select Save as corpus to save your library as a corpus and type a name for it.
   3. In the Documents tab:
      1. Display the list of documents and folders to upload. They can be deleted by clicking on the X button at the right of the file name.
   4. Select Upload.

   When the upload is complete, a temporary uploaded corpus is created and made available in the window.

   Supported documents formats

   Supported document formats are those managed by the Apache Tika toolkit. Documents are automatically converted to plain text files during upload.

   Documents are ignored if:

   • They are empty.
   • They mainly consist of nonsense words.
   • Their language is unrecognized or not supported (in case of automatic language recognition).

   • They exceed the following values:

     • 200 MB for .zip files.
     • 1 MB for .txt files.
     • 100 MB for other file types.

5. Select Next.

Info

It is also possible to upload an annotated library.

Fourth step: Summary

The last step shows the project details of the previous steps, like the project name, the project language, the tech version, and the library.

Select Open project to end the wizard process and start working on the project.

Info

To quit the wizard at any time:

1. Select Exit wizard in the upper right corner or select the expert.ai icon in the upper left one.
2. In the save changes dialog you can select:
   • Cancel to quit.
   • Delete project to delete the project.
   • Save to save the project at that step and then reopen it from the main dashboard and continue with the wizard at a later time.

Create a categorization project importing a CPK

Note

It is not possible to import a CPK in the Categorization wizard.

1. Go to the main dashboard.

2. Select:

   a. The plus button , then Import CPK .

   Or:

   b. Import CPK in the Create item area.

   Or:

   c. Categorization in the left column, then Import CPK in the Create project area.

3. In the Create a new project from a CPK dialog:

   • Select Browse files to upload the CPK file from the file system .

     Warning

     Maximum CPK file size is 2GB.

   • If you selected 2.a. or 2.b., choose Categorization under Type of project.

   • Enter the mandatory categorization project name in Project name.
   • Select the technology version from the Tech version drop-down menu.
   • Enter the optional description in Description.

4. Select Create project to start the import.

5. Select Check resources in Project resources to check them, then Next to go on or select Skip this step to directly go on.
6. Create the library as described above in Third step: Project library.
7. Select Open project in the Project summary page to end the creation process and start to work on the project.

Note

In the imported CPK projects, it is not allowed to change the taxonomy. This is marked in the dashboard with a padlock.