Skip to content

Create a categorization project

Platform provides the following ways to create a new categorization project:

Create a categorization project with the Categorization wizard

The wizard procedure depends on the number of items already present in the dashboard.

  1. Go to the main dashboard.

If there are no projects or corpora created

  1. Select the Categorization project card.

Or:

  1. Select the plus button and then New Categorization Project. This creation procedure is always available.

If there are other existing projects or corpora but not categorization projects

  1. Select Categorization in the left menu, then Create your first project.

If there are other existing categorization projects

  1. Select Categorization in the left menu, then select New Categorization Project in the Create project area.

Or:

  1. Select New Categorization project in the Create item area

Common preliminary steps

  1. In the New categorization project dialog enter the mandatory categorization project name in Project name, select the technology version from the Tech version drop-down menu and enter the optional description in Description.
  2. Select Create.

First step: Project language

In the Project language page, select the project language for your analysis engine, then Next.

Second step: Project resources

In the Project resources page:

  1. Select Create project taxonomy to create the taxonomy from scratch, then Next.
  2. In the Create taxonomy window, enter a category and then press Enter to add the next one. When done, select Next.
  3. The taxonomy is then displayed in the Resources tab. It is possible to edit it. Select Next to go on.

Or:

  1. Select Import taxonomy to import an existing taxonomy in XML format.
  2. Select an XML file from the file system.
  3. The taxonomy is then displayed in the Resources tab. It is possible to edit it. Select Next to go on.

Or:

  1. Select Building magic taxonomy where related documents are grouped and automatically categorized, then select Next.
  2. Select the project library as described in Third step: Project library .
  3. In the Magic taxonomy dialog, switch Manual configuration if you want to set the number of nodes and the mode, such as Strict mode or Soft mode.

    Info

    The creation algorithm automatically suggests the documents annotations.

  4. The taxonomy is then displayed in the Resources tab. It is possible to edit it. Select Next to go directly to Fourth step: Summary .

Third step: Project library

During this step, available only for Create project taxonomy or Import taxonomy procedures, you provide one of the libraries needed to train and test the ML model. More libraries can be added later.

In the Project library dialog:

  1. Enter the library name in Library name (optional step).
  2. Select:

    • Generic library if you want to create a generic library.

    Or:

    Or:

  3. Select Next to go on.

  4. In Corpora and folders, select the source for the library. You can select an existing corpus or upload documents from the file system.

    Info

    If you want to use a corpus, you can use these tools to find it:

    • Use the search bar to look for a corpus. Your search must contain at least three characters.
    • Select Show table view to view your corpora in a table format.
    • Select Show card view to view your corpora in a card format.
    • When in card view, you can sort items by selecting one of the options from the drop-down menu.
    • When in table view, you can sort items by selecting the desired column header.

    The information displayed in the existing corpora is the same displayed in the Corpus info sub-panel of the main dashboard.

    Warning

    Corpora displayed are related to the Tech version selected previously in the the New categorization project dialog.

    If you choose to upload documents:

    1. Select Upload.

      • Select Show advanced settings:

        • If you want to disable automatic language detection: turn off Autodetect language and choose the language from the Select language drop-down list.
        • If you want to disable automatic character encoding detection: turn off Autodetect encoding and choose the encoding from the Select encoding drop-down list.
        • If you later want to save the uploaded documents as a new corpus: select Save as corpus and enter a name for it.
      • When done, select Hide advanced settings.

    2. Select Add files.

    3. Select the files to upload.
      The selected files are displayed in a list and can be deleted by clicking on the "X" button at the right of the file name.
    4. Select Upload.

      When the upload is complete, a temporary uploaded corpus is created and made available in the window.

      Supported documents formats

      Supported document formats are those managed by the Apache Tika toolkit. Documents are automatically converted to plain text files during upload.

      Documents are ignored if:

      • They are empty.
      • They mainly consist of nonsense words.
      • (In case of automatic language recognition) Their language is unrecognized or not supported.
      • They exceed the following values:

        • 200 MB for .zip files.
        • 1 MB for .txt files.
        • 100 MB for other file types.
  5. Select the temporary uploaded corpus you created by uploading documents or a pre-existing corpus.

  6. Select Next.

It is also possible to upload an annotated library.

Warning

If you decide to upload an annotated library during the creation process:

  1. In the Third step: Project library, upload a single document.
  2. After the creation process is over, select Select project library.

  3. Select Manage libraries.

  4. Follow the procedure for the upload of an annotated library and delete the previous library with a single document.

If you upload the whole library, all your annotations will be lost after the creation of the taxonomy.

Fourth step: Summary

The last step shows the project details of the previous steps, like the project name, the project language, the tech version, and the library.

Select Open project to end the wizard process and start working on the project.

Info

To quit the wizard at any time:

  1. Select Exit wizard in the upper right corner or select the expert.ai icon in the upper left one.
  2. In the save changes dialog you can select:
    • Cancel to quit.
    • Delete project to delete the project.
    • Save to save the project at that step and then reopen it from the main dashboard and continue with the wizard at a later time.

Create a categorization project importing a CPK

Note

It is not possible to import a CPK in the Categorization wizard.

  1. Go to the main dashboard.
  2. Select:

    a. The plus button , then Import CPK .

    Or:

    b. Import CPK in the Create item area.

    Or:

    c. Categorization in the left column, then Import CPK in the Create project area.

  3. In the Create a new project from a CPK dialog:

    • Select Browse files to upload the CPK file from the file system .

      Warning

      Maximum CPK file size is 2GB.

    • If you selected 2.a. or 2.b., choose Categorization under Type of project.

    • Enter the mandatory categorization project name in Project name.
    • Select the technology version from the Tech version drop-down menu.
    • Enter the optional description in Description.
  4. Select Create project to start the import.

  5. Select Check resources in Project resources to check them, then Next to go on or select Skip this step to directly go on.
  6. Create the library as described above in Third step: Project library.
  7. Select Open project in the Project summary page to end the creation process and start to work on the project.

Note

In the imported CPK projects, it is not allowed to change the taxonomy. This is marked in the dashboard with a padlock.