Create an extraction project

Platform provides the following ways to create a new extraction project:

• A four step Extraction wizard.
• Importing a CPK.

Create an extraction project with the Extraction wizard

The wizard procedure depends on the number of items already present in the dashboard.

1. Go to the main dashboard.

If there are no projects or corpora created

2. Select the Extraction project card.

Or:

2. Select the plus button and then Extraction project. This creation procedure is always available.

If there are other existing projects or corpora but not extraction projects

2. Select Extraction in the left menu, then Create your first project.

If there are other existing extraction projects

2. Select Extraction in the left menu, then select New Extraction project in the Create project area.

Or:

2. Select New Extraction project in the Create item area

Common preliminary steps

3. In the New Extraction project dialog enter the mandatory extraction project name in Project name, select the technology version from the Tech version drop-down menu and enter the optional description in Description.
4. Select Create.

First step: Project language

In the Project language page, select the project language for your analysis model, then select Next.

Second step: Project resources

In the Project resources page:

1. Select Create project classes to create the classes from scratch, then Next.
2. In the Create classes window, enter a class and then press Enter to add the next one, select Next when you have ended the class creation to go on.
3. The classes are then displayed in Resources. It is possible to edit them. Select Next to go on.

Or:

1. Select Import classes to import an existing classes structure in XML file.
2. Select an XML file from the file system.
3. The classes are then displayed in Resources. It is possible to edit them. Select Next to go on.

Third step: Project library

During this step you provide one of the libraries needed to train and test the ML model. More libraries can be added later.

In the Project library dialog:

1. Enter the library name in Library name (optional step).

2. Select:

   • Generic library to create a generic library.

   Or:

   • Training library to create a training library.

   Or:

   • Test library to create a test library.

3. Select Next to go on.

4. In Corpora and folders, select the source for the library. You can select an existing corpus or upload documents from the file system.

   If you choose an existing corpus:

   • Select the corpus.

     Info

     If you want to use a corpus, you can use these tools to find it:

     • Use the search bar to look for a corpus. Your search must contain at least three characters.
     • Select Show table view to view your corpora in a table format.
     • Select Show card view to view your corpora in a card format.
     • When in card view, you can sort items by selecting one of the options from the drop-down menu.
     • When in table view, you can sort items by selecting the desired column header.

     The information displayed in the existing corpora is the same displayed in the Corpus info sub-panel of the main dashboard.

     Warning

     Corpora displayed are related to the Tech version selected previously in the the New categorization project dialog.

   If you choose to upload documents:

   1. Select Upload > Add files to add the files you need. Multiple selection is allowed.
   2. In the Settings tab:
      1. Switch on Pdf document view to process with the expert.ai Extract technology and view the PDF files in order to work on them in their original format. If not switched, all the documents are converted with the Apache Tika toolkit and used as txt files.
      1. Select or deselect Enable or disable table and title detection to enable or disable table and title detection
      2. Select or deselect Enable or disable OCR extraction to enable or disable OCR extraction
      2. Switch off Autodetect language to disable the automatic language detection. Select the preferred language manually from the Select language drop-down list.
      3. Switch off Autodetect encoding to disable the automatic character encoding detection. Select manually the preferred encoding from the Select encoding drop-down list.
      4. Select Save as corpus to save your library as a corpus and type a name for it.
   3. In the Documents tab:
      1. Display the list of documents and folders to upload. They can be deleted by clicking on the X button at the right of the file name.
   4. Select Upload.

   When the upload is complete, a temporary uploaded corpus is created and made available in the window.

   Supported formats and limits

   Supported document formats are those managed by the Apache Tika toolkit. Documents are automatically converted to plain text files during upload.

   Documents are ignored if:

   • They are empty.
   • They mainly consist of nonsense words.
   • Their language is unrecognized or not supported (in case of automatic language recognition).

   • They exceed the following values:

     • 200 MB for .zip files.
     • 1 MB for .txt files.
     • 100 MB for other file types.

5. Select Next.

Info

It is also possible to upload an annotated library.

Fourth step: Summary

The last step shows the project details of the previous steps, like the project name, the project language, the resources, the tech version, and the library.

Select Open project to end the wizard process and start working on the project.

Info

To quit the wizard at any time:

1. Select Exit wizard in the upper right corner or the expert.ai icon in the upper left one.
2. In the save changes dialog you can select:
   • Cancel to quit.
   • Delete project to delete the project.
   • Save to save the project at that step and then reopen it from the main dashboard and continue with the wizard at a later time.

Create an extraction project importing a CPK

Info

It is not possible to import a CPK in the Extraction wizard.

1. Go to the main dashboard.

2. Select:

   a. The plus button , then Import CPK .

   Or:

   b. Import CPK in the Create item area.

   Or:

   c. Extraction in the left column, then Import CPK in the Create project area.

3. In the Create a new project from a CPK dialog:

   • Select Browse files to upload the CPK file from the file system .

     Warning

     Maximum CPK file size is 2GB.

   • If you selected 2.a. or 2.b., choose Extraction under Type of project.

   • Enter the mandatory extraction project name in Project name.
   • Select the technology version from the Tech version drop-down menu.
   • Enter the optional description in Description.

4. Select Create project to start the importation.

5. Select Check resources in Project resources to display them, then Next to go on or select Skip this step to directly go on.

6. Create the library as described above in Third step: Project library.

7. Select Open project in the Project summary page to end the creation process and start working on the project.

Note

In the imported CPK projects it is not allowed to change the resources. This is marked in the dashboard with a padlock.