Create a corpus

The procedures for creating a corpus depend on the number of items already present in the dashboard.

Procedures

To create a corpus:

Or:

Select the plus button and choose Corpus. This creation procedure is always available.

Or:

Select Corpora in the left menu, then select New Corpus in the Create Corpus area.

In the dialog, enter the mandatory name, select the technology version from the Tech version drop-down list, enter an optional description then Next.
Select Add files. You can upload single files from a folder or a set of zipped files.

In the Settings tab:
1. Switch on Pdf document view to process with the expert.ai Extract technology and view the PDF files in order to work on them in their original format. If not switched, all the documents are converted with the Apache Tika toolkit and used as txt files.
2. Switch off Autodetect language to disable the automatic language detection. Select the preferred language manually from the Select language drop-down list.
3. Switch off Autodetect encoding to disable the automatic character encoding detection. Select manually the preferred encoding from the Select encoding drop-down list.
In the Documents tab:
1. Display the list of documents and folders to upload. They can be deleted by clicking on the X button at the right of the file name.
Select Create.

Note

Watch the Background tasks to check if the corpus is ready and properly created.

Supported formats and limits

Supported document formats are those managed by the Apache Tika toolkit. Documents are automatically converted to plain text files during upload.

Documents are ignored if:

They are empty.
They mainly consist of nonsense words.
Their language is unrecognized or not supported (in case of automatic language recognition).
They exceed the following values:
- 200 MB for .zip files.
- 1 MB for .txt files.
- 100 MB for other file types.

To access the corpus:

Or:

If the number of uploaded documents doesn't immediately correspond to the right amount, refresh the page.