Vectors/metadata - Revision history

Oe: Oe moved page Repository catalogue fields to Vectors/metadata

2019-12-28T21:35:43Z

Oe moved page Repository catalogue fields to Vectors/metadata

Andreku: /* Models */

2019-12-23T18:53:37Z

‎Models

Andreku at 00:24, 23 December 2019

2019-12-23T00:24:50Z

Andreku: /* Corpora */

2019-12-23T00:15:44Z

‎Corpora

Andreku at 00:15, 23 December 2019

2019-12-23T00:15:13Z

Andreku: /* Algorithms */

2019-12-23T00:02:55Z

‎Algorithms

Andreku: /* Algorithms */

2019-12-23T00:02:05Z

‎Algorithms

Andreku: Created page with "This page describes the fields in the [http://vectors.nlpl.eu/repository/ NLPL vector repository] catalogue. The catalogue itself is a `JSON` file, for example, `20...."`

2019-12-23T00:01:47Z Created page with "This page describes the fields in the [http://vectors.nlpl.eu/repository/ NLPL vector repository] catalogue. The catalogue itself is a <tt>JSON</tt> file, for example, <tt>20...." New page This page describes the fields in the [http://vectors.nlpl.eu/repository/ NLPL vector repository] catalogue. The catalogue itself is a <tt>JSON</tt> file, for example, <tt>20.json</tt> for the version 2.0 of the Repository. All field except "id" are optional. == Algorithms == - "command": exact command which was run to train the model, for example, <tt>word2vec -min-count 10 -size 100 -window 10 -negative 5 -iter 2 -threads 16 -cbow 0 -binary 0</tt> - "id": NLPL identifier of the algorithm (an integer) - "name": human-readable name of the algorithm, for example, <tt>Gensim Continuous Skipgram</tt> - "tool": tool used to train models with this algorithm, for example, <tt>Gensim</tt> - "url": webpage of the tool used, for example, <tt>https://github.com/RaRe-Technologies/gensim</tt> - "version": version of the tool used, for example, <tt>3.6</tt> == Corpora == == Models ==

@@ Line 37: / Line 37: @@
 * "'''creators'''": a list of persons who  trained the model; each person is described as a dictionary with the <tt>email</tt> and <tt>name</tt> fields
 * "'''dimensions'''": dimensionality of the word representations in the model (integer),
 * "'''handle'''": persistent NLPL handler of the model, for example, <tt>"http://vectors.nlpl.eu/repository/20/1.zip"</tt>
 * "'''id'''": persistent NLPL identifier of the model (integer)

← Older revision		Revision as of 00:24, 23 December 2019
Line 31:		Line 31:

	== Models ==		== Models ==
		+	This section lists the distributional models themselves.
		+	* "'''algorithm'''": NLPL identifier of the training algorithm used (integer)
		+	* "'''contents'''": a list of files stored in the model ZIP archive; each file is described as a dictionary with the <tt>filename</tt> and <tt>format</tt> fields
		+	* "'''corpus'''": a list of integer NLPL identifiers of the training corpora, for example, <tt>[0, 3]</tt>
		+	* "'''creators'''": a list of persons who trained the model; each person is described as a dictionary with the <tt>email</tt> and <tt>name</tt> fields
		+	* "'''dimensions'''": dimensionality of the word representations in the model (integer),
		+	* "'''handle'''": persistent NLPL handler of the model, for example, <tt>"http://vectors.nlpl.eu/repository/20/1.zip"</tt>
		+	* "'''id'''": persistent NLPL identifier of the model (integer)
		+	* "'''iterations'''": how many epochs (passes over the corpus) were made during training (integer),
		+	* "'''vocabulary size'''": the number of words in the model vocabulary, if applicable (integer)
		+	* "'''window'''": context window size used during training, if applicable (integer)

@@ Line 28: / Line 28: @@
 * "'''tokens'''": number of word tokens in the corpus (integer)
 * "'''tool'''": link to the tool used to generate the corpus, if any (e.g., <tt>"https://github.com/RaRe-Technologies/gensim/blob/master/gensim/scripts/segment_wiki.py"</tt>); otherwise, <tt>null</tt>
-* "'''url'''": link to the corpus, for example, <tt>null</tt>"https://catalog.ldc.upenn.edu/LDC2011T07"</tt>
+* "'''url'''": link to the corpus, for example, <tt>"https://catalog.ldc.upenn.edu/LDC2011T07"</tt>
 == Models ==

@@ Line 1: / Line 1: @@
 This page describes the fields in the [http://vectors.nlpl.eu/repository/ NLPL vector repository] catalogue. The catalogue itself is a <tt>JSON</tt> file, for example, <tt>20.json</tt> for the version 2.0 of the Repository.
-All field except "id" are optional.
+All field except <tt>"id"</tt> are optional.
 == Algorithms ==
 * "'''command'''": exact command which was run to train the model, for example, <tt>"word2vec -min-count 10 -size 100 -window 10 -negative 5 -iter 2 -threads 16 -cbow 0 -binary 0"</tt>
-* "'''id'''": NLPL identifier of the algorithm (an integer)
+* "'''id'''": NLPL identifier of the algorithm (integer)
 * "'''name'''": human-readable name of the algorithm, for example, <tt>"Gensim Continuous Skipgram"</tt>
 * "'''tool'''": tool used to train models with this algorithm, for example, <tt>"Gensim"</tt>
-* "'''url'''": webpage of the tool used, for example, <tt>"https://github.com/RaRe-Technologies/gensim"</tt>
+* "'''url'''": link to the tool used, for example, <tt>"https://github.com/RaRe-Technologies/gensim"</tt>
 * "'''version'''": version of the tool used, for example, <tt>"3.6"</tt>
 == Corpora ==
+* "'''NER'''": whether multi-word named entities were detected and merged into one token (Boolean)
 == Models ==

@@ Line 4: / Line 4: @@
 == Algorithms ==
-* "command": exact command which was run to train the model, for example, <tt>word2vec -min-count 10 -size 100 -window 10 -negative 5 -iter 2 -threads 16 -cbow 0 -binary 0</tt>
+* "'''command'''": exact command which was run to train the model, for example, <tt>"word2vec -min-count 10 -size 100 -window 10 -negative 5 -iter 2 -threads 16 -cbow 0 -binary 0"</tt>
-* "id": NLPL identifier of the algorithm (an integer)
+* "'''id'''": NLPL identifier of the algorithm (an integer)
-* "name": human-readable name of the algorithm, for example, <tt>Gensim Continuous Skipgram</tt>
+* "'''name'''": human-readable name of the algorithm, for example, <tt>"Gensim Continuous Skipgram"</tt>
-* "tool": tool used to train models with this algorithm, for example, <tt>Gensim</tt>
+* "'''tool'''": tool used to train models with this algorithm, for example, <tt>"Gensim"</tt>
-* "url": webpage of the tool used, for example, <tt>https://github.com/RaRe-Technologies/gensim</tt>
+* "'''url'''": webpage of the tool used, for example, <tt>"https://github.com/RaRe-Technologies/gensim"</tt>
-* "version": version of the tool used, for example, <tt>3.6</tt>
+* "'''version'''": version of the tool used, for example, <tt>"3.6"</tt>
 == Corpora ==

← Older revision	Revision as of 21:35, 28 December 2019
(No difference)

Vectors/metadata - Revision history

Oe: Oe moved page Repository catalogue fields to Vectors/metadata

Andreku: /* Models */

Andreku at 00:24, 23 December 2019

Andreku: /* Corpora */

Andreku at 00:15, 23 December 2019

Andreku: /* Algorithms */

Andreku: /* Algorithms */

Andreku: Created page with "This page describes the fields in the [http://vectors.nlpl.eu/repository/ NLPL vector repository] catalogue. The catalogue itself is a JSON file, for example, 20...."

Andreku: Created page with "This page describes the fields in the [http://vectors.nlpl.eu/repository/ NLPL vector repository] catalogue. The catalogue itself is a `JSON` file, for example, `20...."`