Translation/mttools - Revision history

Yvessche at 11:55, 21 October 2022

2022-10-21T11:55:28Z

Yvessche: /* Using the mttools module */

2019-12-18T14:22:25Z

‎Using the mttools module

Yvessche: /* Using the mttools module */

2019-12-18T14:22:00Z

‎Using the mttools module

Yvessche at 13:51, 3 February 2019

2019-02-03T13:51:43Z

Yvessche: Created page with "= Using the mttools module =

Log into Taito or Abel
Activate the NLPL software repository and load the module:
```
module use -a /proj*/nlpl/software/modul..."
```

2019-02-03T13:51:19Z

Created page with "= Using the mttools module = <ul> <li>Log into Taito or Abel</li> <li>Activate the NLPL software repository and load the module: <pre>module use -a /proj*/nlpl/software/modul..."

New page

= Using the mttools module =

<ul>
<li>Log into Taito or Abel</li>
<li>Activate the NLPL software repository and load the module:
<pre>module use -a /proj*/nlpl/software/modulefiles/
module load nlpl-mttools</pre>
</li>
<li>Module-specific help is available by typing:
<pre>module help nlpl-mttools</pre>
</li>
</ul>

The following scripts are part of this module:
<ul>
<li>'''moses-scripts'''</li>
<ul>
<li>Tokenization, casing, corpus cleaning and evaluation scripts from Moses</li>
<li>Source: https://github.com/moses-smt/mosesdecoder (scripts directory)</li>
<li>Installed revision: 413ba6b</li>
<li>The subfolders <code>generic</code>, <code>recaser</code>, <code>tokenizer</code>, <code>training</code> are in PATH</li>
</ul>
<li>'''sacremoses'''</li>
<ul>
<li>Python port of Moses tokenizer and truecaser</li>
<li>Source: https://github.com/alvations/sacremoses</li>
<li>Installed version: 0.0.5</li>
</ul>
<li>'''subword-nmt'''</li>
<ul>
<li>Unsupervised Word Segmentation (a.k.a. Byte Pair Encoding) for Machine Translation and Text Generation</li>
<li>Source: https://github.com/rsennrich/subword-nmt</li>
<li>Installed version: 0.3.6</li>
<li>The <code>subword-nmt</code> executable is in PATH</li>
</ul>
<li>'''sentencepiece'''</li>
<ul>
<li>Unsupervised text tokenizer for Neural Network-based text generation</li>
<li>Source: https://github.com/google/sentencepiece</li>
<li>Installed version: 0.1.6</li>
<li>The <code>spm_*</code> executables are in PATH</li>
</ul>
<li>'''sacreBLEU'''</li>
<ul>
<li>Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons</li>
<li>Source: https://github.com/mjpost/sacreBLEU</li>
<li>Installed version: 1.2.12</li>
<li>The <code>sacrebleu</code> executable is in PATH</li>
</ul>
<li>'''scoring'''</li>
<ul>
<li>Script that makes it easy to score machine translation output using NIST's BLEU and NIST, TER, and METEOR, by Ken Heafield</li>
<li>Source: https://kheafield.com/code/scoring.tar.gz</li>
<li>Installed version: Sept 19, 2012</li>
<li>The <code>score.rb</code> script is in PATH</li>
</ul>
</li>
</ul>

'''Contact:'''
Yves Scherrer, University of Helsinki, firstname.lastname@helsinki.fi

@@ Line 58: / Line 58: @@
 <ul>
 <li>Compare the output of multiple systems for language generation, including machine translation, summarization, dialog response generation. Computes common evaluation scores and runs analyses to find salient differences between the systems.</li>
-<li>To run METEOR, consult the help <code>module spider nlpl-mttools</code> for the exact path.</li>
+<li>To run METEOR, consult the module-specific help page for the exact path.</li>
 <li>Source: https://github.com/neulab/compare-mt</li>
 <li>Installed version: 0.2.7</li>

← Older revision		Revision as of 13:51, 3 February 2019
Line 1:		Line 1:
−	= Using the mttools module =	+	== Using the mttools module ==

	<ul>		<ul>

@@ Line 8: / Line 8: @@
 </li>
 <li>Module-specific help is available by typing:
-<pre>module help nlpl-mttools/20191218</pre>
+<pre>module help nlpl-mttools</pre>
 </li>
 </ul>
@@ Line 18: / Line 18: @@
 <li>Tokenization, casing, corpus cleaning and evaluation scripts from Moses</li>
 <li>Source: https://github.com/moses-smt/mosesdecoder (scripts directory)</li>
-<li>Installed revision: a89691f</li>
+<li>Installed revision: 3990724</li>
 <li>The subfolders <code>generic</code>, <code>recaser</code>, <code>tokenizer</code>, <code>training</code> are in PATH</li>
 </ul>
@@ Line 31: / Line 31: @@
 <li>Unsupervised Word Segmentation (a.k.a. Byte Pair Encoding) for Machine Translation and Text Generation</li>
 <li>Source: https://github.com/rsennrich/subword-nmt</li>
-<li>Installed version: 0.3.7</li>
+<li>Installed version: 0.3.8</li>
 <li>The <code>subword-nmt</code> executable is in PATH</li>
 </ul>
@@ Line 38: / Line 38: @@
 <li>Unsupervised text tokenizer for Neural Network-based text generation</li>
 <li>Source: https://github.com/google/sentencepiece</li>
-<li>Installed version: 0.1.85</li>
+<li>Installed version:  0.1.97</li>
 <li>The <code>spm_*</code> executables are in PATH</li>
 </ul>
@@ Line 45: / Line 45: @@
 <li>Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons</li>
 <li>Source: https://github.com/mjpost/sacreBLEU</li>
-<li>Installed version: 1.4.3</li>
+<li>Installed version: 2.2.1</li>
 <li>The <code>sacrebleu</code> executable is in PATH</li>
 </ul>
@@ Line 60: / Line 60: @@
 <li>To run METEOR, consult the module-specific help page for the exact path.</li>
 <li>Source: https://github.com/neulab/compare-mt</li>
-<li>Installed version: 0.2.7</li>
+<li>Installed version: 0.2.10</li>
 <li>The compare-mt executable is in PATH</li>
 </ul>

Translation/mttools - Revision history

Yvessche at 11:55, 21 October 2022

Yvessche: /* Using the mttools module */

Yvessche: /* Using the mttools module */

Yvessche at 13:51, 3 February 2019

Yvessche: Created page with "= Using the mttools module = Log into Taito or Abel Activate the NLPL software repository and load the module: module use -a /proj*/nlpl/software/modul..."

Yvessche: Created page with "= Using the mttools module =

Log into Taito or Abel

Activate the NLPL software repository and load the module:
module use -a /proj*/nlpl/software/modul..."