Difference between revisions of "Translation/home"

From Nordic Language Processing Laboratory
Jump to: navigation, search
(Created page with "= Background = An experimentation environment for Statistical and Neural Machine Translations (SMT and NMT) is maintained for NLPL under the coordination of the University of...")
 
(Background)
Line 4: Line 4:
 
is maintained for NLPL under the coordination of the University of Helsinki (UoH).
 
is maintained for NLPL under the coordination of the University of Helsinki (UoH).
 
Initially, the software and data are commissioned on the Finnish Taito supercluster.
 
Initially, the software and data are commissioned on the Finnish Taito supercluster.
 +
 +
'''Current status (11/2017):'''
 +
 +
* SMT pipeline (Moses + various word alignment tools) installed on Taito
 +
* Abel installation pending write permission on module directories
 +
 +
'''Coming up (Goal: 12/2017)'''
 +
 +
* Moses version 4.0
 +
* NMT toolkits
 +
* Datasets
 +
 +
= Using the Moses module =
 +
 +
* Log into Taito
 +
* Activate the NLPL module repository:
 +
module use -a /proj/nlpl/software/modulefiles/
 +
* Load the most recent version of the Moses module:
 +
module load moses
 +
* Start using Moses, e.g. using the tutorial at http://statmt.org/moses/ <br />
 +
For word alignment, you can use GIZA++, Mgiza and fast_align. The word alignment tools efmaral and eflomal are part of a separate module.
 +
* If you need to specify absolute paths in your scripts, you can find them on the help page of the module:
 +
module help moses
 +
 +
'''Contact:'''
 +
Yves Scherrer, University of Helsinki, firstname.lastname@helsinki.fi

Revision as of 12:30, 31 October 2017

Background

An experimentation environment for Statistical and Neural Machine Translations (SMT and NMT) is maintained for NLPL under the coordination of the University of Helsinki (UoH). Initially, the software and data are commissioned on the Finnish Taito supercluster.

Current status (11/2017):

  • SMT pipeline (Moses + various word alignment tools) installed on Taito
  • Abel installation pending write permission on module directories

Coming up (Goal: 12/2017)

  • Moses version 4.0
  • NMT toolkits
  • Datasets

Using the Moses module

  • Log into Taito
  • Activate the NLPL module repository:
module use -a /proj/nlpl/software/modulefiles/
  • Load the most recent version of the Moses module:
module load moses

For word alignment, you can use GIZA++, Mgiza and fast_align. The word alignment tools efmaral and eflomal are part of a separate module.

  • If you need to specify absolute paths in your scripts, you can find them on the help page of the module:
module help moses

Contact: Yves Scherrer, University of Helsinki, firstname.lastname@helsinki.fi