OPUS is a collection of open parallel corpora in many languages. It provides bilingually aligned data sets, interfaces, tools and more. The data sets are available in various common formats and are provided for download and for use within the NLPL infrastructure. The service is hosted at CSC in Finland and the core of the data is also available from sigma2.
For instructions on how to access the data and use the tools, check:
- Information for NLPL Users
More detailed information can be found on the OPUS Wiki:
- Information about the OPUS API for finding resources
- Information about data formats
- Information about tools
- Information about on-line interfaces
- Information about word alignment and the alignment lexicon
Contact: Jörg Tiedemann via e-mail - firstname.lastname at helsinki.fi (first name without dots)
The OPUS corpus is now hosted at CSC, the national scientific infrastructure provider of Finland and the resources are directly available for users of their services. The OPUS server runs in that environment but the data sets and tools are also directly available from the puhti shell. The core data is also available on the Norwegian cluster saga provided by sigma2.
If you have access to those systems then you will be able to access the data from the file system:
on puhti: /projappl/nlpl/data/OPUS/ on saga: /projects/nlpl/data/OPUS/ (only raw XML data)
On both systems, you can also use tools that are packaged for working with the data (and other NLPL related activities). The basic tools for working with OPUS data can be loaded with the module nlpl-opus:
- Activate the NLPL module repository:
module use -a /projappl/nlpl/software/modules/etc # Puhti module use -a /cluster/shared/nlpl/software/modules/etc # Saga
- Load the OPUS module:
module load nlpl-opus
With this, you will have access to essential tools that make it easier to read and process the data sets.