Infrastructure/home
The NLPL infrastructure for collaboration and software and data management includes, among other things,
- resource allocations on two superclusters and procedures to gain access;
- an ever-growing collection of mostly parallel software and data modules;
- a project-operated MediaWiki instance with public and internal documentation;
- a collection of project-maintained mailing lists for various project sub-groups.
Catalogue of Supported Software
Project Milestones
Below is upcoming and passed Project Milestones listed. The Milestones are extracted from the Project Plan for NLPL.
When Project Milestone is achieved, email the team list such that the project is informed that new features are in place. The Project Manager will update the Milestone table.
Upcoming Milestones
| Milestone | Milestone description | lead | deadline | delivered |
|---|---|---|---|---|
| A.1.3 | Project Report Year three | PM | Dec'19 | |
| A.3.4 | Cost-Benefit Analysis of the laboratory | PM | Dec'19 | |
| A.3.5 | Automated data replication and backu-up across NLPL systems | UiO | Dec'19 | |
| A.3.6 | Partial automation of software re-installation on Puhti and Saga | UiO and UiH | Dec'19 | |
| A.3.7 | Interface to CSC and Sigma2 user databases for mailing lists | UiO | Dec'19 | |
| A.3.8 | Renegotiation of resource allocation and collaboration framework | UiO | Dec'19 | |
| B.1.5 | Update of Moses Development Environment | UoH | Dec'19 | |
| B.2.3 | Update Machine Translation Data sets and documentation | UoH | Dec'19 | |
| B.3.4 | Translation utilities module | UoH | Dec'19 | |
| C.1.3 | Dependency Data version 3 | UU | Dec'19 | |
| C.2.3 | Dependency parsers version 3 | UU | Dec'19 | |
| C.3.4 | Parsing tutorial version 3 | UU | Dec'19 | |
| D.3.1 | Building comparable corpora for two of the minority Nordic Languages, Faroese and West Greenlandic | ITU | Dec'19 (was Sep'19) | |
| E.3 | Final Update of Embeddings | UiO | Dec'19 | |
| E.4 | Sample code and tutorial on training and using ELMo and BERT | UiO and UoT | Dec'19 | |
| G.3.2 | Reorganization of OPUS for migration to object storage | UiH | Dec'19 |
Passed Milestones
| Milestone | Milestone description | lead | deadline | delivered |
|---|---|---|---|---|
| A1.1 | Project Report Year one | PM | Dec'17 | yes |
| A.1.2 | Project Report Year two | PM | Dec'18 | yes |
| A2.1 | Setup of collaboration infrastructure | PM | Jun'17 | yes |
| A2.2 | Update of collaboration infrastructure | PM | Feb'18 | yes |
| A3.1 | Trial environment for portable, modular installation | PM | Dec'17 | yes |
| A3.2 | Survey needs and use of emerging technologies | PM | Dec'17 | yes |
| A3.3 | Facilitate access to resources at Sigma2 and CSC | PM | Jun'18 | yes |
| A3.4 | Cost-benefit Analysis of the laboratory | PM | Dec'17 | yes |
| A.3.5 | Automated data replication and backu-up across NLPL systems | UiO | Dec'19 | yes |
| A.3.6 | Partial automation of software re-installation on Puhti and Saga | UiO and UiH | Dec'19 | yes |
| A.3.7 | Interface to CSC and Sigma2 user databases for mailing lists | UiO | Dec'19 | yes |
| A.3.8 | Renegotiation of resource allocation and collaboration framework | UiO | Dec'19 | yes |
| B1.1 | Install Moses Release 4.0 and support tools | UoH | Jun '17 | yes |
| B1.2 | Moses Development Environment | UoH | Dec'17 | yes |
| B1.3 | Moses Documentation and tutorials | UoH | Dec'17 | yes |
| B1.4 | Update of Moses Development environment | UoH | Dec'18 | yes |
| B.1.5 | Update of Moses Development Environment | UoH | Dec'19 | yes |
| B2.1 | Installation of MT data sets and documentation | UoH | Dec'17 | yes |
| B2.2 | Updated Machine Translation data sets and documentation | UoH | Dec'18 | yes |
| B.2.3 | Update Machine Translation Data sets and documentation | UoH | Dec'19 | yes |
| B3.1 | Helsinki NMT system with documentation | UoH | Dec'17 | yes |
| B3.2 | Installation of OpenNMT-py | UoH | June'18 | yes |
| B.3.3 | Installation of MarianNMT | UoH | June'18 | yes |
| B.4.1 | Documented SMT Baselines | UoH | Dec'18 | Feb'19 |
| B.4.2 | Documented NMT Baselines | UoH | Dec'18 | May'19 |
| C1.1 | Dependency Parsing Data version 1 | UU | Dec'17 | yes |
| C.1.2 | Dependency Parsing version 2 | UU | Dec'18 | yes |
| C.1.3 | Dependency Data version 3 | UU | Dec'19 | yes |
| C2.1 | Dependency Parsing Parser version 1 | UU | Dec'17 | yes |
| C.2.2 | Dependency Data version 2 | UU | Dec'18 | yes |
| C.2.3 | Dependency parsers version 3 | UU | Dec'19 | yes |
| C3.1 | Dependency Parsing Parsing tutorial | UU | Dec'17 | yes |
| C.3.2 | Dependency Parsing tutorial version 2 | UU | Dec'18 | yes |
| C.3.4 | Parsing tutorial version 3 | UU | Dec'19 | yes |
| D1.1 | Clarification of applicable licensing schemes | UoT | Mar'17 | yes |
| D1.2 | Relevant data sets installed with license management infrastructure | UoT | - | - |
| D.2.2 | Common-Crawl-derived corpora for at least five languages | UoT | Dec'18 | yes |
| E1.1 | Pre-trained Embeddings for ENG,DAN,FIN,NNO,NOB,SWE | UiO | Jun'17 | yes |
| E.2 | Updated Embeddings, including additional languages | UiO | Dec'18 | yes |
| E.3 | Final Update of Embeddings | UiO | Dec'19 | yes |
| E.4 | Sample code and tutorial on training and using ELMo and BERT | UiO and UoT | Dec'19 | yes |
| F1.1 | Extrinsic Evaluation Data First Batch | UiO(UoC) | Dec'17 | yes |
| F.1.2 | Data sets and documentation for the second batch of downstream tasks | UiO | Dec'18 | yes |
| F2.1 | Extrinsic Evaluation Code for First Batch | UiO(UoC) | Dec'17 | yes |
| F.2.2 | Code for second batch of downstream tasks | UiO | Dec'18 | yes |
| F3.1 | Integrating the NLPL Extrinsic Parser Evaluation into CoLL evaluation procedures | UiO | Jun'18 | yes |
| G1.1 | Running OPUS Server | UoH | Jun'17 | yes |
| G1.2 | Mirror OPUS data | UoH | Jun'17 | yes |
| G1.3 | Improved OPUS data release structure | UoH | Jun'18 | yes |
| G1.4 | Partial mirror to abel and long term storage | UoH | Dec'18 | yes |
| G2.1 | Tools and documentation | UoH | Dec'17 | yes |
| G3.1 | Web services and their documentation | UoH | Dec'18 | yes |
| G.3.2 | Reorganization of OPUS for migration to object storage | UiH | Dec'19 | yes |
| H1.1 | Winter School | UiO | Mar'18 | yes |
| H1.2 | NLPL Winter School '19 | UiO | Mar'19 | yes |
| H2.1a | Web site | UiO | Mar '17 | yes |
| H2.1b | Position paper on NoLaiDa | UiO | Jun '17 | yes |
| H2.2 | Workshop at NoDaLiDa and presentation at NeIC conference | UiO | Jun'19 | yes |
| F.2.3 | Wiki for adding downstream tasks | UiO | Deleted milestone (30.10.19) |
