Infrastructure/home

From Nordic Language Processing Laboratory
(Difference between revisions)
Jump to: navigation, search
(Passed Milestones)
(Passed Milestones)
Line 155: Line 155:
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
<tr class="odd">
+
<tr class="even">
 
<td align="left">A.1.2</td>
 
<td align="left">A.1.2</td>
 
<td align="left">Project Report Year two</td>
 
<td align="left">Project Report Year two</td>
Line 162: Line 162:
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
<tr class="even">
+
<tr class="odd">
 
<td align="left">A2.1</td>
 
<td align="left">A2.1</td>
 
<td align="left">Setup of collaboration infrastructure</td>
 
<td align="left">Setup of collaboration infrastructure</td>
Line 169: Line 169:
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
<tr class="odd">
+
<tr class="even">
 
<td align="left">A2.2</td>
 
<td align="left">A2.2</td>
 
<td align="left">Update of collaboration infrastructure</td>
 
<td align="left">Update of collaboration infrastructure</td>
Line 176: Line 176:
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
<tr class="even">
+
<tr class="odd">
 
<td align="left">A3.1</td>
 
<td align="left">A3.1</td>
 
<td align="left">Trial environment for portable, modular installation</td>
 
<td align="left">Trial environment for portable, modular installation</td>
Line 183: Line 183:
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
<tr class="odd">
+
<tr class="even">
 
<td align="left">A3.2</td>
 
<td align="left">A3.2</td>
 
<td align="left">Survey needs and use of emerging technologies</td>
 
<td align="left">Survey needs and use of emerging technologies</td>
Line 190: Line 190:
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
<tr class="even">
+
<tr class="odd">
 
<td align="left">A3.3</td>
 
<td align="left">A3.3</td>
 
<td align="left">Facilitate access to resources at Sigma2 and CSC</td>
 
<td align="left">Facilitate access to resources at Sigma2 and CSC</td>
Line 197: Line 197:
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
<tr class="odd">
+
<tr class="even">
 
<td align="left">A3.4</td>
 
<td align="left">A3.4</td>
 
<td align="left">Cost-benefit Analysis of the laboratory</td>
 
<td align="left">Cost-benefit Analysis of the laboratory</td>
 
<td align="left">PM</td>
 
<td align="left">PM</td>
 
<td align="left">Dec'17</td>
 
<td align="left">Dec'17</td>
 +
<td align="left">yes</td>
 +
</tr>
 +
<tr class="odd">
 +
<td align="left">A.3.5</td>
 +
<td align="left">Automated data replication and backu-up across NLPL systems</td>
 +
<td align="left">UiO</td>
 +
<td align="left">Dec'19</td>
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
 
<tr class="even">
 
<tr class="even">
 +
<td align="left">A.3.6</td>
 +
<td align="left">Partial automation of software re-installation on Puhti and Saga</td>
 +
<td align="left">UiO and UiH</td>
 +
<td align="left">Dec'19</td>
 +
<td align="left">yes</td>
 +
</tr>
 +
<tr class="odd">
 +
<td align="left">A.3.7</td>
 +
<td align="left">Interface to CSC and Sigma2 user databases for mailing lists</td>
 +
<td align="left">UiO</td>
 +
<td align="left">Dec'19</td>
 +
<td align="left">yes</td>
 +
</tr>
 +
<tr class="even">
 +
<td align="left">A.3.8</td>
 +
<td align="left">Renegotiation of resource allocation and collaboration framework</td>
 +
<td align="left">UiO</td>
 +
<td align="left">Dec'19</td>
 +
<td align="left">yes</td>
 +
</tr>
 +
<tr class="odd">
 
<td align="left">B1.1</td>
 
<td align="left">B1.1</td>
<td align="left">Install Moses Release 3.0 and support tools</td>
+
<td align="left">Install Moses Release 4.0 and support tools</td>
 
<td align="left">UoH</td>
 
<td align="left">UoH</td>
 
<td align="left">Jun '17</td>
 
<td align="left">Jun '17</td>
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
<tr class="odd">
+
<tr class="even">
 
<td align="left">B1.2</td>
 
<td align="left">B1.2</td>
 
<td align="left">Moses Development Environment</td>
 
<td align="left">Moses Development Environment</td>
Line 218: Line 246:
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
<tr class="even">
+
<tr class="odd">
 
<td align="left">B1.3</td>
 
<td align="left">B1.3</td>
 
<td align="left">Moses Documentation and tutorials</td>
 
<td align="left">Moses Documentation and tutorials</td>
Line 225: Line 253:
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
<tr class="odd">
+
<tr class="even">
 
<td align="left">B1.4</td>
 
<td align="left">B1.4</td>
 
<td align="left">Update of Moses Development environment</td>
 
<td align="left">Update of Moses Development environment</td>
Line 232: Line 260:
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
<tr class="even">
+
<tr class="odd">
 +
<td align="left">B.1.5</td>
 +
<td align="left">Update of Moses Development Environment</td>
 +
<td align="left">UoH</td>
 +
<td align="left">Dec'19</td>
 +
<td align="left">yes</td>
 +
</tr>
 +
<tr class="odd">
 
<td align="left">B2.1</td>
 
<td align="left">B2.1</td>
 
<td align="left">Installation of MT data sets and documentation</td>
 
<td align="left">Installation of MT data sets and documentation</td>
Line 239: Line 274:
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
<tr class="odd">
+
<tr class="even">
 
<td align="left">B2.2</td>
 
<td align="left">B2.2</td>
 
<td align="left">Updated Machine Translation data sets and documentation</td>
 
<td align="left">Updated Machine Translation data sets and documentation</td>
Line 247: Line 282:
 
</tr>
 
</tr>
 
<tr class="even">
 
<tr class="even">
 +
<td align="left">B.2.3</td>
 +
<td align="left">Update Machine Translation Data sets and documentation</td>
 +
<td align="left">UoH</td>
 +
<td align="left">Dec'19</td>
 +
<td align="left"></td>
 +
</tr>
 +
<tr class="odd">
 
<td align="left">B3.1</td>
 
<td align="left">B3.1</td>
 
<td align="left">Helsinki NMT system with documentation</td>
 
<td align="left">Helsinki NMT system with documentation</td>
Line 253: Line 295:
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
<tr class="odd">
+
<tr class="even">
 +
<td align="left">B3.2</td>
 +
<td align="left">Installation of OpenNMT-py</td>
 +
<td align="left">UoH</td>
 +
<td align="left">June'18</td>
 +
<td align="left">yes</td>
 +
</tr>
 +
<tr class="odd"even>
 +
<td align="left">B.3.3</td>
 +
<td align="left">Installation of MarianNMT</td>
 +
<td align="left">UoH</td>
 +
<td align="left">June'18</td>
 +
<td align="left">yes</td>
 +
</tr>
 +
<tr class="even">
 
<td align="left">B.4.1</td>
 
<td align="left">B.4.1</td>
 
<td align="left">Documented SMT Baselines</td>
 
<td align="left">Documented SMT Baselines</td>
Line 260: Line 316:
 
<td align="left">Feb'19</td>
 
<td align="left">Feb'19</td>
 
</tr>
 
</tr>
<tr class="even">
+
<tr class="odd">
 
<td align="left">B.4.2</td>
 
<td align="left">B.4.2</td>
 
<td align="left">Documented NMT Baselines</td>
 
<td align="left">Documented NMT Baselines</td>
Line 267: Line 323:
 
<td align="left">May'19</td>
 
<td align="left">May'19</td>
 
</tr>
 
</tr>
<tr class="odd">
+
<tr class="even">
 
<td align="left">C1.1</td>
 
<td align="left">C1.1</td>
 
<td align="left">Dependency Parsing Data version 1</td>
 
<td align="left">Dependency Parsing Data version 1</td>
Line 274: Line 330:
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
<tr class="even">
+
<tr class="odd">
 
<td align="left">C.1.2</td>
 
<td align="left">C.1.2</td>
 
<td align="left">Dependency Parsing version 2</td>
 
<td align="left">Dependency Parsing version 2</td>
 
<td align="left">UU</td>
 
<td align="left">UU</td>
 
<td align="left">Dec'18</td>
 
<td align="left">Dec'18</td>
 +
<td align="left">yes</td>
 +
</tr>
 +
<tr class="even">
 +
<td align="left">C.1.3</td>
 +
<td align="left">Dependency Data version 3</td>
 +
<td align="left">UU</td>
 +
<td align="left">Dec'19</td>
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
Line 296: Line 359:
 
</tr>
 
</tr>
 
<tr class="odd">
 
<tr class="odd">
 +
<td align="left">C.2.3</td>
 +
<td align="left">Dependency parsers version 3</td>
 +
<td align="left">UU</td>
 +
<td align="left">Dec'19</td>
 +
<td align="left">yes</td>
 +
</tr>
 +
<tr class="even">
 
<td align="left">C3.1</td>
 
<td align="left">C3.1</td>
 
<td align="left">Dependency Parsing Parsing tutorial</td>
 
<td align="left">Dependency Parsing Parsing tutorial</td>
Line 302: Line 372:
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
<tr class="even">
+
<tr class="odd">
 
<td align="left">C.3.2</td>
 
<td align="left">C.3.2</td>
 
<td align="left">Dependency Parsing tutorial version 2</td>
 
<td align="left">Dependency Parsing tutorial version 2</td>
 
<td align="left">UU</td>
 
<td align="left">UU</td>
 
<td align="left">Dec'18</td>
 
<td align="left">Dec'18</td>
 +
<td align="left">yes</td>
 +
</tr>
 +
<tr class="even">
 +
<td align="left">C.3.4</td>
 +
<td align="left">Parsing tutorial version 3</td>
 +
<td align="left">UU</td>
 +
<td align="left">Dec'19</td>
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
Line 342: Line 419:
 
<td align="left">UiO</td>
 
<td align="left">UiO</td>
 
<td align="left">Dec'18</td>
 
<td align="left">Dec'18</td>
 +
<td align="left">yes</td>
 +
</tr>
 +
<tr class="even">
 +
<td align="left">E.3</td>
 +
<td align="left">Final Update of Embeddings</td>
 +
<td align="left">UiO</td>
 +
<td align="left">Dec'19</td>
 +
<td align="left">yes</td>
 +
</tr>
 +
<tr class="odd">
 +
<td align="left">E.4</td>
 +
<td align="left">Sample code and tutorial on training and using ELMo and BERT</td>
 +
<td align="left">UiO and UoT</td>
 +
<td align="left">Dec'19</td>
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
Line 351: Line 442:
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
<tr class="odd">
+
<tr class="[[odd]]">
 
<td align="left">F.1.2</td>
 
<td align="left">F.1.2</td>
 
<td align="left">Data sets and documentation for the second batch of downstream tasks</td>
 
<td align="left">Data sets and documentation for the second batch of downstream tasks</td>
Line 408: Line 499:
 
</tr>
 
</tr>
 
<tr class="odd">
 
<tr class="odd">
<td align="left">G3.1</td>
+
<td align="left">G2.1</td>
<td align="left">Web services and their documentation</td>
+
<td align="left">Tools and documentation</td>
 
<td align="left">UoH</td>
 
<td align="left">UoH</td>
<td align="left">Dec'18</td>
+
<td align="left">Dec'17</td>
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
 
<tr class="even">
 
<tr class="even">
<td align="left">G2.1</td>
+
<td align="left">G3.1</td>
<td align="left">Tools and documentation</td>
+
<td align="left">Web services and their documentation</td>
 
<td align="left">UoH</td>
 
<td align="left">UoH</td>
<td align="left">Dec'17</td>
+
<td align="left">Dec'18</td>
 
<td align="left">yes</td>
 
<td align="left">yes</td>
 
</tr>
 
</tr>
 
<tr class="odd">
 
<tr class="odd">
 +
<td align="left">G.3.2</td>
 +
<td align="left">Reorganization of OPUS for migration to object storage</td>
 +
<td align="left">UiH</td>
 +
<td align="left">Dec'19</td>
 +
<td align="left">yes</td>
 +
</tr>
 +
</table>
 +
<tr class="even">
 
<td align="left">H1.1</td>
 
<td align="left">H1.1</td>
 
<td align="left">Winter School</td>
 
<td align="left">Winter School</td>

Revision as of 12:16, 15 January 2020

The NLPL infrastructure for collaboration and software and data management includes, among other things,


Catalogue of Supported Software

Software Installation Guide

Project Milestones

Below is upcoming and passed Project Milestones listed. The Milestones are extracted from the Project Plan for NLPL.

When Project Milestone is achieved, email the team list such that the project is informed that new features are in place. The Project Manager will update the Milestone table.

Upcoming Milestones

Milestone Milestone description lead deadline delivered
A.1.3 Project Report Year three PM Dec'19
A.3.4 Cost-Benefit Analysis of the laboratory PM Dec'19
A.3.5 Automated data replication and backu-up across NLPL systems UiO Dec'19
A.3.6 Partial automation of software re-installation on Puhti and Saga UiO and UiH Dec'19
A.3.7 Interface to CSC and Sigma2 user databases for mailing lists UiO Dec'19
A.3.8 Renegotiation of resource allocation and collaboration framework UiO Dec'19
B.1.5 Update of Moses Development Environment UoH Dec'19
B.2.3 Update Machine Translation Data sets and documentation UoH Dec'19
B.3.4 Translation utilities module UoH Dec'19
C.1.3 Dependency Data version 3 UU Dec'19
C.2.3 Dependency parsers version 3 UU Dec'19
C.3.4 Parsing tutorial version 3 UU Dec'19
D.3.1 Building comparable corpora for two of the minority Nordic Languages, Faroese and West Greenlandic ITU Dec'19 (was Sep'19)
E.3 Final Update of Embeddings UiO Dec'19
E.4 Sample code and tutorial on training and using ELMo and BERT UiO and UoT Dec'19
G.3.2 Reorganization of OPUS for migration to object storage UiH Dec'19

Passed Milestones

Milestone Milestone description lead deadline delivered
A1.1 Project Report Year one PM Dec'17 yes
A.1.2 Project Report Year two PM Dec'18 yes
A2.1 Setup of collaboration infrastructure PM Jun'17 yes
A2.2 Update of collaboration infrastructure PM Feb'18 yes
A3.1 Trial environment for portable, modular installation PM Dec'17 yes
A3.2 Survey needs and use of emerging technologies PM Dec'17 yes
A3.3 Facilitate access to resources at Sigma2 and CSC PM Jun'18 yes
A3.4 Cost-benefit Analysis of the laboratory PM Dec'17 yes
A.3.5 Automated data replication and backu-up across NLPL systems UiO Dec'19 yes
A.3.6 Partial automation of software re-installation on Puhti and Saga UiO and UiH Dec'19 yes
A.3.7 Interface to CSC and Sigma2 user databases for mailing lists UiO Dec'19 yes
A.3.8 Renegotiation of resource allocation and collaboration framework UiO Dec'19 yes
B1.1 Install Moses Release 4.0 and support tools UoH Jun '17 yes
B1.2 Moses Development Environment UoH Dec'17 yes
B1.3 Moses Documentation and tutorials UoH Dec'17 yes
B1.4 Update of Moses Development environment UoH Dec'18 yes
B.1.5 Update of Moses Development Environment UoH Dec'19 yes
B2.1 Installation of MT data sets and documentation UoH Dec'17 yes
B2.2 Updated Machine Translation data sets and documentation UoH Dec'18 yes
B.2.3 Update Machine Translation Data sets and documentation UoH Dec'19
B3.1 Helsinki NMT system with documentation UoH Dec'17 yes
B3.2 Installation of OpenNMT-py UoH June'18 yes
B.3.3 Installation of MarianNMT UoH June'18 yes
B.4.1 Documented SMT Baselines UoH Dec'18 Feb'19
B.4.2 Documented NMT Baselines UoH Dec'18 May'19
C1.1 Dependency Parsing Data version 1 UU Dec'17 yes
C.1.2 Dependency Parsing version 2 UU Dec'18 yes
C.1.3 Dependency Data version 3 UU Dec'19 yes
C2.1 Dependency Parsing Parser version 1 UU Dec'17 yes
C.2.2 Dependency Data version 2 UU Dec'18 yes
C.2.3 Dependency parsers version 3 UU Dec'19 yes
C3.1 Dependency Parsing Parsing tutorial UU Dec'17 yes
C.3.2 Dependency Parsing tutorial version 2 UU Dec'18 yes
C.3.4 Parsing tutorial version 3 UU Dec'19 yes
D1.1 Clarification of applicable licensing schemes UoT Mar'17 yes
D1.2 Relevant data sets installed with license management infrastructure UoT - -
D.2.2 Common-Crawl-derived corpora for at least five languages UoT Dec'18 yes
E1.1 Pre-trained Embeddings for ENG,DAN,FIN,NNO,NOB,SWE UiO Jun'17 yes
E.2 Updated Embeddings, including additional languages UiO Dec'18 yes
E.3 Final Update of Embeddings UiO Dec'19 yes
E.4 Sample code and tutorial on training and using ELMo and BERT UiO and UoT Dec'19 yes
F1.1 Extrinsic Evaluation Data First Batch UiO(UoC) Dec'17 yes
F.1.2 Data sets and documentation for the second batch of downstream tasks UiO Dec'18 yes
F2.1 Extrinsic Evaluation Code for First Batch UiO(UoC) Dec'17 yes
F.2.2 Code for second batch of downstream tasks UiO Dec'18 yes
F3.1 Integrating the NLPL Extrinsic Parser Evaluation into CoLL evaluation procedures UiO Jun'18 yes
G1.1 Running OPUS Server UoH Jun'17 yes
G1.2 Mirror OPUS data UoH Jun'17 yes
G1.3 Improved OPUS data release structure UoH Jun'18 yes
G1.4 Partial mirror to abel and long term storage UoH Dec'18 yes
G2.1 Tools and documentation UoH Dec'17 yes
G3.1 Web services and their documentation UoH Dec'18 yes
G.3.2 Reorganization of OPUS for migration to object storage UiH Dec'19 yes

<tr class="even"> <td align="left">H1.1</td> <td align="left">Winter School</td> <td align="left">UiO</td> <td align="left">Mar'18</td> <td align="left">yes</td> </tr> <tr class="odd"> <td align="left">H1.2</td> <td align="left">NLPL Winter School '19</td> <td align="left">UiO</td> <td align="left">Mar'19</td> <td align="left">yes</td> </tr> <tr class="even"> <td align="left">H2.1a</td> <td align="left">Web site</td> <td align="left">UiO</td> <td align="left">Mar '17</td> <td align="left">yes</td> </tr> <tr class="odd"> <td align="left">H2.1b</td> <td align="left">Position paper on NoLaiDa</td> <td align="left">UiO</td> <td align="left">Jun '17</td> <td align="left">yes</td> </tr> <tr class="even"> <td align="left">H2.2</td> <td align="left">Workshop at NoDaLiDa and presentation at NeIC conference</td> <td align="left">UiO</td> <td align="left">Jun'19</td> <td align="left">yes</td> </tr> <tr class="odd"> <td align="left">F.2.3</td> <td align="left">Wiki for adding downstream tasks</td> <td align="left">UiO</td> <td align="left">Deleted milestone (30.10.19)</td> <td align="left"></td> </tr> </table>

Personal tools
Namespaces

Variants
Actions
Navigation
Tools