Nordic Language Processing Laboratory - User contributions [en]

Infrastructure/resources

2019-01-11T09:31:32Z

Matthies: /* Taito Usage Statistics */

= Background =

The NLPL initiative is supported by CSC and Sigma2, the Finnish and Norwegian national e-infrastructure providers, respectively.
The project has received computing allocations on the Taito (Finland) and
Abel (Norway) superclusters, which can be used by all project members.
Additionally, moderate ‘on-line’ storage allocations are provided on both machines (accessible as ‘/projects/nlpl/’ on Abel, and ‘/proj/nlpl/’ on Taito),
as well as a more generous storage allocation of 100 terabytes (in mid-2017) on NIRD.

= Gaining Access =

For the time being, there is no synchronization of user accounts across countries.
Thus, project members need to obtain accounts separately for Abel and Taito.
In mid-2017 at least, staff and students at project member sites and associate partners
are welcome to use the NLPL virtual laboratory.
Allocation decisions (within NLPL) are made by the
[http://lists.nlpl.eu/mailman/listinfo/infrastructure infrastructure task force];
thus, please make sure to make contact with us before submitting account applications.

For '''Abel''', there is an on-line account application form at https://www.metacenter.no/user/application/.
Please request association with Notur project <tt>NN9447K</tt>.
It will usually take a day or two before account activation is complete, and you will receive status updates by email and text messages.
Stephan Oepen (UiO) is the Norwegian point of contact for these projects, but please direct
all inquiries to the NLPL
[http://lists.nlpl.eu/mailman/listinfo/infrastructure infrastructure task force].

For '''Taito''', there is an on-line account application form at https://sui.csc.fi/web/guest/csc-customer-registration/.
Martin Matthiesen will need to approve NLPL-related account requests and manages
allocation ‘projects’ (one per site).
Stephan Oepen manages the on-line storage on Taito (‘<tt>/proj/nlpl/</tt>’).
For all technical questions, please contact the NLPL
[http://lists.nlpl.eu/mailman/listinfo/infrastructure infrastructure task force].

= Resource Allocations =

At present (mid-2017), there are different allocation mechanisms for the two systems.

For Abel, allocations are made by the Norwegian Resource Allocation Committee for six-months periods, which start on April 1 and October 1, each year.
NLPL received an allocation of 500,000 cpu hours for the allocation period <tt>2016.2</tt>; of these, less than one third had been used by March 2017,
and the allocation of period <tt>2017.1</tt> (lasting until the end of September 2017) was reduced (from the original estimates, in mutual agreement)
to a fresh 500,000 hours.
Towards the end of August 2017, it appears that NLPL usage on Abel actually has declined to some 50,000 hours in allocation
period <tt>2017.1</tt>; Stephan Oepen will optimistically request 200,000 hours for the next six-month period.
All NLPL project members share these allocations and, over time, will need to find ways of using and distributing these resources fairly.

For Taito, each NLPL member site can be allocated its ‘own’ project, and CSC tends to make smaller allocations more frequently.
The Steering Group has yet to develop a policy for how to make sure that the sum of these micro-allocations fit (fairly) within the bounds
of the ‘blanket’ allocation of three million core hours over three years granted to NLPL as the CSC in-kind contribution.

= Taito Usage Statistics =

{| class="wikitable"
|-
! Id !! Project !! Principal Investigator !! Active Users 2017 !! Units 2017 !! Active Users 2018 !! Units 2018 !! Users 2019 !! Units 2019
|-
| 2000509 || Deep Learning for Natural Language Processing || Joakim Nivre || 7 || 531099 || 10 || 609617 || ||
|-
| 2000582 || Neic-NLPL || Stephan Oepen || - || - || 3 || 62298 || ||
|-
| 2000661 || NLPL-OPUS || Jörg Tiedemann || 1 || 28959 || 2 || 270915 || ||
|-
| 2000288 || BAULT || Jörg Tiedemann || 1 || 992 || 1 || 7089 || ||
|-
| 2000309 || CrossNLP || Jörg Tiedemann || 10 || 844404 || 15 || 1808416|| ||
|-
| tuy4622 || Textual Data Mining for Bioinformation Management || Filip Ginter || 9 || 891837 || 10 || 558113 || ||
|-
| 2000391 || TurkuNLP EDU || Filip Ginter || 1 || 142808 || 2 || 177932 || ||
|-
| 2000989 || UCPH part of NeIC-NLPL || Anders Søgaard || - || - || 5 || 107657 || ||
|-
| 2001006 || NLPL-ITUNLP || Leon Derczynski || - || - || 7 || 345 || ||
|-
| Total || || || 26 || 2440099 || 47 || 3602382 || ||

|}

= Abel Usage Statistics =

[[File:notur.2017.1.png|center]]
[[File:notur.2016.2.png|center]]

Infrastructure/resources

2019-01-10T12:36:31Z

Matthies: /* Taito Usage Statistics */

= Background =

The NLPL initiative is supported by CSC and Sigma2, the Finnish and Norwegian national e-infrastructure providers, respectively.
The project has received computing allocations on the Taito (Finland) and
Abel (Norway) superclusters, which can be used by all project members.
Additionally, moderate ‘on-line’ storage allocations are provided on both machines (accessible as ‘/projects/nlpl/’ on Abel, and ‘/proj/nlpl/’ on Taito),
as well as a more generous storage allocation of 100 terabytes (in mid-2017) on NIRD.

= Gaining Access =

For the time being, there is no synchronization of user accounts across countries.
Thus, project members need to obtain accounts separately for Abel and Taito.
In mid-2017 at least, staff and students at project member sites and associate partners
are welcome to use the NLPL virtual laboratory.
Allocation decisions (within NLPL) are made by the
[http://lists.nlpl.eu/mailman/listinfo/infrastructure infrastructure task force];
thus, please make sure to make contact with us before submitting account applications.

For '''Abel''', there is an on-line account application form at https://www.metacenter.no/user/application/.
Please request association with Notur project <tt>NN9447K</tt>.
It will usually take a day or two before account activation is complete, and you will receive status updates by email and text messages.
Stephan Oepen (UiO) is the Norwegian point of contact for these projects, but please direct
all inquiries to the NLPL
[http://lists.nlpl.eu/mailman/listinfo/infrastructure infrastructure task force].

For '''Taito''', there is an on-line account application form at https://sui.csc.fi/web/guest/csc-customer-registration/.
Martin Matthiesen will need to approve NLPL-related account requests and manages
allocation ‘projects’ (one per site).
Stephan Oepen manages the on-line storage on Taito (‘<tt>/proj/nlpl/</tt>’).
For all technical questions, please contact the NLPL
[http://lists.nlpl.eu/mailman/listinfo/infrastructure infrastructure task force].

= Resource Allocations =

At present (mid-2017), there are different allocation mechanisms for the two systems.

For Abel, allocations are made by the Norwegian Resource Allocation Committee for six-months periods, which start on April 1 and October 1, each year.
NLPL received an allocation of 500,000 cpu hours for the allocation period <tt>2016.2</tt>; of these, less than one third had been used by March 2017,
and the allocation of period <tt>2017.1</tt> (lasting until the end of September 2017) was reduced (from the original estimates, in mutual agreement)
to a fresh 500,000 hours.
Towards the end of August 2017, it appears that NLPL usage on Abel actually has declined to some 50,000 hours in allocation
period <tt>2017.1</tt>; Stephan Oepen will optimistically request 200,000 hours for the next six-month period.
All NLPL project members share these allocations and, over time, will need to find ways of using and distributing these resources fairly.

For Taito, each NLPL member site can be allocated its ‘own’ project, and CSC tends to make smaller allocations more frequently.
The Steering Group has yet to develop a policy for how to make sure that the sum of these micro-allocations fit (fairly) within the bounds
of the ‘blanket’ allocation of three million core hours over three years granted to NLPL as the CSC in-kind contribution.

= Taito Usage Statistics =

{| class="wikitable"
|-
! Id !! Project !! Principal Investigator !! Active Users 2017 !! Units 2017 !! Active Users 2018 !! Units 2018 !! Users 2019 !! Units 2019
|-
| 2000509 || Deep Learning for Natural Language Processing || Joakim Nivre || 7 || 531099 || 10 || 609617 || ||
|-
| 2000661 || Neic-NLPL || Stephan Oepen || - || - || 3 || 62298 || ||
|-
| 2000661 || NLPL-OPUS || Jörg Tiedemann || 1 || 28959 || 2 || 270915 || ||
|-
| 2000288 || BAULT || Jörg Tiedemann || 1 || 992 || 1 || 7089 || ||
|-
| 2000309 || CrossNLP || Jörg Tiedemann || 10 || 844404 || 15 || 1808416|| ||
|-
| tuy4622 || Textual Data Mining for Bioinformation Management || Filip Ginter || 9 || 891837 || 10 || 558113 || ||
|-
| 2000391 || TurkuNLP EDU || Filip Ginter || 1 || 142808 || 2 || 177932 || ||
|-
| 2000989 || UCPH part of NeIC-NLPL || Anders Søgaard || - || - || 5 || 107657 || ||
|-
| 2001006 || NLPL-ITUNLP || Leon Derczynski || - || - || 7 || 345 || ||
|-
| Total || || || 26 || 2440099 || 47 || 3602382 || ||

|}

= Abel Usage Statistics =

[[File:notur.2017.1.png|center]]
[[File:notur.2016.2.png|center]]

Infrastructure/resources

2019-01-10T12:35:33Z

Matthies: /* Taito Usage Statistics */

= Background =

The NLPL initiative is supported by CSC and Sigma2, the Finnish and Norwegian national e-infrastructure providers, respectively.
The project has received computing allocations on the Taito (Finland) and
Abel (Norway) superclusters, which can be used by all project members.
Additionally, moderate ‘on-line’ storage allocations are provided on both machines (accessible as ‘/projects/nlpl/’ on Abel, and ‘/proj/nlpl/’ on Taito),
as well as a more generous storage allocation of 100 terabytes (in mid-2017) on NIRD.

= Gaining Access =

For the time being, there is no synchronization of user accounts across countries.
Thus, project members need to obtain accounts separately for Abel and Taito.
In mid-2017 at least, staff and students at project member sites and associate partners
are welcome to use the NLPL virtual laboratory.
Allocation decisions (within NLPL) are made by the
[http://lists.nlpl.eu/mailman/listinfo/infrastructure infrastructure task force];
thus, please make sure to make contact with us before submitting account applications.

For '''Abel''', there is an on-line account application form at https://www.metacenter.no/user/application/.
Please request association with Notur project <tt>NN9447K</tt>.
It will usually take a day or two before account activation is complete, and you will receive status updates by email and text messages.
Stephan Oepen (UiO) is the Norwegian point of contact for these projects, but please direct
all inquiries to the NLPL
[http://lists.nlpl.eu/mailman/listinfo/infrastructure infrastructure task force].

For '''Taito''', there is an on-line account application form at https://sui.csc.fi/web/guest/csc-customer-registration/.
Martin Matthiesen will need to approve NLPL-related account requests and manages
allocation ‘projects’ (one per site).
Stephan Oepen manages the on-line storage on Taito (‘<tt>/proj/nlpl/</tt>’).
For all technical questions, please contact the NLPL
[http://lists.nlpl.eu/mailman/listinfo/infrastructure infrastructure task force].

= Resource Allocations =

At present (mid-2017), there are different allocation mechanisms for the two systems.

For Abel, allocations are made by the Norwegian Resource Allocation Committee for six-months periods, which start on April 1 and October 1, each year.
NLPL received an allocation of 500,000 cpu hours for the allocation period <tt>2016.2</tt>; of these, less than one third had been used by March 2017,
and the allocation of period <tt>2017.1</tt> (lasting until the end of September 2017) was reduced (from the original estimates, in mutual agreement)
to a fresh 500,000 hours.
Towards the end of August 2017, it appears that NLPL usage on Abel actually has declined to some 50,000 hours in allocation
period <tt>2017.1</tt>; Stephan Oepen will optimistically request 200,000 hours for the next six-month period.
All NLPL project members share these allocations and, over time, will need to find ways of using and distributing these resources fairly.

For Taito, each NLPL member site can be allocated its ‘own’ project, and CSC tends to make smaller allocations more frequently.
The Steering Group has yet to develop a policy for how to make sure that the sum of these micro-allocations fit (fairly) within the bounds
of the ‘blanket’ allocation of three million core hours over three years granted to NLPL as the CSC in-kind contribution.

= Taito Usage Statistics =

{| class="wikitable"
|-
! Id !! Project !! Principal Investigator !! Active Users 2017 !! Units 2017 !! Active Users 2018 !! Units 2018 !! Users 2019 !! Units 2019
|-
| 2000509 || Deep Learning for Natural Language Processing || Joakim Nivre || 7 || 531099 || 10 || 609617 || ||
|-
| 2000661 || Neic-NLPL || Stephan Oepen || - || - || 3 || 62298 || ||
|-
| 2000661 || NLPL-OPUS || Jörg Tiedemann || 1 || 28959 || 2 || 270915 || ||
|-
| 2000288 || BAULT || Jörg Tiedemann || 1 || 992 || 1 || 7089 || ||
|-
| 2000309 || CrossNLP || Jörg Tiedemann || 10 || 844404 || 15 || 1808416|| ||
|-
| tuy4622 || Textual Data Mining for Bioinformation Management || Filip Ginter || 9 || 891837 || 10 || 558113 || ||
|-
| 2000391 || TurkuNLP EDU || Filip Ginter || 1 || 142808 || 2 || 177932 || ||
|-
| 2000989 || UCPH part of NeIC-NLPL || Anders Søgaard || - || - || 5 || 107657 || ||
|-
| 2001006 || NLPL-ITUNLP || Leon Derczynski || - || - || 7 || 345 || ||
|-
| Total || || || 26 || 2440099 || 47 || 3540084 || ||

|}

= Abel Usage Statistics =

[[File:notur.2017.1.png|center]]
[[File:notur.2016.2.png|center]]

Infrastructure/resources

2019-01-10T12:26:46Z

Matthies: /* Taito Usage Statistics */

= Background =

The NLPL initiative is supported by CSC and Sigma2, the Finnish and Norwegian national e-infrastructure providers, respectively.
The project has received computing allocations on the Taito (Finland) and
Abel (Norway) superclusters, which can be used by all project members.
Additionally, moderate ‘on-line’ storage allocations are provided on both machines (accessible as ‘/projects/nlpl/’ on Abel, and ‘/proj/nlpl/’ on Taito),
as well as a more generous storage allocation of 100 terabytes (in mid-2017) on NIRD.

= Gaining Access =

For the time being, there is no synchronization of user accounts across countries.
Thus, project members need to obtain accounts separately for Abel and Taito.
In mid-2017 at least, staff and students at project member sites and associate partners
are welcome to use the NLPL virtual laboratory.
Allocation decisions (within NLPL) are made by the
[http://lists.nlpl.eu/mailman/listinfo/infrastructure infrastructure task force];
thus, please make sure to make contact with us before submitting account applications.

For '''Abel''', there is an on-line account application form at https://www.metacenter.no/user/application/.
Please request association with Notur project <tt>NN9447K</tt>.
It will usually take a day or two before account activation is complete, and you will receive status updates by email and text messages.
Stephan Oepen (UiO) is the Norwegian point of contact for these projects, but please direct
all inquiries to the NLPL
[http://lists.nlpl.eu/mailman/listinfo/infrastructure infrastructure task force].

For '''Taito''', there is an on-line account application form at https://sui.csc.fi/web/guest/csc-customer-registration/.
Martin Matthiesen will need to approve NLPL-related account requests and manages
allocation ‘projects’ (one per site).
Stephan Oepen manages the on-line storage on Taito (‘<tt>/proj/nlpl/</tt>’).
For all technical questions, please contact the NLPL
[http://lists.nlpl.eu/mailman/listinfo/infrastructure infrastructure task force].

= Resource Allocations =

At present (mid-2017), there are different allocation mechanisms for the two systems.

For Abel, allocations are made by the Norwegian Resource Allocation Committee for six-months periods, which start on April 1 and October 1, each year.
NLPL received an allocation of 500,000 cpu hours for the allocation period <tt>2016.2</tt>; of these, less than one third had been used by March 2017,
and the allocation of period <tt>2017.1</tt> (lasting until the end of September 2017) was reduced (from the original estimates, in mutual agreement)
to a fresh 500,000 hours.
Towards the end of August 2017, it appears that NLPL usage on Abel actually has declined to some 50,000 hours in allocation
period <tt>2017.1</tt>; Stephan Oepen will optimistically request 200,000 hours for the next six-month period.
All NLPL project members share these allocations and, over time, will need to find ways of using and distributing these resources fairly.

For Taito, each NLPL member site can be allocated its ‘own’ project, and CSC tends to make smaller allocations more frequently.
The Steering Group has yet to develop a policy for how to make sure that the sum of these micro-allocations fit (fairly) within the bounds
of the ‘blanket’ allocation of three million core hours over three years granted to NLPL as the CSC in-kind contribution.

= Taito Usage Statistics =

{| class="wikitable"
|-
! Id !! Project !! Principal Investigator !! Active Users 2017 !! Units 2017 !! Active Users 2018 !! Units 2018 !! Users 2019 !! Units 2019
|-
| 2000509 || Deep Learning for Natural Language Processing || Joakim Nivre || 7 || 531099 || 10 || 609617 || ||
|-
| 2000661 || NLPL-OPUS || Jörg Tiedemann || 1 || 28959 || 2 || 270915 || ||
|-
| 2000288 || BAULT || Jörg Tiedemann || 1 || 992 || 1 || 7089 || ||
|-
| 2000309 || CrossNLP || Jörg Tiedemann || 10 || 844404 || 15 || 1808416|| ||
|-
| tuy4622 || Textual Data Mining for Bioinformation Management || Filip Ginter || 9 || 891837 || 10 || 558113 || ||
|-
| 2000391 || TurkuNLP EDU || Filip Ginter || 1 || 142808 || 2 || 177932 || ||
|-
| 2000989 || UCPH part of NeIC-NLPL || Anders Søgaard || - || - || 5 || 107657 || ||
|-
| 2001006 || NLPL-ITUNLP || Leon Derczynski || - || - || 7 || 345 || ||
|-
| Total || || || 26 || 2440099 || 47 || 3540084 || ||

|}

= Abel Usage Statistics =

[[File:notur.2017.1.png|center]]
[[File:notur.2016.2.png|center]]

Infrastructure/resources

2019-01-10T12:19:27Z

Matthies: /* Taito Usage Statistics */

= Background =

The NLPL initiative is supported by CSC and Sigma2, the Finnish and Norwegian national e-infrastructure providers, respectively.
The project has received computing allocations on the Taito (Finland) and
Abel (Norway) superclusters, which can be used by all project members.
Additionally, moderate ‘on-line’ storage allocations are provided on both machines (accessible as ‘/projects/nlpl/’ on Abel, and ‘/proj/nlpl/’ on Taito),
as well as a more generous storage allocation of 100 terabytes (in mid-2017) on NIRD.

= Gaining Access =

For the time being, there is no synchronization of user accounts across countries.
Thus, project members need to obtain accounts separately for Abel and Taito.
In mid-2017 at least, staff and students at project member sites and associate partners
are welcome to use the NLPL virtual laboratory.
Allocation decisions (within NLPL) are made by the
[http://lists.nlpl.eu/mailman/listinfo/infrastructure infrastructure task force];
thus, please make sure to make contact with us before submitting account applications.

For '''Abel''', there is an on-line account application form at https://www.metacenter.no/user/application/.
Please request association with Notur project <tt>NN9447K</tt>.
It will usually take a day or two before account activation is complete, and you will receive status updates by email and text messages.
Stephan Oepen (UiO) is the Norwegian point of contact for these projects, but please direct
all inquiries to the NLPL
[http://lists.nlpl.eu/mailman/listinfo/infrastructure infrastructure task force].

For '''Taito''', there is an on-line account application form at https://sui.csc.fi/web/guest/csc-customer-registration/.
Martin Matthiesen will need to approve NLPL-related account requests and manages
allocation ‘projects’ (one per site).
Stephan Oepen manages the on-line storage on Taito (‘<tt>/proj/nlpl/</tt>’).
For all technical questions, please contact the NLPL
[http://lists.nlpl.eu/mailman/listinfo/infrastructure infrastructure task force].

= Resource Allocations =

At present (mid-2017), there are different allocation mechanisms for the two systems.

For Abel, allocations are made by the Norwegian Resource Allocation Committee for six-months periods, which start on April 1 and October 1, each year.
NLPL received an allocation of 500,000 cpu hours for the allocation period <tt>2016.2</tt>; of these, less than one third had been used by March 2017,
and the allocation of period <tt>2017.1</tt> (lasting until the end of September 2017) was reduced (from the original estimates, in mutual agreement)
to a fresh 500,000 hours.
Towards the end of August 2017, it appears that NLPL usage on Abel actually has declined to some 50,000 hours in allocation
period <tt>2017.1</tt>; Stephan Oepen will optimistically request 200,000 hours for the next six-month period.
All NLPL project members share these allocations and, over time, will need to find ways of using and distributing these resources fairly.

For Taito, each NLPL member site can be allocated its ‘own’ project, and CSC tends to make smaller allocations more frequently.
The Steering Group has yet to develop a policy for how to make sure that the sum of these micro-allocations fit (fairly) within the bounds
of the ‘blanket’ allocation of three million core hours over three years granted to NLPL as the CSC in-kind contribution.

= Taito Usage Statistics =

{| class="wikitable"
|-
! Id !! Project !! Principal Investigator !! Active Users 2017 !! Units 2017 !! Active Users 2018 !! Units 2018 !! Users 2019 !! Units 2019
|-
| 2000509 || Deep Learning for Natural Language Processing || Joakim Nivre || 7 || 531099 || 10 || 609617 || ||
|-
| 2000661 || NLPL-OPUS || Jörg Tiedemann || 1 || 28959 || 2 || 270915 || ||
|-
| 2000288 || BAULT || Jörg Tiedemann || 1 || 992 || 1 || 7089 || ||
|-
| 2000309 || CrossNLP || Jörg Tiedemann || 10 || 844404 || 15 || 1808416|| ||
|-
| tuy4622 || Textual Data Mining for Bioinformation Management || Filip Ginter || 9 || 891837 || 10 || 558113 || || ||
|-
| 2000391 || TurkuNLP EDU || Filip Ginter || 1 || 142808 || 2 || 177932 || ||
|-
| 2000989 || UCPH part of NeIC-NLPL || Anders Søgaard || - || - || 5 || 107657 || ||
|-
| 2001006 || NLPL-ITUNLP || Leon Derczynski || - || - || 7 || 345 || ||

|}

= Abel Usage Statistics =

[[File:notur.2017.1.png|center]]
[[File:notur.2016.2.png|center]]

Home/SG171109

2017-11-09T10:58:05Z

Matthies: /* Elaborate the milestones for 2018 */

[[Category:NLPL steering group meetings 2017]]
'''Note: This draft document is an internal working material for project management. In order not to risk causing misinterpretation and confusion it is not to be shared outside of NeIC without project management consent. Approved steering group minutes are made publicly available on the NeIC external wiki: https://wiki.neic.no/wiki/Nordic_Language_Processing_Laboratory'''

= NLPL steering group meeting =
'''Time''': 2017-11-09
: 9 - 12 CET

'''Place''': Radisson Blu Airport Hotel, OSL, Gardemoen, Norway

'''Invited''':
* Tomasz Malkiewicz, NeIC (PO)
* Joakim Nivre, Uppsala University
* Jörg Tiedemann, University of Helsinki
* Martin Matthiesen, CSC-IT Center for Science Ltd
* Stephan Oepen, University of Oslo
* Anders Søgaard, University of Copenhagen
* Filip Ginter, University of Turku
* Gunnar Bøe, UNINETT Sigma2 AS
* Bjørn Lindi, NeIC (PM)

== NLPL-SG 17-35 The Agenda for the SG meeting ==
* 09:00 NLPL SG 17-35. Attendance and agenda (5’)
* 09:05 NLPL SG 17-36. SG responsibilities according (15')
* 09:20 NLPL SG 17-37. Status of the project - including status of NLPL task forces (30’)
* 09:50 NLPL SG 17-38. Review of personnel situation (15’)
* 10:05 NLPL SG 17-39. A new NLPL partner? Computer Science Department @ IT University Of Copenhagen (10')
* 10:15 NLPL SG 17-40. Status report to NeIC board (10')
* 10:25 Coffee break (5')
* 10:30 NLPL SG 17-41. Mid-term evaluation in 2H/3H 2018 (10')
* 10:40 NLPL SG 17-42. Priorities in 2018 (1h10')
* 11:50 NLPL SG 17-43. Next meetings (5’)
* 11:55 NLPL SG 17-44. AOB (5’)

Suggest to switch 17-38, 17-39

== NLPL SG 17-36. SG responsibilities according==
SG responsibilities according to the PPS model 15'
http://www.ppsonline.se/nordforsk/en/main/skill/ah134

== NLPL SG 17-37. Status of the project - including status of NLPL task forces==
{|
!Milestone
!Milestone Description
!lead
!month 6
!month 12
!month 14
!month 18
|-
|A1.1
|Project Report Year one
|PM
|
|'''''due'''''
|
|
|-
|A2.1
|Setup of colloboration infrastructure
|PM
|DONE(M2)
|
|
|
|-
|A2.2
|Update of colloboration infrastructure
|PM
|
|
|'''''due'''''
|
|-
|A3.1
|Trial environment for portable, modular installation
|PM
|
|'''''due'''''
|
|
|-
|A3.2
|Survey needs and use of emerging technologies
|PM
|
|'''''due'''''
|
|
|-
|A3.3
|Facilitate access to resources at Sigma2 and CSC
|PM
|
|
|
|'''''due'''''
|-
|A3.4
|Cost-benefit Analysis of the laboratory
|PM
|
|'''''due'''''
|
|
|-
|B1.1
|Install Moses Release 3.0 and support tols
|UoH
|DONE
|
|
|
|-
|B1.2
|Moses Development Environment
|UoH
|
|'''''due'''''
|
|
|-
|B1.3
|Moses Documentation and tutorials
|UoH
|
|'''''due'''''
|
|
|-
|B2.2
|MT data sets and documentation
|UoH
|
|'''''due'''''
|
|
|-
|B3.1
|Helsinki NMT system with documentation
|UoH
|
|'''''due'''''
|
|
|-
|C1.1
|Dependency Parsing Data version 1
|UU
|
|'''''due'''''
|
|
|-
|C2.1
|Dependency Parsing Parsers version 1
|UU
|
|'''''due'''''
|
|
|-
|C3.1
|Dependency Parsing Parsing tutorial
|UU
|
|'''''due'''''
|
|
|-
|D1.1
|Clarification of applicable licensing schemes
|UoT
|DONE (M3)
|
|
|
|-
|D1.2
|Relevant data sets installed with license managment infrastructure
|UoT
|Will not be done
|
|
|
|-
|E1
|Pre-trained embeddings for ENG,DAN,FIN,NNO,NOB,SWE
|UiO
|DONE
|
|
|
|-
|F1,1
|Extrinsic Evaluation Data First Batch
|UiO(UoC)
|
|DONE
|
|
|-
|F2.1
|Extrinsic Evaluation Code for First Batach
|UiO(UoC)
|
|DONE
|
|
|-
|G1.1
|Running OPUS Server
|UoH
|DONE
|
|
|
|-
|G1.2
|Mirror OPUS data
|UoH
|waiting on policy?
|
|
|
|-
|H1
|Winter School
|UiO
|
|
|'''''due M15'''''
|
|-
|H2
|Web site
|UiO
|DONE (M3)
|
|
|
|-
|H2.2
|Position paper on NoLaiDa
|UiO
|DONE (M6)
|
|
|
|}

== NLPL SG 17-38. Review of personnel situation ==

== NLPL SG 17-39. A new NLPL partner? Computer Science Department @ IT University Of Copenhagen ==
From Stephan's email (7 Nov):
To formalize this hand-over, we will need to ‘sprinkle’ person months
into our spreadsheet. i have revised the original allocations to
* reduce CU to a total of 0.6, 1.2, and 1.2 in 2017, 2018, and 2019,respectively;
* introduce ITU at 0.4, 1.2, and 1.2 in 2017, 2018, and 2019, respectively;
* make up for the ‘loss’ of 1.4 months in 2017 by increasing UiO accordingly.

please see my current proposal here: https://goo.gl/rwqiru

== NLPL SG 17-40. Status report to NeIC board ==

== NLPL SG 17-41. Mid-term evaluation in 2H/3H 2018 ==

== NLPL SG 17-42. Priorities in 2018 ==
We will work with the prospects and outcomes of next year in two groups:
* Group 1: TM,OE,MM,FG
* Group 2: JN,AS,JT,GB,BL

=== Do a cost-benefit analysis of the NLPL for the current year===
* What has the involvement in NLPL cost you?
* What are the immediate benefits, if any, and what are the benefits for 2018?

Group1:
* Stephan: ~2PMs, experience with different system (Taito)
* Filip: Project was bureacracy heavy at the beginning, getting better now. Plus: Setting up infrastructure as end (and not as side effect)
* Martin: More work than expected, but broader perspective on infrastructure issues as benefit

=== Do a emerging technology analysis ===
* What are the technologies you would like to see available/used in the project
* GPUs to be investigated further.
* Exchange of experiences, CPU/GPU comparison (FG: factor 10)

* What are the consequences for the project if the identified technologies are incorporated in the project
* Enabling new technologies.

=== Elaborate the milestones for 2018===
These are the milestones due in a year:
{|
!Milestone
!Milestone description
!lead
!Usefulness
!Risk
|-
|A.1.1
|Project Report Year two
|PM
|5
|1
|-
|B.1.1
|Moses Development environement update
|UoH
|3 Useful as baseline, for teaching; Users from Oslo using Taito; but: MT moved on to neural networks
|1
|-
|B.2.2
|Updated MT data sets and documentation
|UoH
|
|
|-
|B.3.2
|Helsinki NMT system updates
|UoH
|5 Important emerging technology
|
|-
|B.4.1
|Documented Helsinki NMT Baselines
|UoH
|4-5 NMT is new technology
|
|-
|B.4.2
|Documented SMT Baselines
|UoH
|3-4
|
|-
|C.1.2
|Dependency Parsing version 2
|5
|1 Software exists.
|UU
|-
|C.2.2
|Dependency Data version 2
|UU
|5
|1 Data exists.
|-
|C.3.2
|Dependency Parsing tutorial version 2
|UU
|5
|2 does not yet exist, but funds available.
|-
|D.2.2
|Common-Crawl-derived corpora for at least five languages
|UoT
|5 Used by dozens of teams in the CoNNL-Shared Task 2017 (100+ registered users)
|1
|-
|E.2
|Updated Embeddings, including additional languages
|UiO
|4 Downloadable, should be made available in Taito/Abel
|-
|G.3.1
|Web services and their documentation
|UoH
|5
|1 Exists.
|-
|H.1.2
|Winter School ’19
|UiO
|3-4 We know more after WS 18
|3 Funding, Organization, Visibility, Involvement
|}

One way to discuss the milestones for 2018 is to identify more specific targets under each milestone, keeping the benefits and the emerging technologies in mind. Each group member then characterise, each target by usefulness and risk. Use a character from the set {1,2,3,4,5} for usefulness, where 1 = not so useful and 5 = very useful. Do the similar for risk, where 1 = low risk and 5 = high risk. Summaries and average the result and use it for sorting possible targets on usefulness and/or risk. Discuss the list.

== NLPL SG 17-43. Next meetings ==

== NLPL SG 17-44. AOB ==

Home/SG171109

2017-11-09T10:39:44Z

Matthies: /* Do a emerging technology analysis */

[[Category:NLPL steering group meetings 2017]]
'''Note: This draft document is an internal working material for project management. In order not to risk causing misinterpretation and confusion it is not to be shared outside of NeIC without project management consent. Approved steering group minutes are made publicly available on the NeIC external wiki: https://wiki.neic.no/wiki/Nordic_Language_Processing_Laboratory'''

= NLPL steering group meeting =
'''Time''': 2017-11-09
: 9 - 12 CET

'''Place''': Radisson Blu Airport Hotel, OSL, Gardemoen, Norway

'''Invited''':
* Tomasz Malkiewicz, NeIC (PO)
* Joakim Nivre, Uppsala University
* Jörg Tiedemann, University of Helsinki
* Martin Matthiesen, CSC-IT Center for Science Ltd
* Stephan Oepen, University of Oslo
* Anders Søgaard, University of Copenhagen
* Filip Ginter, University of Turku
* Gunnar Bøe, UNINETT Sigma2 AS
* Bjørn Lindi, NeIC (PM)

== NLPL-SG 17-35 The Agenda for the SG meeting ==
* 09:00 NLPL SG 17-35. Attendance and agenda (5’)
* 09:05 NLPL SG 17-36. SG responsibilities according (15')
* 09:20 NLPL SG 17-37. Status of the project - including status of NLPL task forces (30’)
* 09:50 NLPL SG 17-38. Review of personnel situation (15’)
* 10:05 NLPL SG 17-39. A new NLPL partner? Computer Science Department @ IT University Of Copenhagen (10')
* 10:15 NLPL SG 17-40. Status report to NeIC board (10')
* 10:25 Coffee break (5')
* 10:30 NLPL SG 17-41. Mid-term evaluation in 2H/3H 2018 (10')
* 10:40 NLPL SG 17-42. Priorities in 2018 (1h10')
* 11:50 NLPL SG 17-43. Next meetings (5’)
* 11:55 NLPL SG 17-44. AOB (5’)

Suggest to switch 17-38, 17-39

== NLPL SG 17-36. SG responsibilities according==
SG responsibilities according to the PPS model 15'
http://www.ppsonline.se/nordforsk/en/main/skill/ah134

== NLPL SG 17-37. Status of the project - including status of NLPL task forces==
{|
!Milestone
!Milestone Description
!lead
!month 6
!month 12
!month 14
!month 18
|-
|A1.1
|Project Report Year one
|PM
|
|'''''due'''''
|
|
|-
|A2.1
|Setup of colloboration infrastructure
|PM
|DONE(M2)
|
|
|
|-
|A2.2
|Update of colloboration infrastructure
|PM
|
|
|'''''due'''''
|
|-
|A3.1
|Trial environment for portable, modular installation
|PM
|
|'''''due'''''
|
|
|-
|A3.2
|Survey needs and use of emerging technologies
|PM
|
|'''''due'''''
|
|
|-
|A3.3
|Facilitate access to resources at Sigma2 and CSC
|PM
|
|
|
|'''''due'''''
|-
|A3.4
|Cost-benefit Analysis of the laboratory
|PM
|
|'''''due'''''
|
|
|-
|B1.1
|Install Moses Release 3.0 and support tols
|UoH
|DONE
|
|
|
|-
|B1.2
|Moses Development Environment
|UoH
|
|'''''due'''''
|
|
|-
|B1.3
|Moses Documentation and tutorials
|UoH
|
|'''''due'''''
|
|
|-
|B2.2
|MT data sets and documentation
|UoH
|
|'''''due'''''
|
|
|-
|B3.1
|Helsinki NMT system with documentation
|UoH
|
|'''''due'''''
|
|
|-
|C1.1
|Dependency Parsing Data version 1
|UU
|
|'''''due'''''
|
|
|-
|C2.1
|Dependency Parsing Parsers version 1
|UU
|
|'''''due'''''
|
|
|-
|C3.1
|Dependency Parsing Parsing tutorial
|UU
|
|'''''due'''''
|
|
|-
|D1.1
|Clarification of applicable licensing schemes
|UoT
|DONE (M3)
|
|
|
|-
|D1.2
|Relevant data sets installed with license managment infrastructure
|UoT
|Will not be done
|
|
|
|-
|E1
|Pre-trained embeddings for ENG,DAN,FIN,NNO,NOB,SWE
|UiO
|DONE
|
|
|
|-
|F1,1
|Extrinsic Evaluation Data First Batch
|UiO(UoC)
|
|DONE
|
|
|-
|F2.1
|Extrinsic Evaluation Code for First Batach
|UiO(UoC)
|
|DONE
|
|
|-
|G1.1
|Running OPUS Server
|UoH
|DONE
|
|
|
|-
|G1.2
|Mirror OPUS data
|UoH
|waiting on policy?
|
|
|
|-
|H1
|Winter School
|UiO
|
|
|'''''due M15'''''
|
|-
|H2
|Web site
|UiO
|DONE (M3)
|
|
|
|-
|H2.2
|Position paper on NoLaiDa
|UiO
|DONE (M6)
|
|
|
|}

== NLPL SG 17-38. Review of personnel situation ==

== NLPL SG 17-39. A new NLPL partner? Computer Science Department @ IT University Of Copenhagen ==
From Stephan's email (7 Nov):
To formalize this hand-over, we will need to ‘sprinkle’ person months
into our spreadsheet. i have revised the original allocations to
* reduce CU to a total of 0.6, 1.2, and 1.2 in 2017, 2018, and 2019,respectively;
* introduce ITU at 0.4, 1.2, and 1.2 in 2017, 2018, and 2019, respectively;
* make up for the ‘loss’ of 1.4 months in 2017 by increasing UiO accordingly.

please see my current proposal here: https://goo.gl/rwqiru

== NLPL SG 17-40. Status report to NeIC board ==

== NLPL SG 17-41. Mid-term evaluation in 2H/3H 2018 ==

== NLPL SG 17-42. Priorities in 2018 ==
We will work with the prospects and outcomes of next year in two groups:
* Group 1: TM,OE,MM,FG
* Group 2: JN,AS,JT,GB,BL

=== Do a cost-benefit analysis of the NLPL for the current year===
* What has the involvement in NLPL cost you?
* What are the immediate benefits, if any, and what are the benefits for 2018?

Group1:
* Stephan: ~2PMs, experience with different system (Taito)
* Filip: Project was bureacracy heavy at the beginning, getting better now. Plus: Setting up infrastructure as end (and not as side effect)
* Martin: More work than expected, but broader perspective on infrastructure issues as benefit

=== Do a emerging technology analysis ===
* What are the technologies you would like to see available/used in the project
* GPUs to be investigated further.
* Exchange of experiences, CPU/GPU comparison (FG: factor 10)

* What are the consequences for the project if the identified technologies are incorporated in the project
* Enabling new technologies.

=== Elaborate the milestones for 2018===
These are the milestones due in a year:
{|
!Milestone
!Milestone description
!lead
!Usefulness
!Risk
|-
|A.1.1
|Project Report Year two
|PM
|5
|1
|-
|B.1.1
|Moses Development environement update
|UoH
|3 Useful as baseline, for teaching; Users from Oslo using Taito; but: MT moved on to neural networks
|1
|-
|B.2.2
|Updated MT data sets and documentation
|UoH
|
|
|-
|B.3.2
|Helsinki NMT system updates
|UoH
|5 Important emerging technology
|
|-
|B.4.1
|Documented Helsinki NMT Baselines
|UoH
|4-5 NMT is new technology
|
|-
|B.4.2
|Documented SMT Baselines
|UoH
|3-4
|
|-
|C.1.2
|Dependency Parsing version 2
|5
|1 Software exists.
|UU
|-
|C.2.2
|Dependency Data version 2
|UU
|5
|1 Data exists.
|-
|C.3.2
|Dependency Parsing tutorial version 2
|UU
|5
|2 does not yet exist, but funds available.
|-
|D.2.2
|Common-Crawl-derived corpora for at least five languages
|UoT
|5 Used by dozens of teams in the CoNNL-Shared Task 2017 (100+ registered users)
|1
|-
|E.2
|Updated Embeddings, including additional languages
|UiO
|4 Downloadable, should be made available in Taito/Abel
|-
|G.3.1
|Web services and their documentation
|UoH
|-
|5
|1 Exists.
|H.1.2
|Winter School ’19
|UiO
|3-4 We know more after WS 18
|3 Funding, Organization, Visibility, Involvement
|}

One way to discuss the milestones for 2018 is to identify more specific targets under each milestone, keeping the benefits and the emerging technologies in mind. Each group member then characterise, each target by usefulness and risk. Use a character from the set {1,2,3,4,5} for usefulness, where 1 = not so useful and 5 = very useful. Do the similar for risk, where 1 = low risk and 5 = high risk. Summaries and average the result and use it for sorting possible targets on usefulness and/or risk. Discuss the list.

== NLPL SG 17-43. Next meetings ==

== NLPL SG 17-44. AOB ==

Home/SG171109

2017-11-09T10:36:59Z

Matthies: /* Do a cost-benefit analysis of the NLPL for the current year */

[[Category:NLPL steering group meetings 2017]]
'''Note: This draft document is an internal working material for project management. In order not to risk causing misinterpretation and confusion it is not to be shared outside of NeIC without project management consent. Approved steering group minutes are made publicly available on the NeIC external wiki: https://wiki.neic.no/wiki/Nordic_Language_Processing_Laboratory'''

= NLPL steering group meeting =
'''Time''': 2017-11-09
: 9 - 12 CET

'''Place''': Radisson Blu Airport Hotel, OSL, Gardemoen, Norway

'''Invited''':
* Tomasz Malkiewicz, NeIC (PO)
* Joakim Nivre, Uppsala University
* Jörg Tiedemann, University of Helsinki
* Martin Matthiesen, CSC-IT Center for Science Ltd
* Stephan Oepen, University of Oslo
* Anders Søgaard, University of Copenhagen
* Filip Ginter, University of Turku
* Gunnar Bøe, UNINETT Sigma2 AS
* Bjørn Lindi, NeIC (PM)

== NLPL-SG 17-35 The Agenda for the SG meeting ==
* 09:00 NLPL SG 17-35. Attendance and agenda (5’)
* 09:05 NLPL SG 17-36. SG responsibilities according (15')
* 09:20 NLPL SG 17-37. Status of the project - including status of NLPL task forces (30’)
* 09:50 NLPL SG 17-38. Review of personnel situation (15’)
* 10:05 NLPL SG 17-39. A new NLPL partner? Computer Science Department @ IT University Of Copenhagen (10')
* 10:15 NLPL SG 17-40. Status report to NeIC board (10')
* 10:25 Coffee break (5')
* 10:30 NLPL SG 17-41. Mid-term evaluation in 2H/3H 2018 (10')
* 10:40 NLPL SG 17-42. Priorities in 2018 (1h10')
* 11:50 NLPL SG 17-43. Next meetings (5’)
* 11:55 NLPL SG 17-44. AOB (5’)

Suggest to switch 17-38, 17-39

== NLPL SG 17-36. SG responsibilities according==
SG responsibilities according to the PPS model 15'
http://www.ppsonline.se/nordforsk/en/main/skill/ah134

== NLPL SG 17-37. Status of the project - including status of NLPL task forces==
{|
!Milestone
!Milestone Description
!lead
!month 6
!month 12
!month 14
!month 18
|-
|A1.1
|Project Report Year one
|PM
|
|'''''due'''''
|
|
|-
|A2.1
|Setup of colloboration infrastructure
|PM
|DONE(M2)
|
|
|
|-
|A2.2
|Update of colloboration infrastructure
|PM
|
|
|'''''due'''''
|
|-
|A3.1
|Trial environment for portable, modular installation
|PM
|
|'''''due'''''
|
|
|-
|A3.2
|Survey needs and use of emerging technologies
|PM
|
|'''''due'''''
|
|
|-
|A3.3
|Facilitate access to resources at Sigma2 and CSC
|PM
|
|
|
|'''''due'''''
|-
|A3.4
|Cost-benefit Analysis of the laboratory
|PM
|
|'''''due'''''
|
|
|-
|B1.1
|Install Moses Release 3.0 and support tols
|UoH
|DONE
|
|
|
|-
|B1.2
|Moses Development Environment
|UoH
|
|'''''due'''''
|
|
|-
|B1.3
|Moses Documentation and tutorials
|UoH
|
|'''''due'''''
|
|
|-
|B2.2
|MT data sets and documentation
|UoH
|
|'''''due'''''
|
|
|-
|B3.1
|Helsinki NMT system with documentation
|UoH
|
|'''''due'''''
|
|
|-
|C1.1
|Dependency Parsing Data version 1
|UU
|
|'''''due'''''
|
|
|-
|C2.1
|Dependency Parsing Parsers version 1
|UU
|
|'''''due'''''
|
|
|-
|C3.1
|Dependency Parsing Parsing tutorial
|UU
|
|'''''due'''''
|
|
|-
|D1.1
|Clarification of applicable licensing schemes
|UoT
|DONE (M3)
|
|
|
|-
|D1.2
|Relevant data sets installed with license managment infrastructure
|UoT
|Will not be done
|
|
|
|-
|E1
|Pre-trained embeddings for ENG,DAN,FIN,NNO,NOB,SWE
|UiO
|DONE
|
|
|
|-
|F1,1
|Extrinsic Evaluation Data First Batch
|UiO(UoC)
|
|DONE
|
|
|-
|F2.1
|Extrinsic Evaluation Code for First Batach
|UiO(UoC)
|
|DONE
|
|
|-
|G1.1
|Running OPUS Server
|UoH
|DONE
|
|
|
|-
|G1.2
|Mirror OPUS data
|UoH
|waiting on policy?
|
|
|
|-
|H1
|Winter School
|UiO
|
|
|'''''due M15'''''
|
|-
|H2
|Web site
|UiO
|DONE (M3)
|
|
|
|-
|H2.2
|Position paper on NoLaiDa
|UiO
|DONE (M6)
|
|
|
|}

== NLPL SG 17-38. Review of personnel situation ==

== NLPL SG 17-39. A new NLPL partner? Computer Science Department @ IT University Of Copenhagen ==
From Stephan's email (7 Nov):
To formalize this hand-over, we will need to ‘sprinkle’ person months
into our spreadsheet. i have revised the original allocations to
* reduce CU to a total of 0.6, 1.2, and 1.2 in 2017, 2018, and 2019,respectively;
* introduce ITU at 0.4, 1.2, and 1.2 in 2017, 2018, and 2019, respectively;
* make up for the ‘loss’ of 1.4 months in 2017 by increasing UiO accordingly.

please see my current proposal here: https://goo.gl/rwqiru

== NLPL SG 17-40. Status report to NeIC board ==

== NLPL SG 17-41. Mid-term evaluation in 2H/3H 2018 ==

== NLPL SG 17-42. Priorities in 2018 ==
We will work with the prospects and outcomes of next year in two groups:
* Group 1: TM,OE,MM,FG
* Group 2: JN,AS,JT,GB,BL

=== Do a cost-benefit analysis of the NLPL for the current year===
* What has the involvement in NLPL cost you?
* What are the immediate benefits, if any, and what are the benefits for 2018?

Group1:
* Stephan: ~2PMs, experience with different system (Taito)
* Filip: Project was bureacracy heavy at the beginning, getting better now. Plus: Setting up infrastructure as end (and not as side effect)
* Martin: More work than expected, but broader perspective on infrastructure issues as benefit

=== Do a emerging technology analysis ===
* What are the technologies you would like to see available/used in the project
* What are the consequences for the project if the identified technologies are incorporated in the project

=== Elaborate the milestones for 2018===
These are the milestones due in a year:
{|
!Milestone
!Milestone description
!lead
!Usefulness
!Risk
|-
|A.1.1
|Project Report Year two
|PM
|5
|1
|-
|B.1.1
|Moses Development environement update
|UoH
|3 Useful as baseline, for teaching; Users from Oslo using Taito; but: MT moved on to neural networks
|1
|-
|B.2.2
|Updated MT data sets and documentation
|UoH
|
|
|-
|B.3.2
|Helsinki NMT system updates
|UoH
|5 Important emerging technology
|
|-
|B.4.1
|Documented Helsinki NMT Baselines
|UoH
|4-5 NMT is new technology
|
|-
|B.4.2
|Documented SMT Baselines
|UoH
|3-4
|
|-
|C.1.2
|Dependency Parsing version 2
|5
|1 Software exists.
|UU
|-
|C.2.2
|Dependency Data version 2
|UU
|5
|1 Data exists.
|-
|C.3.2
|Dependency Parsing tutorial version 2
|UU
|5
|2 does not yet exist, but funds available.
|-
|D.2.2
|Common-Crawl-derived corpora for at least five languages
|UoT
|5 Used by dozens of teams in the CoNNL-Shared Task 2017 (100+ registered users)
|1
|-
|E.2
|Updated Embeddings, including additional languages
|UiO
|4 Downloadable, should be made available in Taito/Abel
|-
|G.3.1
|Web services and their documentation
|UoH
|-
|5
|1 Exists.
|H.1.2
|Winter School ’19
|UiO
|3-4 We know more after WS 18
|3 Funding, Organization, Visibility, Involvement
|}

One way to discuss the milestones for 2018 is to identify more specific targets under each milestone, keeping the benefits and the emerging technologies in mind. Each group member then characterise, each target by usefulness and risk. Use a character from the set {1,2,3,4,5} for usefulness, where 1 = not so useful and 5 = very useful. Do the similar for risk, where 1 = low risk and 5 = high risk. Summaries and average the result and use it for sorting possible targets on usefulness and/or risk. Discuss the list.

== NLPL SG 17-43. Next meetings ==

== NLPL SG 17-44. AOB ==

Home/SG171109

2017-11-09T10:25:08Z

Matthies: /* Elaborate the milestones for 2018 */

[[Category:NLPL steering group meetings 2017]]
'''Note: This draft document is an internal working material for project management. In order not to risk causing misinterpretation and confusion it is not to be shared outside of NeIC without project management consent. Approved steering group minutes are made publicly available on the NeIC external wiki: https://wiki.neic.no/wiki/Nordic_Language_Processing_Laboratory'''

= NLPL steering group meeting =
'''Time''': 2017-11-09
: 9 - 12 CET

'''Place''': Radisson Blu Airport Hotel, OSL, Gardemoen, Norway

'''Invited''':
* Tomasz Malkiewicz, NeIC (PO)
* Joakim Nivre, Uppsala University
* Jörg Tiedemann, University of Helsinki
* Martin Matthiesen, CSC-IT Center for Science Ltd
* Stephan Oepen, University of Oslo
* Anders Søgaard, University of Copenhagen
* Filip Ginter, University of Turku
* Gunnar Bøe, UNINETT Sigma2 AS
* Bjørn Lindi, NeIC (PM)

== NLPL-SG 17-35 The Agenda for the SG meeting ==
* 09:00 NLPL SG 17-35. Attendance and agenda (5’)
* 09:05 NLPL SG 17-36. SG responsibilities according (15')
* 09:20 NLPL SG 17-37. Status of the project - including status of NLPL task forces (30’)
* 09:50 NLPL SG 17-38. Review of personnel situation (15’)
* 10:05 NLPL SG 17-39. A new NLPL partner? Computer Science Department @ IT University Of Copenhagen (10')
* 10:15 NLPL SG 17-40. Status report to NeIC board (10')
* 10:25 Coffee break (5')
* 10:30 NLPL SG 17-41. Mid-term evaluation in 2H/3H 2018 (10')
* 10:40 NLPL SG 17-42. Priorities in 2018 (1h10')
* 11:50 NLPL SG 17-43. Next meetings (5’)
* 11:55 NLPL SG 17-44. AOB (5’)

Suggest to switch 17-38, 17-39

== NLPL SG 17-36. SG responsibilities according==
SG responsibilities according to the PPS model 15'
http://www.ppsonline.se/nordforsk/en/main/skill/ah134

== NLPL SG 17-37. Status of the project - including status of NLPL task forces==
{|
!Milestone
!Milestone Description
!lead
!month 6
!month 12
!month 14
!month 18
|-
|A1.1
|Project Report Year one
|PM
|
|'''''due'''''
|
|
|-
|A2.1
|Setup of colloboration infrastructure
|PM
|DONE(M2)
|
|
|
|-
|A2.2
|Update of colloboration infrastructure
|PM
|
|
|'''''due'''''
|
|-
|A3.1
|Trial environment for portable, modular installation
|PM
|
|'''''due'''''
|
|
|-
|A3.2
|Survey needs and use of emerging technologies
|PM
|
|'''''due'''''
|
|
|-
|A3.3
|Facilitate access to resources at Sigma2 and CSC
|PM
|
|
|
|'''''due'''''
|-
|A3.4
|Cost-benefit Analysis of the laboratory
|PM
|
|'''''due'''''
|
|
|-
|B1.1
|Install Moses Release 3.0 and support tols
|UoH
|DONE
|
|
|
|-
|B1.2
|Moses Development Environment
|UoH
|
|'''''due'''''
|
|
|-
|B1.3
|Moses Documentation and tutorials
|UoH
|
|'''''due'''''
|
|
|-
|B2.2
|MT data sets and documentation
|UoH
|
|'''''due'''''
|
|
|-
|B3.1
|Helsinki NMT system with documentation
|UoH
|
|'''''due'''''
|
|
|-
|C1.1
|Dependency Parsing Data version 1
|UU
|
|'''''due'''''
|
|
|-
|C2.1
|Dependency Parsing Parsers version 1
|UU
|
|'''''due'''''
|
|
|-
|C3.1
|Dependency Parsing Parsing tutorial
|UU
|
|'''''due'''''
|
|
|-
|D1.1
|Clarification of applicable licensing schemes
|UoT
|DONE (M3)
|
|
|
|-
|D1.2
|Relevant data sets installed with license managment infrastructure
|UoT
|Will not be done
|
|
|
|-
|E1
|Pre-trained embeddings for ENG,DAN,FIN,NNO,NOB,SWE
|UiO
|DONE
|
|
|
|-
|F1,1
|Extrinsic Evaluation Data First Batch
|UiO(UoC)
|
|DONE
|
|
|-
|F2.1
|Extrinsic Evaluation Code for First Batach
|UiO(UoC)
|
|DONE
|
|
|-
|G1.1
|Running OPUS Server
|UoH
|DONE
|
|
|
|-
|G1.2
|Mirror OPUS data
|UoH
|waiting on policy?
|
|
|
|-
|H1
|Winter School
|UiO
|
|
|'''''due M15'''''
|
|-
|H2
|Web site
|UiO
|DONE (M3)
|
|
|
|-
|H2.2
|Position paper on NoLaiDa
|UiO
|DONE (M6)
|
|
|
|}

== NLPL SG 17-38. Review of personnel situation ==

== NLPL SG 17-39. A new NLPL partner? Computer Science Department @ IT University Of Copenhagen ==
From Stephan's email (7 Nov):
To formalize this hand-over, we will need to ‘sprinkle’ person months
into our spreadsheet. i have revised the original allocations to
* reduce CU to a total of 0.6, 1.2, and 1.2 in 2017, 2018, and 2019,respectively;
* introduce ITU at 0.4, 1.2, and 1.2 in 2017, 2018, and 2019, respectively;
* make up for the ‘loss’ of 1.4 months in 2017 by increasing UiO accordingly.

please see my current proposal here: https://goo.gl/rwqiru

== NLPL SG 17-40. Status report to NeIC board ==

== NLPL SG 17-41. Mid-term evaluation in 2H/3H 2018 ==

== NLPL SG 17-42. Priorities in 2018 ==
We will work with the prospects and outcomes of next year in two groups:
* Group 1: TM,OE,MM,FG
* Group 2: JN,AS,JT,GB,BL

=== Do a cost-benefit analysis of the NLPL for the current year===
* What has the involvement in NLPL cost you?
* What are the immediate benefits, if any, and what are the benefits for 2018?

=== Do a emerging technology analysis ===
* What are the technologies you would like to see available/used in the project
* What are the consequences for the project if the identified technologies are incorporated in the project

=== Elaborate the milestones for 2018===
These are the milestones due in a year:
{|
!Milestone
!Milestone description
!lead
!Usefulness
!Risk
|-
|A.1.1
|Project Report Year two
|PM
|5
|1
|-
|B.1.1
|Moses Development environement update
|UoH
|3 Useful as baseline, for teaching; Users from Oslo using Taito; but: MT moved on to neural networks
|1
|-
|B.2.2
|Updated MT data sets and documentation
|UoH
|
|
|-
|B.3.2
|Helsinki NMT system updates
|UoH
|5 Important emerging technology
|
|-
|B.4.1
|Documented Helsinki NMT Baselines
|UoH
|4-5 NMT is new technology
|
|-
|B.4.2
|Documented SMT Baselines
|UoH
|3-4
|
|-
|C.1.2
|Dependency Parsing version 2
|5
|1 Software exists.
|UU
|-
|C.2.2
|Dependency Data version 2
|UU
|5
|1 Data exists.
|-
|C.3.2
|Dependency Parsing tutorial version 2
|UU
|5
|2 does not yet exist, but funds available.
|-
|D.2.2
|Common-Crawl-derived corpora for at least five languages
|UoT
|5 Used by dozens of teams in the CoNNL-Shared Task 2017 (100+ registered users)
|1
|-
|E.2
|Updated Embeddings, including additional languages
|UiO
|4 Downloadable, should be made available in Taito/Abel
|-
|G.3.1
|Web services and their documentation
|UoH
|-
|5
|1 Exists.
|H.1.2
|Winter School ’19
|UiO
|3-4 We know more after WS 18
|3 Funding, Organization, Visibility, Involvement
|}

One way to discuss the milestones for 2018 is to identify more specific targets under each milestone, keeping the benefits and the emerging technologies in mind. Each group member then characterise, each target by usefulness and risk. Use a character from the set {1,2,3,4,5} for usefulness, where 1 = not so useful and 5 = very useful. Do the similar for risk, where 1 = low risk and 5 = high risk. Summaries and average the result and use it for sorting possible targets on usefulness and/or risk. Discuss the list.

== NLPL SG 17-43. Next meetings ==

== NLPL SG 17-44. AOB ==

Infrastructure/installation/guide

2017-11-08T10:45:40Z

Matthies: removed doube version history

= Software and Data Installation Guide =

= Purpose =

Guidelines to install software and data at resources provided within the Nordic Language Processing Laboratory.

= Resources =
'''Taito''' is a cluster operated at CSC (Finland). User documentation is available at https://research.csc.fi/taito-user-guide.
Each user has access to different areas for storing files: <tt>$HOME</tt> with a quota of 50 GB, <tt>$USERAPPL</tt> with a quota of 50 GB,
and a project area (see below) under <tt>/proj/nlpl/</tt> (access via CSC storage project for NLPL managed by Stephan Oepen).

'''Abel''' is a cluster operated at UiO (Norway). User documentation is available at http://www.uio.no/english/services/it/research/hpc/abel/help/user-guide/.
Each user has access to different areas for storing files: <tt>$HOME</tt> with a quota of 500 GB, and a project area under <tt>/projects/nlpl/</tt> (access via UNIX group <tt>hpc-nlpl</tt> managed by Stephan Oepen).

= Software =

The software environment of the laboratory shall be as uniform as possible from a user perspective. The software environment is comprised of libraries and applications installed system-wide or in a space specific for the laboratory.
System-wide libraries and applications are not considered at the current stage; their installation can be requested through the
<tt>infrastructure@nlpl.eu</tt> task force.

Laboratory-specific software is stored in a location referred to as <tt>$NLPL_SOFTWARE</tt> which points to <tt>/proj/nlpl/software/</tt>
and <tt>/projects/nlpl/software/</tt> for Taito and Abel, respectively.

Under <tt>$NLPL_SOFTWARE</tt> on each system, applications and libraries are stored with the following directory layout:

: $NLPL_SOFTWARE/__APPNAME__/__APPVERSION__

where ''__APPNAME__'' contains only lower case symbols (with some exceptions such as R) and ''__APPVERSION__'' contains the version of the software (as provided by its vendor).

For each installation, there should be a <tt>README</tt> file (or page on the wiki) documenting the exact versions used (and how to obtain them) and the steps used to build the software.
The infrastructure task force will soon make a proposal for how to manage installation scripts and notes in an NLPL-associated version control system.

Optionally, for each software that is installed the sources and build scripts (if adjusted to the NLPL environment) can be stored under <tt>$NLPL_SOFTWARE/sources/</tt>. This directory should be ‘cleaned up’ after the installation and possibly compressed. If possible, it may be useful to create a log file of the complete installation session and preserve that file (in compressed form).

The user environment on Abel and Taito is configured using the so-called ''modules'' system which abstracts actual installation paths and sets certain environment variables in a standardized form.
For each installed software component, there should be a module definition file under <tt>$NLPL_SOFTWARE/modulefiles/__APPNAME__/__APPVERSION__</tt>
See the separate section on the modules system below for further details on the definition files.

At start only limited documentation will be available through the modules system.
A later version of this guide will recommend best practices for documentation.

= Data =

The data sets provided by NLPL shall be presented as uniformly as possible from a user point perspective. The data set environment is predominantly comprised of freely available data. Restricted data sets are not considered at the current stage (see the section on Open Questions below).

Data sets shall be installed under <tt>$NLPL_DATA</tt> which points to <tt>/proj/nlpl/data/</tt> and <tt>/projects/nlpl/data/</tt> for Taito and Abel, respectively.
The top-level data directory is sub-divided by NLPL activities, with sub-directories <tt>translation</tt>, <tt>parsing</tt>, </tt>corpora</tt>, <tt>vectors</tt>, and <tt>opus</tt>.
In principle, each activity is free to decide on the directory layout within their sub-directory, where it may or may not be
most practicaly to organize according to languages, for example.
Where language identifiers are part of directory or file names, they should follow the
[https://www.loc.gov/standards/iso639-2/php/code_list.php three-letter ISO codes].
Here as elsewhere in the NLPL directory space, upper-case letters shall be avoided in file and directory names
(except maybe for de-facto standard names like <tt>Makefile</tt> or <tt>README</tt>).

= The Modules System =

At start only limited documentation will be available through the module system. A subsequent version of this guide will recommend best practices for documentation.
Modules
Modules (command line tool module) allow for a simple and common way of configuring a user's environment to get access to executables, libraries, development files, data sets, etc.

The most essential commands are

; module avail
: Shows which modules are available.
; module list
: Shows which modules have been loaded.
; module load name/version
: Loads module with name name and version version.
; module rm name/version
: Unloads module with name name and version version.
; module purge
: Unloads all modules.
; module show name/version
: Shows the definition of the module.
; module whatis name/version
: Shows a brief information on what this module provides (for Abel).
; module help name/version
: Shows a brief information on what this module provides (for Taito).
; module use -a PATH
: Append <tt>PATH</tt> to the search path for module definition files.

Modules are defined with (short) text files using Tcl and Lua on Abel and Taito, respectively. For modules specific to the laboratory, these files shall be stored under the abovementioned directory layout (see the sections on Software and Data Sets). Integrating modules in the system requires the directory containing these files be included in the search path of the module system (see <tt>module use -a</tt> above). For example, include the command

module use -a $NLPL_SOFTWARE/modulefiles

in your <tt>.bashrc</tt> on Abel and Taito with the correct, system-specific value for <tt>$NLPL_SOFTWARE</tt> (see above).

= Open Questions =

* How to provide documentation (on http://www.nlpl.eu)
* How to test/validate a software that it actually works (e.g. by someone else than the one who has installed it ... based on the provided documentation)
* How to test software to ensure functional identity across systems
* How to sync data sets across systems
* Pick VCS to maintain installation scripts and notes.
* Handling of data sets with access restrictions

= Version History =

{|
!Version !! Date !! Author !! Note
|-
| 0.1 || 2017-04-26 || trz || initial draft
|-
| 0.2 || 2017-05-20 || trz || added information on modules and accessing shared storage space, cleaned up doc
|-
| 0.3 || 2017-05-31 || trz || small fixes; first version to be used as guidelines
|-
| 0.4 || 2017-11-06 || oe || updates from the infrastructure task force
|}

Infrastructure/installation/guide

2017-11-08T10:44:22Z

Matthies:

= Software and Data Installation Guide =

= Version history =

Version
Date
Note
0.1
2017-04-26
Initial draft by trz
0.2
2017-05-20
Added information on modules and accessing shared storage space, cleaned up doc (moving future topics to section at the end)
0.3
2017-05-31
Small fixes; 1st version to be used as guidelines

= Purpose =

Guidelines to install software and data at resources provided within the Nordic Language Processing Laboratory.

= Resources =
'''Taito''' is a cluster operated at CSC (Finland). User documentation is available at https://research.csc.fi/taito-user-guide.
Each user has access to different areas for storing files: <tt>$HOME</tt> with a quota of 50 GB, <tt>$USERAPPL</tt> with a quota of 50 GB,
and a project area (see below) under <tt>/proj/nlpl/</tt> (access via CSC storage project for NLPL managed by Stephan Oepen).

'''Abel''' is a cluster operated at UiO (Norway). User documentation is available at http://www.uio.no/english/services/it/research/hpc/abel/help/user-guide/.
Each user has access to different areas for storing files: <tt>$HOME</tt> with a quota of 500 GB, and a project area under <tt>/projects/nlpl/</tt> (access via UNIX group <tt>hpc-nlpl</tt> managed by Stephan Oepen).

= Software =

The software environment of the laboratory shall be as uniform as possible from a user perspective. The software environment is comprised of libraries and applications installed system-wide or in a space specific for the laboratory.
System-wide libraries and applications are not considered at the current stage; their installation can be requested through the
<tt>infrastructure@nlpl.eu</tt> task force.

Laboratory-specific software is stored in a location referred to as <tt>$NLPL_SOFTWARE</tt> which points to <tt>/proj/nlpl/software/</tt>
and <tt>/projects/nlpl/software/</tt> for Taito and Abel, respectively.

Under <tt>$NLPL_SOFTWARE</tt> on each system, applications and libraries are stored with the following directory layout:

: $NLPL_SOFTWARE/__APPNAME__/__APPVERSION__

where ''__APPNAME__'' contains only lower case symbols (with some exceptions such as R) and ''__APPVERSION__'' contains the version of the software (as provided by its vendor).

For each installation, there should be a <tt>README</tt> file (or page on the wiki) documenting the exact versions used (and how to obtain them) and the steps used to build the software.
The infrastructure task force will soon make a proposal for how to manage installation scripts and notes in an NLPL-associated version control system.

Optionally, for each software that is installed the sources and build scripts (if adjusted to the NLPL environment) can be stored under <tt>$NLPL_SOFTWARE/sources/</tt>. This directory should be ‘cleaned up’ after the installation and possibly compressed. If possible, it may be useful to create a log file of the complete installation session and preserve that file (in compressed form).

The user environment on Abel and Taito is configured using the so-called ''modules'' system which abstracts actual installation paths and sets certain environment variables in a standardized form.
For each installed software component, there should be a module definition file under <tt>$NLPL_SOFTWARE/modulefiles/__APPNAME__/__APPVERSION__</tt>
See the separate section on the modules system below for further details on the definition files.

At start only limited documentation will be available through the modules system.
A later version of this guide will recommend best practices for documentation.

= Data =

The data sets provided by NLPL shall be presented as uniformly as possible from a user point perspective. The data set environment is predominantly comprised of freely available data. Restricted data sets are not considered at the current stage (see the section on Open Questions below).

Data sets shall be installed under <tt>$NLPL_DATA</tt> which points to <tt>/proj/nlpl/data/</tt> and <tt>/projects/nlpl/data/</tt> for Taito and Abel, respectively.
The top-level data directory is sub-divided by NLPL activities, with sub-directories <tt>translation</tt>, <tt>parsing</tt>, </tt>corpora</tt>, <tt>vectors</tt>, and <tt>opus</tt>.
In principle, each activity is free to decide on the directory layout within their sub-directory, where it may or may not be
most practicaly to organize according to languages, for example.
Where language identifiers are part of directory or file names, they should follow the
[https://www.loc.gov/standards/iso639-2/php/code_list.php three-letter ISO codes].
Here as elsewhere in the NLPL directory space, upper-case letters shall be avoided in file and directory names
(except maybe for de-facto standard names like <tt>Makefile</tt> or <tt>README</tt>).

= The Modules System =

At start only limited documentation will be available through the module system. A subsequent version of this guide will recommend best practices for documentation.
Modules
Modules (command line tool module) allow for a simple and common way of configuring a user's environment to get access to executables, libraries, development files, data sets, etc.

The most essential commands are

; module avail
: Shows which modules are available.
; module list
: Shows which modules have been loaded.
; module load name/version
: Loads module with name name and version version.
; module rm name/version
: Unloads module with name name and version version.
; module purge
: Unloads all modules.
; module show name/version
: Shows the definition of the module.
; module whatis name/version
: Shows a brief information on what this module provides (for Abel).
; module help name/version
: Shows a brief information on what this module provides (for Taito).
; module use -a PATH
: Append <tt>PATH</tt> to the search path for module definition files.

Modules are defined with (short) text files using Tcl and Lua on Abel and Taito, respectively. For modules specific to the laboratory, these files shall be stored under the abovementioned directory layout (see the sections on Software and Data Sets). Integrating modules in the system requires the directory containing these files be included in the search path of the module system (see <tt>module use -a</tt> above). For example, include the command

module use -a $NLPL_SOFTWARE/modulefiles

in your <tt>.bashrc</tt> on Abel and Taito with the correct, system-specific value for <tt>$NLPL_SOFTWARE</tt> (see above).

= Open Questions =

* How to provide documentation (on http://www.nlpl.eu)
* How to test/validate a software that it actually works (e.g. by someone else than the one who has installed it ... based on the provided documentation)
* How to test software to ensure functional identity across systems
* How to sync data sets across systems
* Pick VCS to maintain installation scripts and notes.
* Handling of data sets with access restrictions

= Version History =

{|
!Version !! Date !! Author !! Note
|-
| 0.1 || 2017-04-26 || trz || initial draft
|-
| 0.2 || 2017-05-20 || trz || added information on modules and accessing shared storage space, cleaned up doc
|-
| 0.3 || 2017-05-31 || trz || small fixes; first version to be used as guidelines
|-
| 0.4 || 2017-11-06 || oe || updates from the infrastructure task force
|}

Infrastructure/resources

2017-10-18T11:01:58Z

Matthies: /* Gaining Access */