Community/training

From Nordic Language Processing Laboratory
(Difference between revisions)
Jump to: navigation, search
(Programme)
(Programme)
Line 48: Line 48:
 
!colspan=3|Sunday, February 2, 2020
 
!colspan=3|Sunday, February 2, 2020
 
|-
 
|-
| 14:00 || 15:30 || '''Session 1''' Yoav Goldberg
+
| 14:00 || 15:30 || '''Session 1''' Yoav Goldberg: ''Introduction to Neural Network Abstractions and Encoder–Decoder Architectures''
 
|-
 
|-
 
| 15:30 || 15:50 || Coffee Break
 
| 15:30 || 15:50 || Coffee Break
 
|-
 
|-
| 15:50 || 17:20 || '''Session 2''' <ul><li>Joakim Nivre & Artur Kulmizev</li><li>Stephan Oepen & Daniel Hershcovich</li></ul>
+
| 15:50 || 17:20 || '''Session 2''' Jörg Tiedemann & Alessandro Raganato: ''A Practical Crash Course in Neural Machine Translation''
 
|-
 
|-
 
| 17:20 || 17:40 || Coffee Break
 
| 17:20 || 17:40 || Coffee Break
 
|-
 
|-
| 17:40 || 19:10 || '''Session 3''' Yoav Goldberg
+
| 17:40 || 19:10 || '''Session 3''' Yoav Goldberg: ''Topics in Representation Learning''
 
|-
 
|-
 
| 19:30 ||  || Dinner
 
| 19:30 ||  || Dinner
Line 67: Line 67:
 
|colspan=3 | Breakfast is available from 07:30
 
|colspan=3 | Breakfast is available from 07:30
 
|-
 
|-
| 08:30 || 10:00 || '''Session 4''' Yoav Goldberg
+
| 08:30 || 10:00 || '''Session 4''' Yoav Goldberg: ''Interpretability and Black-Box NLP''
 
|-
 
|-
 
|colspan=3| Lunch is available between 13:00 and 14:30
 
|colspan=3| Lunch is available between 13:00 and 14:30
 
|-
 
|-
| 15:00 || 16:20 || '''Session 5''' Thomas Wolf: Transfer Learning 1
+
| 15:00 || 16:20 || '''Session 5''' Thomas Wolf: ''Transfer Learning 1''
 
|-
 
|-
 
| 16:20 || 16:40 || Coffee Break
 
| 16:20 || 16:40 || Coffee Break
 
|-
 
|-
| 16:40 || 18:00 || '''Session 6''' Filip Ginter & Antti Virtanen
+
| 16:40 || 18:00 || '''Session 6''' Filip Ginter & Antti Virtanen: ''Experiences and a Hands-On Tutorial on Training BERT from Scratch in a Multi-GPU Setting''
 
|-
 
|-
 
| 18:00 || 18:10 || Coffee Break
 
| 18:00 || 18:10 || Coffee Break
 
|-
 
|-
| 18:10 || 19:30 || '''Session 7''' Thomas Wolf: Transfer Learning 2
+
| 18:10 || 19:30 || '''Session 7''' Thomas Wolf: ''Transfer Learning 2''
 
|-
 
|-
 
| 19:30 ||  || Dinner
 
| 19:30 ||  || Dinner
Line 91: Line 91:
 
|colspan=3| Breakfast is available from 07:30
 
|colspan=3| Breakfast is available from 07:30
 
|-
 
|-
| 08:30 || 10:00 || '''Session 8''' Jörg Tiedemann & Alessandro Raganato
+
| 08:30 || 10:00 || '''Session 8''' <ul><li>Joakim Nivre & Artur Kulmizev: ''Syntactic Dependency Parsing''</li><li>Stephan Oepen & Daniel Hershcovich: ''Meaning Representation Parsing''</li></ul>
 
|-
 
|-
 
| 10:00 || 10:30 || Coffee Break
 
| 10:00 || 10:30 || Coffee Break
 
|-
 
|-
| 10:30 || 12:00 || '''Session 9''' Thomas Wolf: Limitations of Transfer Learning (Tentative Title)
+
| 10:30 || 12:00 || '''Session 9''' Thomas Wolf: ''Limitations of Transfer Learning (Tentative Title)''
 
|-
 
|-
 
| 12:30 || 13:30 || Lunch
 
| 12:30 || 13:30 || Lunch

Revision as of 15:46, 26 January 2020

Contents

Background

A desirable side-effect of the NLPL cooperation is community formation, i.e. strengthening interaction and collaboration among Nordic research teams in NLP and advancing a shared level of knowledge and experience in using national e-Infrastructures for large-scale NLP research. Towards these goals, the project organizes an annual three-day winter school. For additional background, please see the archival pages from the 2018 and 2019 NLPL Winter Schools].

For early 2020, NLPL will hold its winter school from Sunday, February 2, to Tuesday, February 4, 2020, at a mountain-side hotel (with skiing opportunities) about two hours north of Oslo. The project will organize group bus transfer from and to the Oslo airport Gardermoen, leaving the airport at 9:30 on Sunday morning and returning there around 17:30 on Tuesday afternoon.

The main external instructors in 2020 will be Yoav Goldberg (Bar Ilan University and Allen Institute for AI) and Thomas Wolf (Huggingface). Additional sessions will be contributed by NLPL project members, including

  • Filip Ginter and Antti Virtanen, on multi-gpu training of language-specific BERTs;
  • Joakim Nivre and Artur Kulmizev, on syntactic dependency parsing in the neural age;
  • Stephan Oepen and Daniel Hershcovich, on the 2019 and 2020 CoNLL tasks on semantic parsing;
  • Jörg Tiedemann and Alessandro Raganato, with a practical crash course in neural MT.

Some sessions will combine lecturing and hands-on exercises. The winter school programme will be complemented with an evening ‘research bazar’ (by participants) to stimulate academic socializing and possibly a ‘walk-through’ of available software, data, and service resources in the NLPL Virtual Laboratory.

The winter school is subsidized by the project: there is no fee for participants and no charge for the bus transfer to and from the conference hotel. All participants will have to cover their own travel and accomodation at Skeikampen, however. Two nights at the hotel, including all meals, will come to NOK 2865, to be paid to the hotel directly.

Programme

Sunday, February 2, 2020
14:00 15:30 Session 1 Yoav Goldberg: Introduction to Neural Network Abstractions and Encoder–Decoder Architectures
15:30 15:50 Coffee Break
15:50 17:20 Session 2 Jörg Tiedemann & Alessandro Raganato: A Practical Crash Course in Neural Machine Translation
17:20 17:40 Coffee Break
17:40 19:10 Session 3 Yoav Goldberg: Topics in Representation Learning
19:30 Dinner
Monday, February 3, 2020
Breakfast is available from 07:30
08:30 10:00 Session 4 Yoav Goldberg: Interpretability and Black-Box NLP
Lunch is available between 13:00 and 14:30
15:00 16:20 Session 5 Thomas Wolf: Transfer Learning 1
16:20 16:40 Coffee Break
16:40 18:00 Session 6 Filip Ginter & Antti Virtanen: Experiences and a Hands-On Tutorial on Training BERT from Scratch in a Multi-GPU Setting
18:00 18:10 Coffee Break
18:10 19:30 Session 7 Thomas Wolf: Transfer Learning 2
19:30 Dinner


Tuesday, February 4, 2020
Breakfast is available from 07:30
08:30 10:00 Session 8
  • Joakim Nivre & Artur Kulmizev: Syntactic Dependency Parsing
  • Stephan Oepen & Daniel Hershcovich: Meaning Representation Parsing
10:00 10:30 Coffee Break
10:30 12:00 Session 9 Thomas Wolf: Limitations of Transfer Learning (Tentative Title)
12:30 13:30 Lunch

Registration

In total, we anticipate around 45 participants in the 2020 Winter School. Please register your intent of participation through our on-line registration form. We will process requests for participation on a first-come, first-served basis; the closing date for registration is Friday, December 13, 2019. Once confirmed by the organizing team, registration will establish a binding agreement with the hotel and a cancellation fee will be incurred (unless we can find someone else to ‘take over’ last-minute spaces).

Contact

The 2020 NLPL Winter School is organized by a team of volunteers, Li-Hsin Chang, Filip Ginter, Bjørn Lindi, Farrokh Mehryary, Joakim Nivre, Stephan Oepen, and Jörg Tiedemann. For all inquiries regarding registration, the programme, logistics, or such, please contact outreach@nlpl.eu.

Participants

  1. Jordi Armengol-Estapé (Barcelona)
  2. Pepa Atanasova (Copenhagen)
  3. Jeremy Barnes (Oslo)
  4. Ali Basirat (Uppsala)
  5. Aleksandrs Berdicevskis (Gothenburg)
  6. Maja Buljan (Oslo)
  7. Li-Hsin Chang (Turku, co-organizer)
  8. Manuel Ciosici (Copenhagen)
  9. Cheikh Bamba Dione (Bergen)
  10. Adam Ek (Gothenburg)
  11. Filip Ginter (Turku, co-organizer)
  12. Yoav Goldberg (Tel Aviv, presenter)
  13. Rob van der Goot (Copenhagen)
  14. Daniel Hershcovich (Copenhagen)
  15. Andreas Holm (Copenhagen)
  16. Safiqul Islam (Oslo)
  17. Suwisa Kaewphan (Turku)
  18. Jenna Kanerva (Turku)
  19. Martin Krallinger (Barcelona)
  20. Artur Kulmizev (Uppsala)
  21. Maria Kunilovskaya (Wolverhampton)
  22. Jenny Kunz (Linköping)
  23. Andrey Kutuzov (Oslo)
  24. Anna Lindahl (Gothenburg)
  25. Ellinor Lindqvist (Uppsala)
  26. Juhani Luotolahti (Turku)
  27. Jan Tore Lønning (Oslo)
  28. Arild Matsson (Gothenburg)
  29. Maite Melero (Barcelona)
  30. Farrokh Mehryary (Turku, co-organizer)
  31. Antonio Miranda (Barcelona)
  32. Joakim Nivre (Uppsala, co-organizer)
  33. Stephan Oepen (Oslo, co-organizer)
  34. Ildiko Pilan (Oslo)
  35. Alessandro Raganato (Helsinki)
  36. Vinit Ravishankar (Oslo)
  37. Arradi Nur Rizal (Uppsala)
  38. Samuel Rönnqvist (Turku)
  39. Stian Rødven Eide (Gothenburg)
  40. Jörg Tiedemann (Helsinki, co-organizer)
  41. Samia Touileb (Oslo)
  42. Erik Velldal (Oslo)
  43. Daniel Varab (Copenhagen)
  44. Marta Villegas (Barcelona)
  45. Antti Virtanen (Turku)
  46. Michael Welzl (Oslo)
  47. Thomas Wolf (Huggingface, presenter)
  48. Dustin Wright (Copenhagen)
  49. Lilja Øvrelid (Oslo)
Personal tools
Namespaces

Variants
Actions
Navigation
Tools