User contributions
(newest | oldest) View (newer 100 | older 100) (20 | 50 | 100 | 250 | 500)
- 16:48, 7 July 2021 (diff | hist) . . (+762) . . Infrastructure/software/easybuild (→Community Maintenance)
- 16:32, 7 July 2021 (diff | hist) . . (+166) . . Infrastructure/software/easybuild (→Usage Instructions)
- 16:30, 7 July 2021 (diff | hist) . . (-2) . . Infrastructure/software/easybuild (→Installation Instructions)
- 16:30, 7 July 2021 (diff | hist) . . (+794) . . N Infrastructure/software/easybuild (Created page with "= Background = With support from the EOSC-Nordic project, the NLPL use case has created a blueprint for fully automated installation of the (software core of the) NLPL virtua...")
- 16:19, 26 March 2021 (diff | hist) . . (+4) . . Eosc/pretraining/nvidia (→Setting things up)
- 20:34, 25 March 2021 (diff | hist) . . (+1) . . Lumi/pilot (→LUMI-G Pilot)
- 20:34, 25 March 2021 (diff | hist) . . (+36) . . Lumi/pilot (→LUMI-G Pilot)
- 20:32, 25 March 2021 (diff | hist) . . (+145) . . Lumi/pilot (→LUMI-G Pilot)
- 20:28, 25 March 2021 (diff | hist) . . (+385) . . N Lumi/pilot (Created page with "= LUMI-G Pilot = In late 2021, the shared LUMI supercomputer will (likely) open for trial usage of its vast gpu partition. NLPL partners in Finland (Turku and Helsinki) and N...")
- 16:36, 25 March 2021 (diff | hist) . . (+23) . . Eosc/pretraining/nvidia (→Background)
- 14:46, 28 January 2021 (diff | hist) . . (+359) . . Eosc/easybuild (→Toward a Blueprint)
- 14:38, 28 January 2021 (diff | hist) . . (+159) . . Eosc/easybuild (→Toward a Blueprint)
- 14:35, 28 January 2021 (diff | hist) . . (+865) . . Eosc/easybuild (→References)
- 09:52, 13 January 2021 (diff | hist) . . (+19) . . Vectors/norlm (→Acknowledgements)
- 09:49, 13 January 2021 (diff | hist) . . (+1) . . Vectors/norlm (→Norwegian Large-scale Language Models)
- 09:49, 13 January 2021 (diff | hist) . . (+338) . . Vectors/norlm (→Norwegian Large-scale Language Models)
- 09:28, 13 January 2021 (diff | hist) . . (+171) . . Vectors/norlm/norbert (→NorBERT: Bidirectional Encoder Representations from Transformers)
- 09:12, 13 January 2021 (diff | hist) . . (+168) . . Vectors/norlm/norbert (→NorBERT: Bidirectional Encoder Representations from Transformers)
- 22:23, 12 January 2021 (diff | hist) . . (+12) . . Vectors/home (→Background) (current)
- 22:23, 12 January 2021 (diff | hist) . . (+13) . . Vectors/home (→Background)
- 19:11, 12 January 2021 (diff | hist) . . (0) . . Vectors/norlm/norbert (→NorBERT model details)
- 19:11, 12 January 2021 (diff | hist) . . (0) . . Vectors/norlm/norbert (→Training code)
- 19:10, 12 January 2021 (diff | hist) . . (0) . . Vectors/norlm/norbert (→Training overview)
- 19:10, 12 January 2021 (diff | hist) . . (0) . . Vectors/norlm/norbert (→Training corpus)
- 19:06, 12 January 2021 (diff | hist) . . (+10) . . Vectors/norlm
- 19:01, 12 January 2021 (diff | hist) . . (+29) . . Vectors/norlm (→Norwegian Contextualized Language Models)
- 19:00, 12 January 2021 (diff | hist) . . (0) . . N File:Norbert.png (current)
- 18:43, 12 January 2021 (diff | hist) . . (+4) . . Vectors/home (→Background)
- 18:42, 12 January 2021 (diff | hist) . . (-1) . . Home (→Resources) (current)
- 18:41, 12 January 2021 (diff | hist) . . (+139) . . Home (→Resources)
- 17:33, 12 January 2021 (diff | hist) . . (+329) . . Vectors/norlm (→Available Models)
- 17:21, 12 January 2021 (diff | hist) . . (+188) . . Vectors/norlm (→License and Access)
- 16:59, 12 January 2021 (diff | hist) . . (+430) . . Vectors/norlm (→Acknowledgements)
- 16:52, 12 January 2021 (diff | hist) . . (+799) . . Vectors/norlm (→Background)
- 15:23, 12 January 2021 (diff | hist) . . (+108) . . Vectors/norlm (→Available Models)
- 15:21, 12 January 2021 (diff | hist) . . (+6) . . Vectors/norlm (→Available Models)
- 15:19, 12 January 2021 (diff | hist) . . (+72) . . Vectors/norlm (→Background)
- 21:38, 11 January 2021 (diff | hist) . . (+309) . . Vectors/norlm (→Available Models)
- 17:27, 8 January 2021 (diff | hist) . . (+32) . . Vectors/norlm (→Models)
- 17:16, 8 January 2021 (diff | hist) . . (+69) . . Vectors/norlm (→Models)
- 16:29, 8 January 2021 (diff | hist) . . (+25) . . m Vectors/norlm (→Models)
- 12:53, 8 January 2021 (diff | hist) . . (+68) . . N Vectors/norlm/norbert (Created page with "= NorBERT: Bidirectional Encoder Representations from Transformers =")
- 12:52, 8 January 2021 (diff | hist) . . (+29) . . Vectors/norlm (→Models)
- 12:40, 8 January 2021 (diff | hist) . . (+135) . . N Vectors/norlm (Created page with "= Background = Welcome to the emerging collection of very large contextualized language models for the Norwegian language. = Models =")
- 10:10, 20 December 2020 (diff | hist) . . (+7) . . Home (→Contact)
- 15:59, 3 December 2020 (diff | hist) . . (-2) . . Eosc/norbert (→Evaluation)
- 15:59, 3 December 2020 (diff | hist) . . (+30) . . Eosc/norbert (→Evaluation)
- 15:08, 3 December 2020 (diff | hist) . . (+37) . . N Eosc/norbert/benchmark (Created page with "= Emerging Thoughts on Benchmarking =")
- 16:56, 22 November 2020 (diff | hist) . . (+479) . . N Eosc/easybuild/benchmark (Created page with "= Background = In the context of the EOSC-Nordic EasyBuild pilot, the following page provides instructions for how to benchmark different software configurations on typical p...")
- 16:10, 16 November 2020 (diff | hist) . . (+921) . . N Eosc/clouds (Created page with "= Background = This page gathers information on the various cloud services that are available within the EOSC-Nordic consortium. In principle, cloud utilization may be of int...")
- 10:11, 7 November 2020 (diff | hist) . . (+16) . . Eosc/pretraining/nvidia (→Background)
- 14:36, 6 November 2020 (diff | hist) . . (+419) . . N Eosc/pretraining/nvidia (Created page with "= Background = This page provides a recipe to large-scale pre-training of a BERT neural language model, using the [https://github.com/NVIDIA/DeepLearningExamples/tree/master/...")
- 10:21, 21 October 2020 (diff | hist) . . (+38) . . Eosc/easybuild (→References)
- 15:57, 20 October 2020 (diff | hist) . . (+179) . . Eosc/easybuild (→Desk Pilot)
- 15:48, 20 October 2020 (diff | hist) . . (+122) . . Eosc/easybuild (→Desk Pilot)
- 15:30, 20 October 2020 (diff | hist) . . (+364) . . Eosc/easybuild (→Desk Pilot)
- 15:27, 20 October 2020 (diff | hist) . . (-354) . . Eosc/easybuild (→Important stuff to remember)
- 15:26, 20 October 2020 (diff | hist) . . (+354) . . N Eosc/easybuild/andreku (Created page with "= Important stuff to remember = '''export EB_PYTHON=python3''' '''module load EasyBuild/4.3.0''' Playground on Saga: /cluster/shared/nlpl/software/easybuild4 '''export EA...")
- 15:15, 20 October 2020 (diff | hist) . . (-1) . . Eosc/easybuild (→Desk Pilot)
- 15:14, 20 October 2020 (diff | hist) . . (+724) . . Eosc/easybuild (→Background)
- 14:04, 16 October 2020 (diff | hist) . . (+71) . . Infrastructure/resources (→Gaining Access) (current)
- 06:43, 14 October 2020 (diff | hist) . . (+72) . . Eosc/norbert (→Working Notes for Norwegian BERT-Like Models)
- 19:50, 11 September 2020 (diff | hist) . . (+130) . . N Infrastructure/saga (Created page with "= Background = = Tips & Tricks = <pre> srun -n 1 -p accel --account=nn9447k --gres=gpu:1 --mem 1G -t 15 --pty /bin/bash </pre>") (current)
- 12:06, 11 September 2020 (diff | hist) . . (+113) . . N Eosc/norbert (Created page with "= Working Notes for Norwegian BERT-Like Models = = Available Text Corpora = = Preprocessing and Tokenization =")
- 06:51, 9 September 2020 (diff | hist) . . (+761) . . Eosc/nuggets (→Accounting and Allocations) (current)
- 06:48, 9 September 2020 (diff | hist) . . (-592) . . Eosc/nuggets (→Software Management)
- 11:30, 2 September 2020 (diff | hist) . . (+336) . . Eosc/pretraining (→Background)
- 18:14, 1 September 2020 (diff | hist) . . (+290) . . Eosc/pretraining (→Available implementations)
- 10:21, 27 August 2020 (diff | hist) . . (+407) . . N Eosc/pretraining (Created page with "= Background = This page provides an informal, technically-oriented survey over available (and commonly used) architecturs and implementations for large-scale pre-training (a...")
- 12:46, 15 June 2020 (diff | hist) . . (+465) . . Eosc/easybuild (→Background)
- 12:39, 15 June 2020 (diff | hist) . . (+175) . . N Eosc/easybuild (Created page with "= Background = = References = Compute Canada: https://www.youtube.com/watch?v=_0j5Shuf2uE Jülich & Ghent: http://easybuilders.github.io/easybuild/files/eb-jsc-hust16.pdf")
- 11:10, 14 May 2020 (diff | hist) . . (+232) . . Home (→Partners)
- 19:28, 2 March 2020 (diff | hist) . . (+1) . . Infrastructure/trickle (current)
- 19:26, 2 March 2020 (diff | hist) . . (+29) . . Infrastructure/trickle
- 19:23, 2 March 2020 (diff | hist) . . (+13) . . Infrastructure/trickle
- 09:51, 4 February 2020 (diff | hist) . . (+164) . . Community/training (→Programme)
- 23:05, 3 February 2020 (diff | hist) . . (+54) . . Community/training (→Programme)
- 17:40, 3 February 2020 (diff | hist) . . (+56) . . Community/training (→Programme)
- 17:33, 3 February 2020 (diff | hist) . . (+55) . . Community/training (→Programme)
- 16:54, 3 February 2020 (diff | hist) . . (+58) . . Community/training (→Programme)
- 15:15, 3 February 2020 (diff | hist) . . (+236) . . Community/training (→Programme)
- 11:13, 3 February 2020 (diff | hist) . . (-35) . . Community/training (→Programme)
- 15:47, 2 February 2020 (diff | hist) . . (+36) . . Community/home (→Winter School)
- 15:04, 2 February 2020 (diff | hist) . . (0) . . Community/training (→Programme)
- 15:03, 2 February 2020 (diff | hist) . . (+35) . . Community/training (→Programme)
- 14:03, 2 February 2020 (diff | hist) . . (+2) . . Community/training (→Programme)
- 14:02, 2 February 2020 (diff | hist) . . (+61) . . Community/training (→Programme)
- 14:00, 2 February 2020 (diff | hist) . . (+37) . . Community/training (→Background)
- 13:59, 2 February 2020 (diff | hist) . . (0) . . N File:Skeikampen.2020.png (current)
- 23:03, 1 February 2020 (diff | hist) . . (+6) . . Eosc/horovod (→The Inevitable: Backgrading) (current)
- 23:02, 1 February 2020 (diff | hist) . . (-4) . . Eosc/horovod (→Four Weeks Later: Performance Optimization)
- 23:01, 1 February 2020 (diff | hist) . . (+5) . . Eosc/horovod (→High-Level Goal: Multi-GPU Training)
- 22:29, 1 February 2020 (diff | hist) . . (0) . . Eosc/horovod (→Questions: Installation and Deployment)
- 22:28, 1 February 2020 (diff | hist) . . (+1,449) . . Eosc/horovod (→Questions: Installation and Deployment)
- 22:12, 1 February 2020 (diff | hist) . . (+44) . . Eosc/horovod (→Reflections: Responsibilities)
- 22:11, 1 February 2020 (diff | hist) . . (+1,844) . . Eosc/horovod (→Reflections: Responsibilities)
- 17:31, 31 January 2020 (diff | hist) . . (-11) . . Community/training (→Logistics)
- 15:15, 31 January 2020 (diff | hist) . . (+349) . . Eosc/horovod (→Four Weeks Later: Performance Optimization)
- 22:26, 30 January 2020 (diff | hist) . . (+69) . . Eosc/horovod (→Four Weeks Later: Performance Optimization)
- 22:25, 30 January 2020 (diff | hist) . . (-2) . . Eosc/horovod (→Four Weeks Later: Performance Optimization)
(newest | oldest) View (newer 100 | older 100) (20 | 50 | 100 | 250 | 500)