Eosc/norbert/benchmark

From Nordic Language Processing Laboratory
Revision as of 11:45, 23 June 2021 by Andreku (talk | contribs) (NoReC*)
Jump to: navigation, search

Emerging Thoughts on Benchmarking

The following would be natural places to start. For most of these, while we do have baseline numbers to compare to, we do not have existing set-ups where we could simply plug in a Norwegian BERT and rund, so we may need to identify suitable code for existing BERT-based architectures for e.g. English to re-use. For the first task though (document-level SA on NoReC) Jeremy would have an existing set-up for using mBERT that we could perhaps use.

NLP tasks

NoReC*

Linguistic pipeline (dependency parsing or PoS tagging)

Lexical

Text classification

Other