Corpora/Top

From Nordic Language Processing Laboratory
Revision as of 22:49, 20 March 2017 by Oe (talk | contribs) (Created page with "= Activity D: Very Large Corpora = For English, the UiO team has assessed the following: * GigaWords 5.5: * Wikipedia: * COW: * Common Crawl: * NOW: So far, we have st...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

Activity D: Very Large Corpora

For English, the UiO team has assessed the following:

* GigaWords 5.5:
* Wikipedia:
* COW:
* Common Crawl:
* NOW:

So far, we have standardized on CoreNLP for corpus pre-processing, viz. sentence splitting, tokenization, part of speech tagging, and lemmatization. Each corpus is available in two forms: (a) ‘clean’ running text and (b) pre-processed into the CoNLL-like (tab-separated) output format of CoreNLP.