Infrastructure/software/spacy - Revision history

Oe: /* Usage */

2019-02-25T20:01:19Z

‎Usage

Oe: /* Installation */

2018-10-01T08:08:21Z

‎Installation

Oe: /* Usage */

2018-10-01T08:07:43Z

‎Usage

Oe: /* Available Versions */

2018-10-01T08:06:54Z

‎Available Versions

Oe: Created page with "= Background = The [https://spacy.io/ SpaCy] library supports a range of ‘basic’ NLP tasks, including sentence splitting, tokenization, tagging and lemmatization, and dep..."

2018-10-01T08:06:26Z

Created page with "= Background = The [https://spacy.io/ SpaCy] library supports a range of ‘basic’ NLP tasks, including sentence splitting, tokenization, tagging and lemmatization, and dep..."

New page

= Background =

The [https://spacy.io/ SpaCy] library supports a range of ‘basic’ NLP tasks,
including sentence splitting, tokenization, tagging and lemmatization, and
dependency parsing—for about half a dozen European languages.
SpaCy is somewhat similar on the surface to the
[http://wiki.nlpl.eu/index.php/Infrastructure/software/nltk Natural Language Toolkit]
(NLTK) but prides itself of both higher-quality analysis and better computational
efficiency.

= Usage =

The module <tt>nlpl-nltk</tt> provides a SpaCy installation
in a Python 3.5 virtual environment.

<pre>
module load nlpl-nltk
</pre>

This installation (just as other NLPL-maintained Python virtual environments)
can be combined with other Python-based modules, for example the NLPL
installations of PyTorch or TensorFlow.
To ‘stack’ multiple Python environments, they can simply be loaded together,
e.g.

<pre>
module load nlpl-nltk nlpl-tensorflow
</pre>

Because PyTorch and TensorFlow are ‘special’ in their requirements for
dynamic libraries and support for both cpu and gpu nodes, it is important
for them to be activated last, i.e. on the ‘top’ of a multi-module stack.

= Available Versions =

As of October 2018, version 2.0.12 is installed.

= Installation =

After a ‘standard’ virtual environment and module definition have
been created:

<pre>
module load nlpl-spacy
pip install spacy
for i in en de es pt fr it nl xx; do python -m spacy download $i; done
</pre>

@@ Line 17: / Line 17: @@
 <pre>
 module use -a /proj*/nlpl/software/modulefiles
-module load nlpl-nltk
+module load nlpl-spacy
 </pre>
@@ Line 27: / Line 27: @@
 <pre>
-module load nlpl-nltk nlpl-tensorflow
+module load nlpl-spacy nlpl-tensorflow
 </pre>

← Older revision		Revision as of 08:06, 1 October 2018
Line 34:		Line 34:


−	= ~~Available~~ Versions =	+	= Versions =

	As of October 2018, version 2.0.12 is installed.		As of October 2018, version 2.0.12 is installed.

@@ Line 40: / Line 40: @@
 = Installation =
-After a ‘standard’ virtual environment and module definition have
+After a ‘standard’ NLPL virtual environment and module definition have
 been created:

@@ Line 16: / Line 16: @@
 <pre>
 module load nlpl-nltk
 </pre>
@@ Line 32: / Line 33: @@
 dynamic libraries and support for both cpu and gpu nodes, it is important
 for them to be activated last, i.e. on the ‘top’ of a multi-module stack.
 = Versions =