Difference between revisions of "Infrastructure/software/pytorch"

From Nordic Language Processing Laboratory
Jump to: navigation, search
(Installation on Abel)
(Installation on Abel)
Line 31: Line 31:
 
pip install --upgrade numpy pillow six
 
pip install --upgrade numpy pillow six
 
pip install torch torchvision
 
pip install torch torchvision
 +
</pre>
 +
 +
<pre>
 +
wget -O /tmp/requirements.txt \
 +
  https://raw.githubusercontent.com/OpenNMT/OpenNMT-py/master/requirements.txt
 +
pip install -r /tmp/requirements.txt
 
</pre>
 
</pre>

Revision as of 13:28, 14 September 2018

Background

PyTorch is one of the widely used programming frameworks for Deep Learning; in and of itself it is not NLP-specific, but it is a critical dependency for several of the NLPL strands of activity.

Installation on Abel

The module nlpl-pytorch provides a PyTorch installation in a Python 3.5 virtual environment.

module purge
module load cuda/8.0
module load python3/3.5.0
cd /projects/nlpl/software
mkdir pytorch
virtualenv pytorch/0.4.1

Next, we need to create a module definition, in this case /projects/nlpl/software/modulefiles/nlpl-pytorch/0.4.1.

module load nlpl-pytorch/0.4.1
pip install --upgrade pip
pip install --upgrade numpy pillow six
pip install torch torchvision
wget -O /tmp/requirements.txt \
  https://raw.githubusercontent.com/OpenNMT/OpenNMT-py/master/requirements.txt
pip install -r /tmp/requirements.txt