Parsing/udpipe - Revision history

Sara: /* Running UDPipe */

2020-01-14T21:03:18Z

‎Running UDPipe

Sara at 20:51, 14 January 2020

2020-01-14T20:51:30Z

Sara at 20:23, 14 January 2020

2020-01-14T20:23:59Z

Nivre: /* Using UDPipe on Abel */

2018-12-18T10:25:06Z

‎Using UDPipe on Abel

Nivre: Created page with "= UDPipe = UDPipe is an end-to-end system for morphosyntactic parsing in the UD framework developed by Milan Straka. It was used as the baseline system in the CoNLL shared ta..."

2018-11-28T15:51:18Z

Created page with "= UDPipe = UDPipe is an end-to-end system for morphosyntactic parsing in the UD framework developed by Milan Straka. It was used as the baseline system in the CoNLL shared ta..."

New page

= UDPipe =

UDPipe is an end-to-end system for morphosyntactic parsing in the UD framework developed by Milan Straka. It was used as the baseline system in the CoNLL shared tasks on universal dependency parsing in 2017 and 2018.

== Using UDPipe on Abel ==

UDPipe is available as a module on Abel. It was installed as part of the OPUS activity.

How to use UDPipe:
* Log into Abel
* Activate the NLPL module repository:
module use -a /projects/nlpl/software/modulefiles/
* Load the most recent version of the uuparser module:
module load nlpl-udpipe

To learn more about using UDPipe, check the official [UDPipe User's Manual](http://ufal.mff.cuni.cz/udpipe/users-manual)

← Older revision		Revision as of 21:03, 14 January 2020
Line 35:		Line 35:

	The above command performs segmentation, tokenization, POS-tagging and parsing. If only a subset of these tasks are needed, remove some of the flags. The output file is in CoNLLU format as default.		The above command performs segmentation, tokenization, POS-tagging and parsing. If only a subset of these tasks are needed, remove some of the flags. The output file is in CoNLLU format as default.
		+
		+	If you want to parse with uuparser, run the following command (--tag is optional, depending on if you want POS-tags). Then you can run uuparser on the resulting file, for parsing.
		+	udpipe --tokenize --tag MODEL_DIR/MODEL TESTFILE

	UDPipe can handle several input and output formats and other variations. It is also possible to train new models. See the official manual for more details.		UDPipe can handle several input and output formats and other variations. It is also possible to train new models. See the official manual for more details.

← Older revision		Revision as of 20:51, 14 January 2020
Line 20:		Line 20:
	* Load the most recent version of the udpipe module:		* Load the most recent version of the udpipe module:
	module load nlpl-udpipe/1.2.1-devel		module load nlpl-udpipe/1.2.1-devel
		+
		+	== Pre-trained models ==
		+
		+	There are pre-trained models available for all languages in Universal Dependencies 2.4:
		+	/cluster/shared/nlpl/software/modules/udpipe/latest/models (Saga)
		+	/projappl/nlpl/software/modules/udpipe/latest/models (Puhti)
		+
		+	== Running UDPipe ==
		+
		+	To run UDPipe on raw text (in TESTFILE) run the following command:
		+	udpipe --tokenize --tag --parse MODEL_DIR/MODEL TESTFILE
		+
		+	where MODEL_DIR is specified above, and MODEL is the model for the language (treebank) in question, e.g. swedich_talbanken-ud-2.4-190531.udpipe, for Swedish, tained on Talbanken.
		+
		+	The above command performs segmentation, tokenization, POS-tagging and parsing. If only a subset of these tasks are needed, remove some of the flags. The output file is in CoNLLU format as default.
		+
		+	UDPipe can handle several input and output formats and other variations. It is also possible to train new models. See the official manual for more details.

@@ Line 1: / Line 1: @@
 = UDPipe =
-UDPipe is an end-to-end system for morphosyntactic parsing in the UD framework developed by Milan Straka. It was used as the baseline system in the CoNLL shared tasks on universal dependency parsing in 2017 and 2018.
+UDPipe is an end-to-end system for morphosyntactic parsing in the UD framework developed by Milan Straka. It was used as the baseline system in the CoNLL shared tasks on universal dependency parsing in 2017 and 2018. This page only contains a brief introduction, for the full capability of UDPipe, please see the official  [http://ufal.mff.cuni.cz/udpipe UDPipe Web page] including the [http://ufal.mff.cuni.cz/udpipe/users-manual UDPipe User's Manual] and
-== Using UDPipe on Abel ==
+== Using UDPipe on Puhti and Saga ==
-UDPipe is available as a module on Abel. It was installed as part of the OPUS activity.
+UDPipe is available as a module on Puhti and Saga. It was installed as part of the OPUS activity.
-How to use UDPipe:
+How to use UDPipe on Saga:
-* Log into Abel
+* Log into Saga
 * Activate the NLPL module repository:
-  module use -a /projects/nlpl/software/modulefiles/
+  module use -a /custer/shared/nlpl/software/modules/etc
 * Load the most recent version of the udpipe module:
-  module load nlpl-udpipe
+  module load nlpl-udpipe/1.2.1-devel
-To learn more about using UDPipe, check the official [UDPipe User's Manual](http://ufal.mff.cuni.cz/udpipe/users-manual)
+How to use UDPipe on Puhti: