Infrastructure/software/easybuild - Revision history

Oe: /* Installation Instructions */

2021-07-11T06:51:17Z

‎Installation Instructions

2021-07-11T06:48:10Z

‎Installation Instructions

2021-07-09T07:27:23Z

‎Installation Instructions

2021-07-08T10:45:22Z

‎Usage Instructions

2021-07-08T07:51:52Z

‎Usage Instructions

2021-07-08T07:48:45Z

‎Interactive Installations

2021-07-08T07:48:01Z

‎Community Maintenance

2021-07-08T07:40:24Z

‎Background

2021-07-07T16:50:32Z

‎Community Maintenance

2021-07-07T16:48:02Z

‎Community Maintenance

@@ Line 58: / Line 58: @@
 <pre>
 sbatch build.slurm /projappl/nlpl/software/eb/packages/EasyBuild/4.4.1/easybuild/easyconfigs/g/GCCcore/GCCcore-8.3.0.eb
-bash build.slurm
+bash build.slurm /projappl/nlpl/software/eb/packages/EasyBuild/4.4.1/easybuild/easyconfigs/p/Python/Python-3.7.4-GCCcore-8.3.0.eb
 sbatch build.slurm easyconfigs/{system,mkl}/*.eb
 </pre>

@@ Line 57: / Line 57: @@
 EasyBuild would fail when run via SLURM.
 <pre>
 sbatch build.slurm easyconfigs/{system,mkl}/*.eb
 </pre>

@@ Line 26: / Line 26: @@
 = Installation Instructions =
 <pre>
@@ Line 31: / Line 35: @@
 cd easybuild
 ./setup.sh
 sbatch build.slurm easyconfigs/{system,mkl}/*.eb
 </pre>

@@ Line 16: / Line 16: @@
 <pre>
-module use -a /projappl/nlpl/software/eb/modules/all
+module use -a /projappl/nlpl/software/eb/etc/all
 module --redirect avail | grep nlpl
 </pre>
 <pre>
-module use -a /cluster/shared/nlpl/software/eb/modules/all
+module use -a /cluster/shared/nlpl/software/eb/etc/all
 module --redirect avail | grep nlpl
 </pre>

@@ Line 17: / Line 17: @@
 <pre>
 module use -a /projappl/nlpl/software/eb/modules/all
-module avail
+module --redirect avail | grep nlpl
 </pre>
 <pre>
 module use -a /cluster/shared/nlpl/software/eb/modules/all
-module avail
+module --redirect avail | grep nlpl
 </pre>

@@ Line 66: / Line 66: @@
 NLPL virtual laboratory is preserved on each system, inside the
 <code>.../software/eb/build/</code> directory, where the
-<code>...</code> prefix is the root of the NLPL community directory,
+<code>...</code> prefix must be replaced with the root of the
-e.g. <code>/projapp/nlpl/</code> on Puhti and
+NLPL community directory, e.g.
 <code>/cluster/shared/nlpl/</code> on Saga.

← Older revision		Revision as of 07:48, 8 July 2021
Line 56:		Line 56:
	and Saga, where the infrastructure task force must grant them write		and Saga, where the infrastructure task force must grant them write
	privileges to the NLPL community directory.		privileges to the NLPL community directory.
		+
		+	= Interactive Installations =
		+
		+	While developing and testing a new easyconfig, it will often
		+	be more convenient to work interactively at the command line
		+	(rather than submit EasyBuild jobs through the queue system).
		+
		+	The configuration from the initial fully automated build of the
		+	NLPL virtual laboratory is preserved on each system, inside the
		+	<code>.../software/eb/build/</code> directory, where the
		+	<code>...</code> prefix is the root of the NLPL community directory,
		+	e.g. <code>/projapp/nlpl/</code> on Puhti and
		+	<code>/cluster/shared/nlpl/</code> on Saga.
		+
		+	<pre>
		+	module purge
		+	source .../software/eb/build/config.sh
		+	eb --show-config
		+	eb --robot --dry-run new-module.eb
		+	</pre>

@@ Line 7: / Line 7: @@
 Full automation means that the exact same software environment,
 using the exact same versions and dependencies, will be locally
-compiled, with relevant hardware-specific optimizations.
+compiled on each target system, with relevant hardware-specific
 This approach guarantees maximum reproducibility and replicability
 across different systems, including the Finnish Puhti and the
-Norwegian Saga superclusters.
+Norwegian Saga (and soon Betzy) superclusters.
 = Usage Instructions =

← Older revision		Revision as of 16:50, 7 July 2021
Line 50:		Line 50:
	To contribute, please make contact with the NLPL infrastructure		To contribute, please make contact with the NLPL infrastructure
	team at <code>infrastructure@nlpl.eu</code>.		team at <code>infrastructure@nlpl.eu</code>.
		+
		+	To become a contributor, in addition to the above GitLab instance,
		+	users must have access to at least Puhti
		+	and Saga, where the infrastructure task force must grant them write
		+	privileges to the NLPL community directory.

← Older revision		Revision as of 16:48, 7 July 2021
Line 34:		Line 34:

	= Community Maintenance =		= Community Maintenance =
		+
		+	The NLPL virtual laboratory is maintained collectively by a
		+	team of dedicated and enthusiastic experts from the NLPL partner sites,
		+	with Andrey Kutuzov (Oslo) as the chief cat herder.
		+	Once installed, a module never changes or is removed;
		+	instead, new modules are added to the collection.
		+
		+	To add a module to the virtual laboratory, it must be possible to
		+	install it using EasyBuild.
		+	This presupposes what is called an easyconfig, essentially the
		+	recipe for fetching sources, compilation, and installation using
		+	EasyBuild.
		+	The NLPL collection of easyconfigs is maintained on the Nordic
		+	GitLab instance at https://source.coderefinery.org/nlpl/easybuild.
		+	To contribute, please make contact with the NLPL infrastructure
		+	team at <code>infrastructure@nlpl.eu</code>.