This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revisionNext revisionBoth sides next revision | ||
institute_lorentz:institutelorentz_maris_slurm [2018/08/30 07:41] – [Accounting] lenocil | institute_lorentz:institutelorentz_maris_slurm [2019/01/16 08:38] – [Slurm on the Maris Cluster] lenocil | ||
---|---|---|---|
Line 1: | Line 1: | ||
- | ====== | + | ====== |
All maris nodes have been configured to use [[http:// | All maris nodes have been configured to use [[http:// | ||
Line 7: | Line 7: | ||
A snapshot of the cluster usage can be found at http:// | A snapshot of the cluster usage can be found at http:// | ||
- | Maris runs SLURM v17.02. | + | Maris runs SLURM v17.11.12 |
Suggested readings: | Suggested readings: | ||
Line 45: | Line 45: | ||
|notebook| 48|193044M|all| |maris0[23-28]|6|4| 1| | notebook | all | | |notebook| 48|193044M|all| |maris0[23-28]|6|4| 1| | notebook | all | | ||
|computation| 1552|6578050M |400M, 3Days | |maris0[47-74] | 28 | | | | normal | all | | |computation| 1552|6578050M |400M, 3Days | |maris0[47-74] | 28 | | | | normal | all | | ||
- | |compintel| 192 |1030000M|400M, | + | |compintel| 192 |1030000M|400M, |
+ | |ibintel| 96 |512000M|400M, | ||
|emergency| 384 |2773706M|all| |maris0[69-74] |6| | | | normal | NOBODY | | |emergency| 384 |2773706M|all| |maris0[69-74] |6| | | | normal | NOBODY | | ||
|gpu| 56 |256000M|400M, | |gpu| 56 |256000M|400M, | ||
Line 57: | Line 58: | ||
The `gpu' partition should be used only for jobs requiring GPUs. Note that these latter must be requested to slurm explicitly using '' | The `gpu' partition should be used only for jobs requiring GPUs. Note that these latter must be requested to slurm explicitly using '' | ||
- | The `computation' | + | The `computation' |
+ | |||
+ | The `ibintel' | ||
Line 111: | Line 114: | ||
To compile your cuda application on maris using slurm, note that in your submission script you might have to export the libdevice library path and include the path in which the cuda headers can be found, for instance | To compile your cuda application on maris using slurm, note that in your submission script you might have to export the libdevice library path and include the path in which the cuda headers can be found, for instance | ||
- | < | + | < |
#!/bin/env bash | #!/bin/env bash | ||
.... | .... | ||
Line 129: | Line 132: | ||
In principle to run an MPI application you could just execute it using mpirun as shown in the session below | In principle to run an MPI application you could just execute it using mpirun as shown in the session below | ||
- | < | + | < |
novamaris$ cat slurm_script.sh | novamaris$ cat slurm_script.sh | ||
#!/bin/env bash | #!/bin/env bash | ||
Line 138: | Line 141: | ||
</ | </ | ||
However, __**it is highly advised you use slurm' | However, __**it is highly advised you use slurm' | ||
- | < | + | < |
novamaris$ cat slurm_script.sh | novamaris$ cat slurm_script.sh | ||
#!/bin/env bash | #!/bin/env bash | ||
Line 148: | Line 151: | ||
At the moment maris supports only OpenMPI with slurm so you are required to load a particular openmpi/ | At the moment maris supports only OpenMPI with slurm so you are required to load a particular openmpi/ | ||
- | < | + | < |
# load openMPI | # load openMPI | ||
module load openmpi-slurm/ | module load openmpi-slurm/ | ||
Line 177: | Line 180: | ||
An example of batch script is given below: | An example of batch script is given below: | ||
- | < | + | < |
#!/bin/env bash | #!/bin/env bash | ||
##comment out lines by adding at least two `#' at the beginning | ##comment out lines by adding at least two `#' at the beginning | ||
Line 203: | Line 206: | ||
Consider the batch script below | Consider the batch script below | ||
- | < | + | < |
$ cat slurmcp.sh | $ cat slurmcp.sh | ||
#!/bin/env bash | #!/bin/env bash | ||
Line 230: | Line 233: | ||
Slurm can be instructed to email any job state changes to a chosen email address. This is accomplished by using the '' | Slurm can be instructed to email any job state changes to a chosen email address. This is accomplished by using the '' | ||
- | < | + | < |
... | ... | ||
#SBATCH --mail-user=myemail@address.org | #SBATCH --mail-user=myemail@address.org |