| Both sides previous revisionPrevious revisionNext revision | Previous revision |
| institute_lorentz:xmaris [2022/06/10 12:34] – [TensorFlow Notes] lenocil | institute_lorentz:xmaris [2024/02/29 14:16] (current) – [Xmaris Partitions] jansen |
|---|
| Xmaris is the successor of the maris cluster, renamed with a prefix ''x'' because its nodes deployment is automated using the [[https://www.xcat.org/|xCAT]] software. Less formally, the presence of the ''x'' prefix also suggests the time of the year when xmaris was first made available to IL users, that is Christmas (Xmas). | Xmaris is the successor of the maris cluster, renamed with a prefix ''x'' because its nodes deployment is automated using the [[https://www.xcat.org/|xCAT]] software. Less formally, the presence of the ''x'' prefix also suggests the time of the year when xmaris was first made available to IL users, that is Christmas (Xmas). |
| |
| [[https://www.gnu.org/|{{https://www.gnu.org/graphics/heckert_gnu.transp.small.png?50 }}]][[https://wiki.centos.org/|{{https://wiki.centos.org/ArtWork/Brand/Logo?action=AttachFile&do=get&target=centos-logo-light.png?200 }}]] [[https://openondemand.org/|{{https://openondemand.org/assets/images/ood_logo_stack_rgb.png?200 }}]] [[https://slurm.schedmd.com|{{https://slurm.schedmd.com/slurm_logo.png?60 }}]] [[https://easybuild.readthedocs.io/en/latest/|{{https://easybuild.readthedocs.io/en/latest/_static/easybuild_logo_alpha.png?200 }}]] | [[https://www.gnu.org/|{{https://www.gnu.org/graphics/heckert_gnu.transp.small.png?50 }}]][[https://wiki.centos.org/|{{https://wiki.centos.org/ArtWork/Brand/Logo?action=AttachFile&do=get&target=centos-logo-light.png?200 }}]] [[https://openondemand.org/|{{https://www.osc.edu/sites/default/files/OpenOnDemand_horiz_RGB.png?200 }}]] [[https://slurm.schedmd.com|{{https://slurm.schedmd.com/slurm_logo.png?60 }}]] [[https://easybuild.readthedocs.io/en/latest/|{{https://docs.easybuild.io/img/easybuild_logo.png?100 }}]] |
| ===== Xmaris features and expected cluster lifetime ===== | ===== Xmaris features and expected cluster lifetime ===== |
| |
| ^Mount Point^ Type ^Notes^ | ^Mount Point^ Type ^Notes^ |
| |/scratch | HD | **temporary**, local| | |/scratch | HD | **temporary**, local| |
| |/marisdata |NetApp| 2TB/user quota, remote| | |/marisdata |NetApp| 2TB/user quota, medium-term storage, remote| |
| |/home |NetApp| 10GB/user quota, remote| | |/home |NetApp| 10GB/user quota, medium-term storage, remote| |
| | |/ilZone/home | [[institute_lorentz:irods_fair_storage|iRODS]]| 20GB/user quota, archive storage, remote| |
| |
| Extra efficient scratch spaces are available to all nodes on the infiniband network (''ibIntel'') | Extra efficient scratch spaces are available to all nodes on the infiniband network (''ibIntel'') |
| |
| ^Mount Point^ Type^ Notes^ | ^Mount Point^ Type^ Notes^ |
| |/IBSSD| SSD |**temporary**, InfiniBand/iSER((iSER stands for “iSCSI Extensions for RDMA”. It is an extension of the iSCSI protocol that includes RDMA (Remote Dynamic Memory Access) support. BeeGFS is parallel filysystem. IBSSD will be discontinued by the end of 2022 in favour of PIBSSD.))| | |/IBSSD| SSD |**DISCONTINUED**, InfiniBand/iSER((iSER stands for “iSCSI Extensions for RDMA”. It is an extension of the iSCSI protocol that includes RDMA (Remote Dynamic Memory Access) support. BeeGFS is parallel filysystem. IBSSD will be discontinued by the end of 2022 in favour of PIBSSD.))| |
| |/PIBSSD| SSD|**temporary**, InfiniBand/BeeGFS| | |/PIBSSD| SSD|**temporary**, InfiniBand/BeeGFS| |
| |
| xmaris users are strongly advised they delete (or at least move to the shared data disk), if any, their data from the compute nodes scratch disks upon completion of their calculations. All data on the scratch disks __might be cancelled without prior notice__. | xmaris users are strongly advised they delete (or at least move to the shared data disk), if any, their data from the compute nodes scratch disks upon completion of their calculations. All data on the scratch disks __might be cancelled without prior notice__. |
| |
| Note that **disk policies might change at any time at the discretion of the cluster owners**. | Note that **disk policies might change at any time at the discretion of the cluster owners**. |
| |
| |
| |
| ^Partition^ Number nodes ^ Timelimit ^ Notes^ | ^Partition^ Number nodes ^ Timelimit ^ Notes^ |
| |compAMD*| 11 | 15 days | | | |compAMD*| 6 | 15 days | | |
| |compAMDlong| 3 | 60 days | | | |compAMDlong| 3 | 60 days | | |
| |compIntel| 2 | 5 days and 12 hours| | | |compIntel| 2 | 5 days and 12 hours| | |
| |gpuIntel| 1 | 3 days and 12 hours | GPU | | |gpuIntel| 1 | 3 days and 12 hours | GPU | |
| |ibIntel | 4 | 7 days | InfiniBand, Multiprocessing | | |ibIntel | 8 | 7 days | InfiniBand, Multiprocessing | |
| |
| *: default partition | *: default partition |
| exec python $@ | exec python $@ |
| |
| # DONE. tfquantum will now appear in the dropdown list of kernels | # DONE. tfquantum will appear in the dropdown list of kernels |
| # upon creating a new notebook | # upon creating a new notebook |
| |
| * via a traditional //configure/make// procedure | * via a traditional //configure/make// procedure |
| |
| Whatever installation method you might choose, please note that you do not have administrative rights to the cluster. | Whatever installation method you might choose, please note that you **do not have** administrative rights to the cluster. |
| |
| |
| </code> | </code> |
| |
| :!: The environment variable ''EASYBUILD_OPTARCH'' instructs EasyBuild to compile software in a generic way so that it can be used on different CPUs. This is rather convenient in heterogeneous clusters such as xmaris to avoid recompilations of the same softwares on different compute nodes. This convenience comes of course at a cost; the executables so produced will not be as efficient as they would be on a given CPU. For more info read [[https://easybuild.readthedocs.io/en/latest/Controlling_compiler_optimization_flags.ht | |:!: The environment variable ''EASYBUILD_OPTARCH'' instructs EasyBuild to compile software in a generic way so that it can be used on different CPUs. This is rather convenient in heterogeneous clusters such as xmaris to avoid recompilations of the same softwares on different compute nodes. This convenience comes of course at a cost; the executables so produced will not be as efficient as they would be on a given CPU. For more info read [[https://easybuild.readthedocs.io/en/latest/Controlling_compiler_optimization_flags.ht |
| ml|here]]. | ml|here]].| |
| |
| :!: When compiling OpenBLAS it is not sufficient to define ''EASYBUILD_OPTARCH'' to ''GENERIC'' to achieve portability of the executables. Some extra steps must be taken as described in https://github.com/easybuilders/easybuild/blob/master/docs/Controlling_compiler_optimization_flags.rst. A list of targets supported by OpenBLAS can be found [[https://github.com/xianyi/OpenBLAS/blob/develop/TargetList.txt|here]]. | |:!: When compiling OpenBLAS it is not sufficient to define ''EASYBUILD_OPTARCH'' to ''GENERIC'' to achieve portability of the executables. Some extra steps must be taken as described in https://github.com/easybuilders/easybuild/blob/master/docs/Controlling_compiler_optimization_flags.rst. A list of targets supported by OpenBLAS can be found [[https://github.com/xianyi/OpenBLAS/blob/develop/TargetList.txt|here]].| |
| |
| Then execute | Then execute |
| to make available to the ''module'' comamnd any of the softwares built in your EasyBuild userspace. | to make available to the ''module'' comamnd any of the softwares built in your EasyBuild userspace. |
| |
| :!: ''module use <path>'' will prepend <path> to your ''MODULEPATH''. Should you want to append it instead, then add the option ''-a''. To remove <path> from ''MODULEPATH'' execute ''module unuse <path>''. | |:!: ''module use <path>'' will prepend <path> to your ''MODULEPATH''. Should you want to append it instead, then add the option ''-a''. To remove <path> from ''MODULEPATH'' execute ''module unuse <path>''.| |
| |
| Should you want to customise the building process of a given software please read how to implement [[https://easybuild.readthedocs.io/en/latest/Implementing-easyblocks.html|EasyBlocks]] and write [[https://easybuild.readthedocs.io/en/latest/Writing_easyconfig_files.html|EasyConfig]] files or | Should you want to customise the building process of a given software please read how to implement [[https://easybuild.readthedocs.io/en/latest/Implementing-easyblocks.html|EasyBlocks]] and write [[https://easybuild.readthedocs.io/en/latest/Writing_easyconfig_files.html|EasyConfig]] files or |
| ===== Suggested readings ===== | ===== Suggested readings ===== |
| |
| * https://slurm.schedmd.com/archive/slurm-18.08.6/ | * https://slurm.schedmd.com/archive/slurm-21.08.8-2/ |
| * https://osc.github.io/ood-documentation/master/ | * https://osc.github.io/ood-documentation/master/ |
| * https://www.gnu.org/gnu/linux-and-gnu.en.html | * https://www.gnu.org/gnu/linux-and-gnu.en.html |
