User Tools

Site Tools


institute_lorentz:slurm_ipyparallel

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
institute_lorentz:slurm_ipyparallel [2017/09/21 12:34] – [Start the parallel profile] lenocilinstitute_lorentz:slurm_ipyparallel [2020/01/15 13:37] (current) – removed lenocil
Line 1: Line 1:
-====== ipyparallel on maris ====== 
  
-This quick tutorial will help you with the setup of your first ipyparallel session on maris' jupyterhub. 
- 
-===== Python environments ===== 
- 
-You can either use maris-jupyterhub' python environment and all the packages therein or 
- 
-create a custom python environment as the simple session below shows 
- 
-<code> 
-export PATH=/marisdata/MARISHUB/bin:${PATH} 
-conda create --name=<name> 
-source activate <name> 
-conda install ipyparallel 
-conda install <all-packages-you-might-need> 
-</code> 
- 
-===== Create an ipython parallel profile ===== 
- 
-To create an ipython parallel* profile type 
- 
-<code> 
-export PATH=/marisdata/MARISHUB/bin:${PATH} 
-ipython profile create --parallel --profile=<profile-name> 
-</code> 
- 
-the session above will create <profile-name> in ''${HOME}/.ipython''. 
- 
-To save profiles in alternative locations set the environment variable IPYTHONDIR. 
- 
-===== Adjust created ipython parallel profiles ===== 
- 
-<code> 
-mkdir "/marisdata/$USER/.log" 
-cp  /marisdata/EXAMPLE_FILES/ipcontroller_config.py "${HOME}/.ipython/profile_<profile-name>" 
-cp /marisdata/EXAMPLE_FILES/ipcluster_config.py "${HOME}/.ipython/profile_<profile-name>" 
-cp /marisdata/EXAMPLE_FILES/ipp_tutorial.ipynb "${HOME}/ipp_tutorial.ipynb" 
-</code> 
- 
-===== Start the  parallel profile ===== 
-  * Login to http://jupyterhub.lorentz.leidenuniv.nl/  
-  * Navigate to the `Cluster' tab 
-  * Start profile <profile-name> by selecting the number of engines 
-  * Run the example notebook at jupyterhub.lorentz.leidenuniv.nl/user/<username>/notebooks/ipp_tutorial.ipynb