Computer Documentation Wiki

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.

====== ipyparallel on maris ======

This quick tutorial will help you with the setup of your first ipyparallel session on maris' jupyterhub.

===== Python environments =====

You can either use maris-jupyterhub' python environment and all the packages therein or

create a custom python environment as the simple session below shows

<code>
export PATH=/marisdata/MARISHUB/bin:${PATH}
conda create --name=<name>
source activate <name>
conda install ipyparallel
conda install <all-packages-you-might-need>
</code>

===== Create an ipython parallel profile =====

To create an ipython parallel* profile type

<code>
export PATH=/marisdata/MARISHUB/bin:${PATH}
ipython profile create --parallel --profile=<profile-name>
</code>

the session above will create <profile-name> in ''${HOME}/.ipython''.

To save profiles in alternative locations set the environment variable IPYTHONDIR.

===== Adjust created ipython parallel profiles =====

<code>
mkdir "/marisdata/$USER/.log"
cp  /marisdata/EXAMPLE_FILES/ipcontroller_config.py "${HOME}/.ipython/profile_<profile-name>"
cp /marisdata/EXAMPLE_FILES/ipcluster_config.py "${HOME}/.ipython/profile_<profile-name>"
cp /marisdata/EXAMPLE_FILES/ipp_tutorial.ipynb "${HOME}/ipp_tutorial.ipynb"
</code>

===== Start the  parallel profile =====
  * Login to http://jupyterhub.lorentz.leidenuniv.nl/ 
  * Navigate to the `Cluster' tab
  * Start profile <profile-name> by selecting the number of engines
  * Run the example notebook at https://jupyterhub.lorentz.leidenuniv.nl/user/<username>/notebooks/ipp_tutorial.ipynb

Computer Documentation Wiki

User Tools

Site Tools

Page Tools