-
Notifications
You must be signed in to change notification settings - Fork 8
BigJob Tutorial Part 2: Installation
This page is part of the BigJob Tutorial.
You will need to install SAGA-Bliss in order to perform this tutorial. This is because BigJob uses Bliss in order to connect to the middleware on the various distributed resources. This tutorial will start with the installation of Bliss in a virtual environment, followed by the installation of BigJob. For more information on SAGA-Bliss, please read the SAGA Tutorial.
Assuming you don't want to mess with your system Python installation, you need a place were you can install SAGA locally. A small tool called virtualenv allows you to create a local Python software repository that behaves exactly like the global Python repository, with the only difference that you have write access to it. To create your local Python environment run the following command (you can install virtualenv on most systems via apt-get or yum, etc.):
virtualenv $HOME/tutorial
If you don't have virtualenv installed and you don't have root access to your machine, you can use the following script instead:
curl --insecure -s https://raw.github.com/pypa/virtualenv/master/virtualenv.py | python - $HOME/tutorial
You need to activate your Python environment in order to make it work. Run the command below. It will temporarily modify your PYTHONPATH so that it points to $HOME/tutorial/lib/python2.7/site-packages/ instead of the the system site-package directory:
source $HOME/tutorial/bin/activate
Activating the virtualenv is very important. If you don't activate your virtual Python environment, the rest of this tutorial will not work. You can usually tell that your environment is activated properly if your bash command-line prompt starts with (tutorial).
After your virtual environment is active, you are ready to install BigJob. BigJob is available via PyPi and can be installed using pip by typing:
pip install BigJob
To make sure that your installation works, run the following command to check if the BigJob module can be imported by the interpreter:
python -c "import pilot; print pilot.version"
Prior to running these examples, you will need to create a directory called 'agent' in the same location that you are running your scripts from. BigJob uses this as its working directory. For this tutorial, we'll create the agent directory in the $HOME directory by typing:
mkdir $HOME/agent
If you are planning to submit from one resource to another, you must have SSH password-less login enabled to the submitting resource. This is achieved by placing your public key on one resource in the authorized_keys file on the target machine. Please see our guide to configuring SSH Password-Less Login.
When would you need to use password-less login? (1) You want to submit from your local machine to an XSEDE resource (2) You want to submit from one XSEDE resource to another (3) You want to submit from your local cluster to external clusters Et cetera...