01_Lab_1_Introduction_solution.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Introductory applied machine learning (INFR10069)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Lab 1: Introduction"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the first part of this lab we will set-up a working environment for the IAML course. In the second part we will introduce some packages we will be using throughout the course."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Setting up for DICE"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Within this course we will be using Python along with a few open-source libraries (packages). These packages cannot be installed directly, so we will have to create a virtual environment. We are using virtual enviroments to make the installation of packages and retention of correct versions as simple as possible. You can read [here](https://virtualenv.pypa.io/en/stable/) if you want to learn about virtual environments, but this is **not** neccessary for this tutorial."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now open a terminal and follow these instructions. We are expecting you to enter these commands in **one-by-one**. Waiting for each command to complete will help catch any unexpected warnings and errors. Please read heed any warnings and errors you may encounter. We are on standby in the labs to help if required.\n",
    "\n",
    "1. Change directory to home and create a virtual enviroment\n",
    "```bash\n",
    "cd\n",
    "virtualenv --distribute virtualenvs/iaml_env  # Creates a virtual environment called iaml_env\n",
    "```\n",
    "   \n",
    "2. Navigate to and activate the virtual enviroment (you will need to activate the virtual environment every time you open a new terminal - this adds the correct python version with all installed packages to your system's `$PATH` environment variable)\n",
    "```bash\n",
    "cd virtualenvs/iaml_env\n",
    "source ./bin/activate  # Activates the environment, your shell prompt should now \n",
    "                          # change to reflect you are in the `iaml_env` enviornment\n",
    "```\n",
    "\n",
    "3. Install all the python packages we need (once the correct virtual environment is activated, pip install will install packages to the virtual environent - if you're ever unsure which python you are using, type `which python` in the terminal) **WATCH FOR WARNINGS AND ERRORS HERE**. We have split these commands up to encourage you to enter them one-by-one.\n",
    "   \n",
    "    * `pip install -U setuptools  # The -U flag upgrades the current version`\n",
    "    * `pip install -U pip`\n",
    "    * `pip install yolk`\n",
    "    * `pip install jupyter`\n",
    "    * `pip install numpy`\n",
    "    * `pip install scipy`\n",
    "    * `pip install matplotlib`\n",
    "    * `pip install pandas`\n",
    "    * `pip install statsmodels`\n",
    "    * `pip install scikit-learn`\n",
    "    * `pip install seaborn`"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "You should now have all the required modules installed. Our next step is to make a new directory where we will keep all the lab notebooks, datasets and assignments. Within your terminal:"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "1. Navigate back to your home directory\n",
    "    * `cd`\n",
    "1. Make a new directory and navigate to it\n",
    "    * `mkdir iaml_2016`\n",
    "    * `cd iaml_2016`"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now you have two options:\n",
    "\n",
    "1. We recommend that you directly download a .zip file from https://github.com/agamemnonc/iaml which will contain everything you need and save it in the folder you have just created. You can do this from the terminal by typing:\n",
    "    * `wget https://github.com/agamemnonc/iaml/archive/master.zip`\n",
    "    * `unzip master.zip`\n",
    "2. If **and only if** you are familiar and confident with using Git/GitHub, you can initiliaze a git directory, add the above repo as remote and pull everything into your local directory. Please use this option only if you really know what you are doing. Unfortunately, we won't be able to provide you with Git/Github support if you run into issues with syncing and using version control in general. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Once you have downloaded the material, you are now ready to start working in the Jupyter environment. First you need to activate the `iaml_env` environment and start a Jupyter Notebook session from within the folder where the material is stored. **Note that you will have to follow this procedure for all labs and assignments.**"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "1. Navigate home and ensure the `iaml_env` virtualenv is activated\n",
    "    * `cd`\n",
    "    * `source virtualenvs/iaml_env/bin/activate` (Activate environment)\n",
    "1. Enter the directory you downloaded the course material\n",
    "    * `cd iaml_2016/iaml-master`\n",
    "1. Start a jupyter notebook\n",
    "    * `jupyter notebook`\n",
    "1. This should automatically open your browser\n",
    "    * Click on `01_Lab_1_Introduction.ipynb` to open it"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Setting up for personal machine (Windows / OS X / Ubuntu)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "If you are using a personal machine, you can choose whether to do as above or use the Anaconda distribution (Python version 2.7, choose the appropriate installer according to your operating system). Anaconda is a standard set of packages used in scientific computing which the Anaconda team curate to keep them consistent.\n",
    "\n",
    "Once the installation is complete, we need to install the Seaborn package which is the only one not included in the distribution. It's also recommended that you set up a virtual environment for this project. This way, if you update anything in your anaconda base install, this virtual environment will remain unchanged. To create a virtual environment called `iaml`, open a Terminal (or Command Prompt window if you are running Windows) and type:"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "```bash\n",
    "conda create -n iaml python=2.7 anaconda seaborn=0.7.0\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Don't forget to activate the virtual environment every time you begin work from a new terminal:"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "```bash\n",
    "source activate iaml\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Once you have finished installed everything, open a terminal (or Command Prompt in Windows), navigate to the folder where you have downloaded the course material and type:"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "```bash\n",
    "jupyter notebook\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Then click on `01_Lab_1_Introduction.ipynb` to open it."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Introducing main packages"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In the following section we introduce the main **packages** we will be using in this course. If you think that you are already familiar with the packages outlined below you are free to skip this section. We do advise you, however, to go quickly through this tutorial to make sure that you are familiar with all the tools you will need for the rest of the course.\n",
    "\n",
    "The packages that we will use are the following:\n",
    "* [numpy:](http://www.numpy.org/) scientific computing by using array objects\n",
    "\n",
    "\n",
    "* [pandas](http://pandas.pydata.org/): data structures and data analysis tools\n",
    "\n",
    "\n",
    "* [matplotlib](http://matplotlib.org/): plotting library (similar to MATLAB's plot interface)\n",
    "\n",
    "\n",
    "* [seaborn](https://seaborn.github.io/): data visualisation library which works on top of matplotlib\n",
    "\n",
    "Throughout the course, we will also make heavy use of [scikit-learn](http://scikit-learn.org/stable/) which is a machine learning library implementing many learning algorithms and useful tools. This is introduced in Lab 2."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## IPython / Jupyter environment"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Basic knowledge of `python` and working with `notebooks` in the Jupyter environment is assumed for this course. If you haven't used python before, you are strongly advised to familiarise yourselves with basic python syntax and working in the Jupyter environment. There are many excellent tutorials available on the web and you can choose the ones you like the most. If you are not sure which ones to choose, these are good starting points:\n",
    "\n",
    "[Introduction to Python for scientific computing](http://bebi103.caltech.edu/2015/tutorials/t1a_intro_to_python.html)\n",
    "\n",
    "[Introduction to Jupyter notebooks](http://bebi103.caltech.edu/2015/tutorials/t0b_intro_to_jupyter_notebooks.html)\n",
    "\n",
    "[Python/Numpy tutorial](http://cs231n.github.io/python-numpy-tutorial/#python)\n",
    "(A large part of Lab 1 is based on this tutorial)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Line magics"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Sometimes we might want to connect to the same notebook kernel from multiple frontends. This is useful for excecuting quick calculations, or checking objects currently stored in the kernel, without having to create a new cell in the notebook.\n",
    "\n",
    "The `%connect_info` line magic displays the information necessary to connect another frontend to the Notebook kernel."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{\n",
      "  \"stdin_port\": 57892, \n",
      "  \"ip\": \"127.0.0.1\", \n",
      "  \"control_port\": 57893, \n",
      "  \"hb_port\": 57894, \n",
      "  \"signature_scheme\": \"hmac-sha256\", \n",
      "  \"key\": \"2d83f65b-deea-4d1f-998a-2ca1fd00dbb1\", \n",
      "  \"kernel_name\": \"\", \n",
      "  \"shell_port\": 57890, \n",
      "  \"transport\": \"tcp\", \n",
      "  \"iopub_port\": 57891\n",
      "}\n",
      "\n",
      "Paste the above JSON into a file, and connect with:\n",
      "    $> ipython <app> --existing <file>\n",
      "or, if you are local, you can connect with just:\n",
      "    $> ipython <app> --existing /Users/sneeze/Library/Jupyter/runtime/kernel-117a2b56-a631-4085-87a0-786ad8e7330a.json \n",
      "or even just:\n",
      "    $> ipython <app> --existing \n",
      "if this is the most recent IPython session you have started.\n"
     ]
    }
   ],
   "source": [
    "%connect_info"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Tab completion"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Tab completion is a powerful method of finding out objects attributes and available methods.\n",
    "\n",
    "Let's see an example of this by using a Python [list](http://www.tutorialspoint.com/python/python_lists.htm). We will create a list and then you can see what methods are available by typing the list name followed by `.` and then hitting the < Tab > key. Then you can access any method's help documentation by hitting the method's name followed by `?`"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[1, 4.2, 'hello']\n"
     ]
    }
   ],
   "source": [
    "l = [1, 4.2, 'hello']\n",
    "print(l)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "l.append?"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Import packages"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Before we start, we need to import the packages that we will be using later. If you are having trouble importing any of these packages make sure that these are properly installed. If you still encounter issues, refer to Installing instructions."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "from __future__ import division, print_function # Makes division and printing work like python 3 (we're using 2)\n",
    "import os\n",
    "import numpy as np\n",
    "import pandas as pd\n",
    "from matplotlib import pyplot as plt\n",
    "%matplotlib inline"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Numpy introduction"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Numpy is a powerful scientific computing library. The fundmental object is the (n-dimensional) numpy array and the library provides a collection of tools for working with such arrays. If you are already familiar with MATLAB you might find this [tutorial](https://docs.scipy.org/doc/numpy-dev/user/numpy-for-matlab-users.html) useful. \n",
    "\n",
    "The following Numpy introduction is largely based on this [tutorial](http://cs231n.github.io/python-numpy-tutorial/#numpy)."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Arrays"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "A numpy array is a grid of values, all of the same type, and is indexed by a [tuple](http://www.tutorialspoint.com/python/python_tuples.htm) of nonnegative integers. The number of dimensions is the rank of the array; the shape of an array is a tuple of integers giving the size of the array along each dimension. *N.B. this use of the word 'rank' is not the same as the meaning in linear algebra.*\n",
    "\n",
    "We can initialize numpy arrays from nested Python [lists](http://www.tutorialspoint.com/python/python_lists.htm), and access elements using square brackets:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Array a: [1 2 3]\n"
     ]
    }
   ],
   "source": [
    "import numpy as np\n",
    "a = np.array([1, 2, 3])  # Create a rank 1 array (i.e. vector)\n",
    "print('Array a:', a)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<type 'numpy.ndarray'>\n"
     ]
    }
   ],
   "source": [
    "print(type(a))                    # Prints the type of object a (array)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(3,)\n"
     ]
    }
   ],
   "source": [
    "print(a.shape)                    # Prints the number of elements for each dimension"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "1 2 3\n"
     ]
    }
   ],
   "source": [
    "print(a[0], a[1], a[2])           # Index array"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "a[0] = 5                          # Change an element of the array"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[5 2 3]\n"
     ]
    }
   ],
   "source": [
    "print(a)                          # Prints the whole array"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "b = np.array([[1,2,3],[4,5,6]])   # Create a rank 2 array"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(2, 3)\n"
     ]
    }
   ],
   "source": [
    "print(b.shape)                   "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "1 2 4\n"
     ]
    }
   ],
   "source": [
    "print(b[0, 0], b[0, 1], b[1, 0])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "At this point it worth noting -in case you didn't know already- that Python follows [0-based indexing](https://en.wikipedia.org/wiki/Zero-based_numbering) (as opposed to MATLAB which follows 1-based indexing)."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In an ipython notebook you can just run a cell with an object name and ipython will try to print it. For example, execute the below cell:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "collapsed": false,
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([5, 2, 3])"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "a"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Create arrays"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We have many options here:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[[ 0.  0.]\n",
      " [ 0.  0.]]\n"
     ]
    }
   ],
   "source": [
    "a = np.zeros((2,2))  # Create an array of all zeros\n",
    "print(a)                    # Prints \"[[ 0.  0.]\n",
    "                     #          [ 0.  0.]]\"\n",
    "    "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[[ 1.  1.]]\n"
     ]
    }
   ],
   "source": [
    "b = np.ones((1,2))   # Create an array of all ones\n",
    "print(b)                    # Prints \"[[ 1.  1.]]\""
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[[ 7.  7.]\n",
      " [ 7.  7.]]\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/Users/sneeze/anaconda/envs/iaml/lib/python2.7/site-packages/numpy/core/numeric.py:301: FutureWarning: in the future, full((2, 2), 7) will return an array of dtype('int64')\n",
      "  format(shape, fill_value, array(fill_value).dtype), FutureWarning)\n"
     ]
    }
   ],
   "source": [
    "c = np.full((2,2), 7) # Create a constant array\n",
    "print(c)                     # Prints \"[[ 7.  7.]\n",
    "                      #          [ 7.  7.]]\""
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[[ 1.  0.]\n",
      " [ 0.  1.]]\n"
     ]
    }
   ],
   "source": [
    "d = np.eye(2)        # Create a 2x2 identity matrix\n",
    "print(d)                    # Prints \"[[ 1.  0.]\n",
    "                     #          [ 0.  1.]]\"\n",
    "    "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[[ 0.76392924  0.8048046 ]\n",
      " [ 0.40261426  0.10942217]]\n"
     ]
    }
   ],
   "source": [
    "e = np.random.random((2,2)) # Create an array filled with random values\n",
    "print(e)                           # Might print \"[[ 0.91940167  0.08143941]\n",
    "                            #               [ 0.68744134  0.87236687]]\"\n",
    "    "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[ 1.  4.  6.  8.]\n"
     ]
    }
   ],
   "source": [
    "some_list = [1, 4, 6, 8]\n",
    "f = np.array(some_list, dtype=float) # Create an array from a list. Also sets the array type to float\n",
    "print(f)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Array indexing"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Slicing is the most common way to index arrays. This works in a similar way to indexing python lists. \n",
    "\n",
    "There are also other options, such as integer and boolean array indexing."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[[ 1  2  3  4]\n",
      " [ 5  6  7  8]\n",
      " [ 9 10 11 12]]\n"
     ]
    }
   ],
   "source": [
    "a = np.array([[1,2,3,4], [5,6,7,8], [9,10,11,12]])\n",
    "print(a)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[[2 3]\n",
      " [6 7]]\n"
     ]
    }
   ],
   "source": [
    "# Use slicing to pull out the subarray consisting of the first 2 rows\n",
    "# and columns 1 and 2; b is the following array of shape (2, 2):\n",
    "# [[2 3]\n",
    "#  [6 7]]\n",
    "b = a[:2, 1:3]\n",
    "print(b)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "2\n"
     ]
    }
   ],
   "source": [
    "# A slice of an array is a view into the same data, so modifying it\n",
    "# will modify the original array. This is called \n",
    "print(a[0,1])  # Prints \"2\""
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "77\n"
     ]
    }
   ],
   "source": [
    "b[0, 0] = 77    # b[0, 0] is the same piece of data as a[0, 1]\n",
    "print(a[0,1])          # Prints \"77\""
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Array datatypes"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Every numpy array is a grid of elements of the same type. Numpy provides a large set of numeric datatypes that you can use to construct arrays. Numpy tries to guess a datatype when you create an array, but functions that construct arrays usually also include an optional argument to explicitly specify the datatype. Here is an example:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "int64\n"
     ]
    }
   ],
   "source": [
    "x = np.array([1, 2])  # Let numpy choose the datatype\n",
    "print(x.dtype)       "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "float64\n"
     ]
    }
   ],
   "source": [
    "x = np.array([1.0, 2.0])  # Let numpy choose the datatype\n",
    "print(x.dtype)             "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "int64\n"
     ]
    }
   ],
   "source": [
    "x = np.array([1, 2], dtype=np.int64)  # Force a particular datatype\n",
    "print(x.dtype)                 "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Array math"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Basic mathematical functions operate elementwise on arrays, and are available both as operator overloads and as functions in the numpy module:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "x =  [[ 1.  2.]\n",
      " [ 3.  4.]]\n",
      "y =  [[ 5.  6.]\n",
      " [ 7.  8.]]\n"
     ]
    }
   ],
   "source": [
    "x = np.array([[1,2],[3,4]], dtype=np.float64)\n",
    "y = np.array([[5,6],[7,8]], dtype=np.float64)\n",
    "print('x = ',x)\n",
    "print('y = ',y)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "x + y =\n",
      "[[  6.   8.]\n",
      " [ 10.  12.]]\n",
      "[[  6.   8.]\n",
      " [ 10.  12.]]\n"
     ]
    }
   ],
   "source": [
    "# Elementwise sum, equivalent expressions:\n",
    "print('x + y =')\n",
    "print(x + y)\n",
    "print(np.add(x, y))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "x-y:\n",
      "[[-4. -4.]\n",
      " [-4. -4.]]\n",
      "[[-4. -4.]\n",
      " [-4. -4.]]\n"
     ]
    }
   ],
   "source": [
    "# Elementwise difference, equivalent expressions:\n",
    "print('x-y:')\n",
    "print(x - y)\n",
    "print(np.subtract(x, y))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "x*y:\n",
      "[[  5.  12.]\n",
      " [ 21.  32.]]\n",
      "[[  5.  12.]\n",
      " [ 21.  32.]]\n"
     ]
    }
   ],
   "source": [
    "# Elementwise product, equivalent expressions:\n",
    "print('x*y:')\n",
    "print(x * y)\n",
    "print(np.multiply(x, y))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "x/y:\n",
      "[[ 0.2         0.33333333]\n",
      " [ 0.42857143  0.5       ]]\n",
      "[[ 0.2         0.33333333]\n",
      " [ 0.42857143  0.5       ]]\n"
     ]
    }
   ],
   "source": [
    "# Elementwise division, equivalent expressions:\n",
    "print('x/y:')\n",
    "print(x / y)\n",
    "print(np.divide(x, y))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Square root of x:\n",
      "[[ 1.          1.41421356]\n",
      " [ 1.73205081  2.        ]]\n"
     ]
    }
   ],
   "source": [
    "# Elementwise square root\n",
    "print('Square root of x:')\n",
    "print(np.sqrt(x))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Note that unlike MATLAB, * is elementwise multiplication, not matrix multiplication. We instead use the `dot` function to compute inner products of vectors, to multiply a vector by a matrix, and to multiply matrices. `dot` is available both as a function in the numpy module and as an instance method of array objects:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "x = np.array([[1,2],[3,4]])\n",
    "y = np.array([[5,6],[7,8]])\n",
    "\n",
    "v = np.array([9,10])\n",
    "w = np.array([11, 12])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "219\n"
     ]
    }
   ],
   "source": [
    "# Inner product of vectors, equivalent expressions\n",
    "print(np.dot(v, w))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[29 67]\n",
      "[29 67]\n"
     ]
    }
   ],
   "source": [
    "# Matrix / vector product, equivalent expressions\n",
    "print(x.dot(v))\n",
    "print(np.dot(x, v))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[[19 22]\n",
      " [43 50]]\n",
      "[[19 22]\n",
      " [43 50]]\n"
     ]
    }
   ],
   "source": [
    "# Matrix / matrix product, equivalent expressions\n",
    "print(x.dot(y))\n",
    "print(np.dot(x, y))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Mathematical functions"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Numpy provides many useful functions for performing computations on arrays; one of the most useful is `sum`:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[[1 2]\n",
      " [3 4]]\n"
     ]
    }
   ],
   "source": [
    "x = np.array([[1,2],[3,4]])\n",
    "print(x)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "10"
      ]
     },
     "execution_count": 39,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.sum(x)  # Compute sum of all elements"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([4, 6])"
      ]
     },
     "execution_count": 40,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.sum(x, axis=0)  # Compute sum of each column"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 41,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([3, 7])"
      ]
     },
     "execution_count": 41,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.sum(x, axis=1)  # Compute sum of each row"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "You can find the full list of mathematical functions provided by numpy in the [documentation](http://docs.scipy.org/doc/numpy/reference/routines.math.html).\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Apart from computing mathematical functions using arrays, we frequently need to reshape or otherwise manipulate data in arrays. The simplest example of this type of operation is transposing a matrix; to transpose a matrix, simply use the `T` attribute of an array object:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 42,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[[1 2]\n",
      " [3 4]]\n"
     ]
    }
   ],
   "source": [
    "x = np.array([[1,2], [3,4]])\n",
    "print(x)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 43,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[1, 3],\n",
       "       [2, 4]])"
      ]
     },
     "execution_count": 43,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "x.T"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 44,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[1, 3],\n",
       "       [2, 4]])"
      ]
     },
     "execution_count": 44,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "np.transpose(x) # Equivalent expression"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 45,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[1 2 3]\n"
     ]
    }
   ],
   "source": [
    "# Note that taking the transpose of a rank 1 array does nothing:\n",
    "v = np.array([1,2,3])\n",
    "print(v)  # Prints \"[1 2 3]\""
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 46,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[1 2 3]\n"
     ]
    }
   ],
   "source": [
    "print(v.T)  # Prints \"[1 2 3]\""
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Broadcasting"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Broadcasting is a powerful mechanism that allows numpy to work with arrays of different shapes when performing arithmetic operations. Frequently we have a smaller array and a larger array, and we want to use the smaller array multiple times to perform some operation on the larger array.\n",
    "\n",
    "For example, suppose that we want to add a constant vector to each row of a matrix. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[[ 2  2  4]\n",
      " [ 5  5  7]\n",
      " [ 8  8 10]\n",
      " [11 11 13]]\n"
     ]
    }
   ],
   "source": [
    "x = np.array([[1,2,3], [4,5,6], [7,8,9], [10, 11, 12]])\n",
    "v = np.array([1, 0, 1])\n",
    "y = x + v  # Add v to each row of x using broadcasting\n",
    "print(y)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 48,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "x shape: (4, 3)\n",
      "v shape: (3,)\n",
      "y shape: (4, 3)\n"
     ]
    }
   ],
   "source": [
    "print('x shape:', x.shape)\n",
    "print('v shape:', v.shape)\n",
    "print('y shape:', y.shape)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The line `y = x + v` works even though `x` has shape `(4, 3)` and `v` has shape `(3,)` due to broadcasting; this line works as if v actually had shape `(4, 3)`, where each row was a copy of `v`, and the sum was performed elementwise.\n",
    "\n",
    "Broadcasting two arrays together follows these rules:\n",
    "\n",
    "If the arrays do not have the same rank, prepend the shape of the lower rank array with 1s until both shapes have the same length.\n",
    "The two arrays are said to be compatible in a dimension if they have the same size in the dimension, or if one of the arrays has size 1 in that dimension.\n",
    "The arrays can be broadcast together if they are compatible in all dimensions.\n",
    "After broadcasting, each array behaves as if it had shape equal to the elementwise maximum of shapes of the two input arrays.\n",
    "In any dimension where one array had size 1 and the other array had size greater than 1, the first array behaves as if it were copied along that dimension."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Numpy documentation"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This brief overview has touched on many of the important things that you need to know about numpy, but is far from complete. Check out the numpy reference to find out much more about numpy."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Numpy exercises"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The following short exercises test your understanding of simple -yet important- numpy properties and functions. Make sure you can complete them and feel free to advise the official [documentation](http://docs.scipy.org/doc/) should you need it."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 1 ==========\n",
    "Print your numpy version."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 49,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Numpy version:  1.11.1\n"
     ]
    }
   ],
   "source": [
    "# Your code goes here\n",
    "print(\"Numpy version: \", np.__version__)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 2 ==========\n",
    "Create a null vector of size 5."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 50,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[ 0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.]\n"
     ]
    }
   ],
   "source": [
    "# Your code goes here\n",
    "a = np.zeros(15)\n",
    "print(a)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 3 ==========\n",
    "Create a null vector of size 5 and integer type. Set the third element is 1."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 51,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[ 0.  0.  1.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.  0.]\n"
     ]
    }
   ],
   "source": [
    "# Your code goes here\n",
    "a = np.zeros(15)\n",
    "a[2] = 1\n",
    "print(a)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 4 ==========\n",
    "Create a vector ranging from 0 to 9."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 52,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[0 1 2 3 4 5 6 7 8 9]\n"
     ]
    }
   ],
   "source": [
    "# Your code goes here\n",
    "a = np.arange(10)\n",
    "print(a)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 5 ==========\n",
    "Create a vector ranging from 10 to 29."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 53,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29]\n"
     ]
    }
   ],
   "source": [
    "# Your code goes here\n",
    "a = np.arange(10, 30)\n",
    "print(a)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 6 ==========\n",
    "Create a vector ranging from 0 to 9 and reverse it."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 54,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[9 8 7 6 5 4 3 2 1 0]\n"
     ]
    }
   ],
   "source": [
    "# Your code goes here\n",
    "a = np.arange(0, 10)\n",
    "a = a[::-1]\n",
    "print(a)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 7 ==========\n",
    "Create a null matrix of size (5,3)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 55,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[[ 0.  0.  0.]\n",
      " [ 0.  0.  0.]\n",
      " [ 0.  0.  0.]\n",
      " [ 0.  0.  0.]\n",
      " [ 0.  0.  0.]]\n"
     ]
    }
   ],
   "source": [
    "# Your code goes here\n",
    "a = np.zeros((5,3))\n",
    "print(a)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 8 ==========\n",
    "Crate a 3 X 3 matrix ranging from 0 to 8 and print its transpose."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 56,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[[0 3 6]\n",
      " [1 4 7]\n",
      " [2 5 8]]\n"
     ]
    }
   ],
   "source": [
    "# Your code goes here\n",
    "a = np.arange(9).reshape(3,3)\n",
    "print(a.T)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 9 ==========\n",
    "Create a 3 X 3 identity matrix."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 57,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[[ 1.  0.  0.]\n",
      " [ 0.  1.  0.]\n",
      " [ 0.  0.  1.]]\n"
     ]
    }
   ],
   "source": [
    "# Your code goes here\n",
    "a = np.eye(3)\n",
    "print(a)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 10 ==========\n",
    "Create a 2 X 2 X 2 array with random values (drawn from a normal distribution)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 58,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[[[ 1.0553703   0.39062624]\n",
      "  [-1.05089613 -2.18067652]]\n",
      "\n",
      " [[ 1.41934762 -0.32604857]\n",
      "  [-2.18450359  1.93146948]]]\n"
     ]
    }
   ],
   "source": [
    "# Your code goes here\n",
    "a = np.random.randn(2,2,2)\n",
    "print(a)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 11 ==========\n",
    "Create a 5 x 4 array with random values and find the minimum and maximum values."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 59,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[[ 0.67539161  0.31622057 -0.00855338 -0.02904446]\n",
      " [ 0.12019522  0.51402721 -1.27398404 -0.85952209]\n",
      " [-0.66440386  0.04950572 -0.61846799  0.88324254]\n",
      " [ 1.37120344  0.77358943 -0.06841153 -1.79250127]\n",
      " [ 1.98636879 -0.17262461 -0.09227979  0.38480136]]\n",
      "Minimum:  -1.79250127213\n",
      "Maximum:  1.98636879423\n"
     ]
    }
   ],
   "source": [
    "# Your code goes here\n",
    "a = np.random.randn(5,4)\n",
    "print(a)\n",
    "print(\"Minimum: \", np.min(a))\n",
    "print(\"Maximum: \", np.max(a))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 12 ==========\n",
    "Find the mean value of the array in 11."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 60,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Mean:  0.0747376434386\n"
     ]
    }
   ],
   "source": [
    "# Your code goes here\n",
    "print(\"Mean: \", np.mean(a))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 13 ==========\n",
    "Find the row means of the array in 11."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 61,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Row means:  [ 0.23850359 -0.37482093 -0.0875309   0.07097001  0.52656644]\n"
     ]
    }
   ],
   "source": [
    "# Your code goes here\n",
    "print(\"Row means: \", np.mean(a, axis=1))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 14 ==========\n",
    "Find the column means of the array in 11."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 62,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Column means:  [ 0.69775104  0.29614366 -0.41233935 -0.28260478]\n"
     ]
    }
   ],
   "source": [
    "# Your code goes here\n",
    "print(\"Column means: \", np.mean(a, axis=0))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 15 ==========\n",
    "Create a list with elements 2.2, 3.5, 0, 4, 0. and convert into numpy array. Find the indices of non-zero elements."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 63,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[ 2.2  3.5  0.   4.   0. ]\n",
      "Non-zero indices:  (array([0, 1, 3]),)\n"
     ]
    }
   ],
   "source": [
    "# Your code goes here\n",
    "a = [2.2, 3.5, 0, 4, 0.]\n",
    "a = np.asarray(a)\n",
    "print(a)\n",
    "print(\"Non-zero indices: \", np.nonzero(a))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 16 ==========\n",
    "Crate two random matrices of shape (5,4) and (4,2). Print their matrix product."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 64,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "a =  [[ 0.01375987  1.31094351  0.45705081  2.24897702]\n",
      " [ 0.1337739   2.27608082  0.78639787  0.812711  ]\n",
      " [-2.14840967  0.89108519 -0.2835157   0.41937045]\n",
      " [ 0.76535236  0.26417235 -0.13902847 -0.0829908 ]\n",
      " [ 0.21828222  0.62611011 -0.42153396  0.49258124]] \n",
      "b =  [[ 0.38717116 -0.22842257]\n",
      " [ 0.49144416 -1.38270019]\n",
      " [ 0.84551039  0.10442347]\n",
      " [-1.39448249 -0.57316453]] \n",
      "a * b =  [[-2.1001349  -3.05709193]\n",
      " [ 0.70195634 -3.56139309]\n",
      " [-1.21840388 -1.01133236]\n",
      " [ 0.42432753 -0.50704537]\n",
      " [-0.65109652 -1.24193129]]\n"
     ]
    }
   ],
   "source": [
    "# Your code goes here\n",
    "a = np.random.randn(5,4)\n",
    "b = np.random.randn(4,2)\n",
    "print(\"a = \", a, \"\\nb = \", b, \"\\na * b = \", np.dot(a,b))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 17 ==========\n",
    "Crate a random matrix of shape (5,3) and a random vector of size 3. Use broadcasting to add the two arrays."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 65,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "a =  [[-1.09736055  1.52786685  0.60229352]\n",
      " [-0.52968111 -0.45911216  2.08108063]\n",
      " [ 0.53230221 -0.38668726 -1.02610441]\n",
      " [-0.70165266  0.7035235  -0.32283042]\n",
      " [-0.45393068  0.4265523   1.45055824]] \n",
      "b =  [-0.71789844  0.4331292  -2.23310892] \n",
      "a + b =  [[-1.81525898  1.96099605 -1.6308154 ]\n",
      " [-1.24757955 -0.02598297 -0.1520283 ]\n",
      " [-0.18559623  0.04644194 -3.25921333]\n",
      " [-1.4195511   1.1366527  -2.55593934]\n",
      " [-1.17182911  0.8596815  -0.78255069]]\n"
     ]
    }
   ],
   "source": [
    "# Your code goes here\n",
    "a = np.random.randn(5,3)\n",
    "b = np.random.randn(3,)\n",
    "print(\"a = \", a, \"\\nb = \", b, \"\\na + b = \", a+b)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Pandas introduction"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "Pandas is a library for data manipulation and analysis. There are two fundamental data structures in pandas: the **Series** and **DataFrame** structures which are built on top of NumPy arrays.\n",
    "\n",
    "The following introduction is largely based on this [tutorial](http://www.gregreda.com/2013/10/26/intro-to-pandas-data-structures/). Another useful referece is the [Pandas introduction to data structures](http://pandas.pydata.org/pandas-docs/stable/dsintro.html). Pandas is well documented and you will find good information about all methods and structures in the [API reference](http://pandas.pydata.org/pandas-docs/stable/api.html)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Series"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "A **Series** a one-dimensional object (similar to a vector). Each element has a corresponding *index*. By default the indices range from 0 to N, where N is the length of the Series."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 66,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# First we need to import the pandas package\n",
    "import pandas as pd"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 67,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "0        1\n",
      "1      4.2\n",
      "2    Hello\n",
      "dtype: object\n"
     ]
    }
   ],
   "source": [
    "# Let's create a Series by passing in a list without specifying the indices.\n",
    "s = pd.Series([1, 4.2, 'Hello'])\n",
    "print(s)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 68,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "A        1\n",
      "B      4.2\n",
      "C    Hello\n",
      "dtype: object\n"
     ]
    }
   ],
   "source": [
    "# Now, let's specify the indices explicitly\n",
    "s = pd.Series([1, 4.2, 'Hello'], index=['A', 'B', 'C'])\n",
    "print(s)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 69,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "4.2"
      ]
     },
     "execution_count": 69,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Indexing the Series\n",
    "s['B']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 70,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "B      4.2\n",
       "C    Hello\n",
       "dtype: object"
      ]
     },
     "execution_count": 70,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# We can also index by using boolean logic\n",
    "s[s>2]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### DataFrame"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "A DataFrame is a tabular data structure comprised of rows and columns. You can also think of the DataFrame as a collection of Series objects that share an index. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Creating DataFrame structures"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We can create an empty DataFrame by specifying the column names. Then we can insert data row by row."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 71,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Empty DataFrame\n",
      "Columns: [Gender, Age, Height, Weight]\n",
      "Index: []\n"
     ]
    }
   ],
   "source": [
    "df = pd.DataFrame(columns=['Gender', 'Age', 'Height', 'Weight'])\n",
    "print(df)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 72,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Gender</th>\n",
       "      <th>Age</th>\n",
       "      <th>Height</th>\n",
       "      <th>Weight</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Male</td>\n",
       "      <td>23.0</td>\n",
       "      <td>180.0</td>\n",
       "      <td>73.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>A</th>\n",
       "      <td>Female</td>\n",
       "      <td>27.0</td>\n",
       "      <td>167.0</td>\n",
       "      <td>59.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   Gender   Age  Height  Weight\n",
       "0    Male  23.0   180.0    73.0\n",
       "A  Female  27.0   167.0    59.0"
      ]
     },
     "execution_count": 72,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Now let's add an observation\n",
    "df.loc[0] = ['Male', 23, 180, 73] # Note how we used .loc to specify the index\n",
    "df.loc['A'] = ['Female', 27, 167, 59]\n",
    "df"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Creating DataFrame from other structures"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "You can also create a dataframe from:\n",
    "* Dict of 1D ndarrays, lists, dicts, or Series\n",
    "* 2-D numpy.ndarray\n",
    "* Structured or record ndarray\n",
    "* A Series\n",
    "* Another DataFrame\n",
    "\n",
    "For example:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 73,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "   Gender  Age  Height  Weight\n",
      "0    Male   23     180      73\n",
      "A  Female   27     167      59\n"
     ]
    }
   ],
   "source": [
    "# Create a DataFrame from a list\n",
    "some_list = [['Male', 23, 180, 73], ['Female', 27, 167, 59]]\n",
    "df = pd.DataFrame(some_list, index=[0, 'A'], columns=['Gender', 'Age', 'Height', 'Weight'])\n",
    "print(df)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 74,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "   Gender  Age  Height  Weight\n",
      "0    Male   23     180      73\n",
      "A  Female   27     167      59\n"
     ]
    }
   ],
   "source": [
    "# Create a DataFrame from a dictionary\n",
    "some_dict = {0:['Male', 23, 180, 73], 'A':['Female', 27, 167, 59]}\n",
    "df2 = pd.DataFrame.from_dict(some_dict, orient='index')\n",
    "df2.columns = ['Gender', 'Age', 'Height', 'Weight']\n",
    "print(df2)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 75,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "   Gender Age Height Weight\n",
      "0    Male  23    180     73\n",
      "A  Female  27    167     59\n"
     ]
    }
   ],
   "source": [
    "# By default, dictionary keys are assumed to be the column headers, above we\n",
    "# explicitly made keys the row index using the `orient` argument. Below\n",
    "# We transpose using the `.T` method\n",
    "df3 = pd.DataFrame({0:['Male', 23, 180, 73], 'A':['Female', 27, 167, 59]}).T\n",
    "df3.columns = ['Gender', 'Age', 'Height', 'Weight']\n",
    "print(df3)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Loading a CSV into a DataFrame"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Most commonly we create DataFrame structures by reading csv files. To run the following piece of code you need to download the datasets associated with the course and place them in a subdirectory called \"datasets\" under the same directory that your notebooks are located. Alternatively, you can specify the full path of the .csv file."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 76,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>vendor</th>\n",
       "      <th>MYCT</th>\n",
       "      <th>MMIN</th>\n",
       "      <th>MMAX</th>\n",
       "      <th>CACH</th>\n",
       "      <th>CHMIN</th>\n",
       "      <th>CHMAX</th>\n",
       "      <th>ERP</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>adviser</td>\n",
       "      <td>125.0</td>\n",
       "      <td>256.0</td>\n",
       "      <td>6000.0</td>\n",
       "      <td>256.0</td>\n",
       "      <td>16.0</td>\n",
       "      <td>128.0</td>\n",
       "      <td>199.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>amdahl</td>\n",
       "      <td>29.0</td>\n",
       "      <td>8000.0</td>\n",
       "      <td>32000.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>8.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>253.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>amdahl</td>\n",
       "      <td>29.0</td>\n",
       "      <td>8000.0</td>\n",
       "      <td>32000.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>8.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>253.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>amdahl</td>\n",
       "      <td>29.0</td>\n",
       "      <td>8000.0</td>\n",
       "      <td>32000.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>8.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>253.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>amdahl</td>\n",
       "      <td>29.0</td>\n",
       "      <td>8000.0</td>\n",
       "      <td>16000.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>8.0</td>\n",
       "      <td>16.0</td>\n",
       "      <td>132.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    vendor   MYCT    MMIN     MMAX   CACH  CHMIN  CHMAX    ERP\n",
       "0  adviser  125.0   256.0   6000.0  256.0   16.0  128.0  199.0\n",
       "1   amdahl   29.0  8000.0  32000.0   32.0    8.0   32.0  253.0\n",
       "2   amdahl   29.0  8000.0  32000.0   32.0    8.0   32.0  253.0\n",
       "3   amdahl   29.0  8000.0  32000.0   32.0    8.0   32.0  253.0\n",
       "4   amdahl   29.0  8000.0  16000.0   32.0    8.0   16.0  132.0"
      ]
     },
     "execution_count": 76,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cpu_loc = os.path.join(os.getcwd(), 'datasets', 'cpu.csv')\n",
    "cpu = pd.read_csv(cpu_loc)\n",
    "cpu.head() # Head shows the first 10 elements (unless specified otherwise) of the DataFrame"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "You should see that each observation in our dataset comprises 8 measurements (attributes)."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Basic methods\n",
    "* `head(N)`: displays the first N elements of the DataFrame\n",
    "* `tail(N)`: displays the last N elements of the DataFrame\n",
    "* `info()`:  displays basic information about the variables\n",
    "* `describe()`: displays summary statistics of the data"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Execute the following cells and observe the outputs."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 77,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>vendor</th>\n",
       "      <th>MYCT</th>\n",
       "      <th>MMIN</th>\n",
       "      <th>MMAX</th>\n",
       "      <th>CACH</th>\n",
       "      <th>CHMIN</th>\n",
       "      <th>CHMAX</th>\n",
       "      <th>ERP</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>204</th>\n",
       "      <td>sperry</td>\n",
       "      <td>124.0</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>8000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>1.0</td>\n",
       "      <td>8.0</td>\n",
       "      <td>37.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>205</th>\n",
       "      <td>sperry</td>\n",
       "      <td>98.0</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>8000.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>2.0</td>\n",
       "      <td>8.0</td>\n",
       "      <td>50.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>206</th>\n",
       "      <td>sratus</td>\n",
       "      <td>125.0</td>\n",
       "      <td>2000.0</td>\n",
       "      <td>8000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>2.0</td>\n",
       "      <td>14.0</td>\n",
       "      <td>41.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>207</th>\n",
       "      <td>wang</td>\n",
       "      <td>480.0</td>\n",
       "      <td>512.0</td>\n",
       "      <td>8000.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>47.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>208</th>\n",
       "      <td>wang</td>\n",
       "      <td>480.0</td>\n",
       "      <td>1000.0</td>\n",
       "      <td>4000.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>0.0</td>\n",
       "      <td>25.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "     vendor   MYCT    MMIN    MMAX  CACH  CHMIN  CHMAX   ERP\n",
       "204  sperry  124.0  1000.0  8000.0   0.0    1.0    8.0  37.0\n",
       "205  sperry   98.0  1000.0  8000.0  32.0    2.0    8.0  50.0\n",
       "206  sratus  125.0  2000.0  8000.0   0.0    2.0   14.0  41.0\n",
       "207    wang  480.0   512.0  8000.0  32.0    0.0    0.0  47.0\n",
       "208    wang  480.0  1000.0  4000.0   0.0    0.0    0.0  25.0"
      ]
     },
     "execution_count": 77,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cpu.tail(5)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 78,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "RangeIndex: 209 entries, 0 to 208\n",
      "Data columns (total 8 columns):\n",
      "vendor    209 non-null object\n",
      "MYCT      209 non-null float64\n",
      "MMIN      209 non-null float64\n",
      "MMAX      209 non-null float64\n",
      "CACH      209 non-null float64\n",
      "CHMIN     209 non-null float64\n",
      "CHMAX     209 non-null float64\n",
      "ERP       209 non-null float64\n",
      "dtypes: float64(7), object(1)\n",
      "memory usage: 13.1+ KB\n"
     ]
    }
   ],
   "source": [
    "cpu.info()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 79,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>MYCT</th>\n",
       "      <th>MMIN</th>\n",
       "      <th>MMAX</th>\n",
       "      <th>CACH</th>\n",
       "      <th>CHMIN</th>\n",
       "      <th>CHMAX</th>\n",
       "      <th>ERP</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>count</th>\n",
       "      <td>209.000000</td>\n",
       "      <td>209.000000</td>\n",
       "      <td>209.000000</td>\n",
       "      <td>209.000000</td>\n",
       "      <td>209.000000</td>\n",
       "      <td>209.000000</td>\n",
       "      <td>209.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>mean</th>\n",
       "      <td>203.822967</td>\n",
       "      <td>2867.980861</td>\n",
       "      <td>11796.153110</td>\n",
       "      <td>25.205742</td>\n",
       "      <td>4.698565</td>\n",
       "      <td>18.267943</td>\n",
       "      <td>99.330144</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>std</th>\n",
       "      <td>260.262926</td>\n",
       "      <td>3878.742758</td>\n",
       "      <td>11726.564377</td>\n",
       "      <td>40.628722</td>\n",
       "      <td>6.816274</td>\n",
       "      <td>25.997318</td>\n",
       "      <td>154.757102</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>min</th>\n",
       "      <td>17.000000</td>\n",
       "      <td>64.000000</td>\n",
       "      <td>64.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>15.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25%</th>\n",
       "      <td>50.000000</td>\n",
       "      <td>768.000000</td>\n",
       "      <td>4000.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>5.000000</td>\n",
       "      <td>28.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>50%</th>\n",
       "      <td>110.000000</td>\n",
       "      <td>2000.000000</td>\n",
       "      <td>8000.000000</td>\n",
       "      <td>8.000000</td>\n",
       "      <td>2.000000</td>\n",
       "      <td>8.000000</td>\n",
       "      <td>45.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>75%</th>\n",
       "      <td>225.000000</td>\n",
       "      <td>4000.000000</td>\n",
       "      <td>16000.000000</td>\n",
       "      <td>32.000000</td>\n",
       "      <td>6.000000</td>\n",
       "      <td>24.000000</td>\n",
       "      <td>101.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>max</th>\n",
       "      <td>1500.000000</td>\n",
       "      <td>32000.000000</td>\n",
       "      <td>64000.000000</td>\n",
       "      <td>256.000000</td>\n",
       "      <td>52.000000</td>\n",
       "      <td>176.000000</td>\n",
       "      <td>1238.000000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "              MYCT          MMIN          MMAX        CACH       CHMIN  \\\n",
       "count   209.000000    209.000000    209.000000  209.000000  209.000000   \n",
       "mean    203.822967   2867.980861  11796.153110   25.205742    4.698565   \n",
       "std     260.262926   3878.742758  11726.564377   40.628722    6.816274   \n",
       "min      17.000000     64.000000     64.000000    0.000000    0.000000   \n",
       "25%      50.000000    768.000000   4000.000000    0.000000    1.000000   \n",
       "50%     110.000000   2000.000000   8000.000000    8.000000    2.000000   \n",
       "75%     225.000000   4000.000000  16000.000000   32.000000    6.000000   \n",
       "max    1500.000000  32000.000000  64000.000000  256.000000   52.000000   \n",
       "\n",
       "            CHMAX          ERP  \n",
       "count  209.000000   209.000000  \n",
       "mean    18.267943    99.330144  \n",
       "std     25.997318   154.757102  \n",
       "min      0.000000    15.000000  \n",
       "25%      5.000000    28.000000  \n",
       "50%      8.000000    45.000000  \n",
       "75%     24.000000   101.000000  \n",
       "max    176.000000  1238.000000  "
      ]
     },
     "execution_count": 79,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cpu.describe()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Selection"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "You can think of a DataFrame as a group of Series that share an index (in this case the column headers). This makes it easy to select specific **columns**."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 80,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0     6000.0\n",
       "1    32000.0\n",
       "2    32000.0\n",
       "3    32000.0\n",
       "4    16000.0\n",
       "Name: MMAX, dtype: float64"
      ]
     },
     "execution_count": 80,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cpu['MMAX'].head(5) # Display the first 5 elements"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 81,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "pandas.core.series.Series"
      ]
     },
     "execution_count": 81,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "type(cpu['MMAX'])   # This is a Series "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "To select multiple columns we simple need to pass a list of column names. The resulting object is another DataFrame."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 82,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>MMIN</th>\n",
       "      <th>MMAX</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>256.0</td>\n",
       "      <td>6000.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>8000.0</td>\n",
       "      <td>32000.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>8000.0</td>\n",
       "      <td>32000.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>8000.0</td>\n",
       "      <td>32000.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>8000.0</td>\n",
       "      <td>16000.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>8000.0</td>\n",
       "      <td>32000.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>16000.0</td>\n",
       "      <td>32000.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "      MMIN     MMAX\n",
       "0    256.0   6000.0\n",
       "1   8000.0  32000.0\n",
       "2   8000.0  32000.0\n",
       "3   8000.0  32000.0\n",
       "4   8000.0  16000.0\n",
       "5   8000.0  32000.0\n",
       "6  16000.0  32000.0"
      ]
     },
     "execution_count": 82,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cpu[['MMIN', 'MMAX']].head(7)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 83,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "pandas.core.frame.DataFrame"
      ]
     },
     "execution_count": 83,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "type(cpu[['MMIN', 'MMAX']].head(7)) # This is a DataFrame"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "To select specific **observations (i.e. rows)** we need to pass in the corresponding indices. This operation is called *slicing*. The resulting structure is again a DataFrame."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 84,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>vendor</th>\n",
       "      <th>MYCT</th>\n",
       "      <th>MMIN</th>\n",
       "      <th>MMAX</th>\n",
       "      <th>CACH</th>\n",
       "      <th>CHMIN</th>\n",
       "      <th>CHMAX</th>\n",
       "      <th>ERP</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>adviser</td>\n",
       "      <td>125.0</td>\n",
       "      <td>256.0</td>\n",
       "      <td>6000.0</td>\n",
       "      <td>256.0</td>\n",
       "      <td>16.0</td>\n",
       "      <td>128.0</td>\n",
       "      <td>199.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>amdahl</td>\n",
       "      <td>29.0</td>\n",
       "      <td>8000.0</td>\n",
       "      <td>32000.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>8.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>253.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>amdahl</td>\n",
       "      <td>29.0</td>\n",
       "      <td>8000.0</td>\n",
       "      <td>32000.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>8.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>253.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    vendor   MYCT    MMIN     MMAX   CACH  CHMIN  CHMAX    ERP\n",
       "0  adviser  125.0   256.0   6000.0  256.0   16.0  128.0  199.0\n",
       "1   amdahl   29.0  8000.0  32000.0   32.0    8.0   32.0  253.0\n",
       "2   amdahl   29.0  8000.0  32000.0   32.0    8.0   32.0  253.0"
      ]
     },
     "execution_count": 84,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cpu[0:3]  # Do not forget that Python follows 0-based indexing"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 85,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>vendor</th>\n",
       "      <th>MYCT</th>\n",
       "      <th>MMIN</th>\n",
       "      <th>MMAX</th>\n",
       "      <th>CACH</th>\n",
       "      <th>CHMIN</th>\n",
       "      <th>CHMAX</th>\n",
       "      <th>ERP</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>adviser</td>\n",
       "      <td>125.0</td>\n",
       "      <td>256.0</td>\n",
       "      <td>6000.0</td>\n",
       "      <td>256.0</td>\n",
       "      <td>16.0</td>\n",
       "      <td>128.0</td>\n",
       "      <td>199.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>amdahl</td>\n",
       "      <td>29.0</td>\n",
       "      <td>8000.0</td>\n",
       "      <td>32000.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>8.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>253.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>amdahl</td>\n",
       "      <td>29.0</td>\n",
       "      <td>8000.0</td>\n",
       "      <td>32000.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>8.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>253.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    vendor   MYCT    MMIN     MMAX   CACH  CHMIN  CHMAX    ERP\n",
       "0  adviser  125.0   256.0   6000.0  256.0   16.0  128.0  199.0\n",
       "1   amdahl   29.0  8000.0  32000.0   32.0    8.0   32.0  253.0\n",
       "2   amdahl   29.0  8000.0  32000.0   32.0    8.0   32.0  253.0"
      ]
     },
     "execution_count": 85,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# This is equivalent to using .iloc\n",
    "cpu.iloc[0:3]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Filtering"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now suppose that you want to select all the observations which have an MMAX value which is higher than 35000. It is easy to do that:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 86,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>vendor</th>\n",
       "      <th>MYCT</th>\n",
       "      <th>MMIN</th>\n",
       "      <th>MMAX</th>\n",
       "      <th>CACH</th>\n",
       "      <th>CHMIN</th>\n",
       "      <th>CHMAX</th>\n",
       "      <th>ERP</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>amdahl</td>\n",
       "      <td>23.0</td>\n",
       "      <td>16000.0</td>\n",
       "      <td>64000.0</td>\n",
       "      <td>64.0</td>\n",
       "      <td>16.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>749.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>amdahl</td>\n",
       "      <td>23.0</td>\n",
       "      <td>32000.0</td>\n",
       "      <td>64000.0</td>\n",
       "      <td>128.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>64.0</td>\n",
       "      <td>1238.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>198</th>\n",
       "      <td>sperry</td>\n",
       "      <td>30.0</td>\n",
       "      <td>8000.0</td>\n",
       "      <td>64000.0</td>\n",
       "      <td>96.0</td>\n",
       "      <td>12.0</td>\n",
       "      <td>176.0</td>\n",
       "      <td>919.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>199</th>\n",
       "      <td>sperry</td>\n",
       "      <td>30.0</td>\n",
       "      <td>8000.0</td>\n",
       "      <td>64000.0</td>\n",
       "      <td>128.0</td>\n",
       "      <td>12.0</td>\n",
       "      <td>176.0</td>\n",
       "      <td>978.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "     vendor  MYCT     MMIN     MMAX   CACH  CHMIN  CHMAX     ERP\n",
       "8    amdahl  23.0  16000.0  64000.0   64.0   16.0   32.0   749.0\n",
       "9    amdahl  23.0  32000.0  64000.0  128.0   32.0   64.0  1238.0\n",
       "198  sperry  30.0   8000.0  64000.0   96.0   12.0  176.0   919.0\n",
       "199  sperry  30.0   8000.0  64000.0  128.0   12.0  176.0   978.0"
      ]
     },
     "execution_count": 86,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cpu[cpu['MMAX'] > 35000]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Or equivalently:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 87,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>vendor</th>\n",
       "      <th>MYCT</th>\n",
       "      <th>MMIN</th>\n",
       "      <th>MMAX</th>\n",
       "      <th>CACH</th>\n",
       "      <th>CHMIN</th>\n",
       "      <th>CHMAX</th>\n",
       "      <th>ERP</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>amdahl</td>\n",
       "      <td>23.0</td>\n",
       "      <td>16000.0</td>\n",
       "      <td>64000.0</td>\n",
       "      <td>64.0</td>\n",
       "      <td>16.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>749.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>amdahl</td>\n",
       "      <td>23.0</td>\n",
       "      <td>32000.0</td>\n",
       "      <td>64000.0</td>\n",
       "      <td>128.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>64.0</td>\n",
       "      <td>1238.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>198</th>\n",
       "      <td>sperry</td>\n",
       "      <td>30.0</td>\n",
       "      <td>8000.0</td>\n",
       "      <td>64000.0</td>\n",
       "      <td>96.0</td>\n",
       "      <td>12.0</td>\n",
       "      <td>176.0</td>\n",
       "      <td>919.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>199</th>\n",
       "      <td>sperry</td>\n",
       "      <td>30.0</td>\n",
       "      <td>8000.0</td>\n",
       "      <td>64000.0</td>\n",
       "      <td>128.0</td>\n",
       "      <td>12.0</td>\n",
       "      <td>176.0</td>\n",
       "      <td>978.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "     vendor  MYCT     MMIN     MMAX   CACH  CHMIN  CHMAX     ERP\n",
       "8    amdahl  23.0  16000.0  64000.0   64.0   16.0   32.0   749.0\n",
       "9    amdahl  23.0  32000.0  64000.0  128.0   32.0   64.0  1238.0\n",
       "198  sperry  30.0   8000.0  64000.0   96.0   12.0  176.0   919.0\n",
       "199  sperry  30.0   8000.0  64000.0  128.0   12.0  176.0   978.0"
      ]
     },
     "execution_count": 87,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cpu[cpu.MMAX > 35000]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "You can also filter the data by using multiple attributes:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 88,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>vendor</th>\n",
       "      <th>MYCT</th>\n",
       "      <th>MMIN</th>\n",
       "      <th>MMAX</th>\n",
       "      <th>CACH</th>\n",
       "      <th>CHMIN</th>\n",
       "      <th>CHMAX</th>\n",
       "      <th>ERP</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>amdahl</td>\n",
       "      <td>23.0</td>\n",
       "      <td>32000.0</td>\n",
       "      <td>64000.0</td>\n",
       "      <td>128.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>64.0</td>\n",
       "      <td>1238.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   vendor  MYCT     MMIN     MMAX   CACH  CHMIN  CHMAX     ERP\n",
       "9  amdahl  23.0  32000.0  64000.0  128.0   32.0   64.0  1238.0"
      ]
     },
     "execution_count": 88,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cpu[(cpu.MMAX > 35000) & (cpu.MMIN > 16000)]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We saw before how we can select rows by passing the index numbers. This most of the time works but very often our indices are not in linear ascending order. \n",
    "\n",
    "There are two basic methods of indexing DataFrame structures:\n",
    "* `loc`: works on labels in the index\n",
    "* `iloc`: works on the position in the index (so it only takes integers)\n",
    "\n",
    "The following example should clarify the difference between label-based indexing (`loc`) and positional indexing (`iloc`)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 89,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>vendor</th>\n",
       "      <th>MYCT</th>\n",
       "      <th>MMIN</th>\n",
       "      <th>MMAX</th>\n",
       "      <th>CACH</th>\n",
       "      <th>CHMIN</th>\n",
       "      <th>CHMAX</th>\n",
       "      <th>ERP</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>amdahl</td>\n",
       "      <td>23.0</td>\n",
       "      <td>16000.0</td>\n",
       "      <td>64000.0</td>\n",
       "      <td>64.0</td>\n",
       "      <td>16.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>749.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>amdahl</td>\n",
       "      <td>23.0</td>\n",
       "      <td>32000.0</td>\n",
       "      <td>64000.0</td>\n",
       "      <td>128.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>64.0</td>\n",
       "      <td>1238.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>198</th>\n",
       "      <td>sperry</td>\n",
       "      <td>30.0</td>\n",
       "      <td>8000.0</td>\n",
       "      <td>64000.0</td>\n",
       "      <td>96.0</td>\n",
       "      <td>12.0</td>\n",
       "      <td>176.0</td>\n",
       "      <td>919.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>199</th>\n",
       "      <td>sperry</td>\n",
       "      <td>30.0</td>\n",
       "      <td>8000.0</td>\n",
       "      <td>64000.0</td>\n",
       "      <td>128.0</td>\n",
       "      <td>12.0</td>\n",
       "      <td>176.0</td>\n",
       "      <td>978.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "     vendor  MYCT     MMIN     MMAX   CACH  CHMIN  CHMAX     ERP\n",
       "8    amdahl  23.0  16000.0  64000.0   64.0   16.0   32.0   749.0\n",
       "9    amdahl  23.0  32000.0  64000.0  128.0   32.0   64.0  1238.0\n",
       "198  sperry  30.0   8000.0  64000.0   96.0   12.0  176.0   919.0\n",
       "199  sperry  30.0   8000.0  64000.0  128.0   12.0  176.0   978.0"
      ]
     },
     "execution_count": 89,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# First let's create a new dataframe\n",
    "cpu_new = cpu[cpu['MMAX'] > 35000]\n",
    "cpu_new"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 90,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>vendor</th>\n",
       "      <th>MYCT</th>\n",
       "      <th>MMIN</th>\n",
       "      <th>MMAX</th>\n",
       "      <th>CACH</th>\n",
       "      <th>CHMIN</th>\n",
       "      <th>CHMAX</th>\n",
       "      <th>ERP</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>amdahl</td>\n",
       "      <td>23.0</td>\n",
       "      <td>16000.0</td>\n",
       "      <td>64000.0</td>\n",
       "      <td>64.0</td>\n",
       "      <td>16.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>749.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>amdahl</td>\n",
       "      <td>23.0</td>\n",
       "      <td>32000.0</td>\n",
       "      <td>64000.0</td>\n",
       "      <td>128.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>64.0</td>\n",
       "      <td>1238.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   vendor  MYCT     MMIN     MMAX   CACH  CHMIN  CHMAX     ERP\n",
       "8  amdahl  23.0  16000.0  64000.0   64.0   16.0   32.0   749.0\n",
       "9  amdahl  23.0  32000.0  64000.0  128.0   32.0   64.0  1238.0"
      ]
     },
     "execution_count": 90,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cpu_new.loc[8:10] # Looks for the rows which are labelled 8 and 9"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 91,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>vendor</th>\n",
       "      <th>MYCT</th>\n",
       "      <th>MMIN</th>\n",
       "      <th>MMAX</th>\n",
       "      <th>CACH</th>\n",
       "      <th>CHMIN</th>\n",
       "      <th>CHMAX</th>\n",
       "      <th>ERP</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>amdahl</td>\n",
       "      <td>23.0</td>\n",
       "      <td>16000.0</td>\n",
       "      <td>64000.0</td>\n",
       "      <td>64.0</td>\n",
       "      <td>16.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>749.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>amdahl</td>\n",
       "      <td>23.0</td>\n",
       "      <td>32000.0</td>\n",
       "      <td>64000.0</td>\n",
       "      <td>128.0</td>\n",
       "      <td>32.0</td>\n",
       "      <td>64.0</td>\n",
       "      <td>1238.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   vendor  MYCT     MMIN     MMAX   CACH  CHMIN  CHMAX     ERP\n",
       "8  amdahl  23.0  16000.0  64000.0   64.0   16.0   32.0   749.0\n",
       "9  amdahl  23.0  32000.0  64000.0  128.0   32.0   64.0  1238.0"
      ]
     },
     "execution_count": 91,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "cpu_new.iloc[0:2] # Look for the first and second rows (this yields the same result as before)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 92,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>vendor</th>\n",
       "      <th>MYCT</th>\n",
       "      <th>MMIN</th>\n",
       "      <th>MMAX</th>\n",
       "      <th>CACH</th>\n",
       "      <th>CHMIN</th>\n",
       "      <th>CHMAX</th>\n",
       "      <th>ERP</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "Empty DataFrame\n",
       "Columns: [vendor, MYCT, MMIN, MMAX, CACH, CHMIN, CHMAX, ERP]\n",
       "Index: []"
      ]
     },
     "execution_count": 92,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# If we try the following we will get an empty DataFrame because there are no rows with labels 0 and 1.\n",
    "cpu_new.loc[0:2]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 93,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "pandas.core.frame.DataFrame"
      ]
     },
     "execution_count": 93,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# The result is another DataFrame\n",
    "type(cpu[0:2])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "A very common scenario will be the following. We want to select specific observations and columns of a DataFrame and convert to a NumPy array so that we can use it for feature extraction, classification etc. This can be achieved by using the `values` method."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 94,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([[   256.,   6000.],\n",
       "       [  8000.,  32000.],\n",
       "       [  8000.,  32000.],\n",
       "       [  8000.,  32000.],\n",
       "       [  8000.,  16000.],\n",
       "       [  8000.,  32000.],\n",
       "       [ 16000.,  32000.],\n",
       "       [ 16000.,  32000.],\n",
       "       [ 16000.,  64000.],\n",
       "       [ 32000.,  64000.]])"
      ]
     },
     "execution_count": 94,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Select the first 10 observations and the \"MMIN\" and \"MMAX\" columns only and convert to numpy array.\n",
    "cpu[:10][['MMIN', 'MMAX']].values"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "You can confirm that by using the `values` method the resulting object is a NumPy array."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Pandas exercises"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 18 ==========\n",
    "Load the `credit` dataset and display the dataset basic information."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 95,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<class 'pandas.core.frame.DataFrame'>\n",
      "RangeIndex: 1001 entries, 0 to 1000\n",
      "Data columns (total 21 columns):\n",
      "CheckingAccount     1001 non-null object\n",
      "Duration            1001 non-null float64\n",
      "CreditHistory       1001 non-null object\n",
      "Purpose             1001 non-null object\n",
      "CreditAmount        1001 non-null float64\n",
      "SavingsAccount      1001 non-null object\n",
      "YearsEmployed       1001 non-null object\n",
      "InstallmentRate     1001 non-null float64\n",
      "PersonalStatus      1001 non-null object\n",
      "OtherDebtors        1001 non-null object\n",
      "ResidentSince       1001 non-null float64\n",
      "Property            1001 non-null object\n",
      "Age                 1001 non-null float64\n",
      "OtherPlans          1001 non-null object\n",
      "Housing             1001 non-null object\n",
      "NumCreditsAtBank    1001 non-null float64\n",
      "Job                 1001 non-null object\n",
      "Dependents          1001 non-null float64\n",
      "Telephone           1001 non-null object\n",
      "Foreign             1001 non-null object\n",
      "Approve             1001 non-null object\n",
      "dtypes: float64(7), object(14)\n",
      "memory usage: 164.3+ KB\n"
     ]
    }
   ],
   "source": [
    "# Your code goes here\n",
    "credit_path = os.path.join(os.getcwd(), 'datasets', 'credit.csv')\n",
    "credit = pd.read_csv(credit_path)\n",
    "credit.info()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 19 ==========\n",
    "Display the summary statistics of the attributes of the dataset."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 96,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Duration</th>\n",
       "      <th>CreditAmount</th>\n",
       "      <th>InstallmentRate</th>\n",
       "      <th>ResidentSince</th>\n",
       "      <th>Age</th>\n",
       "      <th>NumCreditsAtBank</th>\n",
       "      <th>Dependents</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>count</th>\n",
       "      <td>1001.000000</td>\n",
       "      <td>1.001000e+03</td>\n",
       "      <td>1001.000000</td>\n",
       "      <td>1001.000000</td>\n",
       "      <td>1001.000000</td>\n",
       "      <td>1001.000000</td>\n",
       "      <td>1001.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>mean</th>\n",
       "      <td>20.882118</td>\n",
       "      <td>-9.957330e+05</td>\n",
       "      <td>-7.019980</td>\n",
       "      <td>2.842158</td>\n",
       "      <td>35.217782</td>\n",
       "      <td>0.406593</td>\n",
       "      <td>0.969031</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>std</th>\n",
       "      <td>12.070878</td>\n",
       "      <td>3.160708e+07</td>\n",
       "      <td>316.165715</td>\n",
       "      <td>1.106825</td>\n",
       "      <td>15.398264</td>\n",
       "      <td>31.656714</td>\n",
       "      <td>5.894916</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>min</th>\n",
       "      <td>0.000000</td>\n",
       "      <td>-1.000000e+09</td>\n",
       "      <td>-10000.000000</td>\n",
       "      <td>0.000000</td>\n",
       "      <td>-293.000000</td>\n",
       "      <td>-1000.000000</td>\n",
       "      <td>-185.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25%</th>\n",
       "      <td>12.000000</td>\n",
       "      <td>1.364000e+03</td>\n",
       "      <td>2.000000</td>\n",
       "      <td>2.000000</td>\n",
       "      <td>27.000000</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>1.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>50%</th>\n",
       "      <td>18.000000</td>\n",
       "      <td>2.319000e+03</td>\n",
       "      <td>3.000000</td>\n",
       "      <td>3.000000</td>\n",
       "      <td>33.000000</td>\n",
       "      <td>1.000000</td>\n",
       "      <td>1.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>75%</th>\n",
       "      <td>24.000000</td>\n",
       "      <td>3.972000e+03</td>\n",
       "      <td>4.000000</td>\n",
       "      <td>4.000000</td>\n",
       "      <td>42.000000</td>\n",
       "      <td>2.000000</td>\n",
       "      <td>1.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>max</th>\n",
       "      <td>72.000000</td>\n",
       "      <td>1.842400e+04</td>\n",
       "      <td>4.000000</td>\n",
       "      <td>4.000000</td>\n",
       "      <td>75.000000</td>\n",
       "      <td>4.000000</td>\n",
       "      <td>2.000000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "          Duration  CreditAmount  InstallmentRate  ResidentSince          Age  \\\n",
       "count  1001.000000  1.001000e+03      1001.000000    1001.000000  1001.000000   \n",
       "mean     20.882118 -9.957330e+05        -7.019980       2.842158    35.217782   \n",
       "std      12.070878  3.160708e+07       316.165715       1.106825    15.398264   \n",
       "min       0.000000 -1.000000e+09    -10000.000000       0.000000  -293.000000   \n",
       "25%      12.000000  1.364000e+03         2.000000       2.000000    27.000000   \n",
       "50%      18.000000  2.319000e+03         3.000000       3.000000    33.000000   \n",
       "75%      24.000000  3.972000e+03         4.000000       4.000000    42.000000   \n",
       "max      72.000000  1.842400e+04         4.000000       4.000000    75.000000   \n",
       "\n",
       "       NumCreditsAtBank   Dependents  \n",
       "count       1001.000000  1001.000000  \n",
       "mean           0.406593     0.969031  \n",
       "std           31.656714     5.894916  \n",
       "min        -1000.000000  -185.000000  \n",
       "25%            1.000000     1.000000  \n",
       "50%            1.000000     1.000000  \n",
       "75%            2.000000     1.000000  \n",
       "max            4.000000     2.000000  "
      ]
     },
     "execution_count": 96,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Your code goes here\n",
    "credit.describe()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 20 ==========\n",
    "Display the last 6 instances of the dataset."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 97,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>CheckingAccount</th>\n",
       "      <th>Duration</th>\n",
       "      <th>CreditHistory</th>\n",
       "      <th>Purpose</th>\n",
       "      <th>CreditAmount</th>\n",
       "      <th>SavingsAccount</th>\n",
       "      <th>YearsEmployed</th>\n",
       "      <th>InstallmentRate</th>\n",
       "      <th>PersonalStatus</th>\n",
       "      <th>OtherDebtors</th>\n",
       "      <th>...</th>\n",
       "      <th>Property</th>\n",
       "      <th>Age</th>\n",
       "      <th>OtherPlans</th>\n",
       "      <th>Housing</th>\n",
       "      <th>NumCreditsAtBank</th>\n",
       "      <th>Job</th>\n",
       "      <th>Dependents</th>\n",
       "      <th>Telephone</th>\n",
       "      <th>Foreign</th>\n",
       "      <th>Approve</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>995</th>\n",
       "      <td>none</td>\n",
       "      <td>12.0</td>\n",
       "      <td>ok_til_now</td>\n",
       "      <td>car_new</td>\n",
       "      <td>2390.0</td>\n",
       "      <td>unknown</td>\n",
       "      <td>&gt;=7</td>\n",
       "      <td>4.0</td>\n",
       "      <td>male_single</td>\n",
       "      <td>none</td>\n",
       "      <td>...</td>\n",
       "      <td>car</td>\n",
       "      <td>50.0</td>\n",
       "      <td>none</td>\n",
       "      <td>own</td>\n",
       "      <td>1.0</td>\n",
       "      <td>skilled</td>\n",
       "      <td>1.0</td>\n",
       "      <td>yes</td>\n",
       "      <td>yes</td>\n",
       "      <td>good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>996</th>\n",
       "      <td>none</td>\n",
       "      <td>12.0</td>\n",
       "      <td>ok_til_now</td>\n",
       "      <td>furniture</td>\n",
       "      <td>1736.0</td>\n",
       "      <td>&lt;100</td>\n",
       "      <td>&lt;7</td>\n",
       "      <td>3.0</td>\n",
       "      <td>female</td>\n",
       "      <td>none</td>\n",
       "      <td>...</td>\n",
       "      <td>real_estate</td>\n",
       "      <td>31.0</td>\n",
       "      <td>none</td>\n",
       "      <td>own</td>\n",
       "      <td>1.0</td>\n",
       "      <td>unskilled</td>\n",
       "      <td>1.0</td>\n",
       "      <td>no</td>\n",
       "      <td>yes</td>\n",
       "      <td>good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>997</th>\n",
       "      <td>&lt;0</td>\n",
       "      <td>30.0</td>\n",
       "      <td>ok_til_now</td>\n",
       "      <td>car_used</td>\n",
       "      <td>3857.0</td>\n",
       "      <td>&lt;100</td>\n",
       "      <td>&lt;4</td>\n",
       "      <td>4.0</td>\n",
       "      <td>male_divorced</td>\n",
       "      <td>none</td>\n",
       "      <td>...</td>\n",
       "      <td>savings</td>\n",
       "      <td>40.0</td>\n",
       "      <td>none</td>\n",
       "      <td>own</td>\n",
       "      <td>1.0</td>\n",
       "      <td>management</td>\n",
       "      <td>1.0</td>\n",
       "      <td>yes</td>\n",
       "      <td>yes</td>\n",
       "      <td>good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>998</th>\n",
       "      <td>none</td>\n",
       "      <td>12.0</td>\n",
       "      <td>ok_til_now</td>\n",
       "      <td>television</td>\n",
       "      <td>804.0</td>\n",
       "      <td>&lt;100</td>\n",
       "      <td>&gt;=7</td>\n",
       "      <td>4.0</td>\n",
       "      <td>male_single</td>\n",
       "      <td>none</td>\n",
       "      <td>...</td>\n",
       "      <td>car</td>\n",
       "      <td>38.0</td>\n",
       "      <td>none</td>\n",
       "      <td>own</td>\n",
       "      <td>1.0</td>\n",
       "      <td>skilled</td>\n",
       "      <td>1.0</td>\n",
       "      <td>no</td>\n",
       "      <td>yes</td>\n",
       "      <td>good</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>999</th>\n",
       "      <td>&lt;0</td>\n",
       "      <td>45.0</td>\n",
       "      <td>ok_til_now</td>\n",
       "      <td>television</td>\n",
       "      <td>1845.0</td>\n",
       "      <td>&lt;100</td>\n",
       "      <td>&lt;4</td>\n",
       "      <td>4.0</td>\n",
       "      <td>male_single</td>\n",
       "      <td>none</td>\n",
       "      <td>...</td>\n",
       "      <td>unknown</td>\n",
       "      <td>23.0</td>\n",
       "      <td>none</td>\n",
       "      <td>free</td>\n",
       "      <td>1.0</td>\n",
       "      <td>skilled</td>\n",
       "      <td>1.0</td>\n",
       "      <td>yes</td>\n",
       "      <td>yes</td>\n",
       "      <td>bad</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1000</th>\n",
       "      <td>&lt;200</td>\n",
       "      <td>45.0</td>\n",
       "      <td>critical</td>\n",
       "      <td>car_used</td>\n",
       "      <td>4576.0</td>\n",
       "      <td>&lt;500</td>\n",
       "      <td>unemployed</td>\n",
       "      <td>3.0</td>\n",
       "      <td>male_single</td>\n",
       "      <td>none</td>\n",
       "      <td>...</td>\n",
       "      <td>car</td>\n",
       "      <td>27.0</td>\n",
       "      <td>none</td>\n",
       "      <td>own</td>\n",
       "      <td>1.0</td>\n",
       "      <td>skilled</td>\n",
       "      <td>1.0</td>\n",
       "      <td>no</td>\n",
       "      <td>yes</td>\n",
       "      <td>good</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>6 rows × 21 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "     CheckingAccount  Duration CreditHistory     Purpose  CreditAmount  \\\n",
       "995             none      12.0    ok_til_now     car_new        2390.0   \n",
       "996             none      12.0    ok_til_now   furniture        1736.0   \n",
       "997               <0      30.0    ok_til_now    car_used        3857.0   \n",
       "998             none      12.0    ok_til_now  television         804.0   \n",
       "999               <0      45.0    ok_til_now  television        1845.0   \n",
       "1000            <200      45.0      critical    car_used        4576.0   \n",
       "\n",
       "     SavingsAccount YearsEmployed  InstallmentRate PersonalStatus  \\\n",
       "995         unknown           >=7              4.0    male_single   \n",
       "996            <100            <7              3.0         female   \n",
       "997            <100            <4              4.0  male_divorced   \n",
       "998            <100           >=7              4.0    male_single   \n",
       "999            <100            <4              4.0    male_single   \n",
       "1000           <500    unemployed              3.0    male_single   \n",
       "\n",
       "     OtherDebtors   ...       Property   Age  OtherPlans Housing  \\\n",
       "995          none   ...            car  50.0        none     own   \n",
       "996          none   ...    real_estate  31.0        none     own   \n",
       "997          none   ...        savings  40.0        none     own   \n",
       "998          none   ...            car  38.0        none     own   \n",
       "999          none   ...        unknown  23.0        none    free   \n",
       "1000         none   ...            car  27.0        none     own   \n",
       "\n",
       "     NumCreditsAtBank         Job Dependents  Telephone Foreign Approve  \n",
       "995               1.0     skilled        1.0        yes     yes    good  \n",
       "996               1.0   unskilled        1.0         no     yes    good  \n",
       "997               1.0  management        1.0        yes     yes    good  \n",
       "998               1.0     skilled        1.0         no     yes    good  \n",
       "999               1.0     skilled        1.0        yes     yes     bad  \n",
       "1000              1.0     skilled        1.0         no     yes    good  \n",
       "\n",
       "[6 rows x 21 columns]"
      ]
     },
     "execution_count": 97,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Your code goes here\n",
    "credit.tail(6)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 21 ==========\n",
    "Print the 5th observation (do not forget that Python follows 0-base indexing)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 98,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "CheckingAccount              <0\n",
      "Duration                     42\n",
      "CreditHistory        ok_til_now\n",
      "Purpose               furniture\n",
      "CreditAmount               7882\n",
      "SavingsAccount             <100\n",
      "YearsEmployed                <7\n",
      "InstallmentRate               2\n",
      "PersonalStatus      male_single\n",
      "OtherDebtors          guarantor\n",
      "ResidentSince                 4\n",
      "Property                savings\n",
      "Age                          45\n",
      "OtherPlans                 none\n",
      "Housing                    free\n",
      "NumCreditsAtBank              1\n",
      "Job                     skilled\n",
      "Dependents                    2\n",
      "Telephone                    no\n",
      "Foreign                     yes\n",
      "Approve                    good\n",
      "Name: 4, dtype: object\n"
     ]
    }
   ],
   "source": [
    "# Your code goes here\n",
    "print(credit.iloc[4])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 22 ==========\n",
    "Print the standard deviation of the attribute `CreditAmount` by using the numpy method `std`. You can verify you get the correct result by inspecting the statistics table from Question 19."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 99,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "31591288.885041825"
      ]
     },
     "execution_count": 99,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Your code goes here\n",
    "credit['CreditAmount'].values.std()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Matplotlib introduction"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Matplotlib is a 2D python plotting library with a similar interface to MATLAB's plot engine. The library is fully compatible with NumPy which means that we can -and most of the times will- pass numpy arrays as input arguments to the various plotting functions.\n",
    "\n",
    "There are many [resources](http://matplotlib.org/resources/index.html) for learning how to use Matplotlib. The following examples demonstrate only some basic plotting functions. When you are looking for a particular feature which you don't know yet how to implement a web search can prove very useful."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 100,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "# First we need to import the package and force it to render plots inside the notebook\n",
    "import matplotlib.pyplot as plt\n",
    "%matplotlib inline"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 101,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAewAAAE4CAYAAACZhcBZAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzt3XmczfX3wPHX21ZklEFlF0UitKGs7ShRSqiQhKJo+yIV\nFUJaLRlRtNj3LWvZki1LSLbsiexZx5j3748z008yZruf+773c8/z8fAo3LmfczH33Pf7c97nGGst\nSimllAptGVwHoJRSSqnkacJWSimlwoAmbKWUUioMaMJWSimlwoAmbKWUUioMaMJWSimlwkBAErYx\nZrAxZq8x5peLPOZTY8wmY8wqY0y5QFxXKaWUihSBWmF/Cdyf1G8aY2oCxay11wEtgQEBuq5SSikV\nEQKSsK21C4FDF3lIHeCrhMcuAS43xlwViGsrpZRSkSBY97DzAzvP+fnuhF9TSimlVApo0ZlSSikV\nBjIF6Tq7gYLn/LxAwq/9hzFGm5srpZSKKNZak9xjArnCNgk/LmQS0BjAGFMROGyt3ZvUE1lrffmj\nc+fOzmPQ1xc5r+/0acuXX1oqVLAUKGDp0MEyb54lNjblr++vvyxDh1oeeMCSI4eleXPLb7+5f20h\n8fe3Zw/2zTexefJgK1fGfvQRduvWlH99fDx21Spst27YsmWx116L/eAD7MGD7l9biP3w++tLqUAd\n6xoGLAKKG2N2GGOeNsa0NMa0SEjA04CtxpjNQAzwfCCuq5T6r7g4GDoUrr8ehg2DN96ArVvhvfeg\nalXInDnlz5U7NzRuDFOmwObNUKAAVKkCjzwCGzZ49xpC2v798MILULKk/P+CBfKjXTsoUiTlz2MM\nlC0Lr78OK1fCV1/BihVw3XXQvTscP+7ZS1DhKVBV4o2stfmstZdYawtZa7+01sZYawee85g21tpr\nrbVlrbUrAnFdpdS/LVoE5crBoEGStGfOhAcfhEwBuPmVJw907gzbtsEdd0ClSvDKK3DkSPqfOyyc\nOQMffiiJGmDjRujfH0qUSP9zGwO33w7ffCN/iatWQfHi8O23kIoVmPI3LToLourVq7sOwVP6+tw5\nehTatIFHH4W33oL582UlnBopfX3ZssGrr8K6dZKsS5WSDwahLl1/f7/+Kgl1xgxZTffpI59gvFC8\nOIwaBePGQY8e8NBDsPuCJT//COV/m4Hg99eXUiY1++fBYIyxoRaTUqFs5Up47DHZ7v7gA8iZM7jX\nnzMHmjaFhx+Gnj0ha9bgXt9T1sLHH8sWdbdu8OyzshoOlthYuZfRrx8MGCD3IpTvGGOwKSg604St\nVJiyFgYOlHvUffpAgwbuYjl4EJ57DjZtggkToFAhd7EEzLFj8PTTsGMHDB8ORYu6i2X5ctk+efRR\nSeCpKURIhyJFirB9+/agXCsSFC5cmG3btv3n1zVhK+VjcXHQurXc7hwzJjC3UdPLWlnhf/ih7OhW\nruw6onTYsgXq1oXy5WV1e+mlriOCAwfgySfh5EnZLo+O9vySCYnE8+tEiqT+PFOasPUetlJh5tgx\nqFMHtm+XhB0KyRpkp/jVV+GLL6BePalQD0vLl8unjZYtpXovFJI1QK5cMHUq3HKLxLdjh+uIVJBp\nwlYqjPz1F1SrBnnzwuTJEBXlOqL/qlFD7mv/73/w2Weuo0mlOXOgVi25X9ymTXDvV6dEhgyyjfHs\ns1Km/0uSAxKVDwWr05lSKp327YO774bataX+KdRyyblKl5ZK9XvvhUOH5KhxyJs4URLh6NHyqSiU\nvfQS5MsH990H06fLWT7le7rCVioM7N0Ld94pRcKhnqwTFS0KCxfC11/L6aSQNm2aJOtp00I/WSd6\n/HG5v16jhpzbVgFRunRp5s+f7zqMC9KErVSIO3gQ7roL6teHt98Oj2SdKG9emD0bPv8cPv3UdTRJ\nmDVLzqVNmgS33uo6mtSpVw/69pWkHaHb48OGDeO2224jKiqK/Pnz88ADD/Djjz+m+fnWrl1L1apV\nAxhh4OiWuFIh7MQJ6VRWq5Z0GQtH+fPLreFq1eCyy+CZZ1xHdI6ffoInnpCq64oVXUeTNo8+KscG\natWCH3+EwoVdRxQ0H374Ib169SImJob77ruPLFmyMGPGDCZPnkylSpVchxd4rpueX6AJulVKWRsb\na22tWtY2bmzt2bOuo0m/jRutvfpqa6dNcx1Jgo0brb3qqhAKKJ0++sja66+3dv/+gD1lKL8fHzly\nxGbPnt2OHTv2gr9/+vRp27ZtW5svXz6bP39+265dOxsbG2uttXb//v32wQcftFdccYWNjo62VatW\n/efrihQpYufMmWOttbZLly62fv36tnHjxjYqKsqWLl3a/vzzz/889o8//rD16tWzefLksUWLFrWf\nfvrpRWNO6s8z4deTzY+6Ja5UCLJWGpFYKyeLMvjgO/W662DsWBkm4vyW619/Qc2a8O678l8/aNdO\nKhJr15az2j73008/cfr0aerWrXvB3+/atStLly7ll19+YfXq1SxdupSuXbsC8MEHH1CwYEEOHDjA\nvn376N69e5LXmTx5Mo0aNeLIkSPUrl2b1q1bA7LYrV27NjfddBN79uxhzpw5fPLJJ8yaNSvwLzaB\nD94GlPKfTz6BZcukAUmQmloFxR13yLyM2rVh1y5HQZw6Jf25GzSQQjM/6dFD2sw9+2zQhoYYE5gf\nqXXgwAFy585NhiQ+zQ4bNozOnTuTK1cucuXKRefOnfn6668ByJw5M3v27GHr1q1kzJjxotvnlStX\n5v7778cYw1NPPcUvCbUCS5cuZf/+/XTq1ImMGTNSpEgRmjdvzogRI1L/YlJIE7ZSIWbGDOnJPWkS\nZM/uOprAe+wx6dL28MOSO4PKWrl4gQKyuvabDBmkc8369dC7d1AuaW1gfqRWrly52L9/P/Hx8Rf8\n/T/++INC5/TILVy4MH/88QcAr732GsWKFeO+++7j2muvpWfPnkle5+qrr/7n/7Nly8apU6eIj49n\nx44d7N69m+joaKKjo8mZMyfvvfce+/btS/2LSSFN2EqFkI0b4amn5Ciwn2uH2reHa66R3BnUzpef\nfQZLl8KXX4ZXuX1qZMsmDd0/+gi++851NJ65/fbbueSSS5gwYcIFfz9//vz/6oO+fft28uXLB0D2\n7Nnp3bs3W7ZsYdKkSXz44Yf88MMPqbp+wYIFKVq0KAcPHuTgwYMcOnSII0eOMHny5LS/qGRowlYq\nRJw4IQW/774b5n24U8AYWQguWSIDTIJi4UI5Fzdhgj+3Ls5VsKB86mvSBLZudR2NJ3LkyMHbb79N\n69atmThxIidPniQuLo7p06fTvn17GjZsSNeuXdm/fz/79+/n3Xff5amnngJg6tSpbNmyBYCoqCgy\nZcpExowZU3Rdm/AJs3z58kRFRdGrVy9OnTrF2bNnWbduHcuXL/fmBaPHupQKGS+8AGXKQIsWriMJ\njuzZYfx46bB5000yZ8Mz+/bJPeshQ6BYMQ8vFEIqVZIWc48/Lh9WsmRxHVHAvfzyy+TNm5euXbvy\n5JNPEhUVxS233EKnTp24+eabOXLkCGXKlMEYQ/369enUqRMAmzZtok2bNuzfv5+cOXPSunXrf85e\nm2R2XhJ/P0OGDEyZMoWXX36Za665htjYWEqUKPFPYZsXdFqXUiFgyBDo1Ut2a/2++Dvf2LHSd3zl\nSsiRw4MLxMfDAw9A2bJh0HItwKyV9niFCkklYyrptK7ASu+0Lk3YSjm2fj1UrQpz50KpUq6jcaNV\nKzh6FL791oNby++/L0v5efP8VXKfUocOyYSv3r0leaeCJuzA0oStVBiLjZUGW61aRc5W+IWcPAm3\n3QavvAJPPx3AJ16yRM6QLVvm7yq+5CxdKn8OK1ZI67kU0oQdWJqwlQpjHTrICnvCBP8WLafUunXS\nvnTxYrj22gA84fHjcnO8Wzc5Sxbp3nlH7mVPn57iTjyasANLE7ZSYWruXGjUCFavhjx5XEcTGj7+\nGMaMkd3rFBbtJu2FF2Q7+JtvAhJb2IuLk+MHTzwhfzYpoAk7sDRhKxWGjh2TmdH9+8vMBiXi42Uy\n2YMPwquvpuOJZs+WvfVffoGcOQMWX9jbtEnazc2fDyVLJvtwTdiBpQlbqTD04otSZDVkiOtIQs/W\nrXLEK81FeEeOwI03wuDBcO+9gQ4v/PXvL9V9CxYkuzWuCTuwNGErFWZ+/FFuqa5dC9HRrqMJTZ9/\nLg1VFi9Ow9Z44tSUAQM8iS3sxcfLsYQGDaBNm4s+VBN2YGnCViqMnDoldVDvvitdzdSFWQt33imn\nkF58MRVfuHChNApZtw6uuMKz+MLeb7/J/ewVK+SMdhI0YQdWehO2tiZVKoi6dpVbh/XquY4ktBkD\nMTFS2LxzZwq/6PRpORv36aearJNz/fUyjjNxN8KHhg0bRo0aNVyHEVC6wlYqSFavlluqq1dD3ryu\nowkPb78tHdCSmO/wb++8Az//rGfkUio2Fm69FTp2hIYNL/iQcFhhL1y4kPbt27Nu3ToyZcpEyZIl\n+fjjj7nllltch/YfuiWuVBg4exYqVIDnn4dmzVxHEz5On4Zy5aB7dxnHmaTELd6VK2XwhUqZpUtl\nNvjatZA7939+O9QT9t9//02hQoWIiYnhscceIzY2lgULFnD11VdTunRp1+H9h26JKxUGPv9cph4G\ntItXBLjkEtkaT6yqv6D4eNkK79xZk3VqlS8vq+v27V1HkiYbN278Z7CHMYZLLrmEe+65h9KlSzN0\n6FCqVKnyz2MzZMhATEwMxYsXJzo6mjbnFdx98cUX3HDDDeTKlYuaNWuyY8eOYL+cZGnCVspjBw7A\nW29B3766U5sWVavC/fdDwqCl//rqK6nme/75oMblG2+/LXOzly51HUmqFS9enIwZM9K0aVOmT5/O\n4cOH//X750/emjp1Kj///DOrV69m1KhRzJw5E4CJEyfSo0cPJkyYwF9//UWVKlVomMRtApc0YSvl\nsU6d5ARNmTKuIwlfvXrBqFHSB+Vfjh6VEZL9+gWgNVqEypED3ntPjnjFx6f+640JzI80iIqKYuHC\nhWTIkIEWLVqQJ08e6taty759+y74+I4dOxIVFUXBggW58847WbVqFQAxMTF07NiR4sWLkyFDBjp0\n6MCqVavYmeKKx+DQhK2UhxJroN55x3Uk4S06Grp0kcLmf90CfPddqFFDJoeotHvqKfnAk5ZOPtYG\n5kcalShRgi+++IIdO3awbt06du/eTbt27S742Kuuuuqf/8+WLRvHjh0DYPv27bRt25bo6Giio6PJ\nlSsXxhh2796d5ri8oAlbKY/Ex8uipXt3PWUUCM8+C/v3y6RMADZuhC+/lD9glT4ZMsg9m06d4Lxt\n5XBSvHhxmjZtyrp161L1dQULFiQmJoaDBw9y8OBBDh06xLFjx6hYsaJHkaaNJmylPPLVV5K0mzZ1\nHYk/ZMokw0FeeUVuWfPSSzLu7OqrXYfmD7fcIhXjXbq4jiTFNmzYwIcffvjPSnjnzp0MHz481Ym2\nVatWdO/enV9//RWAI0eOMGbMmIDHm16asJXywNGjcry1b98UTzJUKXDXXXDzzTCxxVTYvDmVbdBU\nsrp1g2HD5JhXGIiKimLJkiVUqFCBqKgo7rjjDsqUKcMHH3zwn8eeX4B27s/r1q1Lhw4daNCgAVdc\ncQVlypRh+vTpnsefWnoOWykPdOoEu3frcA8v/P5bLLZUaS7/8mNyN9ZRZwHXty9MmgQzZ4b8Oexw\no+ewlQoxO3fK3ImuXV1H4k9Fp/Ul7prraDdTk7UnWraE7dsh4ciTCh26wlYqwJo2hXz5tBbKE4cP\nQ/HiHJ82l+J1bmDSJLn1qgJs/Hh4+23M6tW6wg4gbU2qVAhZvVqafGzYAJdf7joaH+rQQUrFBw1i\nwAAYOxZmzXIdlA9ZC5UrYxYt0oQdQJqwlQoh990nhbbJjBlWabFrF5QtK91T8ufnzBkoVUp6ptx7\nr+vgfGjRIkylSpqwA0gTtlIhYsYMeOEFGcWcObPraHzomWfgyiulK1eCMWPk1sPy5VqN7wUtOgss\nLTpTKgScPQuvvQY9emiy9sS6dTB58n+GVNSrJ3/eo0Y5ikupIMrkOgCl/GD4cMiePZkRkCrtOnaU\n+9fntYwzBnr2lMX3I49AliyO4vOpwoUL/+f8skq7woULp+vrdUtcqXQ6cwZKloRBg6B6ddfR+NCC\nBdLresMGmbd5ATVrwgMPaO2AJ/buhRtugFWrdHypR/QetlJBMmgQjBgBs2e7jsSHrJX5ms2bQ5Mm\nST4ssTp/0yaIigpifJGiQwc5UjdggOtIfEkTtlJBcPo0XHcdjBwJt9/uOhofmjVLKvnWrpVm4hfR\nsKGMMO3YMUixRZIDB6BECVi2DK65xnU0vqMJW6kg6NsXpk+HKVNcR+JD1sIdd0i/8IYNk334b7/J\nYnzzZhnxrAKsc2fYsUMmpKmA0oStlMdOnIBrr5VkffPNrqPxoe++g1dflXPXGTOm6EueekoWgm+8\n4XFskejwYdlO+vFHKF7cdTS+oglbKY/17g2LF8tZYBVg1kL58vC//8Fjj6X4yzZuhEqVZJWtneY8\n0L273J4YNsx1JL6iCVspD/39t6yuv/9eum2pAJs0Cd58E1auTHVHlKZN5TZr587ehBbRjh2DYsVg\nzhwoXdp1NL6hCVspD733HqxZowsNT8THyz2GLl2gbt1Uf/mWLVChglSM58wZ+PAiXu/e8NNP0shd\nBYQmbKU8cvw4FC0KP/wgx1NVgI0bJ7NJf/5ZOqOkwTPPQP788M47AY5NSfFGsWIyfvPGG11H4wua\nsJXyyAcfyL3r0aNdR+JD1kK5cpKwa9dO89Ns3Qq33Sb3tKOjAxifEr16ye2K4cNdR+ILmrCV8sDJ\nk7K4+O47GRylAmzy5P+/d53OlpjNm0OBArKzrgLs77/lG2HBAinLV+miCVspD/TpIx3NJk50HYkP\nWSvdZ155JVWV4UnZvFme7vfftfuZJ959VwoGhgxxHUnY04StVICdPi2V4ePHw623uo7Gh2bPlmbg\n69al+Nx1cho1kh32//0vIE+nznX4sKyyly/X7mfppOM1lQqwIUPkJIsma4906wavvx6wZA3SpvSj\nj+RWhgqwK66AVq1kpqwKCl1hK5UCZ85Ic6dvv5VumSrAfvwRnnxSqsQCPFC8Th24916d5OWJ/fvl\nG+OXX6RgQKWJrrCVCqBvv5WjXJqsPdKtG7RvH/BkDdCpE7z/PsTGBvypVe7c0KyZVI0rz+kKW6lk\nxMfLVnifPnD33a6j8aEVK+QI15YtcOmlnlzi3ntlfkizZp48fWTbs0caEmzYAFde6TqasBTUFbYx\npoYx5jdjzEZjTPsL/H41Y8xhY8yKhB/aml+FjalTIWtWuOsu15H4VPfuMuTDo2QNssru0QPOnvXs\nEpErb16oX19G1ylPpXuFbYzJAGwE7gb+AJYBDay1v53zmGrAK9bah1LwfLrCViGlShW5//n4464j\n8aHEaR3btsFll3l2GWuhcmVo21ZyiwqwIP09+lUwV9jlgU3W2u3W2jPACKDOhWIKwLWUCqpFi2D3\nbqhXz3UkPvXhh1Jp7PGbvDFytOv99yV5qwArXlyGkX/xhetIfC0QCTs/sPOcn+9K+LXz3W6MWWWM\nmWqM0Q7MKiz06iW7tZkyuY7Eh/btg5Ejg1a+Xbu2NOiaNy8ol4s8//uf9O2Ni3MdiW8Fq0r8Z6CQ\ntbYc0BeYEKTrKpVmv/0mQ4maNnUdiU/17Sv701ddFZTLZcggTdR69w7K5SJPhQpQuLA22fdQINYN\nu4FC5/y8QMKv/cNae+yc///OGNPfGBNtrT14oSfsck7z3+rVq1O9evUAhKlU6vTuDa1bQ7ZsriPx\noePH4bPP5Px1ED31lLQq//VXnbTmif/9D954Axo0SHcveD+bO3cuc+fOTfXXBaLoLCOwASk62wMs\nBRpaa9ef85irrLV7E/6/PDDKWlskiefTojPl3B9/yFGuTZsgVy7X0fhQ374wZ470eQ2yrl2lv7je\nbvVAfLyM3Pz4YzlLp1IkqL3EjTE1gE+QLfbB1toexpiWgLXWDjTGtAaeA84AJ4GXrLVLknguTdjK\nufbt4dQp+OQT15H4UFycFCl9842TTjQHDsB110nL8rx5g355/xsyRDoNzZrlOpKwocM/lEqjI0ek\nq9nPP0ORIq6j8aFRo+STUJC3w8/1wguQPTu8956zEPwrNla+gSZPhptuch1NWNDWpEqlUUwM1Kih\nydoT1srZqtdecxrGSy/B559L1bgKsCxZoF07+XtWAaUrbKXOERsrkwKnTYOyZV1H40Nz50LLlrB+\nvZRtO1S/vuzIt2vnNAx/OnpUvpF09GaK6ApbqTQYNQpKltRk7Zn335ezVY6TNcgi/6OPZBKbCrAc\nOaB5cyk+UwGjK2ylElgrs67ffhsefNB1ND60bh3ccw9s3epp3/DUqF4dWrSARo1cR+JDO3fKJ99t\n2ySBqyTpClupVFq4UO5p1qrlOhKf+uQTeO65kEnWIF3sevfWdqWeKFgQ7r9fz88FkK6wlUpQr55M\n5Grd2nUkPrR/v5ylCrERjPHxcgtk0CAZ8qICbMkSmWu6aRNkzOg6mpClK2ylUmHrVukx3aSJ60h8\nauBAePjhkErWILfSX3xRb7V6pkIFaT07ebLrSHxBV9hKAS+/LAM+evVyHYkPnTkjlcJTp4ZkNd+x\nY9ICW8/de2TkSGlDm4ZWnJFCV9hKpdDRozB0aNCGRkWeMWNkOzwEkzVIA5WmTaFfP9eR+NQjj8CW\nLbBypetIwp4mbBXxvvxSipcLFUr+sSoNPvkE2rZ1HcVFtWkjtVHHjiX/WJVKmTPLH7Ded0g33RJX\nEe3s2f9va3377a6j8aHFi+XMVBgUHT3yiHxwe/5515H40MGDUKyYNMy5+mrX0YQc3RJXKgUmT4Y8\neTRZe+aTT6Rxd4gna5BNgE8/lcpxFWDR0TJy87PPXEcS1nSFrSJa9erQqpW8l6gA27ULypSREvzL\nL3cdTbKslVkVPXpIL3kVYOvXyzfc9u0hdRY/FOgKW6lkrFwptTD16rmOxKf694cnnwyLZA1gjKyy\n9VarR0qWhJtvhuHDXUcStnSFrSJWs2ZSvNyxo+tIfOjECTkrtWiR/CGHiVOnJOx58+D6611H40Mz\nZ0oT91Wr5BOSAnSFrdRFHTgA48fLfALlgW++gYoVwypZg+zUtmwp97KVB+69V0biLVjgOpKwpAlb\nRaTBg6FOHSk4UwFmrWS8ED/KlZTnnpNd20OHXEfiQ8ZIGb4eek8TTdgq4pw9K7dXtVGKR+bNkz/k\nu+92HUma5M0LDzygMys806QJzJoFf/zhOpKwowlbRZxp06S98a23uo7Ep/r1kwkqYXyPsnVrOYGk\nR7w8kCOHHMsYONB1JGFHE7aKOH376uraM7t3w+zZ0Lix60jSpWJFySszZriOxKdat5aEHRvrOpKw\noglbRZQNG6RA9bHHXEfiUwMHyjjFHDlcR5IuxkhO0VutHilVCkqUkMpPlWJ6rEtFlLZtZdhDt26u\nI/Gh2FgZdzVrlrwhh7kTJ6S//LJlMmxMBdjYsXLoXSvG9ViXUuc7dkxOG7Vs6ToSnxo/Xhqz+yBZ\nA2TLJvVR2k3TI3XqSBe81atdRxI2NGGriPHNN1Ctmk7l8kxisZmPPPecTHM7edJ1JD6UKZP0Bdb7\nDimmW+IqIlgLN94ox4Pvust1ND60Zo004N62TcYp+kjNmvD44zIzWwXY3r3SUu733yFnTtfROKNb\n4kqdY948OaJz552uI/Gpfv2gRQvfJWvQ4jNPXXUV1KoFQ4a4jiQs6ApbRYTHHpNBQT7bsQ0NR45I\nsdmvv0rXEZ85exauvRZGjoTy5V1H40OLFskxwI0bIUNkriF1ha1Ugl27YM6csD8aHLqGDoX77/dl\nsgYZ5f3cc7rK9sztt8sxwJkzXUcS8nSFrXzvzTfh8GHo08d1JD4UHy9jEwcNgipVXEfjmf37ZZW9\neTPkzu06Gh8aPFhOGUyZ4joSJ3SFrRRw+jR8/rnMG1AemDMHLrkEKld2HYmncueGunUlrygPNGwI\nixdL8ZlKkiZs5Wvjxsmx4JIlXUfiUz7oG55Sif3Fz551HYkPZcsGTz+th96ToQlb+dqAAXL/UXlg\nxw7pUvXEE64jCYrbboMrr4TvvnMdiU/pofdkacJWvrV+vRSe1qnjOhKfGjAAnnxSer1GCD3i5aGi\nRWWE3pgxriMJWVp0pnzrpZcga1bo3t11JD4UGyst4+bOlcYXEeLUKXnZixZJEZoKsAkT4P334ccf\nXUcSVFp0piLayZPw9dfw7LOuI/GpiRMlUUdQsga49FLpL66jnD3y4IOwfTv88ovrSEKSJmzlS6NH\nyz1HnbLkkZiYiJ2i0qKFNOY6fdp1JD6UKRM0by7/vtR/aMJWvhTB+cR7mzbJCuiRR1xH4sR110GZ\nMnICQXmgeXMYPlzG66l/0YStfGfNGplB8eCDriPxqYEDZRLGJZe4jsSZVq2k5k55oEABqFpVkrb6\nFy06U77Tpg1ER8M777iOxIdOn4aCBSO+6urMGSk++/57PePviRkzoGNH+PnniDjjr0VnKiIdPw7D\nhsmumvLAuHGyHxzByRpkKFmzZnqr1TP33iv9hJcvdx1JSNGErXxl5EioVElWP8oDMTGyH6x49ln4\n5hvt8+GJDBmkCEXvO/yLJmzlK1ps5qH162HDBu1Ek6BIERm3OWqU60h86umnZUfn8GHXkYQMTdjK\nN1auhD17oGZN15H41MCB8iaaObPrSEJGq1a6Le6ZK6+EGjWkoYICtOhM+UirVpAvH7z1lutIfOjk\nSSk2W7ZMD7efIy5O/jimTIGyZV1H40Pz5smovbVrfV18pkVnKqL8/bfcv37mGdeR+NSYMdqJ5gK0\nz4fHqlaVmesLF7qOJCRowla+MHw4VK8O+fO7jsSntDggSc88AyNGaJ8PTxijh97PoQlbhT1r5ftZ\n84lH1q6FrVu1E00StM+Hxxo3hmnT4K+/XEfinCZsFfaWL4dDh+C++1xH4lMxMbKMzJTJdSQhq2VL\n3Rb3TM66lr44AAAgAElEQVScULeuNHCPcFp0psJe8+ZQrJg0RlIBduKEFJutXKmH2y/i7FnpJTN6\ntIx0VgG2ZAk88YQMuM/gv3WmFp2piHDkCIwdK6eNlAdGjoQ77tBknYyMGaWRiq6yPVK+PERFwZw5\nriNxShO2Cmvffgv33ANXX+06Ep/SYrMUa9ZMiumPHHEdiQ9p8RmgCVuFMS0289iqVfDHH9qJJoWu\nvlo+PH77retIfKpRI/jhB/k3GaE0YauwtXix9PO46y7XkfhUTIwUCGTM6DqSsJG4CNQyHA9ERUH9\n+vDFF64jcUaLzlTYatoUSpWC115zHYkPHTsm963XrNHD7akQHw8lSsDQoXLrXwXYihXw8MPw++++\n+iCpRWfK1w4dggkTJGkrDwwfDtWqabJOpcQhU1p85pGbb5Ye4zNnuo7ECU3YKix99ZXcWs2Tx3Uk\nPqXFAWnWtClMnAgHD7qOxKci+BORJmwVdqzV4mVPLV8u2UY70aRJ7tzwwAPyoVJ5oEEDmD8fdu92\nHUnQacJWYWfhQrlXWK2a60h8KiYGWrTwZYOKYGnZUovPPJM9Ozz+eEQWn+l3pAo7iatrH0/bc+fo\nUTlMrJ1o0qVKFfm8M3++60h8qkUL+PxzaTEXQTRhq7Cyf7/MHm7SxHUkPqWdaALCmIi+1eq9m26S\nf6MzZriOJKg0YauwMnQo1K4N0dGuI/Eh7UQTUDpkymMtWkTcJ6KAJGxjTA1jzG/GmI3GmPZJPOZT\nY8wmY8wqY0y5QFxXRRZrYeBAaU6hPLBkiQz70E40AZEzJ9Spo0OmPNOgASxYEFHFZ+lO2MaYDEBf\n4H6gFNDQGHP9eY+pCRSz1l4HtAQiuyGsSpO5cyFzZm1I4RktNgu4Vq3kQ2Z8vOtIfCix+GzwYNeR\nBE0gvjPLA5ustduttWeAEUCd8x5TB/gKwFq7BLjcGHNVAK6tIkjibq0Wm3ng8GHtROOBihUha1Zp\nga080LIlDBoUMcVngUjY+YGd5/x8V8KvXewxuy/wmPBmrbRxVJ7Yt0/qS556ynUkPvX111Cjhnai\nCTAtPvNYuXKQNy9Mn+46kqDI5DqAC+nSpcs//1+9enWqV6/uLJYUO3FCDgb/8gsUKOA6Gt/58kt4\n5BG44grXkfhQYrFZv36uI/GlJ5+ETp3gzz+1+N4TrVvDunXSrSZMzJ07l7lz56b669I9/MMYUxHo\nYq2tkfDzDoC11vY85zEDgB+stSMTfv4bUM1au/cCzxe+wz9at5Y+t507u47EV+Lj4brrYNgwqFDB\ndTQ+tHChTOVav17vN3jkmWfg2muhY0fXkahQFMzhH8uAa40xhY0xWYAGwKTzHjMJaJwQWEXg8IWS\nddhLvJ8SF+c6El+ZM0cm65Uv7zoSn9JONJ5r1Ur6fGjxmUqPdCdsa+1ZoA0wE1gHjLDWrjfGtDTG\ntEh4zDRgqzFmMxADPJ/e64akMmVkO3zaNNeR+IoWm3nowAHtRBMEt94qt3NmzXIdiQpnOg870IYM\ngdGjYepU15H4wp49cMMNsH075MjhOhof+ugjmTH89deuI/G9mBgpnBw3znUkKtSkdEtcE3agnTgB\nhQrBzz9D4cKuowl73bpJsh440HUkPmQtlCwpt3EqV3Ydje/9/be8NaxbB/nyuY5GhZJg3sNW58qW\nDZ54Qt4EVbqcPSv3/bRTpkfmzYNMmaBSJdeRRISoKKhfP6L6fKgA04TthZYt5bvyzBnXkYS1GTNk\ntvAtt7iOxKe02CzoEovPIqTPhwowTdheuOEGKFYMJk92HUlYS8wnygP79kmzCe1EE1SJQ6YipM+H\nCjBN2F5p1UrbG6XDrl3S179hQ9eR+NSQIfDww9qJxoGWLeXkg1KppUVnXjl1CgoWlAlIRYu6jibs\nvP027N0L/fu7jsSH4uOheHGZfa2daILu+HF5a1i9Wv6rlBaduXbppTIQV8ubUy0uTovNPDVnjkw6\n0k40Tlx2GTRqpHWpKvU0YXupRQvZeoyNdR1JWJk2TfrPlC3rOhKfiomRWzZabOZMYl2qNkVUqaEJ\n20slSkgB2oQJriMJK1ps5qE9e2SF3aiR60gi2o03ypls7a+kUkMTttd0tl6qbNsGixfLXHrlgS++\ngMce07ZxIUCLz1RqadGZ12JjpbJkwQIp9FEX1amTFOV8/LHrSHzo7Fk5bjh2rB5uDwEnT8qtn59/\nhiJFXEejXNKis1CRJQs0barFZykQGyv39XQ73CMzZ0KePJqsQ0TWrHIM/vPPXUeiwoUm7GBo0QK+\n+kqOeqkkTZwI118v7a2VBxLHnqmQ0bKl3KXQpogqJTRhB0OxYlCunI7pScaAAVK8rDyQ2ImmQQPX\nkahzlCwJ110Hkya5jkSFA03YwaIVJhe1cSOsXSvNt5QHBg+WtnHZs7uORJ1H3xpUSmnRWbCcOSPn\nOObMkaNe6l9efVUGR/Xo4ToSH4qLk6qmadOgTBnX0ajzJDZF/OknuPZa19EoF7ToLNRkzgzPPKPF\nZxdw6hQMHSq3+pUHpk2TD4uarEPSpZdCkyZafKaSpyvsYNq+XSp0d+6UElEFwDffyA+dYOSRBx6Q\nQcxNmriORCVh40aoUkXeGrJkcR2NCjZdYYeiwoWlf/OoUa4jCSlabOahbdtkAE39+q4jURdRvDiU\nKgXjx7uORIUyTdjBpp3P/mXNGskpDz7oOhKfGjQInnhCd3TCgBafqeTolniwaQHQv7RpA7lzQ5cu\nriPxoTNnZFdn9mwtdAwDiU0R58+XMQQqcuiWeKjKlAmaN9dVNnDsGAwbJn8cygOTJknZsSbrsJAl\nCzz9tNalqqTpCtuFXbtkdb1zpwzHjVCDBsGUKTrMzDP33SeFZk884ToSlUJbtkDFivLWcOmlrqNR\nwaIr7FBWoABUrgwjRriOxCktNvPQli2wahXUq+c6EpUKxYrBTTfJfBalzqcJ25VWrSJ6W3z5cjhw\nQBaBygMxMdC4sS7TwpAWn6mk6Ja4K2fPQtGico7j5ptdRxN0zZvL7dUOHVxH4kMnT0qjFG2dFZYS\nawVnzZKjXsr/dEs81GXMKK29PvvMdSRBd+SIbPk9/bTrSHxq9Gi49VZN1mEqc2Zo1kyLz9R/6Qrb\npb17ZZ7k779Dzpyuowmafv3k6MrIka4j8akKFeCNN6B2bdeRqDTSpoiRRVfY4eCqq6BWLRgyxHUk\nQWOtbCposZlHli+XD4K1armORKVDYlPECK9LVefRhO3a889LBouPdx1JUMybJy+1enXXkfhU4qeh\njBldR6LSqXVr2Y2KlA1HlTxN2K7dcQdkyybdqCJAv37yRmSS3fxRqXbwIIwbJzdAVdirUUP+Spcu\ndR2JChWasF0z5v8/Svvc7t0yDvypp1xH4lNDhshkriuvdB2JCoCMGWUDLgLeGlQKadFZKDh+XI7h\nrFghN698qnNnOXvdt6/rSHwoPl4aUH/1Fdx+u+toVIAcPCjNVDZuhDx5XEejvKJFZ+Hksstk2enj\nRiqxsXJM5fnnXUfiU7NmQfbs0tdS+UZ0NDz8sLTxVUoTdqh47jkYPBhOn3YdiSfGjYOSJXUOhWf6\n95dPQ1oc4Dtt2kjns7NnXUeiXNOEHSpKlJCBIKNHu47EE/36yRuP8sD27bBwITRq5DoS5YGbb4Z8\n+WRQjopsmrBDSevWslLymdWrYds2eOgh15H4VEyM3FKJ4Mlvfte6tdZ+KC06Cy1xcdJffOJEGdnj\nEy1aSE3dG2+4jsSHTp+WP9z582WXRvmS/jX7mxadhaNMmWRUj4/OcRw+LLv8zz7rOhKfGjtWbqXo\nu7ivXXKJDMzx4QacSgVdYYcan/UX//hjWLYMvv3WdSQ+VakSvPqqlBIrX9uxQzbetm+XAwHKP3SF\nHa581F88Pv7/O5spD6xaJe/iOuQjIhQqBNWqwTffuI5EuaIJOxQlFp+FeX/xxKPB2sfDI336SN/w\nTJlcR6KCRPuLRzZN2KHo9tsl082c6TqSdEk8yqVHgz2wf78cbm/RwnUkKojuuktqUxcscB2JckET\ndigyBl54AT75xHUkabZ1KyxaBA0buo7EpwYOlPvW2q8yoiSOHtAjXpFJi85C1alT0ld83jwpQgsz\n7dvLSuCDD1xH4kNnzsA110gnjXLlXEejguzoUShSBNasgfz5XUejAkGLzsLdpZfKWagw/Ch9/Dh8\n8YX2DffM+PEyEUKTdUTKkQOeeEJGn6vIoivsUPbHH1C6tBzxuuIK19Gk2IABMGOG5BXlgUqV4OWX\noV4915EoRzZtgsqVpYNg1qyuo1HppStsP8iXT6bYf/GF60hSLD5ebr23bes6Ep9avhx27YI6dVxH\nohy67jq47TYYNsx1JCqYNGGHurZt5fhOmIzqmTVLujJVq+Y6Ep/69FOpOtKjXBGvXTtpTKQbkpFD\nE3aoq1BBmqlMnuw6khT5+GN5I9GjXB7480/5d9C8uetIVAi4+25J1t9/7zoSFSyasMNB27ZhccRr\n/XpYuRIaNHAdiU8NHAj160N0tOtIVAgw5v9X2SoyaNFZODhzRs5xfPedDHoIUc89J5sBXbq4jsSH\nYmPlmN+sWVKIqBRw8qT8s/jxR7mvrcKTFp35SebMckYqhFfZBw/CiBHSKVN5YPRoKFVKk7X6l6xZ\npdldnz6uI1HBoCvscPHXX1C8OGzcGJLdrXr2lC1xH8wsCT3WQvny8Oab8NBDrqNRISZMT3+qc+gK\n22/y5IFHHpH7mCHmzBnp76JHuTyyYAEcOQIPPug6EhWC8uWDmjXD6vSnSiNN2OGkXTuZ4nX6tOtI\n/mXcOChaVGb1Kg988IE0Ssmg367qwtq2lRN/cXGuI1Fe0neAcHLjjfIjxLolJB7lUh7YsAF++gka\nN3YdiQph5ctLX/FJk1xHorykCTvcvPoq9O4dMt0SFi+W48F6a9UjH30k5ffZsrmORIW4du3kn4vy\nL03Y4ebuu6VqfPp015EA8P77slubMaPrSHzor79g5EjpbKZUMh5+GHbvlg0Z5U+asMONMbLKfv99\n15GwcaPUQzVr5joSn+rfHx57DK680nUkKgxkygSvvBISbw3KI+k61mWMyQmMBAoD24D61tojF3jc\nNuAIEA+csdaWv8hz6rGu5Jw5I+MVx4+HW25xFkarVpJL3nnHWQj+dfKkNMsJ03noyo0TJ+SfzcKF\ncgpUhYdgHevqAMy21pYAvgc6JvG4eKC6tfamiyVrlUKZM0tZ6AcfOAth717ZrW3TxlkI/vb111JJ\npMlapUK2bFLy4PCtQXkovSvs34Bq1tq9xpirgbnW2v+8wxhjtgK3WmsPpOA5dYWdEkePwjXXwIoV\n0pswyN58E/bvh88+C/ql/S8+HkqWhJgYqF7ddTQqzPz1F5QoIY2MrrrKdTQqJYK1wr7SWrsXwFr7\nJ5DUzTYLzDLGLDPGPJvOayqAHDngmWecdP4/dgwGDJBiM+WBqVMhKkpnlKo0yZNHBvBou1L/SXaF\nbYyZBZz7Oc0gCfgNYIi1Nvqcxx6w1ua6wHPktdbuMcbkAWYBbay1C5O4nq6wU2rXLhkGsmUL5MwZ\ntMt++inMnw9jxgTtkpGlWjXZ19SxZyqNNm+G22+HrVshe3bX0ajkpHSFnSm5B1hr773IRfYaY646\nZ0t8XxLPsSfhv38ZY8YD5YELJmyALueMe6pevTrVdVvwwgoUkHaVAwdC+/ZBuWRcHHz4ody/Vh5Y\ntgy2bYNHH3UdiQpj114rd1MGD9aWwaFo7ty5zJ07N9Vfl9572D2Bg9bansaY9kBOa22H8x6TDchg\nrT1mjLkMmAm8ba2dmcRz6go7NVavhlq1pPP/JZd4frnhw2U7fN48zy8VmerVg6pV9V1WpduyZXIq\ncNMmqVNVoStY97B7AvcaYzYAdwM9Ei6e1xgzJeExVwELjTErgcXA5KSStUqDsmVlVM8333h+KWvl\njOdrr3l+qci0fr2cx2ne3HUkygduu02OeI0e7ToSFSg6XtMP5s2TN/nffvO05dicOfDii7Bmjc6h\n8ETTprKX+cYbriNRPjFtGnTqJIdJTLLrN+WKjteMJFWrSgcTj6vAevSQJmuarD2wfTtMnqxtSFVA\n1awpdSczdU/TF/St1w+MkY/R3bt7NhRkyRJpRfrEE548verdW3ZJgljtr/zPGOjYEbp1cx2JCgRN\n2H5Rs6Z8d06d6snTd+smhehZsnjy9JFt3z749lt46SXXkSgfql8f9uyRo5gqvGnC9gtj4PXXJbMG\neJW9ahUsX65DPjzz8cdy5vrqq11HonwoUyZZZXft6joSlV5adOYnZ8/CDTfIuas77wzY09avDxUr\namczTxw5IoNcli2TVrNKeSA2Fq67DkaNggoVXEejzqdFZ5EoY0bo0EHuZQfI+vVShN6yZcCeUp2r\nXz+oUUOTtfJUlixyS0vvZYc3XWH7TYA/SjduLAOjXn89ALGpf/v7b1ldz5+vU7mU506dgqJF5ahX\nuXKuo1HnSukKWxO2H/XvD1OmyHdmOmzZIjl/yxa4/PIAxab+33vvwdq1UnCmVBB88IGc+Bg1ynUk\n6lyasCPZ6dOyyh49Ol2r7BYtZDzfu+8GMDYldHWtHDh2TFbZ8+bJBFcVGjRhR7oBA2DiRPjuuzR9\n+datcOutcvY613/mr6l0e+89aRk3bJjrSFSEee89+OUXmQugQoMm7EiXeC97xAiZs5dKzZrJMLB3\n3vEgtkiXuLrWZY5y4Ngx+ec3Z46MIVDuacJWMnZz7FiYMSNVX7Zpk+T4TZu08ZYnevSQJY6urpUj\nvXvD4sU60z5UaMJWssouXlwSwx13pPjLnnwSSpSAN9/0MLZIpatrFQJOnJA5M1oxHho0YSvx+edS\nEjprVooevn49VKsGmzdDjhwexxaJ9AaiChGffgqzZ8OkSa4jUZqwlThzRlbZX38NlSsn+/DHH4eb\nb5YmCyrADh2Sv4uFC2ULQymHTp2SMpexY6F8edfRRDZN2Or/ffml/Jg376JDcX/5Be67T85dX3ZZ\nEOOLFB07wv79suuhVAhI52ESFSCasNX/O3sWypSBXr3ggQeSfNjDD0OVKtoz3BN79khJ7urVUn6v\nVAhILHP59luoVMl1NJFLE7b6t4kTpYps5UrpOX6exYvhscfk3HXWrA7i87vnn4ds2aQ8V6kQksIN\nOOUhHf6h/u2hhyAq6oJHiayF116Dt9/WZO2JLVuk8K9jR9eRKPUfjRtLecXkya4jUcnRhB0pjJHz\nv2++Ka1LzzF5snzDNmniKDa/e+staNtWW8apkJQxI/TsKYP+4uJcR6MuRhN2JKlSRe6jfvbZP78U\nFycV4T17XnCnXKXX6tXSUuqll1xHolSSataUuQFffuk6EnUxeg870qxZA/fcI23McuTg889ll/z7\n7/X+lSdq1pQfL77oOhKlLmrZMqhbV+pY9JRIcGnRmUpakyZQqBDHO7xL8eIwYQLcdpvroHxo+nRJ\n1GvXQpYsrqNRKlkNGsgm3BtvuI4ksmjCVknbuRPKlaPP0ytYuLMwI0e6DsiH4uKgbFnpbPbQQ66j\nUSpFtmyRJirr18OVV7qOJnJolbhKWsGCHHv6BQr0aU/37q6D8amBAyFvXqhd23UkSqVYsWIyS+Dt\nt11Hoi5EV9gRqlXjE7w34XpyThuWopalKhUOHYLrr5f+7WXKuI5GqVQ5cEDm0syerf98g0VX2CpJ\nS5fCpNnZuOSjHtCuHcTHuw7JX7p2hTp19N1OhaVcuWSF/eKL0qNBhQ5N2BEmPh5eeEFurWZr1lCK\noYYOdR2Wf2zaJH+e777rOhKl0qxFCzh8GEaPdh2JOpduiUeYIUOk4f+iRZAhA3KWo04d2LBBOqGp\n9KlTR2aP67gzFebmz5f72evX6zEvr2mVuPqPI0fk1uqkSecd42rSRAqkevRwFpsvTJ4Mr7wiY88u\nvdR1NEqlW8OGMoLznXdcR+JvmrDVf7z6qtRDDR583m/s2SP3W+fNgxtucBJb2Dt+HEqVgkGDpDGN\nUj6wcyfcdJNsxF1zjeto/EsTtvqXX3+FqlVh3TppQfgf/fvD8OGStDNoaUOqdewI27dfcLiKUuGs\nWzdJ2BMmuI7Ev7RKXP0jPh6efVa2tS6YrAFatpThuNpMOPXWrZOV9Ycfuo5EqYB79VUpcRk3znUk\nSlfYEaB/fxlQv2BBMovnVavgvvuklaa2OUoZa6FaNXj8cWjd2nU0Snli4UL5J75uHVxxheto/Ee3\nxBUAu3ZBuXJS8Zmi29OvvQZ//glff+15bL4wZAj06weLF+u4M+VrrVrJ59OYGNeR+I8mbIW1Mn3n\nppugS5cUflFi8dTgwXD33V6GF/727ZNivSlT4NZbXUejlKeOHJG3hm+/lU0lFTh6D1sxdqz08ejY\nMRVfdNll0Lev3NM+ftyz2HyhTRto3FiTtYoIl18OffpIU5VTp1xHE5l0he1Thw7Jp+HRo6FSpTQ8\nwZNPQnQ0fPppwGPzhTFjZAbhypWQNavraJQKmkcekdtrXbu6jsQ/dEs8wj35JOTMKZ+I0+TQIbjx\nRvjmG6hePZChhb/9++XPZtw4uP1219EoFVR//CF1MVOnnteASaWZbolHsNGj5dxkz57peJKcOWVE\nZLNm8PffAYst7FkLzz8PjRppslYRKV8+2Xh76ik4ccJ1NJFFV9g+s2ePfPqdPFkG0afbM8/IWbDP\nPw/Ak/nA0KHQu7eMPNOtcBXBGjWC3Ln1rlkg6JZ4BLIWHnhAtqkCNoD+6FG4+WbpM/7oowF60jC1\nZQtUrAjffy9b4kpFsEOH5JDEF1/Avfe6jia8acKOQB99BCNGSJODzJkD+MTLlskngeXLoVChAD5x\nGDlzBqpUkWkIbdu6jkapkDBnjhyUWLHiIl0UVbI0YUeYpUvhwQdhyRKPmvT37CnnjX/4ATJl8uAC\nIe711+Vdado07bWu1DneeEPef6ZP12+NtNKiswhy+LC0DYyJ8XCizmuvycjIt97y6AIhbMoUqZb/\n+mt9R1LqPF26yLns995zHYn/6Qo7zMXHQ716ULBgEIo/9u2TJiF9+kCdOh5fLERs3Sr3rcePhzvu\ncB2NUiFp92645Ra5JaenQFNPV9gRols32LsX3n8/CBe78ko5M/bss9JCze9OnYLHHpNWcZqslUpS\n/vyyCdWwoUyZVd7QFXYYmzRJBkQtXQp58wbxwgMGyMCLRYsgKiqIFw4ia+Wg6ZkzsmwwyX74VSri\nffihJO6FCyFbNtfRhA8tOvO5X3+VrafJk6FChSBf3FrpNf7HHzBxoj+nVHXvLtvg8+bpO49SKWSt\nVI3HxcGwYfo5N6V0S9zH/vxTTln17u0gWYN8F/brB6dPw0svOQjAY+PGwWefyYcRTdZKpZgx0iDx\n998jsz7Va5qww8zff0OtWtIxtHFjh4Fkziz3s+fM8Vero0WLZPdg/HjpwaiUSpWsWWXnb/hwnZ0d\naBF4oDZ8nTkjNVC33ipnH5274go58lSlivQobNTIdUTps2YNPPywHN/SkZlKpdmVV8q57CpV5HNv\n7dquI/IHvYcdJuLiJB+ePCmLv5DqXbJ2Ldxzj+yFPfSQ62jSZutWeXd5/30pdVVKpduSJZKsR4yA\nu+5yHU3o0nvYPhIXJwXLR4/KLnRIJWuA0qVlD6x5c5g923U0qbdtG9x9t3Qz02StVMBUqCCj4xs0\nkPpNlT6asENcXBw8/bSMYB4/XpqNhaTbboOxY2UbYOpU19Gk3ObNUK0avPKKjM1USgVU1aqywn70\nUZg/33U04U0Tdgg7eVK6mO3dKwXLIT/NsUoVWWk3awYjR7qOJnnr18Odd0KnTnKgXSnlibvukiK0\nevWkf4RKG03YIergQRlZd9llUtcVNqeLKlSAWbPkuFffvq6jSdrcuXKQvVs3aNHCdTRK+d4998js\nnJYtYdAg19GEJy06C0EbNkDdulCzppy1Dst5E7//LtUm1arBJ58EeN5nOg0dKsNMtBJGqaDbtAnu\nv18GFnXt6s++S6mlnc7C1PjxsuDr3l1adoe1o0eliOvkSdkPcz0w9/RpSdRTp8q2RcmSbuNRKkL9\n9ZcUomXMKB3Rcud2HZFbWiUeZk6ehFdfhXbtJJ+EfbIGyJFDbljdcQfcdJPsh7myebPEsXs3LF+u\nyVoph/LkgRkzoFw5aXmgFeQpowk7BCxZIvlsxw7JJeXLu44ogDJmlH2v4cOhVSto0waOHAne9c+e\nlS35ihWl3H7MGMiZM3jXV0pdUKZM0KuXTOtt1AhefBGOH3cdVWhLV8I2xjxqjFlrjDlrjLn5Io+r\nYYz5zRiz0RjTPj3X9JO9e+UkUZ068M47MGqUfPL0pWrVYPVq2UooWRK++komBXhp6VIpgps4EX78\nUT4s6DQCpUJK7drSZPDQIbjxRjlgEsF3RS8qvSvsNcDDQJIbGsaYDEBf4H6gFNDQGHN9Oq8blubO\nnQtIBfg770CpUnKuet06qF/fbWyBkPj6kpQzJwweLDfq+/SRs9vjx0N8fGADWbFCOq498gi88IL0\nOy9RIt1Pm+zrC3P6+sJXuL+26GjpCDx4sKy6K1SAmTP/P3GH++sLlHQlbGvtBmvtJuBiy5bywCZr\n7XZr7RlgBFAnPdcNR9bC8OFzadECihWTIuply2R+bK5crqMLjBR/U1WoIPcBOnWS6rrSpSWB792b\n9osnFrbdcw88+KD8d/NmaNIkYKtqv79p6OsLX355bXfeKe+L7dpJL6PSpWHAAJg+fa7r0EJCMJpc\n5gd2nvPzXUgS9zVrYedO2QWePVtqrw4dkn+Ev/3mvmDauQwZZNBG3brw/fcwZAi8+abcwL/7bqhU\nSapRkmrtduYMbNki1Spz5siPW2+Var06dUK4JZxS6mIyZJB72g0bSruEPn2kEHf5ctk4K19ets4v\nu8x1pMGXbMI2xswCzk0vBrBAJ2vtZK8CCzenT0sXn8OH5cfu3ZIzypaFypUlYY8ZIzlJncMYSdB3\n3x+Q+oEAAARESURBVA0nTsB330n/wrZtZahIdDQUKCCTweLiJFHv2QO7dsmvV6okw8E/+gjy53f9\napRSAWKMrLjvvFPa/N92mxw0GTpUmhRedZW8PVxxhUwxbNXKdcTeC8g5bGPMD8Ar1toVF/i9ikAX\na22NhJ93AKy1tmcSz6XlBkoppSJKSs5hB3JLPKmLLQOuNcYUBvYADYAkRyKlJGillFIq0qT3WFdd\nY8xOoCIwxRjzXcKv5zXGTAGw1p4F2gAzgXXACGvt+vSFrZRSSkWWkGtNqpRSSqn/CtlOZ8aYV4wx\n8caYaNexBJIx5h1jzGpjzEpjzHRjzNWuYwokY0wvY8x6Y8wqY8xYY0wO1zEFUkqbBYUTvzc2MsYM\nNsbsNcb84jqWQDPGFDDGfG+MWWeMWWOMedF1TIFkjLnEGLMk4f1yjTGms+uYAs0Yk8EYs8IYk+zg\n0ZBM2MaYAsC9wHbXsXigl7W2rLX2JmAq4Ld/gDOBUtbacsAmoKPjeAIt2WZB4SRCGht9ibw+P4oD\nXrbWlgJuB1r76e/PWnsauDPh/bIcUNMY47djwW2BX1PywJBM2MBHwGuug/CCtfbYOT+9DAhwmy+3\nrLWzrbWJr2kxUMBlPIGWwmZB4cT3jY2stQuBQ67j8IK19k9r7aqE/z8GrEd6X/iGtfZEwv9eghRK\n++Y+bsLitBaQognhIZewjTEPATuttWtcx+IVY0xXY8wOoBHwlut4PNQM+M51EOqiLtTYyFdv+JHC\nGFMEWYUucRtJYCVsGa8E/gRmWWuXuY4pgBIXpyn6EBKMTmf/cZFmLG8AryPb4ef+XlhJrtmMtfYN\n4I2E+4UvAF2CH2XapaSZjjGmE3DGWjvMQYjpos2CVLgxxmQHxgBtz9vFC3sJO3Y3JdTDTDDG3GCt\nTdEWcigzxjwA7LXWrjLGVCcFuc5JwrbW3nuhXzfGlAaKAKuNMQbZTv3ZGFPeWrsviCGmS1Kv7wKG\nAdMIs4Sd3OszxjRFtnnuCkpAAZaKvz8/2A0UOufnBRJ+TYUJY0wmJFl/ba2d6Doer1hrjyY06apB\nCu/5hrhKwEPGmFpAViDKGPOVtbZxUl8QUlvi1tq11tqrrbVFrbXXINtzN4VTsk6OMebac35aF7nn\n5BvGmBrIFs9DCQUjfhZ2uz8X8E9jI2NMFqSxUbLVqmHI4I+/rwv5AvjVWvuJ60ACzRiT2xhzecL/\nZ0V2X39zG1VgWGtft9YWstYWRb7vvr9YsoYQS9gXYPHfN1kPY8wvxphVwD1IhaCf9AGyA7MSjir0\ndx1QICXVLChcRUJjI2PMMGARUNwYs8MY87TrmALFGFMJeAK4K+Ho04qED81+kRf4IeH9cgkww1o7\nzXFMzmjjFKWUUioMhPoKWymllFJowlZKKaXCgiZspZRSKgxowlZKKaXCgCZspZRSKgxowlZKKaXC\ngCZspZRSKgxowlZKKaXCwP8B8/kc+8+lM4wAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1174681d0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# The first example creates a sine and a cosine and plots them.\n",
    "X = np.linspace(-np.pi, np.pi, 256,endpoint=True) # Evenly spaced numbers over the specified interval\n",
    "C, S = np.cos(X), np.sin(X) # Create a sine (S) and a cosine (C)\n",
    "\n",
    "plt.figure(figsize=(8,5)) # Instantiates figure with a specified size\n",
    "plt.plot(X,C, label='Cosine', color='blue')\n",
    "plt.plot(X,S, label='Sine', color='red')\n",
    "plt.legend() # Displays legend\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 102,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAbQAAAGxCAYAAAAK+UP1AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzs3Xl8FeXZPvDrPtk3kpBA2AREUDZFRBCEQtgXBQWl7lur\nolZtbd/WtZW+P221tr5WsVVbtS5QFEVBUfYEBVlEFhdAQfYAAbJByH7O8/tjEk04k/XMOc/MnOvb\nj5+GYZi5WObcmWcVpRSIiIiczqM7ABERkRVY0IiIyBVY0IiIyBVY0IiIyBVY0IiIyBVY0IiIyBVY\n0IiIyBVY0FxMRK4Vkc9F5KSI5IjIIhEZKiJ9RGSxiBwTEa/unERO0cAzdaOIbBSRIhHZLyJPigg/\nX0OMf+AuJSK/BvA0gMcAtAXQGcDzACYDqADwFoCfaQtI5DCNPFNxAH4JIA3ARQBGA/gfPUnDl3Cl\nEPcRkVYAcgDcpJSa38B5ZwH4TikVEbJwRA7U1Geq1vn3AchUSl0W9HD0A76hudMQADEA3tcdhMgl\nmvtMDQfwTfDikJlI3QEoKNIAHFdK+XQHIXKJJj9TIvIzAAMA/DzoqagOvqG5Ux6AdHZKE1mmSc+U\niFwO4HEAE5RS+SFJRj/gB547rQVQDuBy3UGIXKLRZ0pEJgB4EcClSqltoQpGP2KTowsppU6IyKMA\nnq8elr8UQCWAMTA6qh8QkRgYfQJS/bVSSlXoS01kX409UwCWAHgTwOVKqS+0BQ1zHOXoYiJyDYBf\nA+gJ4CSAL2A0hxwGsAdAzV++ANirlOqmIyeRUzTwTP0JwDAAZTCeJwXgU6XUJZqihiVLCpqIvAzg\nUgC5Sqnz6jnnWQATAZwCcLNSakvANyYiIqpmVR/aqwDG1/eTIjIRwFlKqR4AZgB4waL7EhERAbCo\noCmlVgMoaOCUywC8Xn3uegDJIpJhxb2JiIiA0I1y7AjgQK0f51QfIyIisoTtRjmKCEepkOMppUR3\nhhp8psgNmvJMheoNLQfAGbV+3Kn6mCmlFP+z4L933lFIT1d44AGFo0fr/tyWLQqXXqpw3nkK336r\nP6ub/rOjYPw+H330UVdd97Utr+FUxak6x/YV7sPY18diwIsDsLdgb0jzuvHPuKX/NZWVBU2q/zOz\nEMCNACAigwEUKqVyLbw3neb554H77gMWLwb+/GegTZu6P9+vH7BwIXDHHcCIEcAXnDlDYe7Gfjci\nPiq+zrHOyZ2x5PoluO7c67DtGOdK250lTY4iMgfG5MI0EdkP4FEA0TAm676klPpIRCaJyC4Yw/Zv\nseK+ZO6NN4AnnwQ++QTo2rX+80SAO+8E2rUDLr0UWLMG6MaZaER1iAjuG3Kf7hjUBJYUNKXUtU04\n524r7kUNW7sW+J//AbKyGi5mtU2dChw6BFxyifHrU1KCGpFcIjMz07HXXfb9MuzK34U7B95p6XWt\n5uQ/Yx1st1KIiCi7ZXKKggKgf3/g2WeBKVOa/+vvuAM4dcp4w6OWExEomw0K4TP1o2OnjuH8F8/H\nm1PfxMgzR7boGkopiNjmr9j1mvpMcXFiF7nrLuCyy1pWzADgb38DNmwA5s2zNheRnTy99mlcd+51\nLS5mAHD3R3djya4lFqYiK/ANzSWWLDEK2tdfA3FxLb/Ohg1GQdy+HUhNtS5fOOEbmr1VeiuhoBAd\nEd3ia+wt3IuOSR0RFRFlYTKqT1OfKRY0FygtBc49F3juOWDixMCvd+edQFSU0XRJzceCRmQtFrQw\n8pe/GIM53nvPmusdPw706mUMLOnb15prhhMWNCJrsaCFicJCoEcP4NNPgZ49rbvuM88AK1cac9Wo\neVjQiKzFQSFh4qmnjD4vK4sZYIx43LQJ2LjR2usS6fDIykcw9+u5Qbn2k6ufxFe5XwXl2tQ8fENz\nsPx8oHt3YMsWoHNn66///PPARx8BixZZf2034xua/eSV5EFBIT0+3fJrP732aazevxrzr5pv+bXJ\nwCbHMPD448DOncB//hOc65eXGwXz/feBAQOCcw83YkELLyWVJej6TFes/tlqnJ12tu44rsSC5nJl\nZcCZZwLLlgV34Mbf/mas8zhnTvDu4TYsaOHnu7zv0L11d3iEvTjBwILmcv/6lzGq8aOPgnufoiJj\nfcfNm4PTrOlGLGhE1uKgEBfz+Yw3p9/+Nvj3Sk4Gbr6Zc9LIebw+L9788k34lE93FAoRFjQHWr7c\nWA0kVOuA3nuv0U9XWhqa+xFZYcG3C/D858+zGTCM8G/agV56yRhWH6q1Ubt0AQYN4hqP5Cz/3PhP\n3DPonpDec2/hXnyZ+2VI70k/YkFzmCNHgBUrgGuuCe19b7/dKKRETqCUwuSzJ2Nar2khve/mw5vx\nec7nIb0n/YiDQhzmiSeA7783BoWEUmWl8aa2bBnQp09o7+00HBRCZC0OCnEhn88oZLffHvp7R0UB\nP/tZ6AspEVFTsaA5SFYWkJQEXHihnvvfeivw5pvGHDgiIrthQXOQN94whtDr2ii3a1djm5pgz30j\nCoTX59UdgTRhQXOIkhJgwQLg6qv15rjuOmD2bL0ZiOpzquIUejzXAxXeCq051h9cj0dWPqI1Qzji\noBCHeOst4OWXgaVL9eYoLDQGh+zbB6Sk6M1iVxwUoldBaQFS4/Rut55bnIuez/fEwfsOIiE6QWsW\nN+CgEJeZPRu4/nrdKYwiNmYM8M47upMQmdNdzAAgIzEDQzoNwfs73tcdJazwDc0Bjh8HzjoLOHjQ\nGBSi2/z5wHPPGYNUyB/f0AgA9hftR5v4NoiLitMdxfH4huYi8+YBEyfao5gBwKRJwNatRoElInOd\nkzuzmIUYC5oDvPMOcNVVulP8KDbW2CV7PvczJBvJ2pOFKl+V7hikEQuazR0/DmzcCIwfrztJXdOm\nAe++qzsFkWFf4T5MnzdddwzSjAXN5hYuBMaOBeLjdSepa9w4o9kxN1d3EiLg/R3vY8o5UxDpidQd\nxU9ucS5OVZzSHSMssKDZ3LvvAldcoTuFv9hYYMIEY24ckW4J0Qm4sd+NumOYun/5/dh4aKPuGGGB\noxxtrKgIOOMMY/BFq1a60/h7+23glVeAxYt1J7EXjnIkshZHObrAokXA8OH2LGaAMdrxs8+AggLd\nSYiIWNBsbf58ezY31khMBEaNAj78UHcSIiIWNNsqKTH2HpsyRXeShnG0IxHZBQuaTS1bBgwYAKSl\n6U7SsMmTgZUrjQJMFGof7/wYr25+VXeMRiml8MLGFzhPLshY0Gxq0SKjWNhdaipwwQVcBov06JHW\nA+dmnKs7RqNEBC9+8SLWHlirO4qrsaDZkFJGv9Qll+hO0jSXXsp+NNKje+vuuLCDph1vm2nK2VPw\nwXcf6I7haixoNrR5szHg4uyzdSdpmksuMQoaR4YT1e+ac6/BgPYDdMdwNUsKmohMEJEdIvKdiNxv\n8vMjRKRQRDZV/8ed7xqwaJHx1uMUPXsC0dHAV1/pTkJkXz3Te+KqvjZalNWFAi5oIuIBMAvAeAB9\nAFwjIj1NTv1EKXVB9X+PBXpfN3NScyMAiLDZkUKPk8XpdFa8oQ0CsFMptU8pVQlgLoDLTM6zzcoJ\ndpabC3z7LfCTn+hO0jw1zY5EobCvcB8G/mug7hhkM1YUtI4ADtT68cHqY6cbIiJbRGSRiPS24L6u\n9PHHxo7Q0dG6kzTPiBHAN98YuwMQBdtHOz9C7zb8GKG6QrU09RcAOiulSkRkIoD3AdQ75GHmzJk/\nfJ2ZmYnMzMxg57ONDz90Vv9ZjZgYYPRooyDfcIPuNKGVnZ2N7Oxs3THCysq9K3Flryt1x2iRxz55\nDAM7DMT47jbbE8oFAl6cWEQGA5iplJpQ/eMHACil1JMN/Jo9AAYopfJNfi5sF1KtrATatDGaHDMy\ndKdpvpdfNiaEz52rO4leXJw4+Cq9lVBQiI5wWFMGgG+OfoOMxAykx6frjuIYoVyc+HMA3UWki4hE\nA7gawMLTwmTU+noQjELqV8zC3bp1QLduzixmgLEJ6fLlgNerOwm5XVRElCOLGQD0aduHxSxIAm5y\nVEp5ReRuAEthFMiXlVLbRWSG8dPqJQBXisidACoBlALg2FUTy5YZG2c6VadORjHevBm40BlzXYnI\nRbgfmo0MHgz86U/GCvZOdd99QHo68PDDupPowyZHImtxPzSHyc8Htm0Dhg7VnSQw48YBS5fqTkFu\nVVhWiN0Fu3XHsAQXKrYeC5pNrFwJDBtmjBZ0shEjgE2bgJMndSchN/oy90s8s+4Z3TECVlJZgo5P\nd0RZVZnuKK7CgmYTS5c6u/+sRnw8cNFFAEexUzAM7zIcz058VneMgMVHxaN76+74dN+nuqO4Cgua\nDSjlnoIGGL+PJUt0pyCyt/Fnjcfnhz7XHcNVOCjEBr77zhgIcuCAsS6i023ZAvz0p8bvKxxxUAg1\nhdfnRYQnQncMR+CgEAepeTtzQzEDgPPOA06cAPbs0Z2EyL5YzKzHgmYDbmpuBACPBxg71phXR2SV\nOV/NQVFZke4YZGMsaJpVVgKrVhkLErsJ+9HISqcqTmHGhzP4VkMNYkHTbN06oEcPYzKym4wda0xF\n4DJYZIVV+1ZhQPsBSIxO1B3FUkopfLrvU+7tZhEWNM3c1txYo107oGNHYxksokClxaXhvsH36Y4R\nFE999hSKytmUagWOctTsoouAJ54ARo7UncR6995rrO/4u9/pThJaHOVIZC2OcnSAoiJjuauLL9ad\nJDhGjwZWrNCdgojCBQuaRp9+aryhOX25q/qMGAF89hlQUaE7CRGFAxY0jVaudPbK+o1JSQF69gTW\nr9edhIjCAQuaRllZ7uw7q23UKKNwE7XUjA9m4NipY7pjBNXWI1uxfPdy3TEcjwVNk7w8YPdu92+E\nOXo0Cxq1nFIKE7pPQOu41rqjBNWewj34y5q/6I7heCxommRnG9vFREXpThJcQ4ca28mcOqU7CTmR\niGBqr6mun1Cd2TUTaw+uRXlVue4ojsaCpkk4NDcCQEIC0L8/sGaN7iRE9pUSm4I/jfoTSqtKdUdx\nNBY0Tdw+IKQ29qMRNe6ei+5BSmyK7hiOxoKmweHDwJEjQL9+upOEBgsaEYUCC5oG2dnGHK0Id3cL\n/GDwYGDHDqCwUHcScpK5X8/Fg8sf1B2DHIQFTYNwam4EgOhoYMgQY1cBoqZa9v0ydGzVUXcMchAW\nNA1WrgyPASG1sdmRmmvVvlUY2TW8HpSPdn6EWRtm6Y7hWJG6A4SbffuA4mKgTx/dSUJr1CjgZz/T\nnYKcZP2t610//+x0vdv0RufkzrpjOBYLWohlZQGZmYDYZi320LjgAuDgQSA3F8jI0J2GnCAtPk13\nhJDrmtJVdwRHY5NjiGVlhVf/WY2ICGD4cOP3T0QUDCxoIaRU+A0IqW3UKBY0IgoeFrQQ2rXLKGrd\nu+tOosfIkSxo1LjiimKcLD+pOwY5EAtaCNU0N4Zb/1mNvn2BggIgJ0d3ErKzrD1Z+NXiX+mOoY1P\n+dD7+d44UX5CdxTHYUELoXAcrl+bx2NMKOdbGjVk8jmT8e8p/9YdQxuPeJCRmIHV+1frjuI4LGgh\nopSxQkg4FzSA89GoaSRcmzGqjew6Ep/s+0R3DMcRpZTuDHWIiLJbJits3w5MmgTs2aM7iV7h8Ocg\nIlBK2eYT2a3PlJsVVxQjNjIWkR7OrAKa/kzxDS1EsrON+WfhrmdPoKwM2LtXdxIi+0qMTmQxawEW\ntBCpmVAd7kSMPwf2o5GZNfvXcIQjtRgLWgjU9J+xoBlGjmQ/GvlTSmHa29OQX5qvOwo5lCUFTUQm\niMgOEflORO6v55xnRWSniGwRkfOtuK9TbN8OJCYCXbroTmIPNROs2a1DtW07tg0JUQnoksIHBTAK\n/IGiA7pjOErABU1EPABmARgPoA+Aa0Sk52nnTARwllKqB4AZAF4I9L5OkpXF0Y21nXWW0fS4a5fu\nJGQnJZUluGvgXbpj2EalrxJj3xiL8qpy3VEcw4pex0EAdiql9gGAiMwFcBmAHbXOuQzA6wCglFov\nIskikqGUyrXg/raXnQ1MmaI7hX2I/LhqSI8eutOQXQzsOBADOw7UHcM2oiOisePuHY2fSD+wosmx\nI4Da78UHq481dE6OyTmu5POx/8wM+9GIyGq2HBc6c+bMH77OzMxEpoOrwbZtQHIycMYZupPYy6hR\nwIMPGv1oTp9Dm52djezsbN0xiMJewBOrRWQwgJlKqQnVP34AgFJKPVnrnBcAZCml3qr+8Q4AI8ya\nHN02CXTWLGDLFuDf4buST726dQM+/BDo3Vt3EmtxYjWRtUI5sfpzAN1FpIuIRAO4GsDC085ZCODG\n6mCDARSGS/8Z55/Vj6vvU43nNzyP/UX7dcewpR3Hd2Bn3k7dMRwh4IKmlPICuBvAUgDfAJirlNou\nIjNE5Pbqcz4CsEdEdgF4EUBYDGXy+YBVq1jQ6sN+NKoRGxmLuMg43TFsaf72+fjH5//QHcMRuJZj\nEH31FTBtGrCT31yZyskB+vUDjh41VuJ3CzY5kpXWHliLuz66C5tnbNYdRRuu5WgDnH/WsI4dgbQ0\no/ATkbkLO1yI/u36w+vz6o5ieyxoQcTh+o1jPxpRw6IiovDKZa8gwhOhO4rtsaAFCfvPmob9aERk\nFRa0IPnqKyA9HejQQXcSe8vMBD79FPCyNSUsbT68GfcvM13+lajZWNCChM2NTZORYfSlbQ7f/u6w\ntuT7JSirKtMdg1yCBS1IOP+s6diPFr5W7lmJUWeO0h3DEd7b/h5W71+tO4atsaAFgc8HfPIJC1pT\nsR8tfP3f+P/D6G6jdcdwhFYxrZAQlaA7hq1xHloQbN4MXHMNsIMLZTdJXh5w5pnG/0dF6U4TOM5D\nI7IW56FpxP6z5klLM/ZI27hRdxIicjIWtCDIzuaE6uZiPxoRBYoFzWJer9F/NmKE7iTOwn608OJT\nPrAZlKzGgmaxrVuB9u2Bdu10J3GW4cOB9euBcu42HxY+O/AZJs2ZpDuG4+SV5OHKt6/UHcO2WNAs\nxv6zlklOBnr1Mooaud+wzsMwb/o83TEcp3Vca3y6/1PsLdyrO4otsaBZjPPPWo79aOElMTpRdwTH\nERGM7DoSWXv4oJjhsH0LVVUZy1199x3Qtq3uNM6zeDHw5z8ba2A6GYftUzDtKdiD5NhktI5rrTtK\nyDT1mYoMRZhwsXEj0KULi1lLDRsGfPEFUFoKxHGvRyJTZ6aeqTuCbbHJ0ULLlwOjuehBiyUmGht+\nfvaZ7iQUTPsK96HCW6E7BrkQC5qFVqxgQQsU+9Hcb/q86Vh3cJ3uGORCLGgWKSkBPv/cGH5OLcf5\naO5WVFaE7ce346KOF+mO4niV3krdEWyHBc0ia9YYzWVJSbqTONvFFwNffgkUF+tOQsGwr2gfpvee\njpjIGN1RHC23OBc9n+/Jyemn4ShHizzwABATA/zxj7qTOF9mpvHnOWGC7iQtw1GOFAplVWWIjYzV\nHSMkuDhxiLH/zDrsRyNqXLgUs+ZgQbNAQQHw7bfA4MG6k7gDCxoRtQQLmgWysoy+n+ho3Unc4aKL\ngO3bgaIi3UmIyElY0CzA5kZrxcQYRe2TT3QnISst2LEAOSdydMdwldziXBw9dVR3DNtgQbMAC5r1\nRo1is6PbfJv3LcqqynTHcJW/fvZXvLDxBd0xbIMFLUA5OcDx48D55+tO4i7sR3Of3w39Hc5qfZbu\nGK4y7qxxWPr9Ut0xbIMFLUArVhgfvh7+SVrqwguB778H8vJ0JyGyr2GdhyEpJglen1d3FFvgx3CA\nuH5jcERFGYsVZ2frTkJkX3FRcfj4uo8R4YnQHcUWWNAC4PMBS5cC48bpTuJO48YBS5boTkFETsGC\nFoCtW4FWrYBu3XQncafx442CxkUunG3T4U34+7q/645BYYAFLQBLljh3eSYn6NnT+P8dO/TmoMAs\n2LEAh04e0h2DwgALWgAWLzbeIig4RH58SyPnWrZ7GcaeNVZ3DFdbd3Adsvdm646hHQtaC508aeyu\nnJmpO4m7TZhgfONAzvXoiEcxrPMw3TFcrbSyFKWVpbpjaMfV9ltowQLgueeMUY4UPEVFQKdOwNGj\nQFyc7jRNw9X2iawVktX2RSRVRJaKyLciskREkus5b6+IbBWRzSKyIZB72gX7z0IjOdmYtM5lsIio\nMYE2OT4AYLlS6hwAKwE8WM95PgCZSqn+SqlBAd5TO6XYfxZK48ez2ZGIGhdoQbsMwGvVX78G4PJ6\nzhML7mUbu3YB5eVA3766k4SHCRM4MMSJ2MxJoRZokWmrlMoFAKXUEQBt6zlPAVgmIp+LyG0B3lO7\nmrczsU0vibtdcAFw7Biwf7/uJNQcT332FJ5c/aTuGGHl5wt+Htar70c2doKILAOQUfsQjAL1iMnp\n9X1LNlQpdVhE2sAobNuVUqvru+fMmTN/+DozMxOZNhtKuGQJcOONulOED4/nx1VDbrPht0PZ2dnI\n5hpdfu4bfB9OVZ7SHSOsFJQVYPGuxbixX3h+QAU0ylFEtsPoG8sVkXYAspRSvRr5NY8COKmUerqe\nn7f1iKzSUqBdO2DPHqB1a91pwscbbwDz5wPvvac7SeM4ypF0eWXzK1i8azHenv627iiWCskoRwAL\nAdxc/fVNABaYBIkXkcTqrxMAjAPwdYD31WblSmPUHYtZaE2aZPzZl3E7LaJ6Tes1DX/M/KPuGNoE\nWtCeBDBWRL4FMBrAEwAgIu1F5MPqczIArBaRzQDWAfhAKeXYDXwWLgSmTNGdIvykpQH9+hlFjYjM\npcSmoFebBhvJXI0Tq5vB5wPOOMPYePLss3WnCT9PPQXs3g3885+6kzQs3JscvT4v9hXtQ7dUrtpN\n1ghVk2NY2bQJSEpiMdNlyhTggw+4+r7drTu4DpfNvUx3DApDLGjN8MEHwOTJulOEr3POAeLjgc2b\ndSehhry/431M7TlVd4yw5lM+lFeV644RcixozcD+M/0mTzb+Hsi+SqtKWdA0+9XiX2HOV3N0xwg5\n9qE10YEDQP/+wJEjQGSjs/coWFatAn79a2OnA7sK9z400q/CW4HoiGjdMSzDPjSLffCBMXScxUyv\noUOBvXuBgwd1JyGyLzcVs+ZgQWuiBQvY3GgHkZHGNxYL/GY8ElG4Y0Frgrw8YN06YOJE3UkIAK68\nEpg3T3cKIrIbFrQmWLAAGDsWSEjQnYQAY2HorVuN/kyyj8W7FuOTfdy4zk5W71+NorIi3TFChgWt\nCd55x3grIHuIjTWaHefP152EaovyRCHSw05mO/nb2r9h4bfhMyyYBa0RBQXAmjXAJZfoTkK1/fSn\nwNvuWn/V8UZ3G42Lz7hYdwyqZWrPqZi/I3y+82NBa8TChcCoUcYKIWQfbHYkatzksyfjrNSzdMcI\nGRa0RrC50Z7Y7EjUuNS4VPx13F91xwgZFrQGHD8OfPIJl7uyq+nTOdqRiH7EgtaAt9823gJatdKd\nhMxMmABs2QIcOqQ7SXh7bv1zeGbdM7pjELGgNeTNN4Hrr9edguoTGwtMnQrMnq07SXh7/cvX0btN\nb90xiFjQ6rNrF/D998C4cbqTUENuvhl47TVuKaPL7oLdOHzyMEafOVp3FGrA3sK9uOn9m3THCDoW\ntHq8+SZw9dVAVJTuJNSQYcOAkhJjrzoKvW6p3bDtF9sQ4YnQHYUa0KlVJ9za/1bdMYKOq+2bUAro\n0QP473+BgQO1RqEmmDkTyM8Hnn1WdxIDV9snshZX2w/AqlVATAxw4YW6k1BT3Hij8c1HRYXuJESk\nEwuaiRdeAO64AxDbfI9NDenWDejdmxt/EoU7FrTTHD0KLF4M3HCD7iTUHHfeCfzjH7pThI8jxUew\ncs9K3TGoBfYW7tUdIWhY0E7z6qvAtGlASoruJNQc06YB27cD27bpThIeck7kYOOhjbpjUDOVVZVh\nwEsDcKDogO4oQcFBIbX4fED37sDcucCgQVoiUAD+8AdjcMisWXpzcFAI2dndH92N1NhU/L9R/093\nlCbjoJAWWLzYeDPjyEZnmjEDmDMHOHFCdxIi+7r3onuRX5qvO0ZQ8A2tlpEjgZ//nKuDONmVVwIj\nRgD33KMvA9/QiKzV1GeKBa3axo1GP8z333MytZOtW2dMiN+5U9/fo5sLmlIKwuG/FGJscmymp54C\n7ruPxczpBg82hvH/97+6k7jTtLenYc3+NbpjEJliQQPwzTdAdjZwq/tXhgkLDz0EPPGEMciHrLMh\nZwO+OPQFLuzAFQfcQikFu7XSBYIFDcbouN/+lrtSu8Xo0UByMt/SrPb2N2/jd0N/h5jIGN1RyCJ3\nLboLi3Yu0h3DMmHfh7Zpk7GB586dQHx8yG5LQbZqlbES/44dxjJmoeTWPjSlFHzKx4WIXSTnRA7a\nJbaz/d8p+9CaQCmj3+z3v2cxc5sRI4A+fbh6iJVExPYffNQ8HVt1dNXfaVi/oc2ZA/z1r8DnnwMR\n7vk7pWrffANkZgJbtwIdOoTuvm59QyPShW9ojSgqMvrNnn+excyt+vQBbr8d+OUvdSchCg/Prn8W\n247pW38uLAuaUsZitpddBgwZojsNBdMjjwBbtgDz5+tOQmRvT6x+Ah9+92FA12iX2A5tE9palKj5\nwrLJ8Y03gD//2ZhMzb4z91u/3hj4s26dMUct2NjkSE706b5PMX3edGyasQkdkkLYRt8EXCmkHuvW\nAVOmAMuWAf36Be02ZDPPPQe88grwySfBn57BgkZO9dgnj6HCW4H/Hfm/uqPUEZI+NBG5UkS+FhGv\niFzQwHkTRGSHiHwnIvcHcs9AbNsGXH458NprLGbh5u67jR0ULrkEOHVKdxp3yM7O5nWDeN1gXru+\n6z78k4fx6IhHm3ydSm8lvD5vo9cNlUD70L4CMBXAqvpOEBEPgFkAxgPoA+AaEekZ4H2bbeVKY/Hh\nv/0NmDgx1Hcn3USAf/7T2B5o7Fjg0CHdiZzPaQXCadcN5rXru25zpmbkl+ZjytwpeGHjC41eN1QC\nKmhKqW+VUjsBNPQqOAjATqXUPqVUJYC5AC4L5L7NsXu3sa3IDTcAs2cD110XqjuT3Xg8wL//DUya\nBJx/PvA0I98YAAAgAElEQVT3v3OrGaLGrNq7CuVV5XWO7S/aj34v9EOv9F64fcDtmpL5C8Uox44A\nam+PerD6WFBNn258N37RRcYeZ19+CYwZE+y7kt15PMbIxxUrjP60Dh2A/v2N4kZEdSml8M+N/0Rx\nRXGd451adcL7V72Pp8c/jagI+6zo3uigEBFZBiCj9iEACsDDSqkPqs/JAvAbpdQmk19/BYDxSqnb\nq398PYBBSql767kfe6/J8ew2KER3BqJANeWZimzCRcYGmCMHQOdaP+5Ufay++9nmg4DIDfhMUbiw\nssmxvofmcwDdRaSLiEQDuBrAQgvvS0REFPCw/ctF5ACAwQA+FJGPq4+3F5EPAUAp5QVwN4ClAL4B\nMFcptT2w2ERERHXZbmI1ERFRS4TlWo5E4UhEfiMiPhFpbeE1/1dEtorIZhFZLCLtLLruX0Rku4hs\nEZF3RaSVRddt0mIQzbheUBaNEJGXRSRXRL608JqdRGSliHwjIl+JiOnAvBZeO0ZE1lf/O/hKRJo+\nO7vxa3tEZJOINNpVxYJGFAZEpBOAsQD2WXzpvyil+iml+gNYBMCqD7KlAPoopc4HsBPAgxZdt9HF\nIJoqyItGvFp9XStVAfi1UqoPgCEAfmFVXqVUOYCR1f8OzgcwUUQGWXFtAL8E0KQl/FnQiMLD/wH4\nrdUXVUrVnqCUAMBn0XWXK6VqrrUOxuhoK67blMUgmipoi0YopVYDKLDiWrWueUQptaX662IA22Hh\nnGClVEn1lzEwRtAH3J9V/Y3YJAD/bsr5LGhELiciUwAcUEp9FaTrPyYi+wFcC+APQbjFzwB8HITr\nBkrLohFWEJGuMN6k1lt4TY+IbAZwBMAypdTnFly25huxJhXHRuehEZH9NbAAwiMAHoLR3Fj756y4\n9sNKqQ+UUo8AeKS6D+keADOtuG71OQ8DqFRKzbEqb1Ov41YikgjgHQC/PO0NOyDVb9T9q/s73xeR\n3kqpFu/2KSKXAMhVSm0RkUw04d8tCxqRC9S3AIKI9AXQFcBWEREYTXdfiMggpdTRQK5tYg6Aj9DE\ngtbYdUXkZhjNTaOaeP8mXddCzVo0wg5EJBJGMXtDKbUgGPdQSp2oXj1qAprY91WPoQCmiMgkAHEA\nkkTkdaXUjfX9AjY5ErmYUuprpVQ7pVQ3pdSZMJrF+je1mDVGRLrX+uHlMPplrLjuBBhNTVOqBxwE\nQ6D9aMFeNEJgTV9fba8A2KaUsnT1UhFJF5Hk6q/jYLQI7Ajkmkqph5RSnZVS3WD82a5sqJgBLGhE\n4UbB2g/JJ0TkSxHZAmAMjBFpVngOQCKAZdVDtv9hxUXrWwyiJYK5aISIzAHwGYCzRWS/iNxiwTWH\nArgOwKjq4fWbqr9xsEJ7AFnV/w7WA1iilPrIoms3GSdWExGRK/ANjYiIXIEFjYiIXIEFjYiIXIEF\njYiIXIEFjYiIXIEFjYiIXIEFjYiIXIEFjYiIXIEFzcVE5FoR+VxETopIjogsEpGhInJV9aaERSJy\nRERerV6wlIgaUN8zddo5K6o3UuXna4jxD9ylROTXAJ4G8BiAtjAWUX0ewGQAawAMV0olA+gGIKr6\nPCKqRyPPVM0518KivcCo+bj0lQtVb9+QA+AmpdT8Rs5NhPFQpimlLg1FPiKnacozVX3OBgA3AlgL\nIKrWJqUUAtw+xp2GwNg19v36TqhuJlkEoBWAUzBWSicic40+UwD+BOAfAHJDkoj8sMnRndIAHG/o\nu0Ol1BqlVAqMHXafArA/VOGIHKjBZ0pELgRwMYxdAkgTFjR3ygOQ3pROaaXUYQBLAMwNeioi56r3\nmareOPV5GDtAW709DzUDC5o7rQVQjqY3I0bBGBxCROYaeqaSAQwA8JaIHIbRjyYADp4+ApKCi31o\nLlS9BfqjAJ4XES+MDQgrYWzAOBLAVgCfKqUOiEgXGKO2lmsLTGRzTXimOtQ6vTOMonYBgOOhzhrO\nOMrRxUTkGgC/BtATwEkAXwB4HMClAG4CkAKgAMbgkIeUUgWaohI5Qn3PlFJqXa1zugDYDY5yDDlL\nCpqIvAzjQzJXKXVePec8C2AijBF1NyultgR8YyKX4jNF1HxW9aG9CmB8fT8pIhMBnKWU6gFgBoAX\nLLovkVvxmSJqJksKmlJqNYymq/pcBuD16nPXA0gWkQwr7k3kRnymiJovVKMcOwI4UOvHOdXHiKhl\n+EwRncZ2oxxFhKNUyPGUUraZi8RnitygKc9UqN7QcgCcUevHnaqPmVJKWf7fo48+auvrlpSU4Jln\nnkFeXt4P162oqEBOTo4t8zrxzzhU1w2RsHimDv7jILJa+L9vrvkGPq/Psf+OnJhZ9zNlZUET1D9D\nfiGMBTshIoMBFCqluN5ZLXFxcfjlL3+J1q1b/3AsKioKHTp0aOBXkcuF9TOVOzcXO3+xs96fj+sR\nh4TzEur9FDv636PY/cDuIKUjO7KkyVFE5gDIBJAmIvsBPAogGoBSSr2klPpIRCaJyC4YQ4xvseK+\nRG4V7s9U8ZfF2HHzDtNNWJIGJeHsf56NpAuSAABlB8uw+/7dODrnqN+5B546gPhz4tH+5+2DHZls\nwJKCppS6tgnn3G3FvVoqMzPTFdetqqrC66+/jltuuQXGEnLWXNcKbvkztoNwfqZ+ctFPsO2qbVDl\n/tWs7bVt0fPVnvBE//haFtspFr1n90bSwCR8f9/3fr9m5707kfyTZEf+O3JaZt3PlO1WChERZbdM\nVtu1axceeughvPXWW80uSuXl5RgyZAjuuOMO3H777UFKSIEQESibDQpx0jP13Z3f4dALh/yOp12W\nhj7v9IEnsv6ekn1/2oc9D+/xO540KAn9V/eHJ4rL1zpRU58p/u2GWFVVFa699loMHz68RW9YMTEx\nmD17Nh5++GHs2LEjCAmJ9ClaV4RDL/oXs4RzE9D7v70bLGYA0PnBzsi4yX863skNJ5HzbL1jZsgl\nWNBCbNasWWjVqhV+8YtftPgavXr1wu9//3vccccdzRoBRGRnviofdt6506/fzBPnQe+3eiMiLqLR\na4gIeszqgbjucX4/t/ePe1F+pNyquGRDLGghdPjwYTz22GOYNWtWi97OarvrrrtQWFiIt956y6J0\nRHodefkIircU+x3v9uduSOiV0OTrRCZGoucbPf3Gh3pPerHnQf/mSHIPFrQQeuCBB3DrrbeiZ8+e\nAV8rMjISzz//PFatWmVBMiK9vKVe7P3jXr/jiecnosMvmj91JXlwMtrf7j+y8chrR1D8lX/RJHfg\noJAQeu6553DzzTcjKSlJdxQKIg4Kab79T+3H7t/5zxnr/1l/JA9JbtE1K45XYMPZG1BVUFXnePq0\ndPR9t2+Lrkl6NPWZYkEjshgLWvNUFVdhXZd1qMqvW3jaXNkGfeb1CejaB/9+ELt+tcvv+IBNA5DU\nn99YOgVHORKRIxx5+YhfMYMH6Pq/XQO+dvsZ7RHdMdrv+L7/ty/ga5P9sKARkTa+Kh8O/N8Bv+MZ\nN2Q0ayBIfSJiI9Dl4S5+x4+/fxwlO0sCvj7ZCwuai1RUVOiOQNQsx945hvJ9/kPpO9/f2bJ7tP9Z\ne8R0iql7UAEHnzlo2T3IHljQgmzr1q2oqqpq/MQA7d69G+eee25I7kVkBaUUDjzl/3aWNjnNkrez\nGp4YDzr+0n+ruCOvHkFlXqVl9yH9WNCCqLCwECNHjsThw4eDfq9u3bqhbdu2mD9/ftDvRWSFok+L\nULzJfwj9Gf9zhsnZgelwWwdEJNWdmO0r9eHwy8F/Nil0WNCC6OWXX8bEiRNxxhnWP6Bm7rnnHrzw\nwgshuRdRoMyWuEoalITkn7RsmH5DIpMj0f5W/3lph146BOWz7whQah4WtCBRSuHFF1/E3XeHbkH0\nyy+/HNu2bcO3334bsnsStURlXiWOvXPM73inX3UKeBWd+nS827/Zsez7MhRmFQblfhR6LGhBsmrV\nKkRHR2Pw4MEhu2d0dDRuueUWvPTSSyG7J1FLHHnjCFRF3TejqPQotJnWJmj3jOsWh9SxqX7Hzd4U\nyZlY0ILkX//6F2677bagfbdZn9tuuw0xMTGNn0ikiVIKh1/y77vKuCkDnpjgfiR1mOG/jNbx946j\nIpcjhN2AK4UEybvvvouRI0eidevWuqNQiHGlkIYVri7Elp9s8Ts+aMcgxJ8TH9R7+yp9WHvGWlTm\n1h3d2O2JbpZOFSBrcaUQza644goWMyITR1494ncseURy0IsZAHiiPGj/M5NFi18/wq2YXIAFjYhC\nxlvmNR0M0uG25q+o31Jmox1LtpWgeCtX4Xc6FjQiCpn8RfnwnvDWORaRGIH0qekhyxDXLQ6tLm7l\nd/zo7KMhy0DBwYJGRCGTOzvX71j61HRExDe+G7WVMq7P8DuWOycXystmRydjQbOQUgqnTp3SHeMH\n119/PbZu3ao7BhEAoLKgEnmL8vyOZ1znX1yCrc30NpDIumMMKg5VoHAV56Q5GQuahdatW4fhw4fr\njvGDzp07480339QdgwgAcOzdY/5zzzKikDI6JeRZotOj0Xqi/6Ct3Df93yDJOVjQLDR79mxcfvnl\numP84Nprr8Vbb73F0VtkC0fn+vdRtb26LTyRej6GzJodj793HL4Kn4Y0ZAUWNIt4vV7MmzcP11xz\nje4oP+jTpw8SEhKwYcMG3VEozFXmVaIw2785L+Pa0Dc31kibnAZPQt2PwKrCKi6F5WAsaBZZs2YN\nOnTogO7du+uO8gMRwZVXXol33nlHdxQKc8cXHgfqDm5EbNdYJA1M0hMIQERcBNIuSfM7fuxd/2kF\n5AwsaBaZP38+pk2bpjuGn+nTp2PNmjW6Y1CYMysS6dPSQ7403OnaXOG/duTx949ztKNDsaBZ6Ior\nrtAdwc+5556L1atX645BYazqRBUKlhX4HQ/mQsRN1XpSa3hi634MVh6rRNHqIk2JKBAsaBZ55pln\n0Lt3b90x/IgIPB7+NZM+eYvy/EY3RreLRqsh/pObQy0yMRKp4/1X4GezozPxk46Igur4/ON+x9Kn\npkM89li/2azZ8dj8Y9z404FY0IgoaLwlXuR95D+ZOn1a6Ja6akzapWn+k6xzKnBiwwlNiailWNCI\nKGjyl+bDV1J3XldkaiRSRoR+MnV9olLNJ3ebvVmSvbGghYlTp07hv//9r+4YFGbyFpq8nV2WDk+U\nvT56zJodzZbpInuz178qB7r//vuRm2v/5XIiIyNxxx134NgxdnZTaCifMm9uvNw+zY010ib7z0cr\n2VaC0t2lGtJQS7GgBSA3NxcvvfQSUlP9R0nZTUxMDMaOHYtFixbpjkJh4uQXJ/12hpYY0bJ2Y2Ni\n2sUg6UL/Sd58S3MWFrQAfPzxxxgzZgyio6N1R2mSyZMn44MPPtAdg8KEWTFIyUxBZGKkhjSNS7vU\n/y2NBc1ZLCloIjJBRHaIyHcicr/Jz48QkUIR2VT93yNW3Fe3RYsW4ZJLLtEdo8kmTZqE5cuXo7y8\nXHcUaoQbnqn8Rfl+x8yKhl2YZSvMKkRVcZWGNNQSARc0EfEAmAVgPIA+AK4RkZ4mp36ilLqg+r/H\nAr2vbhUVFVi+fDkmTpyoO0qTtWnTBn379kV2drbuKNQANzxT5YfLcXLjSb/jZmsn2kVi/0REt6vb\n2qIqFAqW+69yQvZkxRvaIAA7lVL7lFKVAOYCuMzkPHvMorTI6tWr0aNHD2Rk6FstvCUef/xxdOvW\nTXcMapjjn6n8j/3fzuJ7xyPuzDgNaZpGPILWl/jvkZb3IZsdncKKgtYRwIFaPz5Yfex0Q0Rki4gs\nEhH7rRHVTEOGDHHkMPjMzEz06NFDdwxqmOOfKbMiYOe3sxpmzY75H+Vz1RCHCFXv7BcAOiulSkRk\nIoD3AZxd38kzZ8784evMzExkZmYGO1+zxcXF4ayzztIdg2wgOztbRzOubZ8pX7nPdDFiO/ef1Ugd\nkwqJljprT1YcrkDx5mIkDdC31U24aekzJYHuZiwigwHMVEpNqP7xAwCUUurJBn7NHgADlFJ+7RIi\norjDMjmZiEAp1eLmQKc/UwUrC7B19NY6xyJTInHxsYu17U7dHFsnbEXBkroF+czHz0SXh7poSkRN\nfaas+Nf1OYDuItJFRKIBXA1g4WlhMmp9PQhGIfVvZCciwOHPVP5S/xip41IdUcwAIG2iSbPjElv8\n0VIjAm5yVEp5ReRuAEthFMiXlVLbRWSG8dPqJQBXisidACoBlAK4KtD7ErmV05+pgqX+zY2tJ/gP\ntrCr1HH+CyWc+OwEqk5WITLJnnPoyBBwk6PV7N7kWFVVheLiYqSk2G+1g+a4+eabccMNN2D06NG6\no7hOoE2OVgvlM1VxtAKfZXzmd3zwgcGI7RQbkgyBUkphXed1KD9Yd75m34V9kT7Zfst2hYNQNjmG\nlbVr12Ls2LG6YwSsa9euWLx4se4Y5DJmc7bie8U7ppgBxoen2aafbHa0Pxa0Zlq6dCnGjBmjO0bA\nJkyYgCVLluiOQS5TX/+Z07Qe599EataUSvbCgtZMy5Ytw7hx43THCNjAgQORk5ODnJwc3VHIJZRS\npsP1zYqD3aWOSfWbtl66sxSle7j6vp2xoDVDfn4+tm3bhosvvlh3lIBFRERgzJgxWLp0qe4o5BIl\n20pQcaiizjGJEltt5tlUUa2jkDTQf96ZWcEm+2BBa4aVK1di2LBhiImJ0R3FEuPHj8cXX3yhOwa5\nhFlzY/KwZEQkRGhIEzizN0v2o9kbC1ozFBcXY/r06bpjWObmm2/GrFmzdMcglzDrY3Ji/1kNs4Eh\nBSsK4KvyaUhDTcFJFc1w8803645gKY+H38+QNbxlXhSuKvQ77sT+sxqtLmqFiKQIeE96fzjmLfLi\n5OcnkTwkWWMyqg8/0YgoYCfWnICvtO6bS1R6FBLPT9SUKHCeKA9SR3P4vpOwoBFRwEyH649JhXhs\nM7+8RcyaTAtX+r+Jkj2woBFRwMxG/zm5/6xG6hiTZbDWnYD3lNfkbNKNBY2wbds27Nu3T3cMcqiK\n48b2KqdLHev8ghbXPQ4xneqOalaVCkWrizQlooawoDXBtm3bMHfuXN0xguaNN97Ayy+/rDsGOVRh\ntn8TXHxPZy13VR8RQcoo/3l0BSs5H82OWNCa4L333sOGDRt0xwia0aNHY8WKFbpjkEMVZvkXNLMi\n4FRmA0MKVrCg2RELWhNkZWVh5MiRumMEzdChQ7F161acOHFCdxRyINOCNtI9Bc3s91K8qRiVBZUa\n0lBDWNAaUV5ejvXr12P48OG6owRNXFwcBg0ahE8++UR3FHKY8iPlKNle4nc8JdM9BS32jFjE9Yir\ne1DBdN4d6cWC1oj169ejZ8+eSE5290RKNjtSS5j1nyWcm4Do9GgNaYLHrAmVw/fthwWtEW5vbqxx\n+eWXo2/fvrpjkMO4vbmxBvvRnIFLXzViypQpiI+P1x0j6Pr06YM+ffrojkEOEy4FzawJtWRbCcqP\nlCOmnTsWK3cDvqE1on///jjnnHN0xyCynfKccpTuPG1/MIEjt4tpTHSbaCScl+B33Kygkz4saETU\nImb9Z4nnJyIqNUpDmuBLHcVmR7tjQSOiFinI8v8wd2NzY42U0RwYYncsaETUIuHSf1YjZXgKcNpe\npWV7ylC6p9T8F1DIsaBRHa+88go+/PBD3THI5sr2l6Fsd1ndgx4g5SfuLWiRrSKRdGGS33G+pdkH\nC1o9VqxYgVtuuUV3jJArKyvD/PnzdccgmzN7O0sakITIZHcPnDbtR+O6jrbBglaPFStWoFOnTrpj\nhFxmZiaysrJ0xyCbC7f+sxpm89EKVxZCKaUhDZ2OBa0e2dnZYTGh+nS9evVCSUkJ9u7dqzsK2ZRS\nKuz6z2q0urgVJLrupqUVRypQssN/+S8KPRY0E8XFxfjyyy8xZMgQ3VFCTkSQmZmJ7Oxs3VHIpsr2\nlKF8f3ndgxFA8lB3Lw8HABFxEWg1pJXfcc5HswcWNBOrV6/GgAEDEBcX1/jJLsSCRg0x+/BuNbAV\nIpPc3X9WI3WkSbMjC5othMe/wGb64osvwrK5scbVV1+NKVOm6I5BNhWu/Wc1UkamADPrHivMLoTy\nKYhHTH8NhYbYrTNTRJQdMlVVVSEykvWemk9EoJSyzSeblc+UUgprO61FxaGKOsfPW3oeWo9tbck9\n7M5X7sPq1NXwlfrqHL/wywuReG6iplTu1tRnik2O9WAxI/JXurPUr5hJlIRF/1kNT4zH9PfL+Wj6\nsaARUZOZ9p9d1AoR8REmZ7uXWROrWVMshRYLGhE1Wbj3n9Uw+z0XrSqC8urvLglnLGhUr6qqKpSV\nlTV+IoUFpZTpCvvhWNCSLkyCJ6Hux2dVYRWKtxZrSkQAC1odxcXF2Lp1q+4YtvHzn/8cc+bM0R2D\nbKJkewkqcyvrHJMYMZ2X5XaeKI+xWPFpOHxfL0sKmohMEJEdIvKdiNxfzznPishOEdkiIudbcV+r\nLV++HL/73e90x7CNoUOHcj6aJnZ8psw+rJOHJCMiNrz6z2qY9qNxXUetAi5oIuIBMAvAeAB9AFwj\nIj1PO2cigLOUUj0AzADwQqD3DYZwXe6qPjXrOtphGkU4seszxebGukz70T4tgq/KZ3I2hYIVb2iD\nAOxUSu1TSlUCmAvgstPOuQzA6wCglFoPIFlEMiy4t6WysrKQmZmpO4Zt9OjRAz6fD7t379YdJdzY\n7plSPvafnS6pfxIikuu+nXpPelH8BfvRdLGioHUEcKDWjw9WH2vonByTc7Q6fvw49u7diwEDBuiO\nYhs16zpy9f2Qs90zdeqbU6g8Xrf/zBPnQatB4dd/VkMixLQfjcP39bHl7OGZM2f+8HVmZmZI3ppW\nrVqFoUOHIioqKuj3cpIJEyYgJydHdwxby87Otn1fY6DPlGn/2dBkeGLCe1xZyqgU5H2QV+dYYVYh\nujzQRVMid2jpMxXw0lciMhjATKXUhOofPwBAKaWerHXOCwCylFJvVf94B4ARSqlck+tpWfpq8eLF\nOHHiBH7605+G/N7kLoEufWXHZ+rrqV/j+PvH6xw78/Ez0eWh8P7gLt5ajI3nb6xzzBPvwbCCYfBE\nh3ext1Iol776HEB3EekiItEArgaw8LRzFgK4sTrYYACFZg+eThMmTGAxI7uw1TOlfAqFq9h/Zibh\n3AREptVt6PKV+HBiwwlNicJbwAVNKeUFcDeApQC+ATBXKbVdRGaIyO3V53wEYI+I7ALwIoC7Ar0v\nkVvZ7Zkq3lqMqoKqOsc8CR4kXZgUrFs6hngEKSM4H622Pb/fg4PPHkTxl8VQvtC2tnG1fSKLuW21\n/QNPH8D3v/m+zrHU8anot7hfoNFc4eCsg9h1z646x1JGpuD8lbacbhtU3lIvVqeshqow/r1FpkUi\nZUQKev6nZ0D75XG1fSKyhNnbhtkml+EqdZT/n0XRZ0Xwlnk1pNHrxLoTPxQzAKjKq8KJz04gIjE0\nk+9Z0KhJFi1axNGOYchX5UPhJ+w/a0h8r3hEZdQdHa3KFU6sDb9+NNO5ipkpEAlNg0XYF7TDhw/j\nkUce0R3D9t566y0sWrRIdwwKseLNxfCeqPumEZEUgcQLuJFlDRFBSib70QDz33Mov/kJ+4K2cuVK\nfPPNN7pj2N7IkSM5wToMxZ8dj95v9UaHOzsgvmc8ACB5eDI8kWH/0VGHWRNsuBU0b4kXJ9b7v5Wa\nFftgseXE6lDKysrCqFGjdMewvczMTDz00ENQSoWs+YD0i0yORNuftkXbn7YFAJQfLvd7YyNjgvXp\nTqw/Ae8pLyISwmPx5tP7zwAgun004nrEhSxD2H+blZWVxQWJm6Br166Ijo7Gt99+qzsKaRTTPgbx\n58TrjmE7cd3jEN0xus4xValQtKZIU6LQM21uDGH/GRDmBW3fvn04efIk+vTpozuK7YkImx2J6iEi\nYd/saLZ1TiibG4EwL2g1b2dsQmuaGTNm4LzzztMdg8iWTPdHC5OFiquKq3Byw0m/46mjQzu9I6z7\n0CZOnIihQ4fqjuEYQ4YM0R2ByLbMCtrJjSdRdbIqoEnFTlC0ugiqqm7/WcwZMYjtFhvSHGH9hpaR\nkYEePXrojkFELhB3Zhxiu572Ae41Nv10u8KVJv1no0LbfwaEeUEjIrKSabOjSd+S25j9Hs1WUAk2\nFjQiIouYFTS3DwypLKhE8Wb/Xbp1rCbDgkZEZBGzD/HizcWoLKg0Odsdij4pAnx1j8V1j0PsGaHt\nPwPCtKAppVBVVdX4iWTqF7/4BTZu3Nj4iURhJrZTLOK6nzaRWFV/6LuU6XB9k4nmoRCWBW3Hjh24\n4IILdMdwrKioKCxfvlx3DCJbMvswd/Pwfd3rN9YWlgUtKysLAwYM0B3DsUaNGoWVK1fqjkFkS6b9\naCajAN2g4mgFTn11yu+4ru2Fwragcbmrlhs+fDjWrl2L8vJy3VGIbMdsdYxTX51CxbEKDWmCy2y7\nmPje8YjOiDY5O/jCrqD5fD4WtAClpKSgV69eWL9+ve4oRLYT0y4G8b3817ssXOW+tzTTzV81DNev\nEXYF7euvv0ZqairOOOMM3VEcbfTo0cjOztYdg8iWwmX4vp0GhABhuPTVrl27cMkll+iO4XgPPvgg\n4uO56jqRmdRRqTj0j0N1jrmtoJXnlKP0u9K6BwVIGaGvoIlSqvGzQkhElN0yETWHiEApZZsVr/lM\nhV7F8Qp81uYzv+NDDg1BTPsYDYmsd+TNI9hxw446xxL7J+LCTRdafq+mPlNh1+RIRBRs0enRSDgv\nwe+42SAKp6pv/UadWNCIiILAzf1oSikUrDBZv1HTcP0aLGhEREHg5g0/S3eWonz/adN2IoDknyTr\nCVSNBY0CkpOTg5KSEt0xiGwneUSy3yds6a5SlB0o0xPIQvlL8/2OJQ9JRmQrveMMw6agFRcXY/78\n+bpjuM4tt9yCpUuX6o5BZDtRKVFI7J/od9wNb2kFy0yaG8fqbW4EwqigrVq1CrNmzdIdw3XGjh2L\nZSLhfqYAABJiSURBVMuW6Y5BZEtubHb0VfrMJ1SzoIXOsmXLMGbMGN0xXGf8+PF8QyOqR30bfjp5\nGsXJDSfhPemtcywiOQJJA5M0JfpRWBW0sWPH6o7hOueeey5OnjyJ3bt3645CZDvJP0kGIuoeK99f\njtKdpea/wAHM+s9SR6XCE6m/nOhPEAI5OTk4cuQIt4wJAhHBuHHj+JZGZCIyKRKtBrfyO56/xL8o\nOIVd+8+AMCloy5cvx8iRIxEREdH4ydRsV111FaKionTHILKl1uNb+x3LX+zMglZVVIUTG074HW89\nzv/3qENYrOV4zjnnoGvXrrpjuBbXxiSqX+sJrbH3D3vrHCvMLoS3zIuIWGd9k12QVQDU7T5D7Jmx\niDsrzvwXhFhYFLTBgwfrjkBEYSrpgiREpkWiKq/qh2O+Eh+KVheh9Rh7vNk0VcFS+zY3AmHS5EhE\npItEiGmTXMES/+Jgd2b9Z3ZpbgRY0IiIgs4N/Wilu0tRuuu00Zke/QsS1xZQk6OIpAJ4C0AXAHsB\n/FQpVWRy3l4ARQB8ACqVUoMCuS+RW/GZcqfUcf7Ncqe+PoXynHLEdHTGdjJ5H+X5HUsamISoVPsM\nCAv0De0BAMuVUucAWAngwXrO8wHIVEr154PnXvPmzeMu1oHjM+VCMe1jkNDPfzsZJw3fz//IP2va\npDQNSeoXaEG7DMBr1V+/BuDyes4TC+7VbAsXLsTvf//7UN82bB0+fBhvvPGG7hhOZ+tnilqu9QST\nZkeHFDRvidd0uavWk+zTfwYE/kC0VUrlAoBS6giAtvWcpwAsE5HPReS2AO/ZZAsWLECbNm1Cdbuw\nN2nSJHz88ceOXtbHBmz9TFHLmfWjFSwrgPLa/3kpzC6Er8xX51hU2ygkXaB/uavaGu1DE5FlADJq\nH4LxMD1icnp9fzNDlVKHRaQNjIdwu1JqdX33nDlz5g9fZ2ZmIjMzs7GY/kGUwuLFi/HAAw80+9dS\ny3Tv3h1JSUnYvHlzWK3Kkp2d3aymVqc+UxSY5KHJ8CR44Dv1Y2GoKjAmKicP0buPWGPM+s9aT2wN\n8UhQ7tfcZ6qGBPLdtIhsh9GOnysi7QBkKaV6NfJrHgVwUin1dD0/r6z4Dn/r1q244oorsGvXroCv\nRU33m9/8BsnJyfjDH/6gO4o2IgKlVIuedDs/UxS4r6Z8hbwP6haHzg92Rrc/ddOUqHFKKazvth5l\ne+vu49b7rd5o+9P6GhCs1dRnKtAmx4UAbq7++iYAC0yCxItIYvXXCQDGAfg6wPs26uOPP8akSZOC\nfRs6zaWXXooPP/xQdwwns+0zRYFLu8R/EMXpBc5uSr4t8StmiLDXhOoagRa0JwGMFZFvAYwG8AQA\niEh7Ean5VMsAsFpENgNYB+ADpVTQV7LNzs7GxIkTg30bOs2wYcPw4osv6o7hZLZ9pihwaZf6F7RT\nX59C6R77rr6fv8hkd+qLk201XL9GQE2OwWBV80hlZSVEBJGRYbG6FwVAKQUR6/oCAmlyDAY2OdrL\nxgs3oviL4jrHuv+9Ozrd20lTooZtGb0FhSvrjnA8889nossDXUKWIVRNjrYVFRXFYkaN8vl86Nu3\nL44fP647CoWJ9Cnpfsfs2uxYmV+JwlX+w/XtNv+shmsLGlFTbNy4EQCQnu7/IUMUDGmT/YtB4apC\nVBVVmZytV96iPL/V9WM6xyDhXP9J4nbAgkZhbeHChZg8ebLuGBRGEs9PREynustdqUply0nWx9/z\nb7lIvzzd0iZ6K7GgUdDk5dmzGaW2+fPnY+rUqbpjUBgREdO3NLs1O3pLvKYLKKdPtW9rBgsaBcWe\nPXvQt29f+Hy+xk/WZPv27Thx4gQGDhyoOwqFGdOCtigPvkr7PC8FywrgK62bJzItEsnD7DsJnAWN\nguLMM89Eeno61q5dqztKvTZv3oyrr74aHg8fAwqtlJEp8CTU/XdXVVBlul6iLsffN2lunJwOT6R9\nnxf7JiPHu+KKK/Duu+/qjlGva6+9Fk899ZTuGBSGImIjTEcKHpt3TEMaf74qH45/YN5/ZmcsaBQ0\nV1xxBebPn2/rxYrt2rlN7tdmuv/C6cfeO2aLZsei1UWoyqs76tIT57Hl6iC1saBR0PTt2xfR0dHY\ntGmT7ihEtpM2KQ2euNOaHfOqUJitv9nx+Lv+b2etJ7RGRHyEhjRNx4JGQSMiuPfee1FQUKA7CpHt\nRCREmK7teOxtvc2Oviofjr591O+43ZsbARcvfUWkC5e+oqY6+vZRbLtqW51jkWmRuPjwxfBE6Xnf\nKFhRgK1jttY5JtGCoUeHIjJZz+pLYb/0FVF9Fi9ezGZQsoW0S+zX7Hh0rv/bWdqkNG3FrDlY0Cjs\n/OEPf+DajWQLEQkRaD3JfydrXc2Ovgofjr3rf++2V4dm37NAsaBRWPnuu+9w4MABjBo1SncUIgBA\n2+n+xeLovKPwlnlNzg6u/KX5qCo4bXRjgsd02xs7YkGjsDJ79mxcddVV3ImBbCPt0jS/SdbeIi/y\nFoZ+Kayjc0wGg0xJR0SCvUc31mBBo5BYu3YtZs6cqTWDUgqzZ8/G9ddfrzUHUW0RCRFoc4X/nLQj\nrx8JaY7Kgkocm+/c5kaABY1CpHPnznj22WdRVlbW+MlBsmHDBkRERGDAgAHaMhCZaXdTO79j+Yvz\nUZFbEbIMR+cehSqvOxo2Mi0Srcf79/HZFQsahUTHjh1xwQUXYOHChdoy9OnTB/PmzePqIGQ7KZkp\niDmj7pYy8AK5s3NDluHIK/5vhBnXZ8AT45wy4Zyk5Hi33norXnrpJW33T0xMxHnnnaft/kT1EY8g\n44YMv+NHXj0SkqXjir8sxsmNJ/2Ot7+lfdDvbSUWNAqZqVOn4ssvv8SuXbt0RyGynXY3+jc7nvr6\nFIrWFAX93kde9X87SxyQiMR+iUG/t5VY0ChkYmJicNNNN2HRokW6oxDZTvw58Wg1tJXf8UPPHwrq\nfb0lXtMBKO1/5qy3M4BLX1GIVVZWIioqSneMoOLSV9RSuXNysf267XWOSZRg8P7BiGkXU8+vCsyh\nlw7huxnf1b1njODiwxcjKtUezyqXviJb0lHM1q9fj/Ly8pDfl6i52lzRBlFt6z4jqlLh8L8OB+V+\nSikc/PtBv+MZ12TYppg1BwsauVp+fj4mTpyI/Px83VGIGuWJ8aD9bf5NfYdePARfhfX7pBUsL0DJ\nthK/4x1/2dHye4UCCxq52osvvogpU6agfXvn9QdQeOowo4PfJ3NFTgVy51g/hN/s7Sx5eDKSzk+y\n/F6hwIJGrlVRUYHnnnsO9913n+4oRE0We0as6d5jB548AOWzri+0+Kti5C/yb7no9KtOlt0j1FjQ\nSJvHH38c27Zta/zEFnrjjTfQp08f9OvXL2j3IAqGzr/r7HesZEcJjr9v3S4R+/53n9+x2K6xSJ9i\n/40868OCRtr4fD489dRTQbl2ZWUlHn/8cTz66KNBuT5RMLW6qBVSRqb4Hd87cy+UN/C3tOKvi3Hs\nHf91Gzv9uhMkwjYDdJuNBY20ueeee/Dhhx9ix44dll87IiIC//nPfzBs2DDLr00UCp0f9H9LO/XV\nKUuWw9rzyB6/Y9Hto00HpDgJCxppk5KSgt/+9rd45JFHLL+2x+PB8OHDLb8uUaikjklFqyH+E633\n/H5PQHulFawsQN4C/61pOj/QGRGxztgmpj4saKTV3XffjXXr1mH9+vW6oxDZioig25Pd/I6X7y/H\n/if2t+iayquw6z7/pef+f3vnH1rVecbxzze2tSbVlLgyG+OsaeZMdc4oSIf7ZVmpdGI73GBdy+z6\nhyAsU+l+gAYZo2IYY7NsbPtjG7iWtOAqmy211mmtG9rSTKNRE6cgMw50sFWzRJgmefbHPbrYe29y\n7z3v6f3h8wHx3JNzvu/Dved7n/u+533ec0d9+ffOwBOaU2Sqq6tpb29n9+7dxQ7FcUqOuz97d8an\nRZ/bco7B3sG89fp+0sfgsfTzGtsbmTCpvHtn4EtfOU5wfOkrJySDJwfp/FQnNnTzZzjl01NY8PYC\nqm7PrV8yeGKQzoWd2NWbdSYvnszCQwtRVclcsmn40lfOLUdHRwfbtm0rdhiOE5SaB2qY8b0Zafv7\nD/VzdkP65I5MDP1niJNPnExLZgianm8q6WSWD57QnIrg7NmzrFu3zp935lQkM9tmcuf9d6bt7/tx\nHxe2pa+UPxobNnqe6mGwO32osWF9A7UP1gaLs9h4QnPKnkuXLrF8+XLa2tpoaWkpdjiOE5wJkybQ\nvK0ZMtzm6n2mN+uyWCPXRuh9upd/7Uyf1Vg9p5pZz80KHWpRiZXQJH1F0nFJw5IWjnHcMkm9kv4m\n6ftx2iyU/fv3u26CuiG1T58+zebNm288qXcs3StXrrBy5UqWLl1Ka2trXu0k+V4UinvKdbNp1y6p\npXFL+qxHRqDnyR7OrD/D0OWhG7sHjg/Q9fkuLr6YnuyOTjxK80vNwSeCFNtTcXto3cCXgbezHSCp\nCvg58AgwF3hC0pyY7eZNuV3M5aYbUnvq1Kls376dNWvWcPXq1TF1V69ezfTp09m6dStSfvcBim2+\nLLinXDer9ozvzOCer96T8djzW89zsP4gRz53hM6WTjo/2Un/of7Mxz52PpEFiIvtqdvinGxmpwA0\n9jfJYuC0mf09OvZl4DEg/PIQTkVQV1fHgQMHWLVqFYsWLWL+/PmMjIxQVZX++6u9vZ36+vqMfytH\n3FPOWEii+YVmhgeG+feu9IWFR66McPnPl8fUaNraRM37NUmFWFQ+jG+B6UDfqNfno32Ok5UpU6aw\nY8cONm3axN69e5k3b17G4xoaGiommeWBe+oWpmpiFXNfmZtxRf4xmQCzfzWbhrXlu5r+eIxbhyZp\nD/DR0bsAAzaa2avRMW8Bz5rZ4QznrwQeMbPV0eungMVm9u0s7XnBjFP2jFUz455ynPzJpQ5t3CFH\nM3s4Zhz/AEavstkQ7cvWXmUURDhOFtxTjpMMIcdqspnmPaBJ0kxJdwBfA3YGbNdxKhX3lOPkQdxp\n+49L6gMeBF6TtCvaf6+k1wDMbBj4FvAmcAJ42cx64oXtOJWJe8pxCqfk1nJ0HMdxnEIo2elhkp6V\nNCKpLqDmDyUdlXRE0huSpgXS/ZGkHkldkl6RlP4Qo8J0cyqyzUMveDGupN9IuijpWAi9UboNkvZJ\nOiGpW1LGCQ8F6E6U9G50DXRLCvpIa0lVkg5LKrkhQPdUeXgq0g3uq6Q8FWkn5qu8PGVmJfeP1E3u\nN4CzQF1A3btGbbcCvwyk+0WgKtpuB7YE0v0E8HFgH7AwplYVcAaYCdwOdAFzAsT4GWABcCzwNTAN\nWHD9cwNOhYg30quO/p8AvENqhmCouNcDLwI7Q74fAeJyT1l5eCrSDu6rJD0VaSbiq3w8Vao9tJ8C\n3w0tamYDo17WACOBdP9kZte13iH15RFC95SZnSb75IB8uFGMa2bXgOvFuLEws78A78fVyaB7wcy6\nou0BoIdAtVZmdiXanEhqpm+QcXdJDcCjwK9D6AXGPUV5eAqS8VWSnoo0g/sqX0+VXEKTtALoM7Pu\nhPSfk3QO+DqwKYEmngF2JaAbl7ItxpV0H6lfq0Eeax0NYRwBLgB7zOy9ELr8P2mU1I1p91RiuKdu\n1kzCV3l5KtbSV4UyRmFpG7ABePgDfwuhvdHMXjWzNqAtGu9uBX4QQjc6ZiNwzcw6QsWbq06lIuku\n4PfA2g/0Bgom+uXfEt2X+YOkB8zsZMw4vwRcNLMuSV8gTA8gn/bdU3no3sok4SkI76tCPFWUhGZZ\nCkslzQPuA45KEqlhhr9KWmxm/4yjnYEO4HVyNN94upKeJtU1fijH9nPSDUhexbilgKTbSBnvBTP7\nY2h9M+tXakWOZUCshAYsAVZIehSYBEyW9Dsz+0bcOHPBPZW7bkDcUxkI6Ku8PVVSQ45mdtzMpplZ\no5nNItWFb8nVeOMhqWnUy8dJjSGH0F1Gqlu8wsz+G0IzUzMxz0+yGFck0yP5LXDSzJ4PJSjpI5Jq\no+1JpHousRf1NbMNZvYxM2sk9d7u+7CS2ThxuafGaCbm+UkXuCfhq+CegmR8VYinSiqhZcAI+4G2\nSzomqYvULKq1gXR/RmrW0J5oeukvQogqS5FtIVhCxbiSOoCDwGxJ5yR9M65mpLsEeBJ4KJoKfDj6\nkovLvcBb0TXwLrDbzF4PoFsuuKdK3FNRnMF9laCnoER85YXVjuM4TkVQ6j00x3Ecx8kJT2iO4zhO\nReAJzXEcx6kIPKE5juM4FYEnNMdxHKci8ITmOI7jVASe0BzHcZyK4H9JFV6qTniN3gAAAABJRU5E\nrkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1174932d0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Create 4 subplots and plot cosines with different colours, linestyels and linewidths.\n",
    "X = np.linspace(-np.pi, np.pi, 256,endpoint=True) # Evenly spaced numbers over the specified interval\n",
    "C1, C2, C3, C4 = np.cos(X), np.cos(X+0.5), np.cos(X+1.), np.cos(X+1.5)\n",
    "\n",
    "f, ax = plt.subplots(figsize=(7,7))\n",
    "plt.subplot(2,2,1)\n",
    "plt.plot(X, C1)\n",
    "plt.title('C1')\n",
    "plt.xticks([]) # Removes xticks\n",
    "plt.subplot(2,2,2)\n",
    "plt.plot(X, C2, color='green',  linestyle='-.')\n",
    "plt.title('C2')\n",
    "plt.yticks([]) # Removes yticks\n",
    "plt.subplot(2,2,3)\n",
    "plt.plot(X, C3, color='k', linestyle='--')\n",
    "plt.title('C3')\n",
    "plt.subplot(2,2,4)\n",
    "plt.plot(X, C4, color='m', linewidth = 5.)\n",
    "plt.title('C4')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 103,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAZYAAAEZCAYAAAC0HgObAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzt3XuYXWV59/Hvj6Qc5JDEA0TAJAoYB6oE2iClVCIo4aAk\ntm8VsELQV6kaURQFqS1afVUoUMTUAooGaC0obSG0ESKHiByEIAQiTCAcwpBAAmgwGNEkzP3+sdaM\nO3v2ntkze6+ZvZ75fa5rX5m11rPWfu7sw73X/ayDIgIzM7NW2WqkO2BmZmlxYjEzs5ZyYjEzs5Zy\nYjEzs5ZyYjEzs5ZyYjEzs5ZyYrHkSfqFpLeNdD9GkqT3SOqStF7SviPdH0ubE4uVmqQnJB1aNe9E\nST/tmY6IP46IWwfYzmRJ3ZJS/Uz8E/CxiNgpIu6vXpjH/oaK6b0lXSvpBUm/lnSjpLcOa4+ttFL9\nEJkN9sxf5euogL4gaUwR2x2EycBD/Szv/f+StAdwG3A/MAXYFbgW+LGkPy2wj5YIJxZLXuVejaTp\nkpbkv8KfkXRu3uwn+b8v5OWityrzBUkrJa2RNF/SThXbPSFf9lzervJ5zpL0Q0lXSHoBODF/7jsk\nrZO0WtI3JY2t2F63pI9KeiTv3z9KeoOk2/M9hysr21fFWKuvO0raWtKLZJ/1ByStqPffVPH3F4E7\nIuIfIuKFiNgQEd8E/g04e9AvgI06TiyWov72Or4BXBAR44A9gB/k83vGYHbKy0V3AScBJwCHAG8A\ndgTmQVYqAv4FOA54LTCO7Jd9pWOAH0TEeODfgc3Ap4BXAn8GHAp8rGqdw4H9gAOBzwEXA8cDrwPe\nnD9fLbX6+i8RsTEidsz/T94cEXv183/T4x3AD2vM/wHwF5K2bmAbNoo5sVgKrpH0q54H2Rd+PRuB\nPSW9KiJ+GxF3Vy2vTErHA+dHxJMR8Vvg88D78nGYvwIWRMSdEbEZ+Icaz3VnRFwHEBG/j4j7IuLu\nyHQBl5Algkpn53sIncAvgEX5878I/Igs6dRSq6/HVo0ZNVrmezXwTI35zwBjyBKjWV1OLJaCWRHx\nyp4HffcCKn0ImAosl3SXpKP7absr8GTF9JPAWGCXfNlTPQsi4iXgl1XrP1U5IWkvSdflJbgXgP9H\n9iVe6dmKv18C1lZN7zCEvg7W82R7YdVeSzYWUx2n2RacWCwFDQ+4R8RjEXF8RLwGOAe4WtJ21B7s\nf5ps0LvHZLJy1lqyX++793Yg28arqp+uavpfgU5gj7w89neD6fsAavV1E1smpkbdCPx1jfnvA34W\nEZuGsE0bRZxYbFSR9H5JPXsJvyb78u8Gnsv/3aOi+X8Ap0qaImkHsj2MKyOiG7gaeLekAyX9EdmA\n90B2BNZHxG8lvQn4aEuCGrivg/Ul4CBJX5Y0QdIOkj4BnAj8fQv7bIlyYrGya+Sw4so2RwAPSloP\n/DPwvnz84yWyL+Pb87GaA4DvAlcAtwKPAb8FTgGIiIeATwBXke0trCcrY/2+n36cBrw/f+6LgSsH\niGUwh0zX7WuD2+pdHhGPAgcD04CVwAtkyWZ2RNwyiD7ZKKWib/Ql6QjgArIkdmlE9DlcUdKFwJHA\nBmBORCyVtA3Zh2Rrslrx1RHxpbz9BLIP9GSyN/57I+LXhQZi1g9J25N9Ae8ZEU8O1L5MJO0K/Aw4\nKyK+N9L9sfZX6B5LfkTKPGAmsA9wXF4CqGxzJFnNeS/gZOAiyI6iAd4eEfuR/XI6Mv8VCXAGcGNE\nTAVuJjsCxmxYSXqXpO3ypHIe8EBqSQUgIp4m++H3WkmvGOn+WPsruhR2ALAiPwRyE9mu/6yqNrOA\nywHycwfGSdoln/5t3mYbsr2WqFjnsvzvy4DZhUVgVt8ssjLYKrKxmWNHtjvFiYgHI+KrFZ9Js7qK\nTiy7seUhl6vyef21Wd3TRtJWku4D1gA/jogleZudI2ItQESsAXYuoO9m/YqID0fEhPzxzoiod1a7\n2ajS1oP3EdGdl8J2B96an+1cs+kwdsvMzPpR87pDLbQamFQxvXs+r7rN6/prExHrJd1CdkTPQ8Ba\nSbtExFpJE9nypLJekpxwzMyGICKGfI5V0XssS8gunzE5v77QscCCqjYLyK5xhKQDgRfyhPFqSePy\n+dsB7wSWV6wzJ//7RLIrr9YUEck+zjrrrBHvg+NzbI4vvUezCt1jiYiXJc0FFvGHw407JZ2cLY5L\nImKhpKMkPUp2uPFJ+eqvBS7LjyzbCrgqIhbmy84GfiDpg2SXrnhvkXG0q5UrV450FwqVcnwpxwaO\nb7QruhRGRFxPdm2mynkXV03PrbHeMmD/Otv8FdkVWM3MrM209eC99W/OnDkj3YVCpRxfyrGB4xvt\nCj/zfiRJipTjMzMrgiSijQfvrUCLFy8e6S4UKuX4Uo4NHN9o58RiZmYt5VKYmZltwaUwMzNrK04s\nJZZ6nTfl+FKODRzfaOfEYmZmLeUxFjMz24LHWMzMrK04sZRY6nXelONLOTZwfKOdE4uZmbWUx1jM\nzGwLHmMxM7O24sRSYqnXeVOOL+XYwPGNdk4sZmbWUh5jMTOzLXiMxczM2ooTS4mlXudNIb6Zs2fS\nMb2jz2PS1EnMnD1zpLtXmBReu/6kHl+zCr/nvdlo1rW6i4lzJ/aZv65zHV03dY1Aj8yK5zEWswJ1\nTO+omVgA1sxbQ+eSzmHukdnAPMZiZmZtxYmlxFKv86Yc37rOdSPdhUKl/NpB+vE1y2MsZi0wc/ZM\nulb3HTPpWtXFRGqXwsxS5TEWsxaoN5Zyx2l3cNC5B9Vcx2Ms1q48xmJmZm3FiaXEWlnnjQg+/elP\nbzHvy1/+MgsWLOCrX/1qv/OK0hNfrb4tW7YMgMcee4zf//73hfel1TzGUm6px9csJxZj3bp1XHDB\nBdx6662982666SYAjjnmGDZt2sRPf/rTPvNuu+22EekbwIwZM9h111255ppr2GabbQrvh5k1rvDE\nIukIScslPSLp9DptLpS0QtJSSdPyebtLulnSg5KWSTqlov1ZklZJujd/HFF0HO1oxowZLdnOhAkT\nOPXUU9lpp516591+++3st99+AOy3337cfPPNNecVacaMGTX7BvDNb36Tp59+ms985jOF9qEoEzom\njHQXCtWq92a7Sj2+ZhV6VJikrYB5wGHA08ASSddGxPKKNkcCe0TEXpLeClwEHAhsBj4dEUsl7QD8\nXNKiinXPj4jzi+x/WfzoRz9i3bp1HH/88XzhC1/gYx/7GLvuuuugt1N5oMOzzz7L9ttvD8AOO+zA\nmjVrGDt2bJ95A/nf//1fLrroIpYsWcLee+/Ne9/7Xv72b/920H2rds899zB+/Hg6OztLm1zqqXeE\nGcCk3SZxwzU3DHOPzAan6MONDwBWRMSTAJKuBGYByyvazAIuB4iIuySNk7RLRKwB1uTzfyOpE9it\nYt0hH7GQisWLFzNjxgxuuukmPvzhDwOwdOnS3qTy0EMP8eMf/xip73/ViSeeyLhx4+puu7u7mzFj\nxgDw8ssvM2bMmJrz+vPUU09x3XXXcd1113HttdfS3d3Ne97znt7lA/Xvvvvuq/vL8LzzzkMSTzzx\nBIsWLeLwww/vty+t0qrDivsbY6l3GRiArnnluAxMz3szVanH16yiE8tuwFMV06vIkk1/bVbn89b2\nzJA0BZgG3FXRbq6kDwD3AJ+JiF+3rNcl8+CDDzJ16lQ2btzItttu2zt/7733Zu+99254O5Vf8Lvs\nsgsbNmwAYP369ey8884AW8x7zWte0+/2LrvsMk45Jatg/vKXv+T1r3/9FssH278e8+fP5+WXX+ZD\nH/oQ2223HQ888MCwJZZ6X/qPn/b4sDy/WRm0/QmSeRnsauCTEfGbfPa3gH+MiJD0FeB84EMj1ceR\nMmPGDF566SVefPFFAO666y723Xdfbr31Vt72trf17hFUk8QJJ5zA+PHjt5hfWQo7+OCDueeeezjy\nyCO5++67Oeywwxg7dixLlizZYh7Ak08+yeTJk/s8zwsvvNA7/8477+QDH/jAFssH6l/lL8LKvr36\n1a/mgAOy3ycrV64s5S/HCR0TuPt7d9MxvaPPshROqizjazIYqcfXrKITy2pgUsX07vm86javq9VG\n0liypHJFRFzb0yAinqto/23gunodmDNnDlOmTAFg/PjxTJs2rfdN0XPIYJmnly5dyvr161m4cCG3\n3347K1eu7P31/uyzz7LvvvsOuL3p06fz7W9/mwceeIC5c+dyzjnncOihh3LJJZfwpS99CUkcfvjh\n3HLLLdx7771cffXVSGLrrbfm6quv5swzz+SRRx7ps/23vOUtfPGLX2Tq1Kmccsop3H777Vssb6R/\nL730Eg8//DDLly9n7ty5vOtd7+Loo4/uHbzftGkThx566LD9f29Yn+2xwR/KWT0D8bWmuzd2122/\n8Xcb2eawbfqsv/nSzXW3V/n87fD+83Qa04sXL2b+/PkAvd+XzSj0zHtJY4CHyQbvnwHuBo6LiM6K\nNkcBH4+IoyUdCFwQEQfmyy4Hno+IT1dtd2I+BoOkU4HpEXF8jedP+sz7xYsXc/vtt3PwwQdzyCGH\njGg/ivgFV9R2mzHYM+zrzV/XuY7OSzsHtQ6U52z9dnztWin1+Jo9877QPZaIeFnSXGAR2aHNl0ZE\np6STs8VxSUQslHSUpEeBDcAcAEl/DrwfWCbpPiCAMyPieuCc/LDkbmAlcHKRcbSzxx57jM9+9rMj\n2oeecRcrXldXV83ymY8Ws3ZS+BhLngimVs27uGp6bo31bgdqHnYUESe0so9lNWPGjLb41fSOd7yj\nkO22Q2xFGep5LJu7N9fcY2q3o8VSfu0g/fia5TPvrWk+893MKjmxlFjP4FuqRiq+evep75jeQdeq\n1uwZ+Fph5ZZ6fM1q+8ONzYZbfyco+nwVs4F5j6XEUq/zphyfrxVWbqnH1ywnFjMzayknlhJLvc6b\ncnweYym31ONrlhOLmZm1lBNLiaVe5005Po+xlFvq8TXLicXMzFrKiaXEUq/zphyfx1jKLfX4muXE\nYmZmLeXEUmKp13lTjs9jLOWWenzNcmIxM7OWcmIpsdTrvCnH5zGWcks9vmY5sZiZWUs5sZRY6nXe\nlOPzGEu5pR5fs5xYzMyspZxYSiz1Om/K8XmMpdxSj69ZTixmZtZSTiwllnqdN+X4PMZSbqnH1yzf\nQdIsAV1dXXRM7+gzf9Juk7jhmhtGoEc2mnmPpcRSr/OmHF+rx1g2d29m4tyJfR5dq7ta+jyNSvm1\ng/Tja5YTi5mZtZQTS4mlXudNOT6PsZRb6vE1y4nFzMxayomlxFKv8xYd38zZM+mY3tHn0bWq+HEJ\nn8dSbqnH1ywfFWajVtfqLibOndhn/uOnPT4CvTFLhxNLiaVe5005vuEaY6l3GDIUeyhyyq8dpB9f\ns5xYzBLWcxhyLV3zRuZQZEtf4WMsko6QtFzSI5JOr9PmQkkrJC2VNC2ft7ukmyU9KGmZpFMq2k+Q\ntEjSw5JukDSu6DjaUep13pTj8xhLuaUeX7MKTSyStgLmATOBfYDjJL2pqs2RwB4RsRdwMnBRvmgz\n8OmI2Af4M+DjFeueAdwYEVOBm4HPFxmHmZk1rug9lgOAFRHxZERsAq4EZlW1mQVcDhARdwHjJO0S\nEWsiYmk+/zdAJ7BbxTqX5X9fBswuNoz2lHqdN+X4fB5LuaUeX7OKTiy7AU9VTK/iD8mhXpvV1W0k\nTQGmAT/LZ+0cEWsBImINsHPLemxmZk1p+8F7STsAVwOfjIgNdZpFvfXnzJnDlClTABg/fjzTpk3r\n/bXRUyct6/QFF1yQVDzDHd+G9RtY17mud++hetyjZ7pyeffG7n6XN9q+Z9lIPX9P/IsXLy7k/7dy\nDKJd3k+Or/945s+fD9D7fdkMRdT9Tm5+49KBwBcj4oh8+gwgIuLsijYXAbdExFX59HLgkIhYK2ks\n8D/AjyLiGxXrdAIz8jYT8/X7HFMpKYqMb6RVfimkqOj4OqZ31Dxi6o7T7uCgcw+quU69ZYOdv65z\nHZ2Xdg5qnVY+P8CaeWvoXNJZc1mz/N4sN0lEhIa6ftGlsCXAnpImS9oaOBZYUNVmAXAC9CaiF3rK\nXMB3gYcqk0rFOnPyv08Eri2g720v5Tc2pB2fx1jKLfX4mlVoKSwiXpY0F1hElsQujYhOSSdni+OS\niFgo6ShJjwIbyBOGpD8H3g8sk3QfWbnrzIi4Hjgb+IGkDwJPAu8tMg4zM2tc4WMseSKYWjXv4qrp\nuTXWux0YU2ebvwLe0cJullLqu+MpxzcazmNJ9bWD9ONrli9CaWZmLeXEUmKp/2JKOT6PsZRb6vE1\ny4nFzMxayomlxCqPpU9RyvGNhjGWlKUeX7Pa/gRJs2bNnD2TrtV9r+TbtaqLidS+8q+ZDZ0TS4ml\nXudtVXzteEMvj7GUW+rxNcuJxWyUqncTsCJvAGajg8dYSiz1Om/K8bXDGEvPTcCqH7XKhoOV8msH\n6cfXrIYSi6T/knR0fn8VMzOzuhpNFN8CjgdWSPq6pKkDrWDFS73Om3J8HmMpt9Tja1ZDiSUiboyI\n9wP7AyuBGyXdIekkSX9UZAfNzKxcGi5tSXoV2QUi/y9wH/ANskTz40J6ZgNKvc6bcnztMMZSpJRf\nO0g/vmY1dFSYpP8mu5DkFcC7I+KZfNFVku4pqnNmZlY+jR5u/O2IWFg5Q9I2EfH7iPjTAvplDUi9\nzjuY+OqdBAnteSKkx1jKLfX4mtVoYvkKsLBq3p1kpTCzEVfvJEgY2RMhzUajfsdYJE2U9CfAdpL2\nk7R//pgBvGJYemh1pV7nTTk+j7GUW+rxNWugPZaZZAP2uwPnV8x/ETizoD6ZmVmJ9ZtYIuIy4DJJ\nfxUR/zlMfbIGpV7nTTk+j7GUW+rxNavfxCLpbyLi34Apkj5dvTwizq+xmpmZjWIDnceyff7vDsCO\nNR42glKv86Ycn8dYyi31+Jo1UCns4vzfLw1Pd8zMrOwGKoVd2N/yiDiltd2xwUi9zptyfB5jKbfU\n42vWQEeF/XxYemFmZsnod4wlIi7r7zFcnbTaUq/zphyfx1jKLfX4mjVQKeyCiPiUpOuAqF4eEccU\n1jMzMyulgUphV+T/nlt0R2zwUq/zphyfx1jKLfX4mjXQUWE/z//9iaStgTeR7bk8HBEbh6F/ZmZW\nMo3emvho4DHgQmAe8KikI4vsmA0s9TpvyvF5jKXcUo+vWY3e6Os84O0RMSMiDgHeDvxzIytKOkLS\nckmPSDq9TpsLJa2QtFTSfhXzL5W0VtIDVe3PkrRK0r3544gG4zAzs4I1mlhejIhHK6YfJ7sQZb8k\nbUW2hzMT2Ac4TtKbqtocCewREXsBJwP/WrH4e/m6tZwfEfvnj+sbjCMpqdd5U47PYyzllnp8zRro\nqLC/zP+8R9JC4AdkYyx/DSxpYPsHACsi4sl8e1cCs4DlFW1mAZcDRMRdksZJ2iUi1kbEbZIm1+te\nA89vZmbDbKA9lnfnj22BtcAhwAzgOWC7Bra/G/BUxfSqfF5/bVbXaFPL3Lx09h1J4xpon5zU67wp\nx+cxlnJLPb5mDXRU2EnD1ZFB+hbwjxERkr5Cdq+YD9VqOGfOHKZMmQLA+PHjmTZtWu9ubM+bo6zT\nS5cubav+jHR8PV/WPWWm6i/v6uXdG7tZ17mu4fbrOtfRvbG73+WDad/uzz/Sr7+nh2968eLFzJ8/\nH6D3+7IZiuhz3mPfRtK2ZF/c+5DtvQAQER8cYL0DgS9GxBH59BnZanF2RZuLgFsi4qp8ejlwSESs\nzacnA9dFxFvqPEfd5ZKikfis/Dqmd9S9NfEdp93BQece1PT8kd7WcD3/mnlr6FzSWXMdGx0kERFD\nHm5odPD+CmAi2UD6T8juKDng4D3ZOMyekibn58EcCyyoarMAOAF6E9ELPUklJ6rGUyRVfoP8JfCL\nBuMwM7OCNZpY9oyIvwc25NcIOxp460ArRcTLwFxgEfAgcGVEdEo6WdJH8jYLgSckPQpcDHysZ31J\n3wfuAN4oqUtST2nuHEkPSFpKNu5zaoNxJCX1Om/K8XmMpdxSj69ZA13Spcem/N8XJP0xsAbYuZEV\n80OBp1bNu7hqem6ddY+vM/+ERp7bzAavq6uLjukdfeZP2m0SN1xzwwj0yMqm0cRyiaQJwN+Tla52\nyP+2EZT6sfQpx9fO57Fs7t5cc7yqa15Xw9tI+bWD9ONrVkOJJSK+k//5E+ANxXXHzNpVvT0Z8N6M\nbanRa4W9StI388un/FzSBZJeVXTnrH+p13lTjq+MYyw9ezK1Hl2rt9ybSfm1g/Tja1ajg/dXAs8C\nfwX8H+B54KqiOmVmZuXV6BjLayPiyxXTX5H0viI6ZI1Lvc6bcnztPMbSCim/dpB+fM1qNLEsknQs\n2bXCINtrcUHVht3M2TP7lF0AulZ1MZHaJ0ia2fDqtxQm6UVJ64EPA98HNuaPK4GPFN8960/qdd5a\n8XWt7qpZ49+8efPwd7AJZRxjGYzR+N60PxjoWmE7DldHzMwsDY2WwpB0DPC2fHJxRPxPMV2yRqVe\n5005Po+xlFvq8TWr0cONvw58Engof3xS0teK7JiZmZVTo4cbHwW8MyK+GxHfBY4gu16YjaDU67wp\nx+cxlnJLPb5mNZpYAMZX/D0qb6xlZmYDa3SM5WvAfZJuIbuE/duAMwrrlTUk9TpvyvF5jKXcUo+v\nWQMmFkkCbgMOBKbns0+PiDVFdszMysNXRLZKA5bC8lswLoyIZyJiQf5wUmkDqdd5U44vtTGW6uuI\nbXPYNjWvIZaKlN+brdDoGMu9kqYP3MzMzEa7RsdY3gr8jaSVwAaycZaodx96Gx6p13lTji/1MZbU\n40v5vdkKjSaWmYX2wszMkjHQtcK2lfQp4LNk566sjognex7D0kOrK/U6b8rxpTbGUi31+FJ+b7bC\nQGMslwF/CiwDjgTOK7xHZmZWagOVwvaOiDcDSLoUuLv4LlmjUq/zphxf6mMQqceX8nuzFQbaY9nU\n80dElOu65GZmNiIGSiz7SlqfP14E3tLzd36fFhtBqdd5U44v9TGI1ONL+b3ZCgPdj2XMcHXEzMzS\nMJiLUFqbSb3Om3J8qY9BpB5fyu/NVnBiMTOzlnJiKbGU67wzZ89k0tRJdEzv2OLRtSqNa0+lPgaR\nenwpf/ZaoeFbE5sNp67VXbzyPa/sU1J5/LTHR6hHZtaowvdYJB0habmkRySdXqfNhZJWSFoqab+K\n+ZdKWivpgar2EyQtkvSwpBskjcobj6Ve5025Tp9ybJB+fKl/9ppVaGKRtBUwj+xaY/sAx0l6U1Wb\nI4E9ImIv4GTgXysWf4/a1yk7A7gxIqYCNwOfL6D7ZmY2BEXvsRwArMivLbYJuBKYVdVmFnA5QETc\nBYyTtEs+fRtQq1g7i+xyM+T/zi6g720v9TpvynX6lGOD9ONL/bPXrKITy27AUxXTq/J5/bVZXaNN\ntZ0jYi1AftOxnZvsp5mZtUgqg/dRb8GcOXOYMmUKAOPHj2fatGm99dGeXx1lne6Z1y79Gez09IOn\ns/a5tWy/0/YAbFi/AYDtd9qerlVd7MVerOtc11uvX9e5ju6N3b2x9/wqrlxea7pe++6N3X2231/7\noTx/vfYTOiaM6PMPJf567WtNT+iYwLrOdTzx6BO9tyyufH0n7TaJz38qq2C3y/txMNMzZsxoq/40\nO7148WLmz58P0Pt92Qxldx4uhqQDgS9GxBH59BlkNwg7u6LNRcAtEXFVPr0cOKRnj0TSZOC6ypuK\nSeoEZkTEWkkT8/X73HBbUhQZnzWnY3oHE+dOrLnsjtPu4KBzD2p6fkrbGunnb+W21sxbQ+eSzprb\nspEniYjQUNcvuhS2BNhT0mRJWwPHAguq2iwAToDeRPRCT1LJKX9UrzMn//tE4NoW97sUUq/zplyn\nTzk2SD++1D97zSo0sUTEy8BcYBHwIHBlRHRKOlnSR/I2C4EnJD0KXAx8rGd9Sd8H7gDeKKlL0kn5\norOBd0p6GDgM+HqRcZiZWeMKH2OJiOuBqVXzLq6anltn3ePrzP8V8I5W9bGsUj+WPuVzIVKODdKP\nL/XPXrN8SRczM2spJ5YSS73Om3KdPuXYIP34Uv/sNcuJxczMWsqJpcRSr/OmXKdPOTZIP77UP3vN\ncmIxM7OWSuXM+1Gp8qz7djZz9ky6Vve9j0rXqi4mUvsESWCLs7xTk/oYRMqvHZTnszdSnFiscF2r\nu2qeYe97q5ilyaWwEkv9F1PKv3hTjg3Sjy/1z16znFjMzKylnFhKLPVj6VMeh0g5Nkg/vtQ/e81y\nYjEzs5ZyYimx1Ou8KdfpU44N0o8v9c9es5xYzMyspZxYSiz1Om/KdfqUY4P040v9s9csJxYzM2sp\nJ5YSS73Om3KdPuXYIP34Uv/sNcuJxczMWsqJpcRSr/OmXKdPOTZIP77UP3vNcmIxM7OW8kUoSyz1\nOm/KdfqUY4OB4+vq6qJjekfNZZN2m8QN19xQRLdaJvXPXrOcWMxs2G3u3lzzitcAXfP63mLBysWl\nsBJLvc6bcp0+5dgg/fhS/+w1y4nFzMxayqWwEku9zpvyOETKsUFz8dUbf2mnsZfUP3vNcmIxs7ZS\nb/zFYy/l4VJYiaVe5025Tp9ybJB+fKl/9prlPRZrmZmzZ9K1uu+vyq5VXUyk9hFAZpYeJ5YSa7c6\nb9fqrpoljMdPe3xI20t5HCLl2CD9+Nrts9duCi+FSTpC0nJJj0g6vU6bCyWtkLRU0rSB1pV0lqRV\nku7NH0cUHYeZmTWm0MQiaStgHjAT2Ac4TtKbqtocCewREXsBJwMXNbju+RGxf/64vsg42lXqdd6U\n6/Qpxwbpx5f6Z69ZRe+xHACsiIgnI2ITcCUwq6rNLOBygIi4CxgnaZcG1lXBfTczsyEoOrHsBjxV\nMb0qn9dIm4HWnZuXzr4jaVzrulweqdd5U67TpxwbpB9f6p+9ZrXj4caN7Il8C3hDREwD1gDnF9sl\nMzNrVNFHha0GJlVM757Pq27zuhpttq63bkQ8VzH/28B19TowZ84cpkyZAsD48eOZNm1a76+Nnjpp\nWacvuOAz72RJAAALSElEQVSCtopnw/oNrOtc1/trtbrO3jPds7x7Y3fN9j3TT93wFDtM2mGL5d0b\nu+tur970YJ+/v+0P9vnrte9ZNlLPP5T4B3q9quPrWWcw/e3v+Tes38DixYvb4v1eOcbSDv1pRTzz\n588H6P2+bIYioumN1N24NAZ4GDgMeAa4GzguIjor2hwFfDwijpZ0IHBBRBzY37qSJkbEmnz9U4Hp\nEXF8jeePIuMbaZUfsnbQMb2j5uHGd5x2Bwede1DD83uWdXyoo09JZajbGsw6w7GtdZ3r6Ly0M4lY\nai3rSUCt7NeaeWvoXNJZY43h126fvVaTREQMeRy70D2WiHhZ0lxgEVnZ7dI8MZycLY5LImKhpKMk\nPQpsAE7qb9180+fkhyV3AyvJjiYbdVJ+Y0PadfqUY4P040v9s9eswk+QzA8Fnlo17+Kq6bmNrpvP\nP6GVfTQzs9Zpx8F7a1Dqx9KnfC5EyrFBMfH1XPW4+jFz9syWP9dAUv/sNcuXdDGzUvBVj8vDeywl\nlnqdN+U6fcqxQfrxpf7Za5YTi5mZtZQTS4mlXudNeRwi5dgg/fhS/+w1y4nFzMxayoP3JVZknbfe\nTbuG877jKdfpU44N0o/PYyz9c2KxmurdtOu2z91Gx/SO2uv4TpFmhhNLqY3EZSXqHfIJQ79TZD2V\n16VKTepjECm/dpD+JV2a5TEWMzNrKSeWEkv9F1PKv3hTjg3Sjy/1z16znFjMzKylPMZSYqnXeVOu\n03uMpXV6riFWS1FHMab+2WuWE4uZlVp/B5T4OmIjw6WwEkv9F1OqeyuQdmyQfnypf/aa5T0WM0tW\nvTLZcJ7oOxo5sZRY6nVej7GUV7u8dkVdaj/1z16zXAozM7OWcmIpsdR/MbXDL96ipBwbpB9f6p+9\nZrkUNgrUu6AkwHPPPsdrdn5Nn/m+7peZDZUTS4k1Wuetd0FJyK7v9ea5b645f6S1S52+CB5jKTeP\nsfTPicXMRh0fLVYsJ5YSq/7FVK/kVdayVsq/eFOODdo/vmaPFvPeSv+cWBJSr+TVDmUtMxs9fFRY\niaV+3+2UxyFSjg3Sjy/1z16zvMdiZpbr74KWlUdQbli/ge132h7wuEwtTiwllNpYSj3tXqdvRsqx\nQXnjG+gOqbWOoPSFLvtyYikhj6WYWTsrfIxF0hGSlkt6RNLpddpcKGmFpKWSpg20rqQJkhZJeljS\nDZLGFR3HcJs5eyYd0ztqPrpWZb+QUq9jpxxfyrGB4xvtCk0skrYC5gEzgX2A4yS9qarNkcAeEbEX\ncDJwUQPrngHcGBFTgZuBzxcZx0jo2Sup9di8eTMAv+n6zQj3slgpx5dybOD4RruiS2EHACsi4kkA\nSVcCs4DlFW1mAZcDRMRdksZJ2gV4fT/rzgIOyde/DFhMlmxKp5nxks2/3VxUt9pCyvGlHBuMrvh8\nsmVfRSeW3YCnKqZXkSWbgdrsNsC6u0TEWoCIWCNp56F2cNOmTTXnb7XVVowZM2aom+2jvwRywNer\n/0s8XmJWFvUG/G/73G0NHWHWyPyyJal2HLzXENaJoTzR/fffzwc/+kG6o7vPsm3HbsudP72z5nr1\nkkS9NwUUk0B+9/zvhrxuGaQcX8qxgeODoR1hVm9+f0mqXtKp9z01LEkqIgp7AAcC11dMnwGcXtXm\nIuB9FdPLgV36WxfoJNtrAZgIdNZ5/vDDDz/88GPwj2a++4veY1kC7ClpMvAMcCxwXFWbBcDHgask\nHQi8EBFrJT3fz7oLgDnA2cCJwLW1njwihrL3Y2ZmTSg0sUTEy5LmAovIjkC7NCI6JZ2cLY5LImKh\npKMkPQpsAE7qb91802cDP5D0QeBJ4L1FxmFmZo1TXjIyMzNriaQuQilpK0n3SlqQTydzImV+GPYP\nJXVKelDSWxOL71RJv5D0gKR/l7R1meOTdKmktZIeqJhXNx5Jn89PEu6UdPjI9LpxdeI7J+//Ukn/\nKWmnimWlj69i2WckdUt6ZcW80sRXLzZJn8j7v0zS1yvmDzq2pBIL8EngoYrplE6k/AawMCI6gH3J\nDnJIIj5JuwKfAPaPiLeQlWiPo9zxfY/s5N5KNeORtDdZObcDOBL4lqR2Hx+sFd8iYJ+ImAasIL34\nkLQ78E6yEnzPvA7KFV+f2CTNAN4NvDki3gycm88fUmzJJJb8BT8K+E7F7FlkJ1CS/zt7uPvVCvkv\nv7+IiO8BRMTmiPg1icSXGwNsL2kssB2wmhLHFxG3AdXX/agXzzHAlfnrupLsS7nvseltpFZ8EXFj\nRO+x+z8Dds//TiK+3D8Dn62aN4sSxVcnto8CX4+IzXmb5/P5Q4otmcTCH17wykGjLU6kBIZ8IuUI\nez3wvKTv5aW+SyS9gkTii4ingfOALrKE8uuIuJFE4quwc514qk8GXp3PK7MPAgvzv5OIT9IxwFMR\nsaxqUQrxvRF4m6SfSbpF0p/k84cUWxKJRdLRwNqIWEr/J1iW9UiFscD+wL9ExP5kR8+dQd94Shmf\npPFkv4wmA7uS7bm8n0Ti60dq8QAg6e+ATRHxHyPdl1aRtB1wJnDWSPelIGOBCRFxIPA54IfNbCyJ\nxAL8OXCMpMeB/wAOlXQFsCa/7hiSJgLPjmAfm7GK7JfSPfn0f5IlmrWJxPcO4PGI+FVEvAz8N3AQ\n6cTXo148q4HXVbTbPZ9XOpLmkJWkj6+YnUJ8ewBTgPslPUEWw7355aRWA5Mq2pYxvqeA/wKIiCXA\ny5JexRBjSyKxRMSZETEpIt5AdiLlzRHxAeA6shMpoZ8TKdtdXj55StIb81mHAQ/yhxNFocTxkZXA\nDpS0bT4weBjZQRhlj09suQddL54FwLH5kXCvB/YE7h6uTjZhi/gkHUFWjj4mIn5f0a708UXELyJi\nYkS8ISJeT/Zjb7+IeJYsvveVLL7q9+Y1wKEA+ffM1hHxS4YaW5GXdBmJB9lVjxfkf78SuBF4mOyI\nlfEj3b8m4tqX7EoGS8l+WYxLLL6zyC7V8wDZwPYflTk+4PvA08DvyRLnScCEevGQHUH1aP5/cPhI\n93+I8a0gO1rq3vzxrZTiq1r+OPDKMsZX57UbC1wBLAPuAQ5pJjafIGlmZi2VRCnMzMzahxOLmZm1\nlBOLmZm1lBOLmZm1lBOLmZm1lBOLmZm1lBOL2RBI+rv8Mv/359dvm17Ac5Tpas5mvXwei9kgKbuF\n9nlkJ5Ftzu/LsXVkF5Zs1XNsRXYxzh1btU2z4eI9FrPBey3wfPzhEuO/iog1kp6Q9FVJ90m6W9J+\nkq7Pb5J0MoCk7SXdKOmefG/nmHz+ZEnLJV0maRnZ7R+2y/eGrpD0Ckn/k2/7AUl/PWLRmw3Aeyxm\ngyRpe+A2svvG3ARcFRG35hcn/FpEXCLpfLJrLx0EvAL4RURMlDQG2C4ifpNf5O9nEbGXpMnAY8Cf\nRXYRQCStj4id8r//EpgZET0JaseIeHF4IzdrjPdYzAYpIjaQXV36I8BzwJWSTiS7DP51ebNlwF0R\n8dvIbpr0u/yGbQK+Jul+suuG7ZpfIRfgyZ6kUsMy4J2SvibpYCcVa2djR7oDZmUU2a7+rcCteenq\nxHxRz1V9uyv+7pkeC7wfeDXZlXG7872cbfM2G6qepvfqsxGxQtL+ZJek/4qkGyPiK62MyaxVvMdi\nNkiS3ihpz4pZ04CVA62W/zsOeDZPKm8nu7lZdZseG/PSGZJeC7wUEd8H/olsj8msLXmPxWzwdgC+\nKWkcsJnskuIfAd7Vzzo9g5n/DlyXl8LuIbsUeXWbHpcAyyT9nOyS5v8kqRvYSHaPcrO25MF7MzNr\nKZfCzMyspZxYzMyspZxYzMyspZxYzMyspZxYzMyspZxYzMyspZxYzMyspZxYzMyspf4//xZKxhu3\nxpwAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1174d1990>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# Plot a histogram and add some text\n",
    "mu, sigma = 100, 15\n",
    "x = mu + sigma * np.random.randn(10000) # Generate data from a normal distribution with mean mu and variance sigma\n",
    "\n",
    "# the histogram of the data\n",
    "n, bins, patches = plt.hist(x, 50, normed=1, facecolor='g', alpha=0.75)\n",
    "\n",
    "plt.xlabel('Smarts')\n",
    "plt.ylabel('Probability')\n",
    "plt.title('Histogram of IQ')\n",
    "plt.text(60, .025, r'$\\mu=100,\\ \\sigma=15$') # Adds some text by using TeX\n",
    "plt.axis([40, 160, 0, 0.03]) # Sets the axes limits\n",
    "plt.grid(True) # Enables grid\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Matplotlib exercises"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 23 ==========\n",
    "Initialise an empty figure of size (8,6). Create a scatter plot of the observations in the `credit` dataset for the attributes `Duration` and `Age` (age should be shown on the xaxis). Use black coloured markers. Label the axes accordingly by using red colour for the xaxis and green for the yaxis. Finally, add a title of your choice by using a font size of 20. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "# Your code goes here\n",
    "duration = credit['Duration'].values\n",
    "age = credit['Age'].values\n",
    "plt.figure(figsize=(8,6))\n",
    "plt.scatter(age, duration, color='k')\n",
    "plt.xlabel('Age', color = 'g')\n",
    "plt.ylabel('Duration', color = 'r')\n",
    "plt.title(\"This is a title\", size=20)\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### ========== Question 24 ==========\n",
    "You should note above that there is an outlier (i.e. an observation that is very distant to the other observations). Now you think that there must be something wrong with that observation (why?) and as a next step you should remove it from both the age and duration variables and a make a scatter plot of the new data."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "# Your code goes here\n",
    "neg_age_idx = np.argwhere(age<0)\n",
    "age = np.delete(age, neg_age_idx)\n",
    "duration=np.delete(duration, neg_age_idx)\n",
    "plt.figure(figsize=(8,6))\n",
    "plt.scatter(age, duration, color='k')\n",
    "plt.xlabel('Age', color = 'g')\n",
    "plt.ylabel('Duration', color = 'r')\n",
    "plt.title(\"This is a title\", size=20)\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Seaborn"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "[Seaborn](https://seaborn.github.io/) is a visualisation library built on top of matplotlib which offers some aesthetic enhancement and, more importantly, provides some high-level functions for  \"exploring and understanding data\". Seaborn is also tightly integrated with pandas and provides support for both numpy and pandas data structures.\n",
    "\n",
    "In the following example we will load seaborn and use its default settings to plot again the sine and cosine waves we saw earlier.\n",
    "\n",
    "Note that this example does not actually use any seaborn functions, but as soon as the library is loaded, the Seaborn plotting style is adopted by the matplotlib.pyplot library."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "import seaborn as sns # Load seaborn with default settings\n",
    "X = np.linspace(-np.pi, np.pi, 256,endpoint=True) # Evenly spaced numbers over the specified interval\n",
    "C, S = np.cos(X), np.sin(X) # Create a sine (S) and a cosine (C)\n",
    "plt.figure(figsize=(8,5))\n",
    "plt.plot(X,C, label='Cosine')\n",
    "plt.plot(X,S, label='Sine')\n",
    "plt.legend()\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Seaborn implemented functions [Optional]\n",
    "The Seaborn website has many great examples. Below we show a few taken directly from the website. These are just to give you a flavour of the kinds of things that Seaborn can do. You can use it as reference later; by no means should you learn this code by heart! You should definitely not worry if some of the following commands do not make sense just yet."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "sns.set(style=\"white\", palette=\"muted\", color_codes=True)\n",
    "rs = np.random.RandomState(10)\n",
    "\n",
    "# Set up the matplotlib figure\n",
    "f, axes = plt.subplots(2, 2, figsize=(7, 7), sharex=True)\n",
    "sns.despine(left=True)\n",
    "\n",
    "# Generate a random univariate dataset\n",
    "d = rs.normal(size=100)\n",
    "\n",
    "# Plot a simple histogram with binsize determined automatically\n",
    "sns.distplot(d, kde=False, color=\"b\", ax=axes[0, 0])\n",
    "\n",
    "# Plot a kernel density estimate and rug plot\n",
    "sns.distplot(d, hist=False, rug=True, color=\"r\", ax=axes[0, 1])\n",
    "\n",
    "# Plot a filled kernel density estimate\n",
    "sns.distplot(d, hist=False, color=\"g\", kde_kws={\"shade\": True}, ax=axes[1, 0])\n",
    "\n",
    "# Plot a historgram and kernel density estimate\n",
    "sns.distplot(d, color=\"m\", ax=axes[1, 1])\n",
    "\n",
    "plt.setp(axes, yticks=[])\n",
    "plt.tight_layout()\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "sns.set(style=\"white\")\n",
    "\n",
    "# Generate a random correlated bivariate dataset\n",
    "rs = np.random.RandomState(5)\n",
    "mean = [0, 0]\n",
    "cov = [(1, .5), (.5, 1)]\n",
    "x1, x2 = rs.multivariate_normal(mean, cov, 500).T\n",
    "x1 = pd.Series(x1, name=\"$X_1$\")\n",
    "x2 = pd.Series(x2, name=\"$X_2$\")\n",
    "\n",
    "# Show the joint distribution using kernel density estimation\n",
    "g = sns.jointplot(x1, x2, kind=\"kde\", size=7, space=0)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "sns.set(style=\"whitegrid\", palette=\"pastel\", color_codes=True)\n",
    "\n",
    "# Load the example tips dataset\n",
    "tips = sns.load_dataset(\"tips\")\n",
    "\n",
    "# Draw a nested violinplot and split the violins for easier comparison\n",
    "sns.violinplot(x=\"day\", y=\"total_bill\", hue=\"sex\", data=tips, split=True,\n",
    "               inner=\"quart\", palette={\"Male\": \"b\", \"Female\": \"y\"})\n",
    "sns.despine(left=True)\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "sns.set(style=\"darkgrid\")\n",
    "\n",
    "# Load the example titanic dataset\n",
    "df = sns.load_dataset(\"titanic\")\n",
    "\n",
    "# Make a custom palette with gendered colors\n",
    "pal = dict(male=\"#6495ED\", female=\"#F08080\")\n",
    "\n",
    "# Show the survival proability as a function of age and sex\n",
    "g = sns.lmplot(x=\"age\", y=\"survived\", col=\"sex\", hue=\"sex\", data=df,\n",
    "               palette=pal, y_jitter=.02, logistic=True)\n",
    "g.set(xlim=(0, 80), ylim=(-.05, 1.05))\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "sns.set()\n",
    "\n",
    "# Load the example flights dataset and convert to long-form\n",
    "flights_long = sns.load_dataset(\"flights\")\n",
    "flights = flights_long.pivot(\"month\", \"year\", \"passengers\")\n",
    "\n",
    "# Draw a heatmap with the numeric values in each cell\n",
    "sns.heatmap(flights, annot=True, fmt=\"d\", linewidths=.5)\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "sns.set(style=\"darkgrid\")\n",
    "\n",
    "tips = sns.load_dataset(\"tips\")\n",
    "g = sns.FacetGrid(tips, row=\"sex\", col=\"time\", margin_titles=True)\n",
    "bins = np.linspace(0, 60, 13)\n",
    "g.map(plt.hist, \"total_bill\", color=\"steelblue\", bins=bins, lw=0)\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "sns.set(style=\"ticks\")\n",
    "\n",
    "# Create a dataset with many short random walks\n",
    "rs = np.random.RandomState(4)\n",
    "pos = rs.randint(-1, 2, (20, 5)).cumsum(axis=1)\n",
    "pos -= pos[:, 0, np.newaxis]\n",
    "step = np.tile(range(5), 20)\n",
    "walk = np.repeat(range(20), 5)\n",
    "df = pd.DataFrame(np.c_[pos.flat, step, walk],\n",
    "                  columns=[\"position\", \"step\", \"walk\"])\n",
    "\n",
    "# Initialize a grid of plots with an Axes for each walk\n",
    "grid = sns.FacetGrid(df, col=\"walk\", hue=\"walk\", col_wrap=5, size=1.5)\n",
    "\n",
    "# Draw a horizontal line to show the starting point\n",
    "grid.map(plt.axhline, y=0, ls=\":\", c=\".5\")\n",
    "\n",
    "# Draw a line plot to show the trajectory of each random walk\n",
    "grid.map(plt.plot, \"step\", \"position\", marker=\"o\", ms=4)\n",
    "\n",
    "# Adjust the tick positions and labels\n",
    "grid.set(xticks=np.arange(5), yticks=[-3, 3],\n",
    "         xlim=(-.5, 4.5), ylim=(-3.5, 3.5))\n",
    "\n",
    "# Adjust the arrangement of the plots\n",
    "grid.fig.tight_layout(w_pad=1)\n",
    "plt.show()"
   ]
  }
 ],
 "metadata": {
  "anaconda-cloud": {},
  "kernelspec": {
   "display_name": "Python [iaml]",
   "language": "python",
   "name": "Python [iaml]"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 2
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython2",
   "version": "2.7.12"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}