lec/l24/L24.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## CS585: Natural Language Processing\n",
    "### Tips: Neural networks and project\n",
    "\n",
    "<br><br>\n",
    "#### Illinois Institute of Technology  \n",
    "#### Aron Culotta\n",
    "\n",
    "<br><br><br><br><br>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Project tips\n",
    "\n",
    "So you've collected data, implemented a baseline, and have an F1 of 78%.  \n",
    "**Now what??**\n",
    "\n",
    "- Error analysis\n",
    "- Check for data biases\n",
    "- Over/under fitting\n",
    "- Parameter tuning"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Reminder: train/validation/test splits\n",
    "\n",
    "- Training data\n",
    "  - To fit model\n",
    "  - May use cross-validation loop\n",
    "  \n",
    "- Validation data\n",
    "  - To evaluate model while debugging/tuning\n",
    "  \n",
    "- Testing data\n",
    "  - Evaluate once at the end of the project\n",
    "  - Best estimate of accuracy on some new, as-yet-unseen data"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Error analysis\n",
    "\n",
    "What did you get wrong and why?\n",
    "\n",
    "- Fit model on all training data\n",
    "- Predict on validation data\n",
    "- Collect and categorize errors\n",
    "  - false positives\n",
    "  - false negatives\n",
    "- Sort by:\n",
    "  - Label probability\n",
    "  \n",
    "A useful diagnostic:\n",
    "- Find the top 10 most wrong predictions\n",
    "  - I.e., probability of incorrect label is near 1\n",
    "- For each, print the features that are \"most responsible\" for decision\n",
    "\n",
    "E.g., for logistic regression\n",
    "\n",
    "$$\n",
    "p(y \\mid x) = \\frac{1}{1 + e^{-x^T \\theta}}\n",
    "$$\n",
    "\n",
    "If true label was $-1$, but classifier predicted $+1$, sort features in descending order of $x_j * \\theta_j$\n",
    "\n",
    "Can do similarly for neural networks, to identify hidden units most responsible for decision\n",
    "- $\\delta$ computation of backpropagation!\n",
    "\n",
    "<br><br>\n",
    "\n",
    "Error analysis often helps designing new features.\n",
    "- E.g., \"not good\" classified as positive because $x_{\\mathrm{good}} * \\theta_{\\mathrm{good}} >> 0$\n",
    "- Instead, replace feature \"good\" with \"not_good\"\n",
    "  - similarly for other negation words\n",
    "  \n",
    "May also discover incorrectly labeled data\n",
    "- Common in classification tasks in which labels are not easily defined\n",
    "  - E.g., is the sentence \"it's not bad\" positive or negative?\n",
    "  \n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Inter-annotator agreement\n",
    "\n",
    "- How often do two human annotators give the same label to the same example?\n",
    "\n",
    "- E.g., consider two humans labeling 100 documents:\n",
    "\n",
    "<table>\n",
    "<tr><td> </td> <td> </td> <td colspan=2> **Person 1** </td> </tr>\n",
    "<tr><td> </td> <td> </td> <td> Relevant </td> <td> Not Relevant </td> </tr>\n",
    "<tr><td rowspan=2> **Person 2** </td> <td> Relevant </td> <td> 50 </td> <td> 20 </td> </tr>\n",
    "<tr>                              <td> Not Relevant </td> <td> 10 </td> <td> 20 </td> </tr>\n",
    "</table>\n",
    "\n",
    "\n",
    "- Simple **agreement**: fraction of documents with matching labels. $\\frac{70}{100} = 70\\%$\n",
    "\n",
    "<br><br>\n",
    "\n",
    "- But, how much agreement would we expect by chance?\n",
    "\n",
    "- Person 1 says Relevant $60\\%$ of the time.\n",
    "- Person 2 says Relevant $70\\%$ of the time.\n",
    "- Chance that they both say relevant at the same time? $60\\% \\times 70\\% = 42\\%$.\n",
    "\n",
    "\n",
    "- Person 1 says Not Relevant $40\\%$ of the time.\n",
    "- Person 2 says Not Relevant $30\\%$ of the time.\n",
    "- Chance that they both say not relevant at the same time? $40\\% \\times 30\\% = 12\\%$.\n",
    "\n",
    "\n",
    "- Chance that they agree on any document (both say yes or both say no): $42\\% + 12\\% = 54\\%$\n",
    "\n",
    "** Cohen's Kappa ** $\\kappa$\n",
    "\n",
    "- Percent agreement beyond that expected by chance\n",
    "\n",
    "$ \\kappa = \\frac{P(A) - P(E)}{1 - P(E)}$\n",
    "\n",
    "- $P(A)$ = simple agreement proportion\n",
    "- $P(E)$ = agreement proportion expected by chance\n",
    "\n",
    "\n",
    "E.g., $\\kappa = \\frac{.7 - .54}{1 - .54} = .3478$\n",
    "\n",
    "- $k=0$ if no better than chance, $k=1$ if perfect agreement\n",
    "\n",
    "<br><br>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Data biases\n",
    "\n",
    "- How similar is the testing data to the training data?\n",
    "\n",
    "- If you were to deploy the system to run in real-time, would the data it sees be comparable to the testing data?\n",
    "\n",
    "Assumption that test/train data drawn from same distribution often wrong:\n",
    "\n",
    "<u>Label shift:</u>\n",
    "\n",
    "$p_{\\mathrm{train}}(y) \\ne p_{\\mathrm{test}}(y)$\n",
    "  - e.g., positive examples more likely in testing data\n",
    "  - Why does this matter?\n",
    "  Recall Naive Bayes:\n",
    "$$\n",
    "p(y \\mid x) = \\frac{p(x \\mid y)p(y)}{p(x)}\n",
    "$$\n",
    "\n",
    "Similar problem happens in logistic regression:\n",
    "\n",
    "$$\n",
    "p(y \\mid x) = \\frac{1}{1 + e^{-(x^T\\theta + b)}}\n",
    "$$\n",
    "- bias term $b$ adjusts predictions to match overall $p(y)$\n",
    "  \n",
    "<br><br>\n",
    "<u>Feature Shift:</u>\n",
    "- also called \"covariate shift\"  \n",
    "- $p_{\\mathrm{train}}(x) \\ne p_{\\mathrm{test}}(x)$\n",
    "- E.g., for sentiment analysis, if we train on mostly horror movies, but test on mostly comedies\n",
    "  - classifier should focus more on comedies when training\n",
    "- Simple solution: weight training examples by how similar they are to examples in the test set.  \n",
    "Recall negative log likelihood function:\n",
    "\n",
    "$$E(D,h) =  -\\sum_i \\ln p(y_i|x_i)$$\n",
    "\n",
    "becomes\n",
    "\n",
    "$$E(D,h) = -\\sum_i \\ln p(x_i \\mid x_{\\mathrm{test}}) p(y_i|x_i)$$\n",
    "\n",
    "where  $p(x_i \\mid x_{\\mathrm{test}})$ indicates how likely it is that example $x_i$ comes from the test set.\n",
    "- can be estimated by training a separate classifier $p(z \\mid x)$, where $z=1$ if $x$ comes from test set.\n",
    "\n",
    "<br><br>\n",
    "<u>Conditional probability shift</u>\n",
    "- $p_{\\mathrm{train}}(y \\mid x) \\ne p_{\\mathrm{test}}(y \\mid x)$\n",
    "- E.g., \"bad\" used to mean negative, but now it means positive\n",
    "- Much harder\n",
    "- Simple approach: self-training\n",
    "\n",
    "Repeat:\n",
    "1. Fit $p(y \\mid x)$ on training.\n",
    "2. Predict on testing\n",
    "3. Pick top $n$ most confident predictions for each class on testing\n",
    "4. Add to training set with predicted labels.\n",
    "5. Retrain classifier\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## More bias\n",
    "\n",
    "<u>Confounders</u>\n",
    "- Are there variables that predict the label that are not in the feature representation?\n",
    "    - e.g., some products have higher ratings than others; gender bias; location bias;\n",
    "    - May add additional features to model these attributes\n",
    "    - Or, may need to train separate classifiers for each gender/location/etc.\n",
    "    \n",
    "<br>\n",
    "\n",
    "<u>Temporal Bias</u>\n",
    "- Do testing instances come later, chronologically, than the training instances?\n",
    "    - E.g., we observe that user X likes Superman II, she probably also likes Superman I \n",
    "- Why does this matter?\n",
    "    - inflates estimate of accuracy in production setting\n",
    "\n",
    "<br>\n",
    "\n",
    "<u> Cross-validation splits </u>\n",
    "- E.g., classifying a user/organization's tweets: does the same user appear in both training/testing\n",
    "    - could just be learning a user-specific classifier; won't generalize to new user\n",
    "    - speech recognition\n",
    "- Again, will inflate estimate of accuracy.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Over/under fitting\n",
    "\n",
    "What is training vs validation accuracy?\n",
    "\n",
    "- If training accuracy is low, we are probably underfitting. Consider:\n",
    "  - adding new features\n",
    "  - adding combinations of existing features (e.g., ngrams, conjunctions/disjunctions)\n",
    "  - adding hidden units/layers\n",
    "  - try non-linear classifier\n",
    "    - SVM, decision trees, neural nets\n",
    "  \n",
    "- If training accuracy is very high (>99%), but validation accuracy is low, we are probably overfitting\n",
    "  - Do the opposite of above\n",
    "  - reduce number of features (selection or PCA or word2vec)\n",
    "  - Regularization (L2, L1)\n",
    "  - Dropout (parameter)\n",
    "  - Early stopping for gradient descent\n",
    "  - look at learning curves\n",
    "\n",
    " "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Regularization\n",
    "\n",
    "Controls how many parameters the model has, or how large each parameter can get.\n",
    "\n",
    "E.g. L2 Regularization for linear regression:\n",
    "\n",
    "$$\n",
    "E(D, \\theta) =  - \\prod_{i \\in D} p(y_i|x_i) + \\frac{1}{C}||\\vec{\\theta}||^2_2\n",
    "$$\n",
    "\n",
    "$$\n",
    " =  - \\prod_{i \\in D} p(y_i|x_i) + \\frac{1}{C}\\sum_k \\theta_k^2\n",
    "$$\n",
    "\n",
    "As $C \\rightarrow 0$, the classifier prefers smaller and smaller coefficients.\n",
    "\n",
    "This is the $C$ parameter of the `LogisticRegression` class in sklearn.\n",
    "\n",
    "![l2](figs/l2.png)\n",
    "\n",
    "![l22](figs/l22.png)\n",
    "\n",
    "\n",
    "## L1 Regularization\n",
    "\n",
    "Penalize by absolute value of coefficients (rather than square):\n",
    "\n",
    "$$\n",
    "E(D, \\theta) = - \\prod_{i \\in D} p(y_i|x_i) + \\frac{1}{C}\\sum_k |\\theta_k|\n",
    "$$\n",
    "\n",
    "![l1](figs/l1.png)\n",
    "\n",
    "![l11](figs/l11.png)\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Feature Selection\n",
    "\n",
    "Rather than using L1 regularization, we can explicitly look for terms that are highly correlated with the class label.\n",
    "\n",
    "Intuitively, we want terms that are very probable in one class, but not the other.\n",
    "\n",
    "One way to compute this is the chi-squared statistic: $\\chi^2$\n",
    "\n",
    "The chi-squared statistic is used in hypothesis testing to determine whether two variables are independent.\n",
    "\n",
    "$$A \\perp B \\iff P(A,B) \\equiv P(A)P(B)$$\n",
    "\n",
    "To apply this to feature selection, we wish to know whether the occurrence of a term is independent of the class label. \n",
    "- If they are independent, then it is not a useful feature. \n",
    "- If they are highly dependent, then it is a useful feature.\n",
    "\n",
    "To compute the chi-squared statistic for term $t$ and class label $y$:\n",
    "\n",
    "- Let $N^t_{i,j}$ indicate the number of documents that contain/don't contain term $t$ and have class label $y$.\n",
    "  - E.g., $N^t_{0,0}=10$ means that 10 document have class label $0$ and do **not** have term $t$.\n",
    "  - E.g., $N^t_{1,1}=10$ means that 10 documents have class label $1$ and do have term $t$.\n",
    "  \n",
    "So, for each term we have a table like this:\n",
    "\n",
    "|         |  y=1          |  y=0         |\n",
    "|---------|---------------|--------------|\n",
    "| **t=1** |  $N^t_{11}$   | $N^t_{10}$   |\n",
    "| **t=0** | $N^t_{01}$    | $N^t_{00}$   |\n",
    "\n",
    "The chi-squared statistic measures how much these values deviate from what would be expected if $t$ and $y$ were independent.\n",
    "\n",
    "If $N$ is the total number of documents, then the expected value $E_{11}$ (for $t=1$, $y=1$) is:\n",
    "\n",
    "$$\n",
    "p(t=1) = \\frac{N^t_{11} + N^t_{10}}{N}\n",
    "$$\n",
    "\n",
    "$$\n",
    "p(y=1) = \\frac{N^t_{11} + N^t_{01}}{N}\n",
    "$$\n",
    "\n",
    "$$\n",
    "E_{11} = N * p(t=1) * p(y=1)\n",
    "$$\n",
    "Then, the chi-squared statistic is as follows:\n",
    "$$\n",
    "\\chi^2 = \\sum_{ij} \\frac{(N^t_{ij} - E^t_{ij})^2}{E^t_{ij}}\n",
    "$$\n",
    "\n",
    "```python\n",
    "from sklearn.feature_selection import chi2\n",
    "```"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Parameter tuning\n",
    "\n",
    "Many \"hyperparameters\"\n",
    "- regularization strength\n",
    "- number of gradient descent iterations\n",
    "- dropout probability\n",
    "- number of hidden units\n",
    "- ...\n",
    "\n",
    "\n",
    "- Be sure to tune these on the validation set, not the test set.\n",
    "\n",
    "<br>\n",
    "\n",
    "- Grid search\n",
    "  - Exhaustively search over all combinations\n",
    "  - Discretize continous variables\n",
    "  ```python \n",
    "  {'C': [.01, .1, 1, 10, 100, 1000], 'n_hidden': [5, 10, 50], 'regularizer': ['l1', 'l2']},\n",
    "  ```\n",
    "  \n",
    "- Random search\n",
    "  - Define a probability distribution over each parameter\n",
    "  - Each iteration samples from that distribution\n",
    "  - Allows you to express prior knowledge over the likely best settings\n",
    "  - E.g.,\n",
    "  ```python\n",
    "  regularizer={'l1': .3, 'l2': .7}```\n",
    "  \n",
    "See more at http://scikit-learn.org/stable/modules/grid_search.html\n",
    "\n",
    "\n",
    "<br><br>\n",
    "- While building model, may want to avoid evaluating on validation set too much\n",
    "- **double cross-validation** can be used instead\n",
    "\n",
    "- Using only the training set:\n",
    "  - split into $k$ (train, test) splits\n",
    "  - for each split ($D_{tr}, D_{te}$)\n",
    "    - split $D_{tr}$ into $m$ splits\n",
    "    - pick hyperparameters that maximize this nested cross-validation accuracy\n",
    "    - train on all of $D_{tr}$ with those parameters\n",
    "    \n",
    "Evaluates how well your hyperparameter selection algorithm does."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<link href=\"https://fonts.googleapis.com/css?family=Droid+Sans+Mono\" rel=\"stylesheet\" type='text/css'>\n",
       "\n",
       "<link href=\"https://fonts.googleapis.com/css?family=Exo+2\" rel=\"stylesheet\" type='text/css'>\n",
       "\n",
       "<link href=\"https://fonts.googleapis.com/css?family=Lora\" rel=\"stylesheet\" type='text/css'>\n",
       "\n",
       "<link href=\"https://fonts.googleapis.com/css?family=Fira+Mono\" rel=\"stylesheet\" type='text/css'>\n",
       "\n",
       "<style>\n",
       "\n",
       "div#site {\n",
       "    height: 100% !important;\n",
       "}\n",
       "\n",
       "strong {\n",
       "  font-weight: 900 !important;\n",
       "}\n",
       "\n",
       ".container { width:90% !important; }\n",
       "\n",
       "\n",
       "div#notebook {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 20pt;\n",
       " line-height: 170%;\n",
       " color: #303030;\n",
       "}\n",
       "body,\n",
       "div.body {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 20pt;\n",
       " color: #303030;\n",
       " background-color: #ffffff;\n",
       " background: #ffffff;\n",
       "}\n",
       "body.notebook_app {\n",
       " padding: 0;\n",
       " background-color: #ffffff;\n",
       " background: #ffffff;\n",
       " padding-right: 0px !important;\n",
       " overflow-y: hidden;\n",
       "}\n",
       "a {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " color: #303030;\n",
       "}\n",
       "a:hover,\n",
       "a:focus {\n",
       " color: #2f2f2f;\n",
       "}\n",
       ".list_header,\n",
       "div#notebook_list_header.row.list_header {\n",
       " font-size: 20pt;\n",
       " color: #2f2f2f;\n",
       " background-color: #ffffff;\n",
       "}\n",
       "div#cluster_list_header.row.list_header,\n",
       "div#running .row.list_header {\n",
       " font-size: 20pt;\n",
       " color: #303030;\n",
       " background: #eeeeee;\n",
       " background-color: #eeeeee;\n",
       " border-bottom: 2px solid rgba(180,180,180,.30);\n",
       "}\n",
       "div#cluster_list > div.list_item.row,\n",
       "div#cluster_list > div.list_item.row:hover {\n",
       " background: #fafafa;\n",
       " background-color: #fafafa;\n",
       "}\n",
       "div#clusters.tab-pane.active {\n",
       " font-size: 12.0pt;\n",
       " padding: 4px 0 4px 0;\n",
       "}\n",
       "#running .panel-group .panel .panel-heading {\n",
       " font-size: 14pt;\n",
       " color: #303030;\n",
       " padding: 8px 8px;\n",
       " background: #eeeeee;\n",
       " background-color: #eeeeee;\n",
       "}\n",
       "#running .panel-group .panel .panel-heading a {\n",
       " font-size: 14pt;\n",
       " color: #303030;\n",
       "}\n",
       "#running .panel-group .panel .panel-heading a:focus,\n",
       "#running .panel-group .panel .panel-heading a:hover {\n",
       " font-size: 14pt;\n",
       " color: #303030;\n",
       "}\n",
       "#running .panel-group .panel .panel-body .list_container .list_item {\n",
       " background: #fafafa;\n",
       " background-color: #fafafa;\n",
       " padding: 2px;\n",
       " border-bottom: 2px solid rgba(180,180,180,.30);\n",
       "}\n",
       "#running .panel-group .panel .panel-body .list_container .list_item:hover {\n",
       " background: #fafafa;\n",
       " background-color: #fafafa;\n",
       "}\n",
       "#running .panel-group .panel .panel-body {\n",
       " padding: 2px;\n",
       "}\n",
       "div.running_list_info.toolbar_info {\n",
       " font-size: 12.0pt;\n",
       " padding: 4px 0 4px 0;\n",
       " height: inherit;\n",
       " line-height: inherit;\n",
       " text-shadow: none;\n",
       "}\n",
       ".list_placeholder {\n",
       " font-weight: normal;\n",
       "}\n",
       "#tree-selector {\n",
       " padding: 0px;\n",
       "}\n",
       "#project_name > ul > li > a > i.fa.fa-home {\n",
       " color: #ff7823;\n",
       " font-size: 17pt;\n",
       " display: inline-block;\n",
       " position: static;\n",
       " padding: 0px 0px;\n",
       " font-weight: normal;\n",
       " text-align: center;\n",
       " vertical-align: text-top;\n",
       "}\n",
       "#project_name {\n",
       " display: inline-flex;\n",
       " padding-left: 7px;\n",
       " margin-left: -2px;\n",
       " margin-bottom: -20px;\n",
       " text-align: -webkit-auto;\n",
       " vertical-align: text-top;\n",
       "}\n",
       "div#notebook_toolbar div.dynamic-instructions {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 12.0pt;\n",
       "}\n",
       ".toolbar_info {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 12.0pt;\n",
       " color: #303030;\n",
       " text-shadow: none;\n",
       " border: none;\n",
       " height: inherit;\n",
       " line-height: inherit;\n",
       "}\n",
       ".list_container {\n",
       " font-size: 12.0pt;\n",
       " color: #303030;\n",
       " border: none;\n",
       " text-shadow: none !important;\n",
       "}\n",
       ".list_container > div {\n",
       " border-bottom: 1px solid rgba(180,180,180,.14);\n",
       " font-size: 12.0pt;\n",
       "}\n",
       ".list_header > div,\n",
       ".list_item > div {\n",
       " padding-left: 0px;\n",
       "}\n",
       ".list_header > div input,\n",
       ".list_item > div input {\n",
       " top: 0px;\n",
       "}\n",
       ".list_header > div .item_link,\n",
       ".list_item > div .item_link {\n",
       " margin-left: -1px;\n",
       " vertical-align: middle;\n",
       " line-height: 22px;\n",
       " font-size: 12.0pt;\n",
       "}\n",
       ".item_icon {\n",
       " font-size: 12.0pt;\n",
       " vertical-align: middle;\n",
       "}\n",
       ".list_item input:not([type=\"checkbox\"]) {\n",
       " padding-right: 0px;\n",
       " height: auto;\n",
       " width: 20%;\n",
       " margin: 6px 0 0;\n",
       " margin-top: 1px;\n",
       "}\n",
       "#button-select-all {\n",
       " height: auto;\n",
       " font-size: 12.0pt;\n",
       " padding: 5px;\n",
       " min-width: 65px;\n",
       " z-index: 0;\n",
       "}\n",
       "button#tree-selector-btn {\n",
       " height: auto;\n",
       " font-size: 12.0pt;\n",
       " padding: 5px;\n",
       "}\n",
       "input#select-all.pull-left.tree-selector {\n",
       " margin-left: 7px;\n",
       " margin-right: 2px;\n",
       " margin-top: 5px;\n",
       "}\n",
       "input[type=\"radio\"],\n",
       "input[type=\"checkbox\"] {\n",
       " margin: 6px 0 0;\n",
       " margin-top: 1px;\n",
       " line-height: normal;\n",
       "}\n",
       ".list_container a {\n",
       " font-size: 17px;\n",
       " color: #303030;\n",
       " border: none;\n",
       " text-shadow: none !important;\n",
       " font-weight: normal;\n",
       " font-style: normal;\n",
       "}\n",
       "div.list_container a:hover {\n",
       " color: #2f2f2f;\n",
       "}\n",
       "div.list_item:hover {\n",
       " background-color: #fafafa;\n",
       "}\n",
       ".breadcrumb > li {\n",
       " font-size: 12.0pt;\n",
       " color: #303030;\n",
       " border: none;\n",
       " text-shadow: none !important;\n",
       "}\n",
       "ul#tabs a {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 13pt;\n",
       " font-weight: normal;\n",
       " font-style: normal;\n",
       " border-color: transparent;\n",
       " text-shadow: none !important;\n",
       "}\n",
       ".nav-tabs {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 13pt;\n",
       " font-weight: normal;\n",
       " font-style: normal;\n",
       " background: #ffffff;\n",
       " text-shadow: none !important;\n",
       " border-color: transparent;\n",
       " border-bottom-color: rgba(180,180,180,.30);\n",
       "}\n",
       ".nav-tabs > li > a:hover {\n",
       " color: #2f2f2f;\n",
       " background-color: rgba(180,180,180,.14);\n",
       "}\n",
       ".nav-tabs > li > a:active,\n",
       ".nav-tabs > li > a:focus,\n",
       ".nav-tabs > li.active > a,\n",
       ".nav-tabs > li.active > a:focus,\n",
       ".nav-tabs > li.active > a:hover,\n",
       ".nav-tabs > li.active > a,\n",
       ".nav-tabs > li.active > a:hover,\n",
       ".nav-tabs > li.active > a:focus {\n",
       " color: #1c1c1c;\n",
       " background-color: #eeeeee;\n",
       " border: 1px solid transparent;\n",
       " border-bottom-color: transparent;\n",
       " cursor: default;\n",
       "}\n",
       ".nav > li > a:hover,\n",
       ".nav > li > a:focus {\n",
       " text-decoration: none;\n",
       " background-color: rgba(180,180,180,.14);\n",
       "}\n",
       ".nav > li.disabled > a,\n",
       ".nav > li.disabled > a:hover {\n",
       " color: #aaaaaa;\n",
       "}\n",
       "div#notebook {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 20pt;\n",
       " padding-top: 4px;\n",
       "}\n",
       ".notebook_app {\n",
       " background-color: #ffffff;\n",
       "}\n",
       "#notebook-container {\n",
       " padding: 13px;\n",
       " background-color: #ffffff;\n",
       " min-height: 0px;\n",
       " box-shadow: none;\n",
       " width: 980px;\n",
       " margin-right: auto;\n",
       " margin-left: auto;\n",
       "}\n",
       "div#ipython-main-app.container {\n",
       " width: 980px;\n",
       " margin-right: auto;\n",
       " margin-left: auto;\n",
       " margin-right: auto;\n",
       " margin-left: auto;\n",
       "}\n",
       ".container {\n",
       " width: 980px;\n",
       " margin-right: auto;\n",
       " margin-left: auto;\n",
       "}\n",
       ".notebook_app #header {\n",
       " box-shadow: none !important;\n",
       " background-color: #ffffff;\n",
       " border-bottom: 2px solid rgba(180,180,180,.14);\n",
       "}\n",
       "#header {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 22pt;\n",
       " box-shadow: none;\n",
       " background-color: #ffffff;\n",
       "}\n",
       "#header .header-bar {\n",
       " background: #ffffff;\n",
       " background-color: #ffffff;\n",
       "}\n",
       "body > #header .header-bar {\n",
       " width: 100%;\n",
       " background: #ffffff;\n",
       "}\n",
       "#menubar {\n",
       " background-color: #ffffff;\n",
       "}\n",
       "#menubar .navbar,\n",
       ".navbar-default {\n",
       " background-color: #ffffff;\n",
       " margin-bottom: 0px;\n",
       " margin-top: 5px;\n",
       "}\n",
       ".navbar {\n",
       " border: none;\n",
       "}\n",
       "div.navbar-text,\n",
       ".navbar-text {\n",
       " margin-top: 6px !important;\n",
       " margin-bottom: 0px;\n",
       "}\n",
       ".navbar-default {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 13pt;\n",
       " background-color: #ffffff;\n",
       " border-color: rgba(180,180,180,.14);\n",
       " line-height: 1.5em;\n",
       " padding-bottom: 0px;\n",
       "}\n",
       ".navbar-default .navbar-nav > li > a {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 13pt;\n",
       " color: #303030;\n",
       " display: block;\n",
       " line-height: 1.5em;\n",
       " padding-top: 9px;\n",
       " padding-bottom: 6px;\n",
       "}\n",
       ".navbar-default .navbar-nav > li > a:hover,\n",
       ".navbar-default .navbar-nav > li > a:focus {\n",
       " color: #2f2f2f;\n",
       " background-color: rgba(180,180,180,.14);\n",
       " border-color: rgba(180,180,180,.14);\n",
       " line-height: 1.5em;\n",
       "}\n",
       ".navbar-default .navbar-nav > .open > a,\n",
       ".navbar-default .navbar-nav > .open > a:hover,\n",
       ".navbar-default .navbar-nav > .open > a:focus {\n",
       " color: #1c1c1c;\n",
       " background-color: rgba(180,180,180,.14);\n",
       " border-color: rgba(180,180,180,.14);\n",
       " line-height: 1.5em;\n",
       "}\n",
       ".edit_mode .modal_indicator:before {\n",
       " font-size: 15pt;\n",
       " color: #2c85f7;\n",
       " content: \"\\f040\";\n",
       " padding-top: 5px;\n",
       " padding-bottom: 0px;\n",
       " vertical-align: bottom;\n",
       "}\n",
       ".command_mode .modal_indicator:before {\n",
       " font-size: 17pt;\n",
       " color: #2c85f7;\n",
       " content: \"\\f1f9\";\n",
       " padding-top: 5px;\n",
       " padding-bottom: 0px;\n",
       " vertical-align: bottom;\n",
       "}\n",
       ".item_icon {\n",
       " color: #126dce;\n",
       "}\n",
       ".item_buttons .kernel-name {\n",
       " font-size: 13pt;\n",
       " color: #126dce;\n",
       " line-height: 22px;\n",
       "}\n",
       ".running_notebook_icon:before {\n",
       " color: #009e07 !important;\n",
       "}\n",
       ".item_buttons .running-indicator {\n",
       " padding-top: 2px;\n",
       " color: #009e07;\n",
       "}\n",
       "#modal_indicator {\n",
       " float: right !important;\n",
       " color: #126dce;\n",
       " background: #ffffff;\n",
       " background-color: #ffffff;\n",
       "}\n",
       "#kernel_indicator {\n",
       " float: right !important;\n",
       " color: #ff7823;\n",
       " background: #ffffff;\n",
       " background-color: #ffffff;\n",
       " font-size: 16pt;\n",
       " border-left: 2px solid #ff7823;\n",
       " padding-bottom: 2px;\n",
       "}\n",
       "#kernel_indicator .kernel_indicator_name {\n",
       " color: #ff7823;\n",
       " background: #ffffff;\n",
       " background-color: #ffffff;\n",
       " font-size: 16pt;\n",
       " padding-left: 5px;\n",
       " padding-right: 5px;\n",
       " margin-top: 10px;\n",
       " vertical-align: text-bottom;\n",
       " padding-bottom: 0px;\n",
       "}\n",
       "#kernel_indicator .kernel_indicator_name {\n",
       " color: #ff7823;\n",
       " background: #ffffff;\n",
       " background-color: #ffffff;\n",
       " font-size: 15.5pt;\n",
       " padding-left: 5px;\n",
       " padding-right: 5px;\n",
       " margin-top: 10px;\n",
       " vertical-align: text-bottom;\n",
       " padding-bottom: 0px;\n",
       "}\n",
       "div.notification_widget.info,\n",
       ".notification_widget.info,\n",
       ".notification_widget:active:hover,\n",
       ".notification_widget.active:hover,\n",
       ".open > .dropdown-toggle.notification_widget:hover,\n",
       ".notification_widget:active:focus,\n",
       ".notification_widget.active:focus,\n",
       ".open > .dropdown-toggle.notification_widget:focus,\n",
       ".notification_widget:active.focus,\n",
       ".notification_widget.active.focus,\n",
       ".open > .dropdown-toggle.notification_widget.focus,\n",
       "div#notification_notebook.notification_widget.btn.btn-xs.navbar-btn,\n",
       "div#notification_notebook.notification_widget.btn.btn-xs.navbar-btn:hover,\n",
       "div#notification_notebook.notification_widget.btn.btn-xs.navbar-btn:focus {\n",
       " color: #126dce;\n",
       " background-color: #ffffff;\n",
       " border-color: #ffffff;\n",
       "}\n",
       "#notification_area,\n",
       "div.notification_area {\n",
       " float: right !important;\n",
       " position: static;\n",
       "}\n",
       "#kernel_logo_widget,\n",
       "#kernel_logo_widget .current_kernel_logo {\n",
       " display: none;\n",
       "}\n",
       "div#ipython_notebook {\n",
       " display: none;\n",
       "}\n",
       "i.fa.fa-icon {\n",
       " -webkit-font-smoothing: antialiased;\n",
       " -moz-osx-font-smoothing: grayscale;\n",
       " text-rendering: auto;\n",
       "}\n",
       ".fa {\n",
       " display: inline-block;\n",
       " font: normal normal normal 12pt/1 \"FontAwesome\", \"Exo_2\", sans-serif;\n",
       " text-rendering: auto;\n",
       " -webkit-font-smoothing: antialiased;\n",
       " -moz-osx-font-smoothing: grayscale;\n",
       "}\n",
       ".dropdown-menu {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 13pt;\n",
       " box-shadow: none;\n",
       " padding: 0px;\n",
       " text-align: left;\n",
       " border: 2px solid rgba(180,180,180,.30);\n",
       " background-color: #ffffff;\n",
       " background: #ffffff;\n",
       " line-height: 1.3;\n",
       " margin: 0px;\n",
       "}\n",
       ".dropdown-menu:hover {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 13pt;\n",
       " border: 2px solid rgba(180,180,180,.30);\n",
       " background-color: #ffffff;\n",
       " box-shadow: none;\n",
       " line-height: 1.3;\n",
       "}\n",
       ".dropdown-header {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 13pt;\n",
       " display: block;\n",
       " color: #ff7823;\n",
       " text-decoration: underline;\n",
       " white-space: nowrap;\n",
       " padding: 8px 0px 0px 6px;\n",
       " line-height: 1.3;\n",
       "}\n",
       ".dropdown-menu > li > a {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 12.0pt;\n",
       " line-height: 1.3;\n",
       " display: block;\n",
       " padding: 10px 25px 10px 14px;\n",
       " color: #303030;\n",
       " background-color: #ffffff;\n",
       " background: #ffffff;\n",
       "}\n",
       ".dropdown-menu > li > a:hover {\n",
       " color: #2f2f2f;\n",
       " background-color: rgba(180,180,180,.14);\n",
       " background: rgba(180,180,180,.14);\n",
       " border-color: rgba(180,180,180,.14);\n",
       "}\n",
       ".dropdown-menu .divider {\n",
       " height: 2px;\n",
       " margin: 0px 0px;\n",
       " overflow: hidden;\n",
       " background-color: rgba(180,180,180,.30);\n",
       "}\n",
       ".dropdown-submenu > .dropdown-menu {\n",
       " top: 0;\n",
       " left: 100%;\n",
       " margin-top: -2px;\n",
       " margin-left: 0px;\n",
       " padding-top: 0px;\n",
       "}\n",
       ".dropdown-menu > .disabled > a,\n",
       ".dropdown-menu > .disabled > a:hover,\n",
       ".dropdown-menu > .disabled > a:focus {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 12.0pt;\n",
       " font-weight: normal;\n",
       " color: #aaaaaa;\n",
       " padding: none;\n",
       " display: block;\n",
       " clear: both;\n",
       " line-height: 1.2;\n",
       " white-space: nowrap;\n",
       "}\n",
       ".dropdown-submenu > a:after {\n",
       " color: #303030;\n",
       " margin-right: -16px;\n",
       "}\n",
       ".dropdown-submenu:hover > a:after,\n",
       ".dropdown-submenu:active > a:after,\n",
       ".dropdown-submenu:focus > a:after,\n",
       ".dropdown-submenu:visited > a:after {\n",
       " color: #ff7823;\n",
       " margin-right: -16px;\n",
       "}\n",
       "div.kse-dropdown > .dropdown-menu,\n",
       ".kse-dropdown > .dropdown-menu {\n",
       " min-width: 0;\n",
       " top: 94%;\n",
       "}\n",
       ".btn,\n",
       ".btn-default {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " color: #303030;\n",
       " background: #ebebeb;\n",
       " background-color: #ebebeb;\n",
       " border: 2px solid #e8e8e8;\n",
       " font-weight: normal;\n",
       " box-shadow: none;\n",
       " text-shadow: none;\n",
       " border-radius: 2px;\n",
       " font-size: inherit;\n",
       "}\n",
       ".btn:hover,\n",
       ".btn:active:hover,\n",
       ".btn.active:hover,\n",
       ".btn-default:hover,\n",
       ".open > .dropdown-toggle.btn-default:hover,\n",
       ".open > .dropdown-toggle.btn:hover {\n",
       " color: #2f2f2f;\n",
       " background-color: #e4e4e4;\n",
       " background: #e4e4e4;\n",
       " border-color: #e4e4e4;\n",
       " background-image: none;\n",
       " box-shadow: none !important;\n",
       " border-radius: 2px;\n",
       "}\n",
       ".btn:active,\n",
       ".btn.active,\n",
       ".btn:active:focus,\n",
       ".btn.active:focus,\n",
       ".btn:active.focus,\n",
       ".btn.active.focus,\n",
       ".btn-default:focus,\n",
       ".btn-default.focus,\n",
       ".btn-default:active,\n",
       ".btn-default.active,\n",
       ".btn-default:active:hover,\n",
       ".btn-default.active:hover,\n",
       ".btn-default:active:focus,\n",
       ".btn-default.active:focus,\n",
       ".btn-default:active.focus,\n",
       ".btn-default.active.focus,\n",
       ".open > .dropdown-toggle.btn:focus,\n",
       ".open > .dropdown-toggle.btn.focus,\n",
       ".open > .dropdown-toggle.btn-default {\n",
       " color: #1c1c1c;\n",
       " background-color: #e4e4e4;\n",
       " background: #e4e4e4;\n",
       " border-color: #e4e4e4;\n",
       " background-image: none;\n",
       " box-shadow: none !important;\n",
       " border-radius: 1px;\n",
       "}\n",
       ".item_buttons > .btn,\n",
       ".item_buttons > .btn-group,\n",
       ".item_buttons > .input-group {\n",
       " margin-left: 5px;\n",
       " background: #eeeeee;\n",
       " background-color: #eeeeee;\n",
       " border: 1px solid #eeeeee;\n",
       "}\n",
       ".item_buttons > .btn:hover,\n",
       ".item_buttons > .btn-group:hover,\n",
       ".item_buttons > .input-group:hover {\n",
       " margin-left: 5px;\n",
       " background: #e9e9e9;\n",
       " background-color: #e9e9e9;\n",
       " border: 1px solid #e9e9e9;\n",
       "}\n",
       ".btn-group > .btn-mini,\n",
       ".btn-sm,\n",
       ".btn-group-sm > .btn,\n",
       ".btn-xs,\n",
       ".btn-group-xs > .btn,\n",
       ".alternate_upload .btn-upload,\n",
       ".btn-group,\n",
       ".btn-group-vertical {\n",
       " font-size: 12.0pt;\n",
       " font-weight: normal;\n",
       "}\n",
       ".btn-xs,\n",
       ".btn-group-xs > .btn {\n",
       " font-size: 12.0pt;\n",
       " background-image: none;\n",
       " font-weight: normal;\n",
       " text-shadow: none;\n",
       " display: inline-table;\n",
       "}\n",
       ".btn-group > .btn:first-child {\n",
       " margin-left: 3px;\n",
       "}\n",
       ".alternate_upload .btn-upload {\n",
       " display: none;\n",
       "}\n",
       "button.close {\n",
       " border: 0px none;\n",
       " font-family: sans-serif;\n",
       " font-size: 25pt;\n",
       "}\n",
       ".dynamic-buttons {\n",
       " font-size: inherit;\n",
       " padding-top: 0px;\n",
       " display: inline-block;\n",
       "}\n",
       ".close {\n",
       " color: #de143d;\n",
       " opacity: .5;\n",
       " text-shadow: none;\n",
       "}\n",
       ".close:hover {\n",
       " color: #de143d;\n",
       " opacity: 1;\n",
       "}\n",
       "div.btn.btn-default.output_collapsed {\n",
       " background: #eeeeee;\n",
       " background-color: #eeeeee;\n",
       " border-color: #eeeeee;\n",
       "}\n",
       "div.btn.btn-default.output_collapsed:hover {\n",
       " background: #e9e9e9;\n",
       " background-color: #e9e9e9;\n",
       " border-color: #e9e9e9;\n",
       "}\n",
       "div.nbext-enable-btns .btn[disabled],\n",
       "div.nbext-enable-btns .btn[disabled]:hover,\n",
       ".btn-default.disabled,\n",
       ".btn-default[disabled],\n",
       ".btn-default.disabled:hover,\n",
       ".btn-default[disabled]:hover,\n",
       "fieldset[disabled] .btn-default:hover,\n",
       ".btn-default.disabled:focus,\n",
       ".btn-default[disabled]:focus,\n",
       "fieldset[disabled] .btn-default:focus,\n",
       ".btn-default.disabled.focus,\n",
       ".btn-default[disabled].focus,\n",
       "fieldset[disabled] .btn-default.focus {\n",
       " color: #4a4a4a;\n",
       " background: #e8e8e8;\n",
       " background-color: #e8e8e8;\n",
       " border-color: #e8e8e8;\n",
       "}\n",
       ".input-group-addon {\n",
       " padding: 2px 5px;\n",
       " font-size: 12.0pt;\n",
       " font-weight: normal;\n",
       " height: auto;\n",
       " color: #303030;\n",
       " text-align: center;\n",
       " background-color: #ffffff;\n",
       " border: none;\n",
       "}\n",
       ".btn-group > .btn + .dropdown-toggle {\n",
       " padding-left: 8px;\n",
       " padding-right: 8px;\n",
       " height: 100%;\n",
       " border-left: 2px solid #ff7823 !important;\n",
       "}\n",
       ".btn-group > .btn + .dropdown-toggle:hover {\n",
       " border-left: 2px solid #ff7823 !important;\n",
       "}\n",
       ".input-group-btn {\n",
       " position: relative;\n",
       " font-size: inherit;\n",
       " white-space: nowrap;\n",
       "}\n",
       ".input-group-btn:first-child > .btn,\n",
       ".input-group-btn:first-child > .btn-group {\n",
       " background: #eeeeee;\n",
       " background-color: #eeeeee;\n",
       " border: 1px solid #ebebeb;\n",
       " margin: 2px;\n",
       " font-size: inherit;\n",
       "}\n",
       ".input-group-btn:first-child > .btn:hover,\n",
       ".input-group-btn:first-child > .btn-group:hover {\n",
       " background: #e9e9e9;\n",
       " background-color: #e9e9e9;\n",
       " border: 1px solid #e9e9e9;\n",
       " margin: 2px;\n",
       " font-size: inherit;\n",
       "}\n",
       "div.modal .btn-group > .btn:first-child {\n",
       " background: #eeeeee;\n",
       " background-color: #eeeeee;\n",
       " border: 1px solid #ebebeb;\n",
       " margin-top: 0px !important;\n",
       " margin-left: 0px;\n",
       " margin-bottom: 2px;\n",
       "}\n",
       "div.modal .btn-group > .btn:first-child:hover {\n",
       " background: #e9e9e9;\n",
       " background-color: #e9e9e9;\n",
       " border: 1px solid #e9e9e9;\n",
       "}\n",
       "div.modal > button,\n",
       "div.modal-footer > button {\n",
       " background: #eeeeee;\n",
       " background-color: #eeeeee;\n",
       " border-color: #eeeeee;\n",
       "}\n",
       "div.modal > button:hover,\n",
       "div.modal-footer > button:hover {\n",
       " background: #e9e9e9;\n",
       " background-color: #e9e9e9;\n",
       " border-color: #e9e9e9;\n",
       "}\n",
       ".modal-content {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 12.0pt;\n",
       " position: relative;\n",
       " background: #eeeeee;\n",
       " background-color: #eeeeee;\n",
       " border: none;\n",
       " border-radius: 1px;\n",
       " background-clip: padding-box;\n",
       " outline: none;\n",
       "}\n",
       ".modal-header {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 13pt;\n",
       " color: #303030;\n",
       " background: #eeeeee;\n",
       " background-color: #eeeeee;\n",
       " border-color: rgba(180,180,180,.30);\n",
       " padding: 12px;\n",
       " min-height: 16.4286px;\n",
       "}\n",
       ".modal-content h4 {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 16pt;\n",
       " color: #303030;\n",
       " padding: 5px;\n",
       "}\n",
       ".modal-body {\n",
       " background-color: #ffffff;\n",
       " position: relative;\n",
       " padding: 15px;\n",
       "}\n",
       ".modal-footer {\n",
       " padding: 10px;\n",
       " text-align: right;\n",
       " background-color: #fafafa;\n",
       " border-top: 1px solid rgba(180,180,180,.30);\n",
       "}\n",
       ".alert-info {\n",
       " background-color: #fdfdfd;\n",
       " border-color: rgba(180,180,180,.30);\n",
       " color: #303030;\n",
       "}\n",
       ".modal-header .close {\n",
       " margin-top: -5px;\n",
       " font-size: 25pt;\n",
       "}\n",
       ".modal-backdrop,\n",
       ".modal-backdrop.in {\n",
       " opacity: 0.85;\n",
       " background-color: #d6d6d6;\n",
       "}\n",
       "div.panel,\n",
       "div.panel-default,\n",
       ".panel,\n",
       ".panel-default {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 12.0pt;\n",
       " background-color: #fafafa;\n",
       " color: #303030;\n",
       " margin-bottom: 14px;\n",
       " border: 0;\n",
       " box-shadow: none;\n",
       "}\n",
       "div.panel > .panel-heading,\n",
       "div.panel-default > .panel-heading {\n",
       " font-size: 14pt;\n",
       " color: #303030;\n",
       " background: #eeeeee;\n",
       " background-color: #eeeeee;\n",
       " border: 0;\n",
       "}\n",
       ".modal .modal-dialog {\n",
       " min-width: 950px;\n",
       " margin: 50px auto;\n",
       "}\n",
       "div.container-fluid {\n",
       " margin-right: auto;\n",
       " margin-left: auto;\n",
       " padding-left: 7px;\n",
       " padding-right: 12px;\n",
       "}\n",
       "div.form-control,\n",
       ".form-control {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: inherit;\n",
       " color: #303030;\n",
       " background-color: #ffffff;\n",
       " border: 2px solid #e7e7e7;\n",
       " margin-left: 2px;\n",
       " height: auto;\n",
       " box-shadow: none;\n",
       " padding: 6px 12px;\n",
       " transition: border-color 0.15s ease-in-out 0s, box-shadow 0.15s ease-in-out 0s;\n",
       "}\n",
       ".form-group.list-group-item {\n",
       " color: #303030;\n",
       " background-color: #fafafa;\n",
       " border-color: rgba(180,180,180,.30);\n",
       " margin-bottom: 0px;\n",
       "}\n",
       "input,\n",
       "button,\n",
       "select,\n",
       "textarea {\n",
       " background-color: #ffffff;\n",
       " font-weight: normal;\n",
       " border: 1px solid rgba(180,180,180,.30);\n",
       "}\n",
       "select.form-control.select-xs {\n",
       " height: auto;\n",
       "}\n",
       "div.output.output_scroll {\n",
       " box-shadow: none;\n",
       "}\n",
       "::-webkit-scrollbar-track {\n",
       " -webkit-box-shadow: inset 0 0 6px rgba(0,0,0,0.11);\n",
       " background-color: #d0d0d0;\n",
       " border-radius: 6px;\n",
       "}\n",
       "::-webkit-scrollbar {\n",
       " width: 14px;\n",
       " height: 20px;\n",
       " background-color: #d0d0d0;\n",
       " border-radius: 6px;\n",
       "}\n",
       "::-webkit-scrollbar-thumb {\n",
       " background-color: #ffffff;\n",
       " background-image: -webkit-gradient(linear,40% 0%,75% 86%,from(#ff6b0f ),color-stop(0.5,#ff8b42 ),to(#ff6b0f ));\n",
       " min-height: 100px;\n",
       " border-radius: 2px;\n",
       "}\n",
       "div.input_area {\n",
       " background-color: #efefef;\n",
       " padding-right: 1.2em;\n",
       " border: 0px;\n",
       " border-top-left-radius: 0px;\n",
       " border-top-right-radius: 2px;\n",
       " border-bottom-left-radius: 0px;\n",
       " border-bottom-right-radius: 0px;\n",
       "}\n",
       "div.cell {\n",
       " padding: 0px;\n",
       " background: #efefef;\n",
       " background-color: #efefef;\n",
       " border: medium solid #ffffff;\n",
       " border-top-right-radius: 2px;\n",
       " border-top-left-radius: 2px;\n",
       "}\n",
       "div.cell.selected {\n",
       " background: #efefef;\n",
       " background-color: #efefef;\n",
       " border: medium solid #ff7823;\n",
       " padding: 0px;\n",
       " border-top-right-radius: 2px;\n",
       " border-top-left-radius: 2px;\n",
       "}\n",
       ".edit_mode div.cell.selected {\n",
       " padding: 0px;\n",
       " background: #efefef;\n",
       " background-color: #efefef;\n",
       " border: medium solid #ffd5bb;\n",
       " border-top-right-radius: 2px;\n",
       " border-top-left-radius: 2px;\n",
       "}\n",
       "div.cell.edit_mode {\n",
       " padding: 0px;\n",
       " background: #efefef;\n",
       " background-color: #efefef;\n",
       " border: medium solid #ffd5bb;\n",
       " border-top-right-radius: 2px;\n",
       " border-top-left-radius: 2px;\n",
       "}\n",
       "div.prompt,\n",
       ".prompt {\n",
       " font-family: \"Fira Mono\", monospace;\n",
       " font-size: 9.5pt;\n",
       " font-weight: normal;\n",
       " color: #aaaaaa;\n",
       " line-height: 170%;\n",
       " padding: 0px;\n",
       " padding-top: 4px;\n",
       " padding-left: .25em;\n",
       " text-align: left !important;\n",
       " min-width: 12ex;\n",
       " width: 12ex;\n",
       "}\n",
       "div.prompt.input_prompt {\n",
       " background-color: #efefef;\n",
       " border-right: 2px solid rgba(240,147,43,.50);\n",
       " border-top-left-radius: 2px;\n",
       " border-top-right-radius: 0px;\n",
       " border-bottom-left-radius: 0px;\n",
       " border-bottom-right-radius: 0px;\n",
       " min-width: 12ex;\n",
       " width: 12ex !important;\n",
       "}\n",
       "div.output_wrapper {\n",
       " background-color: #ffffff;\n",
       " border: 0px;\n",
       " margin-bottom: 0em;\n",
       " margin-top: 0em;\n",
       " border-top-right-radius: 0px;\n",
       " border-top-left-radius: 0px;\n",
       " border-bottom-left-radius: 2px;\n",
       " border-bottom-right-radius: 2px;\n",
       "}\n",
       "div.output_subarea.output_text.output_stream.output_stdout,\n",
       "div.output_subarea.output_text {\n",
       " font-family: \"Droid Sans Mono\", monospace;\n",
       " font-size: 10.0pt;\n",
       " line-height: 150% !important;\n",
       " background-color: #ffffff;\n",
       " color: #303030;\n",
       " border-top-right-radius: 0px;\n",
       " border-top-left-radius: 0px;\n",
       " border-bottom-left-radius: 2px;\n",
       " border-bottom-right-radius: 2px;\n",
       "}\n",
       "div.output_area pre {\n",
       " font-family: \"Droid Sans Mono\", monospace;\n",
       " font-size: 10.0pt;\n",
       " line-height: 150% !important;\n",
       " color: #303030;\n",
       " border-top-right-radius: 0px;\n",
       " border-top-left-radius: 0px;\n",
       " border-bottom-left-radius: 2px;\n",
       " border-bottom-right-radius: 2px;\n",
       "}\n",
       "div.output_area {\n",
       " display: -webkit-box;\n",
       "}\n",
       "div.output_html {\n",
       " font-family: \"Droid Sans Mono\", monospace;\n",
       " font-size: 10.0pt;\n",
       " color: #353535;\n",
       " background-color: #ffffff;\n",
       " background: #ffffff;\n",
       "}\n",
       "div.output_subarea {\n",
       " overflow-x: auto;\n",
       " padding: .8em;\n",
       " -webkit-box-flex: 1;\n",
       " -moz-box-flex: 1;\n",
       " box-flex: 1;\n",
       " flex: 1;\n",
       " max-width: 90%;\n",
       "}\n",
       "div.prompt.output_prompt {\n",
       " font-family: \"Fira Mono\", monospace;\n",
       " font-size: 9.5pt;\n",
       " background-color: #ffffff;\n",
       " color: #ffffff;\n",
       " border-bottom-left-radius: 2px;\n",
       " border-top-right-radius: 0px;\n",
       " border-top-left-radius: 0px;\n",
       " border-bottom-right-radius: 0px;\n",
       " min-width: 12ex;\n",
       " width: 12ex;\n",
       "}\n",
       "div.out_prompt_overlay.prompt {\n",
       " font-family: \"Fira Mono\", monospace;\n",
       " font-size: 9.5pt;\n",
       " background-color: #ffffff;\n",
       " border-bottom-left-radius: 2px;\n",
       " border-top-right-radius: 0px;\n",
       " border-top-left-radius: 0px;\n",
       " border-bottom-right-radius: 0px;\n",
       " min-width: 12ex;\n",
       " width: 12ex;\n",
       "}\n",
       "div.out_prompt_overlay.prompt:hover {\n",
       " background-color: #ffffff;\n",
       " box-shadow: #e8e8e8 2px 1px 2px 2.5px inset;\n",
       " border-bottom-left-radius: 2px;\n",
       " -webkit-border-: 2px;\n",
       " -moz-border-radius: 2px;\n",
       " border-top-right-radius: 0px;\n",
       " border-top-left-radius: 0px;\n",
       " min-width: 12ex;\n",
       " width: 12ex !important;\n",
       "}\n",
       "div.text_cell,\n",
       "div.text_cell_render pre,\n",
       "div.text_cell_render {\n",
       " font-family: \"Lora\", serif;\n",
       " font-size: 20pt;\n",
       " line-height: 170% !important;\n",
       " color: #353535;\n",
       " background: #ffffff;\n",
       " background-color: #ffffff;\n",
       " border-radius: 2px;\n",
       " min-height: 500px;\n",
       "}\n",
       "div.cell.text_cell.rendered.selected {\n",
       " font-family: \"Lora\", serif;\n",
       " border: medium solid #126dce;\n",
       " line-height: 170% !important;\n",
       " background: #ffffff;\n",
       " background-color: #ffffff;\n",
       " border-radius: 2px;\n",
       " \n",
       "}\n",
       "div.cell.text_cell.unrendered.selected {\n",
       " font-family: \"Lora\", serif;\n",
       " line-height: 170% !important;\n",
       " background: #ffffff;\n",
       " background-color: #ffffff;\n",
       " border: medium solid #126dce;\n",
       " border-radius: 2px;\n",
       "}\n",
       "div.cell.text_cell.selected {\n",
       " font-family: \"Lora\", serif;\n",
       " line-height: 170% !important;\n",
       " border: medium solid #126dce;\n",
       " background: #ffffff;\n",
       " background-color: #ffffff;\n",
       " border-radius: 2px;\n",
       "}\n",
       ".edit_mode div.cell.text_cell.selected {\n",
       " font-family: \"Lora\", serif;\n",
       " line-height: 170% !important;\n",
       " background: #ffffff;\n",
       " background-color: #ffffff;\n",
       " border: medium solid #87b0db;\n",
       " border-radius: 2px;\n",
       "}\n",
       "div.text_cell.unrendered,\n",
       "div.text_cell.unrendered.selected,\n",
       "div.edit_mode div.text_cell.unrendered {\n",
       " font-family: \"Lora\", serif;\n",
       " line-height: 170% !important;\n",
       " background: #ffffff;\n",
       " background-color: #ffffff;\n",
       " border-radius: 2px;\n",
       "}\n",
       "div.cell.text_cell.rendered .input_prompt {\n",
       " font-family: \"Fira Mono\", monospace;\n",
       " font-size: 9.5pt;\n",
       " font-weight: normal;\n",
       " color: #aaaaaa;\n",
       " text-align: left !important;\n",
       " min-width: 0ex;\n",
       " width: 0ex !important;\n",
       " background-color: #ffffff;\n",
       " border-right: 2px solid transparent;\n",
       "}\n",
       "div.cell.text_cell.unrendered .input_prompt {\n",
       " font-family: \"Fira Mono\", monospace;\n",
       " font-size: 9.5pt;\n",
       " font-weight: normal;\n",
       " color: #aaaaaa;\n",
       " text-align: left !important;\n",
       " min-width: 0ex;\n",
       " width: 0ex !important;\n",
       " border-right: 2px solid transparent;\n",
       "}\n",
       "div.rendered_html code {\n",
       " font-family: \"Droid Sans Mono\", monospace;\n",
       " font-size: 11pt;\n",
       " padding-top: 3px;\n",
       " color: #303030;\n",
       " background: #efefef;\n",
       " background-color: #efefef;\n",
       "}\n",
       "pre,\n",
       "code,\n",
       "kbd,\n",
       "samp {\n",
       " white-space: pre-wrap;\n",
       "}\n",
       "code {\n",
       " font-family: \"Droid Sans Mono\", monospace;\n",
       " font-size: 11pt !important;\n",
       " line-height: 170% !important;\n",
       " color: #353535;\n",
       " background: #efefef;\n",
       " background-color: #efefef;\n",
       "}\n",
       "kbd {\n",
       " padding: 4px;\n",
       " font-size: 11pt;\n",
       " color: #303030;\n",
       " background-color: #efefef;\n",
       " border: 0;\n",
       " box-shadow: none;\n",
       "}\n",
       "pre {\n",
       " display: block;\n",
       " padding: 8.5px;\n",
       " margin: 0 0 9px;\n",
       " font-size: 12.0pt;\n",
       " line-height: 1.42857143;\n",
       " color: #303030;\n",
       " background-color: #efefef;\n",
       " border: 1px solid #e7e7e7;\n",
       " border-radius: 2px;\n",
       "}\n",
       "div.rendered_html {\n",
       " color: #353535;\n",
       "}\n",
       "div.rendered_html pre,\n",
       "div.text_cell_render pre {\n",
       " font-family: \"Droid Sans Mono\", monospace;\n",
       " font-size: 11pt !important;\n",
       " line-height: 170% !important;\n",
       " color: #353535;\n",
       " background: #efefef;\n",
       " background-color: #efefef;\n",
       " border: 2px #e7e7e7 solid;\n",
       " max-width: 86%;\n",
       " border-radius: 2px;\n",
       " padding: 5px;\n",
       " min-height: 1px;\n",
       "}\n",
       "div.text_cell_render h1,\n",
       "div.rendered_html h1,\n",
       "div.text_cell_render h2,\n",
       "div.rendered_html h2,\n",
       "div.text_cell_render h3,\n",
       "div.rendered_html h3,\n",
       "div.text_cell_render h4,\n",
       "div.rendered_html h4,\n",
       "div.text_cell_render h5,\n",
       "div.rendered_html h5 {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       "}\n",
       ".rendered_html h1:first-child,\n",
       ".rendered_html h2:first-child,\n",
       ".rendered_html h3:first-child,\n",
       ".rendered_html h4:first-child,\n",
       ".rendered_html h5:first-child,\n",
       ".rendered_html h6:first-child {\n",
       " margin-top: 0.2em;\n",
       "}\n",
       ".rendered_html h1,\n",
       ".text_cell_render h1 {\n",
       " color: #126dce;\n",
       " font-size: 220%;\n",
       " text-align: center;\n",
       " font-weight: lighter;\n",
       "}\n",
       ".rendered_html h2,\n",
       ".text_cell_render h2 {\n",
       " text-align: left;\n",
       " font-size: 170%;\n",
       " color: #126dce;\n",
       " font-style: normal;\n",
       " font-weight: lighter;\n",
       "}\n",
       ".rendered_html h3,\n",
       ".text_cell_render h3 {\n",
       " font-size: 150%;\n",
       " color: #126dce;\n",
       " font-weight: lighter;\n",
       " text-decoration: italic;\n",
       " font-style: normal;\n",
       "}\n",
       ".rendered_html h4,\n",
       ".text_cell_render h4 {\n",
       " font-size: 120%;\n",
       " color: #126dce;\n",
       " font-weight: underline;\n",
       " font-style: normal;\n",
       "}\n",
       ".rendered_html h5,\n",
       ".text_cell_render h5 {\n",
       " font-size: 100%;\n",
       " color: #2f2f2f;\n",
       " font-weight: lighter;\n",
       " text-decoration: underline;\n",
       "}\n",
       ".rendered_html table,\n",
       ".rendered_html tr,\n",
       ".rendered_html td {\n",
       " font-family: \"Fira Mono\", monospace;\n",
       " font-size: 10.0pt !important;\n",
       " line-height: 150% !important;\n",
       " border: 1px solid #d6d6d6;\n",
       " color: #353535;\n",
       " background-color: #ffffff;\n",
       " background: #ffffff;\n",
       "}\n",
       "table.dataframe,\n",
       ".rendered_html tr,\n",
       ".dataframe * {\n",
       " font-family: \"Fira Mono\", monospace;\n",
       " font-size: 10.0pt !important;\n",
       " border: 1px solid #d6d6d6;\n",
       "}\n",
       ".dataframe th,\n",
       ".rendered_html th {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 11pt !important;\n",
       " font-weight: bold;\n",
       " border: 1px solid #c4c4c4;\n",
       " background: #eeeeee;\n",
       "}\n",
       ".dataframe td,\n",
       ".rendered_html td {\n",
       " font-family: \"Fira Mono\", monospace;\n",
       " font-size: 10.0pt !important;\n",
       " color: #353535;\n",
       " background: #ffffff;\n",
       " border: 1px solid #d6d6d6;\n",
       " text-align: left;\n",
       " min-width: 4em;\n",
       "}\n",
       ".dataframe-summary-row tr:last-child,\n",
       ".dataframe-summary-col td:last-child {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 11pt !important;\n",
       " font-weight: bold;\n",
       " color: #353535;\n",
       " border: 1px solid #d6d6d6;\n",
       " background: #eeeeee;\n",
       "}\n",
       "div.widget-area {\n",
       " background-color: #ffffff;\n",
       " background: #ffffff;\n",
       " color: #303030;\n",
       "}\n",
       "div.widget-area a {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 12.0pt;\n",
       " font-weight: normal;\n",
       " font-style: normal;\n",
       " color: #303030;\n",
       " text-shadow: none !important;\n",
       "}\n",
       "div.widget-area a:hover,\n",
       "div.widget-area a:focus {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 12.0pt;\n",
       " font-weight: normal;\n",
       " font-style: normal;\n",
       " color: #2f2f2f;\n",
       " background: rgba(180,180,180,.14);\n",
       " background-color: rgba(180,180,180,.14);\n",
       " border-color: transparent;\n",
       " background-image: none;\n",
       " text-shadow: none !important;\n",
       "}\n",
       "div.widget_item.btn-group > button.btn.btn-default.widget-combo-btn,\n",
       "div.widget_item.btn-group > button.btn.btn-default.widget-combo-btn:hover {\n",
       " background: #eeeeee;\n",
       " background-color: #eeeeee;\n",
       " border: 2px solid #eeeeee !important;\n",
       " font-size: inherit;\n",
       " z-index: 0;\n",
       "}\n",
       "div.jupyter-widgets.widget-hprogress.widget-hbox,\n",
       "div.widget-hbox,\n",
       ".widget-hbox {\n",
       " display: inline-table;\n",
       "}\n",
       "div.jupyter-widgets.widget-hprogress.widget-hbox .widget-label,\n",
       "div.widget-hbox .widget-label,\n",
       ".widget-hbox .widget-label {\n",
       " font-size: 11pt;\n",
       " min-width: 100%;\n",
       " padding-top: 5px;\n",
       " padding-right: 10px;\n",
       " text-align: left;\n",
       " vertical-align: text-top;\n",
       "}\n",
       ".progress {\n",
       " overflow: hidden;\n",
       " height: 20px;\n",
       " margin-bottom: 10px;\n",
       " padding-left: 10px;\n",
       " background-color: #c6c6c6;\n",
       " border-radius: 4px;\n",
       " -webkit-box-shadow: none;\n",
       " box-shadow: none;\n",
       "}\n",
       ".rendered_html :link {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 100%;\n",
       " color: #2c85f7;\n",
       " text-decoration: underline;\n",
       "}\n",
       ".rendered_html :visited,\n",
       ".rendered_html :visited:active,\n",
       ".rendered_html :visited:focus {\n",
       " color: #2e6eb2;\n",
       "}\n",
       ".rendered_html :visited:hover,\n",
       ".rendered_html :link:hover {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 100%;\n",
       " color: #eb6a18;\n",
       "}\n",
       "a.anchor-link:link:hover {\n",
       " font-size: inherit;\n",
       " color: #eb6a18;\n",
       "}\n",
       "a.anchor-link:link {\n",
       " font-size: inherit;\n",
       " text-decoration: none;\n",
       " padding: 0px 20px;\n",
       " visibility: none;\n",
       " color: #126dce;\n",
       "}\n",
       ".navbar-text {\n",
       " margin-top: 4px;\n",
       " margin-bottom: 0px;\n",
       "}\n",
       "div#nbextensions-configurator-container.container,\n",
       "#nbextensions-configurator-container.container {\n",
       " width: 100%;\n",
       " margin-right: auto;\n",
       " margin-left: auto;\n",
       "}\n",
       "div.nbext-selector > nav > .nav > li > a {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 12pt;\n",
       "}\n",
       "div.nbext-readme > .nbext-readme-contents > .rendered_html {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 12pt;\n",
       " line-height: 145%;\n",
       " padding: 1em 1em;\n",
       " color: #353535;\n",
       " background-color: #ffffff;\n",
       " -webkit-box-shadow: none;\n",
       " -moz-box-shadow: none;\n",
       " box-shadow: none;\n",
       "}\n",
       ".nbext-icon,\n",
       ".nbext-desc,\n",
       ".nbext-compat-div,\n",
       ".nbext-enable-btns,\n",
       ".nbext-params {\n",
       " margin-bottom: 8px;\n",
       " font-size: 12pt;\n",
       "}\n",
       "div.nbext-readme > .nbext-readme-contents {\n",
       " padding: 0;\n",
       " overflow-y: hidden;\n",
       "}\n",
       "div.nbext-readme > .nbext-readme-contents:not(:empty) {\n",
       " margin-top: 0.5em;\n",
       " margin-bottom: 2em;\n",
       " border: none;\n",
       " border-top-color: rgba(180,180,180,.30);\n",
       "}\n",
       ".nbext-showhide-incompat {\n",
       " padding-bottom: 0.5em;\n",
       " color: #4a4a4a;\n",
       " font-size: 12.0pt;\n",
       "}\n",
       ".shortcut_key,\n",
       "span.shortcut_key {\n",
       " display: inline-block;\n",
       " width: 16ex;\n",
       " text-align: right;\n",
       " font-family: monospace;\n",
       "}\n",
       "mark,\n",
       ".mark {\n",
       " background-color: #ffffff;\n",
       " color: #353535;\n",
       " padding: .15em;\n",
       "}\n",
       "a.text-warning,\n",
       "a.text-warning:hover {\n",
       " color: #aaaaaa;\n",
       "}\n",
       "a.text-warning.bg-warning {\n",
       " background-color: #ffffff;\n",
       "}\n",
       "span.bg-success.text-success {\n",
       " background-color: transparent;\n",
       " color: #009e07;\n",
       "}\n",
       "span.bg-danger.text-danger {\n",
       " background-color: #ffffff;\n",
       " color: #de143d;\n",
       "}\n",
       ".has-success .input-group-addon {\n",
       " color: #009e07;\n",
       " border-color: transparent;\n",
       " background: inherit;\n",
       " background-color: rgba(83,180,115,.10);\n",
       "}\n",
       ".has-success .form-control {\n",
       " border-color: #009e07;\n",
       " -webkit-box-shadow: inset 0 1px 1px rgba(0,0,0,0.025);\n",
       " box-shadow: inset 0 1px 1px rgba(0,0,0,0.025);\n",
       "}\n",
       ".has-error .input-group-addon {\n",
       " color: #de143d;\n",
       " border-color: transparent;\n",
       " background: inherit;\n",
       " background-color: rgba(192,57,67,.10);\n",
       "}\n",
       ".has-error .form-control {\n",
       " border-color: #de143d;\n",
       " -webkit-box-shadow: inset 0 1px 1px rgba(0,0,0,0.025);\n",
       " box-shadow: inset 0 1px 1px rgba(0,0,0,0.025);\n",
       "}\n",
       ".kse-input-group-pretty > kbd {\n",
       " font-family: \"Droid Sans Mono\", monospace;\n",
       " color: #303030;\n",
       " font-weight: normal;\n",
       " background: transparent;\n",
       "}\n",
       ".kse-input-group-pretty > kbd {\n",
       " font-family: \"Droid Sans Mono\", monospace;\n",
       " color: #303030;\n",
       " font-weight: normal;\n",
       " background: transparent;\n",
       "}\n",
       "div.nbext-enable-btns .btn[disabled],\n",
       "div.nbext-enable-btns .btn[disabled]:hover,\n",
       ".btn-default.disabled,\n",
       ".btn-default[disabled] {\n",
       " background: #e8e8e8;\n",
       " background-color: #e8e8e8;\n",
       " color: #282828;\n",
       "}\n",
       "label#Keyword-Filter {\n",
       " display: none;\n",
       "}\n",
       ".nav-pills > li.active > a,\n",
       ".nav-pills > li.active > a:hover,\n",
       ".nav-pills > li.active > a:focus {\n",
       " color: #ffffff;\n",
       " background-color: #126dce;\n",
       "}\n",
       ".input-group .nbext-list-btn-add,\n",
       ".input-group-btn:last-child > .btn-group > .btn {\n",
       " background: #eeeeee;\n",
       " background-color: #eeeeee;\n",
       " border-color: #eeeeee;\n",
       "}\n",
       ".input-group .nbext-list-btn-add:hover,\n",
       ".input-group-btn:last-child > .btn-group > .btn:hover {\n",
       " background: #e9e9e9;\n",
       " background-color: #e9e9e9;\n",
       " border-color: #e9e9e9;\n",
       "}\n",
       "#notebook-container > div.cell.code_cell.rendered.selected > div.widget-area > div.widget-subarea > div > div.widget_item.btn-group > button.btn.btn-default.dropdown-toggle.widget-combo-carrot-btn {\n",
       " background: #eeeeee;\n",
       " background-color: #eeeeee;\n",
       " border-color: #eeeeee;\n",
       "}\n",
       "#notebook-container > div.cell.code_cell.rendered.selected > div.widget-area > div.widget-subarea > div > div.widget_item.btn-group > button.btn.btn-default.dropdown-toggle.widget-combo-carrot-btn:hover {\n",
       " background: #e9e9e9;\n",
       " background-color: #e9e9e9;\n",
       " border-color: #e9e9e9;\n",
       "}\n",
       "input.raw_input {\n",
       " font-family: \"Droid Sans Mono\", monospace;\n",
       " font-size: 11pt !important;\n",
       " color: #303030;\n",
       " background-color: #efefef;\n",
       " border-color: #ececec;\n",
       " background: #ececec;\n",
       " width: auto;\n",
       " vertical-align: baseline;\n",
       " padding: 0em 0.25em;\n",
       " margin: 0em 0.25em;\n",
       " -webkit-box-shadow: none;\n",
       " box-shadow: none;\n",
       "}\n",
       "audio,\n",
       "video {\n",
       " display: inline;\n",
       " vertical-align: middle;\n",
       " align-content: center;\n",
       " margin-left: 20%;\n",
       "}\n",
       ".cmd-palette .modal-body {\n",
       " padding: 0px;\n",
       " margin: 0px;\n",
       "}\n",
       ".cmd-palette form {\n",
       " background: #eeeeee;\n",
       " background-color: #eeeeee;\n",
       "}\n",
       ".typeahead-field input:last-child,\n",
       ".typeahead-hint {\n",
       " background: #eeeeee;\n",
       " background-color: #eeeeee;\n",
       " z-index: 1;\n",
       "}\n",
       ".typeahead-field input {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " color: #303030;\n",
       " border: none;\n",
       " font-size: 28pt;\n",
       " display: inline-block;\n",
       " line-height: inherit;\n",
       " padding: 3px 10px;\n",
       " height: 70px;\n",
       "}\n",
       ".typeahead-select {\n",
       " background-color: #eeeeee;\n",
       "}\n",
       "body > div.modal.cmd-palette.typeahead-field {\n",
       " display: table;\n",
       " border-collapse: separate;\n",
       " background-color: #fafafa;\n",
       "}\n",
       ".typeahead-container button {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 28pt;\n",
       " background-color: #d0d0d0;\n",
       " border: none;\n",
       " display: inline-block;\n",
       " line-height: inherit;\n",
       " padding: 3px 10px;\n",
       " height: 70px;\n",
       "}\n",
       ".typeahead-search-icon {\n",
       " min-width: 40px;\n",
       " min-height: 55px;\n",
       " display: block;\n",
       " vertical-align: middle;\n",
       " text-align: center;\n",
       "}\n",
       ".typeahead-container button:focus,\n",
       ".typeahead-container button:hover {\n",
       " color: #2f2f2f;\n",
       " background-color: #ff7823;\n",
       " border-color: #ff7823;\n",
       "}\n",
       ".typeahead-list > li.typeahead-group.active > a,\n",
       ".typeahead-list > li.typeahead-group > a,\n",
       ".typeahead-list > li.typeahead-group > a:focus,\n",
       ".typeahead-list > li.typeahead-group > a:hover {\n",
       " display: none;\n",
       "}\n",
       ".typeahead-dropdown > li > a,\n",
       ".typeahead-list > li > a {\n",
       " color: #303030;\n",
       " text-decoration: none;\n",
       "}\n",
       ".typeahead-dropdown,\n",
       ".typeahead-list {\n",
       " font-family: \"Exo_2\", sans-serif;\n",
       " font-size: 13pt;\n",
       " color: #303030;\n",
       " background-color: #ffffff;\n",
       " border: none;\n",
       " background-clip: padding-box;\n",
       " margin-top: 0px;\n",
       " padding: 3px 2px 3px 0px;\n",
       " line-height: 1.7;\n",
       "}\n",
       ".typeahead-dropdown > li.active > a,\n",
       ".typeahead-dropdown > li > a:focus,\n",
       ".typeahead-dropdown > li > a:hover,\n",
       ".typeahead-list > li.active > a,\n",
       ".typeahead-list > li > a:focus,\n",
       ".typeahead-list > li > a:hover {\n",
       " color: #2f2f2f;\n",
       " background-color: #fafafa;\n",
       " border-color: #fafafa;\n",
       "}\n",
       ".command-shortcut:before {\n",
       " content: \"(command)\";\n",
       " padding-right: 3px;\n",
       " color: #aaaaaa;\n",
       "}\n",
       ".edit-shortcut:before {\n",
       " content: \"(edit)\";\n",
       " padding-right: 3px;\n",
       " color: #aaaaaa;\n",
       "}\n",
       "ul.typeahead-list i {\n",
       " margin-left: 1px;\n",
       " width: 18px;\n",
       " margin-right: 10px;\n",
       "}\n",
       "ul.typeahead-list {\n",
       " max-height: 50vh;\n",
       " overflow: auto;\n",
       "}\n",
       ".typeahead-list > li {\n",
       " position: relative;\n",
       " border: none;\n",
       "}\n",
       "div.input.typeahead-hint,\n",
       "input.typeahead-hint,\n",
       "body > div.modal.cmd-palette.in > div > div > div > form > div > div.typeahead-field > span.typeahead-query > input.typeahead-hint {\n",
       " color: #aaaaaa !important;\n",
       " background-color: transparent;\n",
       " padding: 3px 10px;\n",
       "}\n",
       ".typeahead-dropdown > li > a,\n",
       ".typeahead-list > li > a {\n",
       " display: block;\n",
       " padding: 5px;\n",
       " clear: both;\n",
       " font-weight: 400;\n",
       " line-height: 1.7;\n",
       " border: 1px solid #ffffff;\n",
       " border-bottom-color: rgba(180,180,180,.30);\n",
       "}\n",
       "body > div.modal.cmd-palette.in > div {\n",
       " min-width: 750px;\n",
       " margin: 150px auto;\n",
       "}\n",
       ".typeahead-container strong {\n",
       " font-weight: bolder;\n",
       " color: #ff7823;\n",
       "}\n",
       "#find-and-replace #replace-preview .match,\n",
       "#find-and-replace #replace-preview .insert {\n",
       " color: #ffffff;\n",
       " background-color: #ff7823;\n",
       " border-color: #ff7823;\n",
       " border-style: solid;\n",
       " border-width: 1px;\n",
       " border-radius: 0px;\n",
       "}\n",
       "#find-and-replace #replace-preview .replace .match {\n",
       " background-color: #de143d;\n",
       " border-color: #de143d;\n",
       " border-radius: 0px;\n",
       "}\n",
       "#find-and-replace #replace-preview .replace .insert {\n",
       " background-color: #009e07;\n",
       " border-color: #009e07;\n",
       " border-radius: 0px;\n",
       "}\n",
       "div.CodeMirror,\n",
       "div.CodeMirror pre {\n",
       " font-family: \"Droid Sans Mono\", monospace;\n",
       " font-size: 11pt;\n",
       " line-height: 170%;\n",
       " color: #303030;\n",
       "}\n",
       "div.CodeMirror-lines {\n",
       " padding-bottom: .6em;\n",
       " padding-left: .5em;\n",
       " padding-right: 1.5em;\n",
       " padding-top: 4px;\n",
       "}\n",
       "span.ansiblack {\n",
       " color: #dc4384;\n",
       "}\n",
       "span.ansiblue {\n",
       " color: #009e07;\n",
       "}\n",
       "span.ansigray {\n",
       " color: #ff7823;\n",
       "}\n",
       "span.ansigreen {\n",
       " color: #333333;\n",
       "}\n",
       "span.ansipurple {\n",
       " color: #653bc5;\n",
       "}\n",
       "span.ansicyan {\n",
       " color: #055be0;\n",
       "}\n",
       "span.ansiyellow {\n",
       " color: #ff7823;\n",
       "}\n",
       "span.ansired {\n",
       " color: #de143d;\n",
       "}\n",
       "div.output-stderr {\n",
       " background-color: #ebb5b7;\n",
       "}\n",
       "div.output-stderr pre {\n",
       " color: #000000;\n",
       "}\n",
       "div.js-error {\n",
       " color: #de143d;\n",
       "}\n",
       ".ipython_tooltip {\n",
       " font-family: \"Droid Sans Mono\", monospace;\n",
       " font-size: 11pt;\n",
       " line-height: 170%;\n",
       " border: 2px solid #dadada;\n",
       " background: #eeeeee;\n",
       " background-color: #eeeeee;\n",
       " border-radius: 2px;\n",
       " overflow-x: visible;\n",
       " overflow-y: visible;\n",
       " box-shadow: none;\n",
       " position: absolute;\n",
       " z-index: 1000;\n",
       "}\n",
       ".ipython_tooltip .tooltiptext pre {\n",
       " font-family: \"Droid Sans Mono\", monospace;\n",
       " font-size: 11pt;\n",
       " line-height: 170%;\n",
       " background: #eeeeee;\n",
       " background-color: #eeeeee;\n",
       " color: #303030;\n",
       " overflow-x: visible;\n",
       " overflow-y: visible;\n",
       " max-width: 900px;\n",
       "}\n",
       "div#tooltip.ipython_tooltip {\n",
       " overflow-x: wrap;\n",
       " overflow-y: visible;\n",
       " max-width: 800px;\n",
       "}\n",
       "div.tooltiptext.bigtooltip {\n",
       " overflow-x: visible;\n",
       " overflow-y: scroll;\n",
       " height: 400px;\n",
       " max-width: 800px;\n",
       "}\n",
       ".cm-s-ipython.CodeMirror {\n",
       " font-family: \"Droid Sans Mono\", monospace;\n",
       " font-size: 11pt;\n",
       " background: #efefef;\n",
       " color: #303030;\n",
       " border-radius: 2px;\n",
       " font-style: normal;\n",
       " font-weight: normal;\n",
       "}\n",
       ".cm-s-ipython div.CodeMirror-selected {\n",
       " background: #e0e1e3;\n",
       "}\n",
       ".cm-s-ipython .CodeMirror-gutters {\n",
       " background: #e0e1e3;\n",
       " border: none;\n",
       " border-radius: 0px;\n",
       "}\n",
       ".cm-s-ipython .CodeMirror-linenumber {\n",
       " color: #aaaaaa;\n",
       "}\n",
       ".cm-s-ipython .CodeMirror-cursor {\n",
       " border-left: 2px solid #ff711a;\n",
       "}\n",
       ".cm-s-ipython span.cm-comment {\n",
       " color: #8d8d8d;\n",
       " font-style: italic;\n",
       "}\n",
       ".cm-s-ipython span.cm-atom {\n",
       " color: #055be0;\n",
       "}\n",
       ".cm-s-ipython span.cm-number {\n",
       " color: #ff8132;\n",
       "}\n",
       ".cm-s-ipython span.cm-property {\n",
       " color: #e22978;\n",
       "}\n",
       ".cm-s-ipython span.cm-attribute {\n",
       " color: #de143d;\n",
       "}\n",
       ".cm-s-ipython span.cm-keyword {\n",
       " color: #713bc5;\n",
       " font-weight: normal;\n",
       "}\n",
       ".cm-s-ipython span.cm-string {\n",
       " color: #009e07;\n",
       "}\n",
       ".cm-s-ipython span.cm-meta {\n",
       " color: #aa22ff;\n",
       "}\n",
       ".cm-s-ipython span.cm-operator {\n",
       " color: #055be0;\n",
       "}\n",
       ".cm-s-ipython span.cm-builtin {\n",
       " color: #e22978;\n",
       "}\n",
       ".cm-s-ipython span.cm-variable {\n",
       " color: #303030;\n",
       "}\n",
       ".cm-s-ipython span.cm-variable-2 {\n",
       " color: #de143d;\n",
       "}\n",
       ".cm-s-ipython span.cm-variable-3 {\n",
       " color: #aa22ff;\n",
       "}\n",
       ".cm-s-ipython span.cm-def {\n",
       " color: #e22978;\n",
       " font-weight: normal;\n",
       "}\n",
       ".cm-s-ipython span.cm-error {\n",
       " background: rgba(191,97,106,.40);\n",
       "}\n",
       ".cm-s-ipython span.cm-tag {\n",
       " color: #e22978;\n",
       "}\n",
       ".cm-s-ipython span.cm-link {\n",
       " color: #ff7823;\n",
       "}\n",
       ".cm-s-ipython span.cm-storage {\n",
       " color: #055be0;\n",
       "}\n",
       ".cm-s-ipython span.cm-entity {\n",
       " color: #e22978;\n",
       "}\n",
       ".cm-s-ipython span.cm-quote {\n",
       " color: #009e07;\n",
       "}\n",
       "div.CodeMirror span.CodeMirror-matchingbracket {\n",
       " color: #1c1c1c;\n",
       " background-color: rgba(30,112,199,.30);\n",
       "}\n",
       "div.CodeMirror span.CodeMirror-nonmatchingbracket {\n",
       " color: #1c1c1c;\n",
       " background: rgba(191,97,106,.40) !important;\n",
       "}\n",
       "div.cell.text_cell .cm-s-default .cm-header {\n",
       " color: #126dce;\n",
       "}\n",
       "div.cell.text_cell .cm-s-default span.cm-variable-2 {\n",
       " color: #353535;\n",
       "}\n",
       "div.cell.text_cell .cm-s-default span.cm-variable-3 {\n",
       " color: #aa22ff;\n",
       "}\n",
       ".cm-s-default span.cm-comment {\n",
       " color: #8d8d8d;\n",
       "}\n",
       ".cm-s-default .cm-tag {\n",
       " color: #009fb7;\n",
       "}\n",
       ".cm-s-default .cm-builtin {\n",
       " color: #e22978;\n",
       "}\n",
       ".cm-s-default .cm-string {\n",
       " color: #009e07;\n",
       "}\n",
       ".cm-s-default .cm-keyword {\n",
       " color: #713bc5;\n",
       "}\n",
       ".cm-s-default .cm-number {\n",
       " color: #ff8132;\n",
       "}\n",
       ".cm-s-default .cm-error {\n",
       " color: #055be0;\n",
       "}\n",
       ".CodeMirror-cursor {\n",
       " border-left: 2px solid #ff711a;\n",
       " border-right: none;\n",
       " width: 0;\n",
       "}\n",
       ".cm-s-default div.CodeMirror-selected {\n",
       " background: #e0e1e3;\n",
       "}\n",
       ".cm-s-default .cm-selected {\n",
       " background: #e0e1e3;\n",
       "}\n",
       ".completions {\n",
       " position: absolute;\n",
       " z-index: 110;\n",
       " overflow: hidden;\n",
       " border: medium solid #ff7823;\n",
       " line-height: 1;\n",
       "}\n",
       ".completions select {\n",
       " background: #efefef;\n",
       " outline: none;\n",
       " border: none;\n",
       " padding: 0px;\n",
       " margin: 0px;\n",
       " overflow: auto;\n",
       " font-family: \"Droid Sans Mono\", monospace;\n",
       " font-size: 11pt;\n",
       " color: #303030;\n",
       " width: auto;\n",
       "}\n",
       "/**\n",
       "div#maintoolbar {\n",
       "# display: none !important;\n",
       "#}\n",
       "##header-container {\n",
       "# display: none !important;\n",
       "#}\n",
       "**/\n",
       "\n",
       "\n",
       "/**********************************\n",
       " MathJax Settings and Style Script\n",
       "**********************************/\n",
       ".MathJax_Display,\n",
       ".MathJax nobr>span.math>span {\n",
       "    border: 0 !important;\n",
       "    font-size: 110% !important;\n",
       "    text-align: center !important;\n",
       "    margin: 0em !important;\n",
       "}\n",
       "/* Prevents MathJax from jittering */\n",
       "/* cell position when cell is selected */\n",
       ".MathJax:focus, body :focus .MathJax {\n",
       "    display: inline-block !important;\n",
       "}\n",
       "\n",
       "</style>\n",
       "\n",
       "\n",
       "<script>\n",
       "    MathJax.Hub.Config({\n",
       "        \"HTML-CSS\": {\n",
       "            preferredFont: \"TeX\",\n",
       "            availableFonts: [\"STIX\",\"TeX\"],\n",
       "            styles: {\n",
       "                scale: 110,\n",
       "                \".MathJax_Display\": {\n",
       "                    \"font-size\": \"110%\",\n",
       "                }\n",
       "            }\n",
       "        }\n",
       "});\n",
       "\n",
       "$([IPython.events]).on('notebook_loaded.Notebook',function(){\n",
       "    $('#header').hide();\n",
       "    IPython.keyboard_manager.command_shortcuts.add_shortcut('ctrl-`',function (event) {\n",
       "        if (IPython.notebook.mode == 'command') {\n",
       "            $('#header').toggle();\n",
       "            return false;\n",
       "        }\n",
       "        return true;\n",
       "    });\n",
       "});\n",
       "\n",
       "</script>\n",
       "\n"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "execution_count": 1,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from IPython.core.display import HTML\n",
    "HTML(open('../custom.css').read())"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.2"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}