resid_sens_analysis.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## License \n",
    "\n",
    "Copyright 2017 Patrick Hall and the H2O.ai team\n",
    "\n",
    "Licensed under the Apache License, Version 2.0 (the \"License\");\n",
    "you may not use this file except in compliance with the License.\n",
    "You may obtain a copy of the License at\n",
    "\n",
    "    http://www.apache.org/licenses/LICENSE-2.0\n",
    "\n",
    "Unless required by applicable law or agreed to in writing, software\n",
    "distributed under the License is distributed on an \"AS IS\" BASIS,\n",
    "WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n",
    "See the License for the specific language governing permissions and\n",
    "limitations under the License."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**DISCLAIMER:** This notebook is not legal compliance advice."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Testing machine learning models for accuracy, trustworthiness, and stability with Python and H2O\n",
    "#### Performing residual analysis and sensitivity analysis to validate complex models\n",
    "\n",
    "This notebook provides a basic introduction to two traditional data analysis and model diagnostic techniques that can be applied to machine learning models: residual analysis and sensitivity analysis. The notebook starts by loading the UCI credit card default dataset and using h2o to train a GBM model to predict credit card defaults. Then, residual analysis is used to discover and debug an issue with the GBM, and the GBM is retrained and improved. The notebook concludes by conducting sensitivity analysis to test the GBM credit card default model for fairness and stability. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Python imports\n",
    "In general, NumPy and Pandas will be used for data manipulation purposes and h2o will be used for modeling tasks. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "# h2o Python API with specific classes\n",
    "import h2o \n",
    "from h2o.estimators.gbm import H2OGradientBoostingEstimator\n",
    "\n",
    "import numpy as np   # array, vector, matrix calculations\n",
    "import pandas as pd  # DataFrame handling\n",
    "\n",
    "pd.options.display.max_columns = 999 # enable display of all columns in notebook\n",
    "\n",
    "# plotting functionality\n",
    "import matplotlib.pyplot as plt\n",
    "import seaborn as sns\n",
    "\n",
    "# display plots in notebook\n",
    "%matplotlib inline"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Start h2o\n",
    "H2o is both a library and a server. The machine learning algorithms in the library take advantage of the multithreaded and distributed architecture provided by the server to train machine learning algorithms extremely efficiently. The API for the library was imported above in cell 1, but the server still needs to be started."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Checking whether there is an H2O instance running at http://localhost:54321..... not found.\n",
      "Attempting to start a local H2O server...\n",
      "  Java Version: java version \"1.7.0_181\"; OpenJDK Runtime Environment (IcedTea 2.6.14) (7u181-2.6.14-2~deb8u1); OpenJDK 64-Bit Server VM (build 24.181-b01, mixed mode)\n",
      "  Starting server from /opt/conda/lib/python3.6/site-packages/h2o/backend/bin/h2o.jar\n",
      "  Ice root: /tmp/tmp12ed7psq\n",
      "  JVM stdout: /tmp/tmp12ed7psq/h2o_unknownUser_started_from_python.out\n",
      "  JVM stderr: /tmp/tmp12ed7psq/h2o_unknownUser_started_from_python.err\n",
      "  Server is running at http://127.0.0.1:54321\n",
      "Connecting to H2O server at http://127.0.0.1:54321... successful.\n",
      "Warning: Your H2O cluster version is too old (1 year, 3 months and 26 days)! Please download and install the latest version from http://h2o.ai/download/\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div style=\"overflow:auto\"><table style=\"width:50%\"><tr><td>H2O cluster uptime:</td>\n",
       "<td>02 secs</td></tr>\n",
       "<tr><td>H2O cluster version:</td>\n",
       "<td>3.16.0.1</td></tr>\n",
       "<tr><td>H2O cluster version age:</td>\n",
       "<td>1 year, 3 months and 26 days !!!</td></tr>\n",
       "<tr><td>H2O cluster name:</td>\n",
       "<td>H2O_from_python_unknownUser_4o5avs</td></tr>\n",
       "<tr><td>H2O cluster total nodes:</td>\n",
       "<td>1</td></tr>\n",
       "<tr><td>H2O cluster free memory:</td>\n",
       "<td>1.778 Gb</td></tr>\n",
       "<tr><td>H2O cluster total cores:</td>\n",
       "<td>4</td></tr>\n",
       "<tr><td>H2O cluster allowed cores:</td>\n",
       "<td>4</td></tr>\n",
       "<tr><td>H2O cluster status:</td>\n",
       "<td>accepting new members, healthy</td></tr>\n",
       "<tr><td>H2O connection url:</td>\n",
       "<td>http://127.0.0.1:54321</td></tr>\n",
       "<tr><td>H2O connection proxy:</td>\n",
       "<td>None</td></tr>\n",
       "<tr><td>H2O internal security:</td>\n",
       "<td>False</td></tr>\n",
       "<tr><td>H2O API Extensions:</td>\n",
       "<td>AutoML, XGBoost, Algos, Core V3, Core V4</td></tr>\n",
       "<tr><td>Python version:</td>\n",
       "<td>3.6.4 final</td></tr></table></div>"
      ],
      "text/plain": [
       "--------------------------  ----------------------------------------\n",
       "H2O cluster uptime:         02 secs\n",
       "H2O cluster version:        3.16.0.1\n",
       "H2O cluster version age:    1 year, 3 months and 26 days !!!\n",
       "H2O cluster name:           H2O_from_python_unknownUser_4o5avs\n",
       "H2O cluster total nodes:    1\n",
       "H2O cluster free memory:    1.778 Gb\n",
       "H2O cluster total cores:    4\n",
       "H2O cluster allowed cores:  4\n",
       "H2O cluster status:         accepting new members, healthy\n",
       "H2O connection url:         http://127.0.0.1:54321\n",
       "H2O connection proxy:\n",
       "H2O internal security:      False\n",
       "H2O API Extensions:         AutoML, XGBoost, Algos, Core V3, Core V4\n",
       "Python version:             3.6.4 final\n",
       "--------------------------  ----------------------------------------"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "h2o.init(max_mem_size='2G')       # start h2o\n",
    "h2o.remove_all()                  # remove any existing data structures from h2o memory"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 1. Download, explore, and prepare UCI credit card default data\n",
    "\n",
    "UCI credit card default data: https://archive.ics.uci.edu/ml/datasets/default+of+credit+card+clients\n",
    "\n",
    "The UCI credit card default data contains demographic and payment information about credit card customers in Taiwan in the year 2005. The data set contains 23 input variables: \n",
    "\n",
    "* **`LIMIT_BAL`**: Amount of given credit (NT dollar)\n",
    "* **`SEX`**: 1 = male; 2 = female\n",
    "* **`EDUCATION`**: 1 = graduate school; 2 = university; 3 = high school; 4 = others \n",
    "* **`MARRIAGE`**: 1 = married; 2 = single; 3 = others\n",
    "* **`AGE`**: Age in years \n",
    "* **`PAY_0`, `PAY_2` - `PAY_6`**: History of past payment; `PAY_0` = the repayment status in September, 2005; `PAY_2` = the repayment status in August, 2005; ...; `PAY_6` = the repayment status in April, 2005. The measurement scale for the repayment status is: -1 = pay duly; 1 = payment delay for one month; 2 = payment delay for two months; ...; 8 = payment delay for eight months; 9 = payment delay for nine months and above. \n",
    "* **`BILL_AMT1` - `BILL_AMT6`**: Amount of bill statement (NT dollar). `BILL_AMNT1` = amount of bill statement in September, 2005; `BILL_AMT2` = amount of bill statement in August, 2005; ...; `BILL_AMT6` = amount of bill statement in April, 2005. \n",
    "* **`PAY_AMT1` - `PAY_AMT6`**: Amount of previous payment (NT dollar). `PAY_AMT1` = amount paid in September, 2005; `PAY_AMT2` = amount paid in August, 2005; ...; `PAY_AMT6` = amount paid in April, 2005. \n",
    "\n",
    "These 23 input variables are used to predict the target variable, whether or not a customer defaulted on their credit card bill in late 2005.\n",
    "\n",
    "Because h2o accepts both numeric and character inputs, some variables will be recoded into more transparent character values."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Import data and clean\n",
    "The credit card default data is available as an `.xls` file. Pandas reads `.xls` files automatically, so it's used to load the credit card default data and give the prediction target a shorter name: `DEFAULT_NEXT_MONTH`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "# import XLS file\n",
    "path = 'default_of_credit_card_clients.xls'\n",
    "data = pd.read_excel(path,\n",
    "                     skiprows=1)\n",
    "\n",
    "# remove spaces from target column name \n",
    "data = data.rename(columns={'default payment next month': 'DEFAULT_NEXT_MONTH'}) "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Assign modeling roles\n",
    "The shorthand name `y` is assigned to the prediction target. `X` is assigned to all other input variables in the credit card default data except the row indentifier, `ID`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "y = DEFAULT_NEXT_MONTH\n",
      "X = ['LIMIT_BAL', 'SEX', 'EDUCATION', 'MARRIAGE', 'AGE', 'PAY_0', 'PAY_2', 'PAY_3', 'PAY_4', 'PAY_5', 'PAY_6', 'BILL_AMT1', 'BILL_AMT2', 'BILL_AMT3', 'BILL_AMT4', 'BILL_AMT5', 'BILL_AMT6', 'PAY_AMT1', 'PAY_AMT2', 'PAY_AMT3', 'PAY_AMT4', 'PAY_AMT5', 'PAY_AMT6']\n"
     ]
    }
   ],
   "source": [
    "# assign target and inputs for GBM\n",
    "y = 'DEFAULT_NEXT_MONTH'\n",
    "X = [name for name in data.columns if name not in [y, 'ID']]\n",
    "print('y =', y)\n",
    "print('X =', X)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Helper function for recoding values in the UCI credict card default data\n",
    "This simple function maps longer, more understandable character string values from the UCI credit card default data dictionary to the original integer values of the input variables found in the dataset. These character values can be used directly in h2o decision tree models, and the function returns the original Pandas DataFrame as an h2o object, an H2OFrame. H2o models cannot run on Pandas DataFrames. They require H2OFrames."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Parse progress: |█████████████████████████████████████████████████████████| 100%\n"
     ]
    }
   ],
   "source": [
    "def recode_cc_data(frame):\n",
    "    \n",
    "    \"\"\" Recodes numeric categorical variables into categorical character variables\n",
    "    with more transparent values. \n",
    "    \n",
    "    Args:\n",
    "        frame: Pandas DataFrame version of UCI credit card default data.\n",
    "        \n",
    "    Returns: \n",
    "        H2OFrame with recoded values.\n",
    "        \n",
    "    \"\"\"\n",
    "    \n",
    "    # define recoded values\n",
    "    sex_dict = {1:'male', 2:'female'}\n",
    "    education_dict = {0:'other', 1:'graduate school', 2:'university', 3:'high school', \n",
    "                      4:'other', 5:'other', 6:'other'}\n",
    "    marriage_dict = {0:'other', 1:'married', 2:'single', 3:'divorced'}\n",
    "    pay_dict = {-2:'no consumption', -1:'pay duly', 0:'use of revolving credit', 1:'1 month delay', \n",
    "                2:'2 month delay', 3:'3 month delay', 4:'4 month delay', 5:'5 month delay', 6:'6 month delay', \n",
    "                7:'7 month delay', 8:'8 month delay', 9:'9+ month delay'}\n",
    "    \n",
    "    # recode values using Pandas apply() and anonymous function\n",
    "    frame['SEX'] = frame['SEX'].apply(lambda i: sex_dict[i])\n",
    "    frame['EDUCATION'] = frame['EDUCATION'].apply(lambda i: education_dict[i])    \n",
    "    frame['MARRIAGE'] = frame['MARRIAGE'].apply(lambda i: marriage_dict[i]) \n",
    "    for name in frame.columns:\n",
    "        if name in ['PAY_0', 'PAY_2', 'PAY_3', 'PAY_4', 'PAY_5', 'PAY_6']:\n",
    "            frame[name] = frame[name].apply(lambda i: pay_dict[i])            \n",
    "                \n",
    "    return h2o.H2OFrame(frame)\n",
    "\n",
    "data = recode_cc_data(data)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Ensure target is handled as a categorical variable\n",
    "In h2o, a numeric variable can be treated as numeric or categorical. The target variable `DEFAULT_NEXT_MONTH` takes on values of `0` or `1`. To ensure this numeric variable is treated as a categorical variable, the `asfactor()` function is used to explicitly declare that it is a categorical variable. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "data[y] = data[y].asfactor() "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Display descriptive statistics\n",
    "The h2o `describe()` function displays a brief description of the credit card default data. For the categorical input variables `LIMIT_BAL`, `SEX`, `EDUCATION`, `MARRIAGE`, and `PAY_0`-`PAY_6`, the new character values created above in cell 5 are visible. Basic descriptive statistics are displayed for numeric inputs."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Rows:30000\n",
      "Cols:25\n",
      "\n",
      "\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "<thead>\n",
       "<tr><th>       </th><th>ID               </th><th>LIMIT_BAL         </th><th>SEX   </th><th>EDUCATION      </th><th>MARRIAGE  </th><th>AGE              </th><th>PAY_0                  </th><th>PAY_2                  </th><th>PAY_3                  </th><th>PAY_4                  </th><th>PAY_5                  </th><th>PAY_6                  </th><th>BILL_AMT1        </th><th>BILL_AMT2        </th><th>BILL_AMT3        </th><th>BILL_AMT4        </th><th>BILL_AMT5        </th><th>BILL_AMT6        </th><th>PAY_AMT1          </th><th>PAY_AMT2          </th><th>PAY_AMT3          </th><th>PAY_AMT4          </th><th>PAY_AMT5          </th><th>PAY_AMT6          </th><th>DEFAULT_NEXT_MONTH  </th></tr>\n",
       "</thead>\n",
       "<tbody>\n",
       "<tr><td>type   </td><td>int              </td><td>int               </td><td>enum  </td><td>enum           </td><td>enum      </td><td>int              </td><td>enum                   </td><td>enum                   </td><td>enum                   </td><td>enum                   </td><td>enum                   </td><td>enum                   </td><td>int              </td><td>int              </td><td>int              </td><td>int              </td><td>int              </td><td>int              </td><td>int               </td><td>int               </td><td>int               </td><td>int               </td><td>int               </td><td>int               </td><td>enum                </td></tr>\n",
       "<tr><td>mins   </td><td>1.0              </td><td>10000.0           </td><td>      </td><td>               </td><td>          </td><td>21.0             </td><td>                       </td><td>                       </td><td>                       </td><td>                       </td><td>                       </td><td>                       </td><td>-165580.0        </td><td>-69777.0         </td><td>-157264.0        </td><td>-170000.0        </td><td>-81334.0         </td><td>-339603.0        </td><td>0.0               </td><td>0.0               </td><td>0.0               </td><td>0.0               </td><td>0.0               </td><td>0.0               </td><td>                    </td></tr>\n",
       "<tr><td>mean   </td><td>15000.5          </td><td>167484.32266666688</td><td>      </td><td>               </td><td>          </td><td>35.48549999999994</td><td>                       </td><td>                       </td><td>                       </td><td>                       </td><td>                       </td><td>                       </td><td>51223.33090000009</td><td>49179.07516666668</td><td>47013.15479999971</td><td>43262.9489666666 </td><td>40311.40096666653</td><td>38871.76039999991</td><td>5663.580500000014 </td><td>5921.16350000001  </td><td>5225.681500000005 </td><td>4826.076866666661 </td><td>4799.387633333302 </td><td>5215.502566666664 </td><td>                    </td></tr>\n",
       "<tr><td>maxs   </td><td>30000.0          </td><td>1000000.0         </td><td>      </td><td>               </td><td>          </td><td>79.0             </td><td>                       </td><td>                       </td><td>                       </td><td>                       </td><td>                       </td><td>                       </td><td>964511.0         </td><td>983931.0         </td><td>1664089.0        </td><td>891586.0         </td><td>927171.0         </td><td>961664.0         </td><td>873552.0          </td><td>1684259.0         </td><td>896040.0          </td><td>621000.0          </td><td>426529.0          </td><td>528666.0          </td><td>                    </td></tr>\n",
       "<tr><td>sigma  </td><td>8660.398374208891</td><td>129747.66156720225</td><td>      </td><td>               </td><td>          </td><td>9.21790406809016 </td><td>                       </td><td>                       </td><td>                       </td><td>                       </td><td>                       </td><td>                       </td><td>73635.86057552959</td><td>71173.76878252836</td><td>69349.38742703681</td><td>64332.85613391641</td><td>60797.1557702648 </td><td>59554.10753674574</td><td>16563.280354025763</td><td>23040.870402057226</td><td>17606.961469803115</td><td>15666.159744031993</td><td>15278.305679144793</td><td>17777.465775435332</td><td>                    </td></tr>\n",
       "<tr><td>zeros  </td><td>0                </td><td>0                 </td><td>      </td><td>               </td><td>          </td><td>0                </td><td>                       </td><td>                       </td><td>                       </td><td>                       </td><td>                       </td><td>                       </td><td>2008             </td><td>2506             </td><td>2870             </td><td>3195             </td><td>3506             </td><td>4020             </td><td>5249              </td><td>5396              </td><td>5968              </td><td>6408              </td><td>6703              </td><td>7173              </td><td>                    </td></tr>\n",
       "<tr><td>missing</td><td>0                </td><td>0                 </td><td>0     </td><td>0              </td><td>0         </td><td>0                </td><td>0                      </td><td>0                      </td><td>0                      </td><td>0                      </td><td>0                      </td><td>0                      </td><td>0                </td><td>0                </td><td>0                </td><td>0                </td><td>0                </td><td>0                </td><td>0                 </td><td>0                 </td><td>0                 </td><td>0                 </td><td>0                 </td><td>0                 </td><td>0                   </td></tr>\n",
       "<tr><td>0      </td><td>1.0              </td><td>20000.0           </td><td>female</td><td>university     </td><td>married   </td><td>24.0             </td><td>2 month delay          </td><td>2 month delay          </td><td>pay duly               </td><td>pay duly               </td><td>no consumption         </td><td>no consumption         </td><td>3913.0           </td><td>3102.0           </td><td>689.0            </td><td>0.0              </td><td>0.0              </td><td>0.0              </td><td>0.0               </td><td>689.0             </td><td>0.0               </td><td>0.0               </td><td>0.0               </td><td>0.0               </td><td>1                   </td></tr>\n",
       "<tr><td>1      </td><td>2.0              </td><td>120000.0          </td><td>female</td><td>university     </td><td>single    </td><td>26.0             </td><td>pay duly               </td><td>2 month delay          </td><td>use of revolving credit</td><td>use of revolving credit</td><td>use of revolving credit</td><td>2 month delay          </td><td>2682.0           </td><td>1725.0           </td><td>2682.0           </td><td>3272.0           </td><td>3455.0           </td><td>3261.0           </td><td>0.0               </td><td>1000.0            </td><td>1000.0            </td><td>1000.0            </td><td>0.0               </td><td>2000.0            </td><td>1                   </td></tr>\n",
       "<tr><td>2      </td><td>3.0              </td><td>90000.0           </td><td>female</td><td>university     </td><td>single    </td><td>34.0             </td><td>use of revolving credit</td><td>use of revolving credit</td><td>use of revolving credit</td><td>use of revolving credit</td><td>use of revolving credit</td><td>use of revolving credit</td><td>29239.0          </td><td>14027.0          </td><td>13559.0          </td><td>14331.0          </td><td>14948.0          </td><td>15549.0          </td><td>1518.0            </td><td>1500.0            </td><td>1000.0            </td><td>1000.0            </td><td>1000.0            </td><td>5000.0            </td><td>0                   </td></tr>\n",
       "<tr><td>3      </td><td>4.0              </td><td>50000.0           </td><td>female</td><td>university     </td><td>married   </td><td>37.0             </td><td>use of revolving credit</td><td>use of revolving credit</td><td>use of revolving credit</td><td>use of revolving credit</td><td>use of revolving credit</td><td>use of revolving credit</td><td>46990.0          </td><td>48233.0          </td><td>49291.0          </td><td>28314.0          </td><td>28959.0          </td><td>29547.0          </td><td>2000.0            </td><td>2019.0            </td><td>1200.0            </td><td>1100.0            </td><td>1069.0            </td><td>1000.0            </td><td>0                   </td></tr>\n",
       "<tr><td>4      </td><td>5.0              </td><td>50000.0           </td><td>male  </td><td>university     </td><td>married   </td><td>57.0             </td><td>pay duly               </td><td>use of revolving credit</td><td>pay duly               </td><td>use of revolving credit</td><td>use of revolving credit</td><td>use of revolving credit</td><td>8617.0           </td><td>5670.0           </td><td>35835.0          </td><td>20940.0          </td><td>19146.0          </td><td>19131.0          </td><td>2000.0            </td><td>36681.0           </td><td>10000.0           </td><td>9000.0            </td><td>689.0             </td><td>679.0             </td><td>0                   </td></tr>\n",
       "<tr><td>5      </td><td>6.0              </td><td>50000.0           </td><td>male  </td><td>graduate school</td><td>single    </td><td>37.0             </td><td>use of revolving credit</td><td>use of revolving credit</td><td>use of revolving credit</td><td>use of revolving credit</td><td>use of revolving credit</td><td>use of revolving credit</td><td>64400.0          </td><td>57069.0          </td><td>57608.0          </td><td>19394.0          </td><td>19619.0          </td><td>20024.0          </td><td>2500.0            </td><td>1815.0            </td><td>657.0             </td><td>1000.0            </td><td>1000.0            </td><td>800.0             </td><td>0                   </td></tr>\n",
       "<tr><td>6      </td><td>7.0              </td><td>500000.0          </td><td>male  </td><td>graduate school</td><td>single    </td><td>29.0             </td><td>use of revolving credit</td><td>use of revolving credit</td><td>use of revolving credit</td><td>use of revolving credit</td><td>use of revolving credit</td><td>use of revolving credit</td><td>367965.0         </td><td>412023.0         </td><td>445007.0         </td><td>542653.0         </td><td>483003.0         </td><td>473944.0         </td><td>55000.0           </td><td>40000.0           </td><td>38000.0           </td><td>20239.0           </td><td>13750.0           </td><td>13770.0           </td><td>0                   </td></tr>\n",
       "<tr><td>7      </td><td>8.0              </td><td>100000.0          </td><td>female</td><td>university     </td><td>single    </td><td>23.0             </td><td>use of revolving credit</td><td>pay duly               </td><td>pay duly               </td><td>use of revolving credit</td><td>use of revolving credit</td><td>pay duly               </td><td>11876.0          </td><td>380.0            </td><td>601.0            </td><td>221.0            </td><td>-159.0           </td><td>567.0            </td><td>380.0             </td><td>601.0             </td><td>0.0               </td><td>581.0             </td><td>1687.0            </td><td>1542.0            </td><td>0                   </td></tr>\n",
       "<tr><td>8      </td><td>9.0              </td><td>140000.0          </td><td>female</td><td>high school    </td><td>married   </td><td>28.0             </td><td>use of revolving credit</td><td>use of revolving credit</td><td>2 month delay          </td><td>use of revolving credit</td><td>use of revolving credit</td><td>use of revolving credit</td><td>11285.0          </td><td>14096.0          </td><td>12108.0          </td><td>12211.0          </td><td>11793.0          </td><td>3719.0           </td><td>3329.0            </td><td>0.0               </td><td>432.0             </td><td>1000.0            </td><td>1000.0            </td><td>1000.0            </td><td>0                   </td></tr>\n",
       "<tr><td>9      </td><td>10.0             </td><td>20000.0           </td><td>male  </td><td>high school    </td><td>single    </td><td>35.0             </td><td>no consumption         </td><td>no consumption         </td><td>no consumption         </td><td>no consumption         </td><td>pay duly               </td><td>pay duly               </td><td>0.0              </td><td>0.0              </td><td>0.0              </td><td>0.0              </td><td>13007.0          </td><td>13912.0          </td><td>0.0               </td><td>0.0               </td><td>0.0               </td><td>13007.0           </td><td>1122.0            </td><td>0.0               </td><td>0                   </td></tr>\n",
       "</tbody>\n",
       "</table>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "data.describe()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 2. Train an H2O GBM classifier"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Split data into training and test sets for early stopping\n",
    "The credit card default data is split into training and test sets to monitor and prevent overtraining. Reproducibility is also important factor in creating trustworthy models, and randomly splitting datasets can introduce randomness in model predictions and other results. A random seed is used here to ensure the data split is reproducible."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Train data rows = 21060, columns = 25\n",
      "Test data rows = 8940, columns = 25\n"
     ]
    }
   ],
   "source": [
    "# split into training and validation\n",
    "train, test = data.split_frame([0.7], seed=12345)\n",
    "\n",
    "# summarize split\n",
    "print('Train data rows = %d, columns = %d' % (train.shape[0], train.shape[1]))\n",
    "print('Test data rows = %d, columns = %d' % (test.shape[0], test.shape[1]))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Train h2o GBM classifier\n",
    "Many tuning parameters must be specified to train a GBM using h2o. Typically a grid search would be performed to identify the best parameters for a given modeling task using the `H2OGridSearch` class. For brevity's sake, a previously-discovered set of good tuning parameters are specified here. Because gradient boosting methods typically resample training data, an additional random seed is also specified for the h2o GBM using the `seed` parameter to create reproducible predictions, error rates, and variable importance values. To avoid overfitting, the `stopping_rounds` parameter is used to stop the training process after the test error fails to decrease for 5 iterations. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "gbm Model Build progress: |███████████████████████████████████████████████| 100%\n",
      "GBM Test AUC = 0.7808\n"
     ]
    }
   ],
   "source": [
    "# initialize GBM model\n",
    "model = H2OGradientBoostingEstimator(ntrees=150,            # maximum 150 trees in GBM\n",
    "                                     max_depth=4,           # trees can have maximum depth of 4\n",
    "                                     sample_rate=0.9,       # use 90% of rows in each iteration (tree)\n",
    "                                     col_sample_rate=0.9,   # use 90% of variables in each iteration (tree)\n",
    "                                     stopping_rounds=5,     # stop if validation error does not decrease for 5 iterations (trees)\n",
    "                                     seed=12345)            # for reproducibility\n",
    "\n",
    "# train a GBM model\n",
    "model.train(y=y, x=X, training_frame=train, validation_frame=test)\n",
    "\n",
    "# print AUC\n",
    "print('GBM Test AUC = %.4f' % model.auc(valid=True))\n",
    "\n",
    "# uncomment to see model details\n",
    "# print(model) "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Display variable importance\n",
    "During training, the h2o GBM aggregates the improvement in error caused by each split in each decision tree across all the decision trees in the ensemble classifier. These values are attributed to the input variable used in each split and give an indication of the contribution each input variable makes toward the model's predictions. The variable importance ranking should be parsimonious with human domain knowledge and reasonable expectations. In this case, a customer's most recent payment behavior, `PAY_0`, is by far the most important variable followed by their second most recent payment, `PAY_2`, their credit limit, `LIMIT_BAL`, and third most recent payment behavior, `PAY_3`. This result is well-aligned with business practices in credit lending: people who miss their most recent payments are likely to default soon."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAA1sAAAJTCAYAAAD+GAzcAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAIABJREFUeJzs3X+4ZVddH/73xww/ElMClBQ10KQSamgZO0hKFAINEeXHIASKkrE+EA0FTLXNtxoNoF+xlhJrKxgtKSAIxH6NRYxFAlEQ0UQQHSE4USkCiZiAvwJGICGRyef7x96XnNycO3Mnc1funeT1ep7znLPXXnvtte+5k5z3XWuvU90dAAAANtaXbXYHAAAA7oqELQAAgAGELQAAgAGELQAAgAGELQAAgAGELQAAgAGELYCDUFWXV9UXN6Cda6rqowdQ//iq6qr62YM9NwAwhrAFHFKq6n/NIeOsddT99bnuM+6Mvt3VzEGyq+rkze7LaAcadu8OquoJ8/v/rn3UWQn9H11V/qCq+g9VdWlVXV1VN1XVdfO/ydP2c957VNXzquqdVfVXVXXz/PzrVfVdVbXtIK7pG6vqTVX1p1X12bntv6iqd1XVD1bVMUuOWfl3sPj4YlX9ZVW9raqeuOSYbQt191bVsfvo02ULdb/jjl4bsDXd4f9gAWyS1yb59iTPS/KqtSpV1XFJnpDkU0l+dWB/vj3J4QPbh0PR2Um+L8nHk7w7yV8mOS7JM5J8U1X9RHf/wOqDquofJ3lrkn+R5C+SvG1+/ookT0nyTUnOqqqndfcn19uZqrpvkjcmeVqSm5P89tz2DUmOTnJSkvOS/GhVPaq7/3BJMz+X5BPz68OTPCzJk5PsrKozu/v1S475YqbPWmcm+X+X9OuEJCcv1APuYvzDBg4p3f2eqvpIkkdU1dd19wfWqHpmkkryc9190NP89tGfT+y/Ftzt/G6Sx3X3ZYuFVfXwJO9Nck5V/a/u/tDCviOTXJopxLw+yfd0940L+788yf9M8h1J3l5V37C4fy3zSNgvJ3l8puD33O6+Zkm9hyf5T0nus0ZTr+/uy1cd8+wkFyV58dzn1a5N8pkk31VVP9rde1ft/7fz89uS7HPEDzg0mUYIHIpeOz//22U7q+qwJN+ZpJP87EL5MVX1I1X13nnq0M1Vde08NfGEJe186b6oqvqaqnpzVf11Vd2yMrVu2T1bVXWvqvreqnpHVf3ZPIXq0/O0qNtNOVp17H2r6lVV9cmq+kJV/VFV/buqqvX+cKrqy6vqxVX1oar6fFV9br7mZ6+3jf20f01VfbSq7lNVPzVv31hVH6yqp811tlXVD8/Ttb4w1//uJW2tTFX7oap6TFX9RlX93fx4R1V93Rp9uG9V/fhC+5+uacraqfs5x9dX1dvn+l1V31FVneSYJA9ZNVVs8XfnmfPvyZ8u/Ex3V9X3VNXt/l9aVT8/t/Hgqjqrqq6c+/kXVfU/q2rpB/q5/k8vXNd1VfV7VfWSNeq+qqo+XrdO0/s/VfXIfb1/d4bu/qXVQWsuvzLJL82bp6za/f2ZgtZvJ3ne6iDV3Z9PckaS92ca+fr36+zOczIFrQ8neeqyoLXSt+5+ZqaguF6/Pj8fvY86r830+/XkxcKquufct99O8n8P4JzAIUTYAg5Fb8w0FWhXVR2xZP+TM324eVd3X7VQ/vgkP5Dk00nekuSVSX4vybcl+b35L9vL/NO53oOS/HymD0+f3Uf/jp7bPjLJO5P8ZKapUY9M8o6qOmON4+6V6S/vT0jy/83n+YdJfmZub7+q6n5JfifJy5L8faa/tr8xyQOTXFRVL11PO+twryTvSvLEJL+S6efy0CS/XFWnZPr5Pj/JbyZ5XabRgldV1b9eo71Hz3VvzHS9v5bkm5NcXlWPXnWN90/yvtz6Xr4yycVJHpPkXVX1vDXOcXKmD7b3nPv0piR/muRHM72fn5lfrzzeunDsf02yI9MH8Z9OcuF8TT89t7WW/57pvfhgkv+RaUrcCzL9fG6jqk5K8qEk35PkmiQ/leQXknwuq6agVdWJSa5I8sJMIeL8TNNlT0ny3qr65lX1V+4hGjbKewD+fn5e3ZeVP5785+7uZQfOI0P/Zd58/jrPt9Luf13PSNgBjoQ/YX7evY86/yvTdMXVv5fPSPKA3PrHI+CuqLs9PDw8DrlHkl/MNHJ1xpJ9/2fe96xV5Q9McuSS+o9I8vkkv7qq/Pi5nU7yn9box+VJvriq7N5JjllS975J/iTJXye516p918zn+a0k91wof0CSq+Z9j17St59d1c7Pz+X/cVX54ZmC3y1Jtq/zZ3z53NbJa/T1VxavI1OY7UwB6HeTHLWw76GZPmT//qq2nrDwM37hqn3/ei7/cJJaKH/dXP6qVfVPyBSavpDkwWuc48w1rvWaJB/dx8/iIUvKvizTB+lO8sg13oerkjxoofwemabRdZKvWyi/V6b7gTrJty051+o2Pp4pmK5+bx6U6T7Fa1b9Hm2b2/7iWte45JwrP7ePJ3npGo/z5zpr/uyW/Bv46yR7kzx0ofyfzO3cnFX/Npa0ceR8fCf5iv3UvWemUNdJjl3vta/x7+D1C9f94/Pv/81J9iQ5YdUxKz/vq+ftN8y//1+5UOddmf6t3DvT/WKd5DvuSB89PDy27mPTO+Dh4eFxRx5JvnH+cHL5qvKvnD/U/GWSexxAe2/P9NfnwxbKVgLNtYsfXFcdd7uwtZ/z/EBWBae5fCXAfMOSY54373vtkr797ELZP5o/hL5vjXM/cj7mv6yzr/sLW8cuOWYlMDxuyb7LktyU2wanlQ/0f7JYvqQPj5m375UpZFyf5L5L6r98rv/iJef4/X1c6z7D1j6Oe9Tq883lK2HrjCXH/NusCpdJnj2XvWUd51wJoS9fY//3zfu/eVX5CUm+5gCubTGk7u+x359dpnsof3mu/1Or9j16Lr9mnX37m6wKrGvU+6qFPm5bsv/U3D5APm2N38Flj79J8qKs+u9Dbh+2HrP4e5LkqzP94eP8eVvY8vC4iz4skAEcqt6d5GNJHlNVD+vuP5nLvzPTB503dPffrz5ovqfoBZmCxz/M7RcKun+mv7wvuqK7bz6QzlXV9iTnZJq69lWZQsKi2y0xnSmILLtf5D3z8yP2c9pHZRptqTWmC6704WH7aWc9/qa7/2xJ+SeTPDjJsoVLrs000vCPMoXhRZd1dy855j2ZPqg+ItP0yH+WaSTg/d39t0vqvzvJuVn+s/q9JWXrUlUPyPR+PiXTKMyXr6qy7P1Mlk8v+/P5+X4LZV8/P79jHd35hvn5n6zxPn/N/Pyw3HpPUbr7w+toe5nf6O4nLNtRVcdnmoq5Hj+VaercezL9LLeCU5Osvh/udbntFNIVj+15gYz5fqvjkvw/maY1fnNVfWN337LsJN39O1X1J0nOrKqXZwrcFVMI4S5P2AIOSd29soDByzON/HzfvIjEmZlHgVYfU1Xfl+S/ZZq6864kf5ZplKSTPDPJ9tw+FCXTfTbrVlWPmdv/siS/kWla42cz/SX765J8yxrn+es1AsfK+Y/az6n/4fx80vxYy5H7aWc9rl+j/ItJ9nb359bYl0zT4FZbHb5WrL72ledPrVF/pfy++2jrgMz3iO1OcmymxRnelOl36IuZwvn3Zvn7mSTLAuHKz+GwhbKV/l67ji6tvM/7W/BkI97nDVFVP5np5/SbmRapWP3Hi5X35uiquld337SPtr48twbV/S3//jeZRnsPy/RHj9usHtrdP5Tkh+Z2n5T1hd3M/f9Iku+uqkdkulfuXyd58z4Oe22m+zefmHmhj+7es57zAYcuYQs4lP1cpqWan1NVL0ry2EzTc97d3au/ZPUeSX4k04ezr+vuv1y1/7H7OM+yALQvP5xp9OVLfwlfOM8PZwpbyxxdVbUkcH3F/LxWwMmq/Uu/w2iLe+Aa5auv/fpV5at95ap6iw70fVzx/ExB64e7+z8v7ph/b773Dra7aCWUrTVCtmjl2nZ299s34NzDzH8AOT/Toh/vyjRF73aLVHT3x6vqU5nev8dlur9wLadm+kPGx7t7nwG6u2+uqt/PNHL4jZn+m7HR3p/pjxuPyr7D1psy/XHotZl+f2+3wiRw12M1QuCQNQemt2ZaROK03Lra12uWVH9gkn+Q6R6v1UHrPtn/FL0DcXySv1odtGb/ah/H3Su3TidbdMr8/MH9nPf9mQLFvoLjVvXY+YP5aqfMzyvX/ieZpls+Yo3l0x8/P6/1/WtrWRn9WOb4+fl2Kwhm3+/ngViZPvrkfda6bd0t/T7P7+f/zBS0Lk3yLcuC1oKVpfZfvMbvQuZl9l88by77d76vds+pqnuv85gDsTLKts/PVN19XaZ71h6UaaT7Fwf0BdhihC3gULcyXfD7Mt0P8jeZlgFf7VOZPqT/y3kaUpIv3Xvx07nt/TMH6+pMo1T/fLGwql6Q6a/r+3Le3KeVYx6QW/8Cvs+/ynf3pzJ9werXV9WLavq+sduo6bvDjt3/JdzpTsh0L92XzMvEPybTdxC9N0m6+wuZlsU/KtOo5mL9h2b6YH9zpgUqDsR1Sf5RVS2bDnj1/HzKqvOdmOQHD/A8a/mVTPdyPbOqvnX1zqp60MLmxXOf/n2t8b1tVfXo1cGiqk6oqq9ZVn+jzaHodZlGBd+W5LT5vduXn8j0Xp+S5NVL+n9EphUBvz7TEvnnr7M7b8x0n9jDkvxqVa01erhs6uk+VdVXJ3n6vPmedRzyokz/nXpST98bBtzFmUYIHOp+PdMHz0fN2z+zbDGL7t5bVT+d6YtT91TVWzONJJ2a6YP7b2XjRilekSlUvbeq/neSv5v79w2ZRkfW+q6pazKNvl250L9nZZpydH53v3cd5/7uTCMx/yXJGVV1eaYFP74y0+ISJyb51kz3q20l70hyflXtzLSU9kMz3Ud3Y6bl2henAK4sPPIfqupRmd67ozN9X9qRSb67u29zb846/Eam0c1Lq+qyTIHtg919SaZlu78vyU9X1ROSfDTTd689NdP7edBfFt3dN80h69Ik/7uqfjPTgh6HZwoJj8s0NXWl7jPnupdW1e9k+s6tG5P84yT/MtMiHkdnWgY/VbUt06jg3tw5/+//0UyL1dyQ5A+TvGjJYNUHuvtLC1F092fn+6bemmkBiadW1Tsy3c/1FUl2Zhqh/kD2P0r2Jd39xap6RqbvRntqko9X1W8l+aO5f0cneXimf583ZRohXua75vc/me47PC7TiPoRSS7u7l9dR1/+LFvv3x4wkLAFHNIWFspYuZdmX6t7vSjJXyX5rkyjKH+b6d6Ql2S6l2Kj+nRJVT19bvf0TAsi/F6mv9ifkLXD1k2Zwt/Lk3x7poUQPpbpS3H/xzrPff18H9ELkuzKFNbulWkBij9NcnamFfu2mvdmus4fy633QL0zyUu6+w8WK3b3dfMXAL840yjBf8z0ofl9me5Xe9cdOP+PZvqS4qdmmp53WKaRmUu6+5r5Z3peptDzpEzB5QWZviT5oMNWknT3+6tqR6bf0ydlGtX7bKZw99JVdT9YVV+b6dqfmul3+pZMI7h/kOm+wc9sRL/uoH8yPx+RW6f9rXa7Vf+6++p5xPCMTD/Xp2UacfrbTIHyJUne2Af2xcOZV678lqr6piTPyRSsHpMpNH06U/B6UZILu3utRUq+c7HJTPfO/UGme7FefyD9Ae4+avnCVwAw3jxS8M4sWXwCAA517tkCAAAYQNgCAAAYQNgCAAAYwD1bAAAAA1iNcJU3vvGN/dznPnezuwEAAGxdS798fTXTCFf5/Od9xyAAAHDwhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABtm12B7aaPdden+POvWSzuwEAACS5+rydm92FO8zIFgAAwADCFgAAwADCFgAAwADCFgAAwADCFgAAwADCFgAAwADCFgAAwADCFgAAwADCFgAAwADCFgAAwADCFgAAwADCFgAAwADCFgAAwADCFgAAwADCFgAAwADCFgAAwADCFgAAwACbHraqam9VXVFVV1bVm6vqiIV9p1VVV9UJ8/a9q+rDVbV9oc45VfXqfbT/3Kr60/nx3LFXAwAAMNn0sJXkxu7e0d0PT3Jzkhcu7NuV5PL5Od39hSRnJ3lVTY6Z65+7rOGqun+SH0lyUpJHJfmRqrrfsCsBAACYbYWwteiyJMcnSVUdmeTkJGcmOX2lQndfmuRTSZ6T5BVJXtrdn1mjvScmeWd3f3qu884kT1pdqaqeX1W7q2r33huu38jrAQAA7qa2TNiqqm1Jnpxkz1z09CSXdvdHklxXVY9cqH52kpclObq7L9xHs8ck+fOF7Wvmstvo7td094ndfeJhRxx1MJcBAACQZGuErcOr6ooku5N8Isnr5vJdSS6aX180bydJuvuTSd6d5II7sZ8AAADrtm2zO5D5nq3Fgvleq1OTbK+qTnJYkq6qc7q752q3zI99uTbJKQvbD0ryno3oNAAAwL5shZGtZZ6V5MLuPra7j+vuBye5KsljD7CdX0vyzVV1v3lhjG+eywAAAIbaqmFrV5KLV5W9JQtTCdejuz+d5MeS/P78+E9zGQAAwFCbPo2wu49cUvb4JWXnr9o+Y53tvz7J6+9o/wAAAO6IrTqyBQAAcEjb9JGtjVBV25OsXgL+pu4+aTP6AwAAcJcIW929J8mO/VYEAAC4k5hGCAAAMICwBQAAMICwBQAAMICwBQAAMICwBQAAMICwBQAAMICwBQAAMICwBQAAMICwBQAAMMC2ze7AVrP9mKNywVk7N7sbAADAIc7IFgAAwADCFgAAwADCFgAAwADCFgAAwADCFgAAwADCFgAAwADCFgAAwADCFgAAwADCFgAAwADbNrsDW82ea6/PcedestndYIu5+rydm90FAAAOMUa2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABtj0sFVVe6vqiqq6sqreXFVHLOw7raq6qk6Yt+9dVR+uqu0Ldc6pqlev0faOqnpfVf1RVf1hVT17/BUBAABsgbCV5Mbu3tHdD09yc5IXLuzbleTy+Tnd/YUkZyd5VU2Omeufu0bbNyR5Tnf/8yRPSvLKqrrvoOsAAAD4kq0QthZdluT4JKmqI5OcnOTMJKevVOjuS5N8KslzkrwiyUu7+zPLGuvuj3T3n86vP5nkr5IcvbpeVT2/qnZX1e69N1y/sVcEAADcLW2ZsFVV25I8OcmeuejpSS7t7o8kua6qHrlQ/ewkL0tydHdfuM72H5Xknkk+tnpfd7+mu0/s7hMPO+Kog7kMAACAJFsjbB1eVVck2Z3kE0leN5fvSnLR/PqieTvJl0ap3p3kgvWcoKq+MsmFSb6zu2/ZoH4DAACsadtmdyDzPVuLBVV1/ySnJtleVZ3ksCRdVed0d8/Vbpkf+1RV90lySZKXdPfvbmzXAQAAltsKI1vLPCvJhd19bHcf190PTnJVksceSCNVdc8kFyd5U3f/0oB+AgAALLVVw9auTCFp0VuyMJVwnb4tyeOSnDEvL39FVe3Y30EAAAAHa9OnEXb3kUvKHr+k7PxV22eso+2fT/LzB9M/AACAO2KrjmwBAAAc0jZ9ZGsjVNX2TKsNLrqpu0/ajP4AAADcJcJWd+9J4l4sAABgyzCNEAAAYABhCwAAYABhCwAAYABhCwAAYABhCwAAYABhCwAAYABhCwAAYABhCwAAYABhCwAAYABhCwAAYIBtm92BrWb7MUflgrN2bnY3AACAQ5yRLQAAgAGELQAAgAGELQAAgAGELQAAgAGELQAAgAGELQAAgAGELQAAgAGELQAAgAGELQAAgAG2bXYHtpo9116f4869ZLO7MdTV5+3c7C4AAMBdnpEtAACAAYQtAACAAYQtAACAAYQtAACAAYQtAACAAYQtAACAAYQtAACAAYQtAACAAYQtAACAAYQtAACAAYQtAACAAYQtAACAAYQtAACAAYQtAACAAYQtAACAAYQtAACAAQ44bFXV55aUvbSqvn9+/YaquqGq/sHC/ldWVVfVA1baqKrtVXXF/Ph0VV01v37XGuc9rqpunOt8qKreW1Vfs6rOK6vq2qr6soWyM6rqZw70OgEAAA7GqJGtjyZ5epLMwefUJNcuVujuPd29o7t3JHlrknPm7Sfso92PzXX+RZI3Jnnxyo75PM9I8udJ/tWGXg0AAMABGhW2Lkry7Pn1KUl+J8kXN/gc90nymYXtU5L8UZILkuw6kIaq6vlVtbuqdu+94fqN6yEAAHC3NSpsfSTJ0VV1v0zB56INavch8zTCjyX5j0l+cmHfriS/kOTiJDur6h7rbbS7X9PdJ3b3iYcdcdQGdRUAALg7G7lAxi8nOT3JSUku26A2V6YRPiTJ2UlekyRVdc8kT0nyK939d0nen+SJG3ROAACAA7ZtYNu/mOQPkryxu2+pqo1u/61Jfm5+/cQk902yZz7PEUluTPK2jT4pAADAegwLW939Z1X1kiRLVxfcACcn+dj8eleS53X3LyRJVX15kquq6ohB5wYAANinOxK2jqiqaxa2f3Ktit396jvQ/r48pKquSFJJbk7yvDlQPSnJCxfO+/mqujzJt8xFZ1TVaQvtfH13L14DAADAhjrgsNXd+7zPq7vPWKP8uIXXR67nmFV1rk5y+Bq777+k/jMXNt+wv/YBAAA20sgFMgAAAO62Ri6QcYdU1fYkF64qvqm7T9qM/gAAANwRWy5sdfeeJDs2ux8AAAAHwzRCAACAAYQtAACAAYQtAACAAYQtAACAAYQtAACAAYQtAACAAYQtAACAAYQtAACAAYQtAACAAYQtAACAAbZtdge2mu3HHJULztq52d0AAAAOcUa2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABti22R3YavZce32OO/eSze7Ghrn6vJ2b3QUAALhbMrIFAAAwgLAFAAAwgLAFAAAwgLAFAAAwgLAFAAAwgLAFAAAwgLAFAAAwgLAFAAAwgLAFAAAwgLAFAAAwgLAFAAAwgLAFAAAwgLAFAAAwgLAFAAAwgLAFAAAwgLAFAAAwgLAFAAAwwKaHraraW1VXVNWVVfXmqjpiYd9pVdVVdcK8fe+q+nBVbV+oc05VvXqNto+tqg/M7f9RVb1w/BUBAABsgbCV5Mbu3tHdD09yc5LFQLQryeXzc7r7C0nOTvKqmhwz1z93jbY/leQbuntHkpOSnFtVXzXoOgAAAL5kK4StRZclOT5JqurIJCcnOTPJ6SsVuvvSTCHqOUlekeSl3f2ZZY11983dfdO8ea+scb1V9fyq2l1Vu/fecP1GXQsAAHA3tmXCVlVtS/LkJHvmoqcnubS7P5Lkuqp65EL1s5O8LMnR3X3hftp9cFX9YZI/T/Lj3f3J1XW6+zXdfWJ3n3jYEUdtxOUAAAB3c1shbB1eVVck2Z3kE0leN5fvSnLR/PqieTtJMgemdye5YH+Nd/efd/fXZhoxe25VPXAD+w4AALDUts3uQOZ7thYLqur+SU5Nsr2qOslhSbqqzununqvdMj/Wpbs/WVVXJnlskl/amK4DAAAstxVGtpZ5VpILu/vY7j6uux+c5KpMQWndqupBVXX4/Pp+me4B+78b3lsAAIBVtmrY2pXk4lVlb8nCVMJ1eliS91fVh5L8VpL/1t179nMMAADAQdv0aYTdfeSSsscvKTt/1fYZ62j7nUm+9mD6BwAAcEds1ZEtAACAQ9qmj2xthKranmT1EvA3dfdJm9EfAACAu0TYmu/D2rHfigAAAHcS0wgBAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAG2LbZHdhqth9zVC44a+dmdwMAADjEGdkCAAAYQNgCAAAYQNgCAAAYQNgCAAAYQNgCAAAYQNgCAAAYQNgCAAAYQNgCAAAYQNgCAAAYYNtmd2Cr2XPt9Tnu3Es2uxu3c/V5Oze7CwAAwAEwsgUAADCAsAUAADCAsAUAADCAsAUAADCAsAUAADCAsAUAADCAsAUAADCAsAUAADCAsAUAADCAsAUAADCAsAUAADCAsAUAADCAsAUAADCAsAUAADCAsAUAADCAsAUAADDApoetqtpbVVdU1ZVV9eaqOmJh32lV1VV1wrx976r6cFVtX6hzTlW9ej/nuE9VXVNVPzPuSgAAAG616WEryY3dvaO7H57k5iQvXNi3K8nl83O6+wtJzk7yqpocM9c/dz/n+LEkv73hPQcAAFjDVghbiy5LcnySVNWRSU5OcmaS01cqdPelST6V5DlJXpHkpd39mbUarKpHJnlgkl/fR53nV9Xuqtq994brN+I6AACAu7ktE7aqaluSJyfZMxc9Pcml3f2RJNfNoWnF2UleluTo7r5wH21+WZL/nuT793Xu7n5Nd5/Y3ScedsRRB3MZAAAASbZG2Dq8qq5IsjvJJ5K8bi7fleSi+fVF83aSpLs/meTdSS7YT9tnJXl7d1+zoT0GAADYj22b3YHM92wtFlTV/ZOcmmR7VXWSw5J0VZ3T3T1Xu2V+7Ms3JHlsVZ2V5Mgk96yqz3X3/u7xAgAAOChbIWwt86wkF3b3C1YKquq3kjw2B7DQRXf/m4Xjz0hyoqAFAADcGbbCNMJldiW5eFXZW7IwlRAAAGAr2/SRre4+cknZ45eUnb9q+4wDPM8bkrzhwHoHAABwx2zVkS0AAIBD2qaPbG2EqtqeZPUS8Dd190mb0R8AAIC7RNjq7j1Jduy3IgAAwJ3ENEIAAIABhC0AAIABhC0AAIABhC0AAIAatk/3AAAVdklEQVQBhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABtm12B7aa7ccclQvO2rnZ3QAAAA5xRrYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAG2LbZHdhq9lx7fY4795LN7sZtXH3ezs3uAgAAcICMbAEAAAwgbAEAAAwgbAEAAAwgbAEAAAwgbAEAAAwgbAEAAAwgbAEAAAwgbAEAAAwgbAEAAAwgbAEAAAwgbAEAAAwgbAEAAAwgbAEAAAwgbAEAAAwgbAEAAAwgbAEAAAwgbAEAAAyw37BVVXur6oqq+lBVfaCqHj2XH1dVV86vT6mqty059j1VdeJ6O1NVr6yqa6vqyxbKzqiqrqonLJSdNpc9q6ounvv30aq6fn59RVU9uqq+Zy7vqnrAevsBAABwsLato86N3b0jSarqiUlenuRfbXRH5oD1jCR/Prf/mwu79yQ5Pcm75u1dST6UJN39jPn4U5J8f3c/daHNG5O8Lcl7Nrq/AAAA+3Kg0wjvk+QzIzqS5JQkf5TkgkxhatFlSR5VVfeoqiOTHJ/kiv012N0f7O6r91evqp5fVburavfeG64/4I4DAACstp6wdfg8Le/DSX42yY8N6suuJL+Q5OIkO6vqHgv7OtOo1hOTPD3JWzfyxN39mu4+sbtPPOyIozayaQAA4G5qPWHrxu7e0d0nJHlSkjdVVW1kJ6rqnkmekuRXuvvvkrw/U7BadFGmqYSnZwplAAAAW9Z67tn6ku5+37zQxNEb3I8nJrlvkj1zjjsiycr9Vivn/r2q2p7khu7+yAbnPQAAgA11QGGrqk5IcliS6zIFoo2yK8nzuvsX5vN8eZKrqmr1Oc5N8oUNPC8AAMAQ6wlbh1fVymIUleS53b13ycjSN1bVNQvb3zo/X1JVfz+/fl93f+viQXOgelKSF66Udffnq+ryJN+yWLe737GO/i62/e+T/ECSr0jyh1X19u5+3oG0AQAAcEdUd292H7aU737Jy/sde792s7txG1eft3OzuwAAANxqXfc0HejS7wAAAKzDAd2zdbDmL0X+8VXFV618MTEAAMBdxZ0atrr715L82p15TgAAgM1gGiEAAMAAwhYAAMAAwhYAAMAAwhYAAMAAwhYAAMAAwhYAAMAAwhYAAMAAwhYAAMAAwhYAAMAA2za7A1vN9mOOygVn7dzsbgAAAIc4I1sAAAADCFsAAAADCFsAAAADCFsAAAADCFsAAAADCFsAAAADCFsAAAADCFsAAAADCFsAAAADbNvsDmw1e669Psede8mm9uHq83Zu6vkBAICDZ2QLAABgAGELAABgAGELAABgAGELAABgAGELAABgAGELAABgAGELAABgAGELAABgAGELAABgAGELAABgAGELAABgAGELAABgAGELAABgAGELAABgAGELAABgAGELAABgAGELAABggE0PW1W1t6quqKorq+rNVXXEwr7Tqqqr6oR5+95V9eGq2r5Q55yqevU+2v/HVfXrVfUnVfXHVXXcyOsBAABItkDYSnJjd+/o7ocnuTnJCxf27Upy+fyc7v5CkrOTvKomx8z1z91H+29K8hPd/bAkj0ryVwOuAQAA4Da2QthadFmS45Okqo5McnKSM5OcvlKhuy9N8qkkz0nyiiQv7e7PLGusqv5Zkm3d/c752M919w1L6j2/qnZX1e69N1y/wZcEAADcHW2ZsFVV25I8OcmeuejpSS7t7o8kua6qHrlQ/ewkL0tydHdfuI9m/2mSv62qX66qD1bVT1TVYasrdfdruvvE7j7xsCOO2pgLAgAA7ta2Qtg6vKquSLI7ySeSvG4u35Xkovn1RfN2kqS7P5nk3Uku2E/b25I8Nsn3J/mXSb46yRkb1XEAAIC1bNvsDmS+Z2uxoKrun+TUJNurqpMclqSr6pzu7rnaLfNjX65JckV3f3xu91eSfH1uDXQAAABDbIWRrWWeleTC7j62u4/r7gcnuSrTKNWB+P0k962qo+ftU5P88Qb2EwAAYKmtGrZ2Jbl4VdlbsjCVcD26e2+mKYS/UVV7klSS125IDwEAAPZh06cRdveRS8oev6Ts/FXbZ6yz/Xcm+do72j8AAIA7YquObAEAABzSNn1kayNU1fYkq5eAv6m7T9qM/gAAANwlwlZ370myY78VAQAA7iSmEQIAAAwgbAEAAAwgbAEAAAwgbAEAAAwgbAEAAAwgbAEAAAwgbAEAAAwgbAEAAAwgbAEAAAwgbAEAAAywbbM7sNVsP+aoXHDWzs3uBgAAcIgzsgUAADCAsAUAADCAsAUAADCAsAUAADCAsAUAADCAsAUAADCAsAUAADCAsAUAADCAsAUAADDAts3uwFaz59rrc9y5l2xqH64+b+emnh8AADh4RrYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAG2PSwVVV7q+qKqrqyqt5cVUcs7DutqrqqTpi3711VH66q7Qt1zqmqV6+j/Suq6q1jrwYAAGCy6WEryY3dvaO7H57k5iQvXNi3K8nl83O6+wtJzk7yqpocM9c/dx3t7+jup425BAAAgNvaCmFr0WVJjk+SqjoyyclJzkxy+kqF7r40yaeSPCfJK5K8tLs/c+d3FQAAYG1bJmxV1bYkT06yZy56epJLu/sjSa6rqkcuVD87ycuSHN3dF+6n6XtX1e6q+t2qOm2Ncz9/rrN77w3XH+SVAAAAbI2wdXhVXZFkd5JPJHndXL4ryUXz64vm7SRJd38yybuTXLCO9o/t7hOTfHuSV1bVQ1ZX6O7XdPeJ3X3iYUccdcevBAAAYLZtszuQ+Z6qxYKqun+SU5Nsr6pOcliSrqpzurvnarfMj33q7mvn549X1XuSPCLJxzaw/wAAALezFUa2lnlWkgu7+9juPq67H5zkqiSPPZBGqup+VXWv+fUDkjwmyR9veG8BAABW2apha1eSi1eVvSULUwnX6WFJdlfVh5L8ZpLzulvYAgAAhtv0aYTdfeSSsscvKTt/1fYZ62j7vUm2768eAADARtuqI1sAAACHtE0f2doIVbU9yeol4G/q7pM2oz8AAAB3ibDV3XuS7NhvRQAAgDuJaYQAAAADCFsAAAADCFsAAAADCFsAAAADCFsAAAADCFsAAAADCFsAAAADCFsAAAADCFsAAAADCFsAAAADbNvsDmw12485KhectXOzuwEAABzijGwBAAAMIGwBAAAMIGwBAAAMIGwBAAAMIGwBAAAMIGwBAAAMIGwBAAAMIGwBAAAMIGwBAAAMsG2zO7DV7Ln2+hx37iXDz3P1eTuHnwMAANg8RrYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGOGTCVlWdVlVdVScslD20qt5WVR+rqj+oqt+sqsfN+86oqr+uqisWHv9s864AAAC4OzlkwlaSXUkun59TVfdOckmS13T3Q7r7kUm+N8lXLxzzi929Y+Hxx3d6rwEAgLulQyJsVdWRSU5OcmaS0+fif5Pkfd391pV63X1ld7/hzu8hAADAbR0SYSvJ05Nc2t0fSXJdVT0yyT9P8oH9HPfsVdMID19WqaqeX1W7q2r33huu3+CuAwAAd0eHStjaleSi+fVF8/ZtVNXFVXVlVf3yQvHqaYQ3Lmu8u1/T3Sd294mHHXHUxvceAAC429m22R3Yn6q6f5JTk2yvqk5yWJJO8qNJHrdSr7ufUVUnJvlvm9JRAACABYfCyNazklzY3cd293Hd/eAkVyX5aJLHVNXTFuoesSk9BAAAWGXLj2xlmjL446vK3pJpoYynJvnJqnplkr9M8tkk/3mh3rOr6uSF7bO6+70jOwsAAJAcAmGrux+/pOz8hc2nrHHcG5K8YUyvAAAA9u1QmEYIAABwyBG2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABhC2AAAABti22R3YarYfc1QuOGvnZncDAAA4xBnZAgAAGEDYAgAAGEDYAgAAGEDYAgAAGEDYAgAAGEDYAgAAGEDYAgAAGEDYAgAAGEDYAgAAGGDbZndgq9lz7fU57txLNrzdq8/bueFtAgAAW5eRLQAAgAGELQAAgAGELQAAgAGELQAAgAGELQAAgAGELQAAgAGELQAAgAGELQAAgAGELQAAgAGELQAAgAGELQAAgAGELQAAgAGELQAAgAGELQAAgAGELQAAgAGELQAAgAHWHbaqam9VXVFVV1bVm6vqiIV9p1VVV9UJ8/a9q+rDVbV9oc45VfXq/Zzj7Kr6QlUdtVB2ytz28xbKdsxl319V/2Pu1x9X1Y3z6yuq6llV9dKqunah7CnrvV4AAICDcSAjWzd2947ufniSm5O8cGHfriSXz8/p7i8kOTvJq2pyzFz/3P2cY1eS30/yzFXlVyb5tlX1PjSf6991944kT0nysbmPO7r7l+a6r1goe/sBXC8AAMAddkenEV6W5Pgkqaojk5yc5Mwkp69U6O5Lk3wqyXOSvCLJS7v7M2s1WFUPSXJkkh/KHNoW/FmSe1fVA6uqkjwpyTvuYN+Xnfv5VbW7qnbvveH6jWoWAAC4GzvgsFVV25I8OcmeuejpSS7t7o8kua6qHrlQ/ewkL0tydHdfuJ+mT09yUaYg9zVV9cBV+38pybcmeXSSDyS5aZ1d/p6q+sOqen1V3W9Zhe5+TXef2N0nHnbEUcuqAAAAHJADCVuHV9UVSXYn+USS183luzKFpMzPXxqV6u5PJnl3kgvW0f6uJBd19y1J3pIpWC3633PZriS/sM4+X5DkIUl2ZBpl++/rPA4AAOCgbDuAujfO90Z9SVXdP8mpSbZXVSc5LElX1Tnd3XO1W+bHmuaFNB6a5J3TLMHcM8lVSX5mpU53/0VV/X2Sb0ryHzKNcO1Td//lwjlem+Rt+zsGAABgIxzs0u/PSnJhdx/b3cd194MzhaTHHmA7uzLd03Xc/PiqJF9VVceuqvf/JvnB7t67nkar6isXNp+RaaENAACA4Q5kZGuZXUl+fFXZW+by3z6Adk7PtJrgoovn8vevFHT3ew+wf/+1qnYk6SRXJ3nBAR4PAABwh9Sts/1Iku9+ycv7HXu/dsPbvfq8nRveJgAAsClqPZUOdhohAAAASxzsNMIDMi+EsXoJ+Ju6+6Q7sx8AAACj3alhq7v3ZFqGHQAA4C7NNEIAAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABhC0AAIABtm12B7aa7ccclQvO2rnZ3QAAAA5xRrYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGELYAAAAGqO7e7D5sKT/4gz/42Xvc4x7/d7P7wV3H5z73uQcceeSRf/P/t3cvIZfPcRzH3x8zLgu3MhsxjDLKuNRoEllQJGYxsyBRcmliRW4poojZIJRyzzQo94WeQhYuKZnJ1NSEogkxqHEZs5ncvxb/s5jGM8/zxzn/8/yf837VqXP5LT6LT/9zvv/bGXcOzQ/2ScNmpzRsdkrDNkc79cPatWvPm22Rw9YekmyqqhXjzqH5w05pmOyThs1OadjslIatz53yNEJJkiRJGgGHLUmSJEkaAYetf3pi3AE079gpDZN90rDZKQ2bndKw9bZTXrMlSZIkSSPgkS1JkiRJGgGHLUmSJEkagYkdtpKcl+TTJFuT3DLN5/sneXHw+cYkS7pPqb5o0acbk3ySZEuSt5IcPY6c6o/ZOrXbuguSVJJe3hJX3WnTqSQXDbZVHyd5ruuM6pcW331HJXknyebB99/KceRUPyRZl2R7ko/28nmSPDTo25Ykp3Sd8b+YyGEryQLgYeB8YBlwSZJleyxbA+yoqmOBB4F7uk2pvmjZp83Aiqo6GXgFuLfblOqTlp0iyUHAdcDGbhOqb9p0KslS4FbgjKo6Abi+86DqjZbbqduBl6pqOXAx8Ei3KdUz64GZ/iT4fGDp4HE18GgHmf63iRy2gFOBrVX1eVX9BrwArN5jzWrg6cHzV4Czk6TDjOqPWftUVe9U1a7Byw3AkR1nVL+02UYB3E2zI+iXLsOpl9p06irg4araAVBV2zvOqH5p06kCDh48PwT4tsN86pmqeg/4aYYlq4FnqrEBODTJ4d2k++8mddg6Avh6t9fbBu9Nu6aq/gB2Aod1kk5906ZPu1sDvDHSROq7WTs1OH1icVW91mUw9Vab7dRxwHFJ3k+yIclMe5ilNp26E7g0yTbgdeDabqJpnvq3v7fmhIXjDiBNkiSXAiuAM8edRf2VZB/gAeCKMUfR/LKQ5vScs2iOvr+X5KSq+nmsqdRnlwDrq+r+JKcDzyY5sar+GncwqSuTemTrG2Dxbq+PHLw37ZokC2kOf//YSTr1TZs+keQc4DZgVVX92lE29dNsnToIOBF4N8mXwGnAlDfJ0AzabKe2AVNV9XtVfQF8RjN8SdNp06k1wEsAVfUBcACwqJN0mo9a/d6aayZ12PoQWJrkmCT70Vy0ObXHming8sHzC4G3y3+A1vRm7VOS5cDjNIOW10FoNjN2qqp2VtWiqlpSVUtorgNcVVWbxhNXPdDme+9VmqNaJFlEc1rh512GVK+06dRXwNkASY6nGba+7zSl5pMp4LLBXQlPA3ZW1XfjDjWbiTyNsKr+SHIN8CawAFhXVR8nuQvYVFVTwFM0h7u30lysd/H4Emsua9mn+4ADgZcH91n5qqpWjS205rSWnZJaa9mpN4Fzk3wC/AncXFWe0aFptezUTcCTSW6guVnGFe641t4keZ5mh8+iwXV+dwD7AlTVYzTX/a0EtgK7gCvHk/TfiZ2XJEmSpOGb1NMIJUmSJGmkHLYkSZIkaQQctiRJkiRpBBy2JEmSJGkEHLYkSZIkaQQctiRJkiRpBBy2JEmSJGkE/gZsAXRT1UxKgwAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7f03d4485e10>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "model.varimp_plot()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 3. Conduct residual analysis to debug model\n",
    "Residuals refer to the difference between the recorded value of a dependent variable and the predicted value of a dependent variable for every row in a data set. Plotting the residual values against the predicted values is a time-honored model assessment technique and a great way to see all your modeling results in two dimensions."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Bind model predictions onto test data \n",
    "To calculate the residuals for our GBM model, first the model predictions are merged onto onto the test set. The test data is used here to see how the model behaves on holdout data, which should be closer to its behavior on new data than analyzing residuals for the training inputs and predictions."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "gbm prediction progress: |████████████████████████████████████████████████| 100%\n"
     ]
    }
   ],
   "source": [
    "yhat = 'p_DEFAULT_NEXT_MONTH'\n",
    "preds1 = model.predict(test).drop(['predict', 'p0'])\n",
    "preds1.columns = [yhat]\n",
    "test_yhat = test.cbind(preds1[yhat])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Calculate deviance residuals for binomial classification\n",
    "For binomial classification, deviance residuals are related to the logloss cost function. Like analyzing $y - \\hat{y}$ for linear regression, these residuals are the quantities that the GBM sought to minimize. Deviance residual values are calculated by applying the simple formula in the cell directly below."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [],
   "source": [
    "# use Pandas for adding columns and plotting\n",
    "test_yhat = test_yhat.as_data_frame()\n",
    "test_yhat['s'] = 1\n",
    "test_yhat.loc[test_yhat['DEFAULT_NEXT_MONTH'] == 0, 's'] = -1\n",
    "test_yhat['r_DEFAULT_NEXT_MONTH'] = test_yhat['s'] * np.sqrt(-2*(test_yhat[y]*np.log(test_yhat[yhat]) +\n",
    "                                                                 ((1 - test_yhat[y])*np.log(1 - test_yhat[yhat]))))\n",
    "test_yhat = test_yhat.drop('s', axis=1)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Plot residuals\n",
    "Plotting residuals is a model debugging and diagnostic tool that enables users to see modeling results, and any anomolies, in a single two-dimensional plot. Here the green points represent customers who defaulted, and the blue points represent customers who did not. A few potential outliers are visible. There appear to be several cases in the test data with relatively large negative residuals. Understanding and addressing the factors that cause these outliers could lead to a more acccurate model."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAfQAAAHkCAYAAADIAN0RAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAIABJREFUeJzs3Xl8VNXB//HPyUYCZAHZlEFBQVlcEBJwQa3iRo1VFFzqUsDa1spPKT4PSGV5QK3gQt3bWhVsrVSLUjUWqbuitQSEqgiiLJUBxYAkJISsc35/3EwWTDKTyZ0lme/b17wmuXPn3MOr2i9nN9ZaREREpG1LiHYFREREpPUU6CIiIu2AAl1ERKQdUKCLiIi0Awp0ERGRdkCBLiIi0g4o0EVERNoBBbqIiEg7oEAXERFpB5KiXYGW6tatm+3bt2+0qyEiIhIRa9as2W2t7R7ovjYX6H379mX16tXRroaIiEhEGGP+G8x96nIXERFpBxToIiIi7YACXUREpB1oc2PoIiKtUVlZidfrpaysLNpVEWkgNTUVj8dDcnJySN9XoItIXPF6vaSnp9O3b1+MMdGujggA1lr27NmD1+ulX79+IZWhLncRiStlZWUccsghCnOJKcYYDjnkkFb1HCnQRSTuKMwlFrX230sFuoiISDugQBcREWkHFOgiIs3wemHZMnjsMefd6219mYmJiQwdOpQhQ4ZwwgkncN999+Hz+QB4++23yczMZOjQobWv119/vcH3/K9t27bVljllyhR69+5dWw7A//3f/3Hvvfc2eHbfvn3ZvXs3AJ07d27w2bx582rLrv+sRx55pNE/x8yZM+ncuXNtefXLrKqq+l5977nnHqqqqhg6dCjvv/9+7XfOOussli1bRnZ2NkOHDuXwww+ne/futd/bvn17o8/3eDyceeaZDa4de+yxDB06tPb3d999l5ycHAYOHMjAgQN54oknAtb/22+/rX12r1696N27d+3v5eXlZGVlNXjm448/zpQpUxqtY31PPPEEAwYMYMCAATz99NMB728pzXIXEWmC1wsvvghZWdCzJ5SUOL9fdBF4PKGXm5aWxrp16wD49ttv+fGPf8y+ffuYO3cuAKeddhp5eXnNfq8+n8/HsmXL6NOnD++88873Qi5Ys2fPZvbs2VRVVdGtW7dGn3Wwrl278tvf/pY777zze5+lp6c3WsYjjzzCjTfeyOrVq1myZAkdO3Zk7NixjB07FnAC8tNPP+X+++8P+PzCwkJ27tzJYYcdxieffEJSUl2s7dy5k6uvvpqXXnqJoUOHUlBQwLnnnkvv3r05//zzm6x/jx49aus9c+ZMunXrVhvYVVVVAevUmN27d3PnnXfy0UcfUV1dTXZ2NhdeeCGZmZkhldcYtdBFRJqQn++EeUYGJCQ471lZznW39OjRg8cee4yHH34Ya21IZbz99tsMGTKEG264gSVLlrhXuSD89Kc/5S9/+QtFRUVBf+fUU09l+PDhzJ07l1mzZvHggw+G/Pzx48fz3HPPAbBkyRKuvPLK2s8eeughfvrTn9a22Lt37878+fNZsGBBq+ofiuXLlzNmzBiysrI45JBDOOuss/jnP//p6jMU6CIiTSgogIN6penc2bnupiOPPJLq6mq+/fZbAN57770GXdWbN28G4MCBA7XX/K1ZqAuysWPH8sorr1BZWeluBZuRkZHBtdde22goFxcXN/hzLF26tPazBQsWcO+99/KTn/yEI488MuTnjx8/vrbcV155hQsuuKD2s/Xr1zN8+PAG92dnZ7N+/fqg6t+Ug/9c8+bNq/1s2bJlDX7327FjB3369Kn93ePxsGPHjqCfGQx1uYuINKF7d6ebPSOj7lpJiXM9nFrS5V5RUcE//vEPFi5cSHp6OiNHjmTFihXk5uY2uQzK7WV7U6ZMYdiwYfzqV79qcL2pLndwehW6dOnCp59+2qpnd+/enU6dOvHXv/6VE044gdTU1BaX0VT9m3Lwn8s/RAA0GDqINLXQRUSakJMDhYWwbx/4fM57YaFz3U1btmwhMTGRHj16tPi7K1asoLCwkOOOO46+ffuycuXK2m73Qw45hL179za4v7i4+HuTulqra9euXHbZZfz+978P6v6SkhJuvfVW3nnnHbZv386KFSta9fzLL7+cG2+8sUF3O8DgwYNZs2ZNg2tr1qxhyJAhrap/KHr37t1gcp/X66V3796uPkOB3gRvkZdlG5bx2OrHWLZhGd4iF6a2ikib4vE4E+A6doRdu5z31k6IO1hBQQG/+MUvmDx5ckgt5yVLlvD444+zbds2tm3bxtatW3nttdcoLS3l9NNP56WXXqK4uBiAF154gRNOOIHExET3/gA1brnlFh599NEGs+ybMmfOHK6++moGDBjAo48+ypQpU6ioqAj52ZdeeinTpk3jnHPOaXB98uTJPP7443z88ceAMzFtxowZTJs2rVX1D8X555/P8uXLKSwsZM+ePbzxxhuce+65rj5DXe6N8BZ5efHzF6n2VbOzZCf/3vFvln+xnOuHXU+Ox+W/motITPN43A1wqBsLr6ysJCkpiWuuuYapU6fWfu4fQ/ebOXMm48aN+145paWlvPrqqw1alp06dWLUqFG8/PLLXH755UyePJlRo0ZhjKFHjx48/vjjDb7vqfeHmzp1aoN6tETPnj3Jzc3l0Ucfrb3mH2v2u+CCC7jiiivIy8vjP//5D+CMaZ955pncc8893HbbbSE9OzMzk+nTp3/vusfj4amnnmLSpEmUlJQAzp9xzJgxQdU/FMuWLeOTTz5h9uzZDa53796dGTNmkJ2dDThLBN2c4Q5gQp1VGS3Z2dl29erVYX3Gsg3L2F60nfwd+RSVF1Hlq6Kaag5JO4S7z74bT6bL/3WLSMRs2LCBQYMGRbsaIo1q7N9PY8waa212oO+qy70RBfsL+HzP5+wo3kFReRFb9m7h012f8tbWt/hd/u+iXT0REZHvUZd7I7p36s7GPRup8lWxtXArKYkpdErqRHl1Oc+uf5aLB16srncRiRvz5s3jhRdeaHDtiiuu4NZbb43I87Ozs7+3ocszzzzD4MGDI/L8tkKB3oicw3KoqKrAW+TFYDhQeYBKXyWdkjthMCzdsFSBLiJxw7+DXLSEe5i1vVCXeyM8mR5yj86luKKYksoSKqsrSSCBoooiSitLWfd14O0QRUREIkmB3oSrjruK7h27k5KQgjUWn/WRQAJVtoqNezaS73Vx70cREZFWUqA3wZPpYXS/0SSaRJISkrA4qwEqqipIIIHffvhbrU0XEZGYoUBvxuijRjP8sOGkJaVxoOoAZVVl+PBxoPIA/9n1H5Z/uTzaVRSRMNMmU9JWKNCbkXNYDr0698L6LCmJKaQkplBZXUlReRH/LfwvT69z/zxbEYkd/k2mSitL6dm5J6WVpbz4+YutDnWdhx5/56H7fD7OO+88srKyuPjii5u9N1Sa5d4MT6aH64ddz9INS6nyVVFZXUliQiLGGKqqq8j/Op+8jXnkDsyNdlVFJAzyd+aTlZpFRgfndBb/e/7O/FZtMKXz0OPvPHRjDNOmTaO4uJjFixeHVEYgaqEHkOPJ4YiMI8BCUkIS1b5qKqoqKLfllFeXc/OKmzVBTqSdKthfQOeUhq3YzimdKdjv3vmpOg89Ps5DN8YwevTo7/WKuEmBHoST+pxEclIyxhgqfZX48GFwDlHw7vNy25u3aVxNpB3q3qk7JRUlDa6VVJTQvZO756fqPPT2fx56JKjLPQiThk5ixeYVePc5G834Z7z78FHpq+Sdbe+w4L0FPJT7UJRrKiJuyjkshxc/fxFwWuYlFSUUlhVyxhFnhPW5Og89eDoPvY5a6EHI8eQwe9RsEkmsDfP67xW2gkUfLyJv4/f/AxSRtsuT6eGiYy6iY3JHdpXsomNyRy465iLXD2jSeejt/zz0SFALPUgThk/gpS9eYsWXKyitLv3e56WVpcx6a5YmyIm0M55MT1hPWHTrPHR/mO3fv59+/frVnod+1VVXceutt5Kenh7289BPPvnkkM5Dv+aaa/jPf/5DSkpKSM++9NJLKSgo4Jxzzmkw83/y5MmccsopXHzxxRx//PG156Hfcccdrap/rFILvQVmjJrBkV0bH+uxWD4r+Exj6SISkH8sfMiQIZx99tmce+65zJkzp/bzg8fQ64891+c/D73+uHH989CPP/742vPQhw4dyu9///tGz0P3vxYuXBjyn8l/nnhFRUXttYPHmm+77TY++eQT8vLyag92qX8eeqj856HXn+EODc9DHzhwIKNGjeLnP/95s+eh169/KJobQz/55JO58sorWbFiBR6PhzfeeKNVzzqYzkNvobyNeVz07EX4aPxvceOOGcffrvhbhGslIsHSeegSy3QeegTlDszl+B7HN/n5C5+/wOzXo3cqkYiIxCcFeghuP/N2kklu9DMfPu56/y5NkBORdqP+DnL+1/z58yP2fP8OcvVfn332WcSe31aoyz1EY/48hle3vNrk5z1Te/LyVS/r3HSRGLNhwwYGDhzo+tItkday1rJx40Z1uUfavDPnkZGc0eTnu8p2cfFfL9YkOZEYk5qayp49e0LelU0kHKy17NmzJ6R19H5athaiHE8ON4+4mdvfv73Je3bu38lZi85i05RNEayZiDTH4/Hg9XopKHBv+1YRN6SmpuLxhL5EUl3urdTr7l7sOrCr2XsW5S5iwvAJkamQiIi0K+pyj5D5o+fTKbFTs/f88h+/ZPGaxZGpkIiIxCUFeitNGD6BeT9ofiP+A74D3PjKjZr5LiIiYaNAd8HUUVO5oN8Fzd5Takv5yQs/iVCNREQk3ijQXZJ3bR6n9Dql2Xu+q/yO3D9pr3cREXGfAt1F7//8fc7vd36z97yy9RWFuoiIuE6B7rJ5Z81rchc5P4W6iIi4TYHushxPDjcMvyHgfa9sfYVT/3BqBGokIiLxQIEeBg/kPhBwkhzAB998oJa6iIi4QoEeJnnX5tEvvV/A+9T9LiIiblCgh9Gzlz1LUhC7676y9RUuW3JZBGokIiLtlQI9jHI8OSwYvSCoe/+26W8c+8CxYa6RiIi0Vwr0MJs6aiqzTp0V1L3rC9fTaW7z28iKiIg0RoEeAfPOnsdNw28K6t5SSul1V68w10hERNobBXqEPJD7QNAt9V0Vu9T9LiIiLaJAj6B5Z89jUe6ioO5dX7iefvcEniUvIiICCvSImzB8QtAt9W2l2zBzjY5eFRGRgBToUTDv7HlBhzrAxLyJWqsuIiLNUqBHybyz57HqulUkkhjU/doqVkREmqNAj6IcTw7bpmzj0NRDg7r/g28+0GQ5ERFplAI9yjyZHlb9YhXdUroFdf/6wvX0uqsX3iJvmGsmIiJtiQI9BngyPRTMKKAjHYO6f1fFLvrc30eT5UREpJYCPYbsn7Ofnik9g75/Yt5Ehj8yPIw1EhGRtkKBHmO+mfENw7oNC/r+j3Z/RJfbu4SxRiIi0hYo0GPQmhvXtCjUC32FJM9NJt+bH8ZaiYhILFOgx6g1N65h4rETg76/iipGPDFCXfAiInFKgR7Dnrz0SVZdt4pUUoP+zke7P8LMNWqti4jEGQV6jMvx5HBgzgGGZA1p0fdGPDGCSc9PClOtREQk1kQ10I0xfYwxbxljPjPGrDfG3BzN+sSyT2/+lPFHj2/RdxZ9uojEuYlasy4iEgei3UKvAm6x1g4GTgJuNMYMjnKdYtZzVz7HfaPva9F3fPjoc38fRj8xOky1EhGRWBDVQLfWfm2t/ajm52JgA9A7mnWKdVNHTcXOsfTt2LdF33vT+6ZObhMRacei3UKvZYzpC5wI/Du6NWkbtv7v1hbNgvebmDdR+8GLiLRDMRHoxpjOwPPAFGvtvkY+/5kxZrUxZnVBQUHkKxijnrz0SbZP2d7i760vXK/WuohIO2OstdGtgDHJQB6wwlq7MND92dnZdvXq1eGvWBvjWeBhR9mOFn9vQPoANk3dFIYaiYiIG4wxa6y12YHui/YsdwM8AWwIJsylad7pXmadOqvF3/ui+Au11kVE2oGottCNMaOA94BPAF/N5V9ba//R1HfUQg8sbW4aZZS1+HtZSVl8MvkTPJmeMNRKRERC0SZa6NbaldZaY6093lo7tObVZJhLcA7MOcCi3EUt/l5hVSF97u/DqX84NQy1EhGRcIqJSXHivgnDJ2DnWFJIafF3P/jmA8xco2AXEWlDFOjtXPmc8hZvRuPnD/aFKzW9QUQk1inQ44B/M5pTep0S0vdveeMWMuZl6MAXEZEYpkCPI+///P2Q1q0DFNtiRjwxQueui4jEKAV6nPFkerBzbMjd8P5z13WSm4hIbFGgxyl/N/xZnrNC+v6iTxeReUemWusiIjFCgR7n3rjuDewc2+Lz1gH2Ve9jxBMjOGzBYQp2EZEoU6AL4Jy3vuq6VQzrMazF3/267GtGPDFCM+JFRKIo6nu5t5R2iouMjLkZFFMc8vfHHz2e5658zsUaiYjEpzaxU5zErn1z9oU8vg7wt01/I3FuorriRUQiRIEuTfKPr48/enxI3/fhq+2KvznvZpdrJyIi9SnQJaDnrnyuVcEO8OCaB0mYm6AxdhGRMFGgS9D8wR7qjnMWyy1v3IKZa7SOXUTEZQp0abH3f/4+L1/+MmkmLeQyFn26SLPiRURcpECXkOQOzKV0dimrrlsV0olufre8cQsJcxMYv2Q83iKvizUUEYkvCnRplRxPTqtOdAOnK37ppqX0ub8Pwx8ZrmAXEQmBAl1c4d9KdlHuolZ1xX+0+yP63N+HYY8O05I3EZEWUKCLqyYMn1DbFT/y0JEhl7O2YC0jnhhB1/ldWbxmsXsVFBFpp7RTnISVt8jLWYvO4ouiL1pd1lHpR7HksiXkeHJcqJmISNugneIkJngyPWyasgk7x3JBvwtaVdbm4s2MeGIEXX7ThbyNeS7VUESkfVCgS8TkXZuHnWN5+fKXSSU15HIKKwu58NkLtZ5dRKQeBbpEXO7AXA7MOdCqnef8/OvZxy0Zp9nxIhLXFOgSNf6d51Zdt4qh3Ya2qqznNz1Pn/v70GleJ21WIyJxSYEuUZfjyWHtjWvZPmU7444e16qySm0pt7xxCylzU5icN1mtdhGJG5rlLjFp4cqF3PLGLa6UlUYaj+Y+yoThE1wpT0QkkjTLXdo0/0Y1Nw2/iYRW/mt6gANMzJtI+h3p6o4XkXZLLXRpE7xFXua/N59H1jziSnnpSen83xn/x9RRU10pT0QkXIJtoSvQpc2Z9PwkFn26yLXy+mX048ExD5I7MNe1MkVE3KIud2m3nrz0ydp947umdG11eVv3beXCZy9k8IODtWGNiLRZaqFLu7Bw5ULmvjOXfVX7Wl1WqkllTP8xzDh9hraZFZGoU5e7xKV8bz4XP3MxOw/sdKW8w9MPZ+4ZczVDXkSiRoEucS3fm89dK+/ilc9foYIKV8pMS0zjikFX8OSlT7pSnohIMDSGLnEtx5PDC1e8QPmcchblLqJ7avdWl3mg+kDtVrMnP3ayzmsXkZiiFrrElbyNedyQdwPe/e7sIJdIIhcffTH3//B+PJkeV8oUEalPXe4izfAWeXkk/xEe/tfDlPhKXCnTYLjk6EsU7iLiKgW6SBC8RV7ueu8uFq1dxAHfAdfK7dahG4suXqS17SLSagp0kRZavGYxd79/Nxv2bnCtzEQS+fFxP+b/jfh/WgInIiFRoIu0wsKVC3lw9YP8t+i/rpVpMPRI68G0U6Zpy1kRCZoCXcQF3iIv1y69lre8b7labmZSJleecCWThk5Sy11EmqVAF3FZvjefWW/OYsXWFa6W2y21GzNOnaFWu4g0SoEuEkaL1yxm6j+nsrdir6vlKtxF5GAKdJEIWbxmMTe/erMr+8j7DcoaxFOXPqXueBFRoItEmrfIy4+e/hFrd691rcwkkkjvkM6Zfc/k1lG3KuBF4pACXSSKvEVe8nfm88L6F3hu/XMh7ydvMABYLAZDAglkdMjgwgEXcufZd2oDG5E4oEAXiRHeIi/z35vP8xuep6C0gGqqg/6uwWBp+r/R0/uczr3n3quWu0g7pkAXiUHeIi/PfPIMD374IDv27wh4f6BA9+uS0oURvUcwbsg4zu9/vlruIu2IAl0kxvmXwb2+9fUmW+2JJLa4RZ+ZksnVx13N9NOmK9hF2gEFukgbkrcxj3v+dQ9rd65lf9V+fPgajJ+3xuCug1lwzgLtKy/SRinQRdqovI153Pnenaz7Zh0Vvgp8+Fwru1tqN04/4nTNmBdpQxToIu2At8jL8i+XM+/NeXhL3TnD3U8td5G2QYEu0s4sXLmQ+e/Pp6CswNVyE0igQ1IHRvYayd3n3a2Wu0iMUaCLtGP53nzmr5zPW9veoqi8yNVu+YzkDK45/hpuPe1WTaoTiQEKdJE4ke/NZ8HKBaz4cgUl1SWuldsjtQfXDb+OX+b8UsEuEkUKdJE4tHjNYma9PQtvSevH2xNJJNEk4rM+khKS6NGpB1cdf5UCXiTCFOgicW7xmsXc/a+7+XLPl1RS2aqy6q+HTySRzA6Z9MnowymHn8LEoRM17i4SRgp0EamVtzGP29+9nY93fdyipXDNrYVPJBGApIQkjsw6kp+c+BOuOu4qtd5FXKZAF5EmeYu8/Oofv2LZpmXN7kSXQEKz4Z9AAgZTuxGODx+pJpV+Xfsx7eRpTBg+IQy1F4kvCnQRCchb5OWR/Ed4et3TfL3/a6qpxmBIJpkqqrA1/zQl0G52vdJ6cfHgi5k0dJK65UVC5EqgG2PWQqP/pRrAWmuHhV7F0CjQRcIn35vPk+ue5N0t77KlaAuVvsoW7SUfSFpCGmP6j+GBHz6grnmRILkV6Ef5fwReBH5U/3Nr7ebWVDIUCnSRyMjbmMcd793Bum/WUe4rByCJJKqoanXZvVJ7MWHYBEZ4RpBzWI7CXaQZrne5G2M+ikaL/GAKdJHIy9uYxz0f3MOGgg2UVJZQXl1e293uwxfSATL1x+fTEtL4n5P/h3lnz3O13iLtgQJdRMIm35vPg/9+kLe2vsW3B76l2lftym51XTt0pX/X/gw7dBiTTtS4uwi41+V+fL1fnwUug5q/lgPW2o9bU8lQKNBFYku+N5+HVj3Ey5+/TGFFYavLq9+t3ymxE0N6DuHSQZfy4+N+rK55iUtuBfp7zXzXWmtPD6VyraFAF4ldeRvzeDj/Yd7b9h6lvtKwPCORRK499lqevPTJsJQvEmvcCvQR1tpVrtaslRToIm3DwpULWfjvhewo2VF7zWBCGm9vTOeEzlxz4jXaqU7aPbcCPSbGzetToIu0Pd4iL69++Sqrv17N2p1rWf31alfG3JNJxmDoktaFY7ofwwUDLlDXvLQ7rq1Dt9ae6GrNWkmBLtL2LV6zmOmvT+fbsm9bXVZju9n17NiTSSdO0kEy0i64FeiFwJtNfW6tvSS06oVOgS7SfniLvCz/cjnvbn2XldtX8tW+r1w92x2cwD+086FMHTmVqaOmulq2SCS4FehfAL9o6nNr7RuhVS90CnSR9mvxmsXc/eHdbN2zlTJbFnAv+ZaqXRZ32DBtRytthrrcRaRN8xZ5yd+Zz1/W/YXnNz0flmekJ6fzk+N/wvTTpqtrXmKWW4H+orX2Ildr9v1nPAnkAt9aa48NdL8CXSQ++ZfEfbTzIwrLCrFYfDX/uMFgOL778dxx1h3kDsx1pUwRN7gV6KfS+OEsAFhrPwiteg2ecTpQAvxJgS4iwcj35rNo3SLe3vY2m/dspoIK15/RK7UX5ww4h/834v+pa16iyq1AX97IZQsMATzW2sTQq9jgOX2BPAW6iLSUt8jLgvcW8PQnT7uyU11jEkmkV3ovpo7QxDqJvLCch26MGQnMBHoBv7HWLgu9ig3K7YsCXURayVvk5dH8R1n62VK27N3i6tGv9fXq2ItJJ07ihpwbNPYuYedqoBtjzgBmAanAndbaxlruIQsU6MaYnwE/Azj88MOH//e//3Xz8SLSTuV783ly7ZO88993+GLPF64c/dqYE7ufyB9+9Ad1zUtYuNXlfh5wG1COE+Rvu1bDhs/pi1roIhJG+d58Zr85m7f/+zZlvrKwPadLhy7MHDVTXfPiGrcC3QdsBz6ikclxbm0so0AXkUhbuHIhd628i93lu8P2jIzkDE7tcypzz5yr1ruEzK1AH93cl93YWMYYswT4AdAN2AXMsdY+0dT9CnQRcVvexjxmvjmTzwo+o5LKsDwjhRR+MfwXPJD7QFjKl/bL7TH0FODIml+3WGvdXyMSJAW6iISTf9z9Xzv+xee7PqeM8HTPd+3QldtG3aaueQnIrRZ6InA7zoS0HYABDgMeA2Zba8Mzw6QZCnQRiaS8jXlMf206n333WVifM/HYiTrjXRrlVqDfi9MVfrO1tqjmWhZwH7DPWvsrl+obNAW6iETLwpULuev9u9hdFr5x9wQSyO6VzcMXPKxxdwHcPZzlGGut76DrScAGa+2AVte0hRToIhILFq5cyKy3ZlHqKw3bMwyGgYcMZNrJ05gwfELYniOxza1A32StPbqln4WTAl1EYk2+N59p/5zGhzs+DOuSuF6pvbjr7LsU7nHGtcNZgGettc8cdP1K4MfW2gtbXdMWUqCLSKy7Oe9mHl/3OKXV4Wu9J5LI0V2O5u5z79ZhMu2cW4HuAV4E9gJrai5nA1nAxdba7S7UtUUU6CLSluR787l66dVsKtoU1uckkcQvh/9Sy+LaIbeXrZ2LcyALwGfAP21LNoF3kQJdRNoqb5GXKf+YwrJNy1w79rUxySRz66m3Mu/seWF7hkSOWy30jOa+bK3dF0LdWkWBLiLtxeI1i5n77ly27dsWtmcYDBOOnaAlcW2Ym1u/fg21RxaZeh9ba+3hraplCBToItIe3Zx3M79b87uw7VTnN/Kwkcw8babG3dsQtwL9YeA04B1gibX2X+5VMTQKdBFp7/K9+Ux4YQKf7dVmNuLiGLoxJgEYDVwJnAgsB/5grY3KGaYKdBGJN3kb87jng3t4d/u7YSk/kUSO7HIkvz7111oSF4NcnRRXU2AGcAXwG+A2a+0fWlfF0CjQRSSeTXp+Ek9/+nRYu+Y9nTzcfubtCvcY4VbSP0BfAAAgAElEQVSXexpwIXA50Bv4O8669K1uVbSlFOgiIo6FKxcy440ZVBC+87KSSOKaY69R13wUuRXoxcBm4K/ABg46E91a+1Ir69liCnQRke/L25jHtNemseG7DWF9zvijx/Pclc+F9RnSkFuB/jQHhXg91lp7bYj1C5kCXUSked4iL+cvPp/1hevD9oxkkpk/er6Of40A18fQAzzsamvt060uKAgKdBGRllm4ciF3rLyDveV7w1L+GX3O4J5z79HpcGES6UD/yFo7rNUFBUGBLiISutmvz+b+VfdTXFkclvKPyjyKmafN1IQ6F0U60Ndaa09sdUFBUKCLiLhj4cqF3PbGbZQRnhPiMlMyuSnnJm1B20pqoYuISNAWr1nM/77+v+wu2x2W8tMS0rj+xOt1eEwIgg30BLee51I5IiISBROGT6BgegF2juXly1/mhG4nuFr+Ad8BHlzzIGauYdADg8jbmOdq+RIg0I0xFwVZzocu1EVERGJA7sBc1t24DjvHsuq6Vfygzw9cLX9j4UYufPZCEuYm0G1BN2a/PtvV8uNVoGVrEetKD5a63EVEosNb5OXCpy9k3e51rpedbJIZ3G0wU0ZO0YS6g0S6y11ERNo5T6aHtTeuxc6x2DmW8UePx7g04lppK/lPwX+YmDeRDnM7sHDlQlfKjSeBWuilwMbGPsLZWCbirXe10EVEYou3yMv89+bz1/V/ZU/ZHtfKTSSRY3scy5QR8d1qd2unuPXAj5r63Fq7ObTqhU6BLiIS2/I25jH9tel89p07x78mkMCRWUdy/fDr+fFxP8aT6XGl3LbCrUCP2PryYCnQRUTaBrfOdfd36yeTTEJCApkpmQw9bCiTcyaTOzDXjarGNLcC/XfW2htcrVkrKdBFRNoeb5GX3+X/jmfXP8vWwq348LW6TH+X/B1n3tGug92tQP8tMNNau/+g6wOAh6y157e6pi2kQBcRadtqw/3TZ9lc1LqRW4Mhs0MmJ3lO4tJBl3J+//PbXZe8W7Pc9wL/McZcVlNoqjHmN8By4PHWV1NEROKNJ9PDnWffyZdTvmT7lO2MO3ocCS1cdOXvhrdYsJC/I5+737+bS569hAUrF+At8oaj6jEt4Navxpj+wCNAMtAHWAbMPbjVHilqoYuItE95G/N4OP9h8nfkU1heiA8fBkOSSaLSVjb5vY5JHbHWMqjbIPZV7KO8upwuHbpwyuGnMGnopDZ/ClywLfSkIMqqAMqALjX3r41WmIuISPuVOzC3dizcW+TlmU+eYcmnS9i0ZxNVVVVOa/wgiSRSbatJS0yjylaxe/9uOqV0oryqnLxNefzts7/RP7M/Y4eM5arjrmp33fH1BRpDnwH8FJhtrf2LMeZw4EEgA7jBWvt5ZKpZRy10EZH4ku/NZ/7K+azYsoL9lU570tT8k2gSSTDOsrbC8kKqbBVpSWkUlhWSYBJIMSkUVxZTbatJTkhmQNcBXHnclW1q+Ztbk+IeAX5trS066PqFwD3W2oGtrmkLKdBFROJTvjefResW8c62d/i65GsqqipITk4mKyWLLmld2LJ3CxmpGZRWlFLpqyQpIYnSilLKfeUkkljbwk9OSKZrWldG9h7JmKPHMKb/mJgO97Afn2qMSbXWhucQ3WYo0EVEBJxu+b988hee/+x5CssLKa8qJy0pjV37d4EFayz7K/ZjrSXBJFBtq2u/m5SQRFZKFkceciSj+ozi5pNujtlQd6uFvsRae2XNz7+x1v663mfLrbVjXKltCyjQRUSkPm+Rl1e/fJXlXy5n7TdrKa8qJ4EEvjvwHeXV5RhjsNZisRgMFkuSSSIzNZOs1CxKKkrolNyJo7ocxZlHnhlzY+2u7xR38Mlr0dpFToEuIiJNyffm8+C/H+TNrW9SVFGEz+ej0leJz/pIMAn4rDNzvkNiB1KSUvD5fGAgKzWLQzsfyta9W0lKSKJ/1/5ccPQFMTHW7tY69Ob640PrqxcREQmTHE8Of770z/z9ir9z3pHnkZyQ7HS51/zjXwqXkphCla8KgNSkVKqqq/iq6CtKKkr4ev/XvLv9Xaa/MZ1BDw9ict7kNrGuPVCgdzTGHGeMOQFIq/n5eP/vEaifiIhIi+V4cnj+iud5/drX+dExPyK9QzoJJoFkkumQ3IHUpFSstWAgySRRbavZX7Gf0urSBsvjSqpKeGLtE8x4bUbMh3qgLveVNNMSt9aeFo5KNUdd7iIi0lL+cfZ/fPkPPv7mYxJNIqWVpVTbarJSsygqL6Jgf0HtBjb+ZXH+Fn3X1K6M6T+GSwZfQs5hORHthg/7LPdoUaCLiEhreIu85O/MZ5V3Fa9tfQ1jDXsP7GVL0Zba1rl/K1ofPhJIoHNyZwZ1G0S3zt34tuRbhh82PGK70Lk1Ke6U5r5srf0ghLq1igJdRETc4l/b/sH2D/js28+oxGmhJ5CArfknkUTSO6TTIakDg7oNoqS8hL1le0lKTGL0EaM5u//ZYW21u7X166xGrllgCOABEkOom4iISEzI8eTUtrIXrlzI7Hdms79qf21XewIJJCcmk2SSyEjJoKisCIultLKUxKpE/r7p75RVl7H+2/VMGDohqjPimw30g9eZG2NGAjOBb4EpYayXiIhIRE0dNZWjux3NzDdnsnHPRnz4SE1M5aiuR1FYVkh6SjrJScnsKtlFpa+STh06caDqAF8Vf8WWwi18XvA5lwyJ/Bi7X1Bj6MaYM3Ba66nAndba5eGuWFPU5S4iIuHmH2f/fPfnbCncwubvNvNN8Td0TunM5sLNpCenk5iQiLWWtOQ0PJkedu3bRUJiArtLdzOo2yAm50yuPWymNVzpcjfGnAfcBpQDd1hr3251zURERGKcJ9NT28r2n/z2hzV/ILEqkbTENCyW8upy0lPS6ZjSke/2f8fmws3069KPHh17sKNkB3PemQPgSqgHI9A69OXAEUAJcJMx5oX6r/BXT0REJLo8mR6mjZrGA+c9QM9OPZ0d5vDhSfc4u8x1yGJL4RYyUjLI6JBBh6QOdEjsQJfULjyx9omI1TPQpLhzIlILERGRGJc7MJehhw5l+ZfLyduUR7Wvmg6JHTAJzl7xPTv1BKDKVtEhsQNZqVlsL9oesfoFmhT3RjCFGGOes9Ze5k6VREREYpMn08P1w69nTP8x5O/MZ9PuTWzeu5mdGTuppJJKXyUVVRX0zuhNYVkhh6UfFrG6BWqhB2uAS+WIiIjEvIPH2B/Jf4S/fPIXLJY+6X04UHmAvWV7mTIycgvCAo2hB6ttbTcnIiLiEk+mh7vOvotHxzxK/6z+7CndQ3pKOnPPmBuxCXHgXgtdREQkruUOzI1ogB/MrRa6cakcERERCUGzgW6MCXa+/a9dqIuIiIiEKFAL/cRgConmznEiIiISeAy9ozHmOJroUrfWfux+lURERKSlAgV6b+ARGg90C5zueo1ERESkxQIF+pfWWoW2iIhIjHNrlruIiIhEUaBAb3L2ujHmWZfrIiIiIiFqNtADzF4/2eW6iIiISIjU5S4iItIONDspzhgzrKmPgGT3qyMiIiKhCDTL/b5mPtvoZkVEREQkdIHOQz8zUhURERGR0AXqcr/koEsW2A2ss9YWh61WIiIi0iKButwvbORaV+B4Y8x11to3w1AnERERaaFAXe4TG7tujDkCeA4YGY5KiYiISMuEtGzNWvtfNMtdREQkZoQU6MaYY4Byl+siIiIiIQo0Ke5lnIlw9XUFDgWuCVelREREpGUCTYq796DfLbAH+MJaWxGeKomIiEhLBZoU905j140xo4wxV1prb2xtBYwx5wMPAInA49ba+a0tU0REJN4EaqHXMsacCPwYGA9sBV5o7cONMYnAI8A5gBfIN8a8ZK39rLVli4iIxJNAY+hHA1fWvHYDzwLGxR3kRgBfWmu31Dzvr8BFgAJdRESkBQLNct8InAXkWmtHWWsfAqpdfH5vYHu937011xowxvzMGLPaGLO6oKDAxceLiIi0D4EC/RLga+AtY8wfjTGjcU5aiyhr7WPW2mxrbXb37t0j/XgREZGY12ygW2v/bq29AhgIvAVMAXoYY35njDnXhefvAPrU+91Tc01ERERaIKiNZay1+621z1hrL8QJ3bXAdBeenw8MMMb0M8akAFcAL7lQroiISFxpNtDrn7ZmjOkCYK3dW9MFPrq1D7fWVgGTgRXABuA5a+361pYrIiISbwK10GfW+/mNcFTAWvsPa+3R1tqjrLV3huMZIiIi7V2gQDdN/CwiIiIxJNDGMmk1G8okAKk1P9cGu7X2o3BWTkRERIITKNC/ARY28jM4+7qfFY5KRYLXC/n5UFAA3btDTg54PNGulYiISGgC7eX+gwjVI6K8XnjxRcjKgp49oaTE+f2iixTqIiLSNgWa5T6t3s/jD/rsN+GqVLjl5zthnpEBCQnOe1aWc11ERKQtCjQp7op6P8846LPzXa5LxBQUQOfODa917uxcFxERaYtaM8u9zc56797d6Wav77334IknYORIGDsW8vKiUzcREZFQBJoUZ5v4ubHf24ycHGfMHJyW+XvvwTPPQGqqc83rhdWrYfdumDAhatUUEREJWqBAP8EYsw+nNZ5W8zM1v6eGtWZh5PE4E+Dy82HXLnj9dUhMhKIi+O67uvsmToSlS9VaFxGR2BdolntipCoSaR5P3Yz2e+6B8vKGYe73yitgDNg22x8hIiLxIKjDWYwxxxljxte8hoS7UpHWqVPjYV6fMTB7dmTqIyIi0lKBlq1lGmPeBl4EfgxcBbxkjHnLGJMRgfpFxAUXQHV14Ptuv90JdhERkVgTqIV+O7Aa6G+tHWutvRgYgHPsabs5SOWGG6Br1+DvV6iLiEisCRToZwO3Wmt9/gs1P/+65rN2weOB225r2XeMUbCLiEjsCBToFTVnljdQc608PFWKjqlTYfz4wPcdTKEuIiKxINCyte+dsFbDAB3CU6Xoee45Z+Lb7be37Hv+UNdMeBERiRZjm0khY8xbzX3ZWnum6zUKIDs7265evTqsz/B6oU+f0L7bsyd884279RERkfhljFljrc0OdF+gdegRD+xY4PE4re1QutN37dK6dRERibyg1qHHK2th2LDQvqtJcyIiEkkK9ADWrIHt20P/voJdREQiQYEeBH8XfGso2EVEJJwU6C1gbeta66BgFxGR8Ag60I0xHzX3e7xwo7UOCnYREXFX0IFurR3W3O/xxloFu4iIxA51ubeStXDTTa0vR8EuIiKtEei0tWJjzL5GXsXGmH2RqmSse+ABJ9hTUlpfloJdRERCEWhjmfRIVaQ9KK/Z3d6NQNZ2siIi0hIt6nI3xvQwxhzuf4WrUm2dW+PrUNdi79fPnfJERKR9CirQjTE/MsZ8AWwF3gG2AcvDWK92wc1g37ZN3fEiItK0YFvotwMnAZustf2A0cCHYatVO+NmsIOCXUREvi/YQK+01u4BEowxCdbat4CAJ79IQ+EK9uRk98oUEZG2KdB56H6FxpjOwLvAX4wx3wL7w1et9s0f6m61squqNIlORCTeBdtCvwg4APwKeBXYDFwYrkrFC3+LPTXVvTI1iU5EJD4F1UK31tZvjT8VprrErQMHnPejj4YvvnCnTP8kOlCrXUQkHgQV6MaYYsAfCylAMrDfWpsRrorFo02b6n52c9Jb/bIU7iIi7VOwLfTaDWaMMQanC/6kcFVK3B9n91OrXUSkfWrxXu7W8XfgvDDURw7iH2cf5vJROP6xdi1/ExFpH4Ltcr+k3q8JOEvWysJSI2nUmjV1P4er1Z6aWjeeLyIibUuwLfQL673OA4pxut0lCvyt9qwsd8stK6trtS9c6G7ZIiISXsa2scHU7Oxsu3r16mhXI+aEs+u8jf0rIiLSrhhj1lhrA27m1myXuzHmIepmt3+PtdaFk8DFDf7Q7dULdu1yt2x1yYuIxL5AXe6rgTVAKjAM+KLmNRRn+ZrEmG++cX+LWb/6XfLdurlfvoiIhK7ZQLfWPmWtfQo4HviBtfYha+1DOIezDI1EBSV0/mCfNcv9svfsqQv3Ll3cL19ERFom2ElxXYD6m8h0rrkmbcC8eXXh3rGj++UXFmrLWRGRaAs20OcDa40xi40xTwEfAb8JX7UkXPbvD1+XPDQ8t33SpPA8Q0REvi+oQLfWLgJGAsuAF4CTa7ripQ3zB3u4wn3Rorpwz88PzzNERMTRbKAbYwbWvA8DDgO217wOq7km7YQ/2CdODE/5I0bUhftll4XnGSIi8azZdejGmMestT8zxrzVyMfWWntW+KrWOK1Dj5zcXHjllfA+46ab4IEHwvsMEZG2LNh16NpYRoLSoQNUVIT3GWedBW+8Ed5niIi0NcEGelBj6MaY8caY9JqfZxpjXjDGnNjaSkrbUV5e1y2fEqYdCN58U7PlRURCFews91nW2mJjzCjgbOAJ4Pfhq5bEskiEe/3Z8jffHJ5niIi0J8EGenXN+wXAY9baV9BOcULDcA+XBx/UUjgRkUCCDfQdxpg/AJcD/zDGdGjBdyVOhHsZHDRcCqdwFxGpE2woXwasAM6z1hYCXYH/DVutpM2rH+6HHBKeZ9QPd3XLi0i8C3ZjmVLgW2BUzaUqnENaRALavTv8Y+71u+VHjw7PM0REYlmws9znANOBGTWXkoGnw1Upab/qj7mfckp4nlF/trxa7yISL4Ltch8L/AjYD2Ct3Qmkh6tSEh/efz/84Q51rfekJI27i0j7FWygV1hnBxoLYIzpFL4qSTyqH+4XXBCeZ1RXNxx3Hz48PM8REYmGYAP9uZpZ7lnGmOuB14HHw1ctiWd5eXXh/vLLkJUVnud89FFduB97bHieISISKcFOirsXWAo8DxwDzLbWPhjOiomAs5/83r1OuG/fDkOGhOc569fXhfuQIeD1huc5IiLhEvRacmvta9ba/7XW/g/whjHmqjDWS+R7PB749NO61vuAAeF5zmefQZ8+TrinpcHixeF5joiImwIdn5phjJlhjHnYGHOucUwGtuCsTReJmk2bwj+prqzMOVJWM+ZFJNYFaqH/GaeL/RPgp8BbwHjgYmvtRWGum0jQ6k+qmzUrfM+pv969a1e13kUkdgQK9COttROstX8ArgQG4+wWty78VRMJzbx5DSfVhWunur1761rvGRkKdxGJrkCBXun/wVpbDXittWXhrZKIe3Jz63aq274dTgzTob/FxQ275rXeXUQiLVCgn2CM2VfzKgaO9/9sjNkXiQqKuMXjcZaq+Vvv990XvmfVX++ekQELF4bvWSIiECDQrbWJ1tqMmle6tTap3s8ZkaqkSDhMnVoX7qtWwUknhec5xcVwyy1OuKenK9xFJDx0BKoIkJMD//pXXbgPGhSe55SU1IV7164KdxFxjwJd5CA5Oc5a9HAvidu7ty7c+/WDX/4S8vPD8ywRaf8U6CIBRGJJ3LZt8LvfwYgRTsBnZan1LiItE7VAN8aMN8asN8b4jDHZ0aqHSEvUXxJ3003he05RUV3rfdgwZ397EZHmRLOF/ilwCfBuFOsgErIHHqgLd//Y++DB7j9n7Vq48MK6WfNnnqmueRH5vqgFurV2g7X282g9X8RtOTnOIS/+cD/hhPA85+23na75pCQ4+WSFu4g42sQYujHmZ8aY1caY1QUFBdGujkhAOTmwbl14w726Gj78sG7cvWtXmD3b/eeISNsQ1kA3xrxujPm0kVeL9oG31j5mrc221mZ37949XNUVCYv64W4tjB8fnufs3Qu33153StxJJ2nsXSSehDXQrbVnW2uPbeT1YjifKxLLnnuu4V7zI0ZAYqK7zygrg3//2xl7P+ooBbtIPGgTXe4i7VVurhO8VVVO1/zVV0OvXpDg4n+ZW7Y4wZ6WBkccAWPHKuBF2qNoLlsba4zxAicDrxhjVkSrLiKxICcH/vxn+PprZ3zcvx2tW+FeVgZffQV//3vdrPmMDLj2WvB63XmGiERPNGe5L7PWeqy1Hay1Pa2150WrLiKxyL8drT/cx451v2u+uNj5S0SfPtCxI/zwh5o1L9JWqctdpA3IyYEXXnC65hctgkMPdf8ZBw7A8uV1s+bT0jRrXqQtUaCLtDETJsDOnQ23o01Pd/85ZWV1s+aPOELj7iKxToEu0sbNmwf79jWcOX/iiU4QQ917a3z1VcNx90svVde8SKxRoIu0M7m58NFHTgj/8pdw+OGQmupe+cXFTvf/iBFOz8AZZ6j1LhILFOgi7ZTHA4884pzkduCA03IfOdLdZ5SUwLvvOq335GQYMgTuvluz5kWiQYEuEidyc52tYv3d8iNHOiHslqoq5xz56dOhf3+nW17BLhI5CnSROOQP94oKZ0mc2y338nKnW75PH+cvDQMGwOLF7j5DRBpSoIvEuZycupa7tXDffdCpk3vlV1XB5s0wcaIz5t6nD4wbp0l1Im5ToItIA1OnOmPj/q75QYNaX6a1zvv+/bBjBzz/vDOpTmvdRdyjQBeRJuXmOuPi/nA//XTo0iX0sXd/L4Cff617QgJkZsKYMWq5i4RKgS4iQcnNhXfege++c8bet2+HG2+Ebt1aX7a1zlr6V191Wu5dujh7zCvcRYKnQBeRkHg88PDDUFDghPs117g39l5Y6Owxf9JJTrd8374webJmzYs0R4EuIq3m8cCf/uSMvfvPeO/QwdlZLiGh7r2lfD6nW377dmdN/RFHQPfucP752sxG5GAKdBFxlf+M97IyJ5Crq+Gll+CYY0Iv0+ere9+9G1ascDaz6djR2dteLXcRBbqIRIB/ct3LL8PRR7t3xvuBA/DUU85M/DPOgAULFO4SvxToIhIxubnw+edOq337dmdc3I2T4kpKYNMmuPdeGD7c2YJ27Fh1y0t8UaCLSFR4PPDQQ87s9kWLnFZ2Skro5e3d6wT7/v1QVOTsgDd+vHN2vMbcJR4o0EUk6iZMcLrky8udbvmLL3ZmtnfoEHwZVVV16+MLC53Z9z4f7NpVN+aemursVHfeeQp4aX8U6CISU3JzYdky2LrVmVjn39CmuSNgk5OdmfT+s98rK5217f53v/JyZ4z9n/90An78eI25S/uhQBeRmObf0OaLL2D+fDjssIafJyY6LfmUFGfDm8RE57rP1zDMG7N0KRx1FGRlwdChOkBG2jZjA/0bH2Oys7Pt6tWro10NEYmi/HwnjNetcybX7dvnzJwvLnZa8v7d7MC57l/21pT69yQkOGvdf/YzmDcvvH8OkWAYY9ZYa7MD3qdAF5G2zut1Qv611+CDD+Crr5xxdGuDC/SmGOOcRjdrltNTIBINwQa6utxFpM3zeJxlao8+6rTaP/4YLrnEGVsPNczB+QvBqlXOeHtKCvTvr255iV0KdBFpdzwep0v+hRecCXXNzZb3T6QLpLKy7lz3Pn20iY3EHgW6iLRb/gl1ZWVOt3lmZt1nwQZ5Y7xemDHDmVDXp49zMI1OhpNoU6CLSFyYN69uXH37dnjsMRg8OPRg9y+L83rhmWdg9Gi49FIFu0SPAl1E4o7HAz/9KaxfDy++6Gxk06VLy8vxzym21plh/8ILzpGv/fpprF0iT4EuInHNv5HNd985E+DGjoWuXVvWcq+/WMha2LbNGWs3xlkX36sXLFzoetVFGlCgi4jUyMlxWtl79jiz419+2WltN6Wx0D94JbB/+9lbbnHCffBgtd4lPBToIiJNyM2FLVucYD/tNOdkOP9OdKGMvft8sGGD03rv1MlZWqcxd3GLAl1EJIDcXHj3XWdHun/9y5n8lpHRupnypaVOV/+IEU6X/N13axmctI4CXUSkBXJynDXun34Kv/+903JvzbGv4HTJT58OAwbAuHEKdgmNAl1EJAQeD1x/vdNyX7nSOZK1Y8fWlVlWBs8/7+xI94MfwOOPK9wleAp0EZFWysmBV1+F/fud8fYRI+rOZg9FebmzIc711zsb13Tv7mxko3CX5ijQRURclJsL//63c9qbtU7AH3FE68rcvds5Ovbww+GHP1SwS+MU6CIiYZSb63TJL1gAJ5xQN0s+FNbC8uVOq90YOPZYyMtzr67StinQRUTCzOOBadOck+Cqqpx95UPZme5g69c7J8H17q3lb6JAFxGJuHnznJ3prIX77oNu3VpX3s6dzrj9SSfBH/+oLvl4pUAXEYmiqVOhoMAZaw901Gsg//43/Oxnziz5MWPUao83CnQRkRjgP+r1yy/h2mudneRCVV7uzLo/9VRnExy12OODAl1EJIZ4PPDUU1BS4nTJz5oVequ9stLZm/6oo6BvX53b3t4p0EVEYti8ec6GM7NmQVpaaGVUVDit9CVLnJ3tTjxRW822Rwp0EZE2YN48Z//37dvhzDNb/v3qaudVXu7Mtv/1r51lbzogpv1QoIuItCEeD7z5Zt2mNSecENohMdXVUFRUd0DMoYfqWNe2ToEuItJG5eY6re2XXmr9drPffOPMkJ8wQV3xbZUCXUSkjau/3eyiRTBokDPe7m+5B7s7XWUl/OlPMHCgc/Lbbbcp3NsSBbqISDsyYQJ89hls2uQc6HLYYZDQgv+nt9Z5//preOQRuO46jbG3Fcb6/9drI7Kzs+3q1aujXQ0RkTbB63X2f3/+eVi1CgoL60K7McZAaqpzj38iXUoK9OzpzI6/7jqnR0AixxizxlqbHfA+BbqISHzweuHRR+H3v4e9exu/xz8OX1XlhLvP57xb67wnJDjHxT74oPMu4RdsoKvLXUQkTng88JvfwMcfw+TJkJHR8POUFCewq6udcXefz7nub/f53z/80Fk6N3Kk1rPHEgW6iEic8XjgoYecZWvbtztHuw4eDElJda3xpjpv/dfLypzT3u67DyZO1Dh7LFCgi4jEMf/RritWwJQpzu/GOK+UlO/f7w90f+s9Lc2ZhPfb36qlHm0aQxcRkQYWL3Z2pisvd45mPZh/LD0jw5ksV1zsvB9+uHOoTO/eMG6cxtjdojF0EREJyYQJzszOymwAABDxSURBVKS3ESOcoPavZ/e/W+t0z2dmOmvXfT7YscNZ6vbdd5CXB5df7mwvq1Z75CjQRUTke3JznW1hv/nG2Ynu9NOhSxdnslxyMnTt6rTSS0udSXSdOzsnxO3Y4XTVV1c7Lf1p0zS+HikKdBERaZb/rPY9e+Dvf4ehQ51lbZWVcOSRToCnpDit9oQE2LfP+b2yEv75Txg1ygn8wYO1X3w4aQxdRERaxOuFV1+F1audbvitW50NayorYf9+p0u+pMT5C0BFRd3Ws1VVzvvgwc7Mem1QExxtLCMiIhGRnw+/+pWzDK642Anwb791wt2/nv3gDWoyM+Gqq+DWW52Z9dI0TYoTEZGIyMlxgjkrq25MvUMH57P6IX6wJUvgxhvhj3/U5Dk3KNBFRKTVcnOdgL7lFujTBzp2/P46dn+HcGKi0/1eVQVbtsDMmXD88c7YvMbYQ6dAFxERV3g8MH26E+yTJztL3ny+7+88598v3ueDzz93JtFVVsIXXzhd9wsXRqf+bZ0CXUREXOXffW7pUjjttIYt9c6d6zamqaqq6443xtnIprDQaeWfeKL2iW8pBbqIiIRFTg689RZs3uyMlffs6VxPS4P+/etOdPOvZ/dvJwtOy/3++53vaR17cBToIiISVh4PPPyws8ztt7+FMWOcUE9JqRtPP3jinDHOLPk1a5wd5xTqgSnQRUQkIjwe+OlP4c9/hr/+1emOr652xs+trWuhJyQ4v1dX13XFayZ8YAp0ERGJOI8HHn8cLrjAmSTnnzRnjPN7YqKz81yHDtCjh9OKVyu9eQp0ERGJCv+57LfcAoce6pzUlpbmhLrP5wR79+7OvvE9e0JBQbRrHNsU6CIiEjUeD9x5J7z4Iowd6wS4Mc5s+OOOc14JCU7gd+/ufCc/H665xtlCdvBguPZatd4BkqJdARERkZwcZ2wdnHD+4x+dbvZDDnHCPDHRuSc/H2bMgG3bID3dCf8PPnCObv3Nb+L7DHYFuoiIxJScHCfE8/Odbvbu3Z1r/i763budveA7dnTuN8a5b+lSBXpUGGPuAS4EKoDNwERrbWG06iMiIrHD42n80JYdO5xZ8Z061V1LTXWuv/yy8967N4wbF3/hHs0x9NeAY621xwObgBlRrIuIiLQBvXs7k+XKyuqu7d7t7DCXkgKHH+6c+HbvvfE3rh61QLfW/tNaW3M6Lh8COkBPRESaNW4cdOvmHNVaUuJsPrNrl9NiHzbMGWsvK3N2mvvJT5y95eMl2GNllvskYHlTHxpjfmaMWW2MWV2gdQsiInErJwfuugtOPtnZcKaszFnWds45Tut9xw748MO6/eHjqbUe1jF0Y8zrQK9GPrrNWvtizT23AVXAX5oqx1r7GPAYQHZ2tm3qPhERaf/qz4gHpxVeXOz8vHGjs5YdICPDmSUP8TFhLqyBbq09u7nPjTETgFxgtLVWQS0iIi02bpzTCgenKz4lxWm9n3CCcy0rC776Knr1i5SodbkbY84HpgE/staWRqseIiLStuXkwP/8j7Mu3X/2+kknOV3w4EyY8//cnkVzDP1hIB14zRizzhjz+yjWRURE2rCcHFiwAJ56Co45xlnKVl0Ne/Y4r3Hjol3D8IvaOnRrbf9oPVtERNonf2t96VKnm713b5g4sf2Pn4N2ihMRkXYmJyc+AvxgsbJsTURERFpBgS4iItIOKNBFRETaAY2hi4iIAF5v4ye8tRVqoYuISNzzeuHFF6G0FHr2dN5ffNG53lYo0EVEJO7l5zs7ymVkQEKC856V1bb2gFeXu4iIxL2CAqdl7rdpE6xcCTt3Ooe9tIXz1dVCFxGRuNe9u3McKzhhvmyZc+CLx9N2TmxToIuISNzLyXH2fN+3z2mZp6ZCUpIT6Icc4ryWLo12LZunQBcRkbjn8cBFF/3/9u48ZqrqjOP496fG5RUU96qoWMEqLkVwRXEp1IixaKq12pDW1mjEuLTWpY22dYldxNamrdZibG3VukYNdYlbsSACcQO3qoC7NrgVC6i1ytM/znnlOs7rexned4a5/D7JhLn3nrn3uecd5plz7p1zoKMjdbOvvXYaE36ttdL2fv3SXOvLM19DNzMzIyX1/v3TNfMFC5Ykc0it9759U1f88vqzNrfQzczMCg47bMksbZ0ztr38ckrwy/PP2pzQzczMCorzq7/0Uvp3xAjYcUf44AOYMQMeeABmz4Y77mh1tEu4y93MzKxG7YxtEybA+++nO93XXBPWWQcWLYJJk2D06OWj690tdDMzs25ssAE8/nhK5h0dIKUBaDbccPn5OZsTupmZWTd22QXmzYMIWLw4XUNftAh22CHdJLc8cEI3MzPrRv/+MHJkSubz58Nqq8Fuu6WkPndu6pK/+ebW3iTnhG5mZlbCAQfAoEEwfHhK5gsWwNSpsOmmy8ed707oZmZmJRQHn5k3Lw00s+eesOWWy8eELr7L3czMrKTOwWcgdbMXJ3QB6NMnJftWcAvdzMysAcUJXTotXJjWt4ITupmZWQOKE7osXpz+nT+/ddOsOqGbmZk1oPaaekdHWm7VIDO+hm5mZtag4jX1VnML3czMrAKc0M3MzCrACd3MzKwCnNDNzMwqwAndzMysApzQzczMKsAJ3czMrAKc0M3MzCrACd3MzKwCnNDNzMwqwAndzMysApzQzczMKsAJ3czMrAKc0M3MzCrACd3MzKwCFBGtjmGpSHoDeHEZdrE+8GYPhWOf5LrtPa7b3uX67T2u22W3RURs0F2htkvoy0rSQxGxc6vjqCLXbe9x3fYu12/vcd02j7vczczMKsAJ3czMrAJWxIQ+odUBVJjrtve4bnuX67f3uG6bZIW7hm5mZlZFK2IL3czMrHKc0M3MzCqgkgld0gGSnpE0R9IP6mxfTdJ1efsMSQOaH2X7KlG/p0h6StJjku6VtEUr4mxH3dVtodyhkkKSfw5UUpm6lXR4fu8+KemvzY6xnZX4XNhc0iRJj+bPhgNbEWelRUSlHsDKwFzg88CqwCxgcE2Z44FL8/MjgOtaHXe7PErW735AR34+zvXbc3Wby/UFJgPTgZ1bHXc7PEq+bwcBjwLr5OUNWx13uzxK1u8EYFx+Phh4odVxV+1RxRb6rsCciHguIj4ArgUOrilzMPDn/PxGYKQkNTHGdtZt/UbEpIh4Ny9OB/o3OcZ2Vea9C3Ae8Avg/WYG1+bK1O0xwMUR8W+AiHi9yTG2szL1G8Ba+fnawGtNjG+FUMWEvinwcmH5lbyubpmI+BB4B1ivKdG1vzL1W3Q0cEevRlQd3datpKHAZhFxWzMDq4Ay79utga0lTZU0XdIBTYuu/ZWp37OBsZJeAW4HTmxOaCuOVVodgFWXpLHAzsA+rY6lCiStBPwKOKrFoVTVKqRu931JvUqTJe0QEfNbGlV1HAlcERG/lLQHcKWk7SNicasDq4oqttBfBTYrLPfP6+qWkbQKqfvnraZE1/7K1C+SRgFnAmMi4r9Niq3ddVe3fYHtgfskvQDsDkz0jXGllHnfvgJMjIj/RcTzwLOkBG/dK1O/RwPXA0TENGB10sQt1kOqmNAfBAZJ2lLSqqSb3ibWlJkIfCs/Pwz4e+Q7Naxb3davpJ2AP5CSua9DlveZdRsR70TE+hExICIGkO5PGBMRD7Um3LZS5nPhFlLrHEnrk7rgn2tmkG2sTP2+BIwEkLQtKaG/0dQoK65yCT1fEz8BuBP4J3B9RDwp6VxJY3Kxy4H1JM0BTgG6/HmQfVLJ+h0P9AFukDRTUu1/bKujZN1aA0rW7Z3AW5KeAiYBp0WEe+5KKFm/3weOkTQLuAY4yg2pnuWhX83MzCqgci10MzOzFZETupmZWQU4oZuZmVWAE7qZmVkFOKGbmZlVgBO6VY6kj/LP5Z6QdIOkjmXY176Sbs3Px3QzA1o/Scc3cIyzJZ1aIo538kxVz0iaLOmgmn28ms+789Gv8LrOdffU7HempGtr1t1XHKxG0gBJTxTiuLWm/MS8nzk1x9qti3O5X9KMwvLunXFJGlWzj5mS9ssxPC+pXy63Xl4eUSj3dl43U9KdXRx7oNIsdWcX1m0k6UNJvy6sGyfp6fyYIWl4d/FLOrAQy8L8d5op6U/5vG6pieUqSYfUi9OsER761arovYgYAiDpauA40pCp5HUi/WRzqYacjIiJfHqwjKJ+pJn8LlnqiMuZEhEHAUgaAtwi6b2IuDdvvygiLiy+IJ3qktfVbNuWNEvWCElrRsSiRoKKiDF5f6OAEyKiTJLaWNKXI+LuOtsm1duHpMuAn5Lq+ALgkoiYAnT+ra8CboyIW2pfW2Mu8BXS2OIAhwNPFI5zCPBtYHhEvJ2/3NwkaVhEdA6E8qn4I+J20hjlSLqfVBcz8/KobmIyW2ZuoVvVTQEG5hbeM5L+Qvrw3kzS/pKmSXokt+T7wMfzOj8t6RHgq507knSUpN/l5xtJulnSrPwYDvwc2Cq3ysbncqdJelBp/udzCvs6U9Kz+YP/C0t7UjlRnEsazKNRRwJXAndRf1a33jQeOGspX3MhsLek7wK7ABc1eOyFwNz8pQhSQr+hsP0M4NSIeBsgj8R3NemLRKdG4jfrVU7oVllK4/SPBh7PqwaRWnXbAYtIH8ijImIo8BBwiqTVgctILbhhwOe62P1vgH9ExBeBocCTpBEH50bEkIg4TdL++Zi7klqRwyTtLWkYaWjMIcCBpOTUGfNxko4reYqPANsUlr9X6PKdVFhf7JY+s7D+66RpLq8hJfdmmgIgaa862/ar6XIfAJCn5TyDlMhPzqOTNepa4Ii87/eAeYVtg4GHa8o/BGxXMv6ufOK8SH97sx7jLnerojXyByakD97LgU2AFyNiel6/O+mDe2rull4VmEZKkM9HxGz4uBv32DrH+BLwTYCI+Ah4R9I6NWX2z49H83IfUoLvC9zcOWe8CkPjRsSlS3Geqln+VJd79qku99yN/GZEvCTpVeCPktbNrdJ6w0f2xpCS5wM/An5Ss75ul3s2GvgXaZKaSV2UKeN24MfAfFJyLzZuauu1K13F35VPnFd+b5n1GLfQrYrey63kIRFxYm7ZQWqVdxJwd6Hc4Ig4uofjEPCzwjEGRsTlPbj/nUjjZjfiSGAbpVnb5gJrAYfmbW8BxS8n6wJvNnicLkXEXaT7DkrNFpd7NvYB9gBOk7ThMhz7feAx4GTgpprNT5F6Z4qGkXphivtYqvjNepsTuq2opgN7ShoIIGlNSVsDTwMDJG2Vy3XVFX0vMC6/dmVJawMLSK3vTncC3ylcm980J6HJwCGS1pDUl9S9v1Qk7UhqHV7cwGtXIl033qEwc9vBLDnX+4Cx+eZBSDMTLktr+LOcD5zeXaEc8++BkyLiRVK3+/hlPPZ44PQ6851fAFzQ2eMiaSgwNh+/Vqn4zZrBXe62QoqINyQdBVwjabW8+qyIeFbSscBtkt4lddn3rbOLk4EJko4GPgLGRcQ0SVOVfuJ1R76Ovi0wLefGhcDYiHhE0nXALOB10tSTQLqGnuOr1/U+QtKjQEd+3UmFO9whXUMfW1juqtt6BPBqRLxWWDcZGCxpY2AC6dLDLElBun78w0LZkZJeKSx/Lc9v3Yi/AefVrNuvcMkE4BxgY2B2RHR+sfgt8LCkvSLi/kYOHBGPs+T+iuL6myRtAkzP5/8f4BtdTAVcL36zlvBsa2ZmZhXgLnczM7MKcJe7mfWKfPf+5jWrT42Ie+qV7+FjDwGuqFn9bkQMr1PcrBLc5W5mZlYB7nI3MzOrACd0MzOzCnBCNzMzqwAndDMzswpwQjczM6uA/wPzcr1F57s1pQAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7f03a88309e8>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "groups = test_yhat.groupby('DEFAULT_NEXT_MONTH') # define groups\n",
    "fig, ax_ = plt.subplots(figsize=(8, 8))          # initialize figure\n",
    "\n",
    "plt.xlabel('Predicted: DEFAULT_NEXT_MONTH')\n",
    "plt.ylabel('Residual: DEFAULT_NEXT_MONTH')\n",
    "\n",
    "# plot groups with appropriate color\n",
    "color_list = ['b', 'g'] \n",
    "c_idx = 0\n",
    "for name, group in groups:\n",
    "    ax_.plot(group.p_DEFAULT_NEXT_MONTH, group.r_DEFAULT_NEXT_MONTH, label=' '.join(['DEFAULT_NEXT_MONTH:', str(name)]),\n",
    "             marker='o', linestyle='', color=color_list[c_idx], alpha=0.3)\n",
    "    c_idx += 1\n",
    "\n",
    "_ = ax_.legend(loc=1) # legend"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Sort data by residuals and display data and residuals\n",
    "Printing a table with model inputs, actual target values, and model predictions sorted by residuals is another simple way to analyze residuals. Customers that defaulted, but were predicted not to, are listed at the top of the table below. Scroll to the bottom of the table to see the customers who were predicted to default, but then did not. Also notice the jumps in residual values between -1.96 and -1.99 and then again between -2.02 and -2.16. These are the potential outliers pictured in the residual plot above. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ID</th>\n",
       "      <th>LIMIT_BAL</th>\n",
       "      <th>SEX</th>\n",
       "      <th>EDUCATION</th>\n",
       "      <th>MARRIAGE</th>\n",
       "      <th>AGE</th>\n",
       "      <th>PAY_0</th>\n",
       "      <th>PAY_2</th>\n",
       "      <th>PAY_3</th>\n",
       "      <th>PAY_4</th>\n",
       "      <th>PAY_5</th>\n",
       "      <th>PAY_6</th>\n",
       "      <th>BILL_AMT1</th>\n",
       "      <th>BILL_AMT2</th>\n",
       "      <th>BILL_AMT3</th>\n",
       "      <th>BILL_AMT4</th>\n",
       "      <th>BILL_AMT5</th>\n",
       "      <th>BILL_AMT6</th>\n",
       "      <th>PAY_AMT1</th>\n",
       "      <th>PAY_AMT2</th>\n",
       "      <th>PAY_AMT3</th>\n",
       "      <th>PAY_AMT4</th>\n",
       "      <th>PAY_AMT5</th>\n",
       "      <th>PAY_AMT6</th>\n",
       "      <th>DEFAULT_NEXT_MONTH</th>\n",
       "      <th>p_DEFAULT_NEXT_MONTH</th>\n",
       "      <th>r_DEFAULT_NEXT_MONTH</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>18899</td>\n",
       "      <td>140000</td>\n",
       "      <td>female</td>\n",
       "      <td>other</td>\n",
       "      <td>single</td>\n",
       "      <td>28</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>108018</td>\n",
       "      <td>6500</td>\n",
       "      <td>6327</td>\n",
       "      <td>138485</td>\n",
       "      <td>140492</td>\n",
       "      <td>141006</td>\n",
       "      <td>1000</td>\n",
       "      <td>6327</td>\n",
       "      <td>135000</td>\n",
       "      <td>4700</td>\n",
       "      <td>5000</td>\n",
       "      <td>5000</td>\n",
       "      <td>1</td>\n",
       "      <td>0.028563</td>\n",
       "      <td>2.666700</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>25772</td>\n",
       "      <td>350000</td>\n",
       "      <td>female</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>married</td>\n",
       "      <td>33</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>82964</td>\n",
       "      <td>68532</td>\n",
       "      <td>17926</td>\n",
       "      <td>17966</td>\n",
       "      <td>30741</td>\n",
       "      <td>31088</td>\n",
       "      <td>68940</td>\n",
       "      <td>18018</td>\n",
       "      <td>18058</td>\n",
       "      <td>30897</td>\n",
       "      <td>31244</td>\n",
       "      <td>88461</td>\n",
       "      <td>1</td>\n",
       "      <td>0.030224</td>\n",
       "      <td>2.645421</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>6933</td>\n",
       "      <td>500000</td>\n",
       "      <td>male</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>single</td>\n",
       "      <td>37</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>4331</td>\n",
       "      <td>60446</td>\n",
       "      <td>30592</td>\n",
       "      <td>154167</td>\n",
       "      <td>13410</td>\n",
       "      <td>25426</td>\n",
       "      <td>60446</td>\n",
       "      <td>30594</td>\n",
       "      <td>150843</td>\n",
       "      <td>163881</td>\n",
       "      <td>25426</td>\n",
       "      <td>39526</td>\n",
       "      <td>1</td>\n",
       "      <td>0.030849</td>\n",
       "      <td>2.637673</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>13381</td>\n",
       "      <td>400000</td>\n",
       "      <td>female</td>\n",
       "      <td>university</td>\n",
       "      <td>single</td>\n",
       "      <td>35</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>109943</td>\n",
       "      <td>222085</td>\n",
       "      <td>223350</td>\n",
       "      <td>213831</td>\n",
       "      <td>210563</td>\n",
       "      <td>211925</td>\n",
       "      <td>120018</td>\n",
       "      <td>10071</td>\n",
       "      <td>8037</td>\n",
       "      <td>8018</td>\n",
       "      <td>8809</td>\n",
       "      <td>5022</td>\n",
       "      <td>1</td>\n",
       "      <td>0.031902</td>\n",
       "      <td>2.624911</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>2561</td>\n",
       "      <td>310000</td>\n",
       "      <td>female</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>single</td>\n",
       "      <td>32</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>20138</td>\n",
       "      <td>8267</td>\n",
       "      <td>65993</td>\n",
       "      <td>8543</td>\n",
       "      <td>1695</td>\n",
       "      <td>750</td>\n",
       "      <td>8267</td>\n",
       "      <td>66008</td>\n",
       "      <td>8543</td>\n",
       "      <td>1695</td>\n",
       "      <td>750</td>\n",
       "      <td>7350</td>\n",
       "      <td>1</td>\n",
       "      <td>0.032029</td>\n",
       "      <td>2.623404</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>22751</td>\n",
       "      <td>350000</td>\n",
       "      <td>female</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>married</td>\n",
       "      <td>32</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>30625</td>\n",
       "      <td>60003</td>\n",
       "      <td>7147</td>\n",
       "      <td>9950</td>\n",
       "      <td>22117</td>\n",
       "      <td>4874</td>\n",
       "      <td>60396</td>\n",
       "      <td>7147</td>\n",
       "      <td>9950</td>\n",
       "      <td>22117</td>\n",
       "      <td>4874</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0.033741</td>\n",
       "      <td>2.603470</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>25692</td>\n",
       "      <td>330000</td>\n",
       "      <td>female</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>single</td>\n",
       "      <td>42</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>565</td>\n",
       "      <td>20650</td>\n",
       "      <td>15360</td>\n",
       "      <td>0</td>\n",
       "      <td>12923</td>\n",
       "      <td>1816</td>\n",
       "      <td>20650</td>\n",
       "      <td>15360</td>\n",
       "      <td>0</td>\n",
       "      <td>12923</td>\n",
       "      <td>1816</td>\n",
       "      <td>17050</td>\n",
       "      <td>1</td>\n",
       "      <td>0.034929</td>\n",
       "      <td>2.590155</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>8339</td>\n",
       "      <td>480000</td>\n",
       "      <td>male</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>married</td>\n",
       "      <td>58</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>24610</td>\n",
       "      <td>-310</td>\n",
       "      <td>148544</td>\n",
       "      <td>18791</td>\n",
       "      <td>5909</td>\n",
       "      <td>68988</td>\n",
       "      <td>4</td>\n",
       "      <td>149654</td>\n",
       "      <td>18885</td>\n",
       "      <td>5940</td>\n",
       "      <td>69337</td>\n",
       "      <td>200655</td>\n",
       "      <td>1</td>\n",
       "      <td>0.036294</td>\n",
       "      <td>2.575309</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>22712</td>\n",
       "      <td>320000</td>\n",
       "      <td>female</td>\n",
       "      <td>high school</td>\n",
       "      <td>married</td>\n",
       "      <td>35</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>157249</td>\n",
       "      <td>148123</td>\n",
       "      <td>142852</td>\n",
       "      <td>133583</td>\n",
       "      <td>129049</td>\n",
       "      <td>128325</td>\n",
       "      <td>6000</td>\n",
       "      <td>6048</td>\n",
       "      <td>6000</td>\n",
       "      <td>5000</td>\n",
       "      <td>5000</td>\n",
       "      <td>5000</td>\n",
       "      <td>1</td>\n",
       "      <td>0.037974</td>\n",
       "      <td>2.557673</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>28964</td>\n",
       "      <td>420000</td>\n",
       "      <td>female</td>\n",
       "      <td>university</td>\n",
       "      <td>married</td>\n",
       "      <td>34</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>158471</td>\n",
       "      <td>44131</td>\n",
       "      <td>32423</td>\n",
       "      <td>18824</td>\n",
       "      <td>0</td>\n",
       "      <td>21082</td>\n",
       "      <td>1644</td>\n",
       "      <td>1436</td>\n",
       "      <td>1000</td>\n",
       "      <td>0</td>\n",
       "      <td>21082</td>\n",
       "      <td>228548</td>\n",
       "      <td>1</td>\n",
       "      <td>0.038392</td>\n",
       "      <td>2.553394</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>22505</td>\n",
       "      <td>260000</td>\n",
       "      <td>female</td>\n",
       "      <td>university</td>\n",
       "      <td>single</td>\n",
       "      <td>33</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>5188</td>\n",
       "      <td>12357</td>\n",
       "      <td>28656</td>\n",
       "      <td>7497</td>\n",
       "      <td>7685</td>\n",
       "      <td>15434</td>\n",
       "      <td>13000</td>\n",
       "      <td>29022</td>\n",
       "      <td>7500</td>\n",
       "      <td>27769</td>\n",
       "      <td>12000</td>\n",
       "      <td>6200</td>\n",
       "      <td>1</td>\n",
       "      <td>0.038427</td>\n",
       "      <td>2.553038</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>7228</td>\n",
       "      <td>410000</td>\n",
       "      <td>male</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>married</td>\n",
       "      <td>34</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>109256</td>\n",
       "      <td>15134</td>\n",
       "      <td>5063</td>\n",
       "      <td>1019</td>\n",
       "      <td>14585</td>\n",
       "      <td>5370</td>\n",
       "      <td>15000</td>\n",
       "      <td>4867</td>\n",
       "      <td>803</td>\n",
       "      <td>14436</td>\n",
       "      <td>5396</td>\n",
       "      <td>875</td>\n",
       "      <td>1</td>\n",
       "      <td>0.040427</td>\n",
       "      <td>2.533087</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>6854</td>\n",
       "      <td>290000</td>\n",
       "      <td>male</td>\n",
       "      <td>high school</td>\n",
       "      <td>single</td>\n",
       "      <td>34</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>5451</td>\n",
       "      <td>6230</td>\n",
       "      <td>140802</td>\n",
       "      <td>143354</td>\n",
       "      <td>146225</td>\n",
       "      <td>148820</td>\n",
       "      <td>1200</td>\n",
       "      <td>135000</td>\n",
       "      <td>5200</td>\n",
       "      <td>5500</td>\n",
       "      <td>5500</td>\n",
       "      <td>5400</td>\n",
       "      <td>1</td>\n",
       "      <td>0.040579</td>\n",
       "      <td>2.531600</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>3016</td>\n",
       "      <td>350000</td>\n",
       "      <td>male</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>married</td>\n",
       "      <td>38</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>16459</td>\n",
       "      <td>4120</td>\n",
       "      <td>44164</td>\n",
       "      <td>35233</td>\n",
       "      <td>884</td>\n",
       "      <td>9924</td>\n",
       "      <td>941</td>\n",
       "      <td>44743</td>\n",
       "      <td>0</td>\n",
       "      <td>884</td>\n",
       "      <td>9924</td>\n",
       "      <td>10824</td>\n",
       "      <td>1</td>\n",
       "      <td>0.041813</td>\n",
       "      <td>2.519744</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>19530</td>\n",
       "      <td>350000</td>\n",
       "      <td>female</td>\n",
       "      <td>university</td>\n",
       "      <td>married</td>\n",
       "      <td>36</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>21026</td>\n",
       "      <td>35588</td>\n",
       "      <td>38002</td>\n",
       "      <td>40357</td>\n",
       "      <td>43663</td>\n",
       "      <td>52735</td>\n",
       "      <td>15000</td>\n",
       "      <td>3000</td>\n",
       "      <td>3000</td>\n",
       "      <td>4000</td>\n",
       "      <td>10000</td>\n",
       "      <td>25000</td>\n",
       "      <td>1</td>\n",
       "      <td>0.042401</td>\n",
       "      <td>2.514193</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>1980</td>\n",
       "      <td>500000</td>\n",
       "      <td>female</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>married</td>\n",
       "      <td>35</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>35176</td>\n",
       "      <td>36193</td>\n",
       "      <td>44157</td>\n",
       "      <td>48322</td>\n",
       "      <td>21593</td>\n",
       "      <td>13866</td>\n",
       "      <td>2504</td>\n",
       "      <td>10004</td>\n",
       "      <td>5178</td>\n",
       "      <td>1047</td>\n",
       "      <td>2019</td>\n",
       "      <td>1004</td>\n",
       "      <td>1</td>\n",
       "      <td>0.042956</td>\n",
       "      <td>2.509018</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>11462</td>\n",
       "      <td>210000</td>\n",
       "      <td>female</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>single</td>\n",
       "      <td>46</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>15655</td>\n",
       "      <td>3918</td>\n",
       "      <td>29881</td>\n",
       "      <td>24247</td>\n",
       "      <td>21664</td>\n",
       "      <td>1556</td>\n",
       "      <td>4854</td>\n",
       "      <td>30366</td>\n",
       "      <td>0</td>\n",
       "      <td>433</td>\n",
       "      <td>1556</td>\n",
       "      <td>14047</td>\n",
       "      <td>1</td>\n",
       "      <td>0.043176</td>\n",
       "      <td>2.506974</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>971</td>\n",
       "      <td>300000</td>\n",
       "      <td>male</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>married</td>\n",
       "      <td>42</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>11973</td>\n",
       "      <td>61834</td>\n",
       "      <td>25145</td>\n",
       "      <td>37666</td>\n",
       "      <td>19453</td>\n",
       "      <td>10492</td>\n",
       "      <td>20979</td>\n",
       "      <td>5000</td>\n",
       "      <td>37676</td>\n",
       "      <td>8808</td>\n",
       "      <td>2000</td>\n",
       "      <td>2709</td>\n",
       "      <td>1</td>\n",
       "      <td>0.043455</td>\n",
       "      <td>2.504409</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>11090</td>\n",
       "      <td>240000</td>\n",
       "      <td>male</td>\n",
       "      <td>university</td>\n",
       "      <td>married</td>\n",
       "      <td>41</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>22165</td>\n",
       "      <td>21292</td>\n",
       "      <td>16469</td>\n",
       "      <td>13737</td>\n",
       "      <td>9071</td>\n",
       "      <td>177268</td>\n",
       "      <td>7002</td>\n",
       "      <td>3002</td>\n",
       "      <td>5002</td>\n",
       "      <td>3009</td>\n",
       "      <td>177004</td>\n",
       "      <td>5452</td>\n",
       "      <td>1</td>\n",
       "      <td>0.045870</td>\n",
       "      <td>2.482715</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>26005</td>\n",
       "      <td>320000</td>\n",
       "      <td>female</td>\n",
       "      <td>university</td>\n",
       "      <td>married</td>\n",
       "      <td>35</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>2276</td>\n",
       "      <td>6626</td>\n",
       "      <td>11131</td>\n",
       "      <td>13824</td>\n",
       "      <td>17992</td>\n",
       "      <td>15250</td>\n",
       "      <td>6626</td>\n",
       "      <td>12446</td>\n",
       "      <td>17746</td>\n",
       "      <td>6000</td>\n",
       "      <td>5749</td>\n",
       "      <td>928</td>\n",
       "      <td>1</td>\n",
       "      <td>0.045997</td>\n",
       "      <td>2.481601</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>1199</td>\n",
       "      <td>340000</td>\n",
       "      <td>female</td>\n",
       "      <td>high school</td>\n",
       "      <td>single</td>\n",
       "      <td>44</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>142836</td>\n",
       "      <td>145125</td>\n",
       "      <td>146682</td>\n",
       "      <td>150407</td>\n",
       "      <td>147868</td>\n",
       "      <td>149349</td>\n",
       "      <td>7000</td>\n",
       "      <td>5500</td>\n",
       "      <td>6027</td>\n",
       "      <td>5328</td>\n",
       "      <td>5390</td>\n",
       "      <td>6047</td>\n",
       "      <td>1</td>\n",
       "      <td>0.046074</td>\n",
       "      <td>2.480930</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>61</td>\n",
       "      <td>500000</td>\n",
       "      <td>female</td>\n",
       "      <td>high school</td>\n",
       "      <td>married</td>\n",
       "      <td>28</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>22848</td>\n",
       "      <td>23638</td>\n",
       "      <td>18878</td>\n",
       "      <td>14937</td>\n",
       "      <td>13827</td>\n",
       "      <td>15571</td>\n",
       "      <td>1516</td>\n",
       "      <td>1300</td>\n",
       "      <td>1000</td>\n",
       "      <td>1000</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000</td>\n",
       "      <td>1</td>\n",
       "      <td>0.046277</td>\n",
       "      <td>2.479158</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>15055</td>\n",
       "      <td>470000</td>\n",
       "      <td>male</td>\n",
       "      <td>university</td>\n",
       "      <td>married</td>\n",
       "      <td>35</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>170812</td>\n",
       "      <td>172332</td>\n",
       "      <td>177566</td>\n",
       "      <td>182074</td>\n",
       "      <td>183417</td>\n",
       "      <td>185608</td>\n",
       "      <td>6500</td>\n",
       "      <td>8000</td>\n",
       "      <td>9000</td>\n",
       "      <td>7000</td>\n",
       "      <td>8000</td>\n",
       "      <td>8000</td>\n",
       "      <td>1</td>\n",
       "      <td>0.046652</td>\n",
       "      <td>2.475903</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>8959</td>\n",
       "      <td>340000</td>\n",
       "      <td>male</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>single</td>\n",
       "      <td>44</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>83059</td>\n",
       "      <td>85634</td>\n",
       "      <td>73950</td>\n",
       "      <td>59324</td>\n",
       "      <td>156094</td>\n",
       "      <td>110234</td>\n",
       "      <td>20000</td>\n",
       "      <td>5000</td>\n",
       "      <td>2000</td>\n",
       "      <td>112000</td>\n",
       "      <td>4234</td>\n",
       "      <td>4000</td>\n",
       "      <td>1</td>\n",
       "      <td>0.046721</td>\n",
       "      <td>2.475300</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>15549</td>\n",
       "      <td>450000</td>\n",
       "      <td>male</td>\n",
       "      <td>university</td>\n",
       "      <td>single</td>\n",
       "      <td>36</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>8012</td>\n",
       "      <td>4009</td>\n",
       "      <td>5226</td>\n",
       "      <td>4715</td>\n",
       "      <td>3275</td>\n",
       "      <td>6422</td>\n",
       "      <td>4021</td>\n",
       "      <td>5241</td>\n",
       "      <td>4729</td>\n",
       "      <td>3284</td>\n",
       "      <td>6441</td>\n",
       "      <td>4285</td>\n",
       "      <td>1</td>\n",
       "      <td>0.047879</td>\n",
       "      <td>2.465396</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>16129</td>\n",
       "      <td>200000</td>\n",
       "      <td>female</td>\n",
       "      <td>university</td>\n",
       "      <td>single</td>\n",
       "      <td>32</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>24429</td>\n",
       "      <td>13060</td>\n",
       "      <td>13683</td>\n",
       "      <td>-3942</td>\n",
       "      <td>123250</td>\n",
       "      <td>125926</td>\n",
       "      <td>1500</td>\n",
       "      <td>1000</td>\n",
       "      <td>0</td>\n",
       "      <td>128000</td>\n",
       "      <td>4600</td>\n",
       "      <td>5000</td>\n",
       "      <td>1</td>\n",
       "      <td>0.049313</td>\n",
       "      <td>2.453393</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>4321</td>\n",
       "      <td>420000</td>\n",
       "      <td>female</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>single</td>\n",
       "      <td>34</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>13207</td>\n",
       "      <td>6184</td>\n",
       "      <td>6692</td>\n",
       "      <td>1039</td>\n",
       "      <td>1039</td>\n",
       "      <td>1503</td>\n",
       "      <td>6222</td>\n",
       "      <td>9723</td>\n",
       "      <td>1045</td>\n",
       "      <td>1042</td>\n",
       "      <td>1509</td>\n",
       "      <td>9215</td>\n",
       "      <td>1</td>\n",
       "      <td>0.049665</td>\n",
       "      <td>2.450493</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>5828</td>\n",
       "      <td>280000</td>\n",
       "      <td>female</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>single</td>\n",
       "      <td>38</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>17878</td>\n",
       "      <td>14011</td>\n",
       "      <td>30079</td>\n",
       "      <td>13139</td>\n",
       "      <td>13989</td>\n",
       "      <td>15559</td>\n",
       "      <td>2000</td>\n",
       "      <td>30000</td>\n",
       "      <td>14000</td>\n",
       "      <td>1000</td>\n",
       "      <td>16000</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>0.051280</td>\n",
       "      <td>2.437401</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>10754</td>\n",
       "      <td>160000</td>\n",
       "      <td>female</td>\n",
       "      <td>university</td>\n",
       "      <td>married</td>\n",
       "      <td>31</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>42781</td>\n",
       "      <td>42774</td>\n",
       "      <td>41817</td>\n",
       "      <td>749</td>\n",
       "      <td>5572</td>\n",
       "      <td>10573</td>\n",
       "      <td>2300</td>\n",
       "      <td>2300</td>\n",
       "      <td>749</td>\n",
       "      <td>5572</td>\n",
       "      <td>5573</td>\n",
       "      <td>13793</td>\n",
       "      <td>1</td>\n",
       "      <td>0.052010</td>\n",
       "      <td>2.431592</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>6853</td>\n",
       "      <td>310000</td>\n",
       "      <td>male</td>\n",
       "      <td>university</td>\n",
       "      <td>single</td>\n",
       "      <td>42</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>169749</td>\n",
       "      <td>172685</td>\n",
       "      <td>176630</td>\n",
       "      <td>180315</td>\n",
       "      <td>184072</td>\n",
       "      <td>188194</td>\n",
       "      <td>7000</td>\n",
       "      <td>6630</td>\n",
       "      <td>6379</td>\n",
       "      <td>6586</td>\n",
       "      <td>7086</td>\n",
       "      <td>7522</td>\n",
       "      <td>1</td>\n",
       "      <td>0.052043</td>\n",
       "      <td>2.431334</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8910</th>\n",
       "      <td>12846</td>\n",
       "      <td>90000</td>\n",
       "      <td>male</td>\n",
       "      <td>university</td>\n",
       "      <td>married</td>\n",
       "      <td>42</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>95773</td>\n",
       "      <td>95489</td>\n",
       "      <td>94681</td>\n",
       "      <td>93965</td>\n",
       "      <td>90545</td>\n",
       "      <td>90529</td>\n",
       "      <td>4000</td>\n",
       "      <td>3500</td>\n",
       "      <td>3500</td>\n",
       "      <td>0</td>\n",
       "      <td>3500</td>\n",
       "      <td>4200</td>\n",
       "      <td>0</td>\n",
       "      <td>0.810857</td>\n",
       "      <td>-1.824966</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8911</th>\n",
       "      <td>10785</td>\n",
       "      <td>80000</td>\n",
       "      <td>female</td>\n",
       "      <td>university</td>\n",
       "      <td>married</td>\n",
       "      <td>33</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>53843</td>\n",
       "      <td>55933</td>\n",
       "      <td>56575</td>\n",
       "      <td>57303</td>\n",
       "      <td>58593</td>\n",
       "      <td>59738</td>\n",
       "      <td>3500</td>\n",
       "      <td>2100</td>\n",
       "      <td>2200</td>\n",
       "      <td>2300</td>\n",
       "      <td>2200</td>\n",
       "      <td>2100</td>\n",
       "      <td>0</td>\n",
       "      <td>0.812690</td>\n",
       "      <td>-1.830294</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8912</th>\n",
       "      <td>9756</td>\n",
       "      <td>140000</td>\n",
       "      <td>male</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>married</td>\n",
       "      <td>31</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>51028</td>\n",
       "      <td>52112</td>\n",
       "      <td>55232</td>\n",
       "      <td>55932</td>\n",
       "      <td>54910</td>\n",
       "      <td>57344</td>\n",
       "      <td>2500</td>\n",
       "      <td>4600</td>\n",
       "      <td>2200</td>\n",
       "      <td>0</td>\n",
       "      <td>3513</td>\n",
       "      <td>3000</td>\n",
       "      <td>0</td>\n",
       "      <td>0.818370</td>\n",
       "      <td>-1.847041</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8913</th>\n",
       "      <td>10537</td>\n",
       "      <td>30000</td>\n",
       "      <td>female</td>\n",
       "      <td>university</td>\n",
       "      <td>single</td>\n",
       "      <td>25</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>300</td>\n",
       "      <td>300</td>\n",
       "      <td>300</td>\n",
       "      <td>1126</td>\n",
       "      <td>826</td>\n",
       "      <td>676</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>828</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>31496</td>\n",
       "      <td>0</td>\n",
       "      <td>0.822368</td>\n",
       "      <td>-1.859055</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8914</th>\n",
       "      <td>27255</td>\n",
       "      <td>80000</td>\n",
       "      <td>male</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>married</td>\n",
       "      <td>46</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>40509</td>\n",
       "      <td>40551</td>\n",
       "      <td>42592</td>\n",
       "      <td>43296</td>\n",
       "      <td>43892</td>\n",
       "      <td>43060</td>\n",
       "      <td>1000</td>\n",
       "      <td>3000</td>\n",
       "      <td>1700</td>\n",
       "      <td>1600</td>\n",
       "      <td>0</td>\n",
       "      <td>3500</td>\n",
       "      <td>0</td>\n",
       "      <td>0.822429</td>\n",
       "      <td>-1.859238</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8915</th>\n",
       "      <td>16920</td>\n",
       "      <td>50000</td>\n",
       "      <td>male</td>\n",
       "      <td>high school</td>\n",
       "      <td>married</td>\n",
       "      <td>52</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>4 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>36428</td>\n",
       "      <td>37530</td>\n",
       "      <td>38630</td>\n",
       "      <td>41774</td>\n",
       "      <td>40806</td>\n",
       "      <td>41357</td>\n",
       "      <td>2000</td>\n",
       "      <td>2000</td>\n",
       "      <td>4086</td>\n",
       "      <td>0</td>\n",
       "      <td>1500</td>\n",
       "      <td>1000</td>\n",
       "      <td>0</td>\n",
       "      <td>0.823017</td>\n",
       "      <td>-1.861021</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8916</th>\n",
       "      <td>28144</td>\n",
       "      <td>220000</td>\n",
       "      <td>female</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>married</td>\n",
       "      <td>46</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>249449</td>\n",
       "      <td>243517</td>\n",
       "      <td>228368</td>\n",
       "      <td>224414</td>\n",
       "      <td>196229</td>\n",
       "      <td>190050</td>\n",
       "      <td>9501</td>\n",
       "      <td>0</td>\n",
       "      <td>10000</td>\n",
       "      <td>7200</td>\n",
       "      <td>7001</td>\n",
       "      <td>6900</td>\n",
       "      <td>0</td>\n",
       "      <td>0.823451</td>\n",
       "      <td>-1.862342</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8917</th>\n",
       "      <td>20997</td>\n",
       "      <td>230000</td>\n",
       "      <td>male</td>\n",
       "      <td>university</td>\n",
       "      <td>single</td>\n",
       "      <td>38</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>177917</td>\n",
       "      <td>181465</td>\n",
       "      <td>185074</td>\n",
       "      <td>187053</td>\n",
       "      <td>176805</td>\n",
       "      <td>180826</td>\n",
       "      <td>8000</td>\n",
       "      <td>8000</td>\n",
       "      <td>6500</td>\n",
       "      <td>0</td>\n",
       "      <td>7000</td>\n",
       "      <td>6500</td>\n",
       "      <td>0</td>\n",
       "      <td>0.823666</td>\n",
       "      <td>-1.862996</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8918</th>\n",
       "      <td>17703</td>\n",
       "      <td>60000</td>\n",
       "      <td>female</td>\n",
       "      <td>university</td>\n",
       "      <td>married</td>\n",
       "      <td>35</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>3167</td>\n",
       "      <td>5601</td>\n",
       "      <td>5366</td>\n",
       "      <td>6772</td>\n",
       "      <td>6515</td>\n",
       "      <td>7906</td>\n",
       "      <td>2500</td>\n",
       "      <td>0</td>\n",
       "      <td>1500</td>\n",
       "      <td>0</td>\n",
       "      <td>1500</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.824598</td>\n",
       "      <td>-1.865838</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8919</th>\n",
       "      <td>3087</td>\n",
       "      <td>30000</td>\n",
       "      <td>female</td>\n",
       "      <td>university</td>\n",
       "      <td>single</td>\n",
       "      <td>24</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>7 month delay</td>\n",
       "      <td>7 month delay</td>\n",
       "      <td>7 month delay</td>\n",
       "      <td>7 month delay</td>\n",
       "      <td>300</td>\n",
       "      <td>300</td>\n",
       "      <td>300</td>\n",
       "      <td>300</td>\n",
       "      <td>300</td>\n",
       "      <td>300</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.827808</td>\n",
       "      <td>-1.875710</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8920</th>\n",
       "      <td>4445</td>\n",
       "      <td>100000</td>\n",
       "      <td>male</td>\n",
       "      <td>university</td>\n",
       "      <td>single</td>\n",
       "      <td>36</td>\n",
       "      <td>8 month delay</td>\n",
       "      <td>7 month delay</td>\n",
       "      <td>6 month delay</td>\n",
       "      <td>5 month delay</td>\n",
       "      <td>4 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>110072</td>\n",
       "      <td>108478</td>\n",
       "      <td>105931</td>\n",
       "      <td>104554</td>\n",
       "      <td>102360</td>\n",
       "      <td>100413</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1170</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.828279</td>\n",
       "      <td>-1.877169</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8921</th>\n",
       "      <td>26512</td>\n",
       "      <td>100000</td>\n",
       "      <td>female</td>\n",
       "      <td>high school</td>\n",
       "      <td>married</td>\n",
       "      <td>55</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>1520</td>\n",
       "      <td>1349</td>\n",
       "      <td>959</td>\n",
       "      <td>1623</td>\n",
       "      <td>1470</td>\n",
       "      <td>930</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1623</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>780</td>\n",
       "      <td>0</td>\n",
       "      <td>0.828957</td>\n",
       "      <td>-1.879275</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8922</th>\n",
       "      <td>12281</td>\n",
       "      <td>100000</td>\n",
       "      <td>male</td>\n",
       "      <td>university</td>\n",
       "      <td>married</td>\n",
       "      <td>36</td>\n",
       "      <td>1 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>4 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>9670</td>\n",
       "      <td>9371</td>\n",
       "      <td>11705</td>\n",
       "      <td>12919</td>\n",
       "      <td>12139</td>\n",
       "      <td>11653</td>\n",
       "      <td>0</td>\n",
       "      <td>2500</td>\n",
       "      <td>1700</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.829755</td>\n",
       "      <td>-1.881762</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8923</th>\n",
       "      <td>13811</td>\n",
       "      <td>40000</td>\n",
       "      <td>male</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>married</td>\n",
       "      <td>47</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>11084</td>\n",
       "      <td>12605</td>\n",
       "      <td>13102</td>\n",
       "      <td>12595</td>\n",
       "      <td>14386</td>\n",
       "      <td>14005</td>\n",
       "      <td>2000</td>\n",
       "      <td>1000</td>\n",
       "      <td>0</td>\n",
       "      <td>2000</td>\n",
       "      <td>0</td>\n",
       "      <td>2000</td>\n",
       "      <td>0</td>\n",
       "      <td>0.830768</td>\n",
       "      <td>-1.884933</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8924</th>\n",
       "      <td>15186</td>\n",
       "      <td>30000</td>\n",
       "      <td>female</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>single</td>\n",
       "      <td>25</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>7593</td>\n",
       "      <td>9634</td>\n",
       "      <td>4476</td>\n",
       "      <td>8830</td>\n",
       "      <td>8153</td>\n",
       "      <td>6422</td>\n",
       "      <td>2379</td>\n",
       "      <td>7</td>\n",
       "      <td>7002</td>\n",
       "      <td>13</td>\n",
       "      <td>155</td>\n",
       "      <td>1</td>\n",
       "      <td>0</td>\n",
       "      <td>0.833031</td>\n",
       "      <td>-1.892062</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8925</th>\n",
       "      <td>17748</td>\n",
       "      <td>30000</td>\n",
       "      <td>female</td>\n",
       "      <td>high school</td>\n",
       "      <td>married</td>\n",
       "      <td>54</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>4 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>22147</td>\n",
       "      <td>24770</td>\n",
       "      <td>26068</td>\n",
       "      <td>28842</td>\n",
       "      <td>28094</td>\n",
       "      <td>27361</td>\n",
       "      <td>3000</td>\n",
       "      <td>2000</td>\n",
       "      <td>3500</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1000</td>\n",
       "      <td>0</td>\n",
       "      <td>0.836493</td>\n",
       "      <td>-1.903103</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8926</th>\n",
       "      <td>4249</td>\n",
       "      <td>90000</td>\n",
       "      <td>male</td>\n",
       "      <td>high school</td>\n",
       "      <td>married</td>\n",
       "      <td>42</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>48674</td>\n",
       "      <td>49895</td>\n",
       "      <td>52570</td>\n",
       "      <td>53614</td>\n",
       "      <td>54534</td>\n",
       "      <td>53374</td>\n",
       "      <td>2300</td>\n",
       "      <td>4116</td>\n",
       "      <td>2500</td>\n",
       "      <td>2052</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.851551</td>\n",
       "      <td>-1.953210</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8927</th>\n",
       "      <td>16957</td>\n",
       "      <td>270000</td>\n",
       "      <td>male</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>married</td>\n",
       "      <td>50</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>4 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>213616</td>\n",
       "      <td>208784</td>\n",
       "      <td>212058</td>\n",
       "      <td>207226</td>\n",
       "      <td>202394</td>\n",
       "      <td>231339</td>\n",
       "      <td>0</td>\n",
       "      <td>8000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>32236</td>\n",
       "      <td>3000</td>\n",
       "      <td>0</td>\n",
       "      <td>0.852610</td>\n",
       "      <td>-1.956872</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8928</th>\n",
       "      <td>18659</td>\n",
       "      <td>40000</td>\n",
       "      <td>female</td>\n",
       "      <td>university</td>\n",
       "      <td>married</td>\n",
       "      <td>28</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>31131</td>\n",
       "      <td>33815</td>\n",
       "      <td>33002</td>\n",
       "      <td>32173</td>\n",
       "      <td>34629</td>\n",
       "      <td>33940</td>\n",
       "      <td>3500</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>3000</td>\n",
       "      <td>0</td>\n",
       "      <td>2000</td>\n",
       "      <td>0</td>\n",
       "      <td>0.853746</td>\n",
       "      <td>-1.960822</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8929</th>\n",
       "      <td>19215</td>\n",
       "      <td>150000</td>\n",
       "      <td>female</td>\n",
       "      <td>university</td>\n",
       "      <td>single</td>\n",
       "      <td>34</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>4 month delay</td>\n",
       "      <td>4 month delay</td>\n",
       "      <td>5 month delay</td>\n",
       "      <td>5 month delay</td>\n",
       "      <td>103389</td>\n",
       "      <td>108189</td>\n",
       "      <td>112968</td>\n",
       "      <td>117613</td>\n",
       "      <td>122161</td>\n",
       "      <td>129616</td>\n",
       "      <td>8000</td>\n",
       "      <td>8000</td>\n",
       "      <td>8000</td>\n",
       "      <td>8000</td>\n",
       "      <td>10000</td>\n",
       "      <td>5000</td>\n",
       "      <td>0</td>\n",
       "      <td>0.854225</td>\n",
       "      <td>-1.962494</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8930</th>\n",
       "      <td>7068</td>\n",
       "      <td>90000</td>\n",
       "      <td>female</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>single</td>\n",
       "      <td>30</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>750</td>\n",
       "      <td>750</td>\n",
       "      <td>750</td>\n",
       "      <td>750</td>\n",
       "      <td>2450</td>\n",
       "      <td>2150</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>2000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.864007</td>\n",
       "      <td>-1.997573</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8931</th>\n",
       "      <td>26565</td>\n",
       "      <td>200000</td>\n",
       "      <td>female</td>\n",
       "      <td>high school</td>\n",
       "      <td>married</td>\n",
       "      <td>55</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>159017</td>\n",
       "      <td>162697</td>\n",
       "      <td>163143</td>\n",
       "      <td>161906</td>\n",
       "      <td>165807</td>\n",
       "      <td>169599</td>\n",
       "      <td>9159</td>\n",
       "      <td>4842</td>\n",
       "      <td>3000</td>\n",
       "      <td>8000</td>\n",
       "      <td>7000</td>\n",
       "      <td>3000</td>\n",
       "      <td>0</td>\n",
       "      <td>0.864925</td>\n",
       "      <td>-2.000964</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8932</th>\n",
       "      <td>565</td>\n",
       "      <td>390000</td>\n",
       "      <td>female</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>single</td>\n",
       "      <td>45</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>834</td>\n",
       "      <td>155</td>\n",
       "      <td>-1690</td>\n",
       "      <td>4240</td>\n",
       "      <td>3346</td>\n",
       "      <td>2698</td>\n",
       "      <td>1</td>\n",
       "      <td>1693</td>\n",
       "      <td>6940</td>\n",
       "      <td>7</td>\n",
       "      <td>1230</td>\n",
       "      <td>3</td>\n",
       "      <td>0</td>\n",
       "      <td>0.870124</td>\n",
       "      <td>-2.020481</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8933</th>\n",
       "      <td>21098</td>\n",
       "      <td>200000</td>\n",
       "      <td>male</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>married</td>\n",
       "      <td>42</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>168289</td>\n",
       "      <td>172001</td>\n",
       "      <td>175281</td>\n",
       "      <td>177895</td>\n",
       "      <td>180078</td>\n",
       "      <td>184048</td>\n",
       "      <td>8000</td>\n",
       "      <td>7500</td>\n",
       "      <td>7000</td>\n",
       "      <td>6600</td>\n",
       "      <td>7000</td>\n",
       "      <td>7100</td>\n",
       "      <td>0</td>\n",
       "      <td>0.870909</td>\n",
       "      <td>-2.023481</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8934</th>\n",
       "      <td>9672</td>\n",
       "      <td>170000</td>\n",
       "      <td>male</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>single</td>\n",
       "      <td>48</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>7 month delay</td>\n",
       "      <td>7 month delay</td>\n",
       "      <td>7 month delay</td>\n",
       "      <td>7 month delay</td>\n",
       "      <td>2400</td>\n",
       "      <td>2400</td>\n",
       "      <td>2400</td>\n",
       "      <td>2400</td>\n",
       "      <td>2400</td>\n",
       "      <td>2400</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.903844</td>\n",
       "      <td>-2.164156</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8935</th>\n",
       "      <td>14589</td>\n",
       "      <td>280000</td>\n",
       "      <td>male</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>married</td>\n",
       "      <td>50</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>5 month delay</td>\n",
       "      <td>4 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>327918</td>\n",
       "      <td>321476</td>\n",
       "      <td>314931</td>\n",
       "      <td>176439</td>\n",
       "      <td>154010</td>\n",
       "      <td>134334</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>500</td>\n",
       "      <td>0</td>\n",
       "      <td>6267</td>\n",
       "      <td>2257</td>\n",
       "      <td>0</td>\n",
       "      <td>0.909352</td>\n",
       "      <td>-2.191241</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8936</th>\n",
       "      <td>19316</td>\n",
       "      <td>110000</td>\n",
       "      <td>female</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>married</td>\n",
       "      <td>41</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>7 month delay</td>\n",
       "      <td>7 month delay</td>\n",
       "      <td>7 month delay</td>\n",
       "      <td>150</td>\n",
       "      <td>150</td>\n",
       "      <td>150</td>\n",
       "      <td>150</td>\n",
       "      <td>150</td>\n",
       "      <td>150</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.910655</td>\n",
       "      <td>-2.197840</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8937</th>\n",
       "      <td>22725</td>\n",
       "      <td>100000</td>\n",
       "      <td>female</td>\n",
       "      <td>university</td>\n",
       "      <td>married</td>\n",
       "      <td>38</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>750</td>\n",
       "      <td>750</td>\n",
       "      <td>750</td>\n",
       "      <td>750</td>\n",
       "      <td>750</td>\n",
       "      <td>750</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1500</td>\n",
       "      <td>0</td>\n",
       "      <td>0.920587</td>\n",
       "      <td>-2.250821</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8938</th>\n",
       "      <td>29505</td>\n",
       "      <td>20000</td>\n",
       "      <td>male</td>\n",
       "      <td>university</td>\n",
       "      <td>married</td>\n",
       "      <td>40</td>\n",
       "      <td>1 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>3 month delay</td>\n",
       "      <td>14829</td>\n",
       "      <td>17267</td>\n",
       "      <td>16706</td>\n",
       "      <td>18694</td>\n",
       "      <td>19049</td>\n",
       "      <td>18459</td>\n",
       "      <td>3000</td>\n",
       "      <td>0</td>\n",
       "      <td>2560</td>\n",
       "      <td>955</td>\n",
       "      <td>0</td>\n",
       "      <td>661</td>\n",
       "      <td>0</td>\n",
       "      <td>0.924371</td>\n",
       "      <td>-2.272405</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8939</th>\n",
       "      <td>5916</td>\n",
       "      <td>110000</td>\n",
       "      <td>female</td>\n",
       "      <td>graduate school</td>\n",
       "      <td>married</td>\n",
       "      <td>41</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>7 month delay</td>\n",
       "      <td>7 month delay</td>\n",
       "      <td>7 month delay</td>\n",
       "      <td>7 month delay</td>\n",
       "      <td>150</td>\n",
       "      <td>150</td>\n",
       "      <td>150</td>\n",
       "      <td>150</td>\n",
       "      <td>150</td>\n",
       "      <td>150</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0.932952</td>\n",
       "      <td>-2.324798</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>8940 rows × 27 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "         ID  LIMIT_BAL     SEX        EDUCATION MARRIAGE  AGE  \\\n",
       "0     18899     140000  female            other   single   28   \n",
       "1     25772     350000  female  graduate school  married   33   \n",
       "2      6933     500000    male  graduate school   single   37   \n",
       "3     13381     400000  female       university   single   35   \n",
       "4      2561     310000  female  graduate school   single   32   \n",
       "5     22751     350000  female  graduate school  married   32   \n",
       "6     25692     330000  female  graduate school   single   42   \n",
       "7      8339     480000    male  graduate school  married   58   \n",
       "8     22712     320000  female      high school  married   35   \n",
       "9     28964     420000  female       university  married   34   \n",
       "10    22505     260000  female       university   single   33   \n",
       "11     7228     410000    male  graduate school  married   34   \n",
       "12     6854     290000    male      high school   single   34   \n",
       "13     3016     350000    male  graduate school  married   38   \n",
       "14    19530     350000  female       university  married   36   \n",
       "15     1980     500000  female  graduate school  married   35   \n",
       "16    11462     210000  female  graduate school   single   46   \n",
       "17      971     300000    male  graduate school  married   42   \n",
       "18    11090     240000    male       university  married   41   \n",
       "19    26005     320000  female       university  married   35   \n",
       "20     1199     340000  female      high school   single   44   \n",
       "21       61     500000  female      high school  married   28   \n",
       "22    15055     470000    male       university  married   35   \n",
       "23     8959     340000    male  graduate school   single   44   \n",
       "24    15549     450000    male       university   single   36   \n",
       "25    16129     200000  female       university   single   32   \n",
       "26     4321     420000  female  graduate school   single   34   \n",
       "27     5828     280000  female  graduate school   single   38   \n",
       "28    10754     160000  female       university  married   31   \n",
       "29     6853     310000    male       university   single   42   \n",
       "...     ...        ...     ...              ...      ...  ...   \n",
       "8910  12846      90000    male       university  married   42   \n",
       "8911  10785      80000  female       university  married   33   \n",
       "8912   9756     140000    male  graduate school  married   31   \n",
       "8913  10537      30000  female       university   single   25   \n",
       "8914  27255      80000    male  graduate school  married   46   \n",
       "8915  16920      50000    male      high school  married   52   \n",
       "8916  28144     220000  female  graduate school  married   46   \n",
       "8917  20997     230000    male       university   single   38   \n",
       "8918  17703      60000  female       university  married   35   \n",
       "8919   3087      30000  female       university   single   24   \n",
       "8920   4445     100000    male       university   single   36   \n",
       "8921  26512     100000  female      high school  married   55   \n",
       "8922  12281     100000    male       university  married   36   \n",
       "8923  13811      40000    male  graduate school  married   47   \n",
       "8924  15186      30000  female  graduate school   single   25   \n",
       "8925  17748      30000  female      high school  married   54   \n",
       "8926   4249      90000    male      high school  married   42   \n",
       "8927  16957     270000    male  graduate school  married   50   \n",
       "8928  18659      40000  female       university  married   28   \n",
       "8929  19215     150000  female       university   single   34   \n",
       "8930   7068      90000  female  graduate school   single   30   \n",
       "8931  26565     200000  female      high school  married   55   \n",
       "8932    565     390000  female  graduate school   single   45   \n",
       "8933  21098     200000    male  graduate school  married   42   \n",
       "8934   9672     170000    male  graduate school   single   48   \n",
       "8935  14589     280000    male  graduate school  married   50   \n",
       "8936  19316     110000  female  graduate school  married   41   \n",
       "8937  22725     100000  female       university  married   38   \n",
       "8938  29505      20000    male       university  married   40   \n",
       "8939   5916     110000  female  graduate school  married   41   \n",
       "\n",
       "                        PAY_0                    PAY_2  \\\n",
       "0     use of revolving credit  use of revolving credit   \n",
       "1     use of revolving credit                 pay duly   \n",
       "2                    pay duly                 pay duly   \n",
       "3     use of revolving credit  use of revolving credit   \n",
       "4              no consumption           no consumption   \n",
       "5                    pay duly                 pay duly   \n",
       "6              no consumption           no consumption   \n",
       "7              no consumption           no consumption   \n",
       "8     use of revolving credit  use of revolving credit   \n",
       "9     use of revolving credit  use of revolving credit   \n",
       "10                   pay duly                 pay duly   \n",
       "11                   pay duly  use of revolving credit   \n",
       "12    use of revolving credit  use of revolving credit   \n",
       "13             no consumption           no consumption   \n",
       "14    use of revolving credit  use of revolving credit   \n",
       "15    use of revolving credit  use of revolving credit   \n",
       "16                   pay duly                 pay duly   \n",
       "17                   pay duly  use of revolving credit   \n",
       "18    use of revolving credit  use of revolving credit   \n",
       "19                   pay duly                 pay duly   \n",
       "20    use of revolving credit  use of revolving credit   \n",
       "21    use of revolving credit  use of revolving credit   \n",
       "22    use of revolving credit  use of revolving credit   \n",
       "23    use of revolving credit  use of revolving credit   \n",
       "24             no consumption           no consumption   \n",
       "25    use of revolving credit  use of revolving credit   \n",
       "26                   pay duly                 pay duly   \n",
       "27                   pay duly  use of revolving credit   \n",
       "28    use of revolving credit  use of revolving credit   \n",
       "29    use of revolving credit  use of revolving credit   \n",
       "...                       ...                      ...   \n",
       "8910            2 month delay            2 month delay   \n",
       "8911            2 month delay            2 month delay   \n",
       "8912            2 month delay  use of revolving credit   \n",
       "8913            2 month delay            2 month delay   \n",
       "8914            2 month delay            2 month delay   \n",
       "8915            2 month delay            2 month delay   \n",
       "8916            3 month delay            2 month delay   \n",
       "8917            2 month delay            2 month delay   \n",
       "8918            2 month delay            2 month delay   \n",
       "8919            2 month delay            2 month delay   \n",
       "8920            8 month delay            7 month delay   \n",
       "8921            2 month delay            3 month delay   \n",
       "8922            1 month delay            2 month delay   \n",
       "8923            2 month delay            2 month delay   \n",
       "8924            2 month delay            2 month delay   \n",
       "8925            2 month delay            2 month delay   \n",
       "8926            2 month delay            2 month delay   \n",
       "8927            2 month delay            4 month delay   \n",
       "8928            2 month delay            2 month delay   \n",
       "8929            3 month delay            3 month delay   \n",
       "8930            2 month delay            2 month delay   \n",
       "8931            2 month delay            2 month delay   \n",
       "8932            2 month delay            2 month delay   \n",
       "8933            2 month delay            2 month delay   \n",
       "8934            2 month delay            2 month delay   \n",
       "8935            3 month delay            5 month delay   \n",
       "8936            3 month delay            2 month delay   \n",
       "8937            3 month delay            2 month delay   \n",
       "8938            1 month delay            2 month delay   \n",
       "8939            2 month delay            2 month delay   \n",
       "\n",
       "                        PAY_3                    PAY_4  \\\n",
       "0                    pay duly  use of revolving credit   \n",
       "1                    pay duly                 pay duly   \n",
       "2                    pay duly                 pay duly   \n",
       "3     use of revolving credit  use of revolving credit   \n",
       "4              no consumption           no consumption   \n",
       "5              no consumption           no consumption   \n",
       "6              no consumption           no consumption   \n",
       "7              no consumption           no consumption   \n",
       "8     use of revolving credit  use of revolving credit   \n",
       "9     use of revolving credit  use of revolving credit   \n",
       "10                   pay duly                 pay duly   \n",
       "11    use of revolving credit  use of revolving credit   \n",
       "12    use of revolving credit  use of revolving credit   \n",
       "13                   pay duly  use of revolving credit   \n",
       "14    use of revolving credit  use of revolving credit   \n",
       "15    use of revolving credit  use of revolving credit   \n",
       "16                   pay duly  use of revolving credit   \n",
       "17    use of revolving credit                 pay duly   \n",
       "18    use of revolving credit  use of revolving credit   \n",
       "19                   pay duly                 pay duly   \n",
       "20    use of revolving credit  use of revolving credit   \n",
       "21    use of revolving credit  use of revolving credit   \n",
       "22    use of revolving credit  use of revolving credit   \n",
       "23    use of revolving credit  use of revolving credit   \n",
       "24             no consumption           no consumption   \n",
       "25    use of revolving credit  use of revolving credit   \n",
       "26                   pay duly                 pay duly   \n",
       "27    use of revolving credit                 pay duly   \n",
       "28    use of revolving credit                 pay duly   \n",
       "29    use of revolving credit  use of revolving credit   \n",
       "...                       ...                      ...   \n",
       "8910            2 month delay            2 month delay   \n",
       "8911            2 month delay            2 month delay   \n",
       "8912  use of revolving credit            2 month delay   \n",
       "8913            2 month delay            2 month delay   \n",
       "8914            2 month delay            2 month delay   \n",
       "8915            2 month delay            2 month delay   \n",
       "8916            2 month delay  use of revolving credit   \n",
       "8917            2 month delay            2 month delay   \n",
       "8918            2 month delay            2 month delay   \n",
       "8919            7 month delay            7 month delay   \n",
       "8920            6 month delay            5 month delay   \n",
       "8921            2 month delay                 pay duly   \n",
       "8922            2 month delay            2 month delay   \n",
       "8923            2 month delay            2 month delay   \n",
       "8924            2 month delay            2 month delay   \n",
       "8925            2 month delay            2 month delay   \n",
       "8926            2 month delay            3 month delay   \n",
       "8927            3 month delay            3 month delay   \n",
       "8928            3 month delay            2 month delay   \n",
       "8929            4 month delay            4 month delay   \n",
       "8930            3 month delay            3 month delay   \n",
       "8931            3 month delay            2 month delay   \n",
       "8932            2 month delay                 pay duly   \n",
       "8933            2 month delay            2 month delay   \n",
       "8934            7 month delay            7 month delay   \n",
       "8935            4 month delay            3 month delay   \n",
       "8936            2 month delay            7 month delay   \n",
       "8937            2 month delay            3 month delay   \n",
       "8938            3 month delay            2 month delay   \n",
       "8939            7 month delay            7 month delay   \n",
       "\n",
       "                        PAY_5                    PAY_6  BILL_AMT1  BILL_AMT2  \\\n",
       "0     use of revolving credit  use of revolving credit     108018       6500   \n",
       "1                    pay duly                 pay duly      82964      68532   \n",
       "2                    pay duly                 pay duly       4331      60446   \n",
       "3     use of revolving credit  use of revolving credit     109943     222085   \n",
       "4              no consumption           no consumption      20138       8267   \n",
       "5              no consumption           no consumption      30625      60003   \n",
       "6              no consumption           no consumption        565      20650   \n",
       "7              no consumption           no consumption      24610       -310   \n",
       "8     use of revolving credit  use of revolving credit     157249     148123   \n",
       "9     use of revolving credit                 pay duly     158471      44131   \n",
       "10                   pay duly  use of revolving credit       5188      12357   \n",
       "11    use of revolving credit                 pay duly     109256      15134   \n",
       "12    use of revolving credit  use of revolving credit       5451       6230   \n",
       "13    use of revolving credit           no consumption      16459       4120   \n",
       "14    use of revolving credit  use of revolving credit      21026      35588   \n",
       "15    use of revolving credit  use of revolving credit      35176      36193   \n",
       "16    use of revolving credit                 pay duly      15655       3918   \n",
       "17    use of revolving credit  use of revolving credit      11973      61834   \n",
       "18    use of revolving credit  use of revolving credit      22165      21292   \n",
       "19    use of revolving credit  use of revolving credit       2276       6626   \n",
       "20    use of revolving credit  use of revolving credit     142836     145125   \n",
       "21    use of revolving credit  use of revolving credit      22848      23638   \n",
       "22    use of revolving credit  use of revolving credit     170812     172332   \n",
       "23    use of revolving credit  use of revolving credit      83059      85634   \n",
       "24             no consumption           no consumption       8012       4009   \n",
       "25                   pay duly  use of revolving credit      24429      13060   \n",
       "26                   pay duly                 pay duly      13207       6184   \n",
       "27    use of revolving credit                 pay duly      17878      14011   \n",
       "28                   pay duly  use of revolving credit      42781      42774   \n",
       "29    use of revolving credit  use of revolving credit     169749     172685   \n",
       "...                       ...                      ...        ...        ...   \n",
       "8910            2 month delay  use of revolving credit      95773      95489   \n",
       "8911            2 month delay            2 month delay      53843      55933   \n",
       "8912            2 month delay            2 month delay      51028      52112   \n",
       "8913            3 month delay            2 month delay        300        300   \n",
       "8914            2 month delay            2 month delay      40509      40551   \n",
       "8915            4 month delay            3 month delay      36428      37530   \n",
       "8916  use of revolving credit  use of revolving credit     249449     243517   \n",
       "8917            2 month delay  use of revolving credit     177917     181465   \n",
       "8918            2 month delay            2 month delay       3167       5601   \n",
       "8919            7 month delay            7 month delay        300        300   \n",
       "8920            4 month delay            3 month delay     110072     108478   \n",
       "8921            3 month delay            2 month delay       1520       1349   \n",
       "8922            4 month delay            3 month delay       9670       9371   \n",
       "8923            2 month delay            2 month delay      11084      12605   \n",
       "8924            2 month delay            2 month delay       7593       9634   \n",
       "8925            4 month delay            3 month delay      22147      24770   \n",
       "8926            3 month delay            3 month delay      48674      49895   \n",
       "8927            2 month delay            2 month delay     213616     208784   \n",
       "8928            2 month delay            2 month delay      31131      33815   \n",
       "8929            5 month delay            5 month delay     103389     108189   \n",
       "8930            3 month delay            3 month delay        750        750   \n",
       "8931            2 month delay            2 month delay     159017     162697   \n",
       "8932            2 month delay            2 month delay        834        155   \n",
       "8933            2 month delay            2 month delay     168289     172001   \n",
       "8934            7 month delay            7 month delay       2400       2400   \n",
       "8935            2 month delay  use of revolving credit     327918     321476   \n",
       "8936            7 month delay            7 month delay        150        150   \n",
       "8937            3 month delay            3 month delay        750        750   \n",
       "8938            3 month delay            3 month delay      14829      17267   \n",
       "8939            7 month delay            7 month delay        150        150   \n",
       "\n",
       "      BILL_AMT3  BILL_AMT4  BILL_AMT5  BILL_AMT6  PAY_AMT1  PAY_AMT2  \\\n",
       "0          6327     138485     140492     141006      1000      6327   \n",
       "1         17926      17966      30741      31088     68940     18018   \n",
       "2         30592     154167      13410      25426     60446     30594   \n",
       "3        223350     213831     210563     211925    120018     10071   \n",
       "4         65993       8543       1695        750      8267     66008   \n",
       "5          7147       9950      22117       4874     60396      7147   \n",
       "6         15360          0      12923       1816     20650     15360   \n",
       "7        148544      18791       5909      68988         4    149654   \n",
       "8        142852     133583     129049     128325      6000      6048   \n",
       "9         32423      18824          0      21082      1644      1436   \n",
       "10        28656       7497       7685      15434     13000     29022   \n",
       "11         5063       1019      14585       5370     15000      4867   \n",
       "12       140802     143354     146225     148820      1200    135000   \n",
       "13        44164      35233        884       9924       941     44743   \n",
       "14        38002      40357      43663      52735     15000      3000   \n",
       "15        44157      48322      21593      13866      2504     10004   \n",
       "16        29881      24247      21664       1556      4854     30366   \n",
       "17        25145      37666      19453      10492     20979      5000   \n",
       "18        16469      13737       9071     177268      7002      3002   \n",
       "19        11131      13824      17992      15250      6626     12446   \n",
       "20       146682     150407     147868     149349      7000      5500   \n",
       "21        18878      14937      13827      15571      1516      1300   \n",
       "22       177566     182074     183417     185608      6500      8000   \n",
       "23        73950      59324     156094     110234     20000      5000   \n",
       "24         5226       4715       3275       6422      4021      5241   \n",
       "25        13683      -3942     123250     125926      1500      1000   \n",
       "26         6692       1039       1039       1503      6222      9723   \n",
       "27        30079      13139      13989      15559      2000     30000   \n",
       "28        41817        749       5572      10573      2300      2300   \n",
       "29       176630     180315     184072     188194      7000      6630   \n",
       "...         ...        ...        ...        ...       ...       ...   \n",
       "8910      94681      93965      90545      90529      4000      3500   \n",
       "8911      56575      57303      58593      59738      3500      2100   \n",
       "8912      55232      55932      54910      57344      2500      4600   \n",
       "8913        300       1126        826        676         0         0   \n",
       "8914      42592      43296      43892      43060      1000      3000   \n",
       "8915      38630      41774      40806      41357      2000      2000   \n",
       "8916     228368     224414     196229     190050      9501         0   \n",
       "8917     185074     187053     176805     180826      8000      8000   \n",
       "8918       5366       6772       6515       7906      2500         0   \n",
       "8919        300        300        300        300         0         0   \n",
       "8920     105931     104554     102360     100413         0         0   \n",
       "8921        959       1623       1470        930         0         0   \n",
       "8922      11705      12919      12139      11653         0      2500   \n",
       "8923      13102      12595      14386      14005      2000      1000   \n",
       "8924       4476       8830       8153       6422      2379         7   \n",
       "8925      26068      28842      28094      27361      3000      2000   \n",
       "8926      52570      53614      54534      53374      2300      4116   \n",
       "8927     212058     207226     202394     231339         0      8000   \n",
       "8928      33002      32173      34629      33940      3500         0   \n",
       "8929     112968     117613     122161     129616      8000      8000   \n",
       "8930        750        750       2450       2150         0         0   \n",
       "8931     163143     161906     165807     169599      9159      4842   \n",
       "8932      -1690       4240       3346       2698         1      1693   \n",
       "8933     175281     177895     180078     184048      8000      7500   \n",
       "8934       2400       2400       2400       2400         0         0   \n",
       "8935     314931     176439     154010     134334         0         0   \n",
       "8936        150        150        150        150         0         0   \n",
       "8937        750        750        750        750         0         0   \n",
       "8938      16706      18694      19049      18459      3000         0   \n",
       "8939        150        150        150        150         0         0   \n",
       "\n",
       "      PAY_AMT3  PAY_AMT4  PAY_AMT5  PAY_AMT6  DEFAULT_NEXT_MONTH  \\\n",
       "0       135000      4700      5000      5000                   1   \n",
       "1        18058     30897     31244     88461                   1   \n",
       "2       150843    163881     25426     39526                   1   \n",
       "3         8037      8018      8809      5022                   1   \n",
       "4         8543      1695       750      7350                   1   \n",
       "5         9950     22117      4874         0                   1   \n",
       "6            0     12923      1816     17050                   1   \n",
       "7        18885      5940     69337    200655                   1   \n",
       "8         6000      5000      5000      5000                   1   \n",
       "9         1000         0     21082    228548                   1   \n",
       "10        7500     27769     12000      6200                   1   \n",
       "11         803     14436      5396       875                   1   \n",
       "12        5200      5500      5500      5400                   1   \n",
       "13           0       884      9924     10824                   1   \n",
       "14        3000      4000     10000     25000                   1   \n",
       "15        5178      1047      2019      1004                   1   \n",
       "16           0       433      1556     14047                   1   \n",
       "17       37676      8808      2000      2709                   1   \n",
       "18        5002      3009    177004      5452                   1   \n",
       "19       17746      6000      5749       928                   1   \n",
       "20        6027      5328      5390      6047                   1   \n",
       "21        1000      1000      2000      2000                   1   \n",
       "22        9000      7000      8000      8000                   1   \n",
       "23        2000    112000      4234      4000                   1   \n",
       "24        4729      3284      6441      4285                   1   \n",
       "25           0    128000      4600      5000                   1   \n",
       "26        1045      1042      1509      9215                   1   \n",
       "27       14000      1000     16000         0                   1   \n",
       "28         749      5572      5573     13793                   1   \n",
       "29        6379      6586      7086      7522                   1   \n",
       "...        ...       ...       ...       ...                 ...   \n",
       "8910      3500         0      3500      4200                   0   \n",
       "8911      2200      2300      2200      2100                   0   \n",
       "8912      2200         0      3513      3000                   0   \n",
       "8913       828         0         0     31496                   0   \n",
       "8914      1700      1600         0      3500                   0   \n",
       "8915      4086         0      1500      1000                   0   \n",
       "8916     10000      7200      7001      6900                   0   \n",
       "8917      6500         0      7000      6500                   0   \n",
       "8918      1500         0      1500         0                   0   \n",
       "8919         0         0         0         0                   0   \n",
       "8920      1170         0         0         0                   0   \n",
       "8921      1623         0         0       780                   0   \n",
       "8922      1700         0         0         0                   0   \n",
       "8923         0      2000         0      2000                   0   \n",
       "8924      7002        13       155         1                   0   \n",
       "8925      3500         0         0      1000                   0   \n",
       "8926      2500      2052         0         0                   0   \n",
       "8927         0         0     32236      3000                   0   \n",
       "8928         0      3000         0      2000                   0   \n",
       "8929      8000      8000     10000      5000                   0   \n",
       "8930         0      2000         0         0                   0   \n",
       "8931      3000      8000      7000      3000                   0   \n",
       "8932      6940         7      1230         3                   0   \n",
       "8933      7000      6600      7000      7100                   0   \n",
       "8934         0         0         0         0                   0   \n",
       "8935       500         0      6267      2257                   0   \n",
       "8936         0         0         0         0                   0   \n",
       "8937         0         0         0      1500                   0   \n",
       "8938      2560       955         0       661                   0   \n",
       "8939         0         0         0         0                   0   \n",
       "\n",
       "      p_DEFAULT_NEXT_MONTH  r_DEFAULT_NEXT_MONTH  \n",
       "0                 0.028563              2.666700  \n",
       "1                 0.030224              2.645421  \n",
       "2                 0.030849              2.637673  \n",
       "3                 0.031902              2.624911  \n",
       "4                 0.032029              2.623404  \n",
       "5                 0.033741              2.603470  \n",
       "6                 0.034929              2.590155  \n",
       "7                 0.036294              2.575309  \n",
       "8                 0.037974              2.557673  \n",
       "9                 0.038392              2.553394  \n",
       "10                0.038427              2.553038  \n",
       "11                0.040427              2.533087  \n",
       "12                0.040579              2.531600  \n",
       "13                0.041813              2.519744  \n",
       "14                0.042401              2.514193  \n",
       "15                0.042956              2.509018  \n",
       "16                0.043176              2.506974  \n",
       "17                0.043455              2.504409  \n",
       "18                0.045870              2.482715  \n",
       "19                0.045997              2.481601  \n",
       "20                0.046074              2.480930  \n",
       "21                0.046277              2.479158  \n",
       "22                0.046652              2.475903  \n",
       "23                0.046721              2.475300  \n",
       "24                0.047879              2.465396  \n",
       "25                0.049313              2.453393  \n",
       "26                0.049665              2.450493  \n",
       "27                0.051280              2.437401  \n",
       "28                0.052010              2.431592  \n",
       "29                0.052043              2.431334  \n",
       "...                    ...                   ...  \n",
       "8910              0.810857             -1.824966  \n",
       "8911              0.812690             -1.830294  \n",
       "8912              0.818370             -1.847041  \n",
       "8913              0.822368             -1.859055  \n",
       "8914              0.822429             -1.859238  \n",
       "8915              0.823017             -1.861021  \n",
       "8916              0.823451             -1.862342  \n",
       "8917              0.823666             -1.862996  \n",
       "8918              0.824598             -1.865838  \n",
       "8919              0.827808             -1.875710  \n",
       "8920              0.828279             -1.877169  \n",
       "8921              0.828957             -1.879275  \n",
       "8922              0.829755             -1.881762  \n",
       "8923              0.830768             -1.884933  \n",
       "8924              0.833031             -1.892062  \n",
       "8925              0.836493             -1.903103  \n",
       "8926              0.851551             -1.953210  \n",
       "8927              0.852610             -1.956872  \n",
       "8928              0.853746             -1.960822  \n",
       "8929              0.854225             -1.962494  \n",
       "8930              0.864007             -1.997573  \n",
       "8931              0.864925             -2.000964  \n",
       "8932              0.870124             -2.020481  \n",
       "8933              0.870909             -2.023481  \n",
       "8934              0.903844             -2.164156  \n",
       "8935              0.909352             -2.191241  \n",
       "8936              0.910655             -2.197840  \n",
       "8937              0.920587             -2.250821  \n",
       "8938              0.924371             -2.272405  \n",
       "8939              0.932952             -2.324798  \n",
       "\n",
       "[8940 rows x 27 columns]"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "test_yhat = test_yhat.sort_values(by='r_DEFAULT_NEXT_MONTH', ascending=False).reset_index(drop=True)\n",
    "test_yhat"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This simple analysis has uncovered some of the most difficult customers for the GBM to correctly predict default. Perhaps because of the high importance of the payment features, `PAY_0`-`PAY_6`, the GBM struggles to correctly predict several cases in which customers made timely recent payments and then suddenly defaulted (high positive residuals) and those customers that were chronically late making payments but did not default (high negative residuals)."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Plot residuals by most important input variable \n",
    "Residuals can also be plotted for important input variables to understand how the values of a single input variable affect prediction errors. When plotted by `PAY_0`, the residuals confirm that the GBM is struggling to accurately predict cases where default status is not correlated with recent payment behavior in an obvious way. The residual plots for values of `PAY_0` indicating timely payment behavior (e.g., `use of revolving credit`, `pay duly`, and `no consumption`) generally display the highest positive residuals and relatively small negative residuals. Residuals for the other values of `PAY_0`, those that represent late recent payments, tend to show large negative residuals and relatively small positive residuals."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAM0AAAlACAYAAAAsCra8AAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAIABJREFUeJzsnXmcFNXVv58zOzDDNoCigsggCohBQNGIC7jhFo0JMQTjljfqazQmxviamPwki3mNGo2vy6tGja9L4pKocTco4BYNAqIICjICioLAsM3ADMxyfn/cauhpZqnq7ur1PJ9PMbXcuvdMT38595y6da+oKoZh+Kcg3QYYRrZhojGMgJhoDCMgJhrDCIiJxjACYqIxjICYaAwjIBkvGhFpFpH5IvKBiDwuIl2jrp0uIioi+3vHZSLykYiMjCrzUxG5q4P6zxGRj73tnHB/m+QiIqUi8rL3+ZyZojanicgVnZS5R0SGp8KeIIjILBEZ6+0/LyI9ve3iIPVkvGiAelUdpaoHANuBi6KuTQHe8H6iqg3Aj4A7xLGnV/6qtioWkd7ANcA44BDgGhHpFdpvknwOAvA+n0fbKyQiRakzCVT1P1R1USraivd3U9WTVHUj0BPIOdFE8zowBEBEyoHxwPeAb0cKqOqLwCrgbOBmYJqqbminvhOA6aq63iszHZiUiIEicq6I3BZ1/KyIHC0ihSJyv+cxF4jIj73rVSLyoojMFZHXI14zps7eIvKUiLwvIm+LyIEi0g94CDjY8zRVMffMEpE/isgc4DIR6SsifxeRd7ztcBEpEJHlItIz6r6PRWQ3ERkkIjO8Nl8RkYEx9e8vIrOjjgeJyIKotiP/o9eJyLUi8p5n+25Rv/fb3mfxWxGpa+fzPNuz4T0RedA7d7+I3Cki/wauF5FuInKfiMwWkXdF5DSvXBcReUREPhSRJ4EuUfUuF5E+wHVAlfcZ3uDjTwyqmtEbUOf9LAL+AfyndzwVuNfb/xcwJuqePYCVwMxO6r4C+EXU8S+BK9oodzMwv43tqjbKngvcFnX8LHA0MAYn0Mj5nt7PV4B9vf1xwIw26rwVuMbbnwjM9/aPBp5t53ebBdwRdfwXYLy3PxD40Nu/BTgvqv2Xvf1ngHO8/fOBp7z9aZHPyPsM9vH2/yvyWXptj/X2FTjV278+qsyzwBRv/6LI3znmdxgBLAH6eMe9vZ/3e/cXese/A86KfK7ePd2Ay4H7vPMHAk1Rdi0H+gCDgA+CfCdT6rbjpIuIzPf2Xwfu9fan4P7gAI94x3MBVPULEZmB+2ATRlV/nIRqPgEGi8itwHPAPz1v+VXgcRGJlCtt497xwDc8W2aISKWIdPfRZnSX7VhgeFQ73b32HwX+H/BnnMeO3HMYcIa3/yDuCx/LY8CZuP+tz/S2WLaz8+8wFzguqv7Tvf2/ADe2ce9E4HFVXQegquujrj2uqs3e/vHA16JirTLcfwxHAv/j3fu+iLzfRhuByQbR1KvqqOgTXiwyERgpIgoUAioiP1XdMQK1xds64nPc/9YR9sL9L9kKEbkZmNDG/Y+o6nUx55po3e0tA1DVDSLyFVyX8CLgW7j4a2Ps75dEtkTtFwCHqov7diAibwFDRKQv7kv82wD1P4oT/BOAqurHbZRpjPqbNJO871z07ybAN1R1cXSBqP8gkkq2xTQRvgk8qKp7q+ogVR0ALAOOCFjPS8DxItLLSwAc751rhar+WF2wHbvFCgac2x/lxQsDcAkGvP5zgar+HfgFMFpVNwPLRGSyV0Y8YcXyOq47iogcDazz7g3CP4FLIwciMsr73RR4ErgJ12Wr8Yr8i52x4lTPhlaoajVOCL+ktVfzw9t43jOqnVhmAJNFpNKzuXc75V4CLhVPJSJykHf+NeA73rkDcF20WGqBiiCGZ6topuD+0NH83TvvG8/d/wZ4x9t+HdMFiIc3cQJehOsazPPO7wnM8rqaDwE/885PBb4nIu8BC4HT2qhzGjDG615cB8STGv8hMNYLqhfROgv5KHAWrb/4lwLneW1+F7isnXoj9z4W0J4fAZd79Q8BNsUWUNWFwLXAq97nc1M7df0GKAbeF5GF3jHA/wLlIvIh8Gu87ntMGzXAm16CxlciQHZ6TsNIHeKet9WrqorIt3FJgbb+w8g4siGmMXKTMcBtXpdqIy5DlxXkhacRN0LgwZjT21R1XDrsMbKbvBCNYSSTrEsETJo0SXEPzGyzLRlbYLJONOvWrUu3CUaek3WiMYx0Y6IxjICYaAwjICYawwiIicYwApKbIwJqqqF6JtSugor+UDUBKqs6v88wfJB7oqmphjdugfp10LQN1n4Iq96H8ZeZcIykkHuiee8xWF8NBcXQsAm2bwb9EApL4RR/b7MaRkfkXkzz+RwoKHJdM22E0u5QWAJLX3JeyDASJPdEA7BlHWgz1K2FdUth00rndd4L+sqHYexK7olmwFgnmrq1ULcOtte5rWEzzPs/8zZGwuSeaEZ+C4rLYFsd7nX9yDQBLVC3Ch6YnEbjjFwg90RTWQV7HUy7c2psqoYXrk6pSUZukXuiARh4KBR2kBj8923tXzOMTshN0VRNgJLyjsuYtzHiJDdFU1kFh13acRnzNkac5KZoAI68HArLOi5j3saIg9wVDcDgIzu+/u/bYOnM1Nhi5Ay5LZpxPlZQeOj0zssYRhS5LZohE2CPgzsvd+PIzssYhkduiwbgG3fh5sfugLpPLb4xfJP7oqmsggO/03k5i28Mn+S+aADOuMNfOYtvDB/kh2gAJl7jr9y0HuHaYWQ9+SOaIy+H8oGdlwMTjtEh+SMagCsW+C9rwjHaIb9EAzBtl7WDOihrwjF2Ja2iEZEBIjJTRBaJyEIRaW+1reQSVDivtbcAl5GPpNvTNAE/UdXhwKHAD0RkeEpa/prPjBrAjF/BH8eGZ4uRVaRVNKq6SlXnefu1wIe4tSnDZ/RUGHqq//IbP7bumgH4WNRJRJ6kg3U8VPWM9q4FMkRkEG413gNiVy4WkQuACwAGDhw4ZsWKFclo0vGXs2DJM8HuCdK9MzKdwOum+xHNMVGV/y+tVwVGVV8J2mgbbZQDrwLXquoTHZUdO3aszpkzJ9EmW/PExfD+w8HumXiNS2Mb2U7yRdOqsMi7qnpQ5yUDGCBSDDwLvKSqnUbcoYgGYN7D8LSPUdHRlA8MlsY2MpHAogka08S13Fp7eCv73gt86EcwoTJ6avBuV92nLs6xMWt5RaeiEZHukQ0oFJGKmHOJcDjwXWCiiMz3tpMSrDMx4olXHjod7jou+bYYGYmfmOYznIeJdmORY1VVn2NTkkNo3bNY4smUFXaFKX9x7/EY2UIo3bPDVHWgqg6I2iLHKRVMSpm2yf9YtQjNW83r5AF+RPN06FZkKlcsgEvnBb9v1WznqZ4ImFgwsgI/ognsvnKKyirndYri6K69/7ATj70VmlP4iWnWAA+1d11VU/qwImUxTVvEk5aOYOnpTCWwU/CzqFM9sDC4LTnI6Klu+/1+UL862L2R9HT57jDx/7l6jKzEj6eZp6qjU2RPp6TV00RTUw23Ho77PyUO9jjYTfphSxqmm1CyZ81xGJL7VFbBtNXQ/5D47v/iHbjrKHh4sj0czTL8eJo9Orquql8k1aJOyBhPE8ufT4cV8X75C6DfMDj+WnvGk3pCGbD5IW0/3OwN9FXVwqCNJkLGigYSSxSAm3t6+Olw9JXWbUsd4Q7YBPe2JXAlcCJwu6reHLTRRMho0USY9zA8/UPcO3ZxMvRU+E67SUsjeYQ3YFNEBovIPcDLuGza8FQLJmsYPRWm1bi3Q4viHJ635Bm4+1hbIzQD8dM9Gwb8HBgN3AA8pKoJ/BeaGFnhaWJZOhNeuArWf+xWnQ5MAfQeDCfdaDFP8gklpmkGPsMNp9lFLHn1cDNRaqrdsuzzHoC6OPMn5bvD8NNg3IUW9ySHUETzvY6uq+q9QRtNhKwWTYSaaphxHXz0DDTH8ZxHiqB8NxjzXbeatYknEUJ/c7MMQFUbgjaULHJCNBFqvJWml76QWD3dB8LX/se6bvERTiJARL4vIp8Aq4HVIlLtTXZhJEJlFZz1SGIJA4DNn8JD34DbD4NZ/23Jg5Dx0z37GXA0cKmqLvHODQVuAV5T1f8O28hocsrTtEVNNfzjMvj09eD3FpZCt92ga0/Y/yTruvkjlJhmMTBKVetjzncF5qvq0KCNJkLOiybCC1fDO3dDy/aok4V0OKpJiqC0B4i4r0JJNxg6yZIGHROKaD5S1f2DXguLvBFNhEjcs+wVaG6kw7lNpAQKCpxoCsugqAQaNkNJF5c46DcMDjrbYp/WhPJqwCoROVpVZ7VqSeQoXIxjhEkk7lk6E959AD6eCds3tFFQoLAItAUoAG1yTqllOzQ0Qf1mWLcUFj0NvfaGAydb9y1O/HiakcBTwExgrnd6LC7OOV1VU/pmVd55mraI7bpJEZSWQ2MDoCCF7njbZmhqYsfjNSkEVVemax8nmKOuynfPE07KWUS64KZaGuGdWgQ8qKpbgzaYKCaaKCIPS5e/CptXQ30NFJY4b1NUBlvWQIsCLez4bkiBu15SDt33gO794eQ/5LPHCaV7hpcEuDuwOUa4VFbBxJ8BP3PHS2fCrN/BuiXQ0uzimpYtgJcYUNw/BV5CQcQN66memc+iCUynohGRDbQdfUbmPeudiAEich9wCrBGVQ9IpK68Z8gE6DUQ3roTlr4ECDQ3uL9epFumCkXFrktXUARd+0KdhaZB8ONp3gT6AX8DHgE+T7IN9wO3AQ8kud78pLIKTrkBai5yHuSDJ2HlbG+gqEBhsRNOSTcX9/TY041ni6Wm2t1fuwoq+kPVBPNGHn5jml7AN4EzcaMIHgEeU9WNSTHCLbPxrB9PYzFNHCydCW/fDl/Mh+110KUX7D4S+u7nYpzRZ7cWRE21G1TapZdLLnz5PtSthSETczHjFlpMswH4k/c+zbeBW4EK4A9BGzTSwJAJOzNkEQ9St9p5mLY8SPVMJ5imbc5LFXeFbv1g1QInoliR5Rm+RCMihwBTgAnA28BkYFZ4Zu3SfvSiTqlqNjeprOr8C1+7ymXWVi9wginuAig0bHJiyvPEgZ9EQDVQi+uSfQ9o9C6NFBFU9f0Q7QNAVe/Gy96NHTs2qct9GG1Q0R+21TqRlPV05xoboLQ7lFY4UeUxvkYE4PIvJwMnsesEG0eGYJeRTqomuJimqASa6gGBxq3Q/0AnprYSB3lEp6JR1fF+KhKRiao6I6gBIvJX3OiCPiKyErgm1S+2GTFUVrm45b3H4JMZ0K0vDBjnHpzWb4BhARb4zUECz0bTbkUpmonTsmcpxk/iILsJJ3sWVuNGFuAncZBnBF1zsyMsQDfygmSKxjDyAj8L1R7ss67PErTFMLICP57mLj8VqeppCdpiGFmBdc8MIyB+smeDReSJ9i6q6hlJtMcwMh4/olkL3B62IYaRLfgRTZ2qvhK6JYaRJfiJaT4N3QrDyCL8iGaGiOzytF9EeomIr8yaYeQSfkTzFWCuiIyLnPDeb3kX+DgswwwjU/Ezyvl8ETkCuFtE5gHDcF228aq6MmwDDSPT8Dtg813cBBuRMeGXm2CMfMXPMJopwHu4WWiqgG8At4jIfSLSJ2T7DCPj8ONpzgKOVdVl3vFsL775ATAbGByWcYaRifiJaU5u41wLcKuIPBaKVYaRwfjpnv0hav+SmMu/S7pFhpHh+Ek5R08pf37MtYOSaIthZAV+RCPt7BtGXuInEVAgIhU4gUX2I+IpDM0yw8hQ/IimEljITqEsirpm8wIYeYef7NleqTDEMLIFP9PS7tHRdVX9InnmGEbm46d79gquGxY7HW1voC8JxjUiMgm4xavnHlW9LpH6DCNs/HTPhkUfi8gA4ErgROD3iTQuIoW4t0KPA1YC74jI06q6qOM7DSN9+J5YQ0QGe+vTvIxLDAxX1ZsTbP8QYKmqfqKq23ErE9isNkZG42dEwDAReRB4BngDGKGqd3pf8kTZk9bzpa30zsXacIGIzBGROWvXrk1Cs4YRP35img9wX+yngQOB66Nf5FTVy8MxbSe2Po2RSfgRzQUhtv85MCDqeC+SvxCuYSQVP4kAX2vFiMgfVfVHAdt/B9hXRPbBieXbwHcC1mEYKSWZS20EXhFNVZu8kdMv4VLO96nqwkSMOOPWV5n3ed2O49F7lvPEpUclUqVhtCLt09Kq6vOqOlRVq1T12kTqihUMwLzP6xh01XMJ2WgY0aRdNMkkVjDRDLrqOX779IIUWmPkKskUTca/NnDPvz41r2MkjJ/nNL/xWddtCdqSMkw4RiL48TS7zBHQFpmwIvOAHiW+y5pwjHjxI5pCEakQke5tbaFbGIAH/uOwQOUHXfWciccITKdLoovINuBLdh3lLICq6sDwzNuVzpZEv+OVxVw/fWlcdS+/zpdTNXKLwLG4H0+zSFUHquqAqC1ynFLB+OHiY/bjhjMOiOte8zqGH3Iq5Rxh8iF7x+01rMtmdIYf0bSbFRORG5NoS9JJpLtl4jHao9OYpsObRT7NtJimLZLx5bd4J2cJJaZJaoPpYPl1J8cd50Qwz2NE8JM9693eJeC9VM9WE4+niSZZX3zzPDlD4P/4/YhmGbtOrBFBVTWlqwYkKpoIJh7DI/miyTSSJRqAoVc9RzLe2QYY3q8Lz18+MUm1GSkkFE8zOuaUAutU9bO2yodNMkUTIdmxinmfrCIU0cxs43RvoASYoqrzgzaaCGGIJoKJJy9JXfdMRMYCN6lq4Dc2EyFM0URItnhuOOMAJh+yd1LrNJJGamMaEZmnqrHdt1BJhWgiJFs84/fpwUMXjk9qnUbCpNTT7AY8r6pj4qogTlIpmggn3TSDRWvqk1ZfAfCNUbtzw7dT+tEZbRNKTHMruy6p0Rv4KnCZqj4TtNFESIdoojHvk3OEIppzYk4pUAO8o6prgjaYKOkWTYRki2fS/pXcee6hSa3T8EVKu2cDgG+r6g1xVRAnmSKaCMnuupUWCd89ZAC/+NrIpNVpdEi4ohGRvsBkYAqwB/Ckql4RtNFEyDTRRDPkqudoSmJ9g/t05VenjuCI/folsVYjhlC6ZxXAGbiZL4cCTwBnpmuFtEwWTYSL7n+bFz+qSVp9XYqEb40dwLmH78M+fcuTVq8BhCSaemA28AvgDVVVEfkk0TFnIjIZmAYMAw5RVV9KyAbRRHPob15g9ZaWpNRVXCAM36OCK47bz7xP8ghFND/CzbHcDfgr8CgwPQmiGQa0AHcBV+SqaCL89ukF3POvT5NWX9eSAk4Yvhs/PGaoeZ/ECC+mEZHBOPFMAfYFrsHFNEuCNhpT7yzyQDQRHp+9gl898wF1jcmpT4D9duvG1ScNN+8TH6nJnonIATjxnKmqQwJX0LquWXQiGhG5AG/Jj4EDB45ZsWJFIk1mDHe8spg/vrKU7UnovXUpLuDSowdz8TH7JV5ZfhFK9+xQVX07LmtEXgZ2b+PS1ar6D6/MLPLI07TFsrV1/PnNZTw+51Pqk5B+61IkHLhXTy6ZMMS8T+eEIpod48tE5C1VDTYjX2cGmGhasWxtHZf9dS7vf9H+ZO5+KSoQJgyt5Ocnj7C4p30Ci8bP+jTRlZYFbcAIxj59y3n6hzvX03l89gp++/yHbGpoDlxXU4vyykfreGfFmxw0sCfnf3Uf8zxJwI+neQ84GjfOcIa3v0NIqro+roZFvg7cCvQFNgLzVfWEzu7LdU/TFpHu2z/mr2RTQ/AAqEsRlJeV0Nyi7NuvnH13q2C//t0ZX1VpHiik7tlyXGo4p+YIyFaWra3jjy8v5oUFq30lEAoBKRC6lRQi4v6IvbuV0r1LEd1Ki7nwiLz3PjZHQD7x+uI1/PqZD/h4Xftj34oKoFCEspJCigoKqNvWxN69u6Io25pa2NzQyNB+5Xy1qg+njdozHz1PKJ7mLFV9yNs/XFXfjLp2iaqmdF0aE82u3PHKYu5+fTkbG3am3gqAokJoUehWUkhRYSHbGpspKBD69yjji431lBQV0KLK7t3LKC4soKSogP13755vXbfQs2et3tTM9Tc3s5HXF6/h3jeXseDzTdQ1NFFaXEjf8hJqG5rYWN/Inj3LqG9Utm5voqy4kOLCAooKoKDA/dyrVxeKCwtZV7eNI/fNC+8TevYstoGsmGEznzhiv347YpSIgD5aXUu30iIKCwRBaGhsokBAVelSXMDWxmZ6lrqu29K1Wxjevwd9y0tZtLqWhjkrOXPsXrkunED4EY22s9/WsZFBRAS0bG0db1TXMLt6HYtW11JeWkRTSwtlRQWICCWFBaCwvamFXt1K6FJciKJsqm+kZ5dinpr/OX0qyvhyUwO79SjLp65bm/jpnm0FluK8SpW3j3c8WFW7hWphDNY9S4xla+t4av7nTF+4mq1NLezVo4yaLY3UbWukqUUZ3r87FWUlNDQ2U1JcwODKrry2ZB3Hj9id8rIi6rxuXg55n1C6Z8PiMMTIUPbpW86Pj9uP00ftyVPzP2f+ZxspLy2iW2khZUWFFBYW0NDYzNbtzQzfo4IPPt9Mn+6ldO9SDLDj5xvVNbkimsB0KhpVXQEgIj1xo5sBlqjqpjANM8IlIp4IEQ/0+pJ19Oleypi9e1DiJQSOGtqn1b3lZUWs3tSQapMzhk5FIyKluHdeTgeW4dzZ3iLyJHCRqiZrOmQjjUR7oDeqa/hyUwO9y4s4ct8+lBa1/prUNTSxW4/8HVHlp3v2C6AYGKCqtbDjFejbgV96m5Ej7NO3vFW3a9naOh6dsxKgVUxzwojd0mVi2vGzqNPXge9HBAPg7V/sXTNymH36lnPm2L3o5nXJupUV5VISIC78eJoWVd0ae1JV60TEUs55QKz3yXd8PacRkV60nZpLzowRhpFF+BFND2Au7YxyTq45hpH5+Ek5D/JTkYiMUNWFCVtkGBlOoqs7R/NgEusyjIwlmaKxwZtGXpBM0Vh8Y+QFvkQjjgFhG2MY2YAv0agbCv18J8VsOI2RFwTpns0TkYPbu6iqtiKRkRf4eU4TYRwwVURWAFtwgb+q6oGhWGYYGUoQ0XQ6J5lh5AO+RRN5r8Yw8p1kppwDISI3iMhHIvK+iDzpveRmGBlP2kQDTAcO8GKiJcDP0miLYfgmbaJR1X+qamR2u7eBtKzhaRhBSaenieZ84IX2LorIBSIyR0TmrF27NoVmGcauhDqXs89Fna4GxgJnqA9jbAonI8mEMoVT3KjqsR1dF5FzgVOAY/wIxjAygVBF0xEiMgm4EjiqrdepDSNTSWdMcxtQAUwXkfkicmcabTEM36TN0yS6KrRhpItMyZ4ZRtZgojGMgJhoDCMgJhrDCIiJxjACYqIxjICYaAwjICYawwiIicYwAmKiMYyAmGgMIyAmGsMIiInGMAJiojGMgJhoDCMgJhrDCEioE2uEgYisBdqb7bMPsC6F5mQL9rm0TR/gI1WdFOSmrBNNR4jIHFUdm247Mg37XNom3s/FumeGERATjWEEJNdEc3e6DchQ7HNpm7g+l5yKaQwjFeSapzGM0DHRGEZATDSGERATjWEExERjGAEx0RhGQEw0hhEQE41hBMREYxgBMdEYRkBMNAEQkWZv1bYPRORxEekade10EVER2d87LhORj0RkZFSZn4rIXR3Uf46IfOxt54T72yQHETlXRG7rpMwgEfkgVTaFjYkmGPWqOkpVDwC2AxdFXZsCvOH9RFUbgB8Bd4hjT6/8VW1VLCK9gWuAccAhwDUi0iu038SIGxNN/LwODAEQkXJgPPA94NuRAqr6IrAKOBu4GZimqhvaqe8EYLqqrvfKTAcCvVEYi+cF/iEiszzvdU3UtadEZK6ILBSRC7xz54vIH6PKfF9Ebm6j3vNEZImIzAYOjzp/v4h8M+q4ro17XxORUVHHb4jIVxL5PVONiSYORKQIOBFY4J06DXhRVZcANSIyJqr4j4Brgb6q+mAH1e4JfBZ1vNI7F9v2zV4XMXZr04PhvNY3gAOBySISeVPxfFUdA4wFfigilcBjwKkiUuyVOQ+4L6b9/sCvcGIZDwzv4Hdqi3uBc726hgJlqvpewDrSStoWqs1SuojIfG//ddwXAFyX7BZv/xHveC6Aqn4hIjOAZ5NhgKr+OOAt01W1BkBEnsB90efghPJ1r8wAYF9Vfduz9RQR+RAoVtUFMfWNA2ap6lqvzkeBoQHseRz4pYj8FDgfuD/g75N2TDTBqFfVUdEnvFhkIjBSRBQoBFREfqo7X1Zq8baO+Bw4Oup4L2BWbCGvuzShjfsfUdXr2jgf+8KUisjRwLHAYaq6VURmAWXe9XuAnwMfAX/uxOZYmvB6LyJSAJTsYoxrbzrOO38LGBNbJtMx0STON4EHVfXCyAkReRU4AngtQD0vAb+LCv6PB34WWygOT3OcJ+x64HTc/+57Ahu8L/D+wKFR9f9bRAYAo3Fdulj+Ddzidec2A5OBSPdqOU4EjwFfA4rbuB+cMJ8BXu8gxstYLKZJnCnAkzHn/u6d942qrgd+A7zjbb/2ziXKbM+e94G/q+oc4EWgyOuCXQe8HXPPY8CbbX2hVXUVMA14C3gT+DDq8p+Ao0TkPeAwYEtbBqnqXJzggnqyjMBed85hRORcYKyqXhLwvmeBm1X1lZDs2gPX9dxfVTvrtmYc5mmMHYhITxFZgovdwhLM2bgu3tXZKBgwT5NyvBECsannbao6Lh32GMEx0RhGQLKuezZp0iTFpVFtsy0ZW2CyTjTr1tk83kZ6yTrRGEa6MdEYRkBMNIYREBONYQTERGMYATHRGEZAcnOUc001VM+E2lVQ0R+qJkBlVbqtMnKE3PM0NdUw7wHYsBw2LINF/4DnfgJLZ6bbMiNHyD3RVM+ElmZYswi2rIdtdbB+Obx4pQnHSAq5J5raVVD7BbS0OG+zZTU01cPWGpj1O+eJDCMBck80Ff2hbi3Ufglb18LW9U4w27fAuqXw3mPpttDIcnJPNFUToKAQNn4KjQ3Q3Oy8TksTbNsMC59Kt4VGlpN7oqmsgq9eBi3bQJtBG4EWF+doi+ueWRfNSIDcEw3AkAnQtTcg3onIKPAWoBFeuDptphnZT26KBqD/V0Ck7WtLX7BMmhE3uSsnyFs5AAAgAElEQVSacReDdPDr/f2C1Nli5BS5K5ohE2D3tqbt8qhfA6/dlDp7jJwhd0UDMPGXHV9/42ZLChiByW3RDJkAJd3bv759MzwwOXX2GDlBbosGYHwns7huqoY/ju24jGFEkfuiOfJyGHpqx2U2fgy3jU+NPUbWk/uiAfjOQ9BvRMdl1i2Au45LjT1GVpMfogE4/trOy6yaDX85K3xbjKwmf0QzZAJ07dd5uSXPmHCMDskf0QCccTe+XlY14RgdkF+iGTIBzvobO8ekdcCSZ+DPp4dukpF9pFU0IjJARGaKyCJvleHLQm90yAT42u3+yq6YaVk1YxfS7WmagJ+o6nDcEnY/EJGgqwUHZ/RUOHCqv7LrFsBvB4Zrj5FVpFU0qrpKVed5+7W4peh2WQY8FM64AyZe469s0yaY1tNGRhuAj/VpRORJOliSQFXPSIohIoNwC7seoKqbY65dAFwAMHDgwDErVqxIRpOOv5zl4he/jLsETvSRvjayBR8BbswNPkRzTFTl/wtcFH09GcvMiUg58Cpwrao+0VHZsWPH6pw5cxJtsjW3jXfdML8MPdU9MDVygeSLplVhkXdV9aCgjXRSZzHwLPCSqnY6Vj8U0YAbDbBqdoAbiuDS2TYJYfYTWDRBY5q4Vo5qDxER4F7gQz+CCZULp8PeEwLc0AS3jrZ3cvKQTkUjIt0jG1AoIhUx5xLhcOC7wEQRme9tJyVYZ/yc95T/rFqEGb+C3w+x93LyCD8xzWc4DxPtxiLHqqopzceG1j2LZt7D8PTFwe+zJEE2EkoiYC9VXRm3SUkmJaKJEDjOARD38HR0QI9lpItQYpqn4zAkN7hwuvMegVDnpX6dmsdNRurxI5rASswpTrwWpm0CSoLd11IH03pYoiAH8dM9WwO0+1BCVS9PtlEdkdLuWSxxddc8DpzqRiEYmUYo3bN6YGEHW/5w4XT/Q29ief9h+N0AG4qTA/jxNPNUdXSK7OmUtHqaaG4cCXWfxndvvxHuTdIhQZ4LGSERiqdpjsOQ3OeKBXEkCTzWLISHTof/GWOeJwvx42n26Oi6qn6RVIs6IWM8TTSv3eQecsaFQL/h5nnSRyjPaT6k7YebvYG+qloYtNFEyEjRRFg6E/4yFVq2xHd/UVc46UZ7xpNakt89U9Vhqjrc+zkMOB54BagDrghuYw4zZAL8vy+CD8WJ0LTVPeO546vWbctgfA/YFJHBInIP8DIuazZcVW8OzbJs5ow73LOdziYpbI9IzHN9lRvSY2QUfgZsDhORB4FngDeAEap6p6puD926bOc7D8HX7oCS3vHdv3UdPP0DuP9rNiA0g/AT0zQDn+GG0zTFXs+rh5uJMO9hmD7NLfERDyUVsN/JcPSV9g5PcgklEfC9jq6r6r1BG02ErBVNhJpqeOtOmHMfbfwf1AkFUFQCvQbBYT+0hEFyCP3NzTIAVW0I2lCyyHrRRPPn0900UfFS1AX2HANHXGHp6vgJ581NEfm+iHwCrAZWi0i1N9mFkQjnPQWXzoMR3yKuiYGa6uGz2fD38+H5Ky3uSRF+EgE/A74JTFLVnqraEzgR+Lp3zUiEyiqY/Cc46wnYfVQbBdp7DOb9BykCDXUw/69w/8nw8GRLV4eMn5hmMTBKVetjzncF5qvq0BDt24Wc6p61x9KZ8PI0+PIDd6wt7FzWHbyXZr39IqAZCkuhx16wrdYJafhpMO5CSxp0TuDumY/ZwNFYwXgnt4pIS9AGDR8MmeC2pTPh7dvhszmwbSOuYxAlHinyBCVQWAzba921sl6w/E2o/dI9MG3YDN33gIPOttgnCfgRzSoROVpVZ0WfFJGjcDGOERYR8YAb3/bGzW6dUAQo9LTTAgUlUFTmzheVQklX2LQSGjZCQTF06Qmfvwsr58BRV1nWLUH8dM9GAk8BM4G53umxwNHA6aoaYJa9xMmL7ll7RNLVHz3nHnyKOm/TtRKaG4ACKO8DLS1Quwq69HJepscesGUjbPkSWhqhvB/0Pwj2PQ6qJuR7Fy6clLOIdMFNtRRZg28R8KCqbg3aYKLktWhiiYho8dPQolDWAwoKoXErNG0DxMU3UuhEpADNUNwFmpuhS3dXrmsl7Ht8vsZA4T6nyQRMNG0QiX2+XAhdesOg8bDiDdj4GfTYE9YvB21y8Y/iumzNDSAFUNoDtm9x1wtLYc/R+fbcJ5QRARtoe2bNyLxncQ6sig8TTQfUVEP1TKhbDVs3weJnoLgbbFwOFDhhFJVBcyOo7hRK83YoKAIESspdd+643+aLcELJnr0J9AP+BjwCfB60kY4QkfuAU4A1qnpAMuvOOyqrWnev9hgF//rjzuOiMuddwMu6FYA2u3OFxdDSBIVF0NwE7z6QL6IJjJ/3aU4BTgA2APcB04HvARWqmoxXoe8HJiWhHiOW0VNhyiMw7AwnioJS51kAaHECaWnZmbqWQpd9A6j9wnmu2ffAK79xP23EAeBz7IaqblDVPwHHAX8CfocTTsKo6mvA+mTUZbRBZMTBiTdAr71doqCkwnXbpMgdo9DSDMVlUNzV3VdSAfMegO117hnP9jp3bMLx1T1DRA4BpgATgLeBycCs8Mzapf3oRZ1S1WxuMXpq6+czS2fCa9fD5/NcGrq0O3Tp67JppeXQe7BLWZf1cOUjP6tn5mOGrRWdikZEqoFaXDzzPaDRuzRSRFDV90O0DwBVvRu4G1wiIOz28oLIg9NI2nr5a9DUAH2HwriLXfattKL1PaUVLnWd5/gaEYDLnp0MnMSuE2wcGYJdRqqorIJTbtj1/PpqN44t4mHAHZfvvmvZSNaudhVU9M/5B6adikZVfa0JLiITVXVG4iYZGUHVBBfDgPMw22qhfgMMi5n3oKbalevSy8U+22rhjVugR3+XhctBESVzdecb47lJRP4KvAXsJyIrO3tT1EgRlVUw+mz33KZ2lfs5+uxdv/zVM3fGPlLgYqL11bBqQc4mEHwlAnwS1+oCqjoliTYYyST2uU9b1K5y4oiwbokbINq83YkoBxMIyfQ0FqDnIxX9XZcsQsMm900ojVpZsrTCjVLIEZIpGiMfqZrgYp2GTe4BaVGJeyWh7347y7SXQMhS/LzufLDPuj5L0BYjG4mNffqNhMohUFjiRNSwyYmqKneG5PiJae4COl1qQ1VPS9wcIyuJjX2iU9Dlu7uMW47EM5DcRIBhOPwkELIYP6IZLCJPtHdRVc9Ioj2GkfH4Ec1a4PawDTGMbMGPaOpU9ZXQLTGMLMFPyjnOhSUNIzfxI5oZIrLL034R6SUid4Vgk2FkNH5E8xVgroiMi5zw3m95F/g4LMMMI1PxM8r5fBE5ArhbROYBw3BdtvGqujJsAw0j0/D7nOZd3AQbkXHhl5tgjHzFzzCaKcB7uFloqoBvALeIyH0i0idk+wwj4/Djac4CjlXVZd7xbC+++QEwGxgclnGGkYn4iWlObuNcC3CriDwWilWGkcH46Z79IWr/kpjLv0u6RYaR4fhJOUeP6T4/5tpBSbTFMLICP6KRdvYNIy/xkwgoEJEKnMAi+xHxtLcgpGHkLH5EUwksZKdQFkVds3kBjLzDT/Zsr1QYYhjZgp9paffo6LqqfpE8cwwj8/HTPXsF1w2LnY62N9AXi2uMPMPP+jTDVHW493MYcDxOSHXAFYkaICKTRGSxiCwVkasSrc8wwsb3vGciMlhE7gFexiUGhqvqzYk0LiKFuFepTwSGA1NEZHgidRpG2PgZETBMRB4EngHeAEao6p2quj0J7R8CLFXVT7z6HgFsKigjo/ET03yAmwjwaeBA4ProFzlV9fIE2t+T1pMMrgTGxRayRZ2MTMKPaC4I3YpOsEWdjEzCz3Oae/1UJCJ/VNUfBWz/c2BA1PFeJHn1aMNINsmcYTOeFdHeAfYVkX1wYvk28J1EjFi2to43qmv4clMDu/UoY3xVJfv0LU+kSsNoRVqnpVXVJu91g5dwz3vuU9WF8da3bG0dP318PnM+3dTqfHkRfPDbXV4LMoy4SPtSG6r6vKoOVdUqVb02kbp+8+wHuwgGoK4JBl31XCJVG8YOkimatL828O9lGzu8bsIxkoGf5zS/8VnXbQnakjCNzS2dljHhGInix9P4Cgb8ZtnCpGeXYl/lBl31HMN+buIx4sOPaApFpEJEure1hW5hAM49zP+Dz/oW8zpGfIhqx88KRWQb8CW7jnIWQFU1pY/ox44dq3PmzGn3ejxCsOxaXhM4FvfjaRap6kBVHRC1RY4zbkzL8uuCf/kj2bWL7n87BIuMXCPtKecwiEc4AC9+VGNdNqNT/Iim3ayYiNyYRFuSyvLrTqZHSXz3DrrqOROP0S6dxjQd3izyaabFNLEsW1vHhD+8Gnd7BcAncXouIysIJaZJaoOpZp++5XF31wBaMM9jtMbPw83e7WyVZIFoIiy/7mQGdE9sqJ2JxwB/Kedl7DqxRgRV1ZSuGhC0e9YWyfriP3jewRyxX7+k1GWkjcD/8ScU06SDZIgmQrLE06ME3vu1xT1ZSvJFIyKjY04psE5VP2urfNgkUzQAv316Aff8K3kLWCcSPxlpIRTRzGzjdG+gBJiiqvODNpoIyRZNhDNufZV5n9clrT4TT9aQuu6ZiIwFblLVeN7YjJuwRBPhpJtmsGhNfdLq+4+vDuQXXxuZtPqMpJPamEZE5qlqbPctVMIWTYRke57h/brw/OUTk1afkTRS6ml2A55X1TFxVRAnqRJNhMdnr+CnT3yQtPr6dCvmv07Yj8mH7J20Oo2ECCWmuZVdl9ToDXwVuExVnwnaaCKkWjTRJPsZzeRRu3PDt1P6f46xK6GI5pyYUwrUAO+o6pqgDSZKOkUTYehVz5GM6UUjfHVwL679+oE2a056SGn3bADwbVW9Ia4K4iQTRBPhrLve4I1lu07kES/diguYdupw67qllnBFIyJ9gcnAFGAP4ElVTXjlgCBkkmgiJDvuAdh/t25cfdJwG3EQPqF0zyqAM3CT+A0FngDOTNcKaZkommjGTHuOmobk1Teod1d+cPRg8z7hEYpo6oHZwC+AN1RVReSTRMecichkYBowDDhEVX0pIdNFE+H1xWv49TMf8PG65DzzGdynK786dYR5nuQTimh+hJsuthvwV+BRYHoSRDMMN/L+LuCKXBNNNBfd/zYvflSTlLoKgLKSAkbu0YNLJgwxESVOeDGNiAzGiWcKsC9wDS6mWRK00Zh6Z5Hjoonw+uI1/OiRudTUdz4/W2cUCvTqWsJ/nTDUum6JkZrsmYgcgBPPmao6JHAFreuaRSeiiVmfZsyKFSsSaTIj+Okjc3l8/uq47hVc3r+4AEqKCtmnTzcG9enGmWP2Ms8TnFC6Z4eqalzTtIjIy8DubVy6WlX/4ZWZRZ54mvYI2n0rFGhW99cuEigrLqB2+07v1aNLEReOH8TFx+wXgrU5Ryii2TG+TETeUtXD4jSuvfpnkeeiifD47BX839ufsmT1Zra304MTb/PTwdu9opgbvjnKvE/HBBaNn/d/oystC9qA4Z/Jh+y9Iz55ffEabp3xMe+t3Mi25p1llJ1jmiLvqrcnoNW1jXz3z+/Qo6yIifv35YfHDLVRB0nAj2gKRKQX7m8U2d8hJFVdH0/DIvJ14FagL/CciMxX1RPiqSsXOWK/fjs8xOOzV3DrzKWs3NBACy6WKS4sQETYur2544qA2oYmnnl/NQu/2MwvT7YHponip3u2HPefWc7MEZDNRFZ6m129jteXrqNuWxNNnfTVCoAuxQU0NrfQtbSILsVFdCst4vCq3px7+D757n1sjoB84vHZK7juxY+o2drUYbniQqFIlPomKC0UenUroaK0iLrtzYwZ2JOfHL9fPgsn+fOeichZUfuHx1y7JGiDRvKYfMje/O0/D2fifpUdlistKiDSiystLqRFoVtpMRWlRSxdu4U3qpPz4DVf8DNZ4OVR+7fGXDs/ibYYcbBP33LuO+9QZv7kKE77yu6Ul7T+k5YVCqouRV1cACWFQnGhK1NWUsjWbU18uckNllu2to4H317BjS8t5sG3V7BsbfLeXM0lgmbPYl1Z1kwWmOvs07ecW6bsfKEtkjxYvXkbBSg9yoqQAlCEijL3Z2/Y3kzX0iJ261HGsrV1PDpnJT27FLN7jzLqGpp4dM5Kzhy7Vz533drEj2i0nf22jo0MIZK+jk4czF62HikQRGDLtsYdMc34qkreqK6hZ5diunuryUV+PjX/c/pUlNkS81H4yZ5tBZbivEqVt493PFhVu4VqYQyWCIif1xev4d43l/HJuq2UFBVw+OCd2bMbX1rM7j3KKJCdnYc1m+t5bck6jh+xO+VlRdQ1NLGxvjHXvE8oDzeHxWGIkYFEP/uJZTevS9Y9at3SRatq6dO9tJX3WV+3jT9MX8Kgym5563k6TQSo6gpVXQFsAvp528ao80YOML6qko31jWyub6RFlc31jayr28aI/hU7yqyrbeDDL2up2bKN3XuUscWLe/ItYdCppxGRUtw7L6cDy3DubG8ReRK4SFWTOceEkSb26VvOmWP34o3qGlZ78cuR+/ahtGjnV2Tp2i0UitCrwnXj8tXz+Ome/QIoBgaoai3seAX6duCX3mbkAPv0LW/1hY9k1ADKy4pYV7uNwgJhSF8XxkY8T1NLC4cOrsybjJuf5zRfB74fEQyAt3+xd83IUSLep1tZEas3NdC7vIRh/SvoU+7G7UY8T98oz9OzS3HOPyz142laVHVr7ElVrRMRSznnONHeJ+J5Ntc3tul5wHmk1ZuSOLNIBuLrOU3syOYoEn9v18gaYuOe3uUl7NGjbIfnAahraGK3Hrn9Bokf0fQA5tLOKOfkmmNkOh15nshznBNG7JZmK8OlU9Go6iA/FYnICFVdmLBFRtbQVsbthBG75XQSAPx5Gr88CKR02Q0j/cRm3PKBRJdEj8YGbxp5QTJFY/GNkRf4Eo04BoRtjGFkA75Eo24o9POdFLPhNEZeEKR7Nk9EDm7voqoemgR7DCPjCZI9GwdMFZEVwBa82VFV9cBQLDOMDCWIaGxOMsMggGjs3RnDcCQz5RwIEblBRD4SkfdF5EkR6ZkuWwwjCGkTDTAdOMCLiZYAP0ujLYbhm7SJRlX/qaqRqSHfBtKyhqdhBCWdniaa84EX2rsoIheIyBwRmbN27doUmmUYuxLqXM4+F3W6GhgLnKE+jLEpnIwkE8oUTnGjqsd2dF1EzgVOAY7xIxjDyARCFU1HiMgk4ErgqLZepzaMTCWdMc1tQAUwXUTmi8idabTFMHyTNk+T6KrQhpEuMiV7ZhhZg4nGMAJiojGMgJhoDCMgJhrDCIiJxjACYqIxjICYaAwjICYawwiIicYwAmKiMYyAmGgMIyAmGsMIiInGMAJiojGMgJhoDCMgoU6sEQYishZob7bPPsC6FJqTLdjn0jZ9gI9UdVKQm7JONB0hInNUdWy67cg07HNpm3g/F+ueGUZATDSGEZBcE83d6TYgQ7HPpW3i+lxyKqYxjFSQa57GMELHRGMYATHRGEZATDSGERATjWEExERjGAEx0RhGQEw0hhEQE41hBMREYxgByXnRiEizt9LaByLyuIh0jbp2uoioiOzvHZeJyEciMjKqzE9F5K4O6j9HRD72tnPC/W1yExE5WkS+GnV8kYicnU6bOiLnx56JSJ2qlnv7DwNzVfUm7/hRYA9ghqpe452bBFwNHOldew0Yq6ob2qi7NzAHtzq1AnOBMW2VNdpHRKYBdap6Y7pt8YWq5vSG+2NE9i8C7vD2y4HPgaHA4ph7HgPO8X5+t4O6pwB3RR3fBUxJ0N5zgSeAF4GPgetj2lsAfAD8vp37Dwb+BbwHzMata1oG/Nm7911gQkdtAYXA/V47C4Afe+dn4f4DAffW4/Koep4CpgPLgUuAy7223gZ6R91/CzDfq/sQYBCw2vtbzAeOAKYBV3j3jPLqeB94EugVVdfvvd9xCXBEqr5TaVtzM9WISBFwIu4LAnAa8KKqLhGRGhEZo6pzvWs/wv0xPlbVBzuodk/gs6jjld652LZvBia0cf8jqnpdG+dHAQcB24DFInIr0Iz7kowBNgD/FJHTVfWpqHZKgEeBM1X1HRHpDtQDlwGqqiO9rug/RWRoB231A/ZU1QO8ent28BlEOMCrpwxYCvyXqh7k/e5nA3/0ynVV1VEiciRwn6oe4C1SvMPTiMgxUfU+AFyqqq+KyK+Ba3B/H4AiVT1ERE7yzh/rw86EyQfRdBGR+d7+68C93v4U3P96AI94x3MBVPULEZkBPJsMA1T1xwFveUVVNwGIyCJgb6ASmKWqa73zD+O6kE9F3bcfsEpV3/Ha3eyVHQ/c6p37SERW4Dxse20tBAZ7AnoO+KcPm2eqai1QKyKbgGe88wuAA6PK/dWz4zUR6d6RIEWkB9BTVV/1Tv0f8HhUkSe8n3NxHisl5INo6lV1VPQJLxaZCIwUEcV1R1REfqq6I8hr8baO+Bw4Oup4L1y3oRVxeJptUfvNhPt32qUtVd0gIl8BTsB1ab8FnA80sTN5VNZBPS1Rxy20tj82iE4kqI60EfZn1Iqcz561wzeBB1V1b1UdpKoDgGW4/nQQXgKOF5FeItILON471wpV/bGqjmpja0sw7TEbOEpE+ohIIc4zvhpTZjHQX0QOBhCRCq9b+jow1Ts3FBjolW0TEekDFKjq34FfAKO9S8tx3UNwn2E8nOm1MR7Y5Hm5Wlzs1Qrv2gYRifxdvsuuv3PKyQdP0xZTcPFBNH/3zr/mtxJVXS8ivwHe8U79WlXXJ8fEXdpaJSJXATMBAZ5T1X/ElNkuImcCt4pIF1w8cyxwB/C/IrIA5y3OVdVtItJec3sCfxaRyH+qP/N+3gg8JiIX4Lpt8dAgIu8CxTjvBa4r9zcROQ24NKb8OcCd3qOCT4Dz4mw3aeR8ytnIHERkFi4rNifdtiRCvnbPDCNuzNP4wBshEJt63qaq49Jhj5FeTDSGEZCs655NmjRJcWlK22xLxhaYrBPNunU2j7eRXrJONIaRbkw0hhEQE41hBMREYxgBMdEYRkBMNIYRkNwdsFlTDdUzoXYVVPSHqglQWZVuq4wcIDc9TU01zHsAttdB9z3cz3kPuPOGkSC56WmqZ8KWdfDJq1C/Ebr0hN1GuPPmbYwEyU1Ps/xfsPw1aGqALr3cz+WvwYq30m2ZkQPkpqdZXw0FJSACW9dB83ZoaYLVH6TbMiMHyE1Pg0JzI2xZC9oEUgCq0LDe4hojYXJTNJVVUFAIBcXQtB0a60GbQQrhvcfSbZ2R5eSmaA46Gxq3QmEptLQ4r9NYD0WlsPg58zZGQuSmaIZMgOGnwbZaaNwCjQ3Q3AQbV8CXi+Afl6XbQiOLyU3RAIy7EEq7QWE33LRYipvEBfjsTXjtpjQaZ2QzuSuayirovic0bmaHWABoAW2Bf92aLsuMLCd3RQMw+EgnEATnaVrY8YZrw3qY93D6bDOyltwWzchvQVEZu3TPIrx4pQnHCExui6ayCsacH3Uieh4Fge1b4MWrTDhGIHJbNAAnXgv9RrhnNK3wJiPZvhme+wksnZkO64wsJPdFA3D8tS4pIO2MGmquh6d+YM9vDF/kh2iGTICjrnJj0dqj7nOYEWQSfyNfyQ/RAIyeCiO+0XGZD5+0+MbolPwRDcDRV0LJLsug7KSlEZ6+GP5yVupsMrKO/BJNZRWMv5xOf+0lz8ATF6fEJCP7yC/RABx5OYy7uP2kQIT3H4bnr7TkgLELaRWNiAwQkZkiskhEFopIakZSnngtnPo/UFLecbnZd8FdEywdbbQi3Z6mCfiJqg4HDgV+ICLDU9Ly6Kkw6frOy23fBA99yzyOsYNOX3cWkSfpYEkCVT0j3sZVdRWwytuvFZEPces9Loq3zkCMngpv3wFrOnsNeju8cDWc9UhKzDIym04XdRKRYyK7wP/ilsjegaq+khRDRAbhFok9QFU3x1y7ALgAYODAgWNWrFiRjCYdNdXw17Ng3Yd0ulxJYSmM+CaccUfy2jfSTQcP79q5IchKaCLyrqoeFLQRH/WW45a6vlZVn+io7NixY3XOnCSvc1pTDW/dCXPu9le+uBxOvN55KiPbCSyaoDFNXCtHdYSIFOOWI3+4M8GERmUVnHID7D3BX/nGOnuek8d0KhoR6R7ZgEIRqYg5FzfiFrK/F/hQVdP/KuV5T0HPff2XX/KMi3WMvMJPTPMZu76MEjlWVR0Yd+Mi44HXgQW4N8QAfq6qz7d3Tyjds1heuwn+dQs0bPR/T/9D4MLp4dlkhEXyYxoR2UtVV8ZtUpJJiWjAxTkPT4H1i/3fU9Qd/nOWTX2bXYQS0zwdhyHZT2UVTP0r9AgggKbNcPsh8Jcp9lwnh/EjmsBKzBkqq+DH82Doqf7vaWmCJc/DvcfbiOkcxU/3bA3wUHvXVfXyZBvVESnrnsXywtXw7zvYGXr5ZOip8J12Pz4j/YTSPasHFnaw5QcnXgvTNsDEa4Ldt+QZuPtY667lEH48zTxVHZ0iezolbZ4mmnkPu+c0QSgshd0OgIm/dG+SGplCKJ6mOQ5DcpvRU2HaJud1irr5u0db4MuF8MKVNmo6y/EjmtNEZI/2ttAtzGSOvBx+8YU/8RQUQmEhNGyCdx9IjX1GKPhZ1OkV2n642RvoC8TOjZR/HHk5jDjNDaupaWOAthQB4pb+aGl08c3se9yKbeurAXWZuoPOtq5bFtCpp1HVYao63Ps5DDgeJ6Q64IqwDcwaKqvg0rfgwKkgxVEXCry1crz1chRoqocv3oUv3oHa1U5EH0+Hv51nE7NnAb4HbIrIYBG5B3gZlzUbrqo3h2ZZtnLGHXDJv2HEt6CwzE0bVVDoEgHN26CgCAYc6uKb5hY3WaEbkATbt8Ksa+Guo2HWf1vGLUPxkz0bBvwcGA3cADykqk0psK1NMiJ75pelM+G162HdR87D9BsOFf1h78PgzVuhYeMzuHAAACAASURBVINboU3FLUJVUOjW0Snv58oVlbhVqfsNh6oJNjwnHAJnz/zENB8An+GG0xwIXC9Rk+6l+uFmVjFkwq4xyux73GJTXXpC3Wq3Olvztp1/uqISJ6Btm6Cx2C3pvr0O5j0Ao8824WQAfkRzQehW5BNVE5wAdhsBaxe7VdrUG2WgLVDSzfvZ1Xmd7bVQ1sNdr55poskAOhWNqt4b2ReRMu9cQ5hG5TSVVc5jVM+E9cvhi7k4N1MExWWuTGl3150rKHL7AKUVULsqPTYbrfDjaRCR7wM/w6WZEZEa4Peq6vP9YKMVlVVuO+Q/XNzz9u3wxXyXDKisckuAbKuF7v2h737unm21UL77zjpqqp3wale5+MdinpThZzaanwFHA5NUdYl3bihwi4hUqup/h2tijhOJe2qq3XLtX8wBKYDSctjrYOha6R6I1m+AYd5o65pq18Xr0gu67+EEZTFPyvCTPVsMjFLV+pjzXYH5qjo0RPt2IauyZ4kQ8SR1q52HifYks+9xyYFIrANOWCXlznsZQQgle6axgvFObhWRgOPkDd9EunBtUbvKeZhoLOZJGX4ebq4SkaNjT4rIUcDqpFtkdE5Ff9cliyY25jFCw4+n+SHwlIjMBOZ658bi4pzTQ7LL6IhI2hqch9lW2zrmMULFz9izBcABwGxgf2+bDYz0rhmpJpK2Lil3XbKScksCpBBfKWcvprH0cibRUcxjhIqflPMG2p5ZMzLvWe+kW2UYGYyfRMCbwFLgOmAU7h2avkAf72dCiMh9IrJGRDqbut8wMgI/Mc0pwAnABuA+YDrwPaBCVZPxKvT9wKQk1GMYKcHX+zSqukFV/wQcB/wJ+B1OOAmjqq8B65NRl2GkAr9jzw4BpgATgLeBycCs8MwyjMzFTyKgGqgFHsF5l0bv0kgRQVXfD9G+iA3RizqF3ZxhdIgfT7MKlz07GTiJXSfYODIEu1rhjaa+G9zYs7DbM4yO8PM+zXg/FYnIRFWdkbhJhpHZJHN15xvjuUlE/gq8BewnIitFJCkJBsMIC1+JAJ/EtbqAqk5Jog2GETrJ9DQWaxh5QTJFYxh5gZ+Fag/2WddnCdpiGFmBH09zl5+KVPW0BG0xjKzAumeGERA/2bPBIvJEexdV9Ywk2mMYGY8f0awFbg/bEMPIFvyIpk5VXwndEsPIEvzENJ+GboVhZBF+RDNDopcJ8BCRXiLiK7NmGLmEH9F8BZgrIuMiJ7yh+u8CH4dlmGFkKn5GOZ8vIkcAd4vIPGAYrss2XlVXhm2gYWQafgdsvoubYCMyG93lJhgjX/EzjGYK8B7wOVAFfAO3YsB9ItInZPsMI+Pw42nOAo5V1WXe8WwvvvkBbqbNwWEZZxiZiJ+Y5uQ2zrUAt4rIY6FYZRgZjJ/u2R+i9i+Jufy7pFtkGBmOn5Rz9PLE58dcOyiJthhGVuBHNNLOvmHkJX4SAQUiUoETWGQ/Ip7C0CwzjAzFj2gqgYX/n70zD5OivPb/53TPzsAAwwAiizAogrghLklAxS0as6g3xmiMMd5EvblGjVGviSYxiSZGjZpovGo0uZH4U2PirtEoooIGERAFUZRVUZZhgGF6mK1nzu+PqpZmnKVquqqX6fN5nn66uuqt9z008+1z3lPvwk6hLEu6ZusCGHmHl+zZyHQYYhi5gpdlaUd0d11VPw7OHMPIfryEZ7NwwrCOy9EOxtmfxvo1Rl7hZX+aiao6yX2fCByHI6QYcGmqBojI8SKyXERWiMgVqdZnGGHjeWENERknIncDz+MkBiap6s2pNC4iUZyp1CcAk4DTRWRSKnUaRth4GREwUURmAk8Ac4F9VPUOVW0JoP1DgBWqusqt7wHAloIyshovfZqlOAsBPg7sB1yfPJFTVS9Jof3d2XWRwXXAoR0L2f40RjbhRTTnhm5FD9j+NEY24eU5zT1eKhKRW1T1Yp/tfwSMSvo80j3XK1bXxJi7spaNdU0MqyhhWnUlY6vKe1udYXRKkCts9mZHtNeBPUVkrIgUAV/HCQN9s7omxoML1tHQFGd4RQkNTXEeXLCO1TWx3lRnGF0S5P40vlHVuDvd4Fmc5z1/UtW3e1PX3JW1DCwtZGPdDp5aso26xlbKigrY0dzKL07aN1C7jfwmo6IBUNWngadTrWdjXRP1jS3MereGddsaPzn/7oZ6Hlv0AW/+4lNz6QyjVwQZnmV02sCwihJeW7N1F8EkqGuBPa54isseWJgBy4y+hpfnNL/0WNdtKdqSEtOqK9m2o/tHRw8t3sAeVzyVJouMvooXT+MprvGaZQuLsVXlTNytv6eyJhwjFbyIJioi/UVkQGev0C30wTmfHeu57B5XPMU1jy8J0RqjryKq3T8rFJFmYCOfHuUsgKpqWh/RT506VRcsWNDl9f1/+hR1Pgf4rLnOkgR5jO++uBfRvKGqWbOARk+igd6FX8P7RZj3kxN6a5aRu/gWTZ/cPrA3nmNDQzt7XPEUc5ZvCsEioy/hRTRdZsVE5MYAbQmU3oZc3/zz65YoMLqlx/Cs25tFPsi2Pk1HUhFABFhl/Z2+TtrDs6xfB23NdSdSWdK7e9txRGeex0jGSyJgcFeXgDfTvVqNX0+TTBB//JZp63OEkj1bzacX1kigqprWXQNSEQ3AZQ8s5KHFG1K2Y+a3D2b6hKEp12NknOBFk22kKpoEk696ilg8dXuO37uSO84+LPWKjEwRiqeZ0uGUAptV9cPOyodNUKJJEFR/pbIEFl5toVsOEopoZndyejBQBJyuqov9NpoKQYsGYM7yTXzzz68HUtd3Pjuaq75s83dyiPSFZyIyFbhJVXszY7PXhCGaBA/NX8tlDy8NpK79Rw7g0mMnWL8n+0lvn0ZEFqlqx/AtVMIUTYLz/28ez7xbG0hdBRH49UmTOfWQMYHUZwROWj3NMOBpVT2oVxX0knSIJsHqmhgzfvtSIHVFgOMsaZCNhNKnuZVPb6kxGPgscJGqPuG30VRIp2iSGX/FUwSQbKO0QPja1FGc/bmxtlJOdhCKaL7V4ZQCtcDrqpr20Y2ZEk2CIJ7zRICyoijHThrKhUfvZeLJLGkNz0YBX1fVG3pVQS/JtGgSpCqeCFAQFfYa1p//+bwlDDJIuKIRkSrgVOB0YATwiKqmvHOAH7JFNMkc9st/sqGh3XN5cV8FUUChXaEgGqGoIMLE4f25YMZ4E1H6CCU86w+cApwB7AU8DJyWqR3SslE0CVbXxDj5tpfY1tx9OUl6tbnvEfcYoEBgn90tZZ0mQhFNIzAfuAqYq6oqIqvSPeYsQTaLJkFiedw/PP8uGzoZqyNANALt7c5IaiFp/jiOgIoKI4wYUML0PYfQv7TIltkNj1BEczHOcrH9gPuBB4HnUhWNiJwKXA1MBA5RVU9KyAXRJLO6JsafX1nNU0s+ZkuDI6DiqIAIzXEnpBN2ikdkp6iKohGKCqNU9ism3tbO4H5FXHz0nuZ9giW8Po2IjMMRz+nAnsDPcPo07/lt1K1vIs7fyp3ApX1VNMnMWb6JW194n3c2xGhTRVWJt7XT1r4zpy8CEXG8jQIREaqHlqMKseZWhg0o4Yav7m8eJzh8i8bzsrSqugr4FfArEZmMI56ngfF+G3Xrewcgea+bvs70CUOZPmEoq2tiPLr4I55c/BEf1TXS7iYDAFCIRgVBaNN2igujFEWdbU1FoDbWwtyVtSaaDOJlhc1PPcJW1aWqeqWq9kowfhGRc0VkgYgsqKmpSUeToTK2qpwfHDuBu88+hK9NHc3AMue3S3BCt6H9i1EUVajsV7jLvdGIsLGuCXBCv5nz1nLjs8uZOW+t7ZCQJrz0aT4ZXyYi/1bVz3iuXOR5YHgnl65U1cfcMi+SJ+FZdyT6Pq+uqqUl3o4ATfE2KkqKKC2KEm9TdrTE2X1gCZ/fdwTTqit5cME6BpYWUl5SQKwpzpraBoYPKCbejiUOvBNKeJZcqa/Z9qp6jD9z8pexVeW7bAmyuibGjf9aztvrt9Pa2E5JYYQBpYWMquzHtOrKT7YWGVDqeKKWeBtrNjewZUcLh+9ZRczdn+e0qSNNOAHjZWGNiIgMEpHKpOPBiVfYBuYrY6vKufS4CXxl/xGMrixj6IBSZkyo4tzp4xhbVc7GuibKS3b+5q2oaWBAWSEt8XYiIrTE21hVE+PqJ5ZZ6BYwXjxNBbCQnR5nUdI1BXqVehaRk4FbgSrgKRFZrKqf701dfZVE36czhlWUEGuKf+Jptje1Uhx1vNHm+iYWrN1KSZEz5KDBvE6geNlzc48wGlbVR4BHwqg7H0j0aQDKSwooikbY1tjK53YfwIpNDZQWFSBARVnRJ8KyrFsweMmenZl0/LkO1y4IwyijZ8ZWlXPa1JH0KylgQ10TE3frz7iqfhRFo2xvbAVVdrS0Mb6qH+AIK5F1M1LDS3h2CfBX9/hWIHmm5jlkeDOnfGZsVfkuniMxfEdRVGDqHgMZUu7kbmJNcYZV9HLVRGMX/GbPOqbn8ufJZA6QEFEidCuKRmlXJdYUZ1tjK5/fZ1imTewTeMmeaRfHnX02soCOoVu/kgJLAgSIF0+zt4i8heNVqt1j3M8ZGels9EzH0M0IDi+imRi6FYaRQ3hJOa8FEJGBOKObAd5T1bowDTOMbKVH0YhIMc7w/ZOA1Thh2RgReQQ4X1V97nBpGLmNl0TAVUAhMEpVD1TVA4DROIL7SZjGGUY24kU0JwPfVdX6xAn3+HvuNcPIK7yIpl1Vd3Q8qaoxLOVs5CFesmcqIoPo/EGm93WLDKOP0JtRzsmYpzHyjsBGOYvIPqr6dsoWGUaWk+ruzsnMDLAuw8haghSNDd408oIgRWP9GyMv8CQacRgVtjGGkQt4Eo066zw93UMxG05j5AV+wrNFInJwVxdV1fbFM/ICz8vSAocC3xCRtUAD7iL3qrpfKJYZRpbiRzS2vJJh4G8B9LVhGmIYuUKQKWdfiMgNIvKuiLwlIo+4k9wMI+vJmGiA54DJbp/oPeBHGbTFMDyTMdGo6r9UNbG33jwgI3t4GoZfMulpkjkH+GemjTAML/jJnvnG4/40VwJx4L5u6jkXOBdg9OjRIVhqGN7xvOdmKI2LnA2cBxzd2ezQzuirmzoZGSO8PTeDRkSOBy4HjvAqGMPIBjLZp7kN6A88JyKLReSODNpiGJ7JmKdJ1ya3hhE02ZI9M4ycwURjGD4x0RiGT0w0huETE41h+MREYxg+MdEYhk9MNIbhExONYfjERGMYPjHRGIZPTDSG4RMTjWH4xERjGD4x0RiGT0w0huGTjK4R0BtEpAboarXPIcDmNJqTK9j30jlDgHdV9Xg/N+WcaLpDRBao6tRM25Ft2PfSOb39Xiw8MwyfmGgMwyd9TTR3ZdqALMW+l87p1ffSp/o0hpEO+pqnMYzQMdEYhk9MNIbhExONYfjERGMYPjHRGIZPTDSG4RMTjWH4xERjGD4x0RiGT/JONCLS5u68tlREHhKRsqRrJ4mIisje7ucSEXlXRPZNKnOZiNzZTf3fEpH33de3ArC3UkRmi0hMRG5Ltb5etH9xh+8o1os61ojIkFTLZAt5JxqgUVUPUNXJQAtwftK104G57juq2gRcDNwuDru75a/orGIRGQz8DDgUOAT4mYgMStHeJuAnwKUp1tNbLgbKeiyVR+SjaJKZA4wHEJFyYBrwn8DXEwVU9RlgPXAWcDNwtapu7aK+zwPPqeoWt8xzgK9ZgR1R1QZVnYsjni5xf6l/7XrRBSIyRUSeFZGVInK+W0ZE5AbXyy4RkdPc80eKyIsi8nfXs97nlr0QGAHMFpHZSW1dKyJvisg8ERnWiS2VIvIvEXlbRO4maQdlETlTROa7dt4pItFO7n9URBa695/rnjtHRG5JKvNdEbnZ7/cZCKqaVy8g5r4XAI8B/+V+/gZwj3v8KnBQ0j0jgHXA7B7qvhS4KunzT4BLOyl3M7C4k9cV3dR9NnBbN9fXJP1bbgbewtkIuArY6J7/DxwhR4FhwAfAbsCRQB0wEueH9N/AtKR6hyS1o8CX3OPrk/+9SWV+D/zUPT7RvWcIMBF4Aih0r90OnNWxHWCw+14KLAUqgXJgZdK9rwL7ZuJvKGMb1WaQUhFZ7B7PAe5xj08HfuceP+B+Xgigqh+LyAvAk0EYoKo/CKKeTnjcfV8ClKtqPVAvIs0iMhDHk96vqm3ARhF5CTgY2A7MV9V1AO73swdOqNqRFnZ+DwuBYzspczhwCoCqPiUiCc98NHAQ8LqIgCOKTZ3cf6GInOwejwL2VNV57v/BF0XkHRzxLOnxGwmBfBRNo6oekHzC7YscBewrIorzS6wicpm6P2tAu/vqjo9wfrUTjARe7FjIDStmdHL/A6p6nZd/RBc0u+/tSceJzz39XyeXb+umfGvSd9Jduc4Q4C+q+qMuC4gcCRwDfEZVd4jIi0CJe/lu4MfAu8CffbQbKPnep0nwVWCmqo5R1T1UdRSwGpjus55ngeNEZJCbADjOPbcLqvoDdZIRHV+pCMYLc4DTRCQqIlU4HmF+D/fU44R5fngZOANARE4AEsmQWcBXRWSoe22wiIzpcG8FsNUVzN7AYYkLqvoajuc5A7jfp02BYaJxOB14pMO5f7jnPaOqW4BfAq+7r1+451JCRNYANwFni8g6EZnUy6oewenrvAm8AFyuqht6uOcu4JnkRIAHfg4cLiJv44RpHwCo6jLgKuBfIvIWTv9qtw73PgMUuCHYdcC8Dtf/BryiXSdjQsemOxs5hYg8CdysqrMyZYN5GiMnEJGBIvIeTp80Y4IB8zS9wh0hMLPD6WZVPTQT9hjpxURjGD6x8MwwfJJzojn++OMV5wmzvewVxMs3OSeazZtt8Xsjs+ScaAwj05hoDMMnJhrD8ImJxjB8YqIxDJ+YaAzDJyYaw/CJicYwfGKiMQyfmGgMwycmGsPwiYnGMHxiojEMn5hoDMMnJhrD8En+LBZYuxJWzob69dB/N6ieAZXVmbbKyEHyw9PUroRF90JLDAaMcN4X3eucNwyf5IdoVs6G0kFQUgEScd5LBznnDcMn+SGa+vVQ3GFl1eL+EOtpcUnD+DT50afpvxs01zseBmDTO7D2FWiOOSHagWfB+M7WIzeMT5MfnqZ6BjRuhaY62PgOvPsUNGyBwjL46A144kJYdF+mrTRyhPwQTWU1TDkLisph9UsQKYSiYmhvhfY4NG+HWVfDCuvjGD2TH6IBRziHfAdKBzovKXDE0ubuytdUB89cbsIxeiR/RJNgwAho3AatTaDtEG+CeDOIQP1GE47RI/knmgPPAm2Dlnpoa4W2uCMaIo6IdtTCi7+yZzhGl+SfaMbPgCOugGgRtDZCextECyESAQRaGuDjxXD/GeZxjE7JqGhEZJSIzBaRZe721xelpeEp34CT74JBYxyxFBQDEWekQLzZSRBsXg5/OwteviktJhm5Q6Y9TRz4oapOwtlb8b9T2BrPH+NnwPHXO2nnSIHTt6GdXdbGbtkOL/wC/nllWkwycoOMikZV16vqIve4HngH2D1tBoyfAfueCiWD6HrjZoXX/gD/73Tr5xiAhxEBIvII3WxJoKqnBGGIiOwBHAi81sm1c4FzAUaPHh1Eczs59DwnJFuyEdpjXRRSeO9pWDUbDr8cDr8kWBuMnKLHndBE5OjEIfC/wPnJ14PY/1BEyoGXgGtV9eHuyk6dOlUXLFiQapO7UrsSHrsQPngFT1uWHHoBnHBtsDYYmUL83tCjp0kWhYjEgt4kVEQKcbYfv68nwYRGZTV85fcw86uwbVXP5V+7zXk34eQlfvs0vdo5qitERIB7gHdUNbNpqspq+OJNUD7CW/nXboPfH2Rp6TykR9GIyIDEC4iKSP8O51Lhc8A3gaNEZLH7+kKKdfae8TPg20/C+BO8ld+yAv56Ely7uw34zCO89Gk+xPEwybFf4rOqasA98+4JpU/TGf+8cmcY5pUxM+Dbj4ZjjxEWvvs0XsKzz6jqaFUdlfRKfE6rYNLKCdfCft/wd8/a2fDnk8Kxx8gavIjm8dCtyFZOuR3OfBQqxnq/Z+1suHECPH25Pdfpo3gRjW/31acYPwN+sNhJM3vNm8Q2wPw74bZD4OHvhWqekX689Gk2AX/t6rqqpvVJX9r6NJ2x6D54/CKg1f+9e30JzujyazQyRyh9mkbg7W5e+cOUb8D3X4PKXgyPe+8JuLrCxrH1Abx4mkWqOiVN9vRIRj1NMrUr4d5Toa6X/RYbVZAthOJp2nphSN+nshp+sAi+fLubKPD53b92G1w9yJ7v5CBePE23j8hV9eNALeqBrPE0HVl0Hzz5Q2hv7MXNETj0e+Z5MoNvT+NFNO/Q+cPNwUCVqkb9NpoKWSsacEK2P38FYh/2vg4L29JN8OGZqk5U1Unu+0TgOGAWEAMu9W9jH6ayGi5d6qane8lrtzkJgzuPDc4uI1A8D9gUkXEicjfwPE7WbJKq3hyaZbnMCdfC9xdB+aje17F+viOem/azh6RZhpcBmxNFZCbwBDAX2EdV71DVltCty2USXuf7iyBS3vt6tq+FW6fAXceYeLIEL32aNuBDnOE08Y7X8+rhZio8/D14K4BMWdkQOOYXzjMjIwhCSQT8Z3fXVfUev42mQs6KJsGi++DJy6C9IcWKLOMWEMGLZpfCIiUAqtrkt6GgyHnRJPObCdAYwHYf5cPhqJ+a9+kdoTzcRES+KyKrgA3ABhFZ6S52YaTC/yyHo36Wej2xDfD49+DqwbZOWxrwkgj4EfBV4HhVHaiqA4ETgJPda0YqHH4JXF3nJAxGT0+xsjZ44edwze42DTtEvPRplgMHqGpjh/NlwGJV3StE+z5FnwrPumLRffD4JUAAUbAlDnoilPBMOwrGPbmDrlfYM1Jhyjfg6o3OuLaiwanVtWOzG7oNhP/7sqWtA8CLaNaLyJEdT4rIETh9HCMspnwDfrzaCd16Mx1hFxTWvOQ887lxgg0UTQEv4dm+wKPAbGChe3oqcCRwkqouCdPAjuRFeNYdL98EL/4G2gMI3aLFUH00fP4a52FsfhJOyllESnGWWtrHPbUMmOmGaGkl70WTIIjBockMGA1f/n0+btgb7nOabMBE04HalfD/zoTaZQFVKDBgFBx5Rb4kD0IZEbCVzlfWTKx7lmJP1R8mmm54+SZ44Vo6Ge3UOyKFMPlrzqo8fZdQRPMkMBT4O/AA8FHydVVNaWaniPwJ+CKwSVUn91TeROOBFbPhiR9A3eqAKoxA1V7wmQv7ovcJrU8zCOcB52k4GbcHgL+p6ja/DXZS9+E4c3PuNdGEQFADRZMZcTD8x519JXkQ+tgzAb4O3Ar8WlV/67fBLurdA3jSRBMitSth5Wx47Z6A+j8Cg8fCtEtz3fuE5mkOAU4HZgDzgAeBFzWgLEJPoumwqdNBa9euDaLZ/CXQ8E1g6CQ47tpczbyF0qdZCdTjhGTP0WGlPFV9y2+jnbSxB+ZpMsOi++DpKyC+PYVKItB/GMz4SS56neA3dQLW42TPTgS+0KERBQ7326iRRUz5hvNadB/Mvws2LPZZgQAKbXF4+Tew/QPnuP9uUD2jr/R7diGw5zQicpSqvtDLe/fAPE328PJN8Nod0LDRQ+EIRKJQPADaW2C3KVA+BGI1zvnPXpTtYVvmHm72diVOEbkfZ0jOEGAj8LPuZoOaaNJMj89+IlAyANrbIVoExeUwfF8oKIG6j6BxM+wx3en3ZKfnCSU8C61xAFU9PUAbjKA5/BLnVbsS3vwbvPkg1K3BicwjjoeRKBB3BFNcDoWl0FQPjbXQ1gqN26AlBovuhSlnZaNwfOF3z83uyK3xOIY/KqvhqB852458fyHs8zUoHQgiUD7U8STtbVAx0infsBEkAiUDoaUeSiqgdJCT9s5xgvQ0Rr5QWQ2n/nHns5/YBiAKq1+EtjZAoXm744FKBzneCKC4P9Sv31lP4v769TmVOOhRNCJysKq+7qGugIbbGjlDZfWuf+QrDoNXfwexjVBYDkX9HE9UNcG53lzvLAICjmAW3euIasAI51qOhG9ePM2dQI8dfFX9SurmGDnN+BkwaLTjPTYtgy2rYNg+UFYJTXXQuBUmfskpu3K2I5iSCudz4n3l7D4hGsPwTrL3SQ6/yoc7gklcq1/veJhkksO3LA7dvIhmnIg83NVFVT0lQHuMvkTH8C2Z/rs5IVnCw8DO8C3LQzcvoqkB/hC2IUaeUT3DEQI4Hqa5fmf41lno1rAZXrgGBo/LuOfxIpqYqs4K3RIjv6isdjxHZ+Hb4v+3a+gW2wSb3ob2OOwxLeOex4toPgjdCiM/6Sp86xi6bX4PiEK/we6zn8wmDbw83HzBnUezCyIySETuDMEmI9+pnuGEak11oO2Op9G2nalrcEK6WGZWEPMimv2BhSJyaOKEO7/lDeD9sAwz8phE6FZU7oRu/YbA8MnQr2pnmeRnPmmmx/BMVc8RkenAXSKyCJiIE7JNU9V1YRto5CkdU9eL7nU8T8ekQQbwOvbsDeAV4Bhgd+AWE4yRNjp6nqLyjKafvQyjOR24BvgTUA0cAPxBRJYAl6vq5nBNNAy6f+aTZrxkz84EjlHVxITy+W7/5r+B+cC4sIwzjGzES5/mxE7OtQO3isjfQrHKMLIYL5s6/Tbp+IIOl38VuEWGkeV4SQQkT/A+p8O1AwO0xTByAi+ikS6ODSMv8ZIIiIhIfxyBJY4T4omGZplhZCleRFMJvM1OoSSvaWrrAhh5h5fs2ch0GGIYuYKXh5sjuruuqh8HZ45hZD9ewrNZOGFYx+VoBwNVpNivEZHjgd+59dytqtelUp9hhI2X8Gxi8mcRGQVcDpwA/CaVxkUkijMr9FhgHfC6iDyuqkHthWcYgeN5sUARGScidwPP4yQGJqnqzSm2fwiwQlVXqWoLzs4EtqqNkdV4GREwUURmAk8Ac4F9VPUO9488VXZn1/XS1rnnDCNr8dKnMvGcSQAAIABJREFUWYrzh/04sB9wffJETlW9JBzTdtJhU6ewmzOMbvEimnNDbP8jYFTS55F02AgXQFXvAu4CZ9eAEO0xjB7xkgjoctuLZETkFlW92Gf7rwN7ishYHLF8HTjDZx2GkVaCXGHT945oqhp3R04/i5Ny/pOqvh2gTYYROBlfllZVnwaezrQdhuGVIPenMYy8IOM7oYXFnOWbeHDhOtbXNbJbRSmnHTSS6ROGZtosow/gZezZL1X1Jx7qui0AewJhzvJN/Pb59xlYWkhra5xZyzbw9Fvr6V9SwFF7V3Hh0Xsxtqo802YaOYqX8OxTawR0htcsWzp4cOE6BpYWsrWhmXfWx2iMK+1AXVOcRxav5+jfvsTts5Zn2kwjR/EimqiI9BeRAZ29QrewF6yva2RAaQGrt+ygtZOnOu3A9c+t4As39WoHdyPP8SKavXHGmiW/lia9Zx27VZSyvTFOS2t7t+WWbWo04Ri+8SKaZao6WlVHJb0Sn7NyTMtpB41kW2MrBZGecxPLNjUy9oqn+Nx1s3ho/to0WGfkOn0y5Tx9wlB+eMyejK0s9VRegY+2NXHZw0s56oZZrK6JhWugkdN4EU2XWTERuTFAWwJl+oShPHHREUwa6k04CVbVNjHjty+x95VPmXiMThHV3o9/FJEP0h2iTZ06VRcsWODrnlNufYlFH/VOANWDi5h1+bG9utfICXw/X0xVNB+q6qieSwZHb0QDzrObc//yOo3d5wa6ZEARPPb9I+z5Tt8jeNGIyOBuGnsz3avV9FY0CW6ftZxbZ6+gMd67+wsELjlmPN87ekLPhY1cIBTRrObTC2skUFVN664BqYoGYHVNjCv+sZjX1tSlVM/lx5p4+gDpDc8yQRCiSTBn+SYuuO916lKcuH383pXccfZhgdhkpJ1QPM2UDqcU2KyqH3ZWPmyCFE2Ch+av5bKHU39OO2X3ch7+/hEBWGSkkVBEM7uT04OBIuB0VV3st9FUCEM0Cc7/v3k8825tyvWUROGPZx1so6pzg/SFZyIyFbhJVX3P2EyFMEWT4LBf/pMNDb1Ms3Xg1AOGc8PXDwqkLiMU0p5yXqSqHcO3UEmHaBIE5XkAygtg6TWeBowb6SWtnmYY8LSqpvVnNJ2iSXDmnXOZuzq1TFsy1vfJKkLp09zKp7fUGAx8FrhIVZ/w22gqZEI0Cfb/6VMpZ9qSKRD489nW98kwoYjmWx1OKVALvK6qm/w2mCqZFE2Cax5fwt2vfhBondb3yRhpDc9GAV9X1Rt6VUEvyQbRJFhdE+Po375EMCmDndhD07QSrmhEpAo4FTgdGAE8oqqX+m00FbJJNMkEmTRIYN4nLYQSnvUHTsFZ+XIv4GHgtEztkJatokkmyJQ1QFEErj1pMqceMiawOo1PCEU0jcB84CpgrqqqiKxKdcyZiJwKXA1MBA5RVU9KyAXRJAg6cQDwnc+O5qov7xtspflNKKK5GGeN5X7A/cCDwHMBiGYizhoXdwKX9kXRJAhqmE4yBRE4+zATUACE16cRkXE44jkd2BP4GU6f5j2/jXao90X6uGiSCTp0A+v7pEh6smciMhlHPKep6njfFexa14v0IJoO+9MctHZt7i+Akcps0q4YWFrAlSfsbX0ff4QSnh2mqvN6ZY3I88DwTi5dqaqPuWVeJI88TWdM/9WzfLi9l7PiumBgSZRbT59iD057JhTRfDK+TET+raqf6aVxXdX/InkumgS3z1rO9c+tCLTOKPBtSx50RyiieUNVD+x4HBQmms4JQ0AWvnVKKKJ5EzgSZ7mnF9zjTxpS1S1+G3XrPRm4FagCtgGLVfXzPd2XL6JJsLomxhl3vcL6+uDCN/M+uxCKaNbgpIb7zBoBuUrQ3icCnGPisTUC8oWH5q/lRw8vJSj/UxCBk/fLy9S1b9H0uMKmiJyZdPy5Dtcu8NugEQynHjKGFdedyA2nTKY0mnp98XZ4aPEGDrv2X8xZnvbB6zmF3+zZLjM1+/rMzVzj9lnLufG5FYGNuh43pIyff2mfvp62Tm/2LIxsWk+YaHpmdU2MW55fzmNvbgikvj6edQv9OY15mhxjzvJNXPnIm3ywLfWRo6MGlvCrk/fta54nFNHsAFa4lVe7x4nGxqlqP7+NpoKJpvcEMeNUgAnD+nHlFyb1FfGEIppufbKqpnUgmIkmdW6ftZzbX1pFrKX3vZ/iAuGAkQO5YMb4XBdPqKOcB+KMbgZ4T1WDW57FByaaYOntutZRoKhAiEajjB1SxtF7D+UrB+yei7sqhJJyLhaR/wPWAHcBfwTWiMifRKTIb4NGdjG2qpwHz5/GDadMprzQ2z0CtAEtbUpxVNi0vYl/r9rCXXNW5cVGWF52QrsKKARGqeqBqnoAMBooAH4SpnFG+jj1kDEs/eWJzP7hERy6R0W3ZUUc4RRGI5QUFdDaBoVR4Y0PtnH1E8uYOW9tnxaPlz7NUpzpyDs6nC8H5qnq5BDt+xQWnqWHRNr6n0s2kNz1ieKOqRIYVFZINBIBVSrKCtnRHKe0uICh5SVEIsJ508fmQn8n+PAMaO8oGABVjfHpRQSNPsLYqnJ+d/pBvPerE5n57YM5ZMxAygodF1NcIAwoLQCElrZ2yksKaIm30xRvpzAaoap/MQUR4a65q/ukxynwUEZFZBCdKzLoJb+MLGT6hKGfeIw5yzdxzyurWfJRHYpSPaQfWxtaqG9qpbS4gN0HliIiVJQVsqm+ibkra3MxOdAtXkRTASyki1HOwZpjZDsJAa2uifHo4o9Y/OE26pri9CsqYK9h/SkvdrIJza3tDCkvZmNd0y5lQThwVEWuZtqAAEc5i8g+qvp2IJV1g/Vpso/VNTF+8tjbFEQcD9Pc2s6Oljb2Hl5OaVGUjdubWbO5gQFlhYjCtsZWxlX149zp47JBOKH0abwyM8C6jBxibFU5500fS5sqm+qbKCwQ9h5eTiQSQYAtDS1UlBVRVlhAaVEBg8qKqG1oYe7KYFckTRdewjOv+Fas0XeYPmEoIweXMXdlLRvrmhhWUcK06kr+segjWuLtVJTufAhUXBhh244WNtY1ZdDi3hOkaKx/k+eMrSr/VLg1rKKE9zbW0xRvp7TQmfjT3NpOcWGUYRUlmTAzZTyFZ+IwKmxjjL7HtOpKBvcrom5HCzta4zS2xNm6o4XKfkVMq67MtHm9wpNo1MkWPN1DsYBXLTb6AmOryjnv8HEcOm4wza1tNMXb+cy4wdmSBOgVfsKzRSJysKq+3tlFVT0sIJuMPsbYqnJ+cKz3/XZW18Q+1TfKJoH5yZ4dCvxbRFaKyFsiskRE3grLMCM/WV0T48EF62hoijO8ooSGpjgPLliXVSML/HiaHtckM4xUmbuyloGlhQxws22J92waWeBZNOmebGbkJxvrmhjeIatWXlLAhixKTwf5cNMXInKDiLzrhnqPuJPcjDxnWEUJsaZdV3OLNcWzKj2dMdEAzwGTVXU/4D3gRxm0xcgSplVXsq2xle2NrbSrsr2xlW2NrVmVns6YaFT1X6qa+EmZB2RkD08juxhbVc5pU0fSzw3J+pUUcNrUkVnTn4FgRwSkwjk42xJ2SodNndJlk5EhOhtZkE2Eupazx02drgSmAqeoB2NslLMRML7HTIbqaVT1mO6ui8jZwBeBo70IxjCygYyFZyJyPHA5cERn06kNI1vJZPbsNqA/8JyILBaROzJoi2F4JmOeJtVdoQ0jU2RL9swwUiKdgzwzGZ4ZRiCke5CnicbIeZIHeUZEGFBayMDSwtDWIDDRGDnPxromykt27WmUlxSEtgaBicbIedI9yNNEY+Q86R7kaaIxcp50D/K0lLPRJ0jnIE/zNIbhExONYfjERGMYPjHRGIZPTDSG4RMTjWH4xERjGD4x0RiGT0JdWCMMRKQG6Gq1zyHA5jSakyvY99I5Q4B3VfV4PzflnGi6Q0QWqOrUTNuRbdj30jm9/V4sPDMMn5hoDMMnfU00d2XagCzFvpfO6dX30qf6NIaRDvqapzGM0DHRGIZPTDSG4RMTjWH4xERjGD4x0RiGT0w0huETE41h+MREYxg+MdEYhk/yTjQi0ubuvLZURB4SkbKkayeJiIrI3u7nEhF5V0T2TSpzmYjc2U393xKR993XtwKw91gRWSgiS9z3o1Kt02f7F3f4jnzvXyEia0RkSKplsgZVzasXEEs6vg+4JOnzg8Ac4OdJ5453zwmwO7ASGNRF3YOBVe77IPe407I+7D0QGOEeTwY+SvP3tQYY0tn319s6elsmW15552k6MAcYDyAi5cA04D+BrycKqOozwHrgLOBm4GpV3dpFfZ8HnlPVLW6Z53BE12tU9Q1V/dj9+DZQKiLFHcu5v9S/dr3oAhGZIiLPishKETnfLSMicoPrZZeIyGnu+SNF5EUR+bvrWe9zy14IjABmi8jspLauFZE3RWSeiAzrxJZKEfmXiLwtIneTtO24iJwpIvNdO+8UkWgn9z/qetW3ReRc99w5InJLUpnvisjNvfxaUyPTqk33C/eXEmcd68eA/3I/fwO4xz1+FTgo6Z4RwDpgdg91XwpclfT5J8ClnZS7GVjcyeuKHur/KvB8F9fWJP1bbgbewtkIuArY6J7/DxwhR4FhwAfAbsCRQB0wEidk/zcwLaneZE+jwJfc4+uT/71JZX4P/NQ9PtG9ZwgwEXgCKHSv3Q6c1bEdYLD7XgosBSqBchwvn7j3VWDfTPwN5eMC6KUistg9ngPc4x6fDvzOPX7A/bwQQFU/FpEXgCeDMEBVf+D3HhHZB/gNcFw3xR5335cA5apaD9SLSLOIDMTxpPerahuwUUReAg4GtgPzVXWd29ZiYA9gbidttLDze1gIHNtJmcOBUwBU9SkRSXjmo4GDgNdFBBxRbOrk/gtF5GT3eBSwp6rOc/8Pvigi7+CIZ0k330Vo5KNoGlX1gOQTIjIYOArYV0QU55dYReQydX/WgHb31R0f4fxqJxgJvNixkBtWzOjk/gdU9bpOyo8EHsH5VV7ZTfvNSbY2J51vp+f/6+Tybd2Ub036Tror1xkC/EVVf9RlAZEjgWOAz6jqDhF5EUjsznQ38GPgXeDPPtoNlHzv0yT4KjBTVceo6h6qOgpYDUz3Wc+zwHEiMkhEBuF4hWc7FlLVH6jqAZ28OhPMQOApnNDtFd//sl2ZA5wmIlERqcLxCPN7uKceJ8zzw8vAGQAicgJOUgRgFvBVERnqXhssImM63FsBbHUFszdwWOKCqr6G43nOAO73aVNgmGgcTsf5JU/mH+55z6jqFuCXwOvu6xfuuVS4ACdZ8VO387w48UfXCx7B6eu8CbwAXK6qG3q45y7gmeREgAd+DhwuIm/jhGkfAKjqMuAq4F8i8hZO/2q3Dvc+AxS4Idh1wLwO1/8GvKJdJ2NCx6Y7GzmFiDwJ3KyqszJlg3kaIycQkYEi8h5OnzRjggHzNL3CHSEws8PpZlU9NBP2GOnFRGMYPsm58Oz4449XnIdl9rJXEC/f5JxoNm+2dbyNzJJzojGMTGOiMQyfmGgMwycmGsPwiYnGMHxiojEMn5hoDMMnJhrD8ImJxjB8YqIxDJ+YaAzDJyYaw/CJicYwfGKiMQyfmGgMwycmGsPwiYnGMHxiojEMn5hoDMMnJhrD8ImJxjB8YqIxDJ+YaAzDJyYaw/CJicYwfGKiMQyf5OP2gV1TuxJWzob69dB/N6ieAZXVmbbKyDIy6mlEZJSIzBaRZe721xdlzJjalbDoXmiJwYARzvuie53zhpFEpsOzOPBDVZ2Es7fif4vIpIxYsnI2lA6CkgqQiPNeOsg5bxhJ9BieicgjdLMlgaqe0tvGVXU9sN49rnf3WdwdWNbbOntN/XrHwyRT3N85bxhJeOnT3Oa+C/C/wPlhGCIiewAHAq91cu1c4FyA0aNHh9G804dprnc8TILmeigfHk57Rs7So2iS9zcUkVgY+x2KSDnObsoXq+r2Tmy4C2eXYaZOndqrjXh6pHqG04cBx8M010PjVpj4pVCaM3IXv32awP9gRaQQRzD3qerDQdfvmcpqmHIWFJU7IVlRufPZsmdGB7z0aQYkfYyKSH+cUA2AzjyDV0REgHuAd1T1pt7WExiV1d5EYqnpvMaLp3kbWOq+D8bppC9NOp8KnwO+CRwlIovd1xdSrDNcLDWd93hJBHxGVdeF0biqziXJa+UEyalp2Pm+crZ5mzzBi6d5PHQrcon69U6iIJni/hDbkBl7jLTjRTS55QnCJpGaTsZS03mFl/BsdxHpspOuqpcEaE/2Y6npvMeLaBpxOv0G7ExNJ7Jn5cMdwVh/Jm/wIppaVb0ndEtyCa+paaNP4qVP0xa6FYaRQ3jxNF8RkRFdXVTVjwO0xzCyHi+imYUzfCY5i6Y4DzqrgGgIduUHK2bDG/fC9o+dB6UHngXjZ2TaKqMHvAzYnJj8WURGAZcDJwC/Ccmuvs+K2TD7GigZBBUjobHO+QwmnCzH84BNERknIncDz+Nk0yap6s2hWdbXeeNeRzBlg5xJb5ECaI7BM/8D8++2YTlZTI+iEZGJIjITeAKYC+yjqneoakvo1vVltn8Mpe4QnKZ62LoaogXQ1mzj2bIcL32apcCHOMNp9gOudwYnO+Tdw82gGDDCCcnKBkHDRigohLa4430S49ne/BuUV9lo6izDi2jODd2KfOTAs3b2YVp3OKmVeCOMO9I91wSrXoC9T3QEtmU1PPVDGDwOhk4yAWUQL4mATx5sikiJe64pTKPygkRn/417YUsTFJbDhC9A1QTn/Ma3oF+V43Vim2DTMpACaNy2M3yzSXIZwdO6ZyLyXeBHOGlmRKQW+I07DdnoLeNnOK/EHJ3SQaDtzni2WA2MP8Ypt/k9KCyDwhJoqnOEtPl9eOgc55ylq9OKl0TAj4CvAser6kBVHYiTbj7ZvWakSmdTrccfBQXFzvWmOigocUK24gGw6R1Y8zI01znp6u0b4IkL4e/fscxbGhDV7qf9i8hy4ABVbexwvgxYrKp7hWjfp5g6daouWLAgnU1mhmTvs+EtaNwOtMPow+Ddp92VcwZAv2FO5q1lh3N98DiIROGzF5nn8YbvqS9entNoR8G4J93/JSMUkr1PyUDQOAzbB8oqYcdm59lO/2FO5k3b3FR1A5QPg9ZmeOZyePIS8zwh4KVPs15EjlTVF5NPisgRgE1XDJPk0dTJi3mUVkJRPyjqD61rnLBN26G43HlA2lgLba1O0mDrGnjkfOfhaWEZjJoK+37NEggp4CU82xd4FJgNLHRPTwWOBE5S1SVhGtiRvAnPuiN5CM6OzU54hsBu+zlhW2uj0wcqLHO8UP16iBS6gtrslB04CqZdClO+kel/TabxHZ71KBoAESnFWTVmH/fUMmCmG6KlFRONS2KwZ+1KRxQVIx3v8fEbIFEYsLszo7S9FeLNsHUdaAuo8qmoOlIEk0+FU27PyD8lw4QjmmzCRNMJK2bDq79zvErjdid0KyyBeBPs2OJk3xo2QXs73XZDI4Wwz3/AkZfnU/jmWzReFgvcSucrawpOkmCw30aNgBk/AwaNdvo8m5bBllVO0mD7R9BQu3PEQU+0t8KSB5xXYT+YfikcbqOkOuKlT/MkMBT4O/AA8FHydVVNaWaniPwJ+CKwSVUn91TePI0HEkmDTctgwxLnOU7DRifD1hsihXDweXDCtcHamR2E1qcZhPOA8zScNPUDwN9UdZvfBjup+3AgBtxrogmB2pXw7zvgrb9BS8r/XTBmBnz70dTryR7C7dO4ay9/HbgV+LWq/tZvg13UuwfwpIkmRGpXwmMXwQdzgqtzyL5wwdzg6ssMoXmaQ4DTgRnAPOBB4EUNKIvQk2g67E9z0Nq1a4NoNj9ZMRtevh4+eDXYer98e66mr4MXjYisBOpxQrLngNbk66r6lt9GO2ljD8zTpJ8Vs+GfV0Dtu8HVWToc/md5cPWFTyiimcvO3MunFthQ1cP9NtpJG3tgoskctSvhn1fCin8GWGkBnPn3XBj/FnzKWVWneWpZ5ChVfcGvAUYWUFkNZz7gHL98E7zwS1IfVhiHv57kHJaPhkvTOnAkVILc3fnG3twkIvcD/wYmiMg6EfnPAG0y/HL4JXD1VjjzUajcO5g6Yx/A1RXO6+XM792VKoGNCBCRN1T1wEAq6wYLzzLAncfC+vnB1llUCT9eFWydvSP48MwHuTUex/DOec8577Ur4X9nQLwu9Tpbah3PAzmXeQvS0yxS1SmBVNYN5mmyhBv3dcKuIMnMc5/gJ6GJyMEe6/rQb+NGDnPpEri6Dg69ILg6Ny9xvM+N+wZXZwh4STmnxYN4xTxNFvOrcU7YFRTp8TyhTHc2DG/8eJXjfb4c0LychOe5bg9YdF8wdQaAF0+zDejy+YuqnhK0Ud1hnibH+M0EaAxoVnzRADj+uqCTBqFkz2qAP/i3xTDYOaTm4e/BWyl6i5bt8PgFsHFZRqcpePE0aXn+4hXzNH2AqyuBeGp1FA1wViRNfZZpKH2agPOKRt5zdW3qmbeW7c4M0z8elfb+jhfRvCDJ2wS4iMggEbkzBJuMfOGEa1MXT9M2ePIi+Md5aVvfzYto9gcWisihiRPu/JY3gPfDMszIIxLiuboOdjvE//3trbDkb3D/Gc50h5DxOgltOnAbsAiYiBOyXaKq68I179NYnyZP6M1MUymAssFw8Dl+FkQM7TnNG8ArwDHA7sAtmRCMkUdUVsM5T8L3F8E+X4NISQ83iPNqaYD1S0LdSc7LMJrTgTdxVqGpBv4D+J2I/ElEhoRilWEkqKyGU/8I//0qjJ7edblIgbv9Yhy2rISPFsEL14QiHC+e5kzgGFW9VlVbVHU+cCiO9wl4vLhhdEHC85z5KAw/IOmCu8kvAu1tEHE/lw91luwNweP0KBpVPVFVV3c4166qtwKfCdQaw+iJ8TPg/JecoTplVRAtxBFOFEScrUkGjnKW4u031Pm8MtjkgJfw7LdJxx1zg78K1BrD8MqUb8Apf4Sxh0O/IVBY6iQBhu/nJARadzhbMRb3h1iwm1t4GUaTvDLCOThZtARZM1LAyEMS2y+CE4K9cI0TkhUPdXZQ6FflrGNdPjzQZr30aaSLY8PIHiqr4airYMQUGL6vs/lVU52zc0J1sCvieBFNRET6i0hF0vEAERkARAO1xjBSobO9S0PYAdtLeFYJvM1OL7Ms6ZqtC2BkF8m7x4WEl3XPRoZqgWHkGF72pxnR3XVV/Tg4cwwj+/ESns2ik+VogcFAFdavMfIMLw83J6rqJPd9InAcjpBiwKWpGiAix4vIchFZISJXpFqfYYSN54U1RGSciNwNPI+TGJikqjen0riIRHGmUp8ATAJOF5FJqdRpGGHjZUTARBGZCTwBzAX2UdU7VLUlgPYPAVao6iq3vgeArwRQr2GEhpc+zVKchQAfB/YDrk+eyKmqqexkuju7LjK4Dmcw6C502NQpheYMI3W8iObc0K3oAVW9C7gLnEloGTbHyHO8PKe5x0tFInKLql7ss/2PgFFJn0fSYfdow8g2glxhszc7or0O7CkiY0WkCGcT3McDtMkwAifIrTZ8o6pxd7rBszjPe/6kqm9n0ibD6ImMigZAVZ8Gns60HYbhlSDDM5s2YOQFXp7T/NJjXbf1XMQwch8vnuZELxV5zbIZRq7jpU8TFZH+dBF+qer2YE0yjOzGi2j2ZtdJaLBz1LMC9ojeyCu8iGZZNm21YRiZxrYPNAyfeBFNl1kxEbkxQFsMIyfwMgmtu6zY1wK0xTByglTDM3ugaeQdXhbWGNzVJUw0Rh7iJXu2kE8vrJEgiNmbWc3qmhhzV9aysa6JYRUlTKuuZGxVeabNMjKIl/k0Y9NhSDayuibGgwvWMbC0kIIIzHmvhkcWrePwPYfwlQN2N/HkKV7CsykdTimwWVU/7Kx8X2LuyloGlhbSEm9j0QfbKC0qoKq8mGUb6mlasI7Tpo404eQhXsKz33ZybrA7aex0VV0csE1Zw8a6JoZXlDB/9XZKiwooLYyiKHWNrQwsLWTuyloTTR7iJTzrdMl1EZkK/J7ezdjMCYZVlBBrirO9qZWKkkIAmlvbGVBaSHlJARvqmjJsoZEJep1yVtUFQJ/+mZ1WXcm2xlaKohEa4200tbaxo6WN8VX9iDXFGVbR0+apRl+k1zM3RWQYfXzXgLFV5Zw2dSSPLv6IOe9tZsiAYg4aU0FRNMq2xlY+v8+wbu+3zFvfRFS7/7sXkVv5tDgGA58FLlLVJ0KyrVOmTp2qCxYsSGeTgH8BJGfeyksK+GBzA8s21LNHZRkTdhtgAsoefD9r9CKab3U4pUAt8LqqbvLbYKpkSjR+mTlvLQ1NcQaUFrK5vokFa7fS1NLGlsYWmlrixJrbGDW4jKP3Hmrp68ziWzReEgF/6bQlkVEicpmq3uC30XwgkXkDWFHTQLsqG+ob2RJrIRoRWtuU9zfG2NLQwvubYlx63AQTTo7gKxEgIlUi8j0RmQO8CHQf1OcxicwbwPamVrY3ttLU0o4C8XYoiEaIRqCxJc6/V9Vy+T/eZOa8tayuiWXWcKNHvDzc7A+cApwB7AU8DIy1HdK6Z1p1JQ8uWAdA/+ICVtXEaGlrRxUK3C3vBaGxVSkpELY2tNLQFOfOl1cxfEAx8XYseZCleMmebQLmA1cBc1VVReTkcM3KfRKZt7kraxlQUkhhNEJFaRGbY820tzuiAUdAxYURRISWeBtrNjfw4dYGBpcVM/f9Gv48dzX7jhjA1HGVJqAswYtofoSzXOztwP0i8mAQDYvIqcDVwETgEPe5T59ibFX5J3/kc5Zv4pZZ71MbayKu0K9A2NGiFEUiFEQijB5cyoqaBqJR+GBLI4LQ0BynpTXOK6tqeW9TvQkoS/AyCe0WVT2MnfvGPAqMEJH/EZG9Umh7KU7Y93IKdeQM0ycM5cZT9+eUKSMZWFqISoTSogiDygrYbWAJ+48+EuPhAAAgAElEQVQayPamVrbEWikvLmB7UxxVaG5XmlvbqIm1fCKghxd+yE8ee5s5y9OevDTwkHLu9CaRycDpwGmqOj4lA0ReBC716mlyJeXcHYlnPu9+vJ0Ptu5g4vD+jK7sx8vv1bD0ozom7tafD7c00tAcp7VdaY63gUJRYYR4mzJyUCmV/Yqpb2pl+p5DrP+TGsGnnEXkMFWdl3xOVZcCV7qv0Olrmzolh20JAW2oa2Libv3Z0tBMWzuUFEXYHGsjGhEEaMdJHJQVRWmOtxOJwPrtjTz79nrWb2umrimOAIPKCvjifiM4+3NjTUAh4eXh5iJVneIe/1tVP+O5cpHngeGdXLpSVR9zy7xInnma7pizfBN3zV1NfVML67Y2UVIYoam1ndZ4O0UFESpKCykrLiAeV2pjjWyKtQJOYqHd/a8sEBjUr4gvTB5u4umZ4D1Nh0p9jVBU1WP8mWNMnzCUkYPLmLuylvkrN7NsQz39iwuoibVQXBgBhIqSAtbU7iDW0oaI0zFtT/rtiyvUN7XwxFvreX3tVo6bNMxGHQSIF9FERGQQzv9N4vgTIanqlrCMy1cS4ds3DxvzSfj2iYBKChjYr4gxChu2NxER6CxYiLcLCqiqTZoLGC/h2RoSIfWnUVUd16uGnWc9twJVwDZgsap+vqf7+np41h3Jg0ajEbj332uIuVm2Nt11VG1xVBjSv4SyoiiDygqpb2ph9eYdgFBWFOGIvaq48Oi9TERhDNjMNvJZNB25fdZyfvfCClradhVMBOhfEqWqfwmqyrbGFup2xFGgMAru6B6iAqMGlfHfR47j1EPGZOBfkBWEMsr5TFX9q3v8OVV9JenaBaqa1n1pTDS78tD8tdw6ewUfb20iDhREoLykgIElBYhEaFOojTU5GTegtb3zSVDFBcKYwWV8d9rYfBNQKKJJzp59ctzZ53Rgouma1TUxHl38Ea+u2MyG7c2MGVxKS1s7b66ro61diUaE5njX/9+JhezGVJbylQN2z5fkQSiieSOxa0DycWef04GJxhuJ/s/zyzaw6INttMXbiavS0uY9HBdgv5EDuPTYCUyfMDQ8YzNLKCln7eK4s89GlpDIwE2rruRnjy1l/pottPvsvyrw5rrtfPPPr1MQgbMPG81VX943HINzCC+eZgewAkeR1e4x7udxqtovVAs7YJ7GP6trYtzy/HJmvbOJWEt7SnUJcMzeQ/jxifv0ldAtlPCs216hqq7122gqmGhSY3VNjF8+uZS5K2ppaUutrlEDS/jVyfvmeugWXspZRAYCe7of31PVOr+NBYGJJhgSSYNHFn7Aum0tpOJ/+hVGuPpLk3I16xaKpykG7gROAla7jYwBHgHOV9W0LoJuogme1TUxLrp/IW99nNpU66IIXHvS5FwTj2/ReFkj4CqgEBilqgeq6gE4m9MWAD/x26CRfYytKufxC4/gO58d3fuF8ICWdrjs4aWMu+Ipbp+1PDD7sg0vnmYpzszKHR3OlwPzVHVyiPZ9CvM04TNn+SZ+8cRS3t/cmHJd08ZW8NfzpgVgVWiEEp69par7dXFtiaqmNQdpokkv1zy+hLtf/SDler7z2axNV4cimjeBI7uofLaq7u+30VQw0WSGOcs38V8zXycW730dQ8qiPPRf07ItVR2KaNYQwijn3mKiySy3z1rO9c+t6LlgN1QPLmLW5ccGZFHKZG6Us4jso6pvB1JZN5hosoNUxVMQgV9nR6Yto6JJy+BNE012MWf5Js79y+s09vJBT0kBXDhjPN87ekKwhnknlJRzaI0buc/0CUN551cnMvuHR/Tq/qY4XP/cCs7/v3k9F84SghSNDd7MY8ZWlbPmuhOZ+e2DqSjyf/8z79ay/8+fzYnnO57CMxERYGR3m9NaeGYks7omxsm3vcS2Zv/3Di8v4P7zPpeuLFs44Zk6ynq6h2JpHU5jZDdjq8pZ/PMT+c5n/a9TtyEW5/O3vMRD89M6FtgzfgZs/gW4TVVfD9ek7jFPk5vMWb6Jix9YSK3PjMGkYWX84cyDw/Q6oY5yfhcYD6wFGtzGtKvRAmFhosltbp+1nBufW+FrVPWA4gh/OOOgsKYghCqaThPqNp/G6A0PzV/Ldc+8S+0Ob0MM9qzqx11nTQ3D49gSTkZu8YWbXmDZJm8DQ3cbUMIlx4wP+oFoRp/T+EJEbhCRd0XkLRF5xJ3kZuQZT19yFFN29+Y9tu1o5mdPvsMPHliU0W0WMyYa4Dlgstsneg9n8ygjD3n4+0dwwymTKY12X641rjS1tPHYm+v51p/mZyy7ljHRqOq/VDUR0M4DbA/PPObUQ8bwzrUnMm1sRZdl2sSJpdoV6hpb+O3z72dkY6tMeppkzgH+2dVFETlXRBaIyIKampo0mmWkm7+eN40bTpnM+Kp+zor7OIM7o+7uCCJQGBXKigtobm3nwYXr0m5jqKIRkedFZGknr68klbkSiAP3dVWPqt6lqlNVdWpVVVWYJhtZwKmHjOH5Hx7Jb06ZzJD+xRRGIu4OCM4clfJiZ1J2NAIb6prSbl8qU8J7pKf9aUTkbOCLwNGaa2k8I3QSWbLf/Os9GmMtRICKkkJKCqO0xNvpXxxleIWvLZMCIZPZs+OBy4Evd1x/wDASnHrIGB467zMcsWcl5aXOb3x7eztF0QgRiVBZVsiNzy5n5ry1acuoZbJPcxvQH3hORBaLyB0ZtMXIYsZWlXP1lydz0v4jqOxfRHFhlFGDS5g0YgC7DSxjeEUJDU1xHlywLi3CsYebRk4yc95aGpriDCgt/OTc9sZW+pUU8M3DfD38zJ2Hm4aRChvrmigv2bVLXl5SwMY0JAZMNEZOMqyihFjTruPWYk1xhqUhMWCiMXKSadWVbGtsZXtjK+2qbG9sZU1tA7X1TaEnBkw0Rk4ytqqc06aOpF9JARvqmmhsjSMCJYUFoScGQn1OYxhhkti4CpzEQGlhwSeJgcT73JW1gU8nME9j9AnSmRgw0Rh9gnQmBkw0Rp+gs8TAtsZWpv1/9u48zo6qzv//692dkAQ6ZCeQEEgIIGFRwFZgBAQXiKOOiAsiDDL4k3HUryKCIy4z7oMrOjiMIDDjMIzgFkRl2MMACkISAllYwxoIkISQpLN39+f3R9WFS3M7XdVdt++9ue/n43EfXXVq++SmP32qTlWdM31c4cdy0tg2oWfDwA7Dh3BC+65V6ZDDDQG2zShvGKgm1zRmOTlpzHJy0pjl5KQxy8lJY5aTk8Ysp4Z7CU3ScpL+pCsZD6wYxHAahb+XysYDD0TEzDwbNVzSbI2kORHRXus46o2/l8r6+7349MwsJyeNWU7bWtJcVOsA6pS/l8r69b1sU9c0ZoNhW6tpzKrOSWOWk5PGLCcnjVlOThqznJw0Zjk5acxyctKY5eSkMcvJSWOWU9MljaSudOS1hZJ+JWn7smXHSQpJ+6TzwyU9IOmAsnXOlnThVvb/EUkPp5+PFBTzayXdIWmRpAWSBm2gSUln9PiOcvcoLulxSeMHuk7diIim+gAdZdOXA2eWzV8J3AZ8raxsZlomYDKwBBjTy77HAo+mP8ek0xXXzRHvEOA+4HXp/DigdRC/r8eB8ZW+v/7uo7/r1Mun6WqaHm4D9gSQ1AYcDnwU+FBphYi4FlgGnAKcB3w1Ilb1sr9jgRsi4oV0nRtIkm4gjgHui4h703hWRkRXz5XSv9T/ktaicyQdLOk6SUskfTxdR5K+l9ayCySdkJYfJekWSb9Oa9bL03U/DUwCZkuaXXasb0m6V9KdkiZWiGWcpOvTmvFiyobok3SypLvSOC+U1Fph+6skzU23Pz0tO03Sj8rW+Zik8/r/tQ5ArbN2sD+kfylJ/oL/DviHdP4k4JJ0+s/A68u2mQQsBWb3se+zgC+XzX8FOKvCeucB8yt8vlBh3TOAy4DrgHnA53s59uNl/5bzSGqnkcAE4Lm0/H0kidwKTASeBHYBjgJWA7uSnLLfARxett/ymiaAd6fT3y3/95at86/AP6XT70y3GQ/MAH4PDE2XXQCc0vM4wNj05whgIUnt2kZSy5e2/TNwQC1+h5qxW9oRkuan07cBl6TTJwI/TqevSOfnAkTEM5JuBv5QRAAR8dkcqw8hqQHfAKwHbpI0NyJuqrDu1enPBUBbRKwF1kraJGl0up9fRFJTPSfp/9L9rgHuioilAOn3MxW4vcIxNvPy9zAXeHuFdY4Ejk//rX+UVKqZ3wq8HrhbEiRJ8XyF7T8t6b3p9BRgr4i4M/0/eJek+0mSZ0GFbauuGZNmQ0QcWF4gaSzwFuAASUHylzgknR3pnzWgO/1szdMkf7VLdgVu6blSelpxdIXtr4iIc3uULQVujYgV6bbXAAcDlZJmU1msm8rKu+n7/7p8/a6trL+l7DvZ2nqVCPh5RJzT6wrSUcDbgMMiYr2kW4BSw8fFwBeBB4D/yHHcQjX7NU3J+4HLImL3iJgaEVOAx4Ajcu7nOuAYSWMkjSG5Hrmu50oR8dmIOLDCp2fClPZ5gKTtJQ0B3gwszhlXyW3ACZJaJU0gqRHu6mObtSSneXncCnwYQNI7SBpFIEn090vaKV02VlLP8ctHAavShNkHOLS0ICL+QlLzfBj4Rc6YCuOkSZwIzOpR9pu0PLOIeAH4BnB3+vl6WtZvkTQo/DDd33xgXkT8sZ+7m0VyrXMvcDPJ9dGzfWxzEXBteUNABl8DjpS0iOQ07UmAiFgMfBm4XtJ9JNdXu/TY9lpgSHoKdi5wZ4/lvwT+FL03xlSdX3e2hiLpD8B5vVzTDQrXNNYQJI2W9BDJNWnNEgZc0/RL+oTAZT2KN0XEIbWIxwaXk8YsJ5+emeXUcEkzc+bMILnD7I8/RXxya7ikWbHCnd9bbTVc0pjVmpPGLCcnjVlOThqznJw0Zjk5acxyctKY5eSkMcvJSWOWk5PGLCcnjVlOThqznJw0Zjk5acxyctKY5eSkMcvJSWOWk5PGLCcnjVlOThqznJw0Zjk5acxyctKY5eSkMcvJSWOWk5PGLKeaJo2kKZJmS1qcDn/9mVrGY5ZFrQeq7QQ+FxHzJI0E5kq6IR1mzqwu1bSmiYhlETEvnV4L3A9MrmVMZn3ps6aRNIutDEkQEccXEYikqcBBwF8qLDsdOB1gt912K+JwZv2W5fTsJ+lPAf8OfLzoICS1kYymfEZErOm5PCIuIhllmPb29n6NKWJWlD6TpnxQUEkdRQ8SKmkoScJcHhG/LXLfZtWQ95qm0L/ykgRcAtwfET8sct9m1ZLlmmbHstnWtJVLpYJKp1M5vAn4W2CBpPlp2Rcj4poB7NOsqrJc0ywiqWFKibK4bD6Afl+ZR8TtZfs1awhZkuawiFha9UjMGkSWa5qrqx6FWQPJkjQ+fTIrk+X0bLKkXlu2IuLMAuMxq3tZkmYDSWOAmZEtaVZGxCVVj8SsQWS5pumqehRmDSRLTfMeSZN6WxgRzxQYj1ndy5I0N/HKm5uk82OBCUBrFeIyq1tZHticUT4vaQrweeAdwHeqFJdZ3cr8wKakPSRdDNxI0pq2b0ScV7XIzOpUn0kjaYaky4DfA7cD+0XETyNic9WjM6tDWa5pFgJPkTxO81rgu8kT/Qnf3LRmkyVpTq96FNa3lUtgyWxYuwxG7gLTj4Zx02sdVVPK0hDw0o1NScPTso3VDMp6WLkE5v0XjBgDO06CTWuT+YNPceLUQKaGAEkfk/Qo8CzwrKQlaWcXNhiWzE4SZvgoUEvyc8SYpNwGXZaGgHOA9wMzI2J0RIwmaW5+b7rMqm3tMhg28pVlw0ZCx7O1iafJZalpTgWOi4iHSgXp9PuAv6tSXFZu5C7JKVm5TWuhbefaxNPksiRNRMSGCoXrge7iQ7JXmX40bFgFG1dDdCc/N6xKym3QZUmaZZKO6lko6c0k1zhWbeOmJxf927Ulp2rbtbkRoIayNDl/GrhK0mxgblrWDhwFHFeluKyncdOdJHWiz5omIhYA+wN3Afukn7uAA9JlZk0l06gB6TXNRVWOxawhZOkscBWVe9YUSSPB2MKjMqtjWRoC/gQ8ApwLHEjyDs0EYHz6c0AkXSrpeUkLB7ovs8GQ5ZrmXcCxwCrgUuAG4KPAyIgo4lXo/wRmFrAfs0GR6TGaiFgVET8D3g78DPg2SeIMWETcCrxQxL7MBkOmhgBJbwROBI4G7gQ+ANxSvbBedXwP6mR1I0tDwBJgLXAFSe2yJV10gCQi4r4qxgd4UCerL1lqmmUkrWfvBP6aV3ewcWQV4jKrW1nepzk8y44kvSUibh54SGb1rcjRnb/fn40k/QK4A3iNpKWSCmlgMKuWTA0BGfVrdIGIOLHAGMyqrsiaxhfo1hSKTBqzppDldec3ZNzXUwOMxawhZKlpLsyyo4h4zwBjMWsIPj0zyylL69kekn7b28KIOL7AeMzqXpakWQ78W7UDMWsUWZKmIyJuqnokZg0iyzXNk1WPwqyBZEmam1U+TEBK0hhJmVrWzLYlWZLmdcBcSYeUCtL3W+4BHq5WYGb1KstTzqdJOgK4SNI8YAbJKdvhEbG02gGa1ZusD2zeQ9LBxrvT+TOdMNassjxGcyJwL/A0MJ2k4/Mfp73IjK9yfGZ1J0tNczLwtoh4LJ2/K72++SRJT5t7VCs4s3qU5ZrmnRXKuoHzJf2yKlGZ1bEsp2c/KJv+VI/F3y48IrM6l6XJuXwQlNN6LDuowFjMGkKWpFEv02ZNKUtDQIukkSQJVpouJU9r1SIzq1NZkmYcsIiXE2Vx2TL3C2BNJ0vr2a6DEYhZo8jSLe2krS2PiGeKC8es/mU5PbuJ5DSsZ3e0Y0nGpxnQdY2kmcCP0/1cHBHnDmR/ZtWW5fRsRvm8pCnA54F3AN8ZyMEltZK8Ffp2YClwt6SrI2Lx1rc0q53MHWtI2kPSxcCNJA0D+0bEeQM8/huBRyLi0YjYTDIygXu1sbqW5YmAGZIuA34P3A7sFxE/TX/JB2oyr+wvbWlaZla3slzTLCT5xb4aeC3w3fIXOSPizOqE9jIP6mT1JEvSnF7F4z8NTCmb3zUtewUP6mT1JEtDwCVZdiTpRxFxRs7j3w3sJWkaSbJ8CPhwzn2YDaoih9rIPSJaRHSmT05fR9LkfGlELCowJrPCFZk0/RIR1wDX1DoOs6zcl7NZTkUmjV8bsKaQ5T7NNzLu6ycDjMWsIWSpaV7VR0AlWVvZzBpdloaA1h4vnr1CRKwpNiSz+pYlafbhlS+hwctPPQfgW/TWVLIkzeKIcAcaZik3OZvllCVpem0Vk/T9AmMxawh9Jk0frWIfLDAWs4Yw0NMz39C0ppOlY42xvS3CSWNNKEvr2Vxe3bFGSRFvb5o1lCzv00wbjEDMGkWW07ODexQFsCIinqq0vtm2Lsvp2Q8qlI2VtB1wYkTMLzgms7qW5fTs6ErlktqBf6Ufb2yaNbJ+NzlHxBygrcBYzBpCv5NG0kQ8aoA1oSwNAefz6uQYC/wV8JlqBGVWz7I0BMzpMR/ASuDMiHi++JDM6luWhoCfVyqXNEXS2RHxveLDMqtfua5pJE2Q9AlJtwG3ABOrEpVZHctyTTMSOJ6k58u9gd8C0zxCmjWrLDXN8yRDoX8T2CMiPkcBz5xJ+oCkRZK603s+Zg0hS9KcAwwDLgDOkTS9oGMvJKnBbi1of2aDIstLaD+KiEN5ebClq4BJkv5R0t79PXBE3B8RD/Z3e7NaydwQkI5W9u2IOABoB3ZkkPpglnS6pDmS5ixfvnwwDmnWqyw9bB7asywiFkbElyJizz62vVHSwgqfXEMERsRFEdEeEe0TJkzIs6lZ4bLc3LwAOBhA0h0RcVjWnUfE2/obmFm9ynJ6Vv7G5vBqBWLWKLIkTYukMZLGlU2PLX36e2BJ75W0FDgM+KOk6/q7L7PBlOX0bBRJPwGlGmde2bIA9ujPgSNiFjCrP9ua1VKWZ8+mDkIcZg0jS+vZyWXTb+qx7FPVCMqsnmW5pjmzbPr8HstOKzAWs4aQt/WsZ99n7izQmk6WpIlepivNm23zMg3qJOk+klplejpNOt+vljOzRpYlaWZUPQqzBpKlyfkJAEmjgb3S4ociYnU1AzOrV1ne3BwGXAgcBzxGclq2u6RZwMcjwp2gW1PJ0hDwZWAoMCUiDoqIA0kGpx0CfKWawZnVoyxJ817gYxGxtlSQTn8iXWbWVLIkTXdErO9ZGBEduMnZmlCW1rOQNIbKNzK7C47HrO715ynncq5prOkU9pSzpP0iYtGAIzKrcwMd3bncZQXuy6xuFZk0fnjTmkKRSePrG2sKmZJGiSnVDsasEWRKmogI+u4Y0I/TWFPIc3o2T9IbeluYdl1rts3Lcp+m5BDgJElPAOtILvwjIl5blcjM6lSepDm2alGYNZDMSVN6r8as2RXZ5JyLpO9JekDSfZJmpS+5mdW9miUNcAOwf3pN9BDJ4FFmda9mSRMR10dEZzp7J+AxPK0h1LKmKXca8L+9LfSgTlZPlNy3rNLOpRuBnSss+lJE/C5d50skI6sdHxmCaW9vjzlz5hQbqDWz3M9M5mlyzq2vQZ0knQq8C3hrloQxqwdVTZqtkTQT+Dzw5kqvU5vVq1pe0/wEGAncIGm+pJ/WMBazzGpW0/Q1yK1ZvaqX1jOzhuGkMcvJSWOWk5PGLCcnjVlOThqznJw0Zjk5acxyctKY5eSkMcvJSWOWk5PGLCcnjVlOThqznJw0Zjk5acxyqmrHGtUgaTnQW2+f44EVgxhOo/D3Utl44IGImJlno4ZLmq2RNCci2msdR73x91JZf78Xn56Z5eSkMctpW0uai2odQJ3y91JZv76XbeqaxmwwbGs1jVnVOWnMcnLSmOXkpDHLyUljlpOTxiwnJ41ZTk4as5ycNGY5OWnMcmq6pJHUlY68tlDSryRtX7bsOEkhaZ90frikByQdULbO2ZIu3Mr+PyLp4fTzkQLifWMa73xJ90p670D3mfP4XyybnippYT/20VHEOnUjIprqA3SUTV8OnFk2fyVwG/C1srKZaZmAycASYEwv+x4LPJr+HJNOV1w3R7zbA0PS6V2A50vzNfi+pgILB7KPgaxTL5+mq2l6uA3YE0BSG3A48FHgQ6UVIuJaYBlwCnAe8NWIWNXL/o4FboiIF9J1biBJun6LiPUR0ZnODgcqPmErqUPS9yQtknRjWkPdIulRSX+TrjNc0n9IWiDpHklHp+WnSvqtpGvTGvK7afm5wIi0lrs8PVSrpJ+lx7le0ogKsUyTdEd6nG/2WHa2pLsl3SfpaxW2bZN0k6R56fbvScu/LumMsvW+Jekzeb/PQtQ6awf7Q/oXjWS80d8B/5DOnwRckk7/GXh92TaTgKXA7D72fRbw5bL5rwBnVVjvPGB+hc8XetnvIcAioAN4by/rBPCOdHoWcD0wFHgdMD8t/xxwaTq9D/AkSSKeSlIrjkrnnwCmlH9f6fRUoBM4MJ3/JXByhViuBk5Jpz9Z9p0fQ/I4vkguDf4AHFnh/2XHdHo88Ei6/lRgXlreQlLjj6vF71DNBqqtoRGS5qfTtwGXpNMnAj9Op69I5+cCRMQzkm4m+U8esIj4bM71/wLsJ2kG8HNJ/xsRG3usthm4Np1eAGyKiC2SFpD8wkFSk56f7vMBSU8Ae6fLboqI1QCSFgO7A09VCOexiCh9f3PL9l3uTcD70unLgO+k08ekn3vS+TZgL+DWsm0FfFvSkUA3ySnxxIh4XNJKSQcBE4F7ImJlhWNXXTMmzYaIOLC8QNJY4C3AAZICaAVC0tmR/mkj+Q/s7mPfTwNHlc3vCtzScyVJ5wFHV9j+iog4t7edR8T96QXz/sCcHou39Ih1U7pNt6Qs/8+byqa76P13o+d6rzo9K4VboUzAv0RErw0pJDX+BJKafoukx0lqP4CLSWrFnYFLt7KPqmr2a5qS9wOXRcTuETE1IqYAjwFH5NzPdcAxksZIGkPyV/W6nitFxGcj4sAKn1clTHp9MCSd3p3ktOrxnHGV3EbyS4mkvYHdgAf72GaLpKE5j/MnXr4uPKms/DrgtPT6EUmTJe3UY9tRwPNpwhxNUuOVzCK5RnwDFb7XweKkSZxI8h9S7jdpeWYR8QLwDeDu9PP1tGwgDgfuTU8pZwGfiIj+dsd0AdCSnrJdCZwaEZv62OYi4L6yhoAsPgN8Mj3O5FJhRFwP/A9wR7rs18DIHtteDrSny08BHijbfjMwG/hlRHTliKdQft3ZGoakFmAe8IGIeLhWcbimsYYgaV+SlrSbapkw4JqmX9InBC7rUbwpIg6pRTw2uJw0Zjk13OnZzJkzg6Q50x9/ivjk1nBJs2KF+/G22mq4pDGrNSeNWU5OGrOcnDRmOTlpzHJy0pjl5KQxy8lJY5aTk8YsJyeNWU5OGrOcnDRmOTlpzHJy0pjl5KQxy8lJY5aTk8YsJyeNWU5OGrOcnDRmOTlpzHJy0pjl5KQxy8lJY5aTk8YsJyeNWU41TRpJUyTNlrQ4HS24NqP1muVQ6zE3O4HPRcQ8SSOBuZJuiIjFNY7LrFc1rWkiYllEzEun1wL3UzbcnFk96rOmkTSLrQxJEBHHFxGIpKnAQcBfitifWbVkOT37SfpTwL8DHy86iHS0398AZ0TEmgrLTwdOB9htt92KPrxZLrlGQpN0T0QcVGgAyXDbfwCui4gf9rV+e3t7zJkzp8gQrLkp7wZ5r2n6NXJUbyQJuAS4P0vCmNWDLNc0O5bNtqatXC9lZ6XTqRzeBPwtsEDS/LTsixFxzQD2aVZVWa5pFpHUMKVEWVw2H0C/LzIi4nb6UT2a1VKWpDksIpZWPRKzBpHlmubqqkdh1kCyJI1Pn8zKZDk9myyp15atiDizwHjM6l6WpNlA0hhgZmRLmpURcUnVIzFrEFmuabqqHoVZA8lS07xH0qTeFkbEMwXGY1b3siTNTbzy5ibp/FhgAtBahbjM6lafSRMRM8rnJU0BPg+8A/hOleIyq/A6tC8AACAASURBVFuZH9iUtIeki4EbSVrT9o2I86oWmVmd6jNpJM2QdBnwe+B2YL+I+GlEbK56dGZ1KMs1zULgKZLHaV4LfDd5oj/hm5vWbLIkzelVj8KsgWRpCHjpxqak4WnZxmoGZX1YuQSWzIa1y2DkLjD9aBg3vdZRNY1MDQGSPibpUeBZ4FlJS9L39m2wrVwC8/4LNnfAjpOSn/P+Kym3QZGlIeAc4P3AzIgYHRGjSZqb35sus8G0ZDaMGAPDR4Fakp8jxiTlNiiy1DSnAsdFxEOlgnT6fcDfVSku683aZTBs5CvLho2EjmdrE08TypI0EREbKhSuB7qLD8m2auQusGntK8s2rYW2nWsTTxPKkjTLJB3Vs1DSm0mucWwwTT8aNqyCjashupOfG1Yl5TYosjQ5fxq4StJsYG5a1g4cBRxXpbisN+Omw8GnvNx61rYzzHi3W88GUZYm5wWS9ifpamm/tPgu4P+lp2g22MZNd5LUUKZRA9JrmouqHItZQ8jSWeAqKvesKZJGgrGFR2WDq3Sz9LlFsPHFpAl7p31907QXWRoC/gQ8ApwLHEjyDs0EYHz6c0AkXSrpeUkLB7ov64fSzdJVj8OLj8PGtfDCY/DiE75p2oss1zTvkjSG5AbnpSSJdgXwy4h4sYAY/pNkZIL/KmBfllfpZumzC2DoDjB0BGzZAGueSZq3b/4mDB/tGqhM1muaVcDP0vdpPgScD4wEfjDQACLi1nRsGquFtcuSx3E2rk6SA2DocFj9DGx4ATaugeEvwroX4MUnoftXMPtbsOcxcNTnmzJ5MiWNpDcCJwJHA3cCHwBuqV5Yrzq+x6epltLN0uGjoHNjWtNshC3rYej20N0FGzvghUehewu0DoWubljwa3jgDzBiFEzcDw75BOzZHPeK+hyfRtISYC3JKdkNwJby5RFx34CDSGqaP0TE/n2t6/FpCla6punugucXAa0QXUkiDRsJXZtg1ZNJTdTSAl2dSfJ0bYaWodCyHXRvgggYsxscfhYcfFKt/1V55O5BNktNs4yk9eydwF/z6g42jsx7UKsj5TdLt6xPni7YfiysfwFG7Zpc2zyfDhwRkTyFEF1AC3RvThKoZShIySndtV+A+6+Gvd6+zV77ZGkIODzLjiS9JSJuHnhINugq3Swt1UAjd0lqky0d0NKd/Mns7oaW1qR2ogVahyQ1UHQC28HDN8KSm5P5EWPh0E/CkdvOC75Fju78/f5sJOkXwB3AayQtlfTRAmOy/irVQGOmwi4HJUmCQEPShOlO5ltakxqIbqAFNq8jGemepFZavwJu/hp8axL85u+3iSbsXGNubnVHVRiPsxJf09TII7Phzn9LboBuWJ3UOF1bgEhOzbq7YcjwpEYCku7wKnTOqiGwy+vgLV+pl4aD3Nc0RSbNvIg4uJCdbYWTpg6sXAJ3/BQWXQUbV0DrMNhuB9jUAV0bSc76O/vYSQuMnQav/QAc8MFaXvtUfaBas+QX/F3fg398GN79Exj/muQt0tYh6elbll+r7qQZ+65L4KpPJDVZg8jS5PyGiLi7zx1Jv4uI9xQWWS9c09SxR2bD1Z+GNU+RbSDwlrTJugvoSu4BjZo82M3WValpLsyyo8FIGKtzex4NH7kK9pwJDM2wQUD3RpJbf91JC9yqJ+Cas+DWXscRq7ksNc2gXKtk5Zqmgcy7HG7+FnQ8XWGh0k/6xrxagJa0Ja7UgNCS1D4T969mw0HxDQGSXgR6vf8SEcfnPehAOGka0COz4X+/ACsfJDlta4HW7ZKnDUqncSpvuq5AQ2CvY+DYbxbdaFCVpHkY+HhvyyPiprwHHQgnTQMrNVs/Mz/pr42AzrRLcGnrSVMyYhwc8H445O+LSp6qJM2g3H/JykmzjSg1W9/7P7BlXVrTdNF3A4KS+0HD2mDSQUU8KFqVhoAn+xGI2daVmq1P+G8Y95q0MEuLW0DnhuRVhUduhl+eMuiNBlmS5maVDxOQkjRGUqaWNbNe7Xk0/L+/wKfugvbTYWhbxg27kmfbNq9JHtP5/muShodBkCVpXgfMlXRIqSB9v+Ue4OFqBWZNprzm2flAXnXWpD6asDuehas/ARe9rerPt2V6jEbSESSvJM8DZpCcsp0ZEUurGl0FvqZpIvMuh5u/AetWkLyakOWaBxgyAia/Ho44K8v1TlXep4GkVvkT8O50viYJY03m4JNg90Ph3l/C4/8Hzy6Gzav73q5zAzzxJ3h6Drz+/4N3fKvQsLKMGnAicC/wNDCdpOPzH6e9yIwvNBqznsZNh7ecA6ddC38/G6b8FdmuKpQ8njPnZ4Vf62Q5+snA2yLiWxGxOSLuAg4hqX3uKjQas60ZNx2O+wnseSx9nlW1Dnn5HaC7iu3nss+kiYh3RsRjPcq6I+J84LBCozHry7jpcPIVcPIsaJtceR21JjdLIXltYf3yQkPIcnr2g7LpT/VY/O1CozHLas+j4azF8DcXwKhpvOJXuWVI+nSBYNgOsP2A+7R8hSynZ+XND6f1WFY3TwpYkzr4JPjsfPh/c2C3I5JapqszeeVgxJjkles3FjvSZcYrqorTZvVj3HQ47Q/w7vNh5wOS/th22Ane8k+Fv5uTpcm5RdJIkgQrTZeSp7XQaMwG6uCTqv4CW5akGQcs4uVEWVy2rJgOBswaSJZ+z3YdjEDMGkWW8WkmbW15RDxTXDhm9S/L6dlNJKdhPbujHUsyPo2va6ypZLm5OSMi9k1/zgCOIUmkDuCsgQYgaaakByU9IukLA92fWbVl7vdM0h7p+DQ3kjQM7BsR5w3k4JJagX8D3gHsC5woad+B7NOs2rI8ETBD0mXA74Hbgf0i4qcRsbmA478ReCQiHk33dwXgrqCsrmW5plkIPAVcDbwW+G75i5wRMZDu4Cen+y5ZSvIw6Ct4UCerJ1mSpthnEPohIi4iHZK9vb3d94asprLcp7kky44k/Sgizsh5/KeBKWXzu6ZlZnWryA7Q+zMi2t3AXpKmSdqOZBDcqwuMyaxwWV93roqI6ExfN7iO5H7PpRGxqJYxmfWlpkkDEBHXANfUOg6zrIo8PfNrA9YUstyn+UbGff1kgLGYNYQsNc07s+woayubWaPLck3T2uPFs1eIiDXFhmRW37IkzT688iU0ePmp5wB8i96aSpakWVxPQ22Y1ZpHdzbLKUvS9NoqJun7BcZi1hCyvIS2tVaxDxYYi1lDGOjpmW9oWtPJ0rHG2N4W4aSxJpSl9Wwur+5Yo6SItzfNGkqW92mmDUYgZo0iy+nZwT2KAlgREU9VWt9sW5fl9OwHFcrGpi+NnRgR8wuOyayuZTk9qzjSp6R24F/p3xubZg2r303OETEHyDrou9k2o99JI2kiHjXAmlCWhoDzeXVyjAX+CvhMNYIyq2dZGgLm9JgPYCVwZkQ8X3xIZvUtS0PAzyuVS5oi6eyI+F7xYZnVr1zXNJImSPqEpNuAW4CJVYnKrI5luaYZCRwPfBjYG/gtMM0jpFmzylLTPE8yFPo3gT0i4nMU8MyZpA9IWiSpO73nY9YQsiTNOcAw4ALgHEnTCzr2QpIa7NaC9mc2KLK8hPajiDiUl8eNuQqYJOkfJe3d3wNHxP0R8WB/tzerlcwNAenAS9+OiAOAdmBH3J2sNaEsPWwe2rMsIhZGxJciYs8+tr1R0sIKn1yjnUk6XdIcSXOWL1+eZ1OzwmW5uXkBcDCApDsi4rCsO4+It/U3sB778aBOVjeynJ6Vv7E5vFqBmDWKLEnTImmMpHFl02NLn/4eWNJ7JS0FDgP+KOm6/u7LbDBlOT0bRdJPQKnGmVe2LIA9+nPgiJgFzOrPtma1lOXZs6mDEIdZw8jSenZy2fSbeiz7VDWCMqtnWU7PzgT+O50+n7QlLXUaHsxpm/DY8g5uX7KS51ZvZOKo4Rw+fRzTJvjF3Erytp717PvMnQVuAx5b3sGVc5aybmMnO48azrqNnVw5ZymPLe+odWh1KUvSRC/TleatAd2+ZCWjRwxlxxFDaZHYccRQRo8Yyu1LVtY6tLqUaVAnSfeR1CrT02nS+X61nFl9eW71RnYe9cpbcG3Dh/Ds6o0vzfv07WVZkmZG1aOwmpo4ajgdGzvZccTQl8o6NnYyMU2k0ulbd1c3Dz+/lmsWrOeiW5bwln0mcOqbpjVd8mR5yvmJiHgCWA3slH5eLCu3Bnf49HG8uGELazZsoTuCNRu28OKGLRw+fRyQnL51d3Uz78lVPPR8B6s3bOH5NRu4/K4n+eCFd/DPVy1oquufLE3OwyT9J/A4yfNfPwMel3Rp2sumNbhpE9o4oX1XdkhPyXYYPoQT2nd9qQZ5bvVGlq3ZyAvrtrBuYyfrNnUSStqAOjZ1cuMDz3PRbY82TeJkOT37MjAUmBIRa+GlV6D/DfhK+rEGN21CW6+nWRNHDWfeE6vo2LSFbgBEi4LWllZaBKvXb+a6Rc9y7cJljNthOG+aPnabPm3L0nr2XuBjpYQBSKc/kS6zbdzh08fR0iK2dAdd3d10R9Ad0NoCXd1drNvczbqNnXR1BSs7NvKLOU9t06dtWZKmOyLW9yyMiA7c5NwUpk1o4++PmMbIYUPo7A4QDGkVEdDZnSRPayts6e5mc1cwpEWs39zJ/z28Yps8bctyehaSxlD5RmZ3wfFYnTriNTvxreP259xr7+fxlevp7A522K6FzV1K/vKGaJVoaREtamFzVzctLfDkC+v4wQ0PMXXcDttMU3V/nnIu55qmiRzxmp3Ydez2XDX/af78yApWbegENgHJ6VpndyCgqzupbYa0tPDkyg10Bxy6xzg60icNyhsZGpEiivm9l7RfRCwqZGdb0d7eHnPm9Owp12rltgef51v/ez/PrtlIZ1cQ6fXO2B22Y/iQFlpaxIxJozh02jhWrN3IwmfWsKmzm7ftO7Feap3cj4IVmTTzIqLnqGmFc9LUn9sefJ7zb36Yhc+soStgp5HbsfvY7Xl0xXomjR7OkXtPgIA5T6xi7abNPLZ8/UuDuB79mgl8+q171zJ5apo090TEQYXsbCucNPXrseUdXDX/aeY/9SKlZum9dhrJ1PFt3PnoSpauWseDz65lS1c3Q1tb2NTZTQTsMX57/uld+3HEa3aqRdiuaax+lB6/GT1iKHc+upIHnl3Dqo5NhACSBoRNXUFrC4xvG8aH3jCF9xw4ebBrndxJk6nfMyWm5I/Hmln5kwZBsGFLF62tLbRItEh0E7QICFi/qZNrFz3H5351Lz+64cG6bqbOlDSRVEd9dQw44P6dbdszbUIbf3vo7nz13fsxbodhREB3QKnFrUUgwZbuYHNnFxPahrH42bV1/T5PnqE25kl6Q28L065rzSqaNqGNfzhyGkNaRFd3kFwViABaW1oYMbSVtuFD2dLdzWPL13HfUy/ygxseqsvEyZM0hwB3SFoi6T5JC8rerTHr0wfeuDv/9K4ZTGhLnvOVgh22a2Voawttw4eww3atPLZiPUNaxfiR27Fy3aa6rHGy3NwsObZqUVjT+MAbd6d92riXbpA+u2YTQ1vFpFHDeWFdJ0QwefQINncGE0YOf+kN0jq4n/OSwlrPBotbz7YtpWbq2x5awaoNm5k2bnu2GzKE9Zu7aJ86mu7u4J6nXuSAyaOr9RhOdVrPqkHS9yQ9kJ7qzZI0ulaxWO1Mm9DGZ9/+Gn7wwdex36RRbOjsZruhLbRPHQ0Bdz76AsOGttZVhx81SxrgBmD/iHgt8BDJ4FHWpKZNaONzb9+b1+06hn133pGxOwxj4TNrCGD/STvWVYcfNUuaiLg+IjrT2TsBj+HZ5Hq+Qbqps5u/mj6W8W0vd/rRNnwIz5V1+FELeRoCquk04MreFko6HTgdYLfddhusmKwGyt8gvezOJ1i3sfMVy8s7/KiVqtY0WQZ1kvQloBO4vLf9RMRFEdEeEe0TJkyoZshWR/rq8KNWqlrT9DWok6RTgXcBb41Ga8azqiudrt2+ZCXPpv2tHbvfxJo3P9fs9EzSTODzwJsrvU5tBlvv8KNWanlN8xOSodZvUNId0J0R8fEaxmMN6LYHn+fKuUtZtnoDu4wawQmv37XqrxjULGn6GuTWrC+3Pfg8P7jxYUaPGMrk0SNYs6GTH9z4MEBVE6eW92nMBuTKucm7OqO33451m7p4Yf1mXli3ie9cV91XC5w01rCWrd7AjiOGsHbjFp58YT1dXcGoEUNZtX5zVZ8ccNJYw9plVHJKtrxjE9u1tiSvUG/pZuwOw6r65ICTxhrWCa/flRc3bOHF9ZtpaYH1mztZv6WL9t1HV/XJgXp5IsAst9LF/neue5AX1m1m7A7DeNOe49hr4o6s2bClak8OOGmsoZU6MCx14NE2fMhLTw4cu9/EqhzTp2fW8PoaKqRormlsmzCYTw64pjHLyUljlpOTxiwnJ41ZTk4as5ycNGY5OWnMcnLSmOXUcD1sSloOPNHL4vHAikEMp1H4e6lsPPBARMzMs1HDJc3WSJoTEe21jqPe+HuprL/fi0/PzHJy0pjltK0lzUW1DqBO+XuprF/fyzZ1TWM2GLa1msas6pw0Zjk5acxyctKY5eSkMcvJSWOWk5PGLCcnjVlOThqznJw0Zjk1XdJI6pI0Px0w91eSti9bdpykkLRPOj9c0gOSDihb52xJF25l/x+R9HD6+UgB8U6VtCGNeb6knw50nzmPf0aP7yj3+BWSHpc0fqDr1I2IaKoP0FE2fTlwZtn8lcBtwNfKymamZQImA0uAMb3seyzwaPpzTDpdcd0c8U4FFtbw+3ocGF/p++vvPvq7Tr18mq6m6eE2YE8ASW3A4cBHgQ+VVoiIa4FlwCnAecBXI2JVL/s7FrghIl5I17mBJOmqLv1L/S9pbTRH0sGSrpO0RNLH03Uk6XtpLbtA0glp+VGSbpH067RmvTxd99PAJGC2pNllx/qWpHsl3SnpVb2MSxon6XpJiyRdTPIHp7TsZEl3pXFeKKm1wvZXSZqbbn96WnaapB+VrfMxSecV+BVmV+usrcFfzo705xDgd8A/pPMnAZek038GXl+2zSRgKTC7j32fBXy5bP4rwFkV1jsPmF/h84UK604F1gH3AP8HHNHLsR8v+7ecB9wHjAQmAM+l5e8jSeRWYCLwJLALcBSwGtiV5JT9DuDwsv2W1zQBvDud/m75v7dsnX8F/imdfme6zXhgBvB7YGi67ALglJ7HAcamP0cAC4FxQBtJLV/a9s/AAbX4HWrGDtBHSJqfTt8GXJJOnwj8OJ2+Ip2fCxARz0i6GfhDEQFExGdzrL4M2C0iVkp6PXCVpP0iYk2Fda9Ofy4A2iJiLbBW0iZJo0lq0l9ERBfwnKT/A94ArAHuioilAOn3MxW4vcIxNvPy9zAXeHuFdY4Ejk//rX+UVKqZ3wq8Hrg7HdF7BPB8he0/Lem96fQUYK+IuDP9P3iXpPtJkmdBhW2rrhmTZkNEHFheIGks8BbgAElB8pc4JJ0d6Z81oDv9bM3TJH+1S3YFbum5UnpacXSF7a+IiHPLCyJiE7ApnZ4raQmwNzCnwvabymLdVFbeTd//1+Xrd21l/S1l38nW1qtEwM8j4pxeV5COAt4GHBYR6yXdApRGZ7oY+CLwAPAfOY5bqGa/pil5P3BZROweEVMjYgrwGHBEzv1cBxwjaYykMcAxadkrRMRnI+LACp9ze64raULpvF/SHsBeJA0M/XEbcIKkVkkTSGqEu/rYZi3JaV4etwIfBpD0DpJGEYCbgPdL2ildNlbS7j22HQWsShNmH+DQ0oKI+AtJzfNh4Bc5YyqMkyZxIjCrR9lv0vLMIuIF4BvA3enn62nZQBwJ3JeeMv0a+PgA9jmL5FrnXuBm4PMR8Wwf21wEXFveEJDB14AjJS0iOU17EiAiFgNfBq6XdB/J9dUuPba9FhiSnoKdC9zZY/kvgT9F740xVefXna2hSPoDcF5E3FSrGFzTWEOQNFrSQyTXpDVLGHBN0y/pEwKX9SjeFBGH1CIeG1xOGrOcGu70bObMmUFys8wff4r45NZwSbNihfvxttpquKQxqzUnjVlOThqznJw0Zjk5acxyctKY5eSkMcvJSWOWk5PGLCcnjVlOThqznJw0Zjk5acxyctKY5eSkMcvJSWOWk5PGLCcnjVlOThqznJw0Zjk5acxyctKY5eSkMcvJSWOWk5PGLCcnjVlOThqznGqaNJKmSJotaXE6/PVnahmPWRa1Hqi2E/hcRMyTNBKYK+mGdJg5s7pU05omIpZFxLx0ei1wPzC5ljGZ9aXPmkbSLLYyjkdEHF9EIJKmAgcBf6mw7HTgdIDddtutiMOZ9VuW07OfpD8F/Dvw8aKDkNRGMpryGRGxpufyiLiIZJRh2tvb+zUQj1lR+kya8kFBJXUUPUiopKEkCXN5RPy2yH2bVUPea5pC/8pLEnAJcH9E/LDIfZtVS5Zrmh3LZlvTVi6VCiqdTuXwJuBvgQWS5qdlX4yIawawT7OqynJNs4ikhiklyuKy+QD6fWUeEbeX7desIWRJmsMiYmnVIzFrEFmuaa6uehRmDSRL0vj0yaxMltOzyZJ6bdmKiDMLjMes7mVJmg0kjQFmRrakWRkRl1Q9ErMGkeWapqvqUZg1kCw1zXskTeptYUQ8U2A8ZnUvS9LcxCtvbpLOjwUmAK1ViMusbmV5YHNG+bykKcDngXcA36lSXGZ1K/MDm5L2kHQxcCNJa9q+EXFe1SIzq1N9Jo2kGZIuA34P3A7sFxE/jYjNVY/OrA5luaZZCDxF8jjNa4HvJk/0J3xz05pNlqQ5vepRmDWQLA0BL93YlDQ8LdtYzaDM6lmmLpwkfQw4h6SZGUkrge+k7+5braxcAktmw9plMHIXmH40jJte66i2eVne3DwHOAqYGREPpWV7Az+WNC4i/qW6IVpFK5fAvP+CEWNgx0mwaS3c/mMYtQt0dTqJqihLk/OpwHGlhAFIp98H/F2V4rK+LJmdJMzwUaAW6NwELyyBZQuSJNrckSTVyiW1jnSbkyVpIiI2VChcD3QXH5JlsnYZDBv58vyKh2DEaOjekiTR8FFJUi2ZXbsYt1FZkmaZpKN6Fkp6M/Bs4RFZNiN3SU7JSjauTh5uGlbWD8qwkdDh/6KiZWkI+DRwlaTZwNy0rJ3kOue4KsVlfZl+dHL6BUlyDNkONrwIk9788jqb1kLbzrWJbxvWZ00TEQuA/YG7gH3Sz13AAekyq4Vx0+HgU2C7tuRUbacDYNye0LodRHdS82xYlSSXFSpTk3N6TePm5XozbvorW8fKm6DbdoYZ73brWRVkaXJeReWeNUXSSDC28Kisf3omkVVFloaAPwGPAOcCB5K8QzMBGJ/+HBBJl0p6XtLCge7LbDBkuaZ5F3AssAq4FLgB+CgwMiKKeBX6P4GZBezHbFBkep8mIlZFxM+AtwM/A75NkjgDFhG3Ai8UsS+zwZD12bM3AicCRwN3Ah8AbqleWK86vgd1srqRpSFgCbAWuIKkdtmSLjpAEhFxXxXjAzyok9WXLDXNMpLWs3cCf82rO9g4sgpxmdWtLO/THJ5lR5LeEhE3Dzwks/pW5OjO3+/PRpJ+AdwBvEbSUkmFNDCYVUumhoCM+jW6QEScWGAMZlVXZE3jC3RrCkXWNGb5NOjr2ln6PXtDxn09NcBYrJmUXtfe3NFwb5pmOT27MMuOIuI9A4zFmknP17Ub6E3TIq9pzLLr+bo2NMybplmuafaQ9NveFkbE8QXGY82i9Lr28FEvlzXIm6ZZkmY58G/VDsSaTM/XtTetTd40nfHu2saVQZak6YiIm6oeiTWX0uvaDfimaZakebLqUVhzatA3TbM0BNys8mECUpLGSMrUsma2LcmSNK8D5ko6pFSQvt9yD/BwtQIzq1dZnnI+TdIRwEWS5gEzSE7ZDo+IpdUO0KzeZH2M5h6SDjZKTRtnOmGsWWV5jOZE4F7gaWA6ScfnP057kRlf5fjM6k6WmuZk4G0R8Vg6f1d6ffNJkp4296hWcGb1KMs1zTsrlHUD50v6ZVWiMqtjWU7PflA2/akei79deERmdS5Lk3N5D9qn9Vh2UIGxmDWELEmjXqbNmlKWhoAWSSNJEqw0XUqe1qpFZlansiTNOGARLyfK4rJl7hfAmk6W1rNdByMQs0aRpVvaSVtbHhHPFBeOWf3Lcnp2E8lpWM/uaMeSjE8zoOsaSTOBH6f7uTgizh3I/syqLcvp2YzyeUlTgM8D7wC+M5CDS2oleSv07cBS4G5JV0fE4q1vaVY7mTvWkLSHpIuBG0kaBvaNiPMGePw3Ao9ExKMRsZlkZAL3amN1LcsTATMkXQb8Hrgd2C8ifpr+kg/UZF7ZX9rStKxnDKdLmiNpzvLlyws4rFn/ZbmmWUjyi3018Frgu+UvckbEmdUJ7WUen8bqSZakOb2Kx38amFI2v2taZla3sjQEXJJlR5J+FBFn5Dz+3cBekqaRJMuHgA/n3IfZoCqyA/TcI6JFRGf65PR1JE3Ol0bEogJjMitczUcNiIhrgGtqHYdZVu7L2SynIpPGrw1YU8hyn+YbGff1kwHGYtYQstQ0r+ojoJKsrWxmjS5LQ0BrjxfPXiEi1hQbkll9y5I0+/DKl9Dg5aeeA9itCnGZ1a0sSbM4ItyBhlnKTc5mOWVJml5bxSR9v8BYzBpCn0nTR6vYBwuMxawhDPT0zDc0relk6VhjbG+LcNJYE8rSejaXV3esUVLE25tmDSXL+zTTBiMQs0aR5fTs4B5FAayIiKcqrW+2rctyevaDCmVjJW0HnBgR8wuOyayuZTk9O7pSuaR24F/pxxubZo2s303OETEHaCswFrOG0O+kkTQRjxpgTShLQ8D5vDo5xgJ/BXymGkGZ1bMsDQFzeswHsBI4MyKeLz4ks/qWpSHg55XKJU2RdHZEfK/4sMzqV65rGkkTJH1C0m3ALcDEqkRlVseyXNOMBI4n6flyb+C3wDSPkGbNyFtS4wAAIABJREFUKktN8zzJUOjfBPaIiM9RwDNnkj4gaZGk7vSej1lDyJI05wDDgAuAcyRNL+jYC0lqsFsL2p/ZoMjyEtqPIuJQXh5s6SpgkqR/lLR3fw8cEfdHxIP93d6sVjL35RwRjwLfBr4taX/gRJI+mPesUmwvkXQ66ZAfu+3mzm9KHlvewe1LVvLc6o1MHDWcw6ePY9oEP6RRbYrY+k19SYdGxJ392rl0I7BzhUVfiojfpevcApyVPpbTp/b29pgzJ9Oq27THlndw5ZyljB4xlLbhQ3hyxToWP7uWqeO25zW77OgEyi73i5RZapoLgIMBJN0REYdl3XlEvC1vQJbN7UtWMnrEUHYcMZQVazfywHNrGdIiVm/cwrqNnVw5ZykntO/qxKmCLA0B5Zk4vFqBWD7Prd5I2/Dkb94jy9cxYrshjNp+KGs3drLjiKGMHjGU25esrHGU26YsSdMiaYykcWXTY0uf/h5Y0nslLQUOA/4o6br+7qsZTRw1nI6NnQCs2biF4UNa2LSlmx1HDAWgbfgQnlu9sZYhbrOynJ6NIuknoFTjzCtbFsAe/TlwRMwCZvVnW4PDp4/jyjlLARg5bAirN2yhO2DfSSMB6NjYycRRPjGohizPnk0dhDgsp2kT2jihfVduX7KSHYcP5cUNW5ix80jG7jCMNRu28OKGLRy7n59yqoYsj9GcHBH/nU6/KSL+VLbsUxHhcWlqZNqEtpcu9EvNz8+mzc/H7jfRjQBVkqXJeV5EHNxzutL8YHCTsxUsd5Nz3tazngdwZ4HWdLIkTfQyXWnebJuXaVAnSfeR1CrT02nS+X61nJk1sixJM6PqUZg1kCxNzk8ASBoN7JUWPxQRq6sZmFm9ytLkPAy4EDgOeIzktGx3SbOAj0eEO0G3ppKlIeDLwFBgSkQcFBEHkgxOOwT4SjWDM6tHWZLmvcDHImJtqSCd/kS6zKypZEma7ohY37MwIjpwk7M1oSytZyFpDJVvZHYXHI9Z3evPU87lXNNY0ynsKWdJ+0XEogFHZFbnBjq6c7nLCtyXWd0qMmn88KY1hSKTxtc31hQyJY0SU6odjFkjyJQ0kbypdk0fq/lxGmsKeU7P5kl6Q28L065rzbZ5mbulBQ4BTpL0BLCO5MI/IuK1VYnMrE7lSZpjqxaFWQPJ0wH6E9UMxKxRFNnknIuk70l6QNJ9kmalL7mZ1b2aJQ1wA7B/ek30EMngUWZ1r2ZJExHXR0RnOnsn4DE8rSHUsqYpdxrwv70tlHS6pDmS5ixfvnwQwzJ7tT572BzQzrMN6vQloB04PjIE4x42rWBVGdSp3/oa1EnSqcC7gLdmSRizelDVpNkaSTOBzwNvrvQ6tVm9quU1zU+AkcANkuZL+mkNYzHLrGY1TURUfVRos2qol9Yzs4bhpDHLyUljlpOTxiwnJ41ZTk4as5ycNGY5OWnMcnLSmOXkpDHLyUljlpOTxiwnJ41ZTk4as5ycNGY5OWnMcqpqxxrVIGk50Ftvn+OBFYMYTqPw91LZeOCBiJiZZ6OGS5qtkTQnItprHUe98fdSWX+/F5+emeXkpDHLaVtLmotqHUCd8vdSWb++l23qmsZsMGxrNY1Z1TlpzHJy0pjl5KQxy8lJY5aTk8YsJyeNWU5OGrOcnDRmOTlpzHJquqSR1JWOvLZQ0q8kbV+27DhJIWmfdH64pAckHVC2ztmSLtzK/j8i6eH085EC495NUoeks4raZ8bjfrFseqqkhf3YR0cR69SLpksaYENEHBgR+wObgY+XLTsRuD39SURsBM4ALlBicrr+FyrtWNJY4J+BQ4A3Av8saUxBcf+QrQwbX0Vf7HuV5tKMSVPuNmBPAEltwOHAR4EPlVaIiGuBZcApwHnAVyNiVS/7Oxa4ISJeSNe5Acj1VmAlko4DHgMWbWWdDknfk7RI0o2S3ijpFkmPSvqbdJ3hkv5D0gJJ90g6Oi0/VdJvJV2b1pDfTcvPBUakNfPl6aFaJf0sPc71kkZUiGWapDvS43yzx7KzJd0t6T5JX6uwbZukmyTNS7d/T1r+dUlnlK33LUmfyftdFiIimuoDdKQ/hwC/A/4hnT8JuCSd/jPw+rJtJgFLgdl97Pss4Mtl818Bzqqw3nnA/AqfL1RYtw24I/351Ur7S9cL4B3p9CzgemAo8Dpgflr+OeDSdHof4ElgOHAq8CgwKp1/AphS/n2l01OBTuDAdP6XwMkVYrkaOCWd/mTZd34MyeP4IvmD/QfgyAr/Lzum0+OBR9L1pwLz0vIWYAkwrha/QzUbqLaGRkian07fBlySTp8I/DidviKdnwsQEc9IupnkP3nAIuKzOVb/KnBeRHRI2tp6m4Fr0+kFwKaI2CJpAckvHCQ16flpDA9IegLYO112U0SsBpC0GNgdeKrCcR6LiNL3N7ds3+XeBLwvnb4M+E46fUz6uSedbwP2Am4t21bAtyUdCXQDk4GJEfG4pJWSDgImAvdExMrev47qacak2RARB5YXpNcibwEOkBRAKxCSzo70TxvJf2B3H/t+GjiqbH5X4JaeK0k6Dzi6wvZXRMS5PcoOAd6fnjKNBrolbYyIn/RYb0uPWDcBRES3pCz/z5vKprvo/Xej53qvOj1LVXpRS8C/RESvDSkkNf4Ekpp+i6THSWo/gItJasWdgUu3so+qavZrmpL3A5dFxO4RMTUippBcQxyRcz/XAcdIGpM2AByTlr1CRHw2ksaInp+eCUNEHJHGNBX4EfDtCgmT1W0kv5RI2hvYDXiwj222SBqa8zh/4uXrwpPKyq8DTkuvH5E0WdJOPbYdBTyfJszRJDVeySySa8Q3UOF7HSxOmsSJJP8h5X6TlmcWES8A3wDuTj9fT8vqxQVAS3rKdiVwakRs6mObi4D7yhoCsvgM8Mn0OJNLhRFxPfA/wB3psl8DI3tseznQni4/BXigbPvNwGzglxHRlSOeQvl1Z2sYklqAecAHIuLhWsXhmsYagqR9SVrSbqplwoBrmn5JnxC4rEfxpog4pBbx2OBy0pjl1HCnZzNnzgyS5kx//Cnik1vDJc2KFe7H22qr4ZLGrNacNGY5OWnMcnLSmOXkpDHLyUljlpOTxiwnJ41ZTk4as5ycNGY5OWnMcnLSmOXkpDHLyUljlpOTxiwnJ41ZTk4as5ycNGY5OWnMcnLSmOXkpDHLyUljlpOTxiwnJ41ZTk4as5ycNGY51TRpJE2RNFvS4nS04NqM1muWQ63H3OwEPhcR8ySNBOZKuiEiFtc4LrNe1bSmiYhlETEvnV4L3E/ZcHNm9ajPmkbSLLYyJEFEHF9EIJKmAgcBf6mw7HTgdIDddtutiMOZ9VuW07PSSMIC/h34eNFBpKP9/gY4IyLW9FweEReRDJhKe3t7v8YUMStKn0kTETeVpiV1lM8XIR1u+zfA5RHx2yL3bVYNea9pCv0rL0nAJcD9EfHDIvdtVi1Zrml2LJttTVu5VCqodDqVw5uAvwUWSJqfln0xIq4ZwD7NqirLNc0ikhqmlCiLy+YD6PeVeUTcXrZfs4aQJWkOi4ilVY/ErEFkuaa5uupRmDWQLEnj0yezMllOzyZL6rVlKyLOLDAes7qXJWk2kDQGmBnZkmZlRFxS9UjMGkSWa5quqkdh1kCy1DTvkTSpt4UR8UyB8ZjVvSxJcxOvvLlJOj8WmAC0ViEus7qV5YHNGeXzkqYAnwfeAXynSnGZ1a3MD2xK2kPSxcCNJK1p+0bEeVWLzKxO9Zk0/3979x4nR1Xmf/zzzWSSGZjcE8MlgYSgEDAIOHJZgxJkIQouF0GMssrCz6zr+hIXLyuiv9+6KrIiooIsIOAly0pc1yAoyx0WoiBMQgxJuGWISCBACCHJQCaZyTy/P6qadJqezKmequnq6ef9evVr6l5POvPMqTp16hxJ0yXNA24GFgIHmtmVZrY18+icy6GQe5plwLNEzWkOAr4TteiP+MNNV29CkmZu5lE4V0NCKgLeeLApqSle1pllUM7lWVBFgKRPSnoaeAF4QVJ73NmFc3UnpCLgfOA0YLaZjTaz0UTVzafE65yrKyElzVnAyWb2ZGFBPP0h4O8yisu53ApJGjOzzWUWvg70pB+Sc/kWkjRrJB1dulDSe4nucZyrKyFVzp8FbpR0D7AoXtYKHA2cnFFcLivr2qH9Hti0BkbsDtNmwbhp1Y6qpvRZ0pjZo8DbgYeA/ePPQ8CMeJ2rFevaYfHPYWsHdG6CRT+Bn54A158OK++pdnQ1I2jUgPie5uqMY3FZa78HmsfAxufhqVuhcRdoHgdrn4KbPwuTD4e9jvDSpw8hnQWup3zPmiKqJBibelQuG5vWwMg94NmHooQZtgt0bYYtG6NkevkpGLEb/O7zMHYfeMsBnkBlhFQE/B5YCVwEHEz0Ds0EYHz8s18kXSfpJUnL+nss14cRu8OWTbD5VRjaHC3rfBWGDoemkfD6WnhpBXRtgdWLYMVvogTyS7cdhNzTnAgcD6wHrgPuAM4BRphZGq9C/xSYncJxXF+mzYLN62H4rtD9OmzrihKkeXRU4iDo6YHN66DrNRi6C2xcA789F+79dnRP5ILvadYDP47fp/kIcBkwArikvwGY2X3x2DQua+OmwaEfhy2vwxM3wfDR0DIRurdCTxe0vAU6N4CGgBrg1T/D0Ebo6YY/PwAr74YhQ6NLu8mtMOPDdXnpFtr27DBJlwKPAO8FTgcGrJd/SXMltUlqW7t27UCddnAaNw1OvBhOuhImHgANjTBkCEx9L4ydGpVE1hPdsQ5tBARDGqP7nY4XoXMjDG2CVQvh9z+sy9InpCKgHdgE3EB0WdYVr5ohCTNbmmF8gA/qlIl9Z0Uf2P7s5qUVUaLsMh42vxJV//RsBXpAFt339GyLKhAkeG1ttF+dlTYhl2driL6+E4AP8OYONt6TQVxuII2btv0Xf+U98IcfRJdraoARe8ArT0Njc/S/PbQp2q6xKapQ6Ki/RiEh79PMDDmQpGPM7O7+h+Sqat9ZMGYv+NMv4em7o2SZsB+sfwa6XofRb4u26+qEhmHQstubjzHIWx2kObrzdyvZSdIvgAeA/SStlnROijG5SoybBsecD6dcCdOOgVGTokuzptFR6bP19ejeZ9cJUUIUK251MKQxSrwFnxpUtW9BtWeBKhpdwMzmpBiDS1PxZdu69qj0eb4tukybOrN87Vmh1UH3FlgdP0Qdugus+G1U+7bvMTVf65Zm0vgN+mBWKH36Umh18MKjUcJs64aONVGN3K5TYM2j0aXdoR+v2cRJ8/LMue2tDjo3RJUGr70YPfcZPgKGNUcVDM1johKpRoVUOb/LzB4OONazKcTjat20WdE9zdBh0B23a1MDjJgYlTDDR0YJtGlNtH3hsu+5tmi+Bh6ahpQ0V4UcyMxO6mcsbjAotDp4ywzoeAkamqLLNQ2Nat8m7BeVRC27RQmz8AfwzMKoCntbNyz9JfzXWbmuOPDLM5e+4tq3/U+Era9F9zSTD4+qqTevj0qk9ntg88vR5dq2bdEzn4bhUfu3NY9GJVYOEyekImAfSb/ubaWZnZpiPG4wKSTPOz4cJUjHCzBsHEz/YLRuyX9GtWxNY2Bje9QaoWFYVKXd0xW1Prj7m9FrCjl63hOSNGuBH2UdiBvEiquui43YHdY+Bt2dUSvrxuao5fWQoWCCl5ZHjUWnzIwu6Rb/PBe1biFJ02Fmd2Ueias/02bBmqXwSjsMiR+a9nRDywQYItjWALuOjWrfmkZF++SgrVvIPc1fMo/C1adx02DmubD3zKhGrXszjJ4E+8yKEsi2RRUHBcNH5KKtW0hJc7ckmdkODy8ljQEuMrO/zyY0VxfeeGh6/vY2ax0vwK7jo+Y7uxa9HFyodauykKR5B7BI0j+Y2R8her8F+ApweZbBuTpT2mxn8c+jh6TDR8Svaa+PKhGKVaFxqEoKkPIbSUcRJchiYDrRJdt5ZrY60+jKaG1ttba2toE+rauG4pKnZbc3J0QhsZrH7JhYySoLEreZDG179ghRBxuFNK9Kwrg601utW0GhcWihkmCAKgtCRg2YA/wJeA6YRtTx+Q/iXmTGZxaZc33ZtCYqYYoNQGVBSO3ZmcCxZvYtM9tqZg8BhxOVPg9lGp1zO1NoHFpsACoLQrpwOsHMVpUs6zGzy4AjM4vMub4UuqTq3BA10+ncsL2JToZCLs8uKZr+TMnqC1OPyLlQhcahw1qiS7VhLQPSYiCkIqA4bc9mx2rmQ9INx7mE+qosyEDIPY16mXauLoWUNEMkjSBKsMJ0IXkaMovMuZwKSZpxwHK2J8qKonXeL4CrOyH9nk0aiECcqxUhfQTssbP1ZvZ8euE4l38hl2d3EV2GlXZHO5ZofBq/r3F1JeTh5nQzOyD+OR04jiiROoAv9DcASbMlPSFppaQv9/d4zmUtuGMNSfvE49PcSVQxcICZXdqfk0tqIHqV+v3AAcAcSQf055jOZS2kRcB0SfOAm4GFwIFmdqWZbU3h/IcBK83s6fh4NwDeFZTLtZB7mmVEHQHeBBwEfEfafntjZuf14/x7smMng6uJGoPuIH7pbS7AXnvt1Y/TOdd/IUkzN/Mo+uCDOrk8CXlOc23IgSR938w+l/D8zwGTi+Ynxcucy600e9isZES0h4G3SpoqaRjRILg3pRiTc6lLc6iNxMysO37d4Dai5z3XmdnyasbkXF+qmjQAZnYLcEu143AuVJqXZ/7agKsLIc9pvhF4LO8DzdWFkJLmhJADhdayOVfrQu5pGkpePNuBmW1MNyTn8i0kafZnx5fQYHurZwP8Eb2rKyFJs8LMvAMN52I+fKBzCYUkTa+1YpK+m2IsztWEkJfQdlYr9uEUY3GuJvT38swfaLq6E9KxxtjeVuFJ4+pQSO3ZIt7csUZBGm9vOldTQt6nmToQgThXK0Iuzw4tWWTAy2b2bLntnRvsQi7PLimzbGz80tgcM1uSckzO5VrI5VnZEXIktQI/pLI3Np2rWRVXOZtZG9CSYizO1YSKk0bSRHzUAFeHQioCLuPNyTEW+Cvg3CyCci7PQioC2krmDVgHnGdmL6UfknP5FlIR8LNyyyVNlvRFM7s4/bCcy69E9zSSJkj6tKT7gXuBiZlE5VyOhdzTjABOBT4KvA34NTDVR0hz9SqkpHmJaCj0bwL7mNnnSaHNmaTTJS2X1BM/83GuJoQkzfnAcOAK4HxJaQ3avoyoBLsvpeM5NyBCXkL7vpkdwfZxY24E9pD0z5LeVumJzewxM3ui0v2dq5bgioB44KULzWwG0AqMxLuTdXUopIfNI0qXmdkyM7vAzPbtY987JS0r80k02pmkuZLaJLWtXbs2ya7OpS7k4eYVwKEAkh4wsyNDD25mx1YaWMlxfFAnlxshl2fFb2w2ZRWIc7UiJGmGSBojaVzR9NjCp9ITSzpF0mrgSOB3km6r9FjODaSQy7NRRP0EFEqcxUXrDNinkhOb2QJgQSX7OldNIW3PpgxAHG6ArVrbwcL2dby4oZOJo5qYOW0cUyf461EhQmrPziyafnfJus9kEZTL1qq1HcxvW82zL7/GM+te43+WruFrv1nO/U94o/UQIfc05xVNX1ay7uwUY3EDZGH7Onq29fD4i5vYus2YMGI4Q4eIqxeuYtXajmqHl3tJa89K+z7zzgJr0IsbOlmzsZPmYUNpbmxAEqN2aaS7p4eF7euqHV7uhSSN9TJdbt7VgImjmljXsZWmodv/+7d09TC+ZTgvbuisYmS1ISRp9pe0VNKjRdOF+f0yjs9lYOa0cQwZIjZs7sIwOru28frWbew+somJo/xRXF9CqpynZx6FG1BTJ7Tw90dN5eqFq3hpUyfjW4az/9gWhgwZwsxp46odXu6FVDk/AyBpNPDWePGTZrYhy8Bcto7a7y1MGruLVztXIOTNzeHAVcDJwCqim/+9JS0APmVm3gl6jZo6oaVfSVKvz3pCLs++CjQCk81sE7zxCvSPgK/FH1dnCs96Rjc3stuoJv7y8mt8bdkLTBm3C/vtPnJQJ1BIRcApwCcLCQMQT386Xufq0ML2dYxubmRkcyOvdGzh8Rc3MXSI2NDZxWud3cxvWz1on/mElDQ9ZvZ66UIz65DkVc516sUNnewW17StXPsazcOG0tQ4hA2bu3hxw+s8sGo9tzz6PAdNGs0Z75zEUfu9pcoRpyckaUzSGMo/yOxJOR5XIyaOaqKjs5uRzY1s7OxiVFMjW7p62Ly1mzseW0vzsCEMaxhCR2c3l9z5FMCgSZxKWjkX85KmTs2cNo75basBGDF8KBs2d9FjsP71LpqHNTCsYQgNDWL0LsMAmL9odf0kTWgrZ0kHmtnyfkfkasLUCS2c0TqJhe3rGNnUyKubu5i+2wj+vK6DXYc1sHVbD3uP3gWAkc1Def7VwdPSIKSkCTWP+LVoVx+Kq6wL1c/Dhg6hu8fYe9yutAxvBGDj5u437n8GgzSTxhtv1rFCAk0Z08wldz5F9zajx3rYuLmbVzd3cc67p1Q7xNSkmTR+f+PeuG+Zv2g1z78a1bCd8+4pg+Z+BgKTRpKAST44rQtx1H5vGVRJUiqos0AzM/ruGNCb07i6kGSojcWS3tXbyrjrWucGvST3NIcDH5P0DPAa0Y2/mdlBmUTmXE4lSZrjM4vCuRoSnDSF92qcq3cVD4neX5IulvR4/Or0gvglN+dyr2pJA9wBvD2+J3qSaPAo53KvakljZrebWXc8+yDgY3i6mlDNkqbY2cD/9LbSx6dxeaLouWVGB5fuBHYrs+oCM/tNvM0FRCOrnWoBwbS2tlpbW1u6gbp6lrjNZJptz96kr0GdJJ0FnAi8LyRhnMuDTJNmZyTNBr4EvLfc69TO5VU172kuB0YAd0haIunKKsbiXLCqlTR9DXLrXF7lpfbMuZrhSeNcQp40ziXkSeNcQp40ziXkSeNcQp40ziXkSeNcQp40ziXkSeNcQp40ziXkSeNcQp40ziXkSeNcQp40ziXkSeNcQpl2rJEFSWuB3nr7HA+8PIDh1Ar/XsobDzxuZrOT7FRzSbMzktrMrLXaceSNfy/lVfq9+OWZcwl50jiX0GBLmqurHUBO+fdSXkXfy6C6p3FuIAy2ksa5zHnSOJeQJ41zCXnSOJeQJ41zCXnSOJeQJ41zCXnSOJeQJ41zCXnSOJdQ3SWNpG3xyGvLJP2XpF2K1p0sySTtH883SXpc0oyibb4o6aqdHP8Tkp6KP59IId5GST+T9KikxySd399jJjz/V4qmp0haVsExOtLYJjfMrK4+QEfR9PXAeUXz84H7ga8XLZsdLxOwJ9AOjOnl2GOBp+OfY+LpstsmiPejwA3x9C7An4EpVfq+pgDL+nOM/myTl0/dlTQl7gf2BZDUAswEzgE+UtjAzG4F1gAfBy4F/sXM1vdyvOOBO8zslXibO4iSrj8M2FXSUKAZ2ApsLN1IUoekiyUtl3SnpMMk3SvpaUl/E2/TJOkncan1iKRZ8fKzJP1a0q1xCfmdePlFQHNcMl8fn6pB0o/j89wuqblMLFMlPRCf55sl674o6WFJSyV9vcy+LZLukrQ43v+kePm/Svpc0XbfknRuZV9pP1U7awf6Q/wXjWi80d8A/xDPfwy4Np7+A/DOon32AFYD9/Rx7C8AXy2a/xrwhTLbXQosKfP5cpltG4EbgLXAa8DcXs5twPvj6QXA7fG+7wCWxMs/D1wXT+8P/AVoAs4iKhVHxfPPAJOLv694egrQDRwcz/8SOLNMLDcBH4+n/7HoOz+OqDm+iG4Nfgu8p8z/y8h4ejywMt5+CrA4Xj6EqMQfV43foaoNVFtFzZKWxNP3A9fG03OAH8TTN8TziwDM7HlJdxP9J/ebmf1Tgs0PA7YRJe4Y4H5Jd5rZ0yXbbQVujacfBbaYWZekR4l+4SAqSS+LY3hc0jPA2+J1d5nZBgBJK4C9gWfLxLPKzArf36KiYxd7N/CheHoe8G/x9HHx55F4vgV4K3Bf0b4CLpT0HqCH6JJ4opn9WdI6SYcAE4FHzGxdmXNnrh6TZrOZHVy8QNJY4BhghiQDGgCT9EWL/7QR/Qf29HHs54Cji+YnAfeWbiTpUmBWmf1vMLOLSpZ9FLjVzLqAlyT9HmglKhmKdZXEugXAzHriS7u+bCma3kbvvxul273p8ixW7kUtAd82s14rUohK/AlEJX2XpD8TlX4A1xCVirsB1+3kGJmq93uagtOAeWa2t5lNMbPJwCrgqITHuQ04TtIYSWOI/qreVrqRmf2TmR1c5lOaMBBdQh0DIGlX4Ajg8YRxFdxP9EuJpLcBewFP9LFPl6TGhOf5PdvvCz9WtPw24Oz4/hFJe0p6S8m+o4CX4oSZRVTiFSwgukd8F2W+14HiSROZQ/QfUuy/4+XBzOwV4BvAw/HnX+Nl/fEjoEXS8viYPzGzpRUe6wpgSHzJNh84y8y29LHP1cDSooqAEOcC/xifZ8/CQjO7HfhP4IF43a+AESX7Xg+0xus/TtEfCDPbCtwD/NLMtiWIJ1X+urOrGZKGAIuB083sqWrF4SWNqwmSDiCqSburmgkDXtJUJG4hMK9k8RYzO7wa8biB5UnjXEI1d3k2e/ZsI6rO9I9/0vgkVnNJ8/LL3o+3q66aSxrnqs2TxrmEPGmcS8iTxrmEPGmcS8iTxrmEPGmcS8iTxrmEPGmcS8iTxrmEPGmcS8iTxrmEPGmcS8iTxrmEPGmcS8iTxrmEPGmcS8iTxrmEPGmcS8iTxrmEPGmcS8iTxrmEPGmcS8iTxrmEPGmcS8iTxrmEPGmcS6iqSSNpsqR7JK2Ih9iuzhDXziVQ7YFqu4HPm9liSSOARZLuMLMVVY7LuV71mTSSFrCTIQnM7NRKT25ma4A18fQmSY8RjdHoSeNyK6SkuTz+KeDfgU9lEYikKcAhwB/LrJsLzAXYa6+9sji9c8ESjYQm6REzOyT1IKIhsv8X+JaZ/Xpn27a2tlqj6ShMAAAgAElEQVRbW1vaIbj6paQ7JK0IqGjkqJ2Jx6j/b+D6vhLGuTwIuacZWTTbEN+wv5GdZrax0pNLEnAt8JiZfa/S4zg3kELuaZYTlTCFRFlRNG9Af24y3g38LfCopCXxsq+Y2S39OKZzmQpJmiPNbHUWJzezhVRwTelcNYXc09yUeRTO1ZCQpPGSwLkiIZdne0rq9SbdzM5LMR7nci8kaTYTVQY45whLmnVmdm3mkThXI0LuabZlHoVzNSSkpDlJ0h69rTSz51OMx7ncC0mau9jx4Sbx/FhgAtCQQVzO5VafSWNm04vnJU0GvgS8H/i3jOJyLreCG2xK2kfSNcCdRLVpB5jZpZlF5lxO9Zk0kqZLmgfcDCwEDjSzK81sa+bROZdDIfc0y4BniZrTHAR8J2qcHPGHm67ehCTN3MyjcK6GhFQEvPFgU1JTvKwzy6Ccy7OgigBJn5T0NPAC8IKk9vi9fefqTkhFwPnAacBsMxttZqOJqptPidc5V1dCSpqzgJPN7MnCgnj6Q8DfZRSXc7kVkjRmZpvLLHwd6Ek/JOfyLSRp1kg6unShpPcS3eM4V1dCqpw/C9wo6R5gUbysFTgaODmjuJzLrT5LGjN7FHg78BCwf/x5CJgRr3OurgR1gB7f01ydcSzO1YSQzgLXU75nTRFVEoxNPSrnciykIuD3wErgIuBgondoJgDj45/9Iuk6SS9JWtbfYzk3EELuaU4EjgfWA9cBdwDnACPMLI1XoX8KzE7hOM4NiKBmNGa23sx+DPw18GPgQqLE6Tczuw94JY1jOTcQgioCJB0GzAFmAQ8CpwP3ZheWc/kVUhHQDmwCbiAqXbriVTMkYWZLM4yvEIMP6uRyI6SkWUNUe3YC8AHe3MHGezKIawdmdjVxlXdra2vqY+Q4l0TI+zQzQw4k6Rgzu7v/ITmXb2kOif7dSnaS9AvgAWA/SaslpVLB4FxW0hwSvaLRBcxsTooxOJe5NEsav9dwdSHNpHGuLoRUOb/LzB4OONazKcTj6sm6dmi/BzatgRG7w7RZMG5ataPqU0hJc1XIgczspH7G4urJunZY/HPY2gEj94h+Lv55tDzn/PLMVUf7PdA8BppGgYZEP5vHRMtzLqT2bB9Jv+5tpZmdmmI8rl5sWhOVMMWGj4iW51xI0qwFfpR1IK7OjNgdtmyKSpiCLZugZbfqxRQoJGk6zOyuzCNx9WXarOgeBqISZssm2Lwepn+wunEFCLmn+UvmUbj6M24aHPpxGNYSXZINa4nma6D2LKSkuVuSzGyHh5eSxgAXmdnfZxOaG/TGTauJJCkVUtK8A1gk6fDCgrip/iPAU1kF5lxehbRyPlvSUcDVkhYD04ku2Waa2eqsA3QuyAA+KA19TvMIUQcbxwJ7At/3hHG5McAPSkNGDZgD/Al4DphG1PH5D+JeZMZnEpVzSQzwg9KQkuZM4Fgz+5aZbTWzh4DDiUqfhzKJyrkkNq2Jqq2LDR8BHdl0NR7ShdMJZraqZFmPmV0GHJlJVM4lUXhQWizDB6Uhl2eXFE1/pmT1halH5FxS02ZFD0Y7N4D1RD83r4+WZyDk8qz4zGeXrDskxVicq8wAPygNebipXqady48BfFAakjRDJI0gKpUK04XkacgsMudyKiRpxgHL2Z4oK4rWeb8Aru6EtAiYNBCBOFcrQvoI2GNn683s+fTCcS7/Qi7P7iK6DCvtjnYs0fg0fl/j6krIw83pZnZA/HM6cBxRInUAX+hvAJJmS3pC0kpJX+7v8ZzLWnDHGpL2kXQNcCdRxcABZnZpf04uqYHoVer3AwcAcyQd0J9jOpe1kBYB0yXNA24GFgIHmtmVZrY1hfMfBqw0s6fj490AeFdQLtdC7mmWEXUEeBNwEPAdafvtjZmd14/z78mOnQyuJmoMugMfn8blSUjSzM08ij74+DQuT0Ke01wbciBJ3zezzyU8/3PA5KL5SfEy53IrzR42KxkR7WHgrZKmShoGfIToMtC53EpzfJrEzKw7ft3gNqLnPdeZ2fJqxuRcX6qaNABmdgtwS7XjcC5Umpdn/tqAqwshz2m+EXisy/sZi3M1IaSkOSHkQKG1bM7VupB7moaSF892YGYb0w3JuXwLSZr92fElNNje6tkAf0Tv6kpI0qwwM+9Aw7mYDx/oXEIhSdNrrZik76YYi3M1IeQltJ3Vin04xVicqwn9vTzzB5qu7oR0rDG2t1V40rg6FFJ7tog3d6xRkMbbm87VlJD3aaYORCDO1YqQy7NDSxYZ8LKZPVtue+cGu5DLs0vKLBsbvzQ2x8yWpByTc7kWcnlWdpAPSa3AD6nsjU3nalbFVc5m1ga0pBiLczWh4qSRNBEfNcDVoZCKgMt4c3KMBf4KODeLoJzLs5CKgLaSeQPWAeeZ2Uvph+RcvoVUBPys3HJJkyV90cwuTj8s5/IrUW80kiYApwNzgD2ABVkEVU9Wre1gYfs6XtzQycRRTcycNo6pE7x+Jc9COtYYIekTkm4DHgKmAVPNbJqZ9XuojXq2am0H89tW81pnN7uNauK1zm7mt61m1dqOaofmdiKkpHmJKFm+Ciw0M5N0SrZh1YeF7esY3dzIyOZGgDd+Lmxf56VNjoVUOZ8PDAeuAM6XlMq405JOl7RcUk/8oLTuvLihk5amHf9utTQN5cUNnVWKyIUIeQnt+2Z2BNvHjbkR2EPSP0t6Wz/OvQw4FbivH8eoaRNHNdHR2b3Dso7ObiaOaqpSRC5E8MPNeOClC81sBtAKjKQf3cma2WNm9kSl+w8GM6eN49XNXWzc3EWPGRs3d/Hq5i5mThtX7dDcToRUBBxRuszMlpnZBWa2bzZhvSmGuZLaJLWtXbt2IE45IKZOaOGM1kns2jSUFzZ0smvTUM5oneT3MzkXUhFwBXAogKQHzOzI0INLuhPYrcyqC8zsN6HHGcyDOk2d0OJJUmNCkqb4jc1EF9tmdmyycJzLv5CkGSJpDNGlXGH6jUQys1eyCs65PApJmlFE/QQUEmVx0ToD9qnkxPGznsuACcDvJC0xs+MrOZZzAymk7dmULE5sZgvwZjiuBoXUnp1ZNP3uknWfySIol71VazuY9+AzfPe2J5j34DPedCeBkOc05xVNX1ay7uwUY3EDxNu89U9I0qiX6XLzrgYUt3kbIjGyuZHRzY0sbF9X7dBqQkjSWC/T5eZdDfA2b/0TNKiTpKVEpcq0eJp4vqKaM1ddhTZvhVbV4G3ekghJmumZR+EG1Mxp45jfthqISpiOzm5e3dzF8QdOrHJktSGklfMzZvYMsAF4S/x5tWi5qzHe5q1/QnqjGQ5cBZwMrCK6LNtb0gLgU2bmnaDXIG/zVrmQioCvAo3AZDM7xMwOJhqcdijwtSyDcy6PQpLmFOCTZrapsCCe/nS8zrm6EpI0PWb2eulCM+vAq5xdHQqpPbPSls1FelKOx7ncq6SVczEvaVzdSa2Vs6QDzWx5vyNyLuf6O7pzsXkpHsu53EozabzxpqsLaSaN39+4uhCUNIpMzjoY52pBUNKYmdF3x4DenMbVhSSXZ4slvau3lXHXtc4NeknGpzkc+JikZ4DXiG78zcwOyiQyV7fyPmZPkqTx7pVc5gr9F4xubmS3+GW5+W2rc/XqQnDS+LszbiDUwpg9aVY5JyLpYkmPS1oqaYGk0dWKxeVHLfRfULWkAe4A3h7fEz1JNHiUq3O1MGZP1ZLGzG43s8K38yAwqVqxuPyohTF7qlnSFDsb+J9qB+Gqrxb6L0g0JHpSIePTSLoA6Aau38lx5gJzAfbaa68MInV5kvf+CxQ97K/SyaWzgL8H3lfu7dByWltbra2tLdO4XF1J3NA405JmZyTNBr4EvDc0YZzLg2re01wOjADukLRE0pVVjMW5YFUraQZqkFvn0paX2jPnaoYnjXMJedI4l5AnjXMJedI4l5AnjXMJedI4l5AnjXMJedI4l5AnjXMJedI4l5AnjXMJedI4l5AnjXMJedI4l5AnjXMJVbWPgEpIWgv01tvneODlAQynVvj3Ut544HEzm51kp5pLmp2R1GZmrdWOI2/8eymv0u/FL8+cS8iTxrmEBlvSXF3tAHLKv5fyKvpeBtU9jXMDYbCVNM5lzpPGuYQ8aZxLyJPGuYQ8aZxLyJPGuYQ8aZxLyJPGuYQ8aZxLyJPGuYTqLmkkbYtHXlsm6b8k7VK07mRJJmn/eL5J0uOSZhRt80VJV+3k+J+Q9FT8+UQK8X4sjrfw6ZF0cH+Pm+D8nyv5jjoqOMafJY3v7za5YWZ19QE6iqavB84rmp8P3A98vWjZ7HiZgD2BdmBML8ceCzwd/xwTT5fdtsLYZwDtA/x9/RkYX+77q/QYlW6Tl0/dlTQl7gf2BZDUAswEzgE+UtjAzG4F1gAfBy4F/sXM1vdyvOOBO8zslXibO4iSLi1zgBvKrYj/Un87Lo3aJB0q6TZJ7ZI+FW8jSRfHpeyjks6Ilx8t6V5Jv4pL1uvjbT8L7AHcI+meonN9S9KfJD0oaWKZWMZJul3ScknXUDSCsqQzJT0Ux3mVpIYy+98oaVG8/9x42dmSvl+0zSclXVrpF9kv1c7agf4Q/6UkGm/0N8A/xPMfA66Np/8AvLNonz2A1cA9fRz7C8BXi+a/BnyhzHaXAkvKfL7cx/Hbgbf3su7PRf+WS4GlRAMBTwBejJd/iCiRG4CJwF+A3YGjgQ3AJKJL9geAmUXHLS5pDPhgPP2d4n9v0TY/BP5vPH1CvM94YDpwM9AYr7sC+HjpeYCx8c9mYBkwDmiJ//2Fff8AzKjG71DVBqqtomZJS+Lp+4Fr4+k5wA/i6Rvi+UUAZva8pLuB36YRgJn9U9J9JB0OvG5my3ay2U3xz0eBFjPbBGyStEXSaKKS9Bdmtg14UdL/Au8CNgIPmdnq+FxLgCnAwjLn2Mr272ER8NdltnkPcCqAmf1OUqFkfh/wTuBhSRAlxUtl9v+spFPi6cnAW83swfj/4ERJjxElz6M7+S4yU49Js9nMdriRljQWOAaYIcmI/hKbpC9a/GcN6Ik/O/Mc0V/tgknAvaUbxZcVs8rsf4OZXdTLsT8C/KKP82+Jf/YUTRfm+/q/Lt5+20627yr6Tna2XTkCfmZm5/e6gXQ0cCxwpJm9LuleoClefQ3wFeBx4CcJzpuqer+nKTgNmGdme5vZFDObDKwCjkp4nNuA4ySNkTQGOC5etgMz+yczO7jMp2zCSBoCfJhe7mcSuB84Q1KDpAlEJcJDfeyziegyL4n7gI8CSHo/UaUIwF3AaZLeEq8bK2nvkn1HAevjhNkfOKKwwsz+SFTyfJS+/4BkxpMmMgdYULLsv+PlwczsFeAbwMPx51/jZf31HuBZM3u6n8dZQHSv8yfgbuBLZvZCH/tcDdxaXBEQ4OvAeyQtJ7pM+wuAma0AvgrcLmkp0f3V7iX73goMjS/BLgIeLFn/S+D31ntlTOb8dWdXUyT9FrjUzO6qVgxe0riaIGm0pCeJ7kmrljDgJU1F4hYC80oWbzGzw6sRjxtYnjTOJeSXZ84lVHNJM3v2bCN6wuwf/6TxSazmkubll73ze1ddNZc0zlWbJ41zCXnSOJeQJ41zCXnSOJeQJ41zCXnSOJeQJ41zCXnSOJeQJ41zCXnSOJeQJ41zCXnSOJeQJ41zCXnSOJeQJ41zCXnSOJeQJ41zCXnSOJeQJ41zCXnSOJeQJ41zCXnSOJeQJ41zCXnSOJeQJ41zCVU1aSRNlnSPpBXx8NfnVjMe50JUe6DabuDzZrZY0ghgkaQ74mHmnMulqpY0ZrbGzBbH05uAx4A9qxmTc33ps6SRtICdDElgZqemEYikKcAhwB/LrJsLzAXYa6+90jidcxULuTy7PP4p4N+BT6UdhKQWotGUP2dmG0vXm9nVRKMM09raWtGYIs6lpc+kKR4UVFJH2oOESmokSpjrzezXaR7buSwkvadJ9a+8JAHXAo+Z2ffSPLZzWQm5pxlZNNsQ13KpsKDc5VQC7wb+FnhU0pJ42VfM7JZ+HNO5TIXc0ywnKmEKibKiaN6Aiu/MzWxh0XGdqwkhSXOkma3OPBLnakTIPc1NmUfhXA0JSRq/fHKuSMjl2Z6Seq3ZMrPzUozHudwLSZrNRJUBzjnCkmadmV2beSTO1YiQe5ptmUfhXA0JKWlOkrRHbyvN7PkU43Eu90KS5i52fLhJPD8WmAA0ZBCXc7kV0mBzevG8pMnAl4D3A/+WUVzO5VZwg01J+0i6BriTqDbtADO7NLPInMupPpNG0nRJ84CbgYXAgWZ2pZltzTw653Io5J5mGfAsUXOag4DvRC36I/5w09WbkKSZm3kUztWQkIqANx5sSmqKl3VmGZRzeRZUESDpk5KeBl4AXpDUHnd24VzdCakIOB84DZhtZqPNbDRRdfMp8Trn6kpISXMWcLKZPVlYEE9/CPi7jOJyLrdCksbMbHOZha8DPemH5Fy+hSTNGklHly6U9F6iexzn6kpIlfNngRsl3QMsipe1AkcDJ2cUl3O51WdJY2aPAm8HHgL2jz8PATPidc7VlaBRA+J7mqszjsW5mhDSWeB6yvesKaJKgrGpR+VcjoVUBPweWAlcBBxM9A7NBGB8/LNfJF0n6SVJy/p7LOcGQsg9zYnA8cB64DrgDuAcYISZpfEq9E+B2Skcx7kBEdSMxszWm9mPgb8GfgxcSJQ4/WZm9wGvpHEs5wZCUEWApMOAOcAs4EHgdODe7MJ60/l9UCeXGyEVAe3AJuAGotKlK141QxJmtjTD+AAf1MnlS0hJs4ao9uwE4AO8uYON92QQl3O5FfI+zcyQA0k6xszu7n9IzuVbmqM7f7eSnST9AngA2E/SakmpVDA4l5WgioBAFY0uYGZzUozBucylWdL4DbqrC2kmjXN1IeR153cFHuvZfsbiXE0IKWmuCjmQmZ3Uz1icqwl+eeZcQiG1Z/tI+nVvK83s1BTjcS73QpJmLfCjrANxrlaEJE2Hmd2VeSTO1YiQe5q/ZB6FczUkJGnuVvEwATFJYyQF1aw5N5iEJM07gEWSDi8siN9veQR4KqvAnMurkFbOZ0s6Crha0mJgOtEl20wzW511gM7lTWiDzUeIOtj4YDx/nieMq1chzWjmAH8CngOmEXV8/oO4F5nxGcfnXO6ElDRnAsea2ap4/qH4/uYfiXra3Cer4JzLo5B7mhPKLOsBLpP0y0yici7HQi7PLima/kzJ6gtTj8i5nAupcp5VNH12ybpDUozFuZoQkjTqZdq5uhRSETBE0giiBCtMF5KnIbPInMupkKQZByxne6KsKFrn/QK4uhNSezZpIAJxrlaEdEu7x87Wm9nz6YXjXP6FXJ7dRXQZVtod7Vii8Wn8vsbVlZDxaaab2QHxz+nAcUSJ1AF8ob8BSJot6QlJKyV9ub/Hcy5rwR1rSNpH0jXAnUQVAweY2aX9ObmkBqJXqd8PHADMkXRAf47pXNZCWgRMlzQPuBlYCBxoZlea2dYUzn8YsNLMno6PdwPgXUG5XAu5p1lG1BHgTcBBwHeKX+Q0s/P6cf492bGTwdXA4aUb+aBOLk9CkmZu5lH0wQd1cnkS8pzm2pADSfq+mX0u4fmfAyYXzU+KlzmXW2n2sFnJiGgPA2+VNFXSMOAjRJeBzuVWmuPTJGZm3fHrBrcRPe+5zsyWVzMm5/pS1aQBMLNbgFuqHYdzodK8PPPXBlxdCHlO843AY13ez1icqwkhJc2b+ggoJ7SWzblaF3JP01Dy4tkOzGxjuiE5l28hSbM/O76EBttbPRvgj+hdXQlJmhVm5h1oOBfz4QOdSygkaXqtFZP03RRjca4mhLyEtrNasQ+nGItzNaG/l2f+QNPVnZCONcb2tgpPGleHQmrPFvHmjjUK0nh707maEvI+zdSBCMS5WhFyeXZoySIDXjazZ8tt79xgF3J5dkmZZWPjl8bmmNmSlGNyLtdCLs9mlVsuqRX4IZW9selczaq4ytnM2oCWFGNxriZUnDSSJuKjBrg6FFIRcBlvTo6xwF8B52YRlHN5FlIR0FYyb8A64Dwzeyn9kJzLt5CKgJ+VWy5psqQvmtnF6YflXH4luqeRNEHSpyXdD9wLTMwkKudyLOSeZgRwKvBR4G3Ar4GpPkKaq1chJc1LREOhfxPYx8w+TwptziSdLmm5pJ74mY9zNSEkac4HhgNXAOdLmpbSuZcRlWD3pXQ85wZEyEto3zezI9g+bsyNwB6S/lnS2yo9sZk9ZmZPVLq/c9USXBEQD7x0oZnNAFqBkQxQd7KS5kpqk9S2du3agTilc70K6WHziNJlZrbMzC4ws3372PdOScvKfBKNdmZmV5tZq5m1TpgwIcmuzqUu5OHmFcChAJIeMLMjQw9uZsdWGphzeRVyeVb8xmZTVoE4VytCkmaIpDGSxhVNjy18Kj2xpFMkrQaOBH4n6bZKj+XcQAq5PBtF1E9AocRZXLTOgH0qObGZLQAWVLKvc9UU0vZsygDE4VzNCKk9O7No+t0l6z6TRVDO5VnIPc15RdOXlaw7O8VYnKsJSWvPSvs+884CXd0JSRrrZbrcvHODXtCgTpKWEpUq0+Jp4vmKas6cq2UhSTM98yicqyEhVc7PAEgaDbw1XvykmW3IMjDn8irkzc3hwFXAycAqosuyvSUtAD5lZt4JuqsrIRUBXwUagclmdoiZHUw0OO1Q4GtZBudcHoUkzSnAJ81sU2FBPP3peJ1zdSUkaXrM7PXShWbWgVc5uzoUUntmksZQ/kFmT8rxOJd7lbRyLuYljas7qbVylnSgmS3vd0Ru0Fq1toOF7et4cUMnE0c1MXPaOKZOqL2BJ/o7unOxeSkeyw0yq9Z2ML9tNa91drPbqCZe6+xmfttqVq3tqHZoiaWZNN540/VqYfs6Rjc3MrK5kSESI5sbGd3cyML2ddUOLbE0k8bvb1yvXtzQSUvTjncDLU1DeXFDZ5UiqlxQ0igyOetg3OA1cVQTHZ3dOyzr6Oxm4qja66slKGnMzOi7Y0BvTuN6NXPaOF7d3MXGzV30mLFxcxevbu5i5rRx1Q4tsSSXZ4slvau3lXHXtc6VNXVCC2e0TmLXpqG8sKGTXZuGckbrpJqsPQt5TlNwOPAxSc8ArxHd+JuZHZRJZG7QmTqhpSaTpFSSpDk+syicqyHBSVN4r8a5epdmlXMiki6W9LikpZIWxC+5OZd7VUsa4A7g7fE90ZNEg0c5l3tVSxozu93MChX3DwI+hqerCdUsaYqdDfxPbyt9UCeXJ4qeW2Z0cOlOYLcyqy4ws9/E21xANLLaqRYQTGtrq7W1taUbqKtnidtMJqlyTqyvQZ0knQWcCLwvJGGcy4NMk2ZnJM0GvgS8t9zr1M7lVTXvaS4HRgB3SFoi6coqxuJcsKqVNH0NcutcXuWl9sy5muFJ41xCnjTOJeRJ41xCnjTOJeRJ41xCnjTOJeRJ41xCnjTOJeRJ41xCnjTOJeRJ41xCnjTOJeRJ41xCnjTOJeRJ41xCmXaskQVJa4HeevscD7w8gOHUCv9eyhsPPG5ms5PsVHNJszOS2systdpx5I1/L+VV+r345ZlzCXnSOJfQYEuaq6sdQE7591JeRd/LoLqncW4gDLaSxrnMedI4l1BNJo2k2ZKekLRS0pfLrB8uaX68/o+Spgx8lAMv4Hs5S9LauEfTJZL+TzXiHEiSrpP0kqRlvayXpB/G39lSSYf2eVAzq6kP0AC0A/sAw4A/AQeUbPNp4Mp4+iPA/GrHnZPv5Szg8mrHOsDfy3uAQ4Flvaz/ANEwLwKOAP7Y1zFrsaQ5DFhpZk+b2VbgBuCkkm1OAn4WT/8KeJ+kxEMq1JiQ76XumNl9wCs72eQk4OcWeRAYLWn3nR2zFpNmT+DZovnV8bKy21g02toGYNyARFc9Id8LwIfiy5BfSZo8MKHlWuj39oZaTBpXuZuBKRaNc3oH20tjl0AtJs1zQPFfyEnxsrLbSBoKjALWDUh01dPn92Jm68xsSzx7DfDOAYotz0J+n3ZQi0nzMPBWSVMlDSO60b+pZJubgE/E06cBd1t81zeI9fm9lFyr/w3w2ADGl1c3AR+Pa9GOADaY2Zqd7VC18WkqZWbdkj4D3EZUY3SdmS2X9K9Am5ndBFwLzJO0kugm8CPVi3hgBH4vn5X0N0A30fdyVtUCHiCSfgEcDYyXtBr4f0AjgJldCdxCVIO2Engd+Ls+jzn4/wA7l65avDxzrqo8aZxLyJPGuYQ8aZxLyJPGuYQ8aZxLqO6TRtK9cXP6pZIel3S5pNFF67cVNaVfUmhyX7RfYflpRfucLMkk7V+07GhJvy05908L+8XHay1a94GiY3cUnesnvfw7jo3P+f6iZbdKmhlPLyyJd368/ApJXyna5/9J+oGkK+PtVkjaXLTfKb2c/z/iOHctWnZ5HNPoeH6ypJskPSWpXdL3JDX2FX+8z5K4+f6GolgOj/9dBxfts6+kJeViTE21m25X+wPcC7TG08OAS4D/LVrf0dd+ZdbNB+4Hvl607GjgtyXb/RQ4LeB4C4GD+/h3HAv8BVhYtOxWYObOjgGMBlYBU4B9gaeBkUXr9wWWBHyP/wEsBT4SzzfE82vicwhYDPxtvH4oUdu3b4fEX7TNjTv7bkLj7c9nUJY0kqbEpcb1kh6LW/Tu0td+FjWp/xKwl6R3VHjuFmAmcA4D3xJhMbBF0qzQHczsVeD/Aj8ErgAuMLONFZ7/BuCMePp9wP8C2+L544BXzWxefN5u4FxgrqSmSuOvhkGZNLH9gCvMbDqwkejFtD6Z2TaiF7gKl1bNJZdnZxRtfn3R8sKrBycBt5rZk8A6SQPdKPJbwFd7WTe/KN6LCgvjX+TdgWFm9ot+nHsFsKekUcAcoiQqOBBYVLxxnLDPE704FxJ/b974d/HmdoipG8xJ86yZ/T6e/g+iv/6hil9Y22xmBxd95het+1jR8kIr6uJflhvieYDe2hKGdpsAAAHhSURBVCul2o7JzO4mSvQjyqw+oyjeN16HlrQ3MAGYHFIi9+FGohL2UOAPSXfuI/7evPHvImqImqmaa7CZQOkvY9Avp6QGYAYVtACWNBY4BpghyYiu603SF4leTRhTsstYsulj+Zsk+2v9Q+AC4BDga8D5/Tj3DUQtrq8xM9P2F2ZXACcWbxhXEOxJdB+1R9GqpPEPqMFc0uwl6ch4+qNEN4w7FdfkfJuolFpawTlPA+aZ2d5mNsXMJhPdZB8FPAXsIWl6fK69gXcAqdf0mNktwG5El0Q7JemDwCgzux74F+AMSfv149xPE/3CX1my6nZgjKSPxecdCnwP+LGZdVYafzUM5qR5AvhHSY8R/YX/951se72kpcAyYFd2fLe+9J7movKHAKJLsQUly/4bmGPRy19nAj+Jr71/BfwfM9tQtO3vJK2OP/8V9K/s3YVEL1QVK76nuU1SM1Ft4acBzKwD+DJwWX9ObGb/bmarSpb1ACcDcyQ9RfT/s4moZAuNPxcG5asBirps+q2Zvb3KobhBaDCXNM5lYlCWNOVIWgBMLVn8z2Z2WzXiqZSkDxBduhRbaWanlds+g/NfSdQ/WLHvmdnPB+L8eVA3SeNcWvzyzLmEPGmcS8iTxrmEPGmcS+j/A3vI6cgEpIJ6AAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x7f03a86c6a90>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# use Seaborn FacetGrid for convenience\n",
    "g = sns.FacetGrid(test_yhat, row='PAY_0', hue=y)\n",
    "_ = g.map(plt.scatter, yhat, 'r_DEFAULT_NEXT_MONTH', alpha=0.4)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 4. Retrain GBM classifier based on results of residual analysis\n",
    "Now that an issue has been discovered using residual analysis, can it be resolved? \n",
    "\n",
    "#### Create a feature that contains information about behavior over time\n",
    "One strategy to improve prediction accuracy is to introduce a new feature that summarizes a customer's spending behavior over time to expose any potential financial instability: the standard deviation of a customer's bill amounts over six months. Pandas has a one-liner for calculating standard deviations for a set of columns, so the H2OFrame is casted back into Pandas DataFrame for convenience."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>ID</th>\n",
       "      <th>LIMIT_BAL</th>\n",
       "      <th>SEX</th>\n",
       "      <th>EDUCATION</th>\n",
       "      <th>MARRIAGE</th>\n",
       "      <th>AGE</th>\n",
       "      <th>PAY_0</th>\n",
       "      <th>PAY_2</th>\n",
       "      <th>PAY_3</th>\n",
       "      <th>PAY_4</th>\n",
       "      <th>PAY_5</th>\n",
       "      <th>PAY_6</th>\n",
       "      <th>BILL_AMT1</th>\n",
       "      <th>BILL_AMT2</th>\n",
       "      <th>BILL_AMT3</th>\n",
       "      <th>BILL_AMT4</th>\n",
       "      <th>BILL_AMT5</th>\n",
       "      <th>BILL_AMT6</th>\n",
       "      <th>PAY_AMT1</th>\n",
       "      <th>PAY_AMT2</th>\n",
       "      <th>PAY_AMT3</th>\n",
       "      <th>PAY_AMT4</th>\n",
       "      <th>PAY_AMT5</th>\n",
       "      <th>PAY_AMT6</th>\n",
       "      <th>DEFAULT_NEXT_MONTH</th>\n",
       "      <th>bill_std</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>20000</td>\n",
       "      <td>female</td>\n",
       "      <td>university</td>\n",
       "      <td>married</td>\n",
       "      <td>24</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>no consumption</td>\n",
       "      <td>3913</td>\n",
       "      <td>3102</td>\n",
       "      <td>689</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>689</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>1761.633219</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2</td>\n",
       "      <td>120000</td>\n",
       "      <td>female</td>\n",
       "      <td>university</td>\n",
       "      <td>single</td>\n",
       "      <td>26</td>\n",
       "      <td>pay duly</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>2 month delay</td>\n",
       "      <td>2682</td>\n",
       "      <td>1725</td>\n",
       "      <td>2682</td>\n",
       "      <td>3272</td>\n",
       "      <td>3455</td>\n",
       "      <td>3261</td>\n",
       "      <td>0</td>\n",
       "      <td>1000</td>\n",
       "      <td>1000</td>\n",
       "      <td>1000</td>\n",
       "      <td>0</td>\n",
       "      <td>2000</td>\n",
       "      <td>1</td>\n",
       "      <td>637.967841</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>3</td>\n",
       "      <td>90000</td>\n",
       "      <td>female</td>\n",
       "      <td>university</td>\n",
       "      <td>single</td>\n",
       "      <td>34</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>use of revolving credit</td>\n",
       "      <td>29239</td>\n",
       "      <td>14027</td>\n",
       "      <td>13559</td>\n",
       "      <td>14331</td>\n",
       "      <td>14948</td>\n",
       "      <td>15549</td>\n",
       "      <td>1518</td>\n",
       "      <td>1500</td>\n",
       "      <td>1000</td>\n",
       "      <td>1000</td>\n",
       "      <td>1000</td>\n",
       "      <td>5000</td>\n",
       "      <td>0</td>\n",
       "      <td>6064.518593</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   ID  LIMIT_BAL     SEX   EDUCATION MARRIAGE  AGE                    PAY_0  \\\n",
       "0   1      20000  female  university  married   24            2 month delay   \n",
       "1   2     120000  female  university   single   26                 pay duly   \n",
       "2   3      90000  female  university   single   34  use of revolving credit   \n",
       "\n",
       "                     PAY_2                    PAY_3                    PAY_4  \\\n",
       "0            2 month delay                 pay duly                 pay duly   \n",
       "1            2 month delay  use of revolving credit  use of revolving credit   \n",
       "2  use of revolving credit  use of revolving credit  use of revolving credit   \n",
       "\n",
       "                     PAY_5                    PAY_6  BILL_AMT1  BILL_AMT2  \\\n",
       "0           no consumption           no consumption       3913       3102   \n",
       "1  use of revolving credit            2 month delay       2682       1725   \n",
       "2  use of revolving credit  use of revolving credit      29239      14027   \n",
       "\n",
       "   BILL_AMT3  BILL_AMT4  BILL_AMT5  BILL_AMT6  PAY_AMT1  PAY_AMT2  PAY_AMT3  \\\n",
       "0        689          0          0          0         0       689         0   \n",
       "1       2682       3272       3455       3261         0      1000      1000   \n",
       "2      13559      14331      14948      15549      1518      1500      1000   \n",
       "\n",
       "   PAY_AMT4  PAY_AMT5  PAY_AMT6  DEFAULT_NEXT_MONTH     bill_std  \n",
       "0         0         0         0                   1  1761.633219  \n",
       "1      1000         0      2000                   1   637.967841  \n",
       "2      1000      1000      5000                   0  6064.518593  "
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "data = data.as_data_frame()\n",
    "data['bill_std'] = data[['BILL_AMT1', 'BILL_AMT2', 'BILL_AMT3', 'BILL_AMT4', 'BILL_AMT5', 'BILL_AMT6']].std(axis=1)\n",
    "data.head(n=3)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Convert Pandas DataFrame back to H2OFrame for modeling\n",
    "To retrain the model with the new feature, an H2OFrame is required and that H2OFrame is split using the same proportion and random seed as in cell 8 for the first GBM model."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Parse progress: |█████████████████████████████████████████████████████████| 100%\n"
     ]
    }
   ],
   "source": [
    "data = h2o.H2OFrame(data)                          # convert \n",
    "data[y] = data[y].asfactor()                       # ensure target is handled as a categorical variable\n",
    "train, test = data.split_frame([0.7], seed=12345)  # split into training and validation"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Retrain GBM with new feature\n",
    "The `train()` function is used to retrain the GBM model with the nearly same hyperparameters used previously in cell 9. A slight, but noticable, increase in accuracy results from retraining with the new feature. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "gbm Model Build progress: |███████████████████████████████████████████████| 100%\n",
      "GBM Test AUC = 0.7826\n"
     ]
    }
   ],
   "source": [
    "# initialize GBM model\n",
    "model = H2OGradientBoostingEstimator(ntrees=150,            # maximum 150 trees in GBM\n",
    "                                     max_depth=6,           # trees can have maximum depth of 6\n",
    "                                     sample_rate=0.9,       # use 90% of rows in each iteration (tree)\n",
    "                                     col_sample_rate=0.85,  # use 90% of variables in each iteration (tree)\n",
    "                                     stopping_rounds=5,     # stop if validation error does not decrease for 5 iterations (trees)\n",
    "                                     seed=12345)            # for reproducibility\n",
    "\n",
    "# retrain GBM model\n",
    "model.train(y=y,\n",
    "            x=X + ['bill_std'], # add new feature\n",
    "            training_frame=train, \n",
    "            validation_frame=test)\n",
    "\n",
    "# print AUC\n",
    "print('GBM Test AUC = %.4f' % model.auc(valid=True))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "While there maybe be other more complex features or a more optimal set of hyperparameters that could lead to further incremental increases in accuracy, more information is needed to achieve meaningful improvement in prediction performance. In particular, a common measure for credit lending, the customers' debt-to-income ratio, for each payment and billing period could be particularly useful. Spikes in debt-to-income ratio, representing loss of income or large increases in debt, would likely be very indicative of a default and would expose the GBM to information not currently available in the UCI credit card default data. Introducing new data could also de-emphasize `PAY_0`, which would likely result in a more stable model as well."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 5. Perform sensitivity analysis to test model performance on unseen data\n",
    "\n",
    "Sensitivity analysis investigates whether model behavior and outputs remain stable when data is intentionally perturbed or other changes are simulated in data. Beyond traditional assessment practices, sensitivity analysis of machine learning model predictions is perhaps the most important validation technique for machine learning models. Machine learning models can make drastically differing predictions for only minor changes in input variable values. In practice, many linear model validation techniques focus on the numerical instability of regression parameters due to correlation between input variables or between input variables and the dependent variable. It may be prudent for those switching from linear modeling techniques to machine learning techniques to focus less on numerical instability of model parameters and to focus more on the potential instability of model predictions.\n",
    "\n",
    "Here sensitivity analysis is used to understand the impact of  changing the most important input variable, `PAY_0`, and the impact of a sociologically sensitive variable, `SEX`, in the model. If the model changes in reasonable and expected ways when important variable values are changed this can enhance trust in the model. If the contribution of potentially sensitive variables, such as those related to gender, race, age, marital status, or disability status, can be shown to have minimal impact on the model, this is an indication of fairness in the model predictions and can also increase overall trust in the model."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Bind new model predictions onto test data \n",
    "Typically, a productive exercise in model debugging and validation is to investigate customers with very high or low predicted probabilities to determine if their predictions stay within reasonable bounds when important variables are changed. The predictions from the new, more accurate model are merged onto the test set to find these potentially interesting customers. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "gbm prediction progress: |████████████████████████████████████████████████| 100%\n"
     ]
    }
   ],
   "source": [
    "preds2 = model.predict(test).drop(['predict', 'p0'])\n",
    "preds2.columns = [yhat]\n",
    "test_yhat = test.cbind(preds1[yhat])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Helper function for finding percentile indices\n",
    "The function below finds and returns the row indices for the minimum, the maximum, and the deciles of one column in terms of another -- in this case, the model predictions (`p_DEFAULT_NEXT_MONTH`) and the row identifier (`ID`), respectively. These indices are used as a starting point for boundary testing. Outlying predictions found through residual analysis is another group of potentially interesting local predictions to investigate."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{0: 28716,\n",
       " 10: 26033,\n",
       " 20: 2460,\n",
       " 30: 24255,\n",
       " 40: 13100,\n",
       " 50: 11365,\n",
       " 60: 6414,\n",
       " 70: 6351,\n",
       " 80: 19705,\n",
       " 90: 6066,\n",
       " 99: 29116}"
      ]
     },
     "execution_count": 30,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "def get_percentile_dict(yhat, id_, frame):\n",
    "\n",
    "    \"\"\" Returns the minimum, the maximum, and the deciles of a column, yhat, \n",
    "        as the indices based on another column id_.\n",
    "    \n",
    "    Args:\n",
    "        yhat: Column in which to find percentiles.\n",
    "        id_: Id column that stores indices for percentiles of yhat.\n",
    "        frame: H2OFrame containing yhat and id_. \n",
    "    \n",
    "    Returns:\n",
    "        Dictionary of percentile values and index column values.\n",
    "    \n",
    "    \"\"\"\n",
    "    \n",
    "    # create a copy of frame and sort it by yhat\n",
    "    sort_df = frame.as_data_frame()\n",
    "    sort_df.sort_values(yhat, inplace=True)\n",
    "    sort_df.reset_index(inplace=True)\n",
    "    \n",
    "    # find top and bottom percentiles\n",
    "    percentiles_dict = {}\n",
    "    percentiles_dict[0] = sort_df.loc[0, id_]\n",
    "    percentiles_dict[99] = sort_df.loc[sort_df.shape[0]-1, id_]\n",
    "\n",
    "    # find 10th-90th percentiles\n",
    "    inc = sort_df.shape[0]//10\n",
    "    for i in range(1, 10):\n",
    "        percentiles_dict[i * 10] = sort_df.loc[i * inc,  id_]\n",
    "\n",
    "    return percentiles_dict\n",
    "\n",
    "# display percentiles dictionary\n",
    "# ID values for rows\n",
    "# from lowest prediction \n",
    "# to highest prediction\n",
    "pred_percentile_dict = get_percentile_dict(yhat, 'ID', test_yhat)\n",
    "pred_percentile_dict"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Display test data prediction range\n",
    "Unlike some regression models and neural networks that can produce outrageous predictions for changes in input variables, GBM predictions in new data are bounded by the lowest and highest probability leaf nodes in each constiuent decision tree in the trained model. While unbounded, extreme predictions are typically not an issue for tree models and classification tasks, it is often a good idea to check that the model predictions cover a full range of useful values in the test set. Below, we can see that the model produces both very low and very high predictions in test set, indicating that it is likely responsive to signal in new data and not simply predicting the majority class or an average value."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Lowest prediction: "
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "<thead>\n",
       "<tr><th style=\"text-align: right;\">  DEFAULT_NEXT_MONTH</th><th style=\"text-align: right;\">  p_DEFAULT_NEXT_MONTH</th></tr>\n",
       "</thead>\n",
       "<tbody>\n",
       "<tr><td style=\"text-align: right;\">                   0</td><td style=\"text-align: right;\">             0.0102792</td></tr>\n",
       "</tbody>\n",
       "</table>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "Highest prediction: "
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "<thead>\n",
       "<tr><th style=\"text-align: right;\">  DEFAULT_NEXT_MONTH</th><th style=\"text-align: right;\">  p_DEFAULT_NEXT_MONTH</th></tr>\n",
       "</thead>\n",
       "<tbody>\n",
       "<tr><td style=\"text-align: right;\">                   1</td><td style=\"text-align: right;\">               0.93937</td></tr>\n",
       "</tbody>\n",
       "</table>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n"
     ]
    }
   ],
   "source": [
    "print('Lowest prediction:', test_yhat[test_yhat['ID'] == int(pred_percentile_dict[0])][[y, yhat]])\n",
    "print('Highest prediction:', test_yhat[test_yhat['ID'] == int(pred_percentile_dict[99])][[y, yhat]])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Use trained model to test predictions for interesting situations: customer least likely to default\n",
    "As a starting point for further analysis, sensitivity analysis is performed for the customer least likely to default. This woman has a roughly 0.01 probability of defaulting according to the trained GBM."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<table>\n",
       "<thead>\n",
       "<tr><th style=\"text-align: right;\">   ID</th><th style=\"text-align: right;\">  LIMIT_BAL</th><th>SEX   </th><th>EDUCATION  </th><th>MARRIAGE  </th><th style=\"text-align: right;\">  AGE</th><th>PAY_0         </th><th>PAY_2         </th><th>PAY_3         </th><th>PAY_4         </th><th>PAY_5         </th><th>PAY_6         </th><th style=\"text-align: right;\">  BILL_AMT1</th><th style=\"text-align: right;\">  BILL_AMT2</th><th style=\"text-align: right;\">  BILL_AMT3</th><th style=\"text-align: right;\">  BILL_AMT4</th><th style=\"text-align: right;\">  BILL_AMT5</th><th style=\"text-align: right;\">  BILL_AMT6</th><th style=\"text-align: right;\">  PAY_AMT1</th><th style=\"text-align: right;\">  PAY_AMT2</th><th style=\"text-align: right;\">  PAY_AMT3</th><th style=\"text-align: right;\">  PAY_AMT4</th><th style=\"text-align: right;\">  PAY_AMT5</th><th style=\"text-align: right;\">  PAY_AMT6</th><th style=\"text-align: right;\">  DEFAULT_NEXT_MONTH</th><th style=\"text-align: right;\">  bill_std</th><th style=\"text-align: right;\">  p_DEFAULT_NEXT_MONTH</th></tr>\n",
       "</thead>\n",
       "<tbody>\n",
       "<tr><td style=\"text-align: right;\">28716</td><td style=\"text-align: right;\">     780000</td><td>female</td><td>university </td><td>single    </td><td style=\"text-align: right;\">   41</td><td>no consumption</td><td>no consumption</td><td>no consumption</td><td>no consumption</td><td>no consumption</td><td>no consumption</td><td style=\"text-align: right;\">     101957</td><td style=\"text-align: right;\">      61715</td><td style=\"text-align: right;\">      38686</td><td style=\"text-align: right;\">      21482</td><td style=\"text-align: right;\">      72628</td><td style=\"text-align: right;\">     182792</td><td style=\"text-align: right;\">     62819</td><td style=\"text-align: right;\">     39558</td><td style=\"text-align: right;\">     22204</td><td style=\"text-align: right;\">     82097</td><td style=\"text-align: right;\">    184322</td><td style=\"text-align: right;\">     25695</td><td style=\"text-align: right;\">                   0</td><td style=\"text-align: right;\">   57564.1</td><td style=\"text-align: right;\">             0.0102792</td></tr>\n",
       "</tbody>\n",
       "</table>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": []
     },
     "execution_count": 32,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "test_case = test_yhat[test_yhat['ID'] == int(pred_percentile_dict[0])]\n",
    "test_case"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Test effect of changing `SEX`"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "`SEX` should not have a large impact on predictions. This could indicate unwanted sociological bias in the GBM model."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "gbm prediction progress: |████████████████████████████████████████████████| 100%\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "<thead>\n",
       "<tr><th style=\"text-align: right;\">   ID</th><th style=\"text-align: right;\">  LIMIT_BAL</th><th>SEX  </th><th>EDUCATION  </th><th>MARRIAGE  </th><th style=\"text-align: right;\">  AGE</th><th>PAY_0         </th><th>PAY_2         </th><th>PAY_3         </th><th>PAY_4         </th><th>PAY_5         </th><th>PAY_6         </th><th style=\"text-align: right;\">  BILL_AMT1</th><th style=\"text-align: right;\">  BILL_AMT2</th><th style=\"text-align: right;\">  BILL_AMT3</th><th style=\"text-align: right;\">  BILL_AMT4</th><th style=\"text-align: right;\">  BILL_AMT5</th><th style=\"text-align: right;\">  BILL_AMT6</th><th style=\"text-align: right;\">  PAY_AMT1</th><th style=\"text-align: right;\">  PAY_AMT2</th><th style=\"text-align: right;\">  PAY_AMT3</th><th style=\"text-align: right;\">  PAY_AMT4</th><th style=\"text-align: right;\">  PAY_AMT5</th><th style=\"text-align: right;\">  PAY_AMT6</th><th style=\"text-align: right;\">  DEFAULT_NEXT_MONTH</th><th style=\"text-align: right;\">  bill_std</th><th style=\"text-align: right;\">  predict</th><th style=\"text-align: right;\">      p0</th><th style=\"text-align: right;\">       p1</th></tr>\n",
       "</thead>\n",
       "<tbody>\n",
       "<tr><td style=\"text-align: right;\">28716</td><td style=\"text-align: right;\">     780000</td><td>male </td><td>university </td><td>single    </td><td style=\"text-align: right;\">   41</td><td>no consumption</td><td>no consumption</td><td>no consumption</td><td>no consumption</td><td>no consumption</td><td>no consumption</td><td style=\"text-align: right;\">     101957</td><td style=\"text-align: right;\">      61715</td><td style=\"text-align: right;\">      38686</td><td style=\"text-align: right;\">      21482</td><td style=\"text-align: right;\">      72628</td><td style=\"text-align: right;\">     182792</td><td style=\"text-align: right;\">     62819</td><td style=\"text-align: right;\">     39558</td><td style=\"text-align: right;\">     22204</td><td style=\"text-align: right;\">     82097</td><td style=\"text-align: right;\">    184322</td><td style=\"text-align: right;\">     25695</td><td style=\"text-align: right;\">                   0</td><td style=\"text-align: right;\">   57564.1</td><td style=\"text-align: right;\">        0</td><td style=\"text-align: right;\">0.959052</td><td style=\"text-align: right;\">0.0409481</td></tr>\n",
       "</tbody>\n",
       "</table>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": []
     },
     "execution_count": 33,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "test_case = test_yhat[test_yhat['ID'] == int(pred_percentile_dict[0])]\n",
    "test_case = test_case.drop([yhat])\n",
    "test_case['SEX'] = 'male'\n",
    "test_case = test_case.cbind(model.predict(test_case))\n",
    "test_case"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As desired, simulating this person as a male does not have a large impact on their probability of default."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Test effect of changing `PAY_0`"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Variable importance and residual analysis indicates that the value of `PAY_0` can have a strong effect on model predictions. Measuring the change in predicted probability when the value of `PAY_0` is changed from a timely payment to late payment is probably a good test case for prediction stability. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "gbm prediction progress: |████████████████████████████████████████████████| 100%\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "<thead>\n",
       "<tr><th style=\"text-align: right;\">   ID</th><th style=\"text-align: right;\">  LIMIT_BAL</th><th>SEX   </th><th>EDUCATION  </th><th>MARRIAGE  </th><th style=\"text-align: right;\">  AGE</th><th>PAY_0        </th><th>PAY_2         </th><th>PAY_3         </th><th>PAY_4         </th><th>PAY_5         </th><th>PAY_6         </th><th style=\"text-align: right;\">  BILL_AMT1</th><th style=\"text-align: right;\">  BILL_AMT2</th><th style=\"text-align: right;\">  BILL_AMT3</th><th style=\"text-align: right;\">  BILL_AMT4</th><th style=\"text-align: right;\">  BILL_AMT5</th><th style=\"text-align: right;\">  BILL_AMT6</th><th style=\"text-align: right;\">  PAY_AMT1</th><th style=\"text-align: right;\">  PAY_AMT2</th><th style=\"text-align: right;\">  PAY_AMT3</th><th style=\"text-align: right;\">  PAY_AMT4</th><th style=\"text-align: right;\">  PAY_AMT5</th><th style=\"text-align: right;\">  PAY_AMT6</th><th style=\"text-align: right;\">  DEFAULT_NEXT_MONTH</th><th style=\"text-align: right;\">  bill_std</th><th style=\"text-align: right;\">  predict</th><th style=\"text-align: right;\">      p0</th><th style=\"text-align: right;\">      p1</th></tr>\n",
       "</thead>\n",
       "<tbody>\n",
       "<tr><td style=\"text-align: right;\">28716</td><td style=\"text-align: right;\">     780000</td><td>female</td><td>university </td><td>single    </td><td style=\"text-align: right;\">   41</td><td>2 month delay</td><td>no consumption</td><td>no consumption</td><td>no consumption</td><td>no consumption</td><td>no consumption</td><td style=\"text-align: right;\">     101957</td><td style=\"text-align: right;\">      61715</td><td style=\"text-align: right;\">      38686</td><td style=\"text-align: right;\">      21482</td><td style=\"text-align: right;\">      72628</td><td style=\"text-align: right;\">     182792</td><td style=\"text-align: right;\">     62819</td><td style=\"text-align: right;\">     39558</td><td style=\"text-align: right;\">     22204</td><td style=\"text-align: right;\">     82097</td><td style=\"text-align: right;\">    184322</td><td style=\"text-align: right;\">     25695</td><td style=\"text-align: right;\">                   0</td><td style=\"text-align: right;\">   57564.1</td><td style=\"text-align: right;\">        1</td><td style=\"text-align: right;\">0.571032</td><td style=\"text-align: right;\">0.428968</td></tr>\n",
       "</tbody>\n",
       "</table>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": []
     },
     "execution_count": 34,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "test_case = test_yhat[test_yhat['ID'] == int(pred_percentile_dict[0])]\n",
    "test_case = test_case.drop([yhat])\n",
    "test_case['PAY_0'] = '2 month delay' \n",
    "test_case = test_case.cbind(model.predict(test_case))\n",
    "test_case"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "When the value is changed from `no consumption` to `two month delay` there is a roughly 40X increase in predicted probability, but assuming a 0.5 probability cutoff, the predicted outcome is stable. However, such a marked change related to the value of one variable is problematic for numerous reasons."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Use trained model to test predictions for interesting situations: customer most likely to default\n",
    "Now the same test will be performed on the customer most likely to default. This woman has an approximately 0.94 probability of default under the GBM model. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<table>\n",
       "<thead>\n",
       "<tr><th style=\"text-align: right;\">   ID</th><th style=\"text-align: right;\">  LIMIT_BAL</th><th>SEX   </th><th>EDUCATION  </th><th>MARRIAGE  </th><th style=\"text-align: right;\">  AGE</th><th>PAY_0        </th><th>PAY_2        </th><th>PAY_3        </th><th>PAY_4        </th><th>PAY_5        </th><th>PAY_6        </th><th style=\"text-align: right;\">  BILL_AMT1</th><th style=\"text-align: right;\">  BILL_AMT2</th><th style=\"text-align: right;\">  BILL_AMT3</th><th style=\"text-align: right;\">  BILL_AMT4</th><th style=\"text-align: right;\">  BILL_AMT5</th><th style=\"text-align: right;\">  BILL_AMT6</th><th style=\"text-align: right;\">  PAY_AMT1</th><th style=\"text-align: right;\">  PAY_AMT2</th><th style=\"text-align: right;\">  PAY_AMT3</th><th style=\"text-align: right;\">  PAY_AMT4</th><th style=\"text-align: right;\">  PAY_AMT5</th><th style=\"text-align: right;\">  PAY_AMT6</th><th style=\"text-align: right;\">  DEFAULT_NEXT_MONTH</th><th style=\"text-align: right;\">  bill_std</th><th style=\"text-align: right;\">  p_DEFAULT_NEXT_MONTH</th></tr>\n",
       "</thead>\n",
       "<tbody>\n",
       "<tr><td style=\"text-align: right;\">29116</td><td style=\"text-align: right;\">      20000</td><td>female</td><td>university </td><td>married   </td><td style=\"text-align: right;\">   59</td><td>3 month delay</td><td>2 month delay</td><td>3 month delay</td><td>2 month delay</td><td>2 month delay</td><td>4 month delay</td><td style=\"text-align: right;\">       8803</td><td style=\"text-align: right;\">      11137</td><td style=\"text-align: right;\">      10672</td><td style=\"text-align: right;\">      11201</td><td style=\"text-align: right;\">      12721</td><td style=\"text-align: right;\">      11946</td><td style=\"text-align: right;\">      2800</td><td style=\"text-align: right;\">         0</td><td style=\"text-align: right;\">      1000</td><td style=\"text-align: right;\">      2000</td><td style=\"text-align: right;\">         0</td><td style=\"text-align: right;\">         0</td><td style=\"text-align: right;\">                   1</td><td style=\"text-align: right;\">   1327.55</td><td style=\"text-align: right;\">               0.93937</td></tr>\n",
       "</tbody>\n",
       "</table>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": []
     },
     "execution_count": 35,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "test_case = test_yhat[test_yhat['ID'] == int(pred_percentile_dict[99])]\n",
    "test_case"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Test effect of changing `SEX`\n",
    "Changing the value for `SEX` from female to male for this customer decreases the predicted probability to about 0.84, another relatively small change."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "gbm prediction progress: |████████████████████████████████████████████████| 100%\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "<thead>\n",
       "<tr><th style=\"text-align: right;\">   ID</th><th style=\"text-align: right;\">  LIMIT_BAL</th><th>SEX  </th><th>EDUCATION  </th><th>MARRIAGE  </th><th style=\"text-align: right;\">  AGE</th><th>PAY_0        </th><th>PAY_2        </th><th>PAY_3        </th><th>PAY_4        </th><th>PAY_5        </th><th>PAY_6        </th><th style=\"text-align: right;\">  BILL_AMT1</th><th style=\"text-align: right;\">  BILL_AMT2</th><th style=\"text-align: right;\">  BILL_AMT3</th><th style=\"text-align: right;\">  BILL_AMT4</th><th style=\"text-align: right;\">  BILL_AMT5</th><th style=\"text-align: right;\">  BILL_AMT6</th><th style=\"text-align: right;\">  PAY_AMT1</th><th style=\"text-align: right;\">  PAY_AMT2</th><th style=\"text-align: right;\">  PAY_AMT3</th><th style=\"text-align: right;\">  PAY_AMT4</th><th style=\"text-align: right;\">  PAY_AMT5</th><th style=\"text-align: right;\">  PAY_AMT6</th><th style=\"text-align: right;\">  DEFAULT_NEXT_MONTH</th><th style=\"text-align: right;\">  bill_std</th><th style=\"text-align: right;\">  predict</th><th style=\"text-align: right;\">      p0</th><th style=\"text-align: right;\">      p1</th></tr>\n",
       "</thead>\n",
       "<tbody>\n",
       "<tr><td style=\"text-align: right;\">29116</td><td style=\"text-align: right;\">      20000</td><td>male </td><td>university </td><td>married   </td><td style=\"text-align: right;\">   59</td><td>3 month delay</td><td>2 month delay</td><td>3 month delay</td><td>2 month delay</td><td>2 month delay</td><td>4 month delay</td><td style=\"text-align: right;\">       8803</td><td style=\"text-align: right;\">      11137</td><td style=\"text-align: right;\">      10672</td><td style=\"text-align: right;\">      11201</td><td style=\"text-align: right;\">      12721</td><td style=\"text-align: right;\">      11946</td><td style=\"text-align: right;\">      2800</td><td style=\"text-align: right;\">         0</td><td style=\"text-align: right;\">      1000</td><td style=\"text-align: right;\">      2000</td><td style=\"text-align: right;\">         0</td><td style=\"text-align: right;\">         0</td><td style=\"text-align: right;\">                   1</td><td style=\"text-align: right;\">   1327.55</td><td style=\"text-align: right;\">        1</td><td style=\"text-align: right;\">0.161579</td><td style=\"text-align: right;\">0.838421</td></tr>\n",
       "</tbody>\n",
       "</table>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": []
     },
     "execution_count": 36,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "test_case = test_yhat[test_yhat['ID'] == int(pred_percentile_dict[99])]\n",
    "test_case = test_case.drop([yhat])\n",
    "test_case['SEX'] = 'male'\n",
    "test_case = test_case.cbind(model.predict(test_case))\n",
    "test_case"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Test effect of changing `PAY_0`\n",
    "Switching the riskiest customer's value for `PAY_0` from `3 month delay` to `pay duly` reduces the their chance of defaulting from roughly 94% to roughly 73%, a noticable swing in probability but still a higher probability value, markedly greater than the typical 0.5 cutoff."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "gbm prediction progress: |████████████████████████████████████████████████| 100%\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<table>\n",
       "<thead>\n",
       "<tr><th style=\"text-align: right;\">   ID</th><th style=\"text-align: right;\">  LIMIT_BAL</th><th>SEX   </th><th>EDUCATION  </th><th>MARRIAGE  </th><th style=\"text-align: right;\">  AGE</th><th>PAY_0   </th><th>PAY_2        </th><th>PAY_3        </th><th>PAY_4        </th><th>PAY_5        </th><th>PAY_6        </th><th style=\"text-align: right;\">  BILL_AMT1</th><th style=\"text-align: right;\">  BILL_AMT2</th><th style=\"text-align: right;\">  BILL_AMT3</th><th style=\"text-align: right;\">  BILL_AMT4</th><th style=\"text-align: right;\">  BILL_AMT5</th><th style=\"text-align: right;\">  BILL_AMT6</th><th style=\"text-align: right;\">  PAY_AMT1</th><th style=\"text-align: right;\">  PAY_AMT2</th><th style=\"text-align: right;\">  PAY_AMT3</th><th style=\"text-align: right;\">  PAY_AMT4</th><th style=\"text-align: right;\">  PAY_AMT5</th><th style=\"text-align: right;\">  PAY_AMT6</th><th style=\"text-align: right;\">  DEFAULT_NEXT_MONTH</th><th style=\"text-align: right;\">  bill_std</th><th style=\"text-align: right;\">  predict</th><th style=\"text-align: right;\">      p0</th><th style=\"text-align: right;\">      p1</th></tr>\n",
       "</thead>\n",
       "<tbody>\n",
       "<tr><td style=\"text-align: right;\">29116</td><td style=\"text-align: right;\">      20000</td><td>female</td><td>university </td><td>married   </td><td style=\"text-align: right;\">   59</td><td>pay duly</td><td>2 month delay</td><td>3 month delay</td><td>2 month delay</td><td>2 month delay</td><td>4 month delay</td><td style=\"text-align: right;\">       8803</td><td style=\"text-align: right;\">      11137</td><td style=\"text-align: right;\">      10672</td><td style=\"text-align: right;\">      11201</td><td style=\"text-align: right;\">      12721</td><td style=\"text-align: right;\">      11946</td><td style=\"text-align: right;\">      2800</td><td style=\"text-align: right;\">         0</td><td style=\"text-align: right;\">      1000</td><td style=\"text-align: right;\">      2000</td><td style=\"text-align: right;\">         0</td><td style=\"text-align: right;\">         0</td><td style=\"text-align: right;\">                   1</td><td style=\"text-align: right;\">   1327.55</td><td style=\"text-align: right;\">        1</td><td style=\"text-align: right;\">0.273858</td><td style=\"text-align: right;\">0.726142</td></tr>\n",
       "</tbody>\n",
       "</table>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": []
     },
     "execution_count": 37,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "test_case = test_yhat[test_yhat['ID'] == int(pred_percentile_dict[99])]\n",
    "test_case = test_case.drop([yhat])\n",
    "test_case['PAY_0'] = 'pay duly' \n",
    "test_case = test_case.cbind(model.predict(test_case))\n",
    "test_case"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "From this small number of boundary test cases, the GBM model appears stable. However, if large swings in predictions occur for sensitive or important variables, practicioners are urged to retrain unstable models without the problematic variables or combinations of variables, which may unfortunately involve some trial and error. Also, four test cases is woefully inadequate for real-world models. Automated sensitivity analysis across many variables, combinations of variables, and for many different rows of data seems more appropriate for mission-critical machine learning."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Shutdown H2O\n",
    "After using h2o, it's typically best to shut it down. However, before doing so, users should ensure that they have saved any h2o data structures, such as models, H2OFrames, or scoring artifacts, such as POJOs or MOJOs."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Are you sure you want to shutdown the H2O instance running at http://127.0.0.1:54321 (Y/N)? y\n",
      "H2O session _sid_a8c5 closed.\n"
     ]
    }
   ],
   "source": [
    "# be careful, this can erase your work!\n",
    "h2o.cluster().shutdown(prompt=True)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Summary"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "In this notebook, a complex GBM classifier was trained to predict credit card defaults. Residual analysis was used to debug the GBM model predictions and enabled a slight improvement in accuracy. Sensitivity analysis was used to test the GBM for trustworthiness and stability. In a small number of boundary test cases, the trained GBM appeared stable. Residual analysis and sensitivity analysis are powerful model debugging techniques and can increase trust in complex models. These techniques should generalize well for many types of business and research problems, enabling you to train a complex model and justify it to your colleagues, bosses, and potentially, external regulators. "
   ]
  }
 ],
 "metadata": {
  "anaconda-cloud": {},
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.4"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}