MovieAnalytics.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# My Movie-Watching Stats\n",
    "\n",
    "[This code complements my blogpost visualizing my movie-watching stats. Check it out here!](https://muhammadali.xyz/my-movie-stats-visualized/)\n",
    "\n",
    "I will briefly talk though my step belows and why I'm taking them."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "import numpy as np\n",
    "\n",
    "omdb_key = 'xxxxxx' #OMDb API key here"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let's import my IMDb ratings data. You can get your's by going to IMDb > Lists > Your Ratings and exporting that.\n",
    "\n",
    "Of course, this requires that you have been consistently rating movies."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Const</th>\n",
       "      <th>Your Rating</th>\n",
       "      <th>Date Rated</th>\n",
       "      <th>Title</th>\n",
       "      <th>URL</th>\n",
       "      <th>Title Type</th>\n",
       "      <th>IMDb Rating</th>\n",
       "      <th>Runtime (mins)</th>\n",
       "      <th>Year</th>\n",
       "      <th>Genres</th>\n",
       "      <th>Num Votes</th>\n",
       "      <th>Release Date</th>\n",
       "      <th>Directors</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Animation, Action, Comedy, Family, Sci-Fi</td>\n",
       "      <td>223442</td>\n",
       "      <td>2010-10-28</td>\n",
       "      <td>Tom McGrath</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>tt0100685</td>\n",
       "      <td>7</td>\n",
       "      <td>2014-05-04</td>\n",
       "      <td>State of Grace</td>\n",
       "      <td>https://www.imdb.com/title/tt0100685/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>134.0</td>\n",
       "      <td>1990</td>\n",
       "      <td>Action, Crime, Drama, Romance, Thriller</td>\n",
       "      <td>20444</td>\n",
       "      <td>1990-09-14</td>\n",
       "      <td>Phil Joanou</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>tt1010048</td>\n",
       "      <td>8</td>\n",
       "      <td>2011-05-06</td>\n",
       "      <td>Slumdog Millionaire</td>\n",
       "      <td>https://www.imdb.com/title/tt1010048/</td>\n",
       "      <td>movie</td>\n",
       "      <td>8.0</td>\n",
       "      <td>120.0</td>\n",
       "      <td>2008</td>\n",
       "      <td>Drama, Romance</td>\n",
       "      <td>787410</td>\n",
       "      <td>2008-08-30</td>\n",
       "      <td>Loveleen Tandan, Danny Boyle</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>tt1013752</td>\n",
       "      <td>6</td>\n",
       "      <td>2011-05-09</td>\n",
       "      <td>Fast &amp; Furious</td>\n",
       "      <td>https://www.imdb.com/title/tt1013752/</td>\n",
       "      <td>movie</td>\n",
       "      <td>6.6</td>\n",
       "      <td>107.0</td>\n",
       "      <td>2009</td>\n",
       "      <td>Action, Thriller</td>\n",
       "      <td>258307</td>\n",
       "      <td>2009-03-12</td>\n",
       "      <td>Justin Lin</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>tt1014759</td>\n",
       "      <td>6</td>\n",
       "      <td>2011-11-14</td>\n",
       "      <td>Alice in Wonderland</td>\n",
       "      <td>https://www.imdb.com/title/tt1014759/</td>\n",
       "      <td>movie</td>\n",
       "      <td>6.4</td>\n",
       "      <td>108.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Adventure, Family, Fantasy</td>\n",
       "      <td>377320</td>\n",
       "      <td>2010-02-25</td>\n",
       "      <td>Tim Burton</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "       Const  Your Rating  Date Rated                Title  \\\n",
       "0  tt1001526            7  2011-04-12             Megamind   \n",
       "1  tt0100685            7  2014-05-04       State of Grace   \n",
       "2  tt1010048            8  2011-05-06  Slumdog Millionaire   \n",
       "3  tt1013752            6  2011-05-09       Fast & Furious   \n",
       "4  tt1014759            6  2011-11-14  Alice in Wonderland   \n",
       "\n",
       "                                     URL Title Type  IMDb Rating  \\\n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "1  https://www.imdb.com/title/tt0100685/      movie          7.2   \n",
       "2  https://www.imdb.com/title/tt1010048/      movie          8.0   \n",
       "3  https://www.imdb.com/title/tt1013752/      movie          6.6   \n",
       "4  https://www.imdb.com/title/tt1014759/      movie          6.4   \n",
       "\n",
       "   Runtime (mins)  Year                                     Genres  Num Votes  \\\n",
       "0            95.0  2010  Animation, Action, Comedy, Family, Sci-Fi     223442   \n",
       "1           134.0  1990    Action, Crime, Drama, Romance, Thriller      20444   \n",
       "2           120.0  2008                             Drama, Romance     787410   \n",
       "3           107.0  2009                           Action, Thriller     258307   \n",
       "4           108.0  2010                 Adventure, Family, Fantasy     377320   \n",
       "\n",
       "  Release Date                     Directors  \n",
       "0   2010-10-28                   Tom McGrath  \n",
       "1   1990-09-14                   Phil Joanou  \n",
       "2   2008-08-30  Loveleen Tandan, Danny Boyle  \n",
       "3   2009-03-12                    Justin Lin  \n",
       "4   2010-02-25                    Tim Burton  "
      ]
     },
     "execution_count": 2,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "imdb_df = pd.read_csv('data/ratings.csv', encoding = \"ISO-8859-1\") #Read IMDb ratings export CSV\n",
    "imdb_df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array(['movie', 'tvMiniSeries', 'tvSeries', 'video', 'tvMovie'],\n",
       "      dtype=object)"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "imdb_df['Title Type'].unique() #Check what types of titles are there"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Const</th>\n",
       "      <th>Your Rating</th>\n",
       "      <th>Date Rated</th>\n",
       "      <th>Title</th>\n",
       "      <th>URL</th>\n",
       "      <th>Title Type</th>\n",
       "      <th>IMDb Rating</th>\n",
       "      <th>Runtime (mins)</th>\n",
       "      <th>Year</th>\n",
       "      <th>Genres</th>\n",
       "      <th>Num Votes</th>\n",
       "      <th>Release Date</th>\n",
       "      <th>Directors</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Animation, Action, Comedy, Family, Sci-Fi</td>\n",
       "      <td>223442</td>\n",
       "      <td>2010-10-28</td>\n",
       "      <td>Tom McGrath</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>tt0100685</td>\n",
       "      <td>7</td>\n",
       "      <td>2014-05-04</td>\n",
       "      <td>State of Grace</td>\n",
       "      <td>https://www.imdb.com/title/tt0100685/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>134.0</td>\n",
       "      <td>1990</td>\n",
       "      <td>Action, Crime, Drama, Romance, Thriller</td>\n",
       "      <td>20444</td>\n",
       "      <td>1990-09-14</td>\n",
       "      <td>Phil Joanou</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>tt1010048</td>\n",
       "      <td>8</td>\n",
       "      <td>2011-05-06</td>\n",
       "      <td>Slumdog Millionaire</td>\n",
       "      <td>https://www.imdb.com/title/tt1010048/</td>\n",
       "      <td>movie</td>\n",
       "      <td>8.0</td>\n",
       "      <td>120.0</td>\n",
       "      <td>2008</td>\n",
       "      <td>Drama, Romance</td>\n",
       "      <td>787410</td>\n",
       "      <td>2008-08-30</td>\n",
       "      <td>Loveleen Tandan, Danny Boyle</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>tt1013752</td>\n",
       "      <td>6</td>\n",
       "      <td>2011-05-09</td>\n",
       "      <td>Fast &amp; Furious</td>\n",
       "      <td>https://www.imdb.com/title/tt1013752/</td>\n",
       "      <td>movie</td>\n",
       "      <td>6.6</td>\n",
       "      <td>107.0</td>\n",
       "      <td>2009</td>\n",
       "      <td>Action, Thriller</td>\n",
       "      <td>258307</td>\n",
       "      <td>2009-03-12</td>\n",
       "      <td>Justin Lin</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>tt1014759</td>\n",
       "      <td>6</td>\n",
       "      <td>2011-11-14</td>\n",
       "      <td>Alice in Wonderland</td>\n",
       "      <td>https://www.imdb.com/title/tt1014759/</td>\n",
       "      <td>movie</td>\n",
       "      <td>6.4</td>\n",
       "      <td>108.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Adventure, Family, Fantasy</td>\n",
       "      <td>377320</td>\n",
       "      <td>2010-02-25</td>\n",
       "      <td>Tim Burton</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "       Const  Your Rating  Date Rated                Title  \\\n",
       "0  tt1001526            7  2011-04-12             Megamind   \n",
       "1  tt0100685            7  2014-05-04       State of Grace   \n",
       "2  tt1010048            8  2011-05-06  Slumdog Millionaire   \n",
       "3  tt1013752            6  2011-05-09       Fast & Furious   \n",
       "4  tt1014759            6  2011-11-14  Alice in Wonderland   \n",
       "\n",
       "                                     URL Title Type  IMDb Rating  \\\n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "1  https://www.imdb.com/title/tt0100685/      movie          7.2   \n",
       "2  https://www.imdb.com/title/tt1010048/      movie          8.0   \n",
       "3  https://www.imdb.com/title/tt1013752/      movie          6.6   \n",
       "4  https://www.imdb.com/title/tt1014759/      movie          6.4   \n",
       "\n",
       "   Runtime (mins)  Year                                     Genres  Num Votes  \\\n",
       "0            95.0  2010  Animation, Action, Comedy, Family, Sci-Fi     223442   \n",
       "1           134.0  1990    Action, Crime, Drama, Romance, Thriller      20444   \n",
       "2           120.0  2008                             Drama, Romance     787410   \n",
       "3           107.0  2009                           Action, Thriller     258307   \n",
       "4           108.0  2010                 Adventure, Family, Fantasy     377320   \n",
       "\n",
       "  Release Date                     Directors  \n",
       "0   2010-10-28                   Tom McGrath  \n",
       "1   1990-09-14                   Phil Joanou  \n",
       "2   2008-08-30  Loveleen Tandan, Danny Boyle  \n",
       "3   2009-03-12                    Justin Lin  \n",
       "4   2010-02-25                    Tim Burton  "
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "imdb_movies = imdb_df[imdb_df['Title Type'] == 'movie'] #Filter out only the 'movie' type\n",
    "imdb_movies.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now that I have my IMDb data, we see it doesn't have all the information. Particularly, information like actors.\n",
    "\n",
    "I will use the [OMDb API](http://www.omdbapi.com/) to get some more data. It's free for up to 1000 calls a day, which fits my dataset."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Title</th>\n",
       "      <th>Year</th>\n",
       "      <th>Rated</th>\n",
       "      <th>Released</th>\n",
       "      <th>Runtime</th>\n",
       "      <th>Genre</th>\n",
       "      <th>Director</th>\n",
       "      <th>Writer</th>\n",
       "      <th>Actors</th>\n",
       "      <th>Plot</th>\n",
       "      <th>...</th>\n",
       "      <th>Metascore</th>\n",
       "      <th>imdbRating</th>\n",
       "      <th>imdbVotes</th>\n",
       "      <th>imdbID</th>\n",
       "      <th>Type</th>\n",
       "      <th>DVD</th>\n",
       "      <th>BoxOffice</th>\n",
       "      <th>Production</th>\n",
       "      <th>Website</th>\n",
       "      <th>Response</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Megamind</td>\n",
       "      <td>2010</td>\n",
       "      <td>PG</td>\n",
       "      <td>05 Nov 2010</td>\n",
       "      <td>95 min</td>\n",
       "      <td>Animation, Action, Comedy, Family, Sci-Fi</td>\n",
       "      <td>Tom McGrath</td>\n",
       "      <td>Alan Schoolcraft, Brent Simons</td>\n",
       "      <td>Will Ferrell, Brad Pitt, Tina Fey, Jonah Hill</td>\n",
       "      <td>The supervillain Megamind finally defeats his ...</td>\n",
       "      <td>...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>7.2</td>\n",
       "      <td>223,114</td>\n",
       "      <td>tt1001526</td>\n",
       "      <td>movie</td>\n",
       "      <td>25 Feb 2011</td>\n",
       "      <td>$148,244,405</td>\n",
       "      <td>Paramount Studios/DWA</td>\n",
       "      <td>NaN</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Megamind</td>\n",
       "      <td>2010</td>\n",
       "      <td>PG</td>\n",
       "      <td>05 Nov 2010</td>\n",
       "      <td>95 min</td>\n",
       "      <td>Animation, Action, Comedy, Family, Sci-Fi</td>\n",
       "      <td>Tom McGrath</td>\n",
       "      <td>Alan Schoolcraft, Brent Simons</td>\n",
       "      <td>Will Ferrell, Brad Pitt, Tina Fey, Jonah Hill</td>\n",
       "      <td>The supervillain Megamind finally defeats his ...</td>\n",
       "      <td>...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>7.2</td>\n",
       "      <td>223,114</td>\n",
       "      <td>tt1001526</td>\n",
       "      <td>movie</td>\n",
       "      <td>25 Feb 2011</td>\n",
       "      <td>$148,244,405</td>\n",
       "      <td>Paramount Studios/DWA</td>\n",
       "      <td>NaN</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Megamind</td>\n",
       "      <td>2010</td>\n",
       "      <td>PG</td>\n",
       "      <td>05 Nov 2010</td>\n",
       "      <td>95 min</td>\n",
       "      <td>Animation, Action, Comedy, Family, Sci-Fi</td>\n",
       "      <td>Tom McGrath</td>\n",
       "      <td>Alan Schoolcraft, Brent Simons</td>\n",
       "      <td>Will Ferrell, Brad Pitt, Tina Fey, Jonah Hill</td>\n",
       "      <td>The supervillain Megamind finally defeats his ...</td>\n",
       "      <td>...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>7.2</td>\n",
       "      <td>223,114</td>\n",
       "      <td>tt1001526</td>\n",
       "      <td>movie</td>\n",
       "      <td>25 Feb 2011</td>\n",
       "      <td>$148,244,405</td>\n",
       "      <td>Paramount Studios/DWA</td>\n",
       "      <td>NaN</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>State of Grace</td>\n",
       "      <td>1990</td>\n",
       "      <td>R</td>\n",
       "      <td>14 Sep 1990</td>\n",
       "      <td>134 min</td>\n",
       "      <td>Action, Crime, Drama, Romance, Thriller</td>\n",
       "      <td>Phil Joanou</td>\n",
       "      <td>Dennis McIntyre</td>\n",
       "      <td>Sean Penn, Ed Harris, Gary Oldman, Robin Wright</td>\n",
       "      <td>A New York cop is recruited to return to his h...</td>\n",
       "      <td>...</td>\n",
       "      <td>60.0</td>\n",
       "      <td>7.2</td>\n",
       "      <td>20,358</td>\n",
       "      <td>tt0100685</td>\n",
       "      <td>movie</td>\n",
       "      <td>03 Dec 2002</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Orion Pictures Corporation</td>\n",
       "      <td>NaN</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>State of Grace</td>\n",
       "      <td>1990</td>\n",
       "      <td>R</td>\n",
       "      <td>14 Sep 1990</td>\n",
       "      <td>134 min</td>\n",
       "      <td>Action, Crime, Drama, Romance, Thriller</td>\n",
       "      <td>Phil Joanou</td>\n",
       "      <td>Dennis McIntyre</td>\n",
       "      <td>Sean Penn, Ed Harris, Gary Oldman, Robin Wright</td>\n",
       "      <td>A New York cop is recruited to return to his h...</td>\n",
       "      <td>...</td>\n",
       "      <td>60.0</td>\n",
       "      <td>7.2</td>\n",
       "      <td>20,358</td>\n",
       "      <td>tt0100685</td>\n",
       "      <td>movie</td>\n",
       "      <td>03 Dec 2002</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Orion Pictures Corporation</td>\n",
       "      <td>NaN</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 25 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "            Title  Year Rated     Released  Runtime  \\\n",
       "0        Megamind  2010    PG  05 Nov 2010   95 min   \n",
       "1        Megamind  2010    PG  05 Nov 2010   95 min   \n",
       "2        Megamind  2010    PG  05 Nov 2010   95 min   \n",
       "3  State of Grace  1990     R  14 Sep 1990  134 min   \n",
       "4  State of Grace  1990     R  14 Sep 1990  134 min   \n",
       "\n",
       "                                       Genre     Director  \\\n",
       "0  Animation, Action, Comedy, Family, Sci-Fi  Tom McGrath   \n",
       "1  Animation, Action, Comedy, Family, Sci-Fi  Tom McGrath   \n",
       "2  Animation, Action, Comedy, Family, Sci-Fi  Tom McGrath   \n",
       "3    Action, Crime, Drama, Romance, Thriller  Phil Joanou   \n",
       "4    Action, Crime, Drama, Romance, Thriller  Phil Joanou   \n",
       "\n",
       "                           Writer  \\\n",
       "0  Alan Schoolcraft, Brent Simons   \n",
       "1  Alan Schoolcraft, Brent Simons   \n",
       "2  Alan Schoolcraft, Brent Simons   \n",
       "3                 Dennis McIntyre   \n",
       "4                 Dennis McIntyre   \n",
       "\n",
       "                                            Actors  \\\n",
       "0    Will Ferrell, Brad Pitt, Tina Fey, Jonah Hill   \n",
       "1    Will Ferrell, Brad Pitt, Tina Fey, Jonah Hill   \n",
       "2    Will Ferrell, Brad Pitt, Tina Fey, Jonah Hill   \n",
       "3  Sean Penn, Ed Harris, Gary Oldman, Robin Wright   \n",
       "4  Sean Penn, Ed Harris, Gary Oldman, Robin Wright   \n",
       "\n",
       "                                                Plot  ... Metascore  \\\n",
       "0  The supervillain Megamind finally defeats his ...  ...      63.0   \n",
       "1  The supervillain Megamind finally defeats his ...  ...      63.0   \n",
       "2  The supervillain Megamind finally defeats his ...  ...      63.0   \n",
       "3  A New York cop is recruited to return to his h...  ...      60.0   \n",
       "4  A New York cop is recruited to return to his h...  ...      60.0   \n",
       "\n",
       "  imdbRating imdbVotes     imdbID   Type          DVD     BoxOffice  \\\n",
       "0        7.2   223,114  tt1001526  movie  25 Feb 2011  $148,244,405   \n",
       "1        7.2   223,114  tt1001526  movie  25 Feb 2011  $148,244,405   \n",
       "2        7.2   223,114  tt1001526  movie  25 Feb 2011  $148,244,405   \n",
       "3        7.2    20,358  tt0100685  movie  03 Dec 2002           NaN   \n",
       "4        7.2    20,358  tt0100685  movie  03 Dec 2002           NaN   \n",
       "\n",
       "                   Production Website Response  \n",
       "0       Paramount Studios/DWA     NaN     True  \n",
       "1       Paramount Studios/DWA     NaN     True  \n",
       "2       Paramount Studios/DWA     NaN     True  \n",
       "3  Orion Pictures Corporation     NaN     True  \n",
       "4  Orion Pictures Corporation     NaN     True  \n",
       "\n",
       "[5 rows x 25 columns]"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "url = 'http://www.omdbapi.com/?apikey='+omdb_key+'&i='\n",
    "omdb_movies = pd.DataFrame() #Blank dataframe to append OMDb data to\n",
    "for i in imdb_movies['Const']: #Loop through all the movie IDs\n",
    "    omdb_movies = omdb_movies.append(pd.read_json(url+i)) #Get API JSON data as dataframe and append to omdb_movies\n",
    "\n",
    "# omdb_movies = pd.read_csv('output/omdb_export.csv') #Use this if API data already saved\n",
    "omdb_movies.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We get each movie multiple times; that's because the Ratings column has a dictionary. Each dictionary item gets added as a new row.\n",
    "\n",
    "I will save a CSV of the OMDb data, so I don't need to run the API again on the same dataset."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "omdb_movies.to_csv('output/omdb_export.csv', index=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Title          object\n",
       "Year            int64\n",
       "Rated          object\n",
       "Released       object\n",
       "Runtime        object\n",
       "Genre          object\n",
       "Director       object\n",
       "Writer         object\n",
       "Actors         object\n",
       "Plot           object\n",
       "Language       object\n",
       "Country        object\n",
       "Awards         object\n",
       "Poster         object\n",
       "Ratings        object\n",
       "Metascore     float64\n",
       "imdbRating    float64\n",
       "imdbVotes      object\n",
       "imdbID         object\n",
       "Type           object\n",
       "DVD            object\n",
       "BoxOffice      object\n",
       "Production     object\n",
       "Website       float64\n",
       "Response         bool\n",
       "dtype: object"
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "omdb_movies.dtypes"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "I only care about imdb ratings, which we already have as a column.\n",
    "\n",
    "Let's get rid of the duplicates"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Title</th>\n",
       "      <th>Year</th>\n",
       "      <th>Rated</th>\n",
       "      <th>Released</th>\n",
       "      <th>Runtime</th>\n",
       "      <th>Genre</th>\n",
       "      <th>Director</th>\n",
       "      <th>Writer</th>\n",
       "      <th>Actors</th>\n",
       "      <th>Plot</th>\n",
       "      <th>...</th>\n",
       "      <th>Metascore</th>\n",
       "      <th>imdbRating</th>\n",
       "      <th>imdbVotes</th>\n",
       "      <th>imdbID</th>\n",
       "      <th>Type</th>\n",
       "      <th>DVD</th>\n",
       "      <th>BoxOffice</th>\n",
       "      <th>Production</th>\n",
       "      <th>Website</th>\n",
       "      <th>Response</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Megamind</td>\n",
       "      <td>2010</td>\n",
       "      <td>PG</td>\n",
       "      <td>05 Nov 2010</td>\n",
       "      <td>95 min</td>\n",
       "      <td>Animation, Action, Comedy, Family, Sci-Fi</td>\n",
       "      <td>Tom McGrath</td>\n",
       "      <td>Alan Schoolcraft, Brent Simons</td>\n",
       "      <td>Will Ferrell, Brad Pitt, Tina Fey, Jonah Hill</td>\n",
       "      <td>The supervillain Megamind finally defeats his ...</td>\n",
       "      <td>...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>7.2</td>\n",
       "      <td>223,114</td>\n",
       "      <td>tt1001526</td>\n",
       "      <td>movie</td>\n",
       "      <td>25 Feb 2011</td>\n",
       "      <td>$148,244,405</td>\n",
       "      <td>Paramount Studios/DWA</td>\n",
       "      <td>NaN</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>State of Grace</td>\n",
       "      <td>1990</td>\n",
       "      <td>R</td>\n",
       "      <td>14 Sep 1990</td>\n",
       "      <td>134 min</td>\n",
       "      <td>Action, Crime, Drama, Romance, Thriller</td>\n",
       "      <td>Phil Joanou</td>\n",
       "      <td>Dennis McIntyre</td>\n",
       "      <td>Sean Penn, Ed Harris, Gary Oldman, Robin Wright</td>\n",
       "      <td>A New York cop is recruited to return to his h...</td>\n",
       "      <td>...</td>\n",
       "      <td>60.0</td>\n",
       "      <td>7.2</td>\n",
       "      <td>20,358</td>\n",
       "      <td>tt0100685</td>\n",
       "      <td>movie</td>\n",
       "      <td>03 Dec 2002</td>\n",
       "      <td>NaN</td>\n",
       "      <td>Orion Pictures Corporation</td>\n",
       "      <td>NaN</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>Slumdog Millionaire</td>\n",
       "      <td>2008</td>\n",
       "      <td>R</td>\n",
       "      <td>25 Dec 2008</td>\n",
       "      <td>120 min</td>\n",
       "      <td>Drama, Romance</td>\n",
       "      <td>Danny Boyle, Loveleen Tandan(co-director)</td>\n",
       "      <td>Simon Beaufoy (screenplay), Vikas Swarup (novel)</td>\n",
       "      <td>Dev Patel, Saurabh Shukla, Anil Kapoor, Raj Zu...</td>\n",
       "      <td>A Mumbai teenager reflects on his life after b...</td>\n",
       "      <td>...</td>\n",
       "      <td>84.0</td>\n",
       "      <td>8.0</td>\n",
       "      <td>785,456</td>\n",
       "      <td>tt1010048</td>\n",
       "      <td>movie</td>\n",
       "      <td>31 Mar 2009</td>\n",
       "      <td>$141,243,551</td>\n",
       "      <td>Fox Searchlight Pictures</td>\n",
       "      <td>NaN</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>Fast &amp; Furious</td>\n",
       "      <td>2009</td>\n",
       "      <td>PG-13</td>\n",
       "      <td>03 Apr 2009</td>\n",
       "      <td>107 min</td>\n",
       "      <td>Action, Thriller</td>\n",
       "      <td>Justin Lin</td>\n",
       "      <td>Chris Morgan, Gary Scott Thompson (characters)</td>\n",
       "      <td>Vin Diesel, Paul Walker, Jordana Brewster, Mic...</td>\n",
       "      <td>Brian O'Conner, back working for the FBI in Lo...</td>\n",
       "      <td>...</td>\n",
       "      <td>46.0</td>\n",
       "      <td>6.6</td>\n",
       "      <td>257,984</td>\n",
       "      <td>tt1013752</td>\n",
       "      <td>movie</td>\n",
       "      <td>27 Jul 2009</td>\n",
       "      <td>$155,022,220</td>\n",
       "      <td>Universal Pictures</td>\n",
       "      <td>NaN</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>Alice in Wonderland</td>\n",
       "      <td>2010</td>\n",
       "      <td>PG</td>\n",
       "      <td>05 Mar 2010</td>\n",
       "      <td>108 min</td>\n",
       "      <td>Adventure, Family, Fantasy</td>\n",
       "      <td>Tim Burton</td>\n",
       "      <td>Linda Woolverton (screenplay), Lewis Carroll (...</td>\n",
       "      <td>Johnny Depp, Mia Wasikowska, Helena Bonham Car...</td>\n",
       "      <td>Nineteen-year-old Alice returns to the magical...</td>\n",
       "      <td>...</td>\n",
       "      <td>53.0</td>\n",
       "      <td>6.4</td>\n",
       "      <td>377,027</td>\n",
       "      <td>tt1014759</td>\n",
       "      <td>movie</td>\n",
       "      <td>01 Jun 2010</td>\n",
       "      <td>$319,323,000</td>\n",
       "      <td>Walt Disney Pictures</td>\n",
       "      <td>NaN</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 25 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                  Title  Year  Rated     Released  Runtime  \\\n",
       "0              Megamind  2010     PG  05 Nov 2010   95 min   \n",
       "3        State of Grace  1990      R  14 Sep 1990  134 min   \n",
       "6   Slumdog Millionaire  2008      R  25 Dec 2008  120 min   \n",
       "9        Fast & Furious  2009  PG-13  03 Apr 2009  107 min   \n",
       "12  Alice in Wonderland  2010     PG  05 Mar 2010  108 min   \n",
       "\n",
       "                                        Genre  \\\n",
       "0   Animation, Action, Comedy, Family, Sci-Fi   \n",
       "3     Action, Crime, Drama, Romance, Thriller   \n",
       "6                              Drama, Romance   \n",
       "9                            Action, Thriller   \n",
       "12                 Adventure, Family, Fantasy   \n",
       "\n",
       "                                     Director  \\\n",
       "0                                 Tom McGrath   \n",
       "3                                 Phil Joanou   \n",
       "6   Danny Boyle, Loveleen Tandan(co-director)   \n",
       "9                                  Justin Lin   \n",
       "12                                 Tim Burton   \n",
       "\n",
       "                                               Writer  \\\n",
       "0                      Alan Schoolcraft, Brent Simons   \n",
       "3                                     Dennis McIntyre   \n",
       "6    Simon Beaufoy (screenplay), Vikas Swarup (novel)   \n",
       "9      Chris Morgan, Gary Scott Thompson (characters)   \n",
       "12  Linda Woolverton (screenplay), Lewis Carroll (...   \n",
       "\n",
       "                                               Actors  \\\n",
       "0       Will Ferrell, Brad Pitt, Tina Fey, Jonah Hill   \n",
       "3     Sean Penn, Ed Harris, Gary Oldman, Robin Wright   \n",
       "6   Dev Patel, Saurabh Shukla, Anil Kapoor, Raj Zu...   \n",
       "9   Vin Diesel, Paul Walker, Jordana Brewster, Mic...   \n",
       "12  Johnny Depp, Mia Wasikowska, Helena Bonham Car...   \n",
       "\n",
       "                                                 Plot  ... Metascore  \\\n",
       "0   The supervillain Megamind finally defeats his ...  ...      63.0   \n",
       "3   A New York cop is recruited to return to his h...  ...      60.0   \n",
       "6   A Mumbai teenager reflects on his life after b...  ...      84.0   \n",
       "9   Brian O'Conner, back working for the FBI in Lo...  ...      46.0   \n",
       "12  Nineteen-year-old Alice returns to the magical...  ...      53.0   \n",
       "\n",
       "   imdbRating imdbVotes     imdbID   Type          DVD     BoxOffice  \\\n",
       "0         7.2   223,114  tt1001526  movie  25 Feb 2011  $148,244,405   \n",
       "3         7.2    20,358  tt0100685  movie  03 Dec 2002           NaN   \n",
       "6         8.0   785,456  tt1010048  movie  31 Mar 2009  $141,243,551   \n",
       "9         6.6   257,984  tt1013752  movie  27 Jul 2009  $155,022,220   \n",
       "12        6.4   377,027  tt1014759  movie  01 Jun 2010  $319,323,000   \n",
       "\n",
       "                    Production Website Response  \n",
       "0        Paramount Studios/DWA     NaN     True  \n",
       "3   Orion Pictures Corporation     NaN     True  \n",
       "6     Fox Searchlight Pictures     NaN     True  \n",
       "9           Universal Pictures     NaN     True  \n",
       "12        Walt Disney Pictures     NaN     True  \n",
       "\n",
       "[5 rows x 25 columns]"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "omdb_movies_final = omdb_movies.drop_duplicates('imdbID')\n",
    "omdb_movies_final.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Const</th>\n",
       "      <th>Your Rating</th>\n",
       "      <th>Date Rated</th>\n",
       "      <th>Title</th>\n",
       "      <th>URL</th>\n",
       "      <th>Title Type</th>\n",
       "      <th>IMDb Rating</th>\n",
       "      <th>Runtime (mins)</th>\n",
       "      <th>Year</th>\n",
       "      <th>Genres</th>\n",
       "      <th>...</th>\n",
       "      <th>Directors</th>\n",
       "      <th>imdbID</th>\n",
       "      <th>Writer</th>\n",
       "      <th>Actors</th>\n",
       "      <th>Plot</th>\n",
       "      <th>Language</th>\n",
       "      <th>Country</th>\n",
       "      <th>Poster</th>\n",
       "      <th>Metascore</th>\n",
       "      <th>BoxOffice</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Animation, Action, Comedy, Family, Sci-Fi</td>\n",
       "      <td>...</td>\n",
       "      <td>Tom McGrath</td>\n",
       "      <td>tt1001526</td>\n",
       "      <td>Alan Schoolcraft, Brent Simons</td>\n",
       "      <td>Will Ferrell, Brad Pitt, Tina Fey, Jonah Hill</td>\n",
       "      <td>The supervillain Megamind finally defeats his ...</td>\n",
       "      <td>English</td>\n",
       "      <td>USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTAzMz...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>$148,244,405</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>tt0100685</td>\n",
       "      <td>7</td>\n",
       "      <td>2014-05-04</td>\n",
       "      <td>State of Grace</td>\n",
       "      <td>https://www.imdb.com/title/tt0100685/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>134.0</td>\n",
       "      <td>1990</td>\n",
       "      <td>Action, Crime, Drama, Romance, Thriller</td>\n",
       "      <td>...</td>\n",
       "      <td>Phil Joanou</td>\n",
       "      <td>tt0100685</td>\n",
       "      <td>Dennis McIntyre</td>\n",
       "      <td>Sean Penn, Ed Harris, Gary Oldman, Robin Wright</td>\n",
       "      <td>A New York cop is recruited to return to his h...</td>\n",
       "      <td>English</td>\n",
       "      <td>UK, USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMjEyNT...</td>\n",
       "      <td>60.0</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>tt1010048</td>\n",
       "      <td>8</td>\n",
       "      <td>2011-05-06</td>\n",
       "      <td>Slumdog Millionaire</td>\n",
       "      <td>https://www.imdb.com/title/tt1010048/</td>\n",
       "      <td>movie</td>\n",
       "      <td>8.0</td>\n",
       "      <td>120.0</td>\n",
       "      <td>2008</td>\n",
       "      <td>Drama, Romance</td>\n",
       "      <td>...</td>\n",
       "      <td>Loveleen Tandan, Danny Boyle</td>\n",
       "      <td>tt1010048</td>\n",
       "      <td>Simon Beaufoy (screenplay), Vikas Swarup (novel)</td>\n",
       "      <td>Dev Patel, Saurabh Shukla, Anil Kapoor, Raj Zu...</td>\n",
       "      <td>A Mumbai teenager reflects on his life after b...</td>\n",
       "      <td>English, Hindi, French, German</td>\n",
       "      <td>UK, USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BZmNjZW...</td>\n",
       "      <td>84.0</td>\n",
       "      <td>$141,243,551</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>tt1013752</td>\n",
       "      <td>6</td>\n",
       "      <td>2011-05-09</td>\n",
       "      <td>Fast &amp; Furious</td>\n",
       "      <td>https://www.imdb.com/title/tt1013752/</td>\n",
       "      <td>movie</td>\n",
       "      <td>6.6</td>\n",
       "      <td>107.0</td>\n",
       "      <td>2009</td>\n",
       "      <td>Action, Thriller</td>\n",
       "      <td>...</td>\n",
       "      <td>Justin Lin</td>\n",
       "      <td>tt1013752</td>\n",
       "      <td>Chris Morgan, Gary Scott Thompson (characters)</td>\n",
       "      <td>Vin Diesel, Paul Walker, Jordana Brewster, Mic...</td>\n",
       "      <td>Brian O'Conner, back working for the FBI in Lo...</td>\n",
       "      <td>English, Spanish</td>\n",
       "      <td>USA, Japan</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BYjQ1ZT...</td>\n",
       "      <td>46.0</td>\n",
       "      <td>$155,022,220</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>tt1014759</td>\n",
       "      <td>6</td>\n",
       "      <td>2011-11-14</td>\n",
       "      <td>Alice in Wonderland</td>\n",
       "      <td>https://www.imdb.com/title/tt1014759/</td>\n",
       "      <td>movie</td>\n",
       "      <td>6.4</td>\n",
       "      <td>108.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Adventure, Family, Fantasy</td>\n",
       "      <td>...</td>\n",
       "      <td>Tim Burton</td>\n",
       "      <td>tt1014759</td>\n",
       "      <td>Linda Woolverton (screenplay), Lewis Carroll (...</td>\n",
       "      <td>Johnny Depp, Mia Wasikowska, Helena Bonham Car...</td>\n",
       "      <td>Nineteen-year-old Alice returns to the magical...</td>\n",
       "      <td>English</td>\n",
       "      <td>USA, UK</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTMwNj...</td>\n",
       "      <td>53.0</td>\n",
       "      <td>$319,323,000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 22 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "       Const  Your Rating  Date Rated                Title  \\\n",
       "0  tt1001526            7  2011-04-12             Megamind   \n",
       "1  tt0100685            7  2014-05-04       State of Grace   \n",
       "2  tt1010048            8  2011-05-06  Slumdog Millionaire   \n",
       "3  tt1013752            6  2011-05-09       Fast & Furious   \n",
       "4  tt1014759            6  2011-11-14  Alice in Wonderland   \n",
       "\n",
       "                                     URL Title Type  IMDb Rating  \\\n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "1  https://www.imdb.com/title/tt0100685/      movie          7.2   \n",
       "2  https://www.imdb.com/title/tt1010048/      movie          8.0   \n",
       "3  https://www.imdb.com/title/tt1013752/      movie          6.6   \n",
       "4  https://www.imdb.com/title/tt1014759/      movie          6.4   \n",
       "\n",
       "   Runtime (mins)  Year                                     Genres  ...  \\\n",
       "0            95.0  2010  Animation, Action, Comedy, Family, Sci-Fi  ...   \n",
       "1           134.0  1990    Action, Crime, Drama, Romance, Thriller  ...   \n",
       "2           120.0  2008                             Drama, Romance  ...   \n",
       "3           107.0  2009                           Action, Thriller  ...   \n",
       "4           108.0  2010                 Adventure, Family, Fantasy  ...   \n",
       "\n",
       "                      Directors     imdbID  \\\n",
       "0                   Tom McGrath  tt1001526   \n",
       "1                   Phil Joanou  tt0100685   \n",
       "2  Loveleen Tandan, Danny Boyle  tt1010048   \n",
       "3                    Justin Lin  tt1013752   \n",
       "4                    Tim Burton  tt1014759   \n",
       "\n",
       "                                              Writer  \\\n",
       "0                     Alan Schoolcraft, Brent Simons   \n",
       "1                                    Dennis McIntyre   \n",
       "2   Simon Beaufoy (screenplay), Vikas Swarup (novel)   \n",
       "3     Chris Morgan, Gary Scott Thompson (characters)   \n",
       "4  Linda Woolverton (screenplay), Lewis Carroll (...   \n",
       "\n",
       "                                              Actors  \\\n",
       "0      Will Ferrell, Brad Pitt, Tina Fey, Jonah Hill   \n",
       "1    Sean Penn, Ed Harris, Gary Oldman, Robin Wright   \n",
       "2  Dev Patel, Saurabh Shukla, Anil Kapoor, Raj Zu...   \n",
       "3  Vin Diesel, Paul Walker, Jordana Brewster, Mic...   \n",
       "4  Johnny Depp, Mia Wasikowska, Helena Bonham Car...   \n",
       "\n",
       "                                                Plot  \\\n",
       "0  The supervillain Megamind finally defeats his ...   \n",
       "1  A New York cop is recruited to return to his h...   \n",
       "2  A Mumbai teenager reflects on his life after b...   \n",
       "3  Brian O'Conner, back working for the FBI in Lo...   \n",
       "4  Nineteen-year-old Alice returns to the magical...   \n",
       "\n",
       "                         Language     Country  \\\n",
       "0                         English         USA   \n",
       "1                         English     UK, USA   \n",
       "2  English, Hindi, French, German     UK, USA   \n",
       "3                English, Spanish  USA, Japan   \n",
       "4                         English     USA, UK   \n",
       "\n",
       "                                              Poster Metascore     BoxOffice  \n",
       "0  https://m.media-amazon.com/images/M/MV5BMTAzMz...      63.0  $148,244,405  \n",
       "1  https://m.media-amazon.com/images/M/MV5BMjEyNT...      60.0           NaN  \n",
       "2  https://m.media-amazon.com/images/M/MV5BZmNjZW...      84.0  $141,243,551  \n",
       "3  https://m.media-amazon.com/images/M/MV5BYjQ1ZT...      46.0  $155,022,220  \n",
       "4  https://m.media-amazon.com/images/M/MV5BMTMwNj...      53.0  $319,323,000  \n",
       "\n",
       "[5 rows x 22 columns]"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#Create master df with all the fields we want\n",
    "all_movies = imdb_movies.merge(\n",
    "    omdb_movies_final[['imdbID', 'Writer', 'Actors', 'Plot', 'Language', 'Country', 'Poster', 'Metascore', 'BoxOffice']],\n",
    "    how = 'left',\n",
    "    left_on = 'Const',\n",
    "    right_on = 'imdbID'\n",
    ")\n",
    "all_movies.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Const</th>\n",
       "      <th>Your Rating</th>\n",
       "      <th>Date Rated</th>\n",
       "      <th>Title</th>\n",
       "      <th>URL</th>\n",
       "      <th>Title Type</th>\n",
       "      <th>IMDb Rating</th>\n",
       "      <th>Runtime (mins)</th>\n",
       "      <th>Year</th>\n",
       "      <th>Genres</th>\n",
       "      <th>...</th>\n",
       "      <th>Directors</th>\n",
       "      <th>imdbID</th>\n",
       "      <th>Writer</th>\n",
       "      <th>Actors</th>\n",
       "      <th>Plot</th>\n",
       "      <th>Language</th>\n",
       "      <th>Country</th>\n",
       "      <th>Poster</th>\n",
       "      <th>Metascore</th>\n",
       "      <th>BoxOffice</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Animation</td>\n",
       "      <td>...</td>\n",
       "      <td>Tom McGrath</td>\n",
       "      <td>tt1001526</td>\n",
       "      <td>Alan Schoolcraft, Brent Simons</td>\n",
       "      <td>Will Ferrell</td>\n",
       "      <td>The supervillain Megamind finally defeats his ...</td>\n",
       "      <td>English</td>\n",
       "      <td>USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTAzMz...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>$148,244,405</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Animation</td>\n",
       "      <td>...</td>\n",
       "      <td>Tom McGrath</td>\n",
       "      <td>tt1001526</td>\n",
       "      <td>Alan Schoolcraft, Brent Simons</td>\n",
       "      <td>Brad Pitt</td>\n",
       "      <td>The supervillain Megamind finally defeats his ...</td>\n",
       "      <td>English</td>\n",
       "      <td>USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTAzMz...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>$148,244,405</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Animation</td>\n",
       "      <td>...</td>\n",
       "      <td>Tom McGrath</td>\n",
       "      <td>tt1001526</td>\n",
       "      <td>Alan Schoolcraft, Brent Simons</td>\n",
       "      <td>Tina Fey</td>\n",
       "      <td>The supervillain Megamind finally defeats his ...</td>\n",
       "      <td>English</td>\n",
       "      <td>USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTAzMz...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>$148,244,405</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Animation</td>\n",
       "      <td>...</td>\n",
       "      <td>Tom McGrath</td>\n",
       "      <td>tt1001526</td>\n",
       "      <td>Alan Schoolcraft, Brent Simons</td>\n",
       "      <td>Jonah Hill</td>\n",
       "      <td>The supervillain Megamind finally defeats his ...</td>\n",
       "      <td>English</td>\n",
       "      <td>USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTAzMz...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>$148,244,405</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Action</td>\n",
       "      <td>...</td>\n",
       "      <td>Tom McGrath</td>\n",
       "      <td>tt1001526</td>\n",
       "      <td>Alan Schoolcraft, Brent Simons</td>\n",
       "      <td>Will Ferrell</td>\n",
       "      <td>The supervillain Megamind finally defeats his ...</td>\n",
       "      <td>English</td>\n",
       "      <td>USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTAzMz...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>$148,244,405</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 22 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "       Const  Your Rating  Date Rated     Title  \\\n",
       "0  tt1001526            7  2011-04-12  Megamind   \n",
       "0  tt1001526            7  2011-04-12  Megamind   \n",
       "0  tt1001526            7  2011-04-12  Megamind   \n",
       "0  tt1001526            7  2011-04-12  Megamind   \n",
       "0  tt1001526            7  2011-04-12  Megamind   \n",
       "\n",
       "                                     URL Title Type  IMDb Rating  \\\n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "\n",
       "   Runtime (mins)  Year     Genres  ...    Directors     imdbID  \\\n",
       "0            95.0  2010  Animation  ...  Tom McGrath  tt1001526   \n",
       "0            95.0  2010  Animation  ...  Tom McGrath  tt1001526   \n",
       "0            95.0  2010  Animation  ...  Tom McGrath  tt1001526   \n",
       "0            95.0  2010  Animation  ...  Tom McGrath  tt1001526   \n",
       "0            95.0  2010     Action  ...  Tom McGrath  tt1001526   \n",
       "\n",
       "                           Writer        Actors  \\\n",
       "0  Alan Schoolcraft, Brent Simons  Will Ferrell   \n",
       "0  Alan Schoolcraft, Brent Simons     Brad Pitt   \n",
       "0  Alan Schoolcraft, Brent Simons      Tina Fey   \n",
       "0  Alan Schoolcraft, Brent Simons    Jonah Hill   \n",
       "0  Alan Schoolcraft, Brent Simons  Will Ferrell   \n",
       "\n",
       "                                                Plot Language Country  \\\n",
       "0  The supervillain Megamind finally defeats his ...  English     USA   \n",
       "0  The supervillain Megamind finally defeats his ...  English     USA   \n",
       "0  The supervillain Megamind finally defeats his ...  English     USA   \n",
       "0  The supervillain Megamind finally defeats his ...  English     USA   \n",
       "0  The supervillain Megamind finally defeats his ...  English     USA   \n",
       "\n",
       "                                              Poster Metascore     BoxOffice  \n",
       "0  https://m.media-amazon.com/images/M/MV5BMTAzMz...      63.0  $148,244,405  \n",
       "0  https://m.media-amazon.com/images/M/MV5BMTAzMz...      63.0  $148,244,405  \n",
       "0  https://m.media-amazon.com/images/M/MV5BMTAzMz...      63.0  $148,244,405  \n",
       "0  https://m.media-amazon.com/images/M/MV5BMTAzMz...      63.0  $148,244,405  \n",
       "0  https://m.media-amazon.com/images/M/MV5BMTAzMz...      63.0  $148,244,405  \n",
       "\n",
       "[5 rows x 22 columns]"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#There are columns with comma separated strings; let's split them out into a row each\n",
    "all_movies = all_movies.assign(Genres=all_movies['Genres'].str.split(',')).explode('Genres') #Split Genres\n",
    "all_movies = all_movies.assign(Directors=all_movies['Directors'].str.split(',')).explode('Directors') #Split Directors\n",
    "all_movies = all_movies.assign(Actors=all_movies['Actors'].str.split(',')).explode('Actors') #Split Actors\n",
    "all_movies = all_movies.assign(Language=all_movies['Language'].str.split(',')).explode('Language') #Split Languages\n",
    "\n",
    "all_movies.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Const</th>\n",
       "      <th>Your Rating</th>\n",
       "      <th>Date Rated</th>\n",
       "      <th>Title</th>\n",
       "      <th>URL</th>\n",
       "      <th>Title Type</th>\n",
       "      <th>IMDb Rating</th>\n",
       "      <th>Runtime (mins)</th>\n",
       "      <th>Year</th>\n",
       "      <th>Genres</th>\n",
       "      <th>...</th>\n",
       "      <th>Directors</th>\n",
       "      <th>imdbID</th>\n",
       "      <th>Writer</th>\n",
       "      <th>Actors</th>\n",
       "      <th>Plot</th>\n",
       "      <th>Language</th>\n",
       "      <th>Country</th>\n",
       "      <th>Poster</th>\n",
       "      <th>Metascore</th>\n",
       "      <th>BoxOffice</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Animation</td>\n",
       "      <td>...</td>\n",
       "      <td>Tom McGrath</td>\n",
       "      <td>tt1001526</td>\n",
       "      <td>Alan Schoolcraft, Brent Simons</td>\n",
       "      <td>Will Ferrell</td>\n",
       "      <td>The supervillain Megamind finally defeats his ...</td>\n",
       "      <td>English</td>\n",
       "      <td>USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTAzMz...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>$148,244,405</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Animation</td>\n",
       "      <td>...</td>\n",
       "      <td>Tom McGrath</td>\n",
       "      <td>tt1001526</td>\n",
       "      <td>Alan Schoolcraft, Brent Simons</td>\n",
       "      <td>Brad Pitt</td>\n",
       "      <td>The supervillain Megamind finally defeats his ...</td>\n",
       "      <td>English</td>\n",
       "      <td>USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTAzMz...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>$148,244,405</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Animation</td>\n",
       "      <td>...</td>\n",
       "      <td>Tom McGrath</td>\n",
       "      <td>tt1001526</td>\n",
       "      <td>Alan Schoolcraft, Brent Simons</td>\n",
       "      <td>Tina Fey</td>\n",
       "      <td>The supervillain Megamind finally defeats his ...</td>\n",
       "      <td>English</td>\n",
       "      <td>USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTAzMz...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>$148,244,405</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Animation</td>\n",
       "      <td>...</td>\n",
       "      <td>Tom McGrath</td>\n",
       "      <td>tt1001526</td>\n",
       "      <td>Alan Schoolcraft, Brent Simons</td>\n",
       "      <td>Jonah Hill</td>\n",
       "      <td>The supervillain Megamind finally defeats his ...</td>\n",
       "      <td>English</td>\n",
       "      <td>USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTAzMz...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>$148,244,405</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Action</td>\n",
       "      <td>...</td>\n",
       "      <td>Tom McGrath</td>\n",
       "      <td>tt1001526</td>\n",
       "      <td>Alan Schoolcraft, Brent Simons</td>\n",
       "      <td>Will Ferrell</td>\n",
       "      <td>The supervillain Megamind finally defeats his ...</td>\n",
       "      <td>English</td>\n",
       "      <td>USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTAzMz...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>$148,244,405</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 22 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "       Const  Your Rating  Date Rated     Title  \\\n",
       "0  tt1001526            7  2011-04-12  Megamind   \n",
       "0  tt1001526            7  2011-04-12  Megamind   \n",
       "0  tt1001526            7  2011-04-12  Megamind   \n",
       "0  tt1001526            7  2011-04-12  Megamind   \n",
       "0  tt1001526            7  2011-04-12  Megamind   \n",
       "\n",
       "                                     URL Title Type  IMDb Rating  \\\n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "\n",
       "   Runtime (mins)  Year     Genres  ...    Directors     imdbID  \\\n",
       "0            95.0  2010  Animation  ...  Tom McGrath  tt1001526   \n",
       "0            95.0  2010  Animation  ...  Tom McGrath  tt1001526   \n",
       "0            95.0  2010  Animation  ...  Tom McGrath  tt1001526   \n",
       "0            95.0  2010  Animation  ...  Tom McGrath  tt1001526   \n",
       "0            95.0  2010     Action  ...  Tom McGrath  tt1001526   \n",
       "\n",
       "                           Writer        Actors  \\\n",
       "0  Alan Schoolcraft, Brent Simons  Will Ferrell   \n",
       "0  Alan Schoolcraft, Brent Simons     Brad Pitt   \n",
       "0  Alan Schoolcraft, Brent Simons      Tina Fey   \n",
       "0  Alan Schoolcraft, Brent Simons    Jonah Hill   \n",
       "0  Alan Schoolcraft, Brent Simons  Will Ferrell   \n",
       "\n",
       "                                                Plot Language Country  \\\n",
       "0  The supervillain Megamind finally defeats his ...  English     USA   \n",
       "0  The supervillain Megamind finally defeats his ...  English     USA   \n",
       "0  The supervillain Megamind finally defeats his ...  English     USA   \n",
       "0  The supervillain Megamind finally defeats his ...  English     USA   \n",
       "0  The supervillain Megamind finally defeats his ...  English     USA   \n",
       "\n",
       "                                              Poster Metascore     BoxOffice  \n",
       "0  https://m.media-amazon.com/images/M/MV5BMTAzMz...      63.0  $148,244,405  \n",
       "0  https://m.media-amazon.com/images/M/MV5BMTAzMz...      63.0  $148,244,405  \n",
       "0  https://m.media-amazon.com/images/M/MV5BMTAzMz...      63.0  $148,244,405  \n",
       "0  https://m.media-amazon.com/images/M/MV5BMTAzMz...      63.0  $148,244,405  \n",
       "0  https://m.media-amazon.com/images/M/MV5BMTAzMz...      63.0  $148,244,405  \n",
       "\n",
       "[5 rows x 22 columns]"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#Explode caused some columns to have extra whitespaces; let's fix that\n",
    "all_movies['Genres'] = all_movies['Genres'].str.strip()\n",
    "all_movies['Directors'] = all_movies['Directors'].str.strip()\n",
    "all_movies['Actors'] = all_movies['Actors'].str.strip()\n",
    "all_movies['Language'] = all_movies['Language'].str.strip()\n",
    "all_movies.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "I have split the languages into separate rows too; but I only want to keep the primary language. So I will remove duplicate rows based on the other unique columns I want to keep.\n",
    "\n",
    "Since the primary language will be the first row for each, the additional rows will be dropped."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Const</th>\n",
       "      <th>Your Rating</th>\n",
       "      <th>Date Rated</th>\n",
       "      <th>Title</th>\n",
       "      <th>URL</th>\n",
       "      <th>Title Type</th>\n",
       "      <th>IMDb Rating</th>\n",
       "      <th>Runtime (mins)</th>\n",
       "      <th>Year</th>\n",
       "      <th>Genres</th>\n",
       "      <th>...</th>\n",
       "      <th>Directors</th>\n",
       "      <th>imdbID</th>\n",
       "      <th>Writer</th>\n",
       "      <th>Actors</th>\n",
       "      <th>Plot</th>\n",
       "      <th>Language</th>\n",
       "      <th>Country</th>\n",
       "      <th>Poster</th>\n",
       "      <th>Metascore</th>\n",
       "      <th>BoxOffice</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Animation</td>\n",
       "      <td>...</td>\n",
       "      <td>Tom McGrath</td>\n",
       "      <td>tt1001526</td>\n",
       "      <td>Alan Schoolcraft, Brent Simons</td>\n",
       "      <td>Will Ferrell</td>\n",
       "      <td>The supervillain Megamind finally defeats his ...</td>\n",
       "      <td>English</td>\n",
       "      <td>USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTAzMz...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>$148,244,405</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Animation</td>\n",
       "      <td>...</td>\n",
       "      <td>Tom McGrath</td>\n",
       "      <td>tt1001526</td>\n",
       "      <td>Alan Schoolcraft, Brent Simons</td>\n",
       "      <td>Brad Pitt</td>\n",
       "      <td>The supervillain Megamind finally defeats his ...</td>\n",
       "      <td>English</td>\n",
       "      <td>USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTAzMz...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>$148,244,405</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Animation</td>\n",
       "      <td>...</td>\n",
       "      <td>Tom McGrath</td>\n",
       "      <td>tt1001526</td>\n",
       "      <td>Alan Schoolcraft, Brent Simons</td>\n",
       "      <td>Tina Fey</td>\n",
       "      <td>The supervillain Megamind finally defeats his ...</td>\n",
       "      <td>English</td>\n",
       "      <td>USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTAzMz...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>$148,244,405</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Animation</td>\n",
       "      <td>...</td>\n",
       "      <td>Tom McGrath</td>\n",
       "      <td>tt1001526</td>\n",
       "      <td>Alan Schoolcraft, Brent Simons</td>\n",
       "      <td>Jonah Hill</td>\n",
       "      <td>The supervillain Megamind finally defeats his ...</td>\n",
       "      <td>English</td>\n",
       "      <td>USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTAzMz...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>$148,244,405</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Action</td>\n",
       "      <td>...</td>\n",
       "      <td>Tom McGrath</td>\n",
       "      <td>tt1001526</td>\n",
       "      <td>Alan Schoolcraft, Brent Simons</td>\n",
       "      <td>Will Ferrell</td>\n",
       "      <td>The supervillain Megamind finally defeats his ...</td>\n",
       "      <td>English</td>\n",
       "      <td>USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTAzMz...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>$148,244,405</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 22 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "       Const  Your Rating  Date Rated     Title  \\\n",
       "0  tt1001526            7  2011-04-12  Megamind   \n",
       "0  tt1001526            7  2011-04-12  Megamind   \n",
       "0  tt1001526            7  2011-04-12  Megamind   \n",
       "0  tt1001526            7  2011-04-12  Megamind   \n",
       "0  tt1001526            7  2011-04-12  Megamind   \n",
       "\n",
       "                                     URL Title Type  IMDb Rating  \\\n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "\n",
       "   Runtime (mins)  Year     Genres  ...    Directors     imdbID  \\\n",
       "0            95.0  2010  Animation  ...  Tom McGrath  tt1001526   \n",
       "0            95.0  2010  Animation  ...  Tom McGrath  tt1001526   \n",
       "0            95.0  2010  Animation  ...  Tom McGrath  tt1001526   \n",
       "0            95.0  2010  Animation  ...  Tom McGrath  tt1001526   \n",
       "0            95.0  2010     Action  ...  Tom McGrath  tt1001526   \n",
       "\n",
       "                           Writer        Actors  \\\n",
       "0  Alan Schoolcraft, Brent Simons  Will Ferrell   \n",
       "0  Alan Schoolcraft, Brent Simons     Brad Pitt   \n",
       "0  Alan Schoolcraft, Brent Simons      Tina Fey   \n",
       "0  Alan Schoolcraft, Brent Simons    Jonah Hill   \n",
       "0  Alan Schoolcraft, Brent Simons  Will Ferrell   \n",
       "\n",
       "                                                Plot Language Country  \\\n",
       "0  The supervillain Megamind finally defeats his ...  English     USA   \n",
       "0  The supervillain Megamind finally defeats his ...  English     USA   \n",
       "0  The supervillain Megamind finally defeats his ...  English     USA   \n",
       "0  The supervillain Megamind finally defeats his ...  English     USA   \n",
       "0  The supervillain Megamind finally defeats his ...  English     USA   \n",
       "\n",
       "                                              Poster Metascore     BoxOffice  \n",
       "0  https://m.media-amazon.com/images/M/MV5BMTAzMz...      63.0  $148,244,405  \n",
       "0  https://m.media-amazon.com/images/M/MV5BMTAzMz...      63.0  $148,244,405  \n",
       "0  https://m.media-amazon.com/images/M/MV5BMTAzMz...      63.0  $148,244,405  \n",
       "0  https://m.media-amazon.com/images/M/MV5BMTAzMz...      63.0  $148,244,405  \n",
       "0  https://m.media-amazon.com/images/M/MV5BMTAzMz...      63.0  $148,244,405  \n",
       "\n",
       "[5 rows x 22 columns]"
      ]
     },
     "execution_count": 20,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "all_movies = all_movies.drop_duplicates(['Const', 'Genres', 'Directors', 'Actors'])\n",
    "all_movies.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The above is pretty much all I needed. However, some filters I was trying to create in Google Data Studio were breaking (looks like a bug to me, because the filters work in the Explorer).\n",
    "\n",
    "To counter that bug, I unfortunately need to take some extra steps which I would have ideally used GDS calculated fields for.\n",
    "\n",
    "I want a \"Favourite Score\" for actors, directors and genres. I will calculate this by taking the square of my average rating and multiplying that by the number of movies for each actor/director/genre.\n",
    "\n",
    "I am squaring it to increase the influence of the rating, otherwise a lesser rated actor who appears in more movies will impact the score."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Your Rating</th>\n",
       "      <th>IMDb Rating</th>\n",
       "      <th>Actor Count</th>\n",
       "      <th>Actor Score</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Actors</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>50 Cent</th>\n",
       "      <td>6.555556</td>\n",
       "      <td>6.555556</td>\n",
       "      <td>2</td>\n",
       "      <td>85.950617</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Aaliyah</th>\n",
       "      <td>6.000000</td>\n",
       "      <td>6.100000</td>\n",
       "      <td>1</td>\n",
       "      <td>36.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Aamir Bashir</th>\n",
       "      <td>6.000000</td>\n",
       "      <td>8.100000</td>\n",
       "      <td>1</td>\n",
       "      <td>36.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Aamir Khan</th>\n",
       "      <td>7.666667</td>\n",
       "      <td>8.066667</td>\n",
       "      <td>5</td>\n",
       "      <td>293.888889</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Aaron Eckhart</th>\n",
       "      <td>7.400000</td>\n",
       "      <td>7.520000</td>\n",
       "      <td>4</td>\n",
       "      <td>219.040000</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "               Your Rating  IMDb Rating  Actor Count  Actor Score\n",
       "Actors                                                           \n",
       "50 Cent           6.555556     6.555556            2    85.950617\n",
       "Aaliyah           6.000000     6.100000            1    36.000000\n",
       "Aamir Bashir      6.000000     8.100000            1    36.000000\n",
       "Aamir Khan        7.666667     8.066667            5   293.888889\n",
       "Aaron Eckhart     7.400000     7.520000            4   219.040000"
      ]
     },
     "execution_count": 21,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#Create unique actors dataframe with Actor Score\n",
    "\n",
    "all_actors = all_movies.groupby(['Actors']).agg({'Your Rating': ['mean'], 'IMDb Rating': ['mean'], 'Const': ['nunique']})\n",
    "all_actors['Actor Score'] = np.power(all_actors['Your Rating']['mean'], 2) * all_actors['Const']['nunique']\n",
    "all_actors.columns = all_actors.columns.droplevel(1)\n",
    "all_actors.rename(columns={\"Const\": \"Actor Count\"}, inplace=True)\n",
    "all_actors.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Your Rating</th>\n",
       "      <th>IMDb Rating</th>\n",
       "      <th>Director Count</th>\n",
       "      <th>Director Score</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Directors</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>Aamir Khan</th>\n",
       "      <td>8.000000</td>\n",
       "      <td>8.400000</td>\n",
       "      <td>1</td>\n",
       "      <td>64.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Aaron Schneider</th>\n",
       "      <td>7.000000</td>\n",
       "      <td>7.000000</td>\n",
       "      <td>1</td>\n",
       "      <td>49.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Aaron Sorkin</th>\n",
       "      <td>7.000000</td>\n",
       "      <td>7.400000</td>\n",
       "      <td>1</td>\n",
       "      <td>49.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Adam Kassen</th>\n",
       "      <td>7.000000</td>\n",
       "      <td>6.800000</td>\n",
       "      <td>1</td>\n",
       "      <td>49.000000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Adam McKay</th>\n",
       "      <td>7.142857</td>\n",
       "      <td>7.285714</td>\n",
       "      <td>2</td>\n",
       "      <td>102.040816</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                 Your Rating  IMDb Rating  Director Count  Director Score\n",
       "Directors                                                                \n",
       "Aamir Khan          8.000000     8.400000               1       64.000000\n",
       "Aaron Schneider     7.000000     7.000000               1       49.000000\n",
       "Aaron Sorkin        7.000000     7.400000               1       49.000000\n",
       "Adam Kassen         7.000000     6.800000               1       49.000000\n",
       "Adam McKay          7.142857     7.285714               2      102.040816"
      ]
     },
     "execution_count": 22,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#Create unique directors dataframe with Director Score\n",
    "\n",
    "all_directors = all_movies.groupby(['Directors']).agg({'Your Rating': ['mean'], 'IMDb Rating': ['mean'], 'Const': ['nunique']})\n",
    "all_directors['Director Score'] = np.power(all_directors['Your Rating']['mean'], 2) * all_directors['Const']['nunique']\n",
    "all_directors.columns = all_directors.columns.droplevel(1)\n",
    "all_directors.rename(columns={\"Const\": \"Director Count\"}, inplace=True)\n",
    "all_directors.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Your Rating</th>\n",
       "      <th>IMDb Rating</th>\n",
       "      <th>Genre Count</th>\n",
       "      <th>Genre Score</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Genres</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>Action</th>\n",
       "      <td>6.887550</td>\n",
       "      <td>6.864458</td>\n",
       "      <td>472</td>\n",
       "      <td>22390.900147</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Adventure</th>\n",
       "      <td>7.123839</td>\n",
       "      <td>7.092879</td>\n",
       "      <td>277</td>\n",
       "      <td>14057.495778</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Animation</th>\n",
       "      <td>7.439560</td>\n",
       "      <td>7.370330</td>\n",
       "      <td>52</td>\n",
       "      <td>2878.047096</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Biography</th>\n",
       "      <td>7.463636</td>\n",
       "      <td>7.420000</td>\n",
       "      <td>108</td>\n",
       "      <td>6016.233719</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Comedy</th>\n",
       "      <td>6.876984</td>\n",
       "      <td>7.040476</td>\n",
       "      <td>206</td>\n",
       "      <td>9742.339601</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "           Your Rating  IMDb Rating  Genre Count   Genre Score\n",
       "Genres                                                        \n",
       "Action        6.887550     6.864458          472  22390.900147\n",
       "Adventure     7.123839     7.092879          277  14057.495778\n",
       "Animation     7.439560     7.370330           52   2878.047096\n",
       "Biography     7.463636     7.420000          108   6016.233719\n",
       "Comedy        6.876984     7.040476          206   9742.339601"
      ]
     },
     "execution_count": 23,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#Create unique genres dataframe with Genre Score\n",
    "\n",
    "all_genres = all_movies.groupby(['Genres']).agg({'Your Rating': ['mean'], 'IMDb Rating': ['mean'], 'Const': ['nunique']})\n",
    "all_genres['Genre Score'] = np.power(all_genres['Your Rating']['mean'], 2) * all_genres['Const']['nunique']\n",
    "all_genres.columns = all_genres.columns.droplevel(1)\n",
    "all_genres.rename(columns={\"Const\": \"Genre Count\"}, inplace=True)\n",
    "all_genres.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "I have everything I need now. I will join everything into one large dataframe."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Const</th>\n",
       "      <th>Your Rating</th>\n",
       "      <th>Date Rated</th>\n",
       "      <th>Title</th>\n",
       "      <th>URL</th>\n",
       "      <th>Title Type</th>\n",
       "      <th>IMDb Rating</th>\n",
       "      <th>Runtime (mins)</th>\n",
       "      <th>Year</th>\n",
       "      <th>Genres</th>\n",
       "      <th>...</th>\n",
       "      <th>Country</th>\n",
       "      <th>Poster</th>\n",
       "      <th>Metascore</th>\n",
       "      <th>BoxOffice</th>\n",
       "      <th>Actor Count</th>\n",
       "      <th>Actor Score</th>\n",
       "      <th>Director Count</th>\n",
       "      <th>Director Score</th>\n",
       "      <th>Genre Count</th>\n",
       "      <th>Genre Score</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Animation</td>\n",
       "      <td>...</td>\n",
       "      <td>USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTAzMz...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>$148,244,405</td>\n",
       "      <td>4</td>\n",
       "      <td>157.388430</td>\n",
       "      <td>2</td>\n",
       "      <td>84.5</td>\n",
       "      <td>52</td>\n",
       "      <td>2878.047096</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Animation</td>\n",
       "      <td>...</td>\n",
       "      <td>USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTAzMz...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>$148,244,405</td>\n",
       "      <td>22</td>\n",
       "      <td>1243.936920</td>\n",
       "      <td>2</td>\n",
       "      <td>84.5</td>\n",
       "      <td>52</td>\n",
       "      <td>2878.047096</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Animation</td>\n",
       "      <td>...</td>\n",
       "      <td>USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTAzMz...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>$148,244,405</td>\n",
       "      <td>2</td>\n",
       "      <td>85.950617</td>\n",
       "      <td>2</td>\n",
       "      <td>84.5</td>\n",
       "      <td>52</td>\n",
       "      <td>2878.047096</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Animation</td>\n",
       "      <td>...</td>\n",
       "      <td>USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTAzMz...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>$148,244,405</td>\n",
       "      <td>8</td>\n",
       "      <td>369.170036</td>\n",
       "      <td>2</td>\n",
       "      <td>84.5</td>\n",
       "      <td>52</td>\n",
       "      <td>2878.047096</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>tt1001526</td>\n",
       "      <td>7</td>\n",
       "      <td>2011-04-12</td>\n",
       "      <td>Megamind</td>\n",
       "      <td>https://www.imdb.com/title/tt1001526/</td>\n",
       "      <td>movie</td>\n",
       "      <td>7.2</td>\n",
       "      <td>95.0</td>\n",
       "      <td>2010</td>\n",
       "      <td>Action</td>\n",
       "      <td>...</td>\n",
       "      <td>USA</td>\n",
       "      <td>https://m.media-amazon.com/images/M/MV5BMTAzMz...</td>\n",
       "      <td>63.0</td>\n",
       "      <td>$148,244,405</td>\n",
       "      <td>4</td>\n",
       "      <td>157.388430</td>\n",
       "      <td>2</td>\n",
       "      <td>84.5</td>\n",
       "      <td>472</td>\n",
       "      <td>22390.900147</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>5 rows × 28 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "       Const  Your Rating  Date Rated     Title  \\\n",
       "0  tt1001526            7  2011-04-12  Megamind   \n",
       "0  tt1001526            7  2011-04-12  Megamind   \n",
       "0  tt1001526            7  2011-04-12  Megamind   \n",
       "0  tt1001526            7  2011-04-12  Megamind   \n",
       "0  tt1001526            7  2011-04-12  Megamind   \n",
       "\n",
       "                                     URL Title Type  IMDb Rating  \\\n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "0  https://www.imdb.com/title/tt1001526/      movie          7.2   \n",
       "\n",
       "   Runtime (mins)  Year     Genres  ...  Country  \\\n",
       "0            95.0  2010  Animation  ...      USA   \n",
       "0            95.0  2010  Animation  ...      USA   \n",
       "0            95.0  2010  Animation  ...      USA   \n",
       "0            95.0  2010  Animation  ...      USA   \n",
       "0            95.0  2010     Action  ...      USA   \n",
       "\n",
       "                                              Poster Metascore     BoxOffice  \\\n",
       "0  https://m.media-amazon.com/images/M/MV5BMTAzMz...      63.0  $148,244,405   \n",
       "0  https://m.media-amazon.com/images/M/MV5BMTAzMz...      63.0  $148,244,405   \n",
       "0  https://m.media-amazon.com/images/M/MV5BMTAzMz...      63.0  $148,244,405   \n",
       "0  https://m.media-amazon.com/images/M/MV5BMTAzMz...      63.0  $148,244,405   \n",
       "0  https://m.media-amazon.com/images/M/MV5BMTAzMz...      63.0  $148,244,405   \n",
       "\n",
       "  Actor Count  Actor Score Director Count Director Score Genre Count  \\\n",
       "0           4   157.388430              2           84.5          52   \n",
       "0          22  1243.936920              2           84.5          52   \n",
       "0           2    85.950617              2           84.5          52   \n",
       "0           8   369.170036              2           84.5          52   \n",
       "0           4   157.388430              2           84.5         472   \n",
       "\n",
       "    Genre Score  \n",
       "0   2878.047096  \n",
       "0   2878.047096  \n",
       "0   2878.047096  \n",
       "0   2878.047096  \n",
       "0  22390.900147  \n",
       "\n",
       "[5 rows x 28 columns]"
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "favourites = all_movies.copy()\n",
    "favourites = favourites.merge(all_actors[['Actor Count', 'Actor Score']], how='left', left_on = 'Actors', right_index = True)\n",
    "favourites = favourites.merge(all_directors[['Director Count', 'Director Score']], how='left', left_on = 'Directors', right_index = True)\n",
    "favourites = favourites.merge(all_genres[['Genre Count', 'Genre Score']], how='left', left_on = 'Genres', right_index = True)\n",
    "favourites.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [],
   "source": [
    "#Output all final data\n",
    "favourites.to_csv(\"output/all_movies.csv\", index = False)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## All Done!\n",
    "\n",
    "Hope you enjoyed my process! Leave a [comment on my blog](https://muhammadali.xyz/my-movie-stats-visualized/) with your thoughts :)"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}