ipynb/read_and_write_data2/jun_anl_read_data2.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# **18 Чтение и запись данных. Часть 2**"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Курс ведёт **Андрей Мещеряков** Data Scientist в EPAM"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## **18.1** *Чтение данных JSON из веб-сервисов*\n",
    "\n",
    "**План модуля**\n",
    "\n",
    "* Чтение данных JSON из веб-сервисов\n",
    "* Чтение и запись файлов в формате JSON\n",
    "* Чтение данных из баз данных (при помощи Python, без консоли)\n",
    "* Работа с большими данными — MongoDB\n",
    "* Домашнее задание\n",
    "\n",
    "### JSON\n",
    "\n",
    "В этом уроке мы узнаем для чего используется формат JSON, научимся читать данные в этом формате из веб-сервисов, а также преобразовывать их в `DataFrame` ***pandas***.\n",
    "\n",
    "JavaScript Object Notation — нотация объектов JavaScript\\\n",
    "Пример JSON:\n",
    "<pre><code>\n",
    "    {\n",
    "    \"title\":\"Moscow\",\n",
    "    \"location_type\":\"City\",\n",
    "    \"woeid\":2122265,\n",
    "    \"latt_long\":\"55.756950,37.614971\"\n",
    "    }\n",
    "</code></pre>\n",
    "\n",
    "Этот формат очень похож на словари в Python. И мы будем испльзовать это сходство в дальнейшем. Изначально он использовался только в языке Javascript как синтаксис объектов. Но он оказался настолько удачным, что сейчас стал самостоятельным текстовым форматом, который \"из коробки\" поддерживается во многих языках, в т.ч. и в Python.\\\n",
    "Чаще всего JSON используется для обмена данными между устройствами в Интернете, например, между мобильным приложением и сервером. Или между веб-сайтом и его сервером. Или просто между двумя серверами.\n",
    "\n",
    "Преимущества формата JSON:\n",
    "* понятен человеку\n",
    "* с ним удобно работать\n",
    "* не зависит от языка программирования"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "B3LoqX2c81W3"
   },
   "source": [
    "### Чтение данных из web-сервисов\n",
    "\n",
    "Любое взаимодействие с web-сервисами состоит из нескольких этапов.\n",
    "\n",
    "Этапы взаимодействия с веб-сервисом:\n",
    "* Клиент отправляет запрос по адресу (URL) сервиса (URL — universal resource locator, универсальный локатор\n",
    "ресурсов)\n",
    "* Сервис обрабатывает запрос и возвращает результат клиенту (этот этап полностью скрыт от глаз клиента: мы не можем видеть что происходит внутри сервера)\n",
    "* Клиент принимает ответ сервера и завершает соединение\n",
    "\n",
    "<!DOCTYPE html>\n",
    "<html>\n",
    " <head>\n",
    "  <meta charset=\"utf-8\">\n",
    "  <title></title>\n",
    "  <style>\n",
    "   .thumb img  {\n",
    "    border: 2px solid #55c5e9; /* Рамка вокруг фотографии */\n",
    "    padding: 15px; /* Расстояние от картинки до рамки */\n",
    "    background: #666; /* Цвет фона */\n",
    "    margin-right: 10px; /* Отступ справа */\n",
    "    margin-bottom: 10px; /* Отступ снизу */\n",
    "   }\n",
    "  </style>\n",
    " </head>\n",
    " <body>\n",
    "  <p class=\"thumb\">\n",
    "    <img src=\"img/img1.png\" height=700 width=250 alt=\"Данные мечты\" class=\"thumb\">\n",
    "    <img src=\"img/img2.png\" height=700 width=252 alt=\"Данные мечты\" class=\"thumb\">\n",
    "    <img src=\"img/img3.png\" height=700 width=268 alt=\"Данные мечты\" class=\"thumb\">\n",
    "  </p>\n",
    " </body>\n",
    "</html>"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Поиск данных о погоде в городе при помощи сервиса MetaWeather\n",
    "\n",
    "Для выполнения запросов к сервису, используем модуль `urllib.request`"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "Bu7cArSu81W6"
   },
   "outputs": [],
   "source": [
    "import urllib.request as req\n",
    "import json\n",
    "import pandas as pd"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "y7Ge9bJD81XH"
   },
   "source": [
    "Сформируем запрос к веб-сервису поиска города. Используем следующий адрес веб-сервиса:\n",
    "\n",
    "#### Поиск идентификатора города"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "9_QCtl-r81XJ",
    "outputId": "0c8e8e5e-2a72-401f-aeac-4a620ea8df24"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'[{\"title\":\"Moscow\",\"location_type\":\"City\",\"woeid\":2122265,\"latt_long\":\"55.756950,37.614971\"}]'"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "url = \"https://www.metaweather.com/api/location/search/?query=moscow\"\n",
    "\n",
    "session = req.urlopen(url) # сессия связи с сервером\n",
    "response = session.read().decode() # запишем ответ сервера\n",
    "session.close() # закрываем соединение с сервером\n",
    "\n",
    "response"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Как видно, ответ сервера очень похож на словарь.\n",
    "\n",
    "Важно не забывать закрывать соединение кадждый раз, когда заканчиваем получение ответа от сервера.\\\n",
    "Если забыть и оставить соединение открытым, то это может вызвать разные неприятные последствия: утечку памяти, сложность использования браузера или др. приложений, использующих Интернет.\\\n",
    "Закрыть соединение можно двумя способами:\n",
    "* использовать метод **`session.close()`**,\\\n",
    "но есть недостаток у этого метода: можно забыть вызвать метод\n",
    "* использовать **менеджер контекста** (ключевое слово `with` при создании сессии).\\\n",
    "В этом случае, не нужно явно вызывать метод `close` - это будет сделано автоматически как только выполнится блок инструкций внутри `with`.\n",
    "\n",
    "Перепишем ячейку с использованием инструкции `with`"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "7_EbPEdd81XT",
    "outputId": "8e08a943-21b2-4d54-d308-95798184322b"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'[{\"title\":\"Moscow\",\"location_type\":\"City\",\"woeid\":2122265,\"latt_long\":\"55.756950,37.614971\"}]'"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "url = \"https://www.metaweather.com/api/location/search/?query=moscow\"\n",
    "\n",
    "with req.urlopen(url) as session:\n",
    "    response1 = session.read().decode()\n",
    "response1"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Готово. И нам не нужно закрывать соединение самостоятельно. Это за нас сделал **менеджер контекста**.\n",
    "\n",
    "Теперь перейдём к работе с ответом сервера. Он записан в формате JSON.\\\n",
    "В Python при работе с JSON чаще всего используют два подхода:\n",
    "1. С ним работают как и со словарём, т.к. он сам похож на словарь\n",
    "2. Можно преобразовать его в `DataFrame` **`pandas`**\\\n",
    "и работать с ним как с другими датафреймами.\n",
    "\n",
    "Оба подхода используют специальные методы из библиотеки JSON, которые предоставят нам дополнительную функциональность.\\\n",
    "Преобразуем ответ сервера к словарю. Вызовем функцию `loads` из модуля `json` и передадим ей ответ сервера."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "6Lj3uroL81Xb",
    "outputId": "3afef411-d354-4ac9-ecfb-23231e3bcd19"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'title': 'Moscow',\n",
       " 'location_type': 'City',\n",
       " 'woeid': 2122265,\n",
       " 'latt_long': '55.756950,37.614971'}"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "url = \"https://www.metaweather.com/api/location/search/?query=moscow\"\n",
    "\n",
    "with req.urlopen(url) as session:\n",
    "    response1 = session.read().decode()\n",
    "    data = json.loads(response1) # присвоим переменной data результат функции loads\n",
    "data[0] # и выведем её на экран"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Мы видим список из одного словаря. Такой формат использует сервер для того, чтобы вернуть результат поиска, видимо, на случай, если будет найдено больше одного города.\\\n",
    "Мы вывели первый элемент этого списка.\\\n",
    "Итак, мы видим словарь, из которого мы можем получить идентификатор Москвы просто обратившись по ключу `woeid`.\\\n",
    "Запишем этот идентификтор в переменную `city`"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "JjK-zZxh81Xj",
    "outputId": "ec4bdc33-e446-41d4-d69d-b2b4ffe39311"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "2122265"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "city = data[0]['woeid']\n",
    "city"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "TTp-yTTI81Xq"
   },
   "source": [
    "#### Получение истории погоды\n",
    "\n",
    "Теперь выполним другой запрос, чтобы получить историю погоды в Москве за неделю.\\\n",
    "Для этого используем следующий адрес:\\\n",
    "(Здесь мы используем в url идентификатор города, который мы получили в предыдущем запросе. А после идентификатора идёт YYYY/mm/dd, за которые мы хотим получить данные о погоде).\n",
    "Преобразуем ответ сервера из строки в словарь и выведем его на экран"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "VTzvO03b81Xs",
    "outputId": "1bf6764a-a794-45d7-ead5-2173ef0d8758",
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[{'id': 4919777191526400,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-07-20T18:29:31.885101Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 16.794999999999998,\n",
       "  'max_temp': 24.02,\n",
       "  'the_temp': 23.005,\n",
       "  'wind_speed': 2.833971496858347,\n",
       "  'wind_direction': 300.6971747272375,\n",
       "  'air_pressure': 1011.5,\n",
       "  'humidity': 66,\n",
       "  'visibility': 12.808945756780403,\n",
       "  'predictability': 75},\n",
       " {'id': 5843753002598400,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-07-20T15:29:31.460467Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 16.794999999999998,\n",
       "  'max_temp': 24.02,\n",
       "  'the_temp': 22.95,\n",
       "  'wind_speed': 2.833971496858347,\n",
       "  'wind_direction': 300.6971747272375,\n",
       "  'air_pressure': 1011.5,\n",
       "  'humidity': 66,\n",
       "  'visibility': 12.808945756780403,\n",
       "  'predictability': 73},\n",
       " {'id': 4695383806574592,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-20T12:29:32.565565Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 16.724999999999998,\n",
       "  'max_temp': 23.92,\n",
       "  'the_temp': 21.939999999999998,\n",
       "  'wind_speed': 2.7411799186696357,\n",
       "  'wind_direction': 313.66663657794044,\n",
       "  'air_pressure': 1013.0,\n",
       "  'humidity': 71,\n",
       "  'visibility': 12.808945756780403,\n",
       "  'predictability': 73},\n",
       " {'id': 4806990276591616,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-20T09:29:32.257786Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 16.84,\n",
       "  'max_temp': 22.765,\n",
       "  'the_temp': 21.9,\n",
       "  'wind_speed': 2.5419696853363027,\n",
       "  'wind_direction': 317.3299021184476,\n",
       "  'air_pressure': 1013.0,\n",
       "  'humidity': 71,\n",
       "  'visibility': 12.501367016622922,\n",
       "  'predictability': 73},\n",
       " {'id': 6202314589208576,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-07-20T06:29:32.073897Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.115,\n",
       "  'max_temp': 21.955,\n",
       "  'the_temp': 20.64,\n",
       "  'wind_speed': 2.3568010490760627,\n",
       "  'wind_direction': 328.28048857461255,\n",
       "  'air_pressure': 1013.0,\n",
       "  'humidity': 69,\n",
       "  'visibility': 11.168215123677722,\n",
       "  'predictability': 75},\n",
       " {'id': 5224521143418880,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-07-20T03:29:33.583986Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.375,\n",
       "  'max_temp': 22.18,\n",
       "  'the_temp': 20.68,\n",
       "  'wind_speed': 2.6234677157427293,\n",
       "  'wind_direction': 331.35398418937433,\n",
       "  'air_pressure': 1013.0,\n",
       "  'humidity': 70,\n",
       "  'visibility': 11.11508788674143,\n",
       "  'predictability': 75},\n",
       " {'id': 5431512780505088,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-07-20T00:29:32.173478Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.614999999999998,\n",
       "  'max_temp': 23.05,\n",
       "  'the_temp': 20.93,\n",
       "  'wind_speed': 3.7846014417137255,\n",
       "  'wind_direction': 330.95708612705266,\n",
       "  'air_pressure': 1011.5,\n",
       "  'humidity': 64,\n",
       "  'visibility': 13.85129593175853,\n",
       "  'predictability': 75},\n",
       " {'id': 4761532342730752,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-19T21:29:31.039087Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.614999999999998,\n",
       "  'max_temp': 23.05,\n",
       "  'the_temp': 21.065,\n",
       "  'wind_speed': 3.1284353083803924,\n",
       "  'wind_direction': 308.30386836234067,\n",
       "  'air_pressure': 1009.5,\n",
       "  'humidity': 66,\n",
       "  'visibility': 11.261420802513321,\n",
       "  'predictability': 75},\n",
       " {'id': 4864295173095424,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-19T18:29:34.844031Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.675,\n",
       "  'max_temp': 19.725,\n",
       "  'the_temp': 20.22,\n",
       "  'wind_speed': 3.585032339526498,\n",
       "  'wind_direction': 324.95052346041354,\n",
       "  'air_pressure': 1012.5,\n",
       "  'humidity': 73,\n",
       "  'visibility': 9.874209615843473,\n",
       "  'predictability': 75},\n",
       " {'id': 5888541458432000,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-19T15:29:33.982460Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.675,\n",
       "  'max_temp': 19.725,\n",
       "  'the_temp': 20.2,\n",
       "  'wind_speed': 3.577575906193165,\n",
       "  'wind_direction': 324.95052346041354,\n",
       "  'air_pressure': 1012.5,\n",
       "  'humidity': 74,\n",
       "  'visibility': 9.571912530820011,\n",
       "  'predictability': 75},\n",
       " {'id': 5570326526164992,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-19T12:29:34.058569Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.649999999999999,\n",
       "  'max_temp': 19.1,\n",
       "  'the_temp': 20.064999999999998,\n",
       "  'wind_speed': 3.7432748907897877,\n",
       "  'wind_direction': 319.3329905781327,\n",
       "  'air_pressure': 1012.5,\n",
       "  'humidity': 74,\n",
       "  'visibility': 9.252527738010022,\n",
       "  'predictability': 77},\n",
       " {'id': 6486747825307648,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-19T09:29:35.338169Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.3,\n",
       "  'max_temp': 18.674999999999997,\n",
       "  'the_temp': 19.99,\n",
       "  'wind_speed': 3.8716953574564545,\n",
       "  'wind_direction': 317.3299021184476,\n",
       "  'air_pressure': 1012.0,\n",
       "  'humidity': 73,\n",
       "  'visibility': 9.847801340173387,\n",
       "  'predictability': 77},\n",
       " {'id': 6623753423290368,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-19T06:29:34.153016Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 14.975000000000001,\n",
       "  'max_temp': 18.86,\n",
       "  'the_temp': 19.49,\n",
       "  'wind_speed': 3.712624290296667,\n",
       "  'wind_direction': 315.9993901614561,\n",
       "  'air_pressure': 1012.0,\n",
       "  'humidity': 77,\n",
       "  'visibility': 9.149069434502504,\n",
       "  'predictability': 77},\n",
       " {'id': 5377824447791104,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-19T03:29:34.547118Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 14.86,\n",
       "  'max_temp': 19.34,\n",
       "  'the_temp': 19.485,\n",
       "  'wind_speed': 3.9749935902966675,\n",
       "  'wind_direction': 313.0064297614647,\n",
       "  'air_pressure': 1012.0,\n",
       "  'humidity': 78,\n",
       "  'visibility': 8.328238089556987,\n",
       "  'predictability': 75},\n",
       " {'id': 4958395121532928,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-07-19T00:29:35.849812Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 14.530000000000001,\n",
       "  'max_temp': 20.060000000000002,\n",
       "  'the_temp': 19.185000000000002,\n",
       "  'wind_speed': 4.226027824616241,\n",
       "  'wind_direction': 297.0,\n",
       "  'air_pressure': 1011.0,\n",
       "  'humidity': 75,\n",
       "  'visibility': 12.806149586415334,\n",
       "  'predictability': 75},\n",
       " {'id': 4592018472828928,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-07-18T21:29:33.964414Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 14.530000000000001,\n",
       "  'max_temp': 20.060000000000002,\n",
       "  'the_temp': 19.16,\n",
       "  'wind_speed': 4.300592157949574,\n",
       "  'wind_direction': 303.0080158152948,\n",
       "  'air_pressure': 1009.0,\n",
       "  'humidity': 76,\n",
       "  'visibility': 11.870675256502029,\n",
       "  'predictability': 77},\n",
       " {'id': 6497094837731328,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-18T18:29:38.189563Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.5,\n",
       "  'max_temp': 20.82,\n",
       "  'the_temp': 20.805,\n",
       "  'wind_speed': 3.792148521935894,\n",
       "  'wind_direction': 313.3338037204484,\n",
       "  'air_pressure': 1012.5,\n",
       "  'humidity': 69,\n",
       "  'visibility': 12.691817287043666,\n",
       "  'predictability': 75},\n",
       " {'id': 5515548781707264,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-18T15:29:38.266512Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.5,\n",
       "  'max_temp': 20.82,\n",
       "  'the_temp': 20.77,\n",
       "  'wind_speed': 3.7623227886025608,\n",
       "  'wind_direction': 313.3338037204484,\n",
       "  'air_pressure': 1012.5,\n",
       "  'humidity': 70,\n",
       "  'visibility': 12.901840750019883,\n",
       "  'predictability': 75},\n",
       " {'id': 6166102746857472,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-18T12:29:38.942025Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.425,\n",
       "  'max_temp': 20.925,\n",
       "  'the_temp': 20.735,\n",
       "  'wind_speed': 3.685687008226623,\n",
       "  'wind_direction': 310.6661282155967,\n",
       "  'air_pressure': 1012.5,\n",
       "  'humidity': 68,\n",
       "  'visibility': 12.615388630398472,\n",
       "  'predictability': 75},\n",
       " {'id': 5281846424240128,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-18T09:29:38.063016Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.445,\n",
       "  'max_temp': 21.27,\n",
       "  'the_temp': 20.759999999999998,\n",
       "  'wind_speed': 3.3831434415599566,\n",
       "  'wind_direction': 307.9978606740761,\n",
       "  'air_pressure': 1012.5,\n",
       "  'humidity': 67,\n",
       "  'visibility': 11.950832140300644,\n",
       "  'predictability': 75},\n",
       " {'id': 6165934974697472,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-18T06:29:38.188082Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.864999999999998,\n",
       "  'max_temp': 22.955,\n",
       "  'the_temp': 23.09,\n",
       "  'wind_speed': 3.2650830199024363,\n",
       "  'wind_direction': 307.7345209943367,\n",
       "  'air_pressure': 1013.0,\n",
       "  'humidity': 62,\n",
       "  'visibility': 12.941297820726954,\n",
       "  'predictability': 75},\n",
       " {'id': 5314052773380096,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-18T03:29:38.077836Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.844999999999999,\n",
       "  'max_temp': 23.345,\n",
       "  'the_temp': 23.085,\n",
       "  'wind_speed': 3.437626586569103,\n",
       "  'wind_direction': 307.3905395389413,\n",
       "  'air_pressure': 1012.5,\n",
       "  'humidity': 63,\n",
       "  'visibility': 13.471638133301518,\n",
       "  'predictability': 75},\n",
       " {'id': 5420806500777984,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-07-18T00:29:37.848180Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.48,\n",
       "  'max_temp': 24.29,\n",
       "  'the_temp': 23.21,\n",
       "  'wind_speed': 3.7764806744929618,\n",
       "  'wind_direction': 290.0,\n",
       "  'air_pressure': 1012.0,\n",
       "  'humidity': 60,\n",
       "  'visibility': 13.041959953869402,\n",
       "  'predictability': 73},\n",
       " {'id': 6034350195867648,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-07-17T21:29:38.838727Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.48,\n",
       "  'max_temp': 24.29,\n",
       "  'the_temp': 23.59,\n",
       "  'wind_speed': 3.6944599078262943,\n",
       "  'wind_direction': 298.3780778653654,\n",
       "  'air_pressure': 1010.5,\n",
       "  'humidity': 60,\n",
       "  'visibility': 12.146564065855404,\n",
       "  'predictability': 75},\n",
       " {'id': 5492408034787328,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-17T18:29:41.965740Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.765,\n",
       "  'max_temp': 22.625,\n",
       "  'the_temp': 22.54,\n",
       "  'wind_speed': 3.3230619386330496,\n",
       "  'wind_direction': 309.99847470611667,\n",
       "  'air_pressure': 1013.0,\n",
       "  'humidity': 65,\n",
       "  'visibility': 12.901840750019883,\n",
       "  'predictability': 75},\n",
       " {'id': 4828190235164672,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-17T15:29:42.055016Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.765,\n",
       "  'max_temp': 22.625,\n",
       "  'the_temp': 22.435000000000002,\n",
       "  'wind_speed': 3.3230619386330496,\n",
       "  'wind_direction': 309.99847470611667,\n",
       "  'air_pressure': 1013.0,\n",
       "  'humidity': 66,\n",
       "  'visibility': 13.476609102839417,\n",
       "  'predictability': 75},\n",
       " {'id': 5481795036381184,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-17T12:29:40.479368Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.745000000000001,\n",
       "  'max_temp': 22.965,\n",
       "  'the_temp': 22.625,\n",
       "  'wind_speed': 3.4518928572098946,\n",
       "  'wind_direction': 311.33387178440324,\n",
       "  'air_pressure': 1013.0,\n",
       "  'humidity': 63,\n",
       "  'visibility': 13.224643084387179,\n",
       "  'predictability': 75},\n",
       " {'id': 4808211490144256,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-07-17T09:29:41.267969Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.55,\n",
       "  'max_temp': 23.31,\n",
       "  'the_temp': 22.595,\n",
       "  'wind_speed': 3.738210990543228,\n",
       "  'wind_direction': 326.5287173916311,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 61,\n",
       "  'visibility': 12.605446691322676,\n",
       "  'predictability': 75},\n",
       " {'id': 4745430644555776,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-17T06:29:41.346865Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.309999999999999,\n",
       "  'max_temp': 23.145,\n",
       "  'the_temp': 23.205,\n",
       "  'wind_speed': 3.5066467224899918,\n",
       "  'wind_direction': 323.9202374139645,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 59,\n",
       "  'visibility': 12.826344150163049,\n",
       "  'predictability': 71},\n",
       " {'id': 5665936256270336,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-17T03:29:41.267475Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.265,\n",
       "  'max_temp': 23.985,\n",
       "  'the_temp': 23.2,\n",
       "  'wind_speed': 3.1301543224899917,\n",
       "  'wind_direction': 315.0,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 61,\n",
       "  'visibility': 13.83047999681858,\n",
       "  'predictability': 73},\n",
       " {'id': 6450804183531520,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-07-17T00:29:40.654500Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.715,\n",
       "  'max_temp': 24.325,\n",
       "  'the_temp': 22.67,\n",
       "  'wind_speed': 3.4801932177152097,\n",
       "  'wind_direction': 284.0,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 62,\n",
       "  'visibility': 12.908675833134495,\n",
       "  'predictability': 75},\n",
       " {'id': 6192726309601280,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-07-16T21:29:40.612885Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.715,\n",
       "  'max_temp': 24.325,\n",
       "  'the_temp': 23.034999999999997,\n",
       "  'wind_speed': 3.52493181771521,\n",
       "  'wind_direction': 296.3952340365035,\n",
       "  'air_pressure': 1012.0,\n",
       "  'humidity': 60,\n",
       "  'visibility': 13.062465203213234,\n",
       "  'predictability': 75},\n",
       " {'id': 6717817904693248,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-07-16T18:29:45.292134Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.08,\n",
       "  'max_temp': 24.17,\n",
       "  'the_temp': 23.775,\n",
       "  'wind_speed': 3.629774797998356,\n",
       "  'wind_direction': 286.57783312937227,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 59,\n",
       "  'visibility': 12.953103873379463,\n",
       "  'predictability': 73},\n",
       " {'id': 6282622391025664,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-07-16T15:29:44.543147Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.08,\n",
       "  'max_temp': 24.17,\n",
       "  'the_temp': 23.740000000000002,\n",
       "  'wind_speed': 3.6819698313316898,\n",
       "  'wind_direction': 286.57783312937227,\n",
       "  'air_pressure': 1013.0,\n",
       "  'humidity': 60,\n",
       "  'visibility': 13.768653563190965,\n",
       "  'predictability': 71},\n",
       " {'id': 5448740968071168,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-07-16T12:29:43.717590Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.055,\n",
       "  'max_temp': 23.845,\n",
       "  'the_temp': 22.86,\n",
       "  'wind_speed': 3.4731890687929163,\n",
       "  'wind_direction': 294.27095968840945,\n",
       "  'air_pressure': 1012.5,\n",
       "  'humidity': 63,\n",
       "  'visibility': 13.328722759086933,\n",
       "  'predictability': 77},\n",
       " {'id': 4787503775088640,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-16T09:29:43.072039Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 14.969999999999999,\n",
       "  'max_temp': 23.875,\n",
       "  'the_temp': 22.79,\n",
       "  'wind_speed': 3.759158668792916,\n",
       "  'wind_direction': 307.8915561164231,\n",
       "  'air_pressure': 1012.5,\n",
       "  'humidity': 63,\n",
       "  'visibility': 11.975686987990137,\n",
       "  'predictability': 77},\n",
       " {'id': 6096300569264128,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-07-16T06:29:43.265141Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 14.85,\n",
       "  'max_temp': 24.28,\n",
       "  'the_temp': 23.1,\n",
       "  'wind_speed': 3.7450742131551737,\n",
       "  'wind_direction': 297.9668165243225,\n",
       "  'air_pressure': 1012.0,\n",
       "  'humidity': 61,\n",
       "  'visibility': 12.675040264853257,\n",
       "  'predictability': 75},\n",
       " {'id': 5919543035691008,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-07-16T03:29:43.055793Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 14.965,\n",
       "  'max_temp': 23.79,\n",
       "  'the_temp': 23.255000000000003,\n",
       "  'wind_speed': 3.5427049131551738,\n",
       "  'wind_direction': 300.74522575347123,\n",
       "  'air_pressure': 1012.0,\n",
       "  'humidity': 63,\n",
       "  'visibility': 13.897588085580212,\n",
       "  'predictability': 75},\n",
       " {'id': 4888432553754624,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-16T00:29:44.179349Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.715,\n",
       "  'max_temp': 21.015,\n",
       "  'the_temp': 20.065,\n",
       "  'wind_speed': 3.866646553882658,\n",
       "  'wind_direction': 306.13979750243465,\n",
       "  'air_pressure': 1010.0,\n",
       "  'humidity': 76,\n",
       "  'visibility': 13.623874075399666,\n",
       "  'predictability': 75},\n",
       " {'id': 6000994439659520,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-07-15T21:29:42.971159Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.715,\n",
       "  'max_temp': 21.015,\n",
       "  'the_temp': 17.1,\n",
       "  'wind_speed': 4.334780680823988,\n",
       "  'wind_direction': 289.0,\n",
       "  'air_pressure': 1002.0,\n",
       "  'humidity': 83,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 6483666857361408,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-07-15T18:29:46.542707Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.170000000000002,\n",
       "  'max_temp': 20.465,\n",
       "  'the_temp': 18.42,\n",
       "  'wind_speed': 4.030308796627694,\n",
       "  'wind_direction': 346.0,\n",
       "  'air_pressure': 1008.0,\n",
       "  'humidity': 78,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 5982289555095552,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-07-15T15:29:47.339323Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.170000000000002,\n",
       "  'max_temp': 20.465,\n",
       "  'the_temp': 18.42,\n",
       "  'wind_speed': 4.030308796627694,\n",
       "  'wind_direction': 346.0,\n",
       "  'air_pressure': 1008.0,\n",
       "  'humidity': 78,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 4505435287584768,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-07-15T12:29:47.547152Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.3,\n",
       "  'max_temp': 23.23,\n",
       "  'the_temp': 23.21,\n",
       "  'wind_speed': 4.170117314881095,\n",
       "  'wind_direction': 327.0,\n",
       "  'air_pressure': 1008.0,\n",
       "  'humidity': 67,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 5184659904266240,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-07-15T09:29:47.792083Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.17,\n",
       "  'max_temp': 24.744999999999997,\n",
       "  'the_temp': 23.21,\n",
       "  'wind_speed': 4.050117314881094,\n",
       "  'wind_direction': 326.5,\n",
       "  'air_pressure': 1008.0,\n",
       "  'humidity': 60,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 5209980615524352,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-15T06:29:47.889727Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.61,\n",
       "  'max_temp': 25.369999999999997,\n",
       "  'the_temp': 24.37,\n",
       "  'wind_speed': 4.1930326890956815,\n",
       "  'wind_direction': 320.5,\n",
       "  'air_pressure': 1011.0,\n",
       "  'humidity': 57,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 5913899448664064,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-07-15T03:29:46.385115Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.565,\n",
       "  'max_temp': 25.11,\n",
       "  'the_temp': 24.37,\n",
       "  'wind_speed': 3.758032689095681,\n",
       "  'wind_direction': 338.0,\n",
       "  'air_pressure': 1011.0,\n",
       "  'humidity': 57,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 5978459652227072,\n",
       "  'weather_state_name': 'Light Cloud',\n",
       "  'weather_state_abbr': 'lc',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-07-15T00:29:46.462514Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.115,\n",
       "  'max_temp': 24.64,\n",
       "  'the_temp': 23.8,\n",
       "  'wind_speed': 3.469095084705321,\n",
       "  'wind_direction': 15.999999999999995,\n",
       "  'air_pressure': 1008.0,\n",
       "  'humidity': 50,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 70},\n",
       " {'id': 6040788351844352,\n",
       "  'weather_state_name': 'Light Cloud',\n",
       "  'weather_state_abbr': 'lc',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-07-14T21:29:46.479269Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.115,\n",
       "  'max_temp': 24.64,\n",
       "  'the_temp': 23.8,\n",
       "  'wind_speed': 3.469095084705321,\n",
       "  'wind_direction': 15.999999999999995,\n",
       "  'air_pressure': 1008.0,\n",
       "  'humidity': 50,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 70},\n",
       " {'id': 5546936000053248,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-07-14T18:29:50.573289Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 14.844999999999999,\n",
       "  'max_temp': 23.275,\n",
       "  'the_temp': 21.16,\n",
       "  'wind_speed': 4.605901733874175,\n",
       "  'wind_direction': 346.5,\n",
       "  'air_pressure': 1011.0,\n",
       "  'humidity': 64,\n",
       "  'visibility': 9.529348604151753,\n",
       "  'predictability': 77},\n",
       " {'id': 5112107471208448,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-07-14T15:30:06.980581Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 14.844999999999999,\n",
       "  'max_temp': 23.275,\n",
       "  'the_temp': 21.16,\n",
       "  'wind_speed': 4.605901733874175,\n",
       "  'wind_direction': 346.5,\n",
       "  'air_pressure': 1011.0,\n",
       "  'humidity': 64,\n",
       "  'visibility': 9.529348604151753,\n",
       "  'predictability': 77},\n",
       " {'id': 4683193112330240,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-07-14T12:28:49.948758Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 14.82,\n",
       "  'max_temp': 24.8,\n",
       "  'the_temp': 24.02,\n",
       "  'wind_speed': 4.6152223017577345,\n",
       "  'wind_direction': 356.5,\n",
       "  'air_pressure': 1011.0,\n",
       "  'humidity': 62,\n",
       "  'visibility': 9.529348604151753,\n",
       "  'predictability': 77},\n",
       " {'id': 6527141623627776,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-07-14T09:28:49.746457Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.0,\n",
       "  'max_temp': 24.455,\n",
       "  'the_temp': 24.02,\n",
       "  'wind_speed': 5.250222301757734,\n",
       "  'wind_direction': 2.999999999999988,\n",
       "  'air_pressure': 1011.0,\n",
       "  'humidity': 64,\n",
       "  'visibility': 9.651758729022509,\n",
       "  'predictability': 77},\n",
       " {'id': 4983152957194240,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-07-14T06:28:49.218896Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 14.905,\n",
       "  'max_temp': 23.29,\n",
       "  'the_temp': 22.57,\n",
       "  'wind_speed': 5.060704088125348,\n",
       "  'wind_direction': 355.0,\n",
       "  'air_pressure': 1009.0,\n",
       "  'humidity': 65,\n",
       "  'visibility': 9.651758729022509,\n",
       "  'predictability': 77},\n",
       " {'id': 6205194331226112,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-07-14T03:28:49.646224Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 14.995,\n",
       "  'max_temp': 23.75,\n",
       "  'the_temp': 22.57,\n",
       "  'wind_speed': 5.290704088125348,\n",
       "  'wind_direction': 358.5,\n",
       "  'air_pressure': 1009.0,\n",
       "  'humidity': 63,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 6482354241536000,\n",
       "  'weather_state_name': 'Light Cloud',\n",
       "  'weather_state_abbr': 'lc',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-07-14T00:28:51.376018Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.219999999999999,\n",
       "  'max_temp': 24.14,\n",
       "  'the_temp': 22.75,\n",
       "  'wind_speed': 5.296917800047721,\n",
       "  'wind_direction': 1.9999999999999993,\n",
       "  'air_pressure': 1009.0,\n",
       "  'humidity': 54,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 70},\n",
       " {'id': 6538574960787456,\n",
       "  'weather_state_name': 'Light Cloud',\n",
       "  'weather_state_abbr': 'lc',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-07-13T21:28:51.960596Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.219999999999999,\n",
       "  'max_temp': 24.14,\n",
       "  'the_temp': 22.75,\n",
       "  'wind_speed': 5.296917800047721,\n",
       "  'wind_direction': 1.9999999999999993,\n",
       "  'air_pressure': 1009.0,\n",
       "  'humidity': 54,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 70},\n",
       " {'id': 5667761751588864,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-07-13T18:28:52.857300Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 14.64,\n",
       "  'max_temp': 24.21,\n",
       "  'the_temp': 23.11,\n",
       "  'wind_speed': 5.230222301757735,\n",
       "  'wind_direction': 351.5,\n",
       "  'air_pressure': 1017.0,\n",
       "  'humidity': 55,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 71},\n",
       " {'id': 6074970922811392,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-07-13T15:28:52.787511Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 14.64,\n",
       "  'max_temp': 24.21,\n",
       "  'the_temp': 23.11,\n",
       "  'wind_speed': 5.230222301757735,\n",
       "  'wind_direction': 351.5,\n",
       "  'air_pressure': 1017.0,\n",
       "  'humidity': 55,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 71},\n",
       " {'id': 5568341815066624,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-07-13T12:28:52.974109Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 14.805,\n",
       "  'max_temp': 24.345,\n",
       "  'the_temp': 23.16,\n",
       "  'wind_speed': 5.295466276942655,\n",
       "  'wind_direction': 356.5,\n",
       "  'air_pressure': 1015.0,\n",
       "  'humidity': 56,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 71},\n",
       " {'id': 5038612494155776,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-07-13T09:28:52.672721Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.049999999999999,\n",
       "  'max_temp': 24.134999999999998,\n",
       "  'the_temp': 23.16,\n",
       "  'wind_speed': 5.470466276942655,\n",
       "  'wind_direction': 9.499999999999998,\n",
       "  'air_pressure': 1015.0,\n",
       "  'humidity': 63,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 6416168493514752,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-07-13T06:28:52.968890Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 14.37,\n",
       "  'max_temp': 23.560000000000002,\n",
       "  'the_temp': 21.89,\n",
       "  'wind_speed': 5.7842587290225085,\n",
       "  'wind_direction': 25.499999999999996,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 58,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 71},\n",
       " {'id': 4859397467537408,\n",
       "  'weather_state_name': 'Clear',\n",
       "  'weather_state_abbr': 'c',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-07-13T03:28:52.863944Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 14.79,\n",
       "  'max_temp': 23.51,\n",
       "  'the_temp': 21.89,\n",
       "  'wind_speed': 3.678517458045017,\n",
       "  'wind_direction': 40.0,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 35,\n",
       "  'visibility': None,\n",
       "  'predictability': 68},\n",
       " {'id': 6360345226510336,\n",
       "  'weather_state_name': 'Clear',\n",
       "  'weather_state_abbr': 'c',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-07-13T00:28:51.971253Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 14.06,\n",
       "  'max_temp': 21.5,\n",
       "  'the_temp': 19.97,\n",
       "  'wind_speed': 4.219110395291498,\n",
       "  'wind_direction': 284.0,\n",
       "  'air_pressure': 1004.0,\n",
       "  'humidity': 40,\n",
       "  'visibility': None,\n",
       "  'predictability': 68},\n",
       " {'id': 5016182396551168,\n",
       "  'weather_state_name': 'Clear',\n",
       "  'weather_state_abbr': 'c',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-07-12T21:28:52.276977Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 14.06,\n",
       "  'max_temp': 21.5,\n",
       "  'the_temp': 19.97,\n",
       "  'wind_speed': 4.219110395291498,\n",
       "  'wind_direction': 284.0,\n",
       "  'air_pressure': 1004.0,\n",
       "  'humidity': 40,\n",
       "  'visibility': None,\n",
       "  'predictability': 68},\n",
       " {'id': 5271940921032704,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-07-12T18:28:55.556794Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 17.66,\n",
       "  'max_temp': 23.27,\n",
       "  'the_temp': 18.55,\n",
       "  'wind_speed': 1.6777022190408017,\n",
       "  'wind_direction': 14.999999999999998,\n",
       "  'air_pressure': 1005.0,\n",
       "  'humidity': 82,\n",
       "  'visibility': None,\n",
       "  'predictability': 77},\n",
       " {'id': 5120773607915520,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-07-12T15:28:55.767568Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 17.66,\n",
       "  'max_temp': 23.27,\n",
       "  'the_temp': 18.55,\n",
       "  'wind_speed': 1.6777022190408017,\n",
       "  'wind_direction': 14.999999999999998,\n",
       "  'air_pressure': 1005.0,\n",
       "  'humidity': 82,\n",
       "  'visibility': None,\n",
       "  'predictability': 77},\n",
       " {'id': 6677667845767168,\n",
       "  'weather_state_name': 'Clear',\n",
       "  'weather_state_abbr': 'c',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-12T12:28:56.353567Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 13.96,\n",
       "  'max_temp': 22.75,\n",
       "  'the_temp': 21.25,\n",
       "  'wind_speed': 2.895589755825976,\n",
       "  'wind_direction': 305.0,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 42,\n",
       "  'visibility': None,\n",
       "  'predictability': 68},\n",
       " {'id': 6138189385302016,\n",
       "  'weather_state_name': 'Clear',\n",
       "  'weather_state_abbr': 'c',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-12T09:28:55.458437Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 13.96,\n",
       "  'max_temp': 22.75,\n",
       "  'the_temp': 21.25,\n",
       "  'wind_speed': 2.895589755825976,\n",
       "  'wind_direction': 305.0,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 42,\n",
       "  'visibility': None,\n",
       "  'predictability': 68},\n",
       " {'id': 6017893491802112,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-12T06:28:56.068337Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.35,\n",
       "  'max_temp': 19.09,\n",
       "  'the_temp': 16.16,\n",
       "  'wind_speed': 4.026485325697924,\n",
       "  'wind_direction': 306.0,\n",
       "  'air_pressure': 1009.0,\n",
       "  'humidity': 74,\n",
       "  'visibility': None,\n",
       "  'predictability': 71},\n",
       " {'id': 5086167177363456,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-07-12T03:28:55.565714Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 15.35,\n",
       "  'max_temp': 19.09,\n",
       "  'the_temp': 16.16,\n",
       "  'wind_speed': 4.026485325697924,\n",
       "  'wind_direction': 306.0,\n",
       "  'air_pressure': 1009.0,\n",
       "  'humidity': 74,\n",
       "  'visibility': None,\n",
       "  'predictability': 71},\n",
       " {'id': 6477870966767616,\n",
       "  'weather_state_name': 'Clear',\n",
       "  'weather_state_abbr': 'c',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-07-12T00:28:57.379884Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 14.77,\n",
       "  'max_temp': 23.89,\n",
       "  'the_temp': 22.39,\n",
       "  'wind_speed': 2.8085977889127496,\n",
       "  'wind_direction': 17.000000000000004,\n",
       "  'air_pressure': 1011.0,\n",
       "  'humidity': 44,\n",
       "  'visibility': None,\n",
       "  'predictability': 68},\n",
       " {'id': 4715301616746496,\n",
       "  'weather_state_name': 'Clear',\n",
       "  'weather_state_abbr': 'c',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-07-11T21:28:55.964456Z',\n",
       "  'applicable_date': '2020-07-20',\n",
       "  'min_temp': 14.77,\n",
       "  'max_temp': 23.89,\n",
       "  'the_temp': 22.39,\n",
       "  'wind_speed': 2.8085977889127496,\n",
       "  'wind_direction': 17.000000000000004,\n",
       "  'air_pressure': 1011.0,\n",
       "  'humidity': 44,\n",
       "  'visibility': None,\n",
       "  'predictability': 68}]"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "url = 'https://www.metaweather.com/api/location/2122265/2020/07/20/'\n",
    "\n",
    "with req.urlopen(url) as session:\n",
    "    response = session.read().decode()\n",
    "    data = json.loads(response)\n",
    "data"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "На самом деле ответ был преобразован не в словарь, а в список словарей. И каждый словарь содержит одинаковую иформацию.\\\n",
    "Для нас важно то, что все словари в этом списке имеют одинаковый набор полей. А значит мы можем преобразовать этот список в датафрейм.\\\n",
    "Для этого воспользуемся функцией `read_json` библиотеки **`pandas`**. Передадим ей на вход строку, полученную от сервера и выедем первые 5 строк на экран."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "hk5Vnmlh81Xz",
    "outputId": "17bf0a9d-ace8-4e58-9273-931083a97057"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>id</th>\n",
       "      <th>weather_state_name</th>\n",
       "      <th>weather_state_abbr</th>\n",
       "      <th>wind_direction_compass</th>\n",
       "      <th>created</th>\n",
       "      <th>applicable_date</th>\n",
       "      <th>min_temp</th>\n",
       "      <th>max_temp</th>\n",
       "      <th>the_temp</th>\n",
       "      <th>wind_speed</th>\n",
       "      <th>wind_direction</th>\n",
       "      <th>air_pressure</th>\n",
       "      <th>humidity</th>\n",
       "      <th>visibility</th>\n",
       "      <th>predictability</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>4919777191526400</td>\n",
       "      <td>Light Rain</td>\n",
       "      <td>lr</td>\n",
       "      <td>WNW</td>\n",
       "      <td>2020-07-20T18:29:31.885101Z</td>\n",
       "      <td>2020-07-20</td>\n",
       "      <td>16.795</td>\n",
       "      <td>24.020</td>\n",
       "      <td>23.005</td>\n",
       "      <td>2.833971</td>\n",
       "      <td>300.697175</td>\n",
       "      <td>1011.5</td>\n",
       "      <td>66</td>\n",
       "      <td>12.808946</td>\n",
       "      <td>75</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>5843753002598400</td>\n",
       "      <td>Showers</td>\n",
       "      <td>s</td>\n",
       "      <td>WNW</td>\n",
       "      <td>2020-07-20T15:29:31.460467Z</td>\n",
       "      <td>2020-07-20</td>\n",
       "      <td>16.795</td>\n",
       "      <td>24.020</td>\n",
       "      <td>22.950</td>\n",
       "      <td>2.833971</td>\n",
       "      <td>300.697175</td>\n",
       "      <td>1011.5</td>\n",
       "      <td>66</td>\n",
       "      <td>12.808946</td>\n",
       "      <td>73</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>4695383806574592</td>\n",
       "      <td>Showers</td>\n",
       "      <td>s</td>\n",
       "      <td>NW</td>\n",
       "      <td>2020-07-20T12:29:32.565565Z</td>\n",
       "      <td>2020-07-20</td>\n",
       "      <td>16.725</td>\n",
       "      <td>23.920</td>\n",
       "      <td>21.940</td>\n",
       "      <td>2.741180</td>\n",
       "      <td>313.666637</td>\n",
       "      <td>1013.0</td>\n",
       "      <td>71</td>\n",
       "      <td>12.808946</td>\n",
       "      <td>73</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>4806990276591616</td>\n",
       "      <td>Showers</td>\n",
       "      <td>s</td>\n",
       "      <td>NW</td>\n",
       "      <td>2020-07-20T09:29:32.257786Z</td>\n",
       "      <td>2020-07-20</td>\n",
       "      <td>16.840</td>\n",
       "      <td>22.765</td>\n",
       "      <td>21.900</td>\n",
       "      <td>2.541970</td>\n",
       "      <td>317.329902</td>\n",
       "      <td>1013.0</td>\n",
       "      <td>71</td>\n",
       "      <td>12.501367</td>\n",
       "      <td>73</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>6202314589208576</td>\n",
       "      <td>Light Rain</td>\n",
       "      <td>lr</td>\n",
       "      <td>NNW</td>\n",
       "      <td>2020-07-20T06:29:32.073897Z</td>\n",
       "      <td>2020-07-20</td>\n",
       "      <td>15.115</td>\n",
       "      <td>21.955</td>\n",
       "      <td>20.640</td>\n",
       "      <td>2.356801</td>\n",
       "      <td>328.280489</td>\n",
       "      <td>1013.0</td>\n",
       "      <td>69</td>\n",
       "      <td>11.168215</td>\n",
       "      <td>75</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                 id weather_state_name weather_state_abbr  \\\n",
       "0  4919777191526400         Light Rain                 lr   \n",
       "1  5843753002598400            Showers                  s   \n",
       "2  4695383806574592            Showers                  s   \n",
       "3  4806990276591616            Showers                  s   \n",
       "4  6202314589208576         Light Rain                 lr   \n",
       "\n",
       "  wind_direction_compass                      created applicable_date  \\\n",
       "0                    WNW  2020-07-20T18:29:31.885101Z      2020-07-20   \n",
       "1                    WNW  2020-07-20T15:29:31.460467Z      2020-07-20   \n",
       "2                     NW  2020-07-20T12:29:32.565565Z      2020-07-20   \n",
       "3                     NW  2020-07-20T09:29:32.257786Z      2020-07-20   \n",
       "4                    NNW  2020-07-20T06:29:32.073897Z      2020-07-20   \n",
       "\n",
       "   min_temp  max_temp  the_temp  wind_speed  wind_direction  air_pressure  \\\n",
       "0    16.795    24.020    23.005    2.833971      300.697175        1011.5   \n",
       "1    16.795    24.020    22.950    2.833971      300.697175        1011.5   \n",
       "2    16.725    23.920    21.940    2.741180      313.666637        1013.0   \n",
       "3    16.840    22.765    21.900    2.541970      317.329902        1013.0   \n",
       "4    15.115    21.955    20.640    2.356801      328.280489        1013.0   \n",
       "\n",
       "   humidity  visibility  predictability  \n",
       "0        66   12.808946              75  \n",
       "1        66   12.808946              73  \n",
       "2        71   12.808946              73  \n",
       "3        71   12.501367              73  \n",
       "4        69   11.168215              75  "
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df = pd.read_json(response)\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "И теперь мы можем работать как с обычным датафреймом. Например, давайте посмотрим за какой период времени доступны данные о погоде.\\\n",
    "Для этого найдём минимум и максимум столбца с датой"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "9h7DzkCb81X8",
    "outputId": "4716ce29-3f27-4077-dce9-9d408adebd54"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'2020-07-11T21:28:55.964456Z'"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df['created'].min()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "2CmmRlRz81YE",
    "outputId": "10f9a2a6-753b-4b9f-b80f-934307291649"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'2020-07-20T18:29:31.885101Z'"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df['created'].max()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Здесь мы видим, что формат даты содержит помимо YYYY-mm-dd ещё и время с точностью до микросекунд. Это наиболее полный формат записи даты и времени.\\\n",
    "Итак, мы нашли данные минимум и максимум даты, похоже что нам доступны данные сразу за неделю, а не за один день. Это хорошо. Т.е. если нам нужен больший период времени, то нам понадобится делать меньше запросов к веб-серверу.\n",
    "\n",
    "Вернёмся к функции `read_json`. Кроме строки с JSON, в эту функцию можно передать адрес сервиса, возвращающего JSON.\\\n",
    "Давайте попробуем: скопируем адрес сервиса и передадим его в функцию `read_json`"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "CDC9c4ju81YK",
    "outputId": "6488e134-40b5-4f88-f7b1-b305c8f54c22"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>id</th>\n",
       "      <th>weather_state_name</th>\n",
       "      <th>weather_state_abbr</th>\n",
       "      <th>wind_direction_compass</th>\n",
       "      <th>created</th>\n",
       "      <th>applicable_date</th>\n",
       "      <th>min_temp</th>\n",
       "      <th>max_temp</th>\n",
       "      <th>the_temp</th>\n",
       "      <th>wind_speed</th>\n",
       "      <th>wind_direction</th>\n",
       "      <th>air_pressure</th>\n",
       "      <th>humidity</th>\n",
       "      <th>visibility</th>\n",
       "      <th>predictability</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>4919777191526400</td>\n",
       "      <td>Light Rain</td>\n",
       "      <td>lr</td>\n",
       "      <td>WNW</td>\n",
       "      <td>2020-07-20T18:29:31.885101Z</td>\n",
       "      <td>2020-07-20</td>\n",
       "      <td>16.795</td>\n",
       "      <td>24.020</td>\n",
       "      <td>23.005</td>\n",
       "      <td>2.833971</td>\n",
       "      <td>300.697175</td>\n",
       "      <td>1011.5</td>\n",
       "      <td>66</td>\n",
       "      <td>12.808946</td>\n",
       "      <td>75</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>5843753002598400</td>\n",
       "      <td>Showers</td>\n",
       "      <td>s</td>\n",
       "      <td>WNW</td>\n",
       "      <td>2020-07-20T15:29:31.460467Z</td>\n",
       "      <td>2020-07-20</td>\n",
       "      <td>16.795</td>\n",
       "      <td>24.020</td>\n",
       "      <td>22.950</td>\n",
       "      <td>2.833971</td>\n",
       "      <td>300.697175</td>\n",
       "      <td>1011.5</td>\n",
       "      <td>66</td>\n",
       "      <td>12.808946</td>\n",
       "      <td>73</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>4695383806574592</td>\n",
       "      <td>Showers</td>\n",
       "      <td>s</td>\n",
       "      <td>NW</td>\n",
       "      <td>2020-07-20T12:29:32.565565Z</td>\n",
       "      <td>2020-07-20</td>\n",
       "      <td>16.725</td>\n",
       "      <td>23.920</td>\n",
       "      <td>21.940</td>\n",
       "      <td>2.741180</td>\n",
       "      <td>313.666637</td>\n",
       "      <td>1013.0</td>\n",
       "      <td>71</td>\n",
       "      <td>12.808946</td>\n",
       "      <td>73</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>4806990276591616</td>\n",
       "      <td>Showers</td>\n",
       "      <td>s</td>\n",
       "      <td>NW</td>\n",
       "      <td>2020-07-20T09:29:32.257786Z</td>\n",
       "      <td>2020-07-20</td>\n",
       "      <td>16.840</td>\n",
       "      <td>22.765</td>\n",
       "      <td>21.900</td>\n",
       "      <td>2.541970</td>\n",
       "      <td>317.329902</td>\n",
       "      <td>1013.0</td>\n",
       "      <td>71</td>\n",
       "      <td>12.501367</td>\n",
       "      <td>73</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>6202314589208576</td>\n",
       "      <td>Light Rain</td>\n",
       "      <td>lr</td>\n",
       "      <td>NNW</td>\n",
       "      <td>2020-07-20T06:29:32.073897Z</td>\n",
       "      <td>2020-07-20</td>\n",
       "      <td>15.115</td>\n",
       "      <td>21.955</td>\n",
       "      <td>20.640</td>\n",
       "      <td>2.356801</td>\n",
       "      <td>328.280489</td>\n",
       "      <td>1013.0</td>\n",
       "      <td>69</td>\n",
       "      <td>11.168215</td>\n",
       "      <td>75</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                 id weather_state_name weather_state_abbr  \\\n",
       "0  4919777191526400         Light Rain                 lr   \n",
       "1  5843753002598400            Showers                  s   \n",
       "2  4695383806574592            Showers                  s   \n",
       "3  4806990276591616            Showers                  s   \n",
       "4  6202314589208576         Light Rain                 lr   \n",
       "\n",
       "  wind_direction_compass                      created applicable_date  \\\n",
       "0                    WNW  2020-07-20T18:29:31.885101Z      2020-07-20   \n",
       "1                    WNW  2020-07-20T15:29:31.460467Z      2020-07-20   \n",
       "2                     NW  2020-07-20T12:29:32.565565Z      2020-07-20   \n",
       "3                     NW  2020-07-20T09:29:32.257786Z      2020-07-20   \n",
       "4                    NNW  2020-07-20T06:29:32.073897Z      2020-07-20   \n",
       "\n",
       "   min_temp  max_temp  the_temp  wind_speed  wind_direction  air_pressure  \\\n",
       "0    16.795    24.020    23.005    2.833971      300.697175        1011.5   \n",
       "1    16.795    24.020    22.950    2.833971      300.697175        1011.5   \n",
       "2    16.725    23.920    21.940    2.741180      313.666637        1013.0   \n",
       "3    16.840    22.765    21.900    2.541970      317.329902        1013.0   \n",
       "4    15.115    21.955    20.640    2.356801      328.280489        1013.0   \n",
       "\n",
       "   humidity  visibility  predictability  \n",
       "0        66   12.808946              75  \n",
       "1        66   12.808946              73  \n",
       "2        71   12.808946              73  \n",
       "3        71   12.501367              73  \n",
       "4        69   11.168215              75  "
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df = pd.read_json(url)\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Итак, мы убедились, что это тот же самый датафрейм. И при этом нам не понадобилось выполнять промежуточные шаги: сначала читать JSON, потом передавать преобразованную строку в **`pandas`**. Но следует обратить внимание на то, что в датафрейм можно преобразовать только список словарей, но не обычный словарь.\n",
    "\n",
    "### Выводы\n",
    "На уроке мы узнали:\n",
    "* JSON - текстровый формат записи данных об объектах\n",
    "* JSON чаще всего используются для передачи данных между клиентом и сервером\n",
    "* Как запросить данные у веб-серверов\n",
    "* Как преобразовать в датафрейм"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "FOXDpSRnrknP"
   },
   "source": [
    "### Практика\n",
    "\n",
    "#### Задание 1\n",
    "\n",
    "Используя сервис MetaWeather, найдите идентификатор города Париж (Paris). Для запроса используйте адрес из следующей ячейки, заменив `%city%` на имя города."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "1Xljt65SrknP"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'title': 'Paris',\n",
       " 'location_type': 'City',\n",
       " 'woeid': 615702,\n",
       " 'latt_long': '48.856930,2.341200'}"
      ]
     },
     "execution_count": 19,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "url = \"https://www.metaweather.com/api/location/search/?query=%s\" % ('Paris')\n",
    "\n",
    "with req.urlopen(url) as session:\n",
    "    response = session.read().decode()\n",
    "\n",
    "data = json.loads(response)\n",
    "data[0]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "H0XwvPuJrknR"
   },
   "source": [
    "#### Задание 2\n",
    "\n",
    "Используя полученный идентификатор города, запросите данные о погоде в Париже за 28 мая 2020 года. Для запроса используйте адрес из следующей ячейки, заменив `%city_id%`, `%year%`, `%month%`, `%day%` на идентификатор города, год, месяц и день соответственно. JSON с данными о погоде преобразуйте к датафрейму и найдите среднюю температуру для тех данных, которые вы получили от сервиса. Актуальная температура записывается в столбце `the_temp`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "tjsftok3rknS"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>id</th>\n",
       "      <th>weather_state_name</th>\n",
       "      <th>weather_state_abbr</th>\n",
       "      <th>wind_direction_compass</th>\n",
       "      <th>created</th>\n",
       "      <th>applicable_date</th>\n",
       "      <th>min_temp</th>\n",
       "      <th>max_temp</th>\n",
       "      <th>the_temp</th>\n",
       "      <th>wind_speed</th>\n",
       "      <th>wind_direction</th>\n",
       "      <th>air_pressure</th>\n",
       "      <th>humidity</th>\n",
       "      <th>visibility</th>\n",
       "      <th>predictability</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>6723109975490560</td>\n",
       "      <td>Clear</td>\n",
       "      <td>c</td>\n",
       "      <td>NE</td>\n",
       "      <td>2020-05-28T21:36:04.490586Z</td>\n",
       "      <td>2020-05-28</td>\n",
       "      <td>14.970</td>\n",
       "      <td>21.925</td>\n",
       "      <td>21.810</td>\n",
       "      <td>7.253747</td>\n",
       "      <td>45.331452</td>\n",
       "      <td>1028.0</td>\n",
       "      <td>43</td>\n",
       "      <td>15.078815</td>\n",
       "      <td>68</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>5582221102546944</td>\n",
       "      <td>Clear</td>\n",
       "      <td>c</td>\n",
       "      <td>NE</td>\n",
       "      <td>2020-05-28T18:36:05.696646Z</td>\n",
       "      <td>2020-05-28</td>\n",
       "      <td>13.895</td>\n",
       "      <td>24.470</td>\n",
       "      <td>24.165</td>\n",
       "      <td>7.170185</td>\n",
       "      <td>41.668908</td>\n",
       "      <td>1028.5</td>\n",
       "      <td>42</td>\n",
       "      <td>15.078815</td>\n",
       "      <td>68</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>4875719383449600</td>\n",
       "      <td>Clear</td>\n",
       "      <td>c</td>\n",
       "      <td>NE</td>\n",
       "      <td>2020-05-28T15:36:05.294001Z</td>\n",
       "      <td>2020-05-28</td>\n",
       "      <td>13.895</td>\n",
       "      <td>24.470</td>\n",
       "      <td>24.165</td>\n",
       "      <td>7.170185</td>\n",
       "      <td>41.668908</td>\n",
       "      <td>1028.5</td>\n",
       "      <td>42</td>\n",
       "      <td>15.078815</td>\n",
       "      <td>68</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>5781794072821760</td>\n",
       "      <td>Clear</td>\n",
       "      <td>c</td>\n",
       "      <td>NE</td>\n",
       "      <td>2020-05-28T12:36:04.965983Z</td>\n",
       "      <td>2020-05-28</td>\n",
       "      <td>13.865</td>\n",
       "      <td>23.555</td>\n",
       "      <td>22.340</td>\n",
       "      <td>7.230251</td>\n",
       "      <td>42.670098</td>\n",
       "      <td>1030.0</td>\n",
       "      <td>48</td>\n",
       "      <td>15.078815</td>\n",
       "      <td>68</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>5252630563520512</td>\n",
       "      <td>Clear</td>\n",
       "      <td>c</td>\n",
       "      <td>NE</td>\n",
       "      <td>2020-05-28T09:36:04.743683Z</td>\n",
       "      <td>2020-05-28</td>\n",
       "      <td>13.930</td>\n",
       "      <td>23.000</td>\n",
       "      <td>22.370</td>\n",
       "      <td>7.199636</td>\n",
       "      <td>43.334991</td>\n",
       "      <td>1030.0</td>\n",
       "      <td>47</td>\n",
       "      <td>14.516474</td>\n",
       "      <td>68</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                 id weather_state_name weather_state_abbr  \\\n",
       "0  6723109975490560              Clear                  c   \n",
       "1  5582221102546944              Clear                  c   \n",
       "2  4875719383449600              Clear                  c   \n",
       "3  5781794072821760              Clear                  c   \n",
       "4  5252630563520512              Clear                  c   \n",
       "\n",
       "  wind_direction_compass                      created applicable_date  \\\n",
       "0                     NE  2020-05-28T21:36:04.490586Z      2020-05-28   \n",
       "1                     NE  2020-05-28T18:36:05.696646Z      2020-05-28   \n",
       "2                     NE  2020-05-28T15:36:05.294001Z      2020-05-28   \n",
       "3                     NE  2020-05-28T12:36:04.965983Z      2020-05-28   \n",
       "4                     NE  2020-05-28T09:36:04.743683Z      2020-05-28   \n",
       "\n",
       "   min_temp  max_temp  the_temp  wind_speed  wind_direction  air_pressure  \\\n",
       "0    14.970    21.925    21.810    7.253747       45.331452        1028.0   \n",
       "1    13.895    24.470    24.165    7.170185       41.668908        1028.5   \n",
       "2    13.895    24.470    24.165    7.170185       41.668908        1028.5   \n",
       "3    13.865    23.555    22.340    7.230251       42.670098        1030.0   \n",
       "4    13.930    23.000    22.370    7.199636       43.334991        1030.0   \n",
       "\n",
       "   humidity  visibility  predictability  \n",
       "0        43   15.078815              68  \n",
       "1        42   15.078815              68  \n",
       "2        42   15.078815              68  \n",
       "3        48   15.078815              68  \n",
       "4        47   14.516474              68  "
      ]
     },
     "execution_count": 20,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "url = 'https://www.metaweather.com/api/location/%s/%s/' % (data[0]['woeid'], '2020/05/28')\n",
    "\n",
    "with req.urlopen(url) as session:\n",
    "    response = session.read().decode()\n",
    "\n",
    "df = pd.read_json(response)\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "23.024791666666673"
      ]
     },
     "execution_count": 21,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.the_temp.mean()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## **18.2** *Чтение и запись файлов в формате JSON*\n",
    "\n",
    "**План урока**\n",
    "* Запись данных JSON в файлы\n",
    "* Чтение файлов в формате JSON\n",
    "\n",
    "Файлы в формате JSON  - это текстовые файлы. А значит, их можно открыть с помощью блокнота и посмотреть что в этих файлах записано.\n",
    "\n",
    "Выполним запрос к сервису погоды ещё раз, чтобы работать со свежими данными."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "aNE6t3qH-IXM",
    "outputId": "dc377a3c-15d1-4e9f-9d41-b5b6fa16a42a",
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[{'id': 4723897926680576,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-20T18:28:31.731018Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.674999999999997,\n",
       "  'max_temp': 25.810000000000002,\n",
       "  'the_temp': 24.695,\n",
       "  'wind_speed': 4.646417370025716,\n",
       "  'wind_direction': 40.0,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 72,\n",
       "  'visibility': 14.283459595959595,\n",
       "  'predictability': 77},\n",
       " {'id': 5424697472712704,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-20T15:28:31.713244Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.674999999999997,\n",
       "  'max_temp': 25.810000000000002,\n",
       "  'the_temp': 24.695,\n",
       "  'wind_speed': 4.646417370025716,\n",
       "  'wind_direction': 40.0,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 72,\n",
       "  'visibility': 14.283459595959595,\n",
       "  'predictability': 75},\n",
       " {'id': 5918873591218176,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-20T12:28:31.907804Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.979999999999997,\n",
       "  'max_temp': 28.18,\n",
       "  'the_temp': 27.485,\n",
       "  'wind_speed': 3.7466738551764363,\n",
       "  'wind_direction': 27.740008260428805,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 64,\n",
       "  'visibility': 14.283459595959595,\n",
       "  'predictability': 75},\n",
       " {'id': 5531583773671424,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-20T09:28:32.329702Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.985,\n",
       "  'max_temp': 28.65,\n",
       "  'the_temp': 27.439999999999998,\n",
       "  'wind_speed': 3.5764995885097695,\n",
       "  'wind_direction': 30.29213361107689,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 63,\n",
       "  'visibility': 12.658573928258967,\n",
       "  'predictability': 77},\n",
       " {'id': 6432472222924800,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-20T06:28:31.423102Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.28,\n",
       "  'max_temp': 29.665,\n",
       "  'the_temp': 29.515,\n",
       "  'wind_speed': 3.2173472281582227,\n",
       "  'wind_direction': 34.01101756444167,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 56,\n",
       "  'visibility': 14.147689990455738,\n",
       "  'predictability': 75},\n",
       " {'id': 4745472956694528,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-20T03:28:32.040278Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.18,\n",
       "  'max_temp': 29.71,\n",
       "  'the_temp': 29.485,\n",
       "  'wind_speed': 3.2598907948248894,\n",
       "  'wind_direction': 34.01101756444167,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 57,\n",
       "  'visibility': 14.234681957368965,\n",
       "  'predictability': 75},\n",
       " {'id': 5229048156389376,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'ENE',\n",
       "  'created': '2020-06-20T00:28:31.841135Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.580000000000002,\n",
       "  'max_temp': 26.020000000000003,\n",
       "  'the_temp': 25.155,\n",
       "  'wind_speed': 3.953755292823246,\n",
       "  'wind_direction': 78.00265125555421,\n",
       "  'air_pressure': 1016.5,\n",
       "  'humidity': 54,\n",
       "  'visibility': 15.600145152310507,\n",
       "  'predictability': 73},\n",
       " {'id': 5494374559383552,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-19T21:28:32.222443Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.580000000000002,\n",
       "  'max_temp': 26.020000000000003,\n",
       "  'the_temp': 24.97,\n",
       "  'wind_speed': 3.8717345261565783,\n",
       "  'wind_direction': 56.00563223585546,\n",
       "  'air_pressure': 1015.5,\n",
       "  'humidity': 55,\n",
       "  'visibility': 11.330082319255547,\n",
       "  'predictability': 75},\n",
       " {'id': 5551674422722560,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-19T18:28:35.245563Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.475,\n",
       "  'max_temp': 30.345,\n",
       "  'the_temp': 29.935000000000002,\n",
       "  'wind_speed': 2.8857092152496087,\n",
       "  'wind_direction': 32.36439895770562,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 56,\n",
       "  'visibility': 10.477871729102043,\n",
       "  'predictability': 77},\n",
       " {'id': 6427707896233984,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-19T15:28:36.058110Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.475,\n",
       "  'max_temp': 30.345,\n",
       "  'the_temp': 29.880000000000003,\n",
       "  'wind_speed': 2.8782527819162755,\n",
       "  'wind_direction': 32.36439895770562,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 57,\n",
       "  'visibility': 10.115923009623796,\n",
       "  'predictability': 75},\n",
       " {'id': 4831795625328640,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-19T12:28:35.208524Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.634999999999998,\n",
       "  'max_temp': 29.67,\n",
       "  'the_temp': 29.105,\n",
       "  'wind_speed': 3.145028084196294,\n",
       "  'wind_direction': 19.959271497393267,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 59,\n",
       "  'visibility': 9.221148492802037,\n",
       "  'predictability': 75},\n",
       " {'id': 5688143384674304,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-19T09:28:35.682413Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.130000000000003,\n",
       "  'max_temp': 29.78,\n",
       "  'the_temp': 29.305,\n",
       "  'wind_speed': 2.8299409508629605,\n",
       "  'wind_direction': 12.501292000778834,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 56,\n",
       "  'visibility': 11.417384971764893,\n",
       "  'predictability': 77},\n",
       " {'id': 6181351793360896,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-06-19T06:28:37.132255Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.6,\n",
       "  'max_temp': 29.67,\n",
       "  'the_temp': 29.345,\n",
       "  'wind_speed': 2.6679704451019384,\n",
       "  'wind_direction': 298.00284973908344,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 55,\n",
       "  'visibility': 14.653796826533046,\n",
       "  'predictability': 75},\n",
       " {'id': 5036734217715712,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-06-19T03:28:34.018502Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.485,\n",
       "  'max_temp': 29.655,\n",
       "  'the_temp': 29.215,\n",
       "  'wind_speed': 2.6048113784352713,\n",
       "  'wind_direction': 306.4590037110713,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 56,\n",
       "  'visibility': 15.789663365942893,\n",
       "  'predictability': 75},\n",
       " {'id': 5452899368828928,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'E',\n",
       "  'created': '2020-06-19T00:28:34.725544Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.515,\n",
       "  'max_temp': 25.98,\n",
       "  'the_temp': 25.354999999999997,\n",
       "  'wind_speed': 3.562137010260081,\n",
       "  'wind_direction': 96.81947125530712,\n",
       "  'air_pressure': 1017.0,\n",
       "  'humidity': 54,\n",
       "  'visibility': 15.588028414061878,\n",
       "  'predictability': 73},\n",
       " {'id': 5159899686240256,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'ENE',\n",
       "  'created': '2020-06-18T21:28:35.543932Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.515,\n",
       "  'max_temp': 25.98,\n",
       "  'the_temp': 24.994999999999997,\n",
       "  'wind_speed': 3.5099419769267484,\n",
       "  'wind_direction': 70.49999999999999,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 52,\n",
       "  'visibility': 14.146447248071263,\n",
       "  'predictability': 75},\n",
       " {'id': 4776845209763840,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-18T18:28:38.835979Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.91,\n",
       "  'max_temp': 29.825,\n",
       "  'the_temp': 29.86,\n",
       "  'wind_speed': 2.9970565678066756,\n",
       "  'wind_direction': 36.43633862357382,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 53,\n",
       "  'visibility': 14.329441064185158,\n",
       "  'predictability': 77},\n",
       " {'id': 6497435415216128,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-18T15:28:39.252832Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.91,\n",
       "  'max_temp': 29.825,\n",
       "  'the_temp': 29.854999999999997,\n",
       "  'wind_speed': 2.937405101140009,\n",
       "  'wind_direction': 36.43633862357382,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 54,\n",
       "  'visibility': 15.539250775471247,\n",
       "  'predictability': 75},\n",
       " {'id': 6665698141011968,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-18T12:28:38.246837Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 19.02,\n",
       "  'max_temp': 29.515,\n",
       "  'the_temp': 29.490000000000002,\n",
       "  'wind_speed': 3.018183356130862,\n",
       "  'wind_direction': 17.860675418866176,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 54,\n",
       "  'visibility': 15.007046349319971,\n",
       "  'predictability': 77},\n",
       " {'id': 4758670049017856,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-06-18T09:28:37.143506Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.325,\n",
       "  'max_temp': 29.08,\n",
       "  'the_temp': 29.810000000000002,\n",
       "  'wind_speed': 3.415291256130862,\n",
       "  'wind_direction': 7.7130321813074225,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 54,\n",
       "  'visibility': 14.166952497415096,\n",
       "  'predictability': 75},\n",
       " {'id': 5330697818472448,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-06-18T06:28:41.015246Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.805,\n",
       "  'max_temp': 28.744999999999997,\n",
       "  'the_temp': 29.46,\n",
       "  'wind_speed': 3.716034976094276,\n",
       "  'wind_direction': 356.89960368263144,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 55,\n",
       "  'visibility': 14.301790046130597,\n",
       "  'predictability': 75},\n",
       " {'id': 5603056475439104,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-06-18T03:28:38.057461Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.985,\n",
       "  'max_temp': 28.515,\n",
       "  'the_temp': 29.310000000000002,\n",
       "  'wind_speed': 3.7203323427609427,\n",
       "  'wind_direction': 350.3671858921635,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 57,\n",
       "  'visibility': 14.869723315835522,\n",
       "  'predictability': 75},\n",
       " {'id': 4948419623780352,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'ENE',\n",
       "  'created': '2020-06-18T00:28:36.912938Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.490000000000002,\n",
       "  'max_temp': 24.97,\n",
       "  'the_temp': 25.47,\n",
       "  'wind_speed': 4.253468741806517,\n",
       "  'wind_direction': 72.03408720724613,\n",
       "  'air_pressure': 1017.0,\n",
       "  'humidity': 55,\n",
       "  'visibility': 15.391985802910998,\n",
       "  'predictability': 73},\n",
       " {'id': 6259124322959360,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-17T21:28:36.912915Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.490000000000002,\n",
       "  'max_temp': 24.97,\n",
       "  'the_temp': 25.075,\n",
       "  'wind_speed': 4.298207341806517,\n",
       "  'wind_direction': 19.24926037309231,\n",
       "  'air_pressure': 1015.5,\n",
       "  'humidity': 53,\n",
       "  'visibility': 13.187050127256821,\n",
       "  'predictability': 75},\n",
       " {'id': 5155953450156032,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-17T18:28:41.254676Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.665,\n",
       "  'max_temp': 24.2,\n",
       "  'the_temp': 25.990000000000002,\n",
       "  'wind_speed': 4.4654278407592995,\n",
       "  'wind_direction': 20.9051005219477,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 64,\n",
       "  'visibility': 13.827373140857393,\n",
       "  'predictability': 77},\n",
       " {'id': 6716056364122112,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-17T15:28:40.936173Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.665,\n",
       "  'max_temp': 24.2,\n",
       "  'the_temp': 25.759999999999998,\n",
       "  'wind_speed': 4.457971407425966,\n",
       "  'wind_direction': 41.0,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 66,\n",
       "  'visibility': 14.77651763699992,\n",
       "  'predictability': 75},\n",
       " {'id': 6563580998582272,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-17T12:28:41.747236Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.92,\n",
       "  'max_temp': 24.735,\n",
       "  'the_temp': 25.42,\n",
       "  'wind_speed': 4.460042644733424,\n",
       "  'wind_direction': 19.458050519610584,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 67,\n",
       "  'visibility': 14.223186590312574,\n",
       "  'predictability': 77},\n",
       " {'id': 5090661290213376,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-17T09:28:41.650873Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.885,\n",
       "  'max_temp': 25.005,\n",
       "  'the_temp': 25.515,\n",
       "  'wind_speed': 4.302853178066757,\n",
       "  'wind_direction': 12.137424219666494,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 65,\n",
       "  'visibility': 12.91178268909568,\n",
       "  'predictability': 77},\n",
       " {'id': 6297552267771904,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-17T06:28:41.511359Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.72,\n",
       "  'max_temp': 25.095,\n",
       "  'the_temp': 24.740000000000002,\n",
       "  'wind_speed': 4.159937908719743,\n",
       "  'wind_direction': 15.25851916022202,\n",
       "  'air_pressure': 1014.5,\n",
       "  'humidity': 66,\n",
       "  'visibility': 13.386820965561123,\n",
       "  'predictability': 77},\n",
       " {'id': 6734558210818048,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-17T03:28:40.830693Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.785,\n",
       "  'max_temp': 25.64,\n",
       "  'the_temp': 24.37,\n",
       "  'wind_speed': 4.150553408719744,\n",
       "  'wind_direction': 16.839778718174696,\n",
       "  'air_pressure': 1014.5,\n",
       "  'humidity': 68,\n",
       "  'visibility': 13.449890141573212,\n",
       "  'predictability': 75},\n",
       " {'id': 6184769849131008,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'ENE',\n",
       "  'created': '2020-06-17T00:28:41.240141Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 15.27,\n",
       "  'max_temp': 23.72,\n",
       "  'the_temp': 24.32,\n",
       "  'wind_speed': 4.071432395257032,\n",
       "  'wind_direction': 74.29887418723969,\n",
       "  'air_pressure': 1018.0,\n",
       "  'humidity': 53,\n",
       "  'visibility': 15.376140837508947,\n",
       "  'predictability': 71},\n",
       " {'id': 4621231095545856,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-16T21:28:41.125459Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 15.27,\n",
       "  'max_temp': 23.72,\n",
       "  'the_temp': 24.155,\n",
       "  'wind_speed': 4.145996728590365,\n",
       "  'wind_direction': 18.013792429444138,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 53,\n",
       "  'visibility': 12.920792571383123,\n",
       "  'predictability': 73},\n",
       " {'id': 4906616975523840,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-06-16T18:28:45.216813Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.580000000000002,\n",
       "  'max_temp': 27.805,\n",
       "  'the_temp': 28.455,\n",
       "  'wind_speed': 2.901996462292214,\n",
       "  'wind_direction': 334.26324842843997,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 58,\n",
       "  'visibility': 12.488628907182058,\n",
       "  'predictability': 75},\n",
       " {'id': 6334230281846784,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-06-16T15:28:43.781818Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.580000000000002,\n",
       "  'max_temp': 27.805,\n",
       "  'the_temp': 28.23,\n",
       "  'wind_speed': 2.8870835956255463,\n",
       "  'wind_direction': 348.0,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 62,\n",
       "  'visibility': 13.164059393144038,\n",
       "  'predictability': 75},\n",
       " {'id': 5469815936385024,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-16T12:28:44.709223Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.09,\n",
       "  'max_temp': 27.185000000000002,\n",
       "  'the_temp': 27.505,\n",
       "  'wind_speed': 3.48152870286593,\n",
       "  'wind_direction': 14.692746261527704,\n",
       "  'air_pressure': 1013.0,\n",
       "  'humidity': 62,\n",
       "  'visibility': 14.049824027678358,\n",
       "  'predictability': 77},\n",
       " {'id': 6602521218908160,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-16T09:28:44.255030Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.04,\n",
       "  'max_temp': 27.6,\n",
       "  'the_temp': 27.655,\n",
       "  'wind_speed': 3.6062673028659304,\n",
       "  'wind_direction': 47.75408148522005,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 60,\n",
       "  'visibility': 13.103475701900898,\n",
       "  'predictability': 75},\n",
       " {'id': 4593416820228096,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'WSW',\n",
       "  'created': '2020-06-16T06:28:45.062657Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.744999999999997,\n",
       "  'max_temp': 28.73,\n",
       "  'the_temp': 28.845,\n",
       "  'wind_speed': 3.146866930992338,\n",
       "  'wind_direction': 258.6237156166499,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 57,\n",
       "  'visibility': 13.865587469179989,\n",
       "  'predictability': 75},\n",
       " {'id': 5450024727085056,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'ESE',\n",
       "  'created': '2020-06-16T03:28:44.774659Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.259999999999998,\n",
       "  'max_temp': 28.240000000000002,\n",
       "  'the_temp': 28.67,\n",
       "  'wind_speed': 3.0230923643256715,\n",
       "  'wind_direction': 119.56994692688681,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 59,\n",
       "  'visibility': 15.4618900620377,\n",
       "  'predictability': 75},\n",
       " {'id': 5928352315604992,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'E',\n",
       "  'created': '2020-06-16T00:28:43.980355Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.975,\n",
       "  'max_temp': 25.46,\n",
       "  'the_temp': 25.35,\n",
       "  'wind_speed': 3.7422256009252632,\n",
       "  'wind_direction': 80.81824283999607,\n",
       "  'air_pressure': 1017.5,\n",
       "  'humidity': 53,\n",
       "  'visibility': 15.446977153424003,\n",
       "  'predictability': 71},\n",
       " {'id': 4971991276716032,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-15T21:28:44.375721Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.975,\n",
       "  'max_temp': 25.46,\n",
       "  'the_temp': 22.51,\n",
       "  'wind_speed': 4.304734351387895,\n",
       "  'wind_direction': 55.99999999999999,\n",
       "  'air_pressure': 1017.0,\n",
       "  'humidity': 53,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 5161260654002176,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-15T18:28:46.656423Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.825000000000003,\n",
       "  'max_temp': 26.79,\n",
       "  'the_temp': 26.13,\n",
       "  'wind_speed': 4.405361290066015,\n",
       "  'wind_direction': 20.999999999999996,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 65,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 4521586780536832,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-15T15:28:49.043875Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.825000000000003,\n",
       "  'max_temp': 26.79,\n",
       "  'the_temp': 26.13,\n",
       "  'wind_speed': 4.405361290066015,\n",
       "  'wind_direction': 20.999999999999996,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 65,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 6514217798598656,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-15T12:28:47.739349Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.73,\n",
       "  'max_temp': 26.63,\n",
       "  'the_temp': 25.81,\n",
       "  'wind_speed': 4.414681857949574,\n",
       "  'wind_direction': 18.999999999999996,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 63,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 6131690831347712,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-15T09:28:47.799683Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.08,\n",
       "  'max_temp': 26.939999999999998,\n",
       "  'the_temp': 25.81,\n",
       "  'wind_speed': 3.9996818579495743,\n",
       "  'wind_direction': 37.0,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 64,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 6365394564546560,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'ESE',\n",
       "  'created': '2020-06-15T06:28:48.113908Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 19.08,\n",
       "  'max_temp': 28.08,\n",
       "  'the_temp': 27.99,\n",
       "  'wind_speed': 3.9872544341048277,\n",
       "  'wind_direction': 102.5,\n",
       "  'air_pressure': 1013.0,\n",
       "  'humidity': 60,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 4846567896907776,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'E',\n",
       "  'created': '2020-06-15T03:28:46.610867Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.72,\n",
       "  'max_temp': 27.985,\n",
       "  'the_temp': 27.99,\n",
       "  'wind_speed': 3.8672544341048276,\n",
       "  'wind_direction': 87.5,\n",
       "  'air_pressure': 1013.0,\n",
       "  'humidity': 60,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 5969566821777408,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-15T00:28:47.595493Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.255000000000003,\n",
       "  'max_temp': 24.25,\n",
       "  'the_temp': 20.01,\n",
       "  'wind_speed': 4.367458243855881,\n",
       "  'wind_direction': 40.50000000000001,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 55,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 4516435772571648,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-14T21:28:46.553161Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.255000000000003,\n",
       "  'max_temp': 24.25,\n",
       "  'the_temp': 20.01,\n",
       "  'wind_speed': 4.367458243855881,\n",
       "  'wind_direction': 40.50000000000001,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 55,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 5972475923922944,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'E',\n",
       "  'created': '2020-06-14T18:28:50.141717Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 20.055,\n",
       "  'max_temp': 28.91,\n",
       "  'the_temp': 29.02,\n",
       "  'wind_speed': 2.681800485166627,\n",
       "  'wind_direction': 81.5,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 56,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 5090135358046208,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'E',\n",
       "  'created': '2020-06-14T15:28:49.654893Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 20.055,\n",
       "  'max_temp': 28.91,\n",
       "  'the_temp': 29.02,\n",
       "  'wind_speed': 2.681800485166627,\n",
       "  'wind_direction': 81.5,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 56,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 6036716756402176,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-06-14T12:28:49.943761Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 19.165,\n",
       "  'max_temp': 29.285,\n",
       "  'the_temp': 29.77,\n",
       "  'wind_speed': 3.104332895888014,\n",
       "  'wind_direction': 358.5,\n",
       "  'air_pressure': 1013.0,\n",
       "  'humidity': 56,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 5020204834750464,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-06-14T09:28:50.244540Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.52,\n",
       "  'max_temp': 29.314999999999998,\n",
       "  'the_temp': 29.77,\n",
       "  'wind_speed': 4.264332895888014,\n",
       "  'wind_direction': 1.499999999999994,\n",
       "  'air_pressure': 1013.0,\n",
       "  'humidity': 53,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 5394125559955456,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-06-14T06:28:49.239023Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.655,\n",
       "  'max_temp': 29.605,\n",
       "  'the_temp': 30.35,\n",
       "  'wind_speed': 4.040639266682574,\n",
       "  'wind_direction': 335.5,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 51,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 4612416413368320,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-06-14T03:28:49.328462Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.4,\n",
       "  'max_temp': 29.635,\n",
       "  'the_temp': 30.35,\n",
       "  'wind_speed': 4.560639266682574,\n",
       "  'wind_direction': 330.5,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 52,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 6523118849884160,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-14T00:28:49.642332Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.439999999999998,\n",
       "  'max_temp': 25.765,\n",
       "  'the_temp': 21.15,\n",
       "  'wind_speed': 5.610756581563668,\n",
       "  'wind_direction': 41.49999999999999,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 56,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 6423174356926464,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-13T21:28:49.911562Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.439999999999998,\n",
       "  'max_temp': 25.765,\n",
       "  'the_temp': 21.15,\n",
       "  'wind_speed': 5.610756581563668,\n",
       "  'wind_direction': 41.49999999999999,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 56,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 6683195837775872,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'S',\n",
       "  'created': '2020-06-13T18:28:52.969206Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 20.39,\n",
       "  'max_temp': 30.485,\n",
       "  'the_temp': 28.89,\n",
       "  'wind_speed': 3.127974031655134,\n",
       "  'wind_direction': 184.0,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 53,\n",
       "  'visibility': 9.939453591028395,\n",
       "  'predictability': 77},\n",
       " {'id': 5848773618040832,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'S',\n",
       "  'created': '2020-06-13T15:28:52.123527Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 20.39,\n",
       "  'max_temp': 30.485,\n",
       "  'the_temp': 28.89,\n",
       "  'wind_speed': 3.127974031655134,\n",
       "  'wind_direction': 184.0,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 53,\n",
       "  'visibility': 9.939453591028395,\n",
       "  'predictability': 77},\n",
       " {'id': 4624573922279424,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'E',\n",
       "  'created': '2020-06-13T12:28:53.538462Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 19.72,\n",
       "  'max_temp': 28.53,\n",
       "  'the_temp': 25.41,\n",
       "  'wind_speed': 3.8829400302234944,\n",
       "  'wind_direction': 84.0,\n",
       "  'air_pressure': 1017.0,\n",
       "  'humidity': 57,\n",
       "  'visibility': 9.939453591028395,\n",
       "  'predictability': 71},\n",
       " {'id': 6263144143912960,\n",
       "  'weather_state_name': 'Light Cloud',\n",
       "  'weather_state_abbr': 'lc',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-06-13T09:28:53.723367Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 19.205,\n",
       "  'max_temp': 27.674999999999997,\n",
       "  'the_temp': 25.41,\n",
       "  'wind_speed': 4.017940030223495,\n",
       "  'wind_direction': 299.0,\n",
       "  'air_pressure': 1017.0,\n",
       "  'humidity': 61,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 70},\n",
       " {'id': 5191798576119808,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'SW',\n",
       "  'created': '2020-06-13T06:28:52.730722Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 20.215,\n",
       "  'max_temp': 29.63,\n",
       "  'the_temp': 28.6,\n",
       "  'wind_speed': 3.8439560963970414,\n",
       "  'wind_direction': 215.0,\n",
       "  'air_pressure': 1019.0,\n",
       "  'humidity': 60,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 6474605315227648,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'SW',\n",
       "  'created': '2020-06-13T03:28:53.449238Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 21.11,\n",
       "  'max_temp': 29.77,\n",
       "  'the_temp': 28.6,\n",
       "  'wind_speed': 2.4979121927940824,\n",
       "  'wind_direction': 217.0,\n",
       "  'air_pressure': 1019.0,\n",
       "  'humidity': 48,\n",
       "  'visibility': None,\n",
       "  'predictability': 77},\n",
       " {'id': 6203633949474816,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'ENE',\n",
       "  'created': '2020-06-13T00:28:53.575425Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.51,\n",
       "  'max_temp': 23.94,\n",
       "  'the_temp': 22.81,\n",
       "  'wind_speed': 2.491698480871709,\n",
       "  'wind_direction': 59.99999999999999,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 56,\n",
       "  'visibility': None,\n",
       "  'predictability': 71},\n",
       " {'id': 5844236068978688,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'ENE',\n",
       "  'created': '2020-06-12T21:28:53.464421Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.51,\n",
       "  'max_temp': 23.94,\n",
       "  'the_temp': 22.81,\n",
       "  'wind_speed': 2.491698480871709,\n",
       "  'wind_direction': 59.99999999999999,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 56,\n",
       "  'visibility': None,\n",
       "  'predictability': 71},\n",
       " {'id': 4541776079618048,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-06-12T18:28:56.051306Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 22.64,\n",
       "  'max_temp': 31.61,\n",
       "  'the_temp': 29.95,\n",
       "  'wind_speed': 1.1557504175614413,\n",
       "  'wind_direction': 347.99999999999994,\n",
       "  'air_pressure': 1017.0,\n",
       "  'humidity': 33,\n",
       "  'visibility': None,\n",
       "  'predictability': 71},\n",
       " {'id': 6351655031275520,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-06-12T15:28:56.323706Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 22.64,\n",
       "  'max_temp': 31.61,\n",
       "  'the_temp': 29.95,\n",
       "  'wind_speed': 1.1557504175614413,\n",
       "  'wind_direction': 347.99999999999994,\n",
       "  'air_pressure': 1017.0,\n",
       "  'humidity': 33,\n",
       "  'visibility': None,\n",
       "  'predictability': 71},\n",
       " {'id': 5208857850675200,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-06-12T12:28:55.936931Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 20.93,\n",
       "  'max_temp': 28.99,\n",
       "  'the_temp': 28.99,\n",
       "  'wind_speed': 1.5347868448262147,\n",
       "  'wind_direction': 359.0,\n",
       "  'air_pressure': 1015.0,\n",
       "  'humidity': 46,\n",
       "  'visibility': None,\n",
       "  'predictability': 77},\n",
       " {'id': 5795333655232512,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-06-12T09:28:57.024153Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 20.93,\n",
       "  'max_temp': 28.99,\n",
       "  'the_temp': 28.99,\n",
       "  'wind_speed': 1.5347868448262147,\n",
       "  'wind_direction': 359.0,\n",
       "  'air_pressure': 1015.0,\n",
       "  'humidity': 46,\n",
       "  'visibility': None,\n",
       "  'predictability': 77},\n",
       " {'id': 5677328589914112,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-12T06:28:55.914633Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 22.33,\n",
       "  'max_temp': 31.57,\n",
       "  'the_temp': 30.13,\n",
       "  'wind_speed': 1.8206175932553885,\n",
       "  'wind_direction': 13.0,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 38,\n",
       "  'visibility': None,\n",
       "  'predictability': 77},\n",
       " {'id': 5178619301199872,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-12T03:28:56.312811Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 22.33,\n",
       "  'max_temp': 31.57,\n",
       "  'the_temp': 30.13,\n",
       "  'wind_speed': 1.8206175932553885,\n",
       "  'wind_direction': 13.0,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 38,\n",
       "  'visibility': None,\n",
       "  'predictability': 77},\n",
       " {'id': 6264973464436736,\n",
       "  'weather_state_name': 'Clear',\n",
       "  'weather_state_abbr': 'c',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-12T00:28:55.218831Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 20.9,\n",
       "  'max_temp': 28.41,\n",
       "  'the_temp': 27.14,\n",
       "  'wind_speed': 2.1499443251411754,\n",
       "  'wind_direction': 37.0,\n",
       "  'air_pressure': 1011.0,\n",
       "  'humidity': 38,\n",
       "  'visibility': None,\n",
       "  'predictability': 68},\n",
       " {'id': 5432302651834368,\n",
       "  'weather_state_name': 'Clear',\n",
       "  'weather_state_abbr': 'c',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-11T21:28:56.047726Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 20.9,\n",
       "  'max_temp': 28.41,\n",
       "  'the_temp': 27.14,\n",
       "  'wind_speed': 2.1499443251411754,\n",
       "  'wind_direction': 37.0,\n",
       "  'air_pressure': 1011.0,\n",
       "  'humidity': 38,\n",
       "  'visibility': None,\n",
       "  'predictability': 68}]"
      ]
     },
     "execution_count": 22,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "url = 'https://www.metaweather.com/api/location/2122265/2020/06/20/'\n",
    "\n",
    "with req.urlopen(url) as session:\n",
    "    response = session.read().decode()\n",
    "    s = json.loads(response) # сохраняем ответ сервера в переменную s\n",
    "s"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Чтобы записать данные в файл, создадим объект файла при помощи функции `open` из стандартной библиотеки python.\\\n",
    "Чтобы записать в файл, нам понадобится функция `dump` из библиотеки `json`.\\\n",
    "Эта функция принимает два параметра:\n",
    "1. Строка в формате JSON\n",
    "2. Объект файла, в который нужно записать строку\n",
    "3. Также можно добавить необязательный параметр `indent`.\\\n",
    "Этот параметр нужен для того, чтобы при сохранении файл был красиво отформатирован.\\\n",
    "Благодаря этому, такой файл будет легче читаться глазами.\\\n",
    "\n",
    "После записи в файл, нужно закрыть объект файла. Чтобы разрешить другим процессам работать с файлом.\\\n",
    "Для этого у объекта файла нужно вызвать метод `close`. Как в случае работы с веб-сервисом."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "UxSxZ_cd-IXU"
   },
   "outputs": [],
   "source": [
    "file = open('out/file.json', 'w') # открываем файл на чтение\n",
    "json.dump(s, file, indent=4) # добавим отступ в 4 пробела\n",
    "file.close()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Откроем файл и убедимся что он он записан верно. И данные в нём красиво отформатированы, т.к. мы указали параметр `indent`.\n",
    "\n",
    "Теперь проделаем тоже самое, но будем открывать файл при промощи **менеджера контекста**."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "cMXhvXhc-IXd"
   },
   "outputs": [],
   "source": [
    "with open('out/file.json', 'w') as file:\n",
    "    json.dump(s, file, indent=4)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "h34pwkM2-IXm"
   },
   "source": [
    "### Чтение файла JSON\n",
    "\n",
    "Теперь прочитаем файл. Для этого откроем сохранённый файл при помощи **менеджера контекста**, добавив режим работы с файлом **r** (т.е. read - на чтение)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "collapsed": true,
    "id": "i5MiKUJJ-IXo",
    "jupyter": {
     "outputs_hidden": true
    },
    "outputId": "ca79a992-2367-4956-d95c-c20b7d0464a3",
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[{'id': 4723897926680576,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-20T18:28:31.731018Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.674999999999997,\n",
       "  'max_temp': 25.810000000000002,\n",
       "  'the_temp': 24.695,\n",
       "  'wind_speed': 4.646417370025716,\n",
       "  'wind_direction': 40.0,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 72,\n",
       "  'visibility': 14.283459595959595,\n",
       "  'predictability': 77},\n",
       " {'id': 5424697472712704,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-20T15:28:31.713244Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.674999999999997,\n",
       "  'max_temp': 25.810000000000002,\n",
       "  'the_temp': 24.695,\n",
       "  'wind_speed': 4.646417370025716,\n",
       "  'wind_direction': 40.0,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 72,\n",
       "  'visibility': 14.283459595959595,\n",
       "  'predictability': 75},\n",
       " {'id': 5918873591218176,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-20T12:28:31.907804Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.979999999999997,\n",
       "  'max_temp': 28.18,\n",
       "  'the_temp': 27.485,\n",
       "  'wind_speed': 3.7466738551764363,\n",
       "  'wind_direction': 27.740008260428805,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 64,\n",
       "  'visibility': 14.283459595959595,\n",
       "  'predictability': 75},\n",
       " {'id': 5531583773671424,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-20T09:28:32.329702Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.985,\n",
       "  'max_temp': 28.65,\n",
       "  'the_temp': 27.439999999999998,\n",
       "  'wind_speed': 3.5764995885097695,\n",
       "  'wind_direction': 30.29213361107689,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 63,\n",
       "  'visibility': 12.658573928258967,\n",
       "  'predictability': 77},\n",
       " {'id': 6432472222924800,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-20T06:28:31.423102Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.28,\n",
       "  'max_temp': 29.665,\n",
       "  'the_temp': 29.515,\n",
       "  'wind_speed': 3.2173472281582227,\n",
       "  'wind_direction': 34.01101756444167,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 56,\n",
       "  'visibility': 14.147689990455738,\n",
       "  'predictability': 75},\n",
       " {'id': 4745472956694528,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-20T03:28:32.040278Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.18,\n",
       "  'max_temp': 29.71,\n",
       "  'the_temp': 29.485,\n",
       "  'wind_speed': 3.2598907948248894,\n",
       "  'wind_direction': 34.01101756444167,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 57,\n",
       "  'visibility': 14.234681957368965,\n",
       "  'predictability': 75},\n",
       " {'id': 5229048156389376,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'ENE',\n",
       "  'created': '2020-06-20T00:28:31.841135Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.580000000000002,\n",
       "  'max_temp': 26.020000000000003,\n",
       "  'the_temp': 25.155,\n",
       "  'wind_speed': 3.953755292823246,\n",
       "  'wind_direction': 78.00265125555421,\n",
       "  'air_pressure': 1016.5,\n",
       "  'humidity': 54,\n",
       "  'visibility': 15.600145152310507,\n",
       "  'predictability': 73},\n",
       " {'id': 5494374559383552,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-19T21:28:32.222443Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.580000000000002,\n",
       "  'max_temp': 26.020000000000003,\n",
       "  'the_temp': 24.97,\n",
       "  'wind_speed': 3.8717345261565783,\n",
       "  'wind_direction': 56.00563223585546,\n",
       "  'air_pressure': 1015.5,\n",
       "  'humidity': 55,\n",
       "  'visibility': 11.330082319255547,\n",
       "  'predictability': 75},\n",
       " {'id': 5551674422722560,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-19T18:28:35.245563Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.475,\n",
       "  'max_temp': 30.345,\n",
       "  'the_temp': 29.935000000000002,\n",
       "  'wind_speed': 2.8857092152496087,\n",
       "  'wind_direction': 32.36439895770562,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 56,\n",
       "  'visibility': 10.477871729102043,\n",
       "  'predictability': 77},\n",
       " {'id': 6427707896233984,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-19T15:28:36.058110Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.475,\n",
       "  'max_temp': 30.345,\n",
       "  'the_temp': 29.880000000000003,\n",
       "  'wind_speed': 2.8782527819162755,\n",
       "  'wind_direction': 32.36439895770562,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 57,\n",
       "  'visibility': 10.115923009623796,\n",
       "  'predictability': 75},\n",
       " {'id': 4831795625328640,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-19T12:28:35.208524Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.634999999999998,\n",
       "  'max_temp': 29.67,\n",
       "  'the_temp': 29.105,\n",
       "  'wind_speed': 3.145028084196294,\n",
       "  'wind_direction': 19.959271497393267,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 59,\n",
       "  'visibility': 9.221148492802037,\n",
       "  'predictability': 75},\n",
       " {'id': 5688143384674304,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-19T09:28:35.682413Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.130000000000003,\n",
       "  'max_temp': 29.78,\n",
       "  'the_temp': 29.305,\n",
       "  'wind_speed': 2.8299409508629605,\n",
       "  'wind_direction': 12.501292000778834,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 56,\n",
       "  'visibility': 11.417384971764893,\n",
       "  'predictability': 77},\n",
       " {'id': 6181351793360896,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-06-19T06:28:37.132255Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.6,\n",
       "  'max_temp': 29.67,\n",
       "  'the_temp': 29.345,\n",
       "  'wind_speed': 2.6679704451019384,\n",
       "  'wind_direction': 298.00284973908344,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 55,\n",
       "  'visibility': 14.653796826533046,\n",
       "  'predictability': 75},\n",
       " {'id': 5036734217715712,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-06-19T03:28:34.018502Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.485,\n",
       "  'max_temp': 29.655,\n",
       "  'the_temp': 29.215,\n",
       "  'wind_speed': 2.6048113784352713,\n",
       "  'wind_direction': 306.4590037110713,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 56,\n",
       "  'visibility': 15.789663365942893,\n",
       "  'predictability': 75},\n",
       " {'id': 5452899368828928,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'E',\n",
       "  'created': '2020-06-19T00:28:34.725544Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.515,\n",
       "  'max_temp': 25.98,\n",
       "  'the_temp': 25.354999999999997,\n",
       "  'wind_speed': 3.562137010260081,\n",
       "  'wind_direction': 96.81947125530712,\n",
       "  'air_pressure': 1017.0,\n",
       "  'humidity': 54,\n",
       "  'visibility': 15.588028414061878,\n",
       "  'predictability': 73},\n",
       " {'id': 5159899686240256,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'ENE',\n",
       "  'created': '2020-06-18T21:28:35.543932Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.515,\n",
       "  'max_temp': 25.98,\n",
       "  'the_temp': 24.994999999999997,\n",
       "  'wind_speed': 3.5099419769267484,\n",
       "  'wind_direction': 70.49999999999999,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 52,\n",
       "  'visibility': 14.146447248071263,\n",
       "  'predictability': 75},\n",
       " {'id': 4776845209763840,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-18T18:28:38.835979Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.91,\n",
       "  'max_temp': 29.825,\n",
       "  'the_temp': 29.86,\n",
       "  'wind_speed': 2.9970565678066756,\n",
       "  'wind_direction': 36.43633862357382,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 53,\n",
       "  'visibility': 14.329441064185158,\n",
       "  'predictability': 77},\n",
       " {'id': 6497435415216128,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-18T15:28:39.252832Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.91,\n",
       "  'max_temp': 29.825,\n",
       "  'the_temp': 29.854999999999997,\n",
       "  'wind_speed': 2.937405101140009,\n",
       "  'wind_direction': 36.43633862357382,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 54,\n",
       "  'visibility': 15.539250775471247,\n",
       "  'predictability': 75},\n",
       " {'id': 6665698141011968,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-18T12:28:38.246837Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 19.02,\n",
       "  'max_temp': 29.515,\n",
       "  'the_temp': 29.490000000000002,\n",
       "  'wind_speed': 3.018183356130862,\n",
       "  'wind_direction': 17.860675418866176,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 54,\n",
       "  'visibility': 15.007046349319971,\n",
       "  'predictability': 77},\n",
       " {'id': 4758670049017856,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-06-18T09:28:37.143506Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.325,\n",
       "  'max_temp': 29.08,\n",
       "  'the_temp': 29.810000000000002,\n",
       "  'wind_speed': 3.415291256130862,\n",
       "  'wind_direction': 7.7130321813074225,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 54,\n",
       "  'visibility': 14.166952497415096,\n",
       "  'predictability': 75},\n",
       " {'id': 5330697818472448,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-06-18T06:28:41.015246Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.805,\n",
       "  'max_temp': 28.744999999999997,\n",
       "  'the_temp': 29.46,\n",
       "  'wind_speed': 3.716034976094276,\n",
       "  'wind_direction': 356.89960368263144,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 55,\n",
       "  'visibility': 14.301790046130597,\n",
       "  'predictability': 75},\n",
       " {'id': 5603056475439104,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-06-18T03:28:38.057461Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.985,\n",
       "  'max_temp': 28.515,\n",
       "  'the_temp': 29.310000000000002,\n",
       "  'wind_speed': 3.7203323427609427,\n",
       "  'wind_direction': 350.3671858921635,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 57,\n",
       "  'visibility': 14.869723315835522,\n",
       "  'predictability': 75},\n",
       " {'id': 4948419623780352,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'ENE',\n",
       "  'created': '2020-06-18T00:28:36.912938Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.490000000000002,\n",
       "  'max_temp': 24.97,\n",
       "  'the_temp': 25.47,\n",
       "  'wind_speed': 4.253468741806517,\n",
       "  'wind_direction': 72.03408720724613,\n",
       "  'air_pressure': 1017.0,\n",
       "  'humidity': 55,\n",
       "  'visibility': 15.391985802910998,\n",
       "  'predictability': 73},\n",
       " {'id': 6259124322959360,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-17T21:28:36.912915Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.490000000000002,\n",
       "  'max_temp': 24.97,\n",
       "  'the_temp': 25.075,\n",
       "  'wind_speed': 4.298207341806517,\n",
       "  'wind_direction': 19.24926037309231,\n",
       "  'air_pressure': 1015.5,\n",
       "  'humidity': 53,\n",
       "  'visibility': 13.187050127256821,\n",
       "  'predictability': 75},\n",
       " {'id': 5155953450156032,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-17T18:28:41.254676Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.665,\n",
       "  'max_temp': 24.2,\n",
       "  'the_temp': 25.990000000000002,\n",
       "  'wind_speed': 4.4654278407592995,\n",
       "  'wind_direction': 20.9051005219477,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 64,\n",
       "  'visibility': 13.827373140857393,\n",
       "  'predictability': 77},\n",
       " {'id': 6716056364122112,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-17T15:28:40.936173Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.665,\n",
       "  'max_temp': 24.2,\n",
       "  'the_temp': 25.759999999999998,\n",
       "  'wind_speed': 4.457971407425966,\n",
       "  'wind_direction': 41.0,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 66,\n",
       "  'visibility': 14.77651763699992,\n",
       "  'predictability': 75},\n",
       " {'id': 6563580998582272,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-17T12:28:41.747236Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.92,\n",
       "  'max_temp': 24.735,\n",
       "  'the_temp': 25.42,\n",
       "  'wind_speed': 4.460042644733424,\n",
       "  'wind_direction': 19.458050519610584,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 67,\n",
       "  'visibility': 14.223186590312574,\n",
       "  'predictability': 77},\n",
       " {'id': 5090661290213376,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-17T09:28:41.650873Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.885,\n",
       "  'max_temp': 25.005,\n",
       "  'the_temp': 25.515,\n",
       "  'wind_speed': 4.302853178066757,\n",
       "  'wind_direction': 12.137424219666494,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 65,\n",
       "  'visibility': 12.91178268909568,\n",
       "  'predictability': 77},\n",
       " {'id': 6297552267771904,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-17T06:28:41.511359Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.72,\n",
       "  'max_temp': 25.095,\n",
       "  'the_temp': 24.740000000000002,\n",
       "  'wind_speed': 4.159937908719743,\n",
       "  'wind_direction': 15.25851916022202,\n",
       "  'air_pressure': 1014.5,\n",
       "  'humidity': 66,\n",
       "  'visibility': 13.386820965561123,\n",
       "  'predictability': 77},\n",
       " {'id': 6734558210818048,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-17T03:28:40.830693Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.785,\n",
       "  'max_temp': 25.64,\n",
       "  'the_temp': 24.37,\n",
       "  'wind_speed': 4.150553408719744,\n",
       "  'wind_direction': 16.839778718174696,\n",
       "  'air_pressure': 1014.5,\n",
       "  'humidity': 68,\n",
       "  'visibility': 13.449890141573212,\n",
       "  'predictability': 75},\n",
       " {'id': 6184769849131008,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'ENE',\n",
       "  'created': '2020-06-17T00:28:41.240141Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 15.27,\n",
       "  'max_temp': 23.72,\n",
       "  'the_temp': 24.32,\n",
       "  'wind_speed': 4.071432395257032,\n",
       "  'wind_direction': 74.29887418723969,\n",
       "  'air_pressure': 1018.0,\n",
       "  'humidity': 53,\n",
       "  'visibility': 15.376140837508947,\n",
       "  'predictability': 71},\n",
       " {'id': 4621231095545856,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-16T21:28:41.125459Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 15.27,\n",
       "  'max_temp': 23.72,\n",
       "  'the_temp': 24.155,\n",
       "  'wind_speed': 4.145996728590365,\n",
       "  'wind_direction': 18.013792429444138,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 53,\n",
       "  'visibility': 12.920792571383123,\n",
       "  'predictability': 73},\n",
       " {'id': 4906616975523840,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-06-16T18:28:45.216813Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.580000000000002,\n",
       "  'max_temp': 27.805,\n",
       "  'the_temp': 28.455,\n",
       "  'wind_speed': 2.901996462292214,\n",
       "  'wind_direction': 334.26324842843997,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 58,\n",
       "  'visibility': 12.488628907182058,\n",
       "  'predictability': 75},\n",
       " {'id': 6334230281846784,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-06-16T15:28:43.781818Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.580000000000002,\n",
       "  'max_temp': 27.805,\n",
       "  'the_temp': 28.23,\n",
       "  'wind_speed': 2.8870835956255463,\n",
       "  'wind_direction': 348.0,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 62,\n",
       "  'visibility': 13.164059393144038,\n",
       "  'predictability': 75},\n",
       " {'id': 5469815936385024,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-16T12:28:44.709223Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.09,\n",
       "  'max_temp': 27.185000000000002,\n",
       "  'the_temp': 27.505,\n",
       "  'wind_speed': 3.48152870286593,\n",
       "  'wind_direction': 14.692746261527704,\n",
       "  'air_pressure': 1013.0,\n",
       "  'humidity': 62,\n",
       "  'visibility': 14.049824027678358,\n",
       "  'predictability': 77},\n",
       " {'id': 6602521218908160,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-16T09:28:44.255030Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.04,\n",
       "  'max_temp': 27.6,\n",
       "  'the_temp': 27.655,\n",
       "  'wind_speed': 3.6062673028659304,\n",
       "  'wind_direction': 47.75408148522005,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 60,\n",
       "  'visibility': 13.103475701900898,\n",
       "  'predictability': 75},\n",
       " {'id': 4593416820228096,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'WSW',\n",
       "  'created': '2020-06-16T06:28:45.062657Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.744999999999997,\n",
       "  'max_temp': 28.73,\n",
       "  'the_temp': 28.845,\n",
       "  'wind_speed': 3.146866930992338,\n",
       "  'wind_direction': 258.6237156166499,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 57,\n",
       "  'visibility': 13.865587469179989,\n",
       "  'predictability': 75},\n",
       " {'id': 5450024727085056,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'ESE',\n",
       "  'created': '2020-06-16T03:28:44.774659Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.259999999999998,\n",
       "  'max_temp': 28.240000000000002,\n",
       "  'the_temp': 28.67,\n",
       "  'wind_speed': 3.0230923643256715,\n",
       "  'wind_direction': 119.56994692688681,\n",
       "  'air_pressure': 1013.5,\n",
       "  'humidity': 59,\n",
       "  'visibility': 15.4618900620377,\n",
       "  'predictability': 75},\n",
       " {'id': 5928352315604992,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'E',\n",
       "  'created': '2020-06-16T00:28:43.980355Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.975,\n",
       "  'max_temp': 25.46,\n",
       "  'the_temp': 25.35,\n",
       "  'wind_speed': 3.7422256009252632,\n",
       "  'wind_direction': 80.81824283999607,\n",
       "  'air_pressure': 1017.5,\n",
       "  'humidity': 53,\n",
       "  'visibility': 15.446977153424003,\n",
       "  'predictability': 71},\n",
       " {'id': 4971991276716032,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-15T21:28:44.375721Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.975,\n",
       "  'max_temp': 25.46,\n",
       "  'the_temp': 22.51,\n",
       "  'wind_speed': 4.304734351387895,\n",
       "  'wind_direction': 55.99999999999999,\n",
       "  'air_pressure': 1017.0,\n",
       "  'humidity': 53,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 5161260654002176,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-15T18:28:46.656423Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.825000000000003,\n",
       "  'max_temp': 26.79,\n",
       "  'the_temp': 26.13,\n",
       "  'wind_speed': 4.405361290066015,\n",
       "  'wind_direction': 20.999999999999996,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 65,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 4521586780536832,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-15T15:28:49.043875Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.825000000000003,\n",
       "  'max_temp': 26.79,\n",
       "  'the_temp': 26.13,\n",
       "  'wind_speed': 4.405361290066015,\n",
       "  'wind_direction': 20.999999999999996,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 65,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 6514217798598656,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-15T12:28:47.739349Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.73,\n",
       "  'max_temp': 26.63,\n",
       "  'the_temp': 25.81,\n",
       "  'wind_speed': 4.414681857949574,\n",
       "  'wind_direction': 18.999999999999996,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 63,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 6131690831347712,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-15T09:28:47.799683Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.08,\n",
       "  'max_temp': 26.939999999999998,\n",
       "  'the_temp': 25.81,\n",
       "  'wind_speed': 3.9996818579495743,\n",
       "  'wind_direction': 37.0,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 64,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 6365394564546560,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'ESE',\n",
       "  'created': '2020-06-15T06:28:48.113908Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 19.08,\n",
       "  'max_temp': 28.08,\n",
       "  'the_temp': 27.99,\n",
       "  'wind_speed': 3.9872544341048277,\n",
       "  'wind_direction': 102.5,\n",
       "  'air_pressure': 1013.0,\n",
       "  'humidity': 60,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 4846567896907776,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'E',\n",
       "  'created': '2020-06-15T03:28:46.610867Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.72,\n",
       "  'max_temp': 27.985,\n",
       "  'the_temp': 27.99,\n",
       "  'wind_speed': 3.8672544341048276,\n",
       "  'wind_direction': 87.5,\n",
       "  'air_pressure': 1013.0,\n",
       "  'humidity': 60,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 5969566821777408,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-15T00:28:47.595493Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.255000000000003,\n",
       "  'max_temp': 24.25,\n",
       "  'the_temp': 20.01,\n",
       "  'wind_speed': 4.367458243855881,\n",
       "  'wind_direction': 40.50000000000001,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 55,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 4516435772571648,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-14T21:28:46.553161Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.255000000000003,\n",
       "  'max_temp': 24.25,\n",
       "  'the_temp': 20.01,\n",
       "  'wind_speed': 4.367458243855881,\n",
       "  'wind_direction': 40.50000000000001,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 55,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 5972475923922944,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'E',\n",
       "  'created': '2020-06-14T18:28:50.141717Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 20.055,\n",
       "  'max_temp': 28.91,\n",
       "  'the_temp': 29.02,\n",
       "  'wind_speed': 2.681800485166627,\n",
       "  'wind_direction': 81.5,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 56,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 5090135358046208,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'E',\n",
       "  'created': '2020-06-14T15:28:49.654893Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 20.055,\n",
       "  'max_temp': 28.91,\n",
       "  'the_temp': 29.02,\n",
       "  'wind_speed': 2.681800485166627,\n",
       "  'wind_direction': 81.5,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 56,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 6036716756402176,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-06-14T12:28:49.943761Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 19.165,\n",
       "  'max_temp': 29.285,\n",
       "  'the_temp': 29.77,\n",
       "  'wind_speed': 3.104332895888014,\n",
       "  'wind_direction': 358.5,\n",
       "  'air_pressure': 1013.0,\n",
       "  'humidity': 56,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 5020204834750464,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-06-14T09:28:50.244540Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.52,\n",
       "  'max_temp': 29.314999999999998,\n",
       "  'the_temp': 29.77,\n",
       "  'wind_speed': 4.264332895888014,\n",
       "  'wind_direction': 1.499999999999994,\n",
       "  'air_pressure': 1013.0,\n",
       "  'humidity': 53,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 5394125559955456,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-06-14T06:28:49.239023Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.655,\n",
       "  'max_temp': 29.605,\n",
       "  'the_temp': 30.35,\n",
       "  'wind_speed': 4.040639266682574,\n",
       "  'wind_direction': 335.5,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 51,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 4612416413368320,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-06-14T03:28:49.328462Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 18.4,\n",
       "  'max_temp': 29.635,\n",
       "  'the_temp': 30.35,\n",
       "  'wind_speed': 4.560639266682574,\n",
       "  'wind_direction': 330.5,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 52,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 6523118849884160,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-14T00:28:49.642332Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.439999999999998,\n",
       "  'max_temp': 25.765,\n",
       "  'the_temp': 21.15,\n",
       "  'wind_speed': 5.610756581563668,\n",
       "  'wind_direction': 41.49999999999999,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 56,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 6423174356926464,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-13T21:28:49.911562Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 16.439999999999998,\n",
       "  'max_temp': 25.765,\n",
       "  'the_temp': 21.15,\n",
       "  'wind_speed': 5.610756581563668,\n",
       "  'wind_direction': 41.49999999999999,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 56,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 6683195837775872,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'S',\n",
       "  'created': '2020-06-13T18:28:52.969206Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 20.39,\n",
       "  'max_temp': 30.485,\n",
       "  'the_temp': 28.89,\n",
       "  'wind_speed': 3.127974031655134,\n",
       "  'wind_direction': 184.0,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 53,\n",
       "  'visibility': 9.939453591028395,\n",
       "  'predictability': 77},\n",
       " {'id': 5848773618040832,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'S',\n",
       "  'created': '2020-06-13T15:28:52.123527Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 20.39,\n",
       "  'max_temp': 30.485,\n",
       "  'the_temp': 28.89,\n",
       "  'wind_speed': 3.127974031655134,\n",
       "  'wind_direction': 184.0,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 53,\n",
       "  'visibility': 9.939453591028395,\n",
       "  'predictability': 77},\n",
       " {'id': 4624573922279424,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'E',\n",
       "  'created': '2020-06-13T12:28:53.538462Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 19.72,\n",
       "  'max_temp': 28.53,\n",
       "  'the_temp': 25.41,\n",
       "  'wind_speed': 3.8829400302234944,\n",
       "  'wind_direction': 84.0,\n",
       "  'air_pressure': 1017.0,\n",
       "  'humidity': 57,\n",
       "  'visibility': 9.939453591028395,\n",
       "  'predictability': 71},\n",
       " {'id': 6263144143912960,\n",
       "  'weather_state_name': 'Light Cloud',\n",
       "  'weather_state_abbr': 'lc',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-06-13T09:28:53.723367Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 19.205,\n",
       "  'max_temp': 27.674999999999997,\n",
       "  'the_temp': 25.41,\n",
       "  'wind_speed': 4.017940030223495,\n",
       "  'wind_direction': 299.0,\n",
       "  'air_pressure': 1017.0,\n",
       "  'humidity': 61,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 70},\n",
       " {'id': 5191798576119808,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'SW',\n",
       "  'created': '2020-06-13T06:28:52.730722Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 20.215,\n",
       "  'max_temp': 29.63,\n",
       "  'the_temp': 28.6,\n",
       "  'wind_speed': 3.8439560963970414,\n",
       "  'wind_direction': 215.0,\n",
       "  'air_pressure': 1019.0,\n",
       "  'humidity': 60,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 6474605315227648,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'SW',\n",
       "  'created': '2020-06-13T03:28:53.449238Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 21.11,\n",
       "  'max_temp': 29.77,\n",
       "  'the_temp': 28.6,\n",
       "  'wind_speed': 2.4979121927940824,\n",
       "  'wind_direction': 217.0,\n",
       "  'air_pressure': 1019.0,\n",
       "  'humidity': 48,\n",
       "  'visibility': None,\n",
       "  'predictability': 77},\n",
       " {'id': 6203633949474816,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'ENE',\n",
       "  'created': '2020-06-13T00:28:53.575425Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.51,\n",
       "  'max_temp': 23.94,\n",
       "  'the_temp': 22.81,\n",
       "  'wind_speed': 2.491698480871709,\n",
       "  'wind_direction': 59.99999999999999,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 56,\n",
       "  'visibility': None,\n",
       "  'predictability': 71},\n",
       " {'id': 5844236068978688,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'ENE',\n",
       "  'created': '2020-06-12T21:28:53.464421Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 17.51,\n",
       "  'max_temp': 23.94,\n",
       "  'the_temp': 22.81,\n",
       "  'wind_speed': 2.491698480871709,\n",
       "  'wind_direction': 59.99999999999999,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 56,\n",
       "  'visibility': None,\n",
       "  'predictability': 71},\n",
       " {'id': 4541776079618048,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-06-12T18:28:56.051306Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 22.64,\n",
       "  'max_temp': 31.61,\n",
       "  'the_temp': 29.95,\n",
       "  'wind_speed': 1.1557504175614413,\n",
       "  'wind_direction': 347.99999999999994,\n",
       "  'air_pressure': 1017.0,\n",
       "  'humidity': 33,\n",
       "  'visibility': None,\n",
       "  'predictability': 71},\n",
       " {'id': 6351655031275520,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-06-12T15:28:56.323706Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 22.64,\n",
       "  'max_temp': 31.61,\n",
       "  'the_temp': 29.95,\n",
       "  'wind_speed': 1.1557504175614413,\n",
       "  'wind_direction': 347.99999999999994,\n",
       "  'air_pressure': 1017.0,\n",
       "  'humidity': 33,\n",
       "  'visibility': None,\n",
       "  'predictability': 71},\n",
       " {'id': 5208857850675200,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-06-12T12:28:55.936931Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 20.93,\n",
       "  'max_temp': 28.99,\n",
       "  'the_temp': 28.99,\n",
       "  'wind_speed': 1.5347868448262147,\n",
       "  'wind_direction': 359.0,\n",
       "  'air_pressure': 1015.0,\n",
       "  'humidity': 46,\n",
       "  'visibility': None,\n",
       "  'predictability': 77},\n",
       " {'id': 5795333655232512,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-06-12T09:28:57.024153Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 20.93,\n",
       "  'max_temp': 28.99,\n",
       "  'the_temp': 28.99,\n",
       "  'wind_speed': 1.5347868448262147,\n",
       "  'wind_direction': 359.0,\n",
       "  'air_pressure': 1015.0,\n",
       "  'humidity': 46,\n",
       "  'visibility': None,\n",
       "  'predictability': 77},\n",
       " {'id': 5677328589914112,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-12T06:28:55.914633Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 22.33,\n",
       "  'max_temp': 31.57,\n",
       "  'the_temp': 30.13,\n",
       "  'wind_speed': 1.8206175932553885,\n",
       "  'wind_direction': 13.0,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 38,\n",
       "  'visibility': None,\n",
       "  'predictability': 77},\n",
       " {'id': 5178619301199872,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-06-12T03:28:56.312811Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 22.33,\n",
       "  'max_temp': 31.57,\n",
       "  'the_temp': 30.13,\n",
       "  'wind_speed': 1.8206175932553885,\n",
       "  'wind_direction': 13.0,\n",
       "  'air_pressure': 1016.0,\n",
       "  'humidity': 38,\n",
       "  'visibility': None,\n",
       "  'predictability': 77},\n",
       " {'id': 6264973464436736,\n",
       "  'weather_state_name': 'Clear',\n",
       "  'weather_state_abbr': 'c',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-12T00:28:55.218831Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 20.9,\n",
       "  'max_temp': 28.41,\n",
       "  'the_temp': 27.14,\n",
       "  'wind_speed': 2.1499443251411754,\n",
       "  'wind_direction': 37.0,\n",
       "  'air_pressure': 1011.0,\n",
       "  'humidity': 38,\n",
       "  'visibility': None,\n",
       "  'predictability': 68},\n",
       " {'id': 5432302651834368,\n",
       "  'weather_state_name': 'Clear',\n",
       "  'weather_state_abbr': 'c',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-06-11T21:28:56.047726Z',\n",
       "  'applicable_date': '2020-06-20',\n",
       "  'min_temp': 20.9,\n",
       "  'max_temp': 28.41,\n",
       "  'the_temp': 27.14,\n",
       "  'wind_speed': 2.1499443251411754,\n",
       "  'wind_direction': 37.0,\n",
       "  'air_pressure': 1011.0,\n",
       "  'humidity': 38,\n",
       "  'visibility': None,\n",
       "  'predictability': 68}]"
      ]
     },
     "execution_count": 29,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "with open('out/file.json', 'r') as file:\n",
    "    s = json.load(file)\n",
    "\n",
    "s"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Как и в случае с веб-сервисами, если мы работаем в JSON ввиде списка словарей, мы можем загрузить его в **`pandas`** `DataFrame`.\n",
    "Причём, мы можем загрузить как список словарей,"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>id</th>\n",
       "      <th>weather_state_name</th>\n",
       "      <th>weather_state_abbr</th>\n",
       "      <th>wind_direction_compass</th>\n",
       "      <th>created</th>\n",
       "      <th>applicable_date</th>\n",
       "      <th>min_temp</th>\n",
       "      <th>max_temp</th>\n",
       "      <th>the_temp</th>\n",
       "      <th>wind_speed</th>\n",
       "      <th>wind_direction</th>\n",
       "      <th>air_pressure</th>\n",
       "      <th>humidity</th>\n",
       "      <th>visibility</th>\n",
       "      <th>predictability</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>4723897926680576</td>\n",
       "      <td>Heavy Rain</td>\n",
       "      <td>hr</td>\n",
       "      <td>NE</td>\n",
       "      <td>2020-06-20T18:28:31.731018Z</td>\n",
       "      <td>2020-06-20</td>\n",
       "      <td>18.675</td>\n",
       "      <td>25.810</td>\n",
       "      <td>24.695</td>\n",
       "      <td>4.646417</td>\n",
       "      <td>40.000000</td>\n",
       "      <td>1014.0</td>\n",
       "      <td>72</td>\n",
       "      <td>14.283460</td>\n",
       "      <td>77</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>5424697472712704</td>\n",
       "      <td>Light Rain</td>\n",
       "      <td>lr</td>\n",
       "      <td>NE</td>\n",
       "      <td>2020-06-20T15:28:31.713244Z</td>\n",
       "      <td>2020-06-20</td>\n",
       "      <td>18.675</td>\n",
       "      <td>25.810</td>\n",
       "      <td>24.695</td>\n",
       "      <td>4.646417</td>\n",
       "      <td>40.000000</td>\n",
       "      <td>1014.0</td>\n",
       "      <td>72</td>\n",
       "      <td>14.283460</td>\n",
       "      <td>75</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>5918873591218176</td>\n",
       "      <td>Light Rain</td>\n",
       "      <td>lr</td>\n",
       "      <td>NNE</td>\n",
       "      <td>2020-06-20T12:28:31.907804Z</td>\n",
       "      <td>2020-06-20</td>\n",
       "      <td>18.980</td>\n",
       "      <td>28.180</td>\n",
       "      <td>27.485</td>\n",
       "      <td>3.746674</td>\n",
       "      <td>27.740008</td>\n",
       "      <td>1014.0</td>\n",
       "      <td>64</td>\n",
       "      <td>14.283460</td>\n",
       "      <td>75</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>5531583773671424</td>\n",
       "      <td>Heavy Rain</td>\n",
       "      <td>hr</td>\n",
       "      <td>NNE</td>\n",
       "      <td>2020-06-20T09:28:32.329702Z</td>\n",
       "      <td>2020-06-20</td>\n",
       "      <td>18.985</td>\n",
       "      <td>28.650</td>\n",
       "      <td>27.440</td>\n",
       "      <td>3.576500</td>\n",
       "      <td>30.292134</td>\n",
       "      <td>1014.0</td>\n",
       "      <td>63</td>\n",
       "      <td>12.658574</td>\n",
       "      <td>77</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>6432472222924800</td>\n",
       "      <td>Light Rain</td>\n",
       "      <td>lr</td>\n",
       "      <td>NE</td>\n",
       "      <td>2020-06-20T06:28:31.423102Z</td>\n",
       "      <td>2020-06-20</td>\n",
       "      <td>18.280</td>\n",
       "      <td>29.665</td>\n",
       "      <td>29.515</td>\n",
       "      <td>3.217347</td>\n",
       "      <td>34.011018</td>\n",
       "      <td>1014.0</td>\n",
       "      <td>56</td>\n",
       "      <td>14.147690</td>\n",
       "      <td>75</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                 id weather_state_name weather_state_abbr  \\\n",
       "0  4723897926680576         Heavy Rain                 hr   \n",
       "1  5424697472712704         Light Rain                 lr   \n",
       "2  5918873591218176         Light Rain                 lr   \n",
       "3  5531583773671424         Heavy Rain                 hr   \n",
       "4  6432472222924800         Light Rain                 lr   \n",
       "\n",
       "  wind_direction_compass                      created applicable_date  \\\n",
       "0                     NE  2020-06-20T18:28:31.731018Z      2020-06-20   \n",
       "1                     NE  2020-06-20T15:28:31.713244Z      2020-06-20   \n",
       "2                    NNE  2020-06-20T12:28:31.907804Z      2020-06-20   \n",
       "3                    NNE  2020-06-20T09:28:32.329702Z      2020-06-20   \n",
       "4                     NE  2020-06-20T06:28:31.423102Z      2020-06-20   \n",
       "\n",
       "   min_temp  max_temp  the_temp  wind_speed  wind_direction  air_pressure  \\\n",
       "0    18.675    25.810    24.695    4.646417       40.000000        1014.0   \n",
       "1    18.675    25.810    24.695    4.646417       40.000000        1014.0   \n",
       "2    18.980    28.180    27.485    3.746674       27.740008        1014.0   \n",
       "3    18.985    28.650    27.440    3.576500       30.292134        1014.0   \n",
       "4    18.280    29.665    29.515    3.217347       34.011018        1014.0   \n",
       "\n",
       "   humidity  visibility  predictability  \n",
       "0        72   14.283460              77  \n",
       "1        72   14.283460              75  \n",
       "2        64   14.283460              75  \n",
       "3        63   12.658574              77  \n",
       "4        56   14.147690              75  "
      ]
     },
     "execution_count": 40,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "with open('out/file.json', 'r') as file:\n",
    "    s = file.read()\n",
    "    \n",
    "df = pd.read_json(s)\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "так и пропустив этот шаг, загрузить сам файл"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "enOCvMvG-IXy",
    "outputId": "58847511-24a7-49ac-e256-4c125d20c78a"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>id</th>\n",
       "      <th>weather_state_name</th>\n",
       "      <th>weather_state_abbr</th>\n",
       "      <th>wind_direction_compass</th>\n",
       "      <th>created</th>\n",
       "      <th>applicable_date</th>\n",
       "      <th>min_temp</th>\n",
       "      <th>max_temp</th>\n",
       "      <th>the_temp</th>\n",
       "      <th>wind_speed</th>\n",
       "      <th>wind_direction</th>\n",
       "      <th>air_pressure</th>\n",
       "      <th>humidity</th>\n",
       "      <th>visibility</th>\n",
       "      <th>predictability</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>4723897926680576</td>\n",
       "      <td>Heavy Rain</td>\n",
       "      <td>hr</td>\n",
       "      <td>NE</td>\n",
       "      <td>2020-06-20T18:28:31.731018Z</td>\n",
       "      <td>2020-06-20</td>\n",
       "      <td>18.675</td>\n",
       "      <td>25.810</td>\n",
       "      <td>24.695</td>\n",
       "      <td>4.646417</td>\n",
       "      <td>40.000000</td>\n",
       "      <td>1014.0</td>\n",
       "      <td>72</td>\n",
       "      <td>14.283460</td>\n",
       "      <td>77</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>5424697472712704</td>\n",
       "      <td>Light Rain</td>\n",
       "      <td>lr</td>\n",
       "      <td>NE</td>\n",
       "      <td>2020-06-20T15:28:31.713244Z</td>\n",
       "      <td>2020-06-20</td>\n",
       "      <td>18.675</td>\n",
       "      <td>25.810</td>\n",
       "      <td>24.695</td>\n",
       "      <td>4.646417</td>\n",
       "      <td>40.000000</td>\n",
       "      <td>1014.0</td>\n",
       "      <td>72</td>\n",
       "      <td>14.283460</td>\n",
       "      <td>75</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>5918873591218176</td>\n",
       "      <td>Light Rain</td>\n",
       "      <td>lr</td>\n",
       "      <td>NNE</td>\n",
       "      <td>2020-06-20T12:28:31.907804Z</td>\n",
       "      <td>2020-06-20</td>\n",
       "      <td>18.980</td>\n",
       "      <td>28.180</td>\n",
       "      <td>27.485</td>\n",
       "      <td>3.746674</td>\n",
       "      <td>27.740008</td>\n",
       "      <td>1014.0</td>\n",
       "      <td>64</td>\n",
       "      <td>14.283460</td>\n",
       "      <td>75</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>5531583773671424</td>\n",
       "      <td>Heavy Rain</td>\n",
       "      <td>hr</td>\n",
       "      <td>NNE</td>\n",
       "      <td>2020-06-20T09:28:32.329702Z</td>\n",
       "      <td>2020-06-20</td>\n",
       "      <td>18.985</td>\n",
       "      <td>28.650</td>\n",
       "      <td>27.440</td>\n",
       "      <td>3.576500</td>\n",
       "      <td>30.292134</td>\n",
       "      <td>1014.0</td>\n",
       "      <td>63</td>\n",
       "      <td>12.658574</td>\n",
       "      <td>77</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>6432472222924800</td>\n",
       "      <td>Light Rain</td>\n",
       "      <td>lr</td>\n",
       "      <td>NE</td>\n",
       "      <td>2020-06-20T06:28:31.423102Z</td>\n",
       "      <td>2020-06-20</td>\n",
       "      <td>18.280</td>\n",
       "      <td>29.665</td>\n",
       "      <td>29.515</td>\n",
       "      <td>3.217347</td>\n",
       "      <td>34.011018</td>\n",
       "      <td>1014.0</td>\n",
       "      <td>56</td>\n",
       "      <td>14.147690</td>\n",
       "      <td>75</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                 id weather_state_name weather_state_abbr  \\\n",
       "0  4723897926680576         Heavy Rain                 hr   \n",
       "1  5424697472712704         Light Rain                 lr   \n",
       "2  5918873591218176         Light Rain                 lr   \n",
       "3  5531583773671424         Heavy Rain                 hr   \n",
       "4  6432472222924800         Light Rain                 lr   \n",
       "\n",
       "  wind_direction_compass                      created applicable_date  \\\n",
       "0                     NE  2020-06-20T18:28:31.731018Z      2020-06-20   \n",
       "1                     NE  2020-06-20T15:28:31.713244Z      2020-06-20   \n",
       "2                    NNE  2020-06-20T12:28:31.907804Z      2020-06-20   \n",
       "3                    NNE  2020-06-20T09:28:32.329702Z      2020-06-20   \n",
       "4                     NE  2020-06-20T06:28:31.423102Z      2020-06-20   \n",
       "\n",
       "   min_temp  max_temp  the_temp  wind_speed  wind_direction  air_pressure  \\\n",
       "0    18.675    25.810    24.695    4.646417       40.000000        1014.0   \n",
       "1    18.675    25.810    24.695    4.646417       40.000000        1014.0   \n",
       "2    18.980    28.180    27.485    3.746674       27.740008        1014.0   \n",
       "3    18.985    28.650    27.440    3.576500       30.292134        1014.0   \n",
       "4    18.280    29.665    29.515    3.217347       34.011018        1014.0   \n",
       "\n",
       "   humidity  visibility  predictability  \n",
       "0        72   14.283460              77  \n",
       "1        72   14.283460              75  \n",
       "2        64   14.283460              75  \n",
       "3        63   12.658574              77  \n",
       "4        56   14.147690              75  "
      ]
     },
     "execution_count": 30,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df = pd.read_json('out/file.json')\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Итоги\n",
    "\n",
    "Итак, на этом уроке мы узнали:\n",
    "* Как сохранять данные в файле JSON с удобным форматированием\n",
    "* Как читать данные из файлов\n",
    "* Как преобразовать данные из файла JSON в датафрейм **`pandas`**"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "azHzSUyx_QKF"
   },
   "source": [
    "### Практика\n",
    "\n",
    "#### Задание 1 \n",
    "\n",
    "Используя сервис MetaWeather, найдите идентификатор Москвы (Moscow). Для запроса используйте адрес из следующей ячейки, заменив `%city%` на имя города."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 41,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "S-mrH_cC_QKJ"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'title': 'Moscow',\n",
       " 'location_type': 'City',\n",
       " 'woeid': 2122265,\n",
       " 'latt_long': '55.756950,37.614971'}"
      ]
     },
     "execution_count": 41,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "url = \"https://www.metaweather.com/api/location/search/?query=%s\" % 'moscow'\n",
    "\n",
    "with req.urlopen(url) as session:\n",
    "    response = session.read().decode()\n",
    "response\n",
    "data = json.loads(response)\n",
    "data[0]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "rCWH6UNH_QKX"
   },
   "source": [
    "#### Задание 2 \n",
    "\n",
    "Используя полученный идентификатор города, запросите данные о погоде в Москве за 28 апреля 2020 года. Для запроса используйте адрес из следующей ячейки, заменив `%city_id%`, `%year%`, `%month%`, `%day%` на идентификатор города, год, месяц и день соответственно."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 42,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "collapsed": true,
    "id": "fKYwn-Iz_QKa",
    "jupyter": {
     "outputs_hidden": true
    },
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[{'id': 4520607007899648,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-04-28T18:27:32.227221Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 3.67,\n",
       "  'max_temp': 10.915,\n",
       "  'the_temp': 9.965,\n",
       "  'wind_speed': 4.5501686624777955,\n",
       "  'wind_direction': 297.50133470847635,\n",
       "  'air_pressure': 1009.0,\n",
       "  'humidity': 39,\n",
       "  'visibility': 12.064543068480077,\n",
       "  'predictability': 73},\n",
       " {'id': 5728158202462208,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-04-28T15:27:32.320780Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 3.67,\n",
       "  'max_temp': 10.915,\n",
       "  'the_temp': 9.92,\n",
       "  'wind_speed': 4.5501686624777955,\n",
       "  'wind_direction': 297.50133470847635,\n",
       "  'air_pressure': 1009.0,\n",
       "  'humidity': 39,\n",
       "  'visibility': 12.064543068480077,\n",
       "  'predictability': 73},\n",
       " {'id': 5480870762774528,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-28T12:27:32.389465Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 3.3049999999999997,\n",
       "  'max_temp': 10.225,\n",
       "  'the_temp': 8.145,\n",
       "  'wind_speed': 4.519928933365148,\n",
       "  'wind_direction': 308.33499428378383,\n",
       "  'air_pressure': 1009.5,\n",
       "  'humidity': 51,\n",
       "  'visibility': 12.064543068480077,\n",
       "  'predictability': 73},\n",
       " {'id': 5972593918083072,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-28T09:27:32.493205Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 3.195,\n",
       "  'max_temp': 9.915,\n",
       "  'the_temp': 8.025,\n",
       "  'wind_speed': 4.555980100031815,\n",
       "  'wind_direction': 308.6673835118722,\n",
       "  'air_pressure': 1009.5,\n",
       "  'humidity': 51,\n",
       "  'visibility': 10.53690199236459,\n",
       "  'predictability': 73},\n",
       " {'id': 5468569036914688,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-28T06:27:31.423059Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.425,\n",
       "  'max_temp': 10.260000000000002,\n",
       "  'the_temp': 8.765,\n",
       "  'wind_speed': 4.571307277080517,\n",
       "  'wind_direction': 308.6673835118722,\n",
       "  'air_pressure': 1009.5,\n",
       "  'humidity': 47,\n",
       "  'visibility': 12.849024198679711,\n",
       "  'predictability': 73},\n",
       " {'id': 5212616366489600,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-28T03:27:31.446036Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.26,\n",
       "  'max_temp': 10.635000000000002,\n",
       "  'the_temp': 8.75,\n",
       "  'wind_speed': 4.755430377080516,\n",
       "  'wind_direction': 307.6709904229787,\n",
       "  'air_pressure': 1009.5,\n",
       "  'humidity': 47,\n",
       "  'visibility': 13.045998866618945,\n",
       "  'predictability': 73},\n",
       " {'id': 4888443760934912,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-28T00:27:32.632727Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 2.8449999999999998,\n",
       "  'max_temp': 12.600000000000001,\n",
       "  'the_temp': 12.435,\n",
       "  'wind_speed': 5.2744841032370955,\n",
       "  'wind_direction': 311.2624574246146,\n",
       "  'air_pressure': 1000.0,\n",
       "  'humidity': 37,\n",
       "  'visibility': 15.173573828839576,\n",
       "  'predictability': 73},\n",
       " {'id': 5844479674155008,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-04-27T21:27:31.816560Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 2.8449999999999998,\n",
       "  'max_temp': 12.600000000000001,\n",
       "  'the_temp': 11.585,\n",
       "  'wind_speed': 5.848629469903762,\n",
       "  'wind_direction': 292.88373023762034,\n",
       "  'air_pressure': 1003.0,\n",
       "  'humidity': 46,\n",
       "  'visibility': 10.872131750576632,\n",
       "  'predictability': 73},\n",
       " {'id': 4722492750954496,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-27T18:27:34.511103Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.3250000000000002,\n",
       "  'max_temp': 10.8,\n",
       "  'the_temp': 9.23,\n",
       "  'wind_speed': 4.374458585675654,\n",
       "  'wind_direction': 307.34963261827176,\n",
       "  'air_pressure': 1009.0,\n",
       "  'humidity': 47,\n",
       "  'visibility': 13.100368845939713,\n",
       "  'predictability': 73},\n",
       " {'id': 6043165666574336,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-27T15:27:34.462190Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.3250000000000002,\n",
       "  'max_temp': 10.8,\n",
       "  'the_temp': 9.225000000000001,\n",
       "  'wind_speed': 4.404284319008988,\n",
       "  'wind_direction': 307.34963261827176,\n",
       "  'air_pressure': 1008.5,\n",
       "  'humidity': 48,\n",
       "  'visibility': 13.528804282987352,\n",
       "  'predictability': 73},\n",
       " {'id': 5011162066321408,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-27T12:27:34.693266Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 0.71,\n",
       "  'max_temp': 10.66,\n",
       "  'the_temp': 9.265,\n",
       "  'wind_speed': 4.463107479514303,\n",
       "  'wind_direction': 308.02150160064934,\n",
       "  'air_pressure': 1009.0,\n",
       "  'humidity': 47,\n",
       "  'visibility': 13.008716595084703,\n",
       "  'predictability': 73},\n",
       " {'id': 5429401602752512,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-27T09:27:35.595486Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 0.89,\n",
       "  'max_temp': 10.825,\n",
       "  'the_temp': 9.344999999999999,\n",
       "  'wind_speed': 4.524861279514304,\n",
       "  'wind_direction': 310.0061151618099,\n",
       "  'air_pressure': 1009.0,\n",
       "  'humidity': 46,\n",
       "  'visibility': 11.97040533285612,\n",
       "  'predictability': 73},\n",
       " {'id': 5102355563413504,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-27T06:27:34.409498Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 0.8500000000000001,\n",
       "  'max_temp': 10.965,\n",
       "  'the_temp': 9.22,\n",
       "  'wind_speed': 4.55965800335905,\n",
       "  'wind_direction': 310.0061151618099,\n",
       "  'air_pressure': 1009.5,\n",
       "  'humidity': 46,\n",
       "  'visibility': 12.825101407778572,\n",
       "  'predictability': 71},\n",
       " {'id': 5725551492857856,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-04-27T03:27:34.619624Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.0150000000000001,\n",
       "  'max_temp': 11.030000000000001,\n",
       "  'the_temp': 9.17,\n",
       "  'wind_speed': 4.724570870025716,\n",
       "  'wind_direction': 301.82355249485084,\n",
       "  'air_pressure': 1009.5,\n",
       "  'humidity': 47,\n",
       "  'visibility': 13.320644933587847,\n",
       "  'predictability': 71},\n",
       " {'id': 6241938028101632,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-04-27T00:27:34.530307Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.745,\n",
       "  'max_temp': 12.2,\n",
       "  'the_temp': 10.52,\n",
       "  'wind_speed': 4.747770154068241,\n",
       "  'wind_direction': 298.04209422388783,\n",
       "  'air_pressure': 1000.5,\n",
       "  'humidity': 51,\n",
       "  'visibility': 14.89084993637159,\n",
       "  'predictability': 73},\n",
       " {'id': 6353475308879872,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-04-26T21:27:34.739365Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.745,\n",
       "  'max_temp': 12.2,\n",
       "  'the_temp': 10.125,\n",
       "  'wind_speed': 5.224981887401575,\n",
       "  'wind_direction': 290.7808478210698,\n",
       "  'air_pressure': 1003.5,\n",
       "  'humidity': 56,\n",
       "  'visibility': 10.639738924679868,\n",
       "  'predictability': 73},\n",
       " {'id': 5481074538840064,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-26T18:27:37.523136Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.8050000000000002,\n",
       "  'max_temp': 11.1,\n",
       "  'the_temp': 9.434999999999999,\n",
       "  'wind_speed': 5.189363735398605,\n",
       "  'wind_direction': 309.9989829823174,\n",
       "  'air_pressure': 1009.0,\n",
       "  'humidity': 47,\n",
       "  'visibility': 12.717914877117632,\n",
       "  'predictability': 73},\n",
       " {'id': 5909991951171584,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-26T15:27:37.218842Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.8050000000000002,\n",
       "  'max_temp': 11.1,\n",
       "  'the_temp': 9.434999999999999,\n",
       "  'wind_speed': 5.2117330353986056,\n",
       "  'wind_direction': 309.9989829823174,\n",
       "  'air_pressure': 1009.0,\n",
       "  'humidity': 47,\n",
       "  'visibility': 13.315052592857711,\n",
       "  'predictability': 73},\n",
       " {'id': 5689896956067840,\n",
       "  'weather_state_name': 'Light Cloud',\n",
       "  'weather_state_abbr': 'lc',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-26T12:27:37.800754Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.7349999999999999,\n",
       "  'max_temp': 11.205,\n",
       "  'the_temp': 9.465,\n",
       "  'wind_speed': 5.2009626433468545,\n",
       "  'wind_direction': 312.002747204715,\n",
       "  'air_pressure': 1009.5,\n",
       "  'humidity': 47,\n",
       "  'visibility': 12.117670305416368,\n",
       "  'predictability': 70},\n",
       " {'id': 5056103127711744,\n",
       "  'weather_state_name': 'Light Cloud',\n",
       "  'weather_state_abbr': 'lc',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-26T09:27:38.809776Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.7149999999999999,\n",
       "  'max_temp': 11.16,\n",
       "  'the_temp': 9.28,\n",
       "  'wind_speed': 4.984644510013521,\n",
       "  'wind_direction': 313.0008130560872,\n",
       "  'air_pressure': 1010.0,\n",
       "  'humidity': 51,\n",
       "  'visibility': 9.706750079535514,\n",
       "  'predictability': 70},\n",
       " {'id': 6345560019697664,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-26T06:27:37.417696Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.795,\n",
       "  'max_temp': 10.969999999999999,\n",
       "  'the_temp': 9.309999999999999,\n",
       "  'wind_speed': 4.98381588924945,\n",
       "  'wind_direction': 315.0,\n",
       "  'air_pressure': 1010.0,\n",
       "  'humidity': 47,\n",
       "  'visibility': 13.75342996898115,\n",
       "  'predictability': 73},\n",
       " {'id': 5520572165390336,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-26T03:27:38.230928Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.745,\n",
       "  'max_temp': 10.95,\n",
       "  'the_temp': 9.205,\n",
       "  'wind_speed': 5.086974955916117,\n",
       "  'wind_direction': 317.6663655959727,\n",
       "  'air_pressure': 1009.5,\n",
       "  'humidity': 47,\n",
       "  'visibility': 14.929064264694185,\n",
       "  'predictability': 73},\n",
       " {'id': 6085597175218176,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NNW',\n",
       "  'created': '2020-04-26T00:27:37.693172Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 2.425,\n",
       "  'max_temp': 9.765,\n",
       "  'the_temp': 7.755000000000001,\n",
       "  'wind_speed': 4.090296863925342,\n",
       "  'wind_direction': 330.86725894359245,\n",
       "  'air_pressure': 1005.0,\n",
       "  'humidity': 58,\n",
       "  'visibility': 13.767721506402609,\n",
       "  'predictability': 73},\n",
       " {'id': 4707287694311424,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-25T21:27:38.712171Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 2.425,\n",
       "  'max_temp': 9.765,\n",
       "  'the_temp': 7.404999999999999,\n",
       "  'wind_speed': 4.560052163925342,\n",
       "  'wind_direction': 323.2935424263512,\n",
       "  'air_pressure': 1007.5,\n",
       "  'humidity': 61,\n",
       "  'visibility': 12.833489918873777,\n",
       "  'predictability': 73},\n",
       " {'id': 5386597774131200,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-25T18:27:40.705815Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.305,\n",
       "  'max_temp': 10.19,\n",
       "  'the_temp': 8.89,\n",
       "  'wind_speed': 5.370316047320979,\n",
       "  'wind_direction': 318.6661282155967,\n",
       "  'air_pressure': 1009.0,\n",
       "  'humidity': 48,\n",
       "  'visibility': 12.383617175693947,\n",
       "  'predictability': 71},\n",
       " {'id': 6023018310533120,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-25T15:27:41.716182Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.305,\n",
       "  'max_temp': 10.19,\n",
       "  'the_temp': 8.91,\n",
       "  'wind_speed': 5.415054647320979,\n",
       "  'wind_direction': 318.6661282155967,\n",
       "  'air_pressure': 1008.5,\n",
       "  'humidity': 50,\n",
       "  'visibility': 13.665816630875685,\n",
       "  'predictability': 71},\n",
       " {'id': 4880358568886272,\n",
       "  'weather_state_name': 'Light Cloud',\n",
       "  'weather_state_abbr': 'lc',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-25T12:27:40.193497Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.385,\n",
       "  'max_temp': 10.29,\n",
       "  'the_temp': 9.155000000000001,\n",
       "  'wind_speed': 5.559626948460988,\n",
       "  'wind_direction': 319.99643554570355,\n",
       "  'air_pressure': 1008.0,\n",
       "  'humidity': 49,\n",
       "  'visibility': 12.785644337071503,\n",
       "  'predictability': 70},\n",
       " {'id': 6627355910995968,\n",
       "  'weather_state_name': 'Light Cloud',\n",
       "  'weather_state_abbr': 'lc',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-25T09:27:40.708779Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.395,\n",
       "  'max_temp': 11.100000000000001,\n",
       "  'the_temp': 9.0,\n",
       "  'wind_speed': 4.411555015127655,\n",
       "  'wind_direction': 323.6745232343287,\n",
       "  'air_pressure': 1008.0,\n",
       "  'humidity': 48,\n",
       "  'visibility': 12.244430028632785,\n",
       "  'predictability': 70},\n",
       " {'id': 5603415172317184,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-25T06:27:40.410376Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.75,\n",
       "  'max_temp': 11.375,\n",
       "  'the_temp': 9.2,\n",
       "  'wind_speed': 3.6969782489222935,\n",
       "  'wind_direction': 322.3349942837838,\n",
       "  'air_pressure': 1009.5,\n",
       "  'humidity': 48,\n",
       "  'visibility': 11.768770380975106,\n",
       "  'predictability': 71},\n",
       " {'id': 6349476761436160,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-25T03:27:40.433114Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 2.02,\n",
       "  'max_temp': 11.504999999999999,\n",
       "  'the_temp': 9.205,\n",
       "  'wind_speed': 4.0752244489222935,\n",
       "  'wind_direction': 321.0024421460581,\n",
       "  'air_pressure': 1010.0,\n",
       "  'humidity': 49,\n",
       "  'visibility': 13.349849379623002,\n",
       "  'predictability': 71},\n",
       " {'id': 4563868535750656,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-04-25T00:27:41.036470Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 3.3449999999999998,\n",
       "  'max_temp': 13.825,\n",
       "  'the_temp': 12.14,\n",
       "  'wind_speed': 4.635702711492882,\n",
       "  'wind_direction': 294.40350450294295,\n",
       "  'air_pressure': 1007.0,\n",
       "  'humidity': 46,\n",
       "  'visibility': 13.470706076513164,\n",
       "  'predictability': 73},\n",
       " {'id': 5227287303684096,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-04-24T21:27:39.897827Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 3.3449999999999998,\n",
       "  'max_temp': 13.825,\n",
       "  'the_temp': 12.155000000000001,\n",
       "  'wind_speed': 5.015980811492882,\n",
       "  'wind_direction': 294.40350450294295,\n",
       "  'air_pressure': 1008.5,\n",
       "  'humidity': 49,\n",
       "  'visibility': 11.535445498289986,\n",
       "  'predictability': 73},\n",
       " {'id': 5456787337641984,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-24T18:27:43.595633Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 2.005,\n",
       "  'max_temp': 11.04,\n",
       "  'the_temp': 9.54,\n",
       "  'wind_speed': 4.614086924123121,\n",
       "  'wind_direction': 317.29157811967093,\n",
       "  'air_pressure': 1009.0,\n",
       "  'humidity': 49,\n",
       "  'visibility': 11.869743199713671,\n",
       "  'predictability': 73},\n",
       " {'id': 5800593429889024,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-24T15:27:42.924522Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 2.005,\n",
       "  'max_temp': 11.04,\n",
       "  'the_temp': 9.504999999999999,\n",
       "  'wind_speed': 4.621543357456455,\n",
       "  'wind_direction': 324.6503690081608,\n",
       "  'air_pressure': 1009.0,\n",
       "  'humidity': 51,\n",
       "  'visibility': 13.088873478883322,\n",
       "  'predictability': 73},\n",
       " {'id': 6473013509750784,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-24T12:27:43.599229Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.6,\n",
       "  'max_temp': 10.82,\n",
       "  'the_temp': 9.225,\n",
       "  'wind_speed': 4.334884093130783,\n",
       "  'wind_direction': 323.9759968906734,\n",
       "  'air_pressure': 1008.5,\n",
       "  'humidity': 50,\n",
       "  'visibility': 12.689021116678596,\n",
       "  'predictability': 71},\n",
       " {'id': 5767946779492352,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-24T09:27:44.727634Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.4,\n",
       "  'max_temp': 11.844999999999999,\n",
       "  'the_temp': 9.21,\n",
       "  'wind_speed': 4.02979695979745,\n",
       "  'wind_direction': 304.881289290963,\n",
       "  'air_pressure': 1009.0,\n",
       "  'humidity': 48,\n",
       "  'visibility': 11.603174958243855,\n",
       "  'predictability': 71},\n",
       " {'id': 5835349378990080,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-04-24T06:27:43.555093Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.905,\n",
       "  'max_temp': 12.67,\n",
       "  'the_temp': 9.74,\n",
       "  'wind_speed': 4.0119844447944,\n",
       "  'wind_direction': 288.84468559373204,\n",
       "  'air_pressure': 1009.5,\n",
       "  'humidity': 47,\n",
       "  'visibility': 11.976619044778493,\n",
       "  'predictability': 71},\n",
       " {'id': 6735633311596544,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-04-24T03:27:44.303546Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.85,\n",
       "  'max_temp': 12.61,\n",
       "  'the_temp': 9.565000000000001,\n",
       "  'wind_speed': 3.7627742114610676,\n",
       "  'wind_direction': 303.3167434401916,\n",
       "  'air_pressure': 1009.5,\n",
       "  'humidity': 49,\n",
       "  'visibility': 13.109068042631035,\n",
       "  'predictability': 71},\n",
       " {'id': 4598092177342464,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-04-24T00:27:43.733175Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 3.715,\n",
       "  'max_temp': 13.07,\n",
       "  'the_temp': 8.955,\n",
       "  'wind_speed': 4.150096426896259,\n",
       "  'wind_direction': 291.4155746148685,\n",
       "  'air_pressure': 1005.0,\n",
       "  'humidity': 55,\n",
       "  'visibility': 13.350470750815239,\n",
       "  'predictability': 73},\n",
       " {'id': 6154505781510144,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'W',\n",
       "  'created': '2020-04-23T21:27:43.327709Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 3.715,\n",
       "  'max_temp': 13.07,\n",
       "  'the_temp': 7.74,\n",
       "  'wind_speed': 4.558631790344389,\n",
       "  'wind_direction': 265.5,\n",
       "  'air_pressure': 1005.0,\n",
       "  'humidity': 65,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 5503780722311168,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-04-23T18:27:47.671974Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.9749999999999999,\n",
       "  'max_temp': 11.68,\n",
       "  'the_temp': 9.53,\n",
       "  'wind_speed': 2.9891352501391872,\n",
       "  'wind_direction': 282.0,\n",
       "  'air_pressure': 1011.0,\n",
       "  'humidity': 53,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 71},\n",
       " {'id': 5311494768033792,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-04-23T15:27:48.571545Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.9749999999999999,\n",
       "  'max_temp': 11.68,\n",
       "  'the_temp': 9.53,\n",
       "  'wind_speed': 2.9891352501391872,\n",
       "  'wind_direction': 282.0,\n",
       "  'air_pressure': 1011.0,\n",
       "  'humidity': 53,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 71},\n",
       " {'id': 4823482380582912,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'WSW',\n",
       "  'created': '2020-04-23T12:27:46.721449Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.9749999999999999,\n",
       "  'max_temp': 11.56,\n",
       "  'the_temp': 10.64,\n",
       "  'wind_speed': 3.250111150878867,\n",
       "  'wind_direction': 255.5,\n",
       "  'air_pressure': 1004.0,\n",
       "  'humidity': 51,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 75},\n",
       " {'id': 5516129525039104,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'W',\n",
       "  'created': '2020-04-23T09:27:46.328368Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 2.9749999999999996,\n",
       "  'max_temp': 11.815000000000001,\n",
       "  'the_temp': 10.64,\n",
       "  'wind_speed': 3.705111150878867,\n",
       "  'wind_direction': 275.0,\n",
       "  'air_pressure': 1004.0,\n",
       "  'humidity': 50,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 5766464948666368,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'WNW',\n",
       "  'created': '2020-04-23T06:27:46.480384Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 3.01,\n",
       "  'max_temp': 12.01,\n",
       "  'the_temp': 10.06,\n",
       "  'wind_speed': 3.910163644317188,\n",
       "  'wind_direction': 282.5,\n",
       "  'air_pressure': 1005.0,\n",
       "  'humidity': 52,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 5554822784745472,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'W',\n",
       "  'created': '2020-04-23T03:27:46.413528Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 3.13,\n",
       "  'max_temp': 12.469999999999999,\n",
       "  'the_temp': 10.06,\n",
       "  'wind_speed': 3.6701636443171877,\n",
       "  'wind_direction': 264.0,\n",
       "  'air_pressure': 1005.0,\n",
       "  'humidity': 51,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 4619790352121856,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'WSW',\n",
       "  'created': '2020-04-23T00:27:47.933745Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 4.88,\n",
       "  'max_temp': 12.34,\n",
       "  'the_temp': 10.14,\n",
       "  'wind_speed': 4.701639823431162,\n",
       "  'wind_direction': 251.5,\n",
       "  'air_pressure': 1001.0,\n",
       "  'humidity': 68,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 5012406533095424,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'WSW',\n",
       "  'created': '2020-04-22T21:27:47.913412Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 4.88,\n",
       "  'max_temp': 12.34,\n",
       "  'the_temp': 10.14,\n",
       "  'wind_speed': 4.701639823431162,\n",
       "  'wind_direction': 251.5,\n",
       "  'air_pressure': 1001.0,\n",
       "  'humidity': 68,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 6098047698206720,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-22T18:27:50.338686Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 4.025,\n",
       "  'max_temp': 14.559999999999999,\n",
       "  'the_temp': 12.59,\n",
       "  'wind_speed': 2.3005929372464804,\n",
       "  'wind_direction': 311.5,\n",
       "  'air_pressure': 1012.0,\n",
       "  'humidity': 46,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 71},\n",
       " {'id': 5538383193440256,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'NW',\n",
       "  'created': '2020-04-22T15:27:50.115038Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 4.025,\n",
       "  'max_temp': 14.559999999999999,\n",
       "  'the_temp': 12.59,\n",
       "  'wind_speed': 2.3005929372464804,\n",
       "  'wind_direction': 311.5,\n",
       "  'air_pressure': 1012.0,\n",
       "  'humidity': 46,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 71},\n",
       " {'id': 6316427323637760,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'W',\n",
       "  'created': '2020-04-22T12:27:49.195811Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 4.01,\n",
       "  'max_temp': 14.26,\n",
       "  'the_temp': 12.75,\n",
       "  'wind_speed': 2.943712121212121,\n",
       "  'wind_direction': 275.0,\n",
       "  'air_pressure': 1009.0,\n",
       "  'humidity': 46,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 71},\n",
       " {'id': 6714499220373504,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'SW',\n",
       "  'created': '2020-04-22T09:27:51.222209Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 3.64,\n",
       "  'max_temp': 14.48,\n",
       "  'the_temp': 12.75,\n",
       "  'wind_speed': 4.673712121212121,\n",
       "  'wind_direction': 223.5,\n",
       "  'air_pressure': 1009.0,\n",
       "  'humidity': 47,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 71},\n",
       " {'id': 4745102733869056,\n",
       "  'weather_state_name': 'Light Rain',\n",
       "  'weather_state_abbr': 'lr',\n",
       "  'wind_direction_compass': 'SW',\n",
       "  'created': '2020-04-22T06:27:54.915948Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 3.375,\n",
       "  'max_temp': 13.745000000000001,\n",
       "  'the_temp': 11.37,\n",
       "  'wind_speed': 4.878764614650441,\n",
       "  'wind_direction': 226.0,\n",
       "  'air_pressure': 1006.0,\n",
       "  'humidity': 49,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 75},\n",
       " {'id': 6531665583144960,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'W',\n",
       "  'created': '2020-04-22T03:27:50.021761Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 4.75,\n",
       "  'max_temp': 12.145,\n",
       "  'the_temp': 11.37,\n",
       "  'wind_speed': 4.498764614650441,\n",
       "  'wind_direction': 261.0,\n",
       "  'air_pressure': 1006.0,\n",
       "  'humidity': 57,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 6310368534069248,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'W',\n",
       "  'created': '2020-04-22T00:27:51.614409Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 4.07,\n",
       "  'max_temp': 10.65,\n",
       "  'the_temp': 5.77,\n",
       "  'wind_speed': 4.191185874492961,\n",
       "  'wind_direction': 276.0,\n",
       "  'air_pressure': 995.0,\n",
       "  'humidity': 75,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 6458815757156352,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'W',\n",
       "  'created': '2020-04-21T21:27:51.068481Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 4.07,\n",
       "  'max_temp': 10.65,\n",
       "  'the_temp': 5.77,\n",
       "  'wind_speed': 4.191185874492961,\n",
       "  'wind_direction': 276.0,\n",
       "  'air_pressure': 995.0,\n",
       "  'humidity': 75,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 5245224026636288,\n",
       "  'weather_state_name': 'Hail',\n",
       "  'weather_state_abbr': 'h',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-04-21T18:27:53.555798Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 3.88,\n",
       "  'max_temp': 10.295,\n",
       "  'the_temp': 5.89,\n",
       "  'wind_speed': 4.161423685675654,\n",
       "  'wind_direction': 352.0,\n",
       "  'air_pressure': 1004.0,\n",
       "  'humidity': 72,\n",
       "  'visibility': 9.676613576712002,\n",
       "  'predictability': 82},\n",
       " {'id': 5100067990011904,\n",
       "  'weather_state_name': 'Hail',\n",
       "  'weather_state_abbr': 'h',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-04-21T15:27:53.109905Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 3.88,\n",
       "  'max_temp': 10.295,\n",
       "  'the_temp': 5.89,\n",
       "  'wind_speed': 4.161423685675654,\n",
       "  'wind_direction': 352.0,\n",
       "  'air_pressure': 1004.0,\n",
       "  'humidity': 72,\n",
       "  'visibility': 9.676613576712002,\n",
       "  'predictability': 82},\n",
       " {'id': 5886596224122880,\n",
       "  'weather_state_name': 'Hail',\n",
       "  'weather_state_abbr': 'h',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-04-21T12:27:53.103622Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 3.88,\n",
       "  'max_temp': 10.295,\n",
       "  'the_temp': 5.89,\n",
       "  'wind_speed': 4.161423685675654,\n",
       "  'wind_direction': 352.0,\n",
       "  'air_pressure': 1004.0,\n",
       "  'humidity': 72,\n",
       "  'visibility': 9.676613576712002,\n",
       "  'predictability': 82},\n",
       " {'id': 4527590893158400,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-04-21T09:27:52.980890Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 3.05,\n",
       "  'max_temp': 10.815000000000001,\n",
       "  'the_temp': 5.89,\n",
       "  'wind_speed': 3.541423685675654,\n",
       "  'wind_direction': 30.50000000000001,\n",
       "  'air_pressure': 1004.0,\n",
       "  'humidity': 64,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 77},\n",
       " {'id': 5697636487135232,\n",
       "  'weather_state_name': 'Showers',\n",
       "  'weather_state_abbr': 's',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-04-21T06:27:53.199225Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 2.69,\n",
       "  'max_temp': 11.02,\n",
       "  'the_temp': 8.53,\n",
       "  'wind_speed': 3.5755991012487076,\n",
       "  'wind_direction': 52.500000000000014,\n",
       "  'air_pressure': 1006.0,\n",
       "  'humidity': 54,\n",
       "  'visibility': 9.999726596675416,\n",
       "  'predictability': 73},\n",
       " {'id': 5413790688477184,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'ESE',\n",
       "  'created': '2020-04-21T03:27:53.339675Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.53,\n",
       "  'max_temp': 9.24,\n",
       "  'the_temp': 8.53,\n",
       "  'wind_speed': 1.721198202497415,\n",
       "  'wind_direction': 121.0,\n",
       "  'air_pressure': 1006.0,\n",
       "  'humidity': 47,\n",
       "  'visibility': None,\n",
       "  'predictability': 77},\n",
       " {'id': 6336877072220160,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-04-21T00:27:52.507494Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 2.42,\n",
       "  'max_temp': 10.92,\n",
       "  'the_temp': 9.65,\n",
       "  'wind_speed': 2.945299451204963,\n",
       "  'wind_direction': 1.0,\n",
       "  'air_pressure': 1005.0,\n",
       "  'humidity': 47,\n",
       "  'visibility': None,\n",
       "  'predictability': 77},\n",
       " {'id': 6126731503075328,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'N',\n",
       "  'created': '2020-04-20T21:27:53.730576Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 2.42,\n",
       "  'max_temp': 10.92,\n",
       "  'the_temp': 9.65,\n",
       "  'wind_speed': 2.945299451204963,\n",
       "  'wind_direction': 1.0,\n",
       "  'air_pressure': 1005.0,\n",
       "  'humidity': 47,\n",
       "  'visibility': None,\n",
       "  'predictability': 77},\n",
       " {'id': 4724993025900544,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-04-20T18:27:56.396637Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 4.12,\n",
       "  'max_temp': 5.25,\n",
       "  'the_temp': 4.95,\n",
       "  'wind_speed': 2.839666348524616,\n",
       "  'wind_direction': 45.0,\n",
       "  'air_pressure': 996.0,\n",
       "  'humidity': 87,\n",
       "  'visibility': None,\n",
       "  'predictability': 77},\n",
       " {'id': 4997355692621824,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'NE',\n",
       "  'created': '2020-04-20T15:27:56.795716Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 4.12,\n",
       "  'max_temp': 5.25,\n",
       "  'the_temp': 4.95,\n",
       "  'wind_speed': 2.839666348524616,\n",
       "  'wind_direction': 45.0,\n",
       "  'air_pressure': 996.0,\n",
       "  'humidity': 87,\n",
       "  'visibility': None,\n",
       "  'predictability': 77},\n",
       " {'id': 5992850795790336,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'SSE',\n",
       "  'created': '2020-04-20T12:27:57.004340Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 4.94,\n",
       "  'max_temp': 14.56,\n",
       "  'the_temp': 13.83,\n",
       "  'wind_speed': 2.193440308597789,\n",
       "  'wind_direction': 148.0,\n",
       "  'air_pressure': 1007.0,\n",
       "  'humidity': 44,\n",
       "  'visibility': None,\n",
       "  'predictability': 77},\n",
       " {'id': 6250892430934016,\n",
       "  'weather_state_name': 'Heavy Rain',\n",
       "  'weather_state_abbr': 'hr',\n",
       "  'wind_direction_compass': 'SSE',\n",
       "  'created': '2020-04-20T09:27:56.706292Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 4.94,\n",
       "  'max_temp': 14.56,\n",
       "  'the_temp': 13.83,\n",
       "  'wind_speed': 2.193440308597789,\n",
       "  'wind_direction': 148.0,\n",
       "  'air_pressure': 1007.0,\n",
       "  'humidity': 44,\n",
       "  'visibility': None,\n",
       "  'predictability': 77},\n",
       " {'id': 5886764499599360,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'W',\n",
       "  'created': '2020-04-20T06:27:56.122840Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 2.33,\n",
       "  'max_temp': 12.22,\n",
       "  'the_temp': 11.36,\n",
       "  'wind_speed': 1.9013958482462419,\n",
       "  'wind_direction': 281.0,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 41,\n",
       "  'visibility': None,\n",
       "  'predictability': 71},\n",
       " {'id': 6287126788308992,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'W',\n",
       "  'created': '2020-04-20T03:27:55.833923Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 2.33,\n",
       "  'max_temp': 12.22,\n",
       "  'the_temp': 11.36,\n",
       "  'wind_speed': 1.9013958482462419,\n",
       "  'wind_direction': 281.0,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 41,\n",
       "  'visibility': None,\n",
       "  'predictability': 71},\n",
       " {'id': 4568015662219264,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-04-20T00:27:56.863059Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.12,\n",
       "  'max_temp': 8.76,\n",
       "  'the_temp': 7.68,\n",
       "  'wind_speed': 1.373230334844508,\n",
       "  'wind_direction': 14.999999999999998,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 49,\n",
       "  'visibility': None,\n",
       "  'predictability': 71},\n",
       " {'id': 6086405786697728,\n",
       "  'weather_state_name': 'Heavy Cloud',\n",
       "  'weather_state_abbr': 'hc',\n",
       "  'wind_direction_compass': 'NNE',\n",
       "  'created': '2020-04-19T21:27:55.595543Z',\n",
       "  'applicable_date': '2020-04-28',\n",
       "  'min_temp': 1.12,\n",
       "  'max_temp': 8.76,\n",
       "  'the_temp': 7.68,\n",
       "  'wind_speed': 1.373230334844508,\n",
       "  'wind_direction': 14.999999999999998,\n",
       "  'air_pressure': 1014.0,\n",
       "  'humidity': 49,\n",
       "  'visibility': None,\n",
       "  'predictability': 71}]"
      ]
     },
     "execution_count": 42,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "url = 'https://www.metaweather.com/api/location/%s/%s/' % (data[0]['woeid'], '2020/04/28')\n",
    "\n",
    "with req.urlopen(url) as session:\n",
    "    response = session.read().decode()\n",
    "    s = json.loads(response)\n",
    "    \n",
    "s"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "VeTB_VLo_QKl"
   },
   "source": [
    "#### Задание 3 \n",
    "\n",
    "Сохраните полученные данные в файл `file.json`. Для форматирования файла используйте четыре пробела."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 44,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "6RKs950M_QKm"
   },
   "outputs": [],
   "source": [
    "with open('out/practice.json', 'w') as file:\n",
    "    json.dump(s, file, indent=4)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "dpCG2qxv_QKw"
   },
   "source": [
    "#### Задание 4 \n",
    "\n",
    "Загрузите содержимое файла `file.json` в DataFrame и выведите первые пять строк на экран."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 45,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "1wug7UER_QKx"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>id</th>\n",
       "      <th>weather_state_name</th>\n",
       "      <th>weather_state_abbr</th>\n",
       "      <th>wind_direction_compass</th>\n",
       "      <th>created</th>\n",
       "      <th>applicable_date</th>\n",
       "      <th>min_temp</th>\n",
       "      <th>max_temp</th>\n",
       "      <th>the_temp</th>\n",
       "      <th>wind_speed</th>\n",
       "      <th>wind_direction</th>\n",
       "      <th>air_pressure</th>\n",
       "      <th>humidity</th>\n",
       "      <th>visibility</th>\n",
       "      <th>predictability</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>4520607007899648</td>\n",
       "      <td>Showers</td>\n",
       "      <td>s</td>\n",
       "      <td>WNW</td>\n",
       "      <td>2020-04-28T18:27:32.227221Z</td>\n",
       "      <td>2020-04-28</td>\n",
       "      <td>3.670</td>\n",
       "      <td>10.915</td>\n",
       "      <td>9.965</td>\n",
       "      <td>4.550169</td>\n",
       "      <td>297.501335</td>\n",
       "      <td>1009.0</td>\n",
       "      <td>39</td>\n",
       "      <td>12.064543</td>\n",
       "      <td>73</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>5728158202462208</td>\n",
       "      <td>Showers</td>\n",
       "      <td>s</td>\n",
       "      <td>WNW</td>\n",
       "      <td>2020-04-28T15:27:32.320780Z</td>\n",
       "      <td>2020-04-28</td>\n",
       "      <td>3.670</td>\n",
       "      <td>10.915</td>\n",
       "      <td>9.920</td>\n",
       "      <td>4.550169</td>\n",
       "      <td>297.501335</td>\n",
       "      <td>1009.0</td>\n",
       "      <td>39</td>\n",
       "      <td>12.064543</td>\n",
       "      <td>73</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>5480870762774528</td>\n",
       "      <td>Showers</td>\n",
       "      <td>s</td>\n",
       "      <td>NW</td>\n",
       "      <td>2020-04-28T12:27:32.389465Z</td>\n",
       "      <td>2020-04-28</td>\n",
       "      <td>3.305</td>\n",
       "      <td>10.225</td>\n",
       "      <td>8.145</td>\n",
       "      <td>4.519929</td>\n",
       "      <td>308.334994</td>\n",
       "      <td>1009.5</td>\n",
       "      <td>51</td>\n",
       "      <td>12.064543</td>\n",
       "      <td>73</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>5972593918083072</td>\n",
       "      <td>Showers</td>\n",
       "      <td>s</td>\n",
       "      <td>NW</td>\n",
       "      <td>2020-04-28T09:27:32.493205Z</td>\n",
       "      <td>2020-04-28</td>\n",
       "      <td>3.195</td>\n",
       "      <td>9.915</td>\n",
       "      <td>8.025</td>\n",
       "      <td>4.555980</td>\n",
       "      <td>308.667384</td>\n",
       "      <td>1009.5</td>\n",
       "      <td>51</td>\n",
       "      <td>10.536902</td>\n",
       "      <td>73</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>5468569036914688</td>\n",
       "      <td>Showers</td>\n",
       "      <td>s</td>\n",
       "      <td>NW</td>\n",
       "      <td>2020-04-28T06:27:31.423059Z</td>\n",
       "      <td>2020-04-28</td>\n",
       "      <td>1.425</td>\n",
       "      <td>10.260</td>\n",
       "      <td>8.765</td>\n",
       "      <td>4.571307</td>\n",
       "      <td>308.667384</td>\n",
       "      <td>1009.5</td>\n",
       "      <td>47</td>\n",
       "      <td>12.849024</td>\n",
       "      <td>73</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                 id weather_state_name weather_state_abbr  \\\n",
       "0  4520607007899648            Showers                  s   \n",
       "1  5728158202462208            Showers                  s   \n",
       "2  5480870762774528            Showers                  s   \n",
       "3  5972593918083072            Showers                  s   \n",
       "4  5468569036914688            Showers                  s   \n",
       "\n",
       "  wind_direction_compass                      created applicable_date  \\\n",
       "0                    WNW  2020-04-28T18:27:32.227221Z      2020-04-28   \n",
       "1                    WNW  2020-04-28T15:27:32.320780Z      2020-04-28   \n",
       "2                     NW  2020-04-28T12:27:32.389465Z      2020-04-28   \n",
       "3                     NW  2020-04-28T09:27:32.493205Z      2020-04-28   \n",
       "4                     NW  2020-04-28T06:27:31.423059Z      2020-04-28   \n",
       "\n",
       "   min_temp  max_temp  the_temp  wind_speed  wind_direction  air_pressure  \\\n",
       "0     3.670    10.915     9.965    4.550169      297.501335        1009.0   \n",
       "1     3.670    10.915     9.920    4.550169      297.501335        1009.0   \n",
       "2     3.305    10.225     8.145    4.519929      308.334994        1009.5   \n",
       "3     3.195     9.915     8.025    4.555980      308.667384        1009.5   \n",
       "4     1.425    10.260     8.765    4.571307      308.667384        1009.5   \n",
       "\n",
       "   humidity  visibility  predictability  \n",
       "0        39   12.064543              73  \n",
       "1        39   12.064543              73  \n",
       "2        51   12.064543              73  \n",
       "3        51   10.536902              73  \n",
       "4        47   12.849024              73  "
      ]
     },
     "execution_count": 45,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df = pd.read_json('out/practice.json')\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "EMKJCFDSkra7"
   },
   "source": [
    "## **18.3** *Чтение из баз данных с помощью pandas и sqlalchemy*\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "ZuBkQh8KkrbQ"
   },
   "source": [
    "В этом уроке мы научимся читать данные из разных баз данных и выполнять к ним запросы с помощью библиотеки **`pandas`**\n",
    "\n",
    "**План урока**\n",
    "* Подключение к базам данных с помощью Python\n",
    "* Чтение данных из БД с помощью Python и Pandas\n",
    "\n",
    "### Подключение к БД\n",
    "\n",
    "Существует несколько способов подключения к БД. Один из наиболее частых - подключение при помощи библиотек:\n",
    "* `sqlalchemy` - для создания подключения\n",
    "* `psycopg2` - как драйвер для PostgreSQL\\\n",
    "(мы будем работать с БД PostgreSQL)\n",
    "\n",
    "*- нужно установить эти библиотеки, если они ещё не установлены"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 46,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "Jc6AEE2xkrbR"
   },
   "outputs": [],
   "source": [
    "import sqlalchemy\n",
    "import psycopg2"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Для подключения к БД необходимо использовать функцию `create_engine` библиотеки `sqlalchemy`.\\\n",
    "В качестве обязательного параметра этой функции необходимо передать строку подключения.\\\n",
    "Эта строка определённого жёстко заданного формата. Разберём эту строку.\n",
    "\n",
    "- В начале строки указывается диалект языка SQL, который мы планируем использовать. В нашем случае это **PostgreSQL**.\n",
    "- Далее, после `+` указывается название драйвера, который мы используем для подключения. У нас это `psycopg2`.\\\n",
    "Драйвер указывать необязательно, если у вас в системе есть точно только один драйвер. Если же установлено несколько драйверов, то нужно обязательно указать конкретно драйвер.\\\n",
    "- После этого ставится `://`, далее пишется имя пользователя (`readonly`), `:` пароль (`6hajV34RTQfmxhS`).\n",
    "- Сам адрес СУБД пишется через `@`: `dsstudents.skillbox.ru`.\n",
    "- После адреса ставится `:` и указывается порт, на котором доступна БД: `5432`\\\n",
    "(Разные БД имею свои исторически сложившиеся порты, например для PostgreSQL - это 5432. Но часто бывает, что БД находится на каком-то другом порту. Поэтому, лучше всегда уточнять его).\n",
    "- После порта ставится слеш `/` и указывается название конкретной БД, к которой мы хотим подключиться: - `db_ds_students`\n",
    "\n",
    "Функция `create_engine` ждёт объект, который принято называть **`engine`**.\\\n",
    "Это отправная точка работы с БД, которя позволяет создавть отдельные подключения к БД, анализировать её структуру и т.д.\\\n",
    "Иными словами, **engine** содержит все действия, которые мы можем совершить с указанной БД.\\\n",
    "Теперь вызовем у этой переменной метод `connect`, чтобы создать объект подключения к БД и запишем этот объект в другую переменную."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "EeNJn18CkrbU"
   },
   "outputs": [],
   "source": [
    "conn = 'postgresql+psycopg2://readonly:6hajV34RTQfmxhS@dsstudents.skillbox.ru:5432/db_ds_students'\n",
    "\n",
    "engine = sqlalchemy.create_engine(conn) # создаём движок указанной БД\n",
    "connect = engine.connect() # создаём коннект к БД"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Итак, мы загрузили БД. Посмотрим теперь какие таблицы нам доступны в этой БД.\\\n",
    "Для анализа структуры БД используется функция `inspect` библиотеки `sqlalchemy`.\\\n",
    "Она принимает на вход **`enginge`** и возвращает объект `inspector`.\\\n",
    "Теперь, используя этот объект, мы можем получать детальную информацию о структуре БД.\\\n",
    "Например, вызовем метод `get_table_names` чтобы получить список доступных таблиц."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 48,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "2Ot0ihWEkrbW",
    "outputId": "fce4519b-5287-4795-fd1d-90db9b335345"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['keywords', 'links', 'ratings', 'exploratory', 'course_purchases', 'joi']"
      ]
     },
     "execution_count": 48,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "inspector = sqlalchemy.inspect(engine)\n",
    "inspector.get_table_names()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Итак, мы видим, что нам доступно 6 таблиц. Поработаем с таблицей `course_purchases`.\\\n",
    "По названию кажется что в ней содержатся сведения о покупке курсов. Убедимся в этом, загрузив её содержимое в **`pandas`** `DataFrame`.\\\n",
    "Для этого используем функцию `read_sql` из библиотеки **`pandas`**.\\\n",
    "Эта функция принимает два обязательных аргумента:\n",
    "1. Запрос к БД\n",
    "2. Объект подключения к БД, который мы создали ранее\n",
    "\n",
    "Вернёмся к запросу. Чтобы загрузить всё содержимое таблицы в датафрейм, нам нужно написать следующий запрос:\n",
    "`select * from course_purchases`"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 49,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "51811lzVkrbZ",
    "outputId": "8469df67-d3e0-4c68-b9b4-2c5c56178eea"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>user_id</th>\n",
       "      <th>course_id</th>\n",
       "      <th>purchase_date</th>\n",
       "      <th>purchase_place</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>user_id</td>\n",
       "      <td>course_id</td>\n",
       "      <td>purchase_date</td>\n",
       "      <td>purchase_place</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>ed5da480-57a2-489c-8e68-512155ab9892</td>\n",
       "      <td>fc082ec6-7721-4419-916b-06e4b560b50e</td>\n",
       "      <td>2019-03-22</td>\n",
       "      <td>Екатеринбург</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>7ba07e70-f76a-4bbc-9b5d-34265f4f7638</td>\n",
       "      <td>66583e42-987a-4c38-b168-e5ee4772a627</td>\n",
       "      <td>2018-10-28</td>\n",
       "      <td>Курганинск</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>7ba07e70-f76a-4bbc-9b5d-34265f4f7638</td>\n",
       "      <td>b45874ec-57c7-41e7-a38c-580330a23f50</td>\n",
       "      <td>2019-04-06</td>\n",
       "      <td>Владивосток</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>8b1752da-599d-413a-a2e9-bc75387b2be9</td>\n",
       "      <td>2d98baac-eb91-4285-99e1-bee66018cd25</td>\n",
       "      <td>2019-03-23</td>\n",
       "      <td>Владивосток</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>3e3b7b84-65f0-4152-815a-730bec31bb9d</td>\n",
       "      <td>83982097-8179-4ba2-affa-f8aef42fc070</td>\n",
       "      <td>2019-03-25</td>\n",
       "      <td>Катайск</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>3e3b7b84-65f0-4152-815a-730bec31bb9d</td>\n",
       "      <td>71a3a64e-b0ec-40ac-9952-a9833900a48e</td>\n",
       "      <td>2019-02-25</td>\n",
       "      <td>Североуральск</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>8c390b6e-a490-44ac-b974-f5dec7f6970b</td>\n",
       "      <td>b45874ec-57c7-41e7-a38c-580330a23f50</td>\n",
       "      <td>2019-03-06</td>\n",
       "      <td>Сочи</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>8c390b6e-a490-44ac-b974-f5dec7f6970b</td>\n",
       "      <td>34bfd77d-4ddd-411b-af91-6d2f92dfb8ce</td>\n",
       "      <td>2019-03-26</td>\n",
       "      <td>Владивосток</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>1affa6e8-1e05-4728-96ed-dd471f9552d1</td>\n",
       "      <td>590078fa-1cd7-4a1c-b184-839d79f9c54a</td>\n",
       "      <td>2019-02-16</td>\n",
       "      <td>Александровск-Сахалинский</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                user_id                             course_id  \\\n",
       "0                               user_id                             course_id   \n",
       "1  ed5da480-57a2-489c-8e68-512155ab9892  fc082ec6-7721-4419-916b-06e4b560b50e   \n",
       "2  7ba07e70-f76a-4bbc-9b5d-34265f4f7638  66583e42-987a-4c38-b168-e5ee4772a627   \n",
       "3  7ba07e70-f76a-4bbc-9b5d-34265f4f7638  b45874ec-57c7-41e7-a38c-580330a23f50   \n",
       "4  8b1752da-599d-413a-a2e9-bc75387b2be9  2d98baac-eb91-4285-99e1-bee66018cd25   \n",
       "5  3e3b7b84-65f0-4152-815a-730bec31bb9d  83982097-8179-4ba2-affa-f8aef42fc070   \n",
       "6  3e3b7b84-65f0-4152-815a-730bec31bb9d  71a3a64e-b0ec-40ac-9952-a9833900a48e   \n",
       "7  8c390b6e-a490-44ac-b974-f5dec7f6970b  b45874ec-57c7-41e7-a38c-580330a23f50   \n",
       "8  8c390b6e-a490-44ac-b974-f5dec7f6970b  34bfd77d-4ddd-411b-af91-6d2f92dfb8ce   \n",
       "9  1affa6e8-1e05-4728-96ed-dd471f9552d1  590078fa-1cd7-4a1c-b184-839d79f9c54a   \n",
       "\n",
       "   purchase_date             purchase_place  \n",
       "0  purchase_date             purchase_place  \n",
       "1     2019-03-22               Екатеринбург  \n",
       "2     2018-10-28                 Курганинск  \n",
       "3     2019-04-06                Владивосток  \n",
       "4     2019-03-23                Владивосток  \n",
       "5     2019-03-25                    Катайск  \n",
       "6     2019-02-25              Североуральск  \n",
       "7     2019-03-06                       Сочи  \n",
       "8     2019-03-26                Владивосток  \n",
       "9     2019-02-16  Александровск-Сахалинский  "
      ]
     },
     "execution_count": 49,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df = pd.read_sql(\"select * from course_purchases\", connect)\n",
    "df.head(10)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Заголовок продублировался. Наверно, так было в изначальной БД. Но мы можем это быстро поправить."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 50,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "bbnc1Ozykrbb",
    "outputId": "c0777553-9e36-4275-abce-2c3a12a29831"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>user_id</th>\n",
       "      <th>course_id</th>\n",
       "      <th>purchase_date</th>\n",
       "      <th>purchase_place</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>ed5da480-57a2-489c-8e68-512155ab9892</td>\n",
       "      <td>fc082ec6-7721-4419-916b-06e4b560b50e</td>\n",
       "      <td>2019-03-22</td>\n",
       "      <td>Екатеринбург</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>7ba07e70-f76a-4bbc-9b5d-34265f4f7638</td>\n",
       "      <td>66583e42-987a-4c38-b168-e5ee4772a627</td>\n",
       "      <td>2018-10-28</td>\n",
       "      <td>Курганинск</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>7ba07e70-f76a-4bbc-9b5d-34265f4f7638</td>\n",
       "      <td>b45874ec-57c7-41e7-a38c-580330a23f50</td>\n",
       "      <td>2019-04-06</td>\n",
       "      <td>Владивосток</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>8b1752da-599d-413a-a2e9-bc75387b2be9</td>\n",
       "      <td>2d98baac-eb91-4285-99e1-bee66018cd25</td>\n",
       "      <td>2019-03-23</td>\n",
       "      <td>Владивосток</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>3e3b7b84-65f0-4152-815a-730bec31bb9d</td>\n",
       "      <td>83982097-8179-4ba2-affa-f8aef42fc070</td>\n",
       "      <td>2019-03-25</td>\n",
       "      <td>Катайск</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>149</th>\n",
       "      <td>395ab5c0-e2f1-4644-974e-29fa4f821b0e</td>\n",
       "      <td>8fba0f0c-e887-4090-84dd-121712a5b86b</td>\n",
       "      <td>2019-04-04</td>\n",
       "      <td>Санкт-Петербург</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>150</th>\n",
       "      <td>1b681fe4-5c5a-4c60-b0a3-24241374df95</td>\n",
       "      <td>f6cc4782-0ec5-4741-8c32-6fec0ad6f14b</td>\n",
       "      <td>2018-05-30</td>\n",
       "      <td>Москва</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>151</th>\n",
       "      <td>1b681fe4-5c5a-4c60-b0a3-24241374df95</td>\n",
       "      <td>3cc8041e-ac78-4c27-899f-c204427d3f63</td>\n",
       "      <td>2019-01-04</td>\n",
       "      <td>Южно-Курильск</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>152</th>\n",
       "      <td>9fc78a49-22bc-4c21-9ee7-1444030c371a</td>\n",
       "      <td>fe32d4f8-9272-4be2-8a74-da8ef0c2bad8</td>\n",
       "      <td>2018-11-17</td>\n",
       "      <td>Пермь</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>153</th>\n",
       "      <td>3e585c7d-52f7-4718-a324-71a5fec75a47</td>\n",
       "      <td>bdd8cac0-4003-4b22-ab71-9d3272a14121</td>\n",
       "      <td>2018-12-01</td>\n",
       "      <td>Москва</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>153 rows × 4 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                  user_id  \\\n",
       "1    ed5da480-57a2-489c-8e68-512155ab9892   \n",
       "2    7ba07e70-f76a-4bbc-9b5d-34265f4f7638   \n",
       "3    7ba07e70-f76a-4bbc-9b5d-34265f4f7638   \n",
       "4    8b1752da-599d-413a-a2e9-bc75387b2be9   \n",
       "5    3e3b7b84-65f0-4152-815a-730bec31bb9d   \n",
       "..                                    ...   \n",
       "149  395ab5c0-e2f1-4644-974e-29fa4f821b0e   \n",
       "150  1b681fe4-5c5a-4c60-b0a3-24241374df95   \n",
       "151  1b681fe4-5c5a-4c60-b0a3-24241374df95   \n",
       "152  9fc78a49-22bc-4c21-9ee7-1444030c371a   \n",
       "153  3e585c7d-52f7-4718-a324-71a5fec75a47   \n",
       "\n",
       "                                course_id purchase_date   purchase_place  \n",
       "1    fc082ec6-7721-4419-916b-06e4b560b50e    2019-03-22     Екатеринбург  \n",
       "2    66583e42-987a-4c38-b168-e5ee4772a627    2018-10-28       Курганинск  \n",
       "3    b45874ec-57c7-41e7-a38c-580330a23f50    2019-04-06      Владивосток  \n",
       "4    2d98baac-eb91-4285-99e1-bee66018cd25    2019-03-23      Владивосток  \n",
       "5    83982097-8179-4ba2-affa-f8aef42fc070    2019-03-25          Катайск  \n",
       "..                                    ...           ...              ...  \n",
       "149  8fba0f0c-e887-4090-84dd-121712a5b86b    2019-04-04  Санкт-Петербург  \n",
       "150  f6cc4782-0ec5-4741-8c32-6fec0ad6f14b    2018-05-30           Москва  \n",
       "151  3cc8041e-ac78-4c27-899f-c204427d3f63    2019-01-04    Южно-Курильск  \n",
       "152  fe32d4f8-9272-4be2-8a74-da8ef0c2bad8    2018-11-17            Пермь  \n",
       "153  bdd8cac0-4003-4b22-ab71-9d3272a14121    2018-12-01           Москва  \n",
       "\n",
       "[153 rows x 4 columns]"
      ]
     },
     "execution_count": 50,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df = df.iloc[1:,:]\n",
    "df"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Теперь попробуем сделать более сложный запрос с группировкой. Например, посмотрим, сколько курсов было куплено в каждом городе.\\\n",
    "Мы можем сделать это двумя способами:\n",
    "1. Прямо в **`pandas`**.\\\n",
    "Для этого у нас уже есть загруженный датафрейм. Используем метод `groupby` по городу и посчитаем количество курсов, проданных в каждом городе с помощью метода `count`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 51,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "uoo0F5JYkrbf",
    "outputId": "d01bd06c-e65d-41a3-a861-0f90e62723a0",
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "purchase_place\n",
       "Алдан                         1\n",
       "Александровск-Сахалинский     1\n",
       "Ангарск                       1\n",
       "Анива                         1\n",
       "Арзамас                       1\n",
       "Аршан (Бурят.)                1\n",
       "Асбест                        1\n",
       "Аша                           1\n",
       "Белогорск (Амур.)             1\n",
       "Биробиджан                    1\n",
       "Верхний Баскунчак             1\n",
       "Владивосток                  25\n",
       "Волхов                        1\n",
       "Гаврилов-Ям                   1\n",
       "Диксон                        1\n",
       "Екатеринбург                 15\n",
       "Зеленогорск (Ленин.)          1\n",
       "Златоуст                      1\n",
       "Карабудахкент                 1\n",
       "Катайск                       1\n",
       "Качканар                      1\n",
       "Колпашево                     2\n",
       "Костомукша                    1\n",
       "Крымск                        1\n",
       "Курганинск                    1\n",
       "Минусинск                     1\n",
       "Москва                       30\n",
       "Нефтеюганск                   1\n",
       "Орел                          1\n",
       "Орск                          1\n",
       "Павловский Посад              1\n",
       "Пермь                         1\n",
       "Печора                        1\n",
       "Рославль                      1\n",
       "Санкт-Петербург              19\n",
       "Саратов                       1\n",
       "Сасово                        1\n",
       "Североуральск                 1\n",
       "Сосногорск                    1\n",
       "Сочи                         20\n",
       "Тольятти                      1\n",
       "Троицк (Моск.)                1\n",
       "Тымовское                     1\n",
       "Усть-Кулом                    1\n",
       "Хужир                         1\n",
       "Шатки                         1\n",
       "Шенкурск                      1\n",
       "Южно-Курильск                 1\n",
       "Name: course_id, dtype: int64"
      ]
     },
     "execution_count": 51,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.groupby('purchase_place')['course_id'].count()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Второй способ заключается в том, чтобы с помощью **SQL** привести все необходимые группировки и потом скачать уже подготовленные данные.\\\n",
    "Попробуем это сделать.\\\n",
    "Снова используем метод `read_sql` чтобы выполнить запрос к БД, но вместо простого `SELECT` выполним запрос с группировкой.\\\n",
    "Выглядеть этот запрос будет так:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 52,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "XABpL_E3krbi",
    "outputId": "56e75d8f-1f1a-424f-94eb-314453704a57"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>purchase_place</th>\n",
       "      <th>count</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Асбест</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Александровск-Сахалинский</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Костомукша</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Орел</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Саратов</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>Зеленогорск (Ленин.)</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>Минусинск</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>Печора</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>Катайск</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>Павловский Посад</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "              purchase_place  count\n",
       "0                     Асбест      1\n",
       "1  Александровск-Сахалинский      1\n",
       "2                 Костомукша      1\n",
       "3                       Орел      1\n",
       "4                    Саратов      1\n",
       "5       Зеленогорск (Ленин.)      1\n",
       "6                  Минусинск      1\n",
       "7                     Печора      1\n",
       "8                    Катайск      1\n",
       "9           Павловский Посад      1"
      ]
     },
     "execution_count": 52,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df = pd.read_sql(\"select purchase_place, count(course_id) from course_purchases group by purchase_place\", connect)\n",
    "df.head(10)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Мы получили такой же датафрейм. Оба способа приводят к одному и тому же рельутату. Так каким же способом лучше пользоваться?\\\n",
    "Всё зависит от размера данных, которые вы хотите загрузить из БД. Если данных не много, и они помещаются в оперативную память компьютера, то можно пользоваться первым способом. Т.е. сначала загрузить данные в датафрейм, почистить их, а затем преобразовывать.\\\n",
    "Если же данных много и они не помещаются в памяти, или нужно проводить какие-то сложные группировки или объединения таблиц, тогда имеет смысл сначала подготовить данные в **SQL**, а затем загрузить в датафрейм уже готовые данные.\n",
    "\n",
    "### Итоги\n",
    "\n",
    "На этом уроке мы узнали:\n",
    "* Как подключиться к БД\\\n",
    "Используя библиотеки `sqlalchemy` и `psycopg2`\n",
    "* Научились загружать данные из таблицы БД в **`pandas`** `DataFrame`\n",
    "* Разобрали, в каких случаях предпочтительнее проводить обработку данных в СУБД,\\\n",
    "а в каких можно загружать данные целиком и обрабатывать их с помощью **`pandas`**"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "aRCcWdnV_Y5E"
   },
   "source": [
    "### Практика\n",
    "\n",
    "#### Задание 1\n",
    "\n",
    "Подключитесь к базе данных, загрузите содержимое таблицы `course_purchases` в DataFrame и выведите первые 10 строк на экран."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 56,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "AN0QBySk_Y5I"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>user_id</th>\n",
       "      <th>course_id</th>\n",
       "      <th>purchase_date</th>\n",
       "      <th>purchase_place</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>ed5da480-57a2-489c-8e68-512155ab9892</td>\n",
       "      <td>fc082ec6-7721-4419-916b-06e4b560b50e</td>\n",
       "      <td>2019-03-22</td>\n",
       "      <td>Екатеринбург</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>7ba07e70-f76a-4bbc-9b5d-34265f4f7638</td>\n",
       "      <td>66583e42-987a-4c38-b168-e5ee4772a627</td>\n",
       "      <td>2018-10-28</td>\n",
       "      <td>Курганинск</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>7ba07e70-f76a-4bbc-9b5d-34265f4f7638</td>\n",
       "      <td>b45874ec-57c7-41e7-a38c-580330a23f50</td>\n",
       "      <td>2019-04-06</td>\n",
       "      <td>Владивосток</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>8b1752da-599d-413a-a2e9-bc75387b2be9</td>\n",
       "      <td>2d98baac-eb91-4285-99e1-bee66018cd25</td>\n",
       "      <td>2019-03-23</td>\n",
       "      <td>Владивосток</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>3e3b7b84-65f0-4152-815a-730bec31bb9d</td>\n",
       "      <td>83982097-8179-4ba2-affa-f8aef42fc070</td>\n",
       "      <td>2019-03-25</td>\n",
       "      <td>Катайск</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>3e3b7b84-65f0-4152-815a-730bec31bb9d</td>\n",
       "      <td>71a3a64e-b0ec-40ac-9952-a9833900a48e</td>\n",
       "      <td>2019-02-25</td>\n",
       "      <td>Североуральск</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>8c390b6e-a490-44ac-b974-f5dec7f6970b</td>\n",
       "      <td>b45874ec-57c7-41e7-a38c-580330a23f50</td>\n",
       "      <td>2019-03-06</td>\n",
       "      <td>Сочи</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>8c390b6e-a490-44ac-b974-f5dec7f6970b</td>\n",
       "      <td>34bfd77d-4ddd-411b-af91-6d2f92dfb8ce</td>\n",
       "      <td>2019-03-26</td>\n",
       "      <td>Владивосток</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>1affa6e8-1e05-4728-96ed-dd471f9552d1</td>\n",
       "      <td>590078fa-1cd7-4a1c-b184-839d79f9c54a</td>\n",
       "      <td>2019-02-16</td>\n",
       "      <td>Александровск-Сахалинский</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>f7006ad5-9ecd-4606-a8ee-9c730baeb000</td>\n",
       "      <td>187e1d34-1d4b-4ded-8f40-8425974e25d6</td>\n",
       "      <td>2019-01-20</td>\n",
       "      <td>Сочи</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                 user_id  \\\n",
       "1   ed5da480-57a2-489c-8e68-512155ab9892   \n",
       "2   7ba07e70-f76a-4bbc-9b5d-34265f4f7638   \n",
       "3   7ba07e70-f76a-4bbc-9b5d-34265f4f7638   \n",
       "4   8b1752da-599d-413a-a2e9-bc75387b2be9   \n",
       "5   3e3b7b84-65f0-4152-815a-730bec31bb9d   \n",
       "6   3e3b7b84-65f0-4152-815a-730bec31bb9d   \n",
       "7   8c390b6e-a490-44ac-b974-f5dec7f6970b   \n",
       "8   8c390b6e-a490-44ac-b974-f5dec7f6970b   \n",
       "9   1affa6e8-1e05-4728-96ed-dd471f9552d1   \n",
       "10  f7006ad5-9ecd-4606-a8ee-9c730baeb000   \n",
       "\n",
       "                               course_id purchase_date  \\\n",
       "1   fc082ec6-7721-4419-916b-06e4b560b50e    2019-03-22   \n",
       "2   66583e42-987a-4c38-b168-e5ee4772a627    2018-10-28   \n",
       "3   b45874ec-57c7-41e7-a38c-580330a23f50    2019-04-06   \n",
       "4   2d98baac-eb91-4285-99e1-bee66018cd25    2019-03-23   \n",
       "5   83982097-8179-4ba2-affa-f8aef42fc070    2019-03-25   \n",
       "6   71a3a64e-b0ec-40ac-9952-a9833900a48e    2019-02-25   \n",
       "7   b45874ec-57c7-41e7-a38c-580330a23f50    2019-03-06   \n",
       "8   34bfd77d-4ddd-411b-af91-6d2f92dfb8ce    2019-03-26   \n",
       "9   590078fa-1cd7-4a1c-b184-839d79f9c54a    2019-02-16   \n",
       "10  187e1d34-1d4b-4ded-8f40-8425974e25d6    2019-01-20   \n",
       "\n",
       "               purchase_place  \n",
       "1                Екатеринбург  \n",
       "2                  Курганинск  \n",
       "3                 Владивосток  \n",
       "4                 Владивосток  \n",
       "5                     Катайск  \n",
       "6               Североуральск  \n",
       "7                        Сочи  \n",
       "8                 Владивосток  \n",
       "9   Александровск-Сахалинский  \n",
       "10                       Сочи  "
      ]
     },
     "execution_count": 56,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "conn = 'postgresql+psycopg2://readonly:6hajV34RTQfmxhS@dsstudents.skillbox.ru:5432/db_ds_students'\n",
    "\n",
    "engine = sqlalchemy.create_engine(conn)\n",
    "connect = engine.connect()\n",
    "\n",
    "df = pd.read_sql(\"select * from course_purchases\", connect).iloc[1:,:]\n",
    "df.head(10)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "0htcnwRb_Y5V"
   },
   "source": [
    "#### Задание 2\n",
    "\n",
    "Используя DataFrame из предыдущего задания, определите для каждого курса количество пользователей, купивших его. Подсказка: используйте метод groupby."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 57,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "paPpxP0L_Y5Y",
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "course_id\n",
       "0172e898-7ddf-4ce9-ae0f-3c26ce949141    2\n",
       "0722fb94-7c6b-41fd-98ea-d4cab87f3655    3\n",
       "0d0d9bbc-c451-41a0-983e-0733046044de    2\n",
       "187e1d34-1d4b-4ded-8f40-8425974e25d6    3\n",
       "196cd844-ffcd-4694-8b94-2983421ddb87    3\n",
       "215c9f43-6046-454b-9f82-e1992f835227    4\n",
       "2466d92a-2a30-4edc-bb8d-bcc2a3891099    3\n",
       "2d98baac-eb91-4285-99e1-bee66018cd25    4\n",
       "31bfef7f-5310-4256-a097-a9c4243654ff    1\n",
       "34bfd77d-4ddd-411b-af91-6d2f92dfb8ce    5\n",
       "3c580c86-9f15-4730-9578-1aca7d19a8ca    2\n",
       "3cc8041e-ac78-4c27-899f-c204427d3f63    4\n",
       "3d2c9fe4-5659-4457-bfd8-6aef1f516374    2\n",
       "44ec7db3-07ab-4b9d-aaef-4b52684510ea    1\n",
       "46ee2954-ec65-4b53-af1e-4a7c7d318873    2\n",
       "493b245c-c7e6-4134-8b58-3264971e097e    9\n",
       "590078fa-1cd7-4a1c-b184-839d79f9c54a    8\n",
       "5b58a4ab-9950-4bdf-bc4d-16225adead8a    8\n",
       "625cd518-8a6f-4bef-9326-10a7e3f9417c    4\n",
       "66583e42-987a-4c38-b168-e5ee4772a627    4\n",
       "71a3a64e-b0ec-40ac-9952-a9833900a48e    1\n",
       "72ddec62-3821-4c9e-a8dd-29e05e7a3210    5\n",
       "83982097-8179-4ba2-affa-f8aef42fc070    3\n",
       "846231ae-5a86-4218-bb3b-d7bb9640d3f1    5\n",
       "86a06a55-2da2-4a37-9a6e-742ba4841fca    4\n",
       "8e730d61-1924-419f-9c0a-c6b7d9688114    4\n",
       "8fba0f0c-e887-4090-84dd-121712a5b86b    1\n",
       "96dcf479-8f6c-4953-804b-a4f2f9c1e2ca    7\n",
       "a1307f0a-70c1-40ca-b868-76c428250e02    2\n",
       "b45874ec-57c7-41e7-a38c-580330a23f50    6\n",
       "b96f0a37-6a38-45cb-9bcf-5940a06d877f    1\n",
       "bdd8cac0-4003-4b22-ab71-9d3272a14121    2\n",
       "d5720be9-13be-4a66-8d0a-c180099537d2    4\n",
       "d575090d-7dc1-4413-98bc-eef102fc79d2    2\n",
       "e4a731c1-67d4-4fe1-a908-4a84dd7db821    2\n",
       "f384577d-759e-4dd4-84ab-51cbd929a7af    3\n",
       "f48a7fc7-40ae-4ede-ab9d-aac7c833c8af    4\n",
       "f6cc4782-0ec5-4741-8c32-6fec0ad6f14b    4\n",
       "f716b7b6-90af-4b0a-998b-b382beadcfc1    3\n",
       "f7d37ce8-2388-4b10-8a7e-55fbd763a5a9    5\n",
       "fc082ec6-7721-4419-916b-06e4b560b50e    7\n",
       "fe32d4f8-9272-4be2-8a74-da8ef0c2bad8    3\n",
       "ff8101ba-a43d-404b-bfeb-a4e5ae4a3dfc    1\n",
       "Name: user_id, dtype: int64"
      ]
     },
     "execution_count": 57,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df.groupby('course_id').user_id.count()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "KMzH2sXZ_Y5i"
   },
   "source": [
    "#### Задание 3. \n",
    "\n",
    "Используя SQL-запрос с группировкой (GROUP BY), определите для каждого курса количество пользователей, купивших его. Результат запроса загрузите в DataFrame и выведите первые 10 строк на экран."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 62,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "Z2lJnyQ5_Y5k",
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>course_id</th>\n",
       "      <th>count</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>fe32d4f8-9272-4be2-8a74-da8ef0c2bad8</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>f716b7b6-90af-4b0a-998b-b382beadcfc1</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>b45874ec-57c7-41e7-a38c-580330a23f50</td>\n",
       "      <td>6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>96dcf479-8f6c-4953-804b-a4f2f9c1e2ca</td>\n",
       "      <td>7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>f6cc4782-0ec5-4741-8c32-6fec0ad6f14b</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>ff8101ba-a43d-404b-bfeb-a4e5ae4a3dfc</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>b96f0a37-6a38-45cb-9bcf-5940a06d877f</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>0d0d9bbc-c451-41a0-983e-0733046044de</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>196cd844-ffcd-4694-8b94-2983421ddb87</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>8e730d61-1924-419f-9c0a-c6b7d9688114</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>66583e42-987a-4c38-b168-e5ee4772a627</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>215c9f43-6046-454b-9f82-e1992f835227</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>590078fa-1cd7-4a1c-b184-839d79f9c54a</td>\n",
       "      <td>8</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>31bfef7f-5310-4256-a097-a9c4243654ff</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>86a06a55-2da2-4a37-9a6e-742ba4841fca</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>f48a7fc7-40ae-4ede-ab9d-aac7c833c8af</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>fc082ec6-7721-4419-916b-06e4b560b50e</td>\n",
       "      <td>7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>3c580c86-9f15-4730-9578-1aca7d19a8ca</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>44ec7db3-07ab-4b9d-aaef-4b52684510ea</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>34bfd77d-4ddd-411b-af91-6d2f92dfb8ce</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>0172e898-7ddf-4ce9-ae0f-3c26ce949141</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>187e1d34-1d4b-4ded-8f40-8425974e25d6</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>d5720be9-13be-4a66-8d0a-c180099537d2</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>46ee2954-ec65-4b53-af1e-4a7c7d318873</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>625cd518-8a6f-4bef-9326-10a7e3f9417c</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>71a3a64e-b0ec-40ac-9952-a9833900a48e</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>a1307f0a-70c1-40ca-b868-76c428250e02</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>2466d92a-2a30-4edc-bb8d-bcc2a3891099</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>5b58a4ab-9950-4bdf-bc4d-16225adead8a</td>\n",
       "      <td>8</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>30</th>\n",
       "      <td>2d98baac-eb91-4285-99e1-bee66018cd25</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31</th>\n",
       "      <td>3cc8041e-ac78-4c27-899f-c204427d3f63</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32</th>\n",
       "      <td>f7d37ce8-2388-4b10-8a7e-55fbd763a5a9</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>33</th>\n",
       "      <td>bdd8cac0-4003-4b22-ab71-9d3272a14121</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>34</th>\n",
       "      <td>e4a731c1-67d4-4fe1-a908-4a84dd7db821</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35</th>\n",
       "      <td>3d2c9fe4-5659-4457-bfd8-6aef1f516374</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>36</th>\n",
       "      <td>8fba0f0c-e887-4090-84dd-121712a5b86b</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>37</th>\n",
       "      <td>f384577d-759e-4dd4-84ab-51cbd929a7af</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>38</th>\n",
       "      <td>0722fb94-7c6b-41fd-98ea-d4cab87f3655</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>39</th>\n",
       "      <td>83982097-8179-4ba2-affa-f8aef42fc070</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>40</th>\n",
       "      <td>72ddec62-3821-4c9e-a8dd-29e05e7a3210</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>41</th>\n",
       "      <td>846231ae-5a86-4218-bb3b-d7bb9640d3f1</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>42</th>\n",
       "      <td>493b245c-c7e6-4134-8b58-3264971e097e</td>\n",
       "      <td>9</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>43</th>\n",
       "      <td>d575090d-7dc1-4413-98bc-eef102fc79d2</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                               course_id  count\n",
       "0   fe32d4f8-9272-4be2-8a74-da8ef0c2bad8      3\n",
       "1   f716b7b6-90af-4b0a-998b-b382beadcfc1      3\n",
       "2   b45874ec-57c7-41e7-a38c-580330a23f50      6\n",
       "3   96dcf479-8f6c-4953-804b-a4f2f9c1e2ca      7\n",
       "4   f6cc4782-0ec5-4741-8c32-6fec0ad6f14b      4\n",
       "5   ff8101ba-a43d-404b-bfeb-a4e5ae4a3dfc      1\n",
       "6   b96f0a37-6a38-45cb-9bcf-5940a06d877f      1\n",
       "7   0d0d9bbc-c451-41a0-983e-0733046044de      2\n",
       "8   196cd844-ffcd-4694-8b94-2983421ddb87      3\n",
       "9   8e730d61-1924-419f-9c0a-c6b7d9688114      4\n",
       "10  66583e42-987a-4c38-b168-e5ee4772a627      4\n",
       "11  215c9f43-6046-454b-9f82-e1992f835227      4\n",
       "12  590078fa-1cd7-4a1c-b184-839d79f9c54a      8\n",
       "13  31bfef7f-5310-4256-a097-a9c4243654ff      1\n",
       "14  86a06a55-2da2-4a37-9a6e-742ba4841fca      4\n",
       "15  f48a7fc7-40ae-4ede-ab9d-aac7c833c8af      4\n",
       "16  fc082ec6-7721-4419-916b-06e4b560b50e      7\n",
       "17  3c580c86-9f15-4730-9578-1aca7d19a8ca      2\n",
       "18  44ec7db3-07ab-4b9d-aaef-4b52684510ea      1\n",
       "19  34bfd77d-4ddd-411b-af91-6d2f92dfb8ce      5\n",
       "20  0172e898-7ddf-4ce9-ae0f-3c26ce949141      2\n",
       "21  187e1d34-1d4b-4ded-8f40-8425974e25d6      3\n",
       "22  d5720be9-13be-4a66-8d0a-c180099537d2      4\n",
       "23  46ee2954-ec65-4b53-af1e-4a7c7d318873      2\n",
       "24  625cd518-8a6f-4bef-9326-10a7e3f9417c      4\n",
       "25  71a3a64e-b0ec-40ac-9952-a9833900a48e      1\n",
       "26  a1307f0a-70c1-40ca-b868-76c428250e02      2\n",
       "28  2466d92a-2a30-4edc-bb8d-bcc2a3891099      3\n",
       "29  5b58a4ab-9950-4bdf-bc4d-16225adead8a      8\n",
       "30  2d98baac-eb91-4285-99e1-bee66018cd25      4\n",
       "31  3cc8041e-ac78-4c27-899f-c204427d3f63      4\n",
       "32  f7d37ce8-2388-4b10-8a7e-55fbd763a5a9      5\n",
       "33  bdd8cac0-4003-4b22-ab71-9d3272a14121      2\n",
       "34  e4a731c1-67d4-4fe1-a908-4a84dd7db821      2\n",
       "35  3d2c9fe4-5659-4457-bfd8-6aef1f516374      2\n",
       "36  8fba0f0c-e887-4090-84dd-121712a5b86b      1\n",
       "37  f384577d-759e-4dd4-84ab-51cbd929a7af      3\n",
       "38  0722fb94-7c6b-41fd-98ea-d4cab87f3655      3\n",
       "39  83982097-8179-4ba2-affa-f8aef42fc070      3\n",
       "40  72ddec62-3821-4c9e-a8dd-29e05e7a3210      5\n",
       "41  846231ae-5a86-4218-bb3b-d7bb9640d3f1      5\n",
       "42  493b245c-c7e6-4134-8b58-3264971e097e      9\n",
       "43  d575090d-7dc1-4413-98bc-eef102fc79d2      2"
      ]
     },
     "execution_count": 62,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df = pd.read_sql(\"select course_id, count(user_id) from course_purchases group by course_id\", connect)\n",
    "df = df[df.course_id != 'course_id'] # отфильтруем строку 27, которая дублирует заголовок (изначально первая строка)\n",
    "df"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "s7BsZ775lFce"
   },
   "source": [
    "## **18.4** *Работа с большими данными - MongoDB*\n",
    "\n",
    "В этом уроке мы познакомимся с нереляционной БД **MongoDB**\n",
    "\n",
    "**План урока**\n",
    "* Что такое большие данные.\\\n",
    "Чем они отличаются от других данных\n",
    "* Как подключиться к **MongoDB** с помощью Python\n",
    "* Как читать данные из **MongoDB**\n",
    "* Выполнять различные запросы к **MongoDB**\n",
    "\n",
    "### Что такое большие данные\n",
    "\n",
    "**Big Data** - это разнообразные структурированные и неструктурированные данные большого объёма, требующие быстрой обработки.\n",
    "\n",
    "Из этого определения можно выделить три свойства BD, т.н. **\"V3\"**:\n",
    "* **Объём (Volume)**.\\\n",
    "Размер больших данных, который варьируется от гигабайта до терабайта и более\n",
    "* **Скорость (Velocity)**.\\\n",
    "Система обработки больших данных должна быть достаточно быстрой, чтобы обрабатывать поступающие данные почти в режиме реального времени\n",
    "* **Разнообразие (Variety)**.\\\n",
    "Данные могут быть классифицированы по различным типам.\\\n",
    "Оптимальная система обработки больших данных должна предоставлять функции для\\\n",
    "манипулирования этими данными без дополнительных действий со стороны клиента.\n",
    "\n",
    "Наример, **MongoDB** поддерживает операции с геолокацией: таких, как поиск известных точек вблизи координат, указанных в запросе.\n",
    "\n",
    "### Что такое **MongoDB**\n",
    "\n",
    "**MongoDB** - это очень гибкая и масштабируемая **документоориентированная** система управления базами данных.\\\n",
    "Документоориентированная означает что такие БД в отличие от стандартных реляционных оперируют не строками или таблицами, а документами и коллекциями документов.\\\n",
    "Фактически, каждый документ можно рассматривать как объект формата JSON.\\\n",
    "Отличие документа от таблицы в том, что в документе набор полей жёстко не ограничен, т.е. потенциально в каждом документе может быть свой набор полей. И все эти документы могут находиться в одной коллекции.\\\n",
    "Также, **MongoDB** поддерживает все три свойства больших данных."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "g2QMJBmzlFcx"
   },
   "source": [
    "### Подключение к MongoDB\n",
    "\n",
    "Для подключения нам понадобится библиотека `pymongo` (тоже требует установки)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 63,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "oYgugG4-lFcx"
   },
   "outputs": [],
   "source": [
    "import pymongo"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "В начале, мы указывает название диалекта.\\\n",
    "Поскольку у нас в системе есть только один драйвер подключения, который был установлен вместе с библиотекой 'pymongo', то мы можем его не указывать.\\\n",
    "Далее вводим - имя пользователя : пароль @ хост : порт.\n",
    "Для **MongoDB** стандартный порт 27017, но всегда уточняйте этот момент.\\\n",
    "При подключении к **MongoDB** название БД указывают немного по-другому: ещё пишут после параметра `?authSource=`.\n",
    "\n",
    "Теперь создадим подключение к **MongoDB**.\\\n",
    "Для этого создадим экземпляр класса `MongoClient`, а в конструктор класса передадим строку подключения. И запишем экземпляр клиента в переменную `connect`.\\\n",
    "Для того, чтобы работать с конкретной базой, нужно обратиться к клиенту как к словарю и передать название требуемой БД как ключ.\n",
    "Запишем результат в новую переменную `db`:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 65,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "geTLPMSHlFc1"
   },
   "outputs": [],
   "source": [
    "conn = 'mongodb://students:X63673t47Gl03Sq@dsstudents.skillbox.ru:27017/?authSource=movies'\n",
    "\n",
    "connect = pymongo.MongoClient(conn)\n",
    "db = connect['movies']"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Теперь посмотрим какие коллекции в этой базе нам доступны. Для этого вызвать метод `list_collection_names` у объекта db"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 66,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "ua979i-tlFc4",
    "outputId": "f2991a9c-6859-419e-ba1a-e98a7a67a641"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['tags', 'users']"
      ]
     },
     "execution_count": 66,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "db.list_collection_names()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Нам доступны коллекции `users` и `tags`. Мы будем работать в этом уроке только с коллекцией `tags`.\\\n",
    "Создадим отдельную переменную под эту коллекцию. Чтобы было проще работать"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 80,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "vTqXplbWlFc7"
   },
   "outputs": [],
   "source": [
    "tags = db['tags']"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Мы создали переменную tags в коллекции `tags`. Теперь посмотрим на документы, записанные в этой коллекции.\n",
    "Мы можем посомотреть на превый документ вызвав у коллекции метод `find_one`"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 81,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "zXC4lL3plFdC",
    "outputId": "18af7dcc-556d-42b8-f4ba-e312748daaf7"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'_id': ObjectId('5c822402c0669da98bd5081e'), 'id': 931, 'name': 'jealousy'}"
      ]
     },
     "execution_count": 81,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tags.find_one()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Мы видим документ в формате JSON, содержащий три поля:\n",
    "1. `_id` - это внутренний идентификатор документа в БД\n",
    "2. `id` - это идентификатор тэга\n",
    "3. `name` - имя тэга\n",
    "\n",
    "Теперь посчитаем сколько документов содержится в коллекции. Для этого вызовем метод `find`, а после него вызовем метод `count`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 83,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "bb2G0PW-lFdF",
    "outputId": "c63d4813-21e0-4604-c547-e60067374ecf"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "158680"
      ]
     },
     "execution_count": 83,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tags.estimated_document_count()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 85,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "m4qWMlFOlFc9",
    "outputId": "824c57b9-f72c-4e65-b456-0f4a6817e1f8"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "100"
      ]
     },
     "execution_count": 85,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "users = db['users']\n",
    "users.estimated_document_count()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Мы также можем посмотреть на несколько первых записей по аналогии с методом `head` в **`pandas`**.\\\n",
    "Для этого нам нужно вызвать цепочку методов:\\\n",
    "сначала метод `find`, который говорит, что нужно найти несколько записей (или даже все),\\\n",
    "а после него метод `limit`, который ограничивает общее число возвращаемых документов:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 84,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "qVk0XhjolFdH",
    "outputId": "d46748e6-ce4b-46cf-c1dc-1bcec07551ee"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<pymongo.cursor.Cursor at 0x1e5dc4b9490>"
      ]
     },
     "execution_count": 84,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "head = tags.find().limit(5)\n",
    "head"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Как видно, переменная *head* - это объект класса `Cursor`, а не список словарей, как мы ожидали.\\\n",
    "`Cursor` похож на итератор, т.е. он обеспечивает последовательный доступ к элементам коллекции одни за одним.\\\n",
    "С `Cursor`'ом в `pymongo` можно работать несколькими способамиЖ\n",
    "1. Если документов планируется много, мы можем обрабатывать их один за одним чтобы не загружать весь большой объём данных в оперативную память.\\\n",
    "Попробуем вывести каждый элемент на экран:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 86,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "tXMH8Td2lFdJ",
    "outputId": "28c4b90c-b872-4134-c89b-658b9e49e8e5"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{'_id': ObjectId('5c822402c0669da98bd5081e'), 'id': 931, 'name': 'jealousy'}\n",
      "{'_id': ObjectId('5c822402c0669da98bd5081f'), 'id': 4290, 'name': 'toy'}\n",
      "{'_id': ObjectId('5c822402c0669da98bd50820'), 'id': 5202, 'name': 'boy'}\n",
      "{'_id': ObjectId('5c822402c0669da98bd50821'), 'id': 6054, 'name': 'friendship'}\n",
      "{'_id': ObjectId('5c822402c0669da98bd50822'), 'id': 9713, 'name': 'friends'}\n"
     ]
    }
   ],
   "source": [
    "for doc in head:\n",
    "    print(doc)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "2. Этот способ можно применять, если мы используем небольшое количество данных, которое помещается в оперативную память.\\\n",
    "Мы можем преобразовать курсор к списку и этот списко будет содержать все документы курсора. Попробуем:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 87,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "viNrdGz_lFdL",
    "outputId": "1d4dbcce-3a2c-4959-f1f2-8c871e2c517b"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[]"
      ]
     },
     "execution_count": 87,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "my_list = list(head)\n",
    "my_list"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Список оказался пуст. Это произошло потому что `Cursor` не загружает документы на ваш компьютер, а указывает на подготовленный список документов, находящийся внутри сервера **MongoDB**. Изначально `Cursor` указывает на первый элемент этого списка, а затем, когда мы используем цикл, мы каждую итерацию переставляем `Cursor` на следующий элемент.\\\n",
    "И когда мы пройдём по всему списку, `Cursor` не будет указывать ни на какой документ. Поэтому, нам нужно ещё раз вызвать методы `find` и `limit` чтобы получить новый `Cursor`.\\\n",
    "Вызовем их заново и запишем список в новую переменную."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 88,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "s97xvAiPlFdP",
    "outputId": "50298dd9-9ea4-42a7-e865-a884d34b4eae"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[{'_id': ObjectId('5c822402c0669da98bd5081e'), 'id': 931, 'name': 'jealousy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5081f'), 'id': 4290, 'name': 'toy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd50820'), 'id': 5202, 'name': 'boy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd50821'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd50822'), 'id': 9713, 'name': 'friends'}]"
      ]
     },
     "execution_count": 88,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "head = tags.find().limit(5)\n",
    "my_list = list(head)\n",
    "my_list"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Вижим первые 5 документов коллекции. И при этом, документы из этого списка уже никуда не пропадут потому что мы загрузили их себе на компьютер. Можно это проверить."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 89,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[{'_id': ObjectId('5c822402c0669da98bd5081e'), 'id': 931, 'name': 'jealousy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5081f'), 'id': 4290, 'name': 'toy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd50820'), 'id': 5202, 'name': 'boy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd50821'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd50822'), 'id': 9713, 'name': 'friends'}]"
      ]
     },
     "execution_count": 89,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "my_list"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Вернёмся к списку.\\\n",
    "Мы работаем со списком словарей, а значит можем преобразовать его к датафрейму **`pandas`**.\n",
    "Для это просто вызовем конструктор `DataFrame`, в который передадим список словарей.\\\n",
    "И выведем датафрейм на экран."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 90,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "wqBaBcVilFdR",
    "outputId": "1524e69f-3596-4fff-bc7f-578c96cc55a5"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>_id</th>\n",
       "      <th>id</th>\n",
       "      <th>name</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>5c822402c0669da98bd5081e</td>\n",
       "      <td>931</td>\n",
       "      <td>jealousy</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>5c822402c0669da98bd5081f</td>\n",
       "      <td>4290</td>\n",
       "      <td>toy</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>5c822402c0669da98bd50820</td>\n",
       "      <td>5202</td>\n",
       "      <td>boy</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>5c822402c0669da98bd50821</td>\n",
       "      <td>6054</td>\n",
       "      <td>friendship</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>5c822402c0669da98bd50822</td>\n",
       "      <td>9713</td>\n",
       "      <td>friends</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                        _id    id        name\n",
       "0  5c822402c0669da98bd5081e   931    jealousy\n",
       "1  5c822402c0669da98bd5081f  4290         toy\n",
       "2  5c822402c0669da98bd50820  5202         boy\n",
       "3  5c822402c0669da98bd50821  6054  friendship\n",
       "4  5c822402c0669da98bd50822  9713     friends"
      ]
     },
     "execution_count": 90,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df = pd.DataFrame(my_list)\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Теперь мы можем работать с этим датафреймом.\\\n",
    "Но вернёмся к **MongoDB**. По аналогии с SQL мы можем использовать различные фильтры чтобы ограничить выдачу или найти конкретные документы.\\\n",
    "Например, мы хотим найти все тэги с индентификатором 4290.\\\n",
    "Фильтры в **MongoDB** выполняют ту же самую функцию, что и `WHERE` в SQL, однако, строится по-другому.\n",
    "В **MongoDB** фильтр - это **словарь**, который чаще всего строится следующим образом:\n",
    "* **ключ фильтра** - это название поля в документах, по которому нужно фильтровать (в нашем случае это `id`)\n",
    "* **значение** - это ещё один словарь, в котором *ключ* - это операция сравнения (равенство/неравенство/включение и т.п),\\\n",
    "а *значение* - это, собственно, значение, с которым мы будем сравнивать информацию в полях.\n",
    "\n",
    "Поскольку мы хотим найти тэг, идентификатор которого равен 4290, то в качестве ключа передадим `$eq`, а в качестве значения - 4290.\\\n",
    "Теперь весь этот словарь передадим в функцию `find` в качестве параметра и выполним ячейку."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 91,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<pymongo.cursor.Cursor at 0x1e5dc53b520>"
      ]
     },
     "execution_count": 91,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "tags.find({'id': {'$eq': 4290}}, {'_id': True})"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Мы снова получили `Cursor`. И теперь преобразуем его к списку:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 93,
   "metadata": {
    "colab": {},
    "colab_type": "code",
    "id": "WWa6Xfg3lFdV",
    "outputId": "6ea6cb41-93ec-4498-bdb5-9f7d98485ae4"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[{'_id': ObjectId('5c822402c0669da98bd5081f'), 'id': 4290, 'name': 'toy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5143a'), 'id': 4290, 'name': 'toy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd52bdb'), 'id': 4290, 'name': 'toy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5338c'), 'id': 4290, 'name': 'toy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd53a7b'), 'id': 4290, 'name': 'toy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5416e'), 'id': 4290, 'name': 'toy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd56db6'), 'id': 4290, 'name': 'toy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd59399'), 'id': 4290, 'name': 'toy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5971a'), 'id': 4290, 'name': 'toy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5b9e5'), 'id': 4290, 'name': 'toy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5d698'), 'id': 4290, 'name': 'toy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5fe50'), 'id': 4290, 'name': 'toy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd61622'), 'id': 4290, 'name': 'toy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd62719'), 'id': 4290, 'name': 'toy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd648c0'), 'id': 4290, 'name': 'toy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6563a'), 'id': 4290, 'name': 'toy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd66d5f'), 'id': 4290, 'name': 'toy'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6c705'), 'id': 4290, 'name': 'toy'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd72a48'), 'id': 4290, 'name': 'toy'}]"
      ]
     },
     "execution_count": 93,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "head = tags.find({'id': {'$eq': 4290}})\n",
    "my_list = list(head)\n",
    "my_list"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "На экране появился список документов, которые содержат тэг 4290.\\\n",
    "Также мы можем ограничить список полей, которые должны содержать документы из выдачи.\\\n",
    "Например, предположим что в предыдущем примере нам нужен только внутренний идентификатор документа.\\\n",
    "Для ограничения списка полей существует проекция.\\\n",
    "Это ещё один словарь, который в качестве ключей содержит название поля, а в качестве значений - булеву переменную - включать ли данное поле в выдачу.\\\n",
    "Нам нужно создать прекцию, содержащую только поле `_id`. Создадим соответствующий словарь и передадим его в качестве второго параметра в функцию `find`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 95,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[{'_id': ObjectId('5c822402c0669da98bd5081f')},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5143a')},\n",
       " {'_id': ObjectId('5c822402c0669da98bd52bdb')},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5338c')},\n",
       " {'_id': ObjectId('5c822402c0669da98bd53a7b')},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5416e')},\n",
       " {'_id': ObjectId('5c822402c0669da98bd56db6')},\n",
       " {'_id': ObjectId('5c822402c0669da98bd59399')},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5971a')},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5b9e5')},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5d698')},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5fe50')},\n",
       " {'_id': ObjectId('5c822402c0669da98bd61622')},\n",
       " {'_id': ObjectId('5c822402c0669da98bd62719')},\n",
       " {'_id': ObjectId('5c822402c0669da98bd648c0')},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6563a')},\n",
       " {'_id': ObjectId('5c822402c0669da98bd66d5f')},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6c705')},\n",
       " {'_id': ObjectId('5c822403c0669da98bd72a48')}]"
      ]
     },
     "execution_count": 95,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "head = tags.find({'id': {'$eq': 4290}}, {'_id': True})\n",
    "my_list = list(head)\n",
    "my_list"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Теперь в выдаче остались только внутренние идентификаторы `_id`\n",
    "\n",
    "### Итоги\n",
    "\n",
    "На это уроке мы узнали:\n",
    "* Как подключиться к **MongoDB** из Notebook'а используя библиотеку `pymongo`\n",
    "* Научились загружать данные из коллекции **MongoDB** в **`pandas`** `DataFrame`\n",
    "* Научились выполнять поиск по коллекциям"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "colab_type": "text",
    "id": "aRCcWdnV_Y5E"
   },
   "source": [
    "### Практика\n",
    "\n",
    "#### Задание 1\n",
    "\n",
    "Подключитесь к коллекции `tags` MongoDB и выведите первый документ на экран"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'_id': ObjectId('5c822402c0669da98bd5081e'), 'id': 931, 'name': 'jealousy'}"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "conn = 'mongodb://students:X63673t47Gl03Sq@dsstudents.skillbox.ru:27017/?authSource=movies'\n",
    "\n",
    "connect = pymongo.MongoClient(conn)\n",
    "db = connect['movies']\n",
    "tags = db['tags']\n",
    "\n",
    "tags.find_one()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Задание 2\n",
    "\n",
    "Найдите документы, в которых имя тега (поле `name`) 'friendship', преобразуйте курсор в список и выведите содержимое списка на экран"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[{'_id': ObjectId('5c822402c0669da98bd50821'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd50911'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd50a72'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd50c39'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd50dc9'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd510d4'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5111c'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd51138'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd51141'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5115b'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5121f'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd51449'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd51492'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd514bc'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd51503'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd51631'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd516f8'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5177d'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd51789'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd51a1a'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd51a67'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd51b07'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd51c0e'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd51c34'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd51c99'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd520a1'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd52117'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5212a'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5267c'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd527bf'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd52855'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd52984'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd52a49'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd52cc7'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd52d30'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd52dd8'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd52e4f'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd52f6a'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd532a2'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5335f'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd53506'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd536ac'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd537e1'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd53857'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd53de0'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd53ef4'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd53f71'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd54130'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd543db'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd54542'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd54649'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd54663'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd54738'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd54a6c'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd54b14'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd54b5d'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd54e2a'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd54f11'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd55002'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd550aa'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd552a6'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd556c2'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5598a'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd55ac7'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd55b6b'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd55c96'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd55e22'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd55f68'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd560fa'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd561dc'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd567bc'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd567d8'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5686f'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd56b38'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd56b9a'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd56ccf'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd56df4'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd56e23'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd57088'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd57225'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd57259'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5727b'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd57369'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd573d3'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5792e'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd579b1'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd57a27'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd57b46'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd57c90'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd57d31'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd57e8b'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd57fac'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd580cd'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd58146'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd582d3'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5847e'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd58596'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd585d4'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd587f5'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd589f2'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd58ac7'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd58b1e'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd58d0b'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd58d88'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5915a'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5921a'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd59450'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd59517'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd59649'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd596a0'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5984c'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd59961'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd59a54'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd59a8e'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd59fd8'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5a0fe'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5a4bd'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5a777'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5a7f8'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5a7ff'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5b15e'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5b221'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5b2f1'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5b4d1'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5b76d'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5bac6'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5bdf4'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5bf8a'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5c1e5'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5c2d1'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5c48f'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5c724'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5cfac'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5cff7'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5d05f'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5d18f'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5d648'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5d6b5'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5d738'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5d9c3'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5da86'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5df46'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5df76'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5e113'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5e1da'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5e208'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5e3aa'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5e3e0'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5e4c0'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5e73b'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5e82b'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5e8b0'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5eaea'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5ec66'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5ede1'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5ef7b'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5f23c'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5f362'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5f3c4'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5f84d'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5fba4'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5fbdd'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5fcf4'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5fd1e'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5fe2b'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd5ff16'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd600af'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd601fb'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd60401'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6052b'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd60638'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6069b'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd60774'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd60a43'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd60abe'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd60af8'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd60b3f'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd60eaf'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd60f06'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd60f33'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd60f71'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6109c'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd61125'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd61288'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd612d1'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd61395'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6171e'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd619e0'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd61c32'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd61ca5'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd61d3a'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd61d89'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd61ea9'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd61f63'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd622a4'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd622d6'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd623fa'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6269f'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd627f0'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd628f4'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd629ff'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd62a40'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd62af1'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd62b28'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd62b95'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd62d19'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd62e8c'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd62ee7'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd63498'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd63553'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd63786'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd63acd'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd63ce9'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd63e47'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd64061'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd640e4'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd642ce'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd642f9'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd64388'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd643a3'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd64400'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6451d'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd645a4'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd646d9'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6478d'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd64821'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd64a2c'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd64c27'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd64c83'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd64f6f'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd64fbd'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd65194'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd654b3'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd654c6'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd658cc'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd659b3'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd659db'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd65a7e'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd65cb0'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd65ddb'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd65fe6'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd660d5'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6620b'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd66384'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6679c'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6680f'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd66824'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd66e5d'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd66f8e'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd66fa8'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd67011'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd670c3'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd671e0'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd67239'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6725e'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd67269'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6749a'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd67563'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6765b'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd67851'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd67aaa'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd67ae1'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd67b90'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd67c92'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd67e4d'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd682b7'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd68511'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6867d'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6897b'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6899c'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd68af6'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd68ea2'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd68ee3'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd68f54'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd68fd3'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd69021'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd690dc'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6916c'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd695ad'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd69f89'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6a117'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6a200'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6a217'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6a346'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6a478'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6a53f'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6a624'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6a6e0'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6a730'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6a887'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6a9a5'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6a9c5'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6aa32'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6ac16'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6ac1b'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6aebc'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6b093'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6b0af'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6b519'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6b55f'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6b5bd'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6b5d9'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6b782'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6b7d1'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6b8db'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6b900'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6baa9'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6bd6c'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6bdbc'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6bdef'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6bf0f'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6c03c'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6c577'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6c64d'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6ca9d'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6ce36'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6ced3'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6d1ae'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6d421'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6d630'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822402c0669da98bd6d904'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd6dc02'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd6e1d8'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd6e2f0'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd6e6a5'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd6e6b3'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd6e9b4'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd6eb70'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd6ed00'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd6f030'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd6f0bd'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd6f931'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd6fa46'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd6fb35'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd6fc55'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd7002a'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd70300'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd70467'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd706e4'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd708db'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd70e52'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd70eed'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd70f21'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd7169c'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd7169f'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd71955'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd71a46'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd71b43'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd71d83'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd71e81'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd7203f'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd721ec'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd722e3'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd72527'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd72638'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd727e0'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd72a32'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd72a49'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd72ab2'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd72b24'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd72cbf'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd72d68'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd72daa'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd73009'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd73193'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd731a3'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd7326c'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd7344c'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd734fa'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd7387e'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd738cd'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd73965'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd73b91'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd73c34'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd73ffc'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd74014'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd740cf'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd74156'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd741ef'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd7420d'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd74385'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd743b2'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd743e3'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd74994'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd74a2a'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd74c98'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd74da2'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd74f96'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd750fb'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd7525c'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd7539c'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd753bc'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd75502'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd75560'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd75568'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd75707'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd75a31'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd75bb9'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd75d55'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd75d70'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd75d75'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd75e1a'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd762e5'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd76350'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd764d2'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd7668d'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd769e6'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd76d3b'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd76d7f'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd77080'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'},\n",
       " {'_id': ObjectId('5c822403c0669da98bd770eb'),\n",
       "  'id': 6054,\n",
       "  'name': 'friendship'}]"
      ]
     },
     "execution_count": 5,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "head = tags.find({'name': {'$eq': 'friendship'}})\n",
    "my_list = list(head)\n",
    "my_list"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### Задание 3\n",
    "\n",
    "Преобразуйте список документов в pandas DataFrame и выведите первые 5 строк на экран"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>_id</th>\n",
       "      <th>id</th>\n",
       "      <th>name</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>5c822402c0669da98bd50821</td>\n",
       "      <td>6054</td>\n",
       "      <td>friendship</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>5c822402c0669da98bd50911</td>\n",
       "      <td>6054</td>\n",
       "      <td>friendship</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>5c822402c0669da98bd50a72</td>\n",
       "      <td>6054</td>\n",
       "      <td>friendship</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>5c822402c0669da98bd50c39</td>\n",
       "      <td>6054</td>\n",
       "      <td>friendship</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>5c822402c0669da98bd50dc9</td>\n",
       "      <td>6054</td>\n",
       "      <td>friendship</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                        _id    id        name\n",
       "0  5c822402c0669da98bd50821  6054  friendship\n",
       "1  5c822402c0669da98bd50911  6054  friendship\n",
       "2  5c822402c0669da98bd50a72  6054  friendship\n",
       "3  5c822402c0669da98bd50c39  6054  friendship\n",
       "4  5c822402c0669da98bd50dc9  6054  friendship"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "df = pd.DataFrame(my_list)\n",
    "df.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Итоги\n",
    "\n",
    "В этом модуле мы научились:\n",
    "* Читать данные в формате JSON как из веб-сервисов, так и из файлов\\\n",
    "А также преобразовывать их в **pandas** `DataFrame` и сохранять в файлы формата JSON\n",
    "* Узнали как читать данные из реляционных баз данных используя **Pandas**\n",
    "* Познакомились с миром Больших данных, а конкретно - с БД **MongoDB**\n",
    "\n",
    "## *Выводы*\n",
    "\n",
    "* Формат JSON часто используется для обмена данными между клиентом и сервером\n",
    "* **Pandas** и **SQLAlchemy** позволяют читать данные напрямую из баз данных\n",
    "* Работа с большими данными отличается от работы c обычными БД"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.3"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}