notebooks/classifier_scikitlearn_pipeline_pca_cv_svc.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Adversarial Robustness Toolbox (ART) and scikit-learn Pipeline"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This notebook contains an example of generating adversarial samples using a black-box attack against a scikit-learn pipeline consisting of principal component analysis (PCA) and a support vector machine classifier (SVC), but any other valid pipeline would work too. The pipeline is first optimised using grid search with cross validation. The adversarial samples are created with black-box `HopSkipJump` attack. The training data is MNIST, becasue of its intuitive visualisation, but any other dataset including tabular data would be suitable too."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import numpy as np\n",
    "import matplotlib.pyplot as plt\n",
    "\n",
    "from sklearn import datasets\n",
    "from sklearn.decomposition import PCA\n",
    "from sklearn.svm import SVC\n",
    "from sklearn.pipeline import Pipeline\n",
    "from sklearn.model_selection import GridSearchCV\n",
    "\n",
    "from art.utils import load_dataset\n",
    "from art.estimators.classification import SklearnClassifier\n",
    "from art.attacks.evasion import HopSkipJump\n",
    "\n",
    "import warnings\n",
    "warnings.filterwarnings('ignore')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Load the training and testing dataset"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "n_features = 28*28\n",
    "(x_train, y_train), (x_test, y_test), _, _ = load_dataset('mnist')\n",
    "x_train = x_train.reshape((x_train.shape[0], n_features))\n",
    "x_test = x_test.reshape((x_test.shape[0], n_features))\n",
    "y_train = np.argmax(y_train, axis=1)\n",
    "y_test = np.argmax(y_test, axis=1)\n",
    "\n",
    "# Select a smaller set of samples to accelerate notebook example, remove for higher accuracy\n",
    "x_train = x_train[0:1000]\n",
    "x_test = x_test[0:100]\n",
    "y_train = y_train[0:1000]\n",
    "y_test = y_test[0:100]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Create a pipeline containing PCA and SVC classifier"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "svc = SVC(C=1.0, kernel='rbf')\n",
    "pca = PCA()\n",
    "pipeline = Pipeline(steps=[('pca', pca), ('svc', svc)])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Grid search and cross validation to optimise number of PCA components and error term penalty"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Best parameter (CV score=0.908):\n",
      "{'pca__n_components': 20, 'svc__C': 1.0}\n"
     ]
    }
   ],
   "source": [
    "param_grid = {'pca__n_components': [5, 20, 30, 40, 50, 64],\n",
    "              'svc__C': np.logspace(-4, 4, 5)}\n",
    "search = GridSearchCV(estimator=pipeline, param_grid=param_grid, iid=False, cv=5)\n",
    "search.fit(x_train, y_train)\n",
    "print(\"Best parameter (CV score=%0.3f):\" % search.best_score_)\n",
    "print(search.best_params_)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Create a black-box attack using ART"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "classifier = SklearnClassifier(model=search.best_estimator_)\n",
    "attack = HopSkipJump(classifier=classifier, targeted=False, norm=np.inf, max_iter=100, max_eval=100,\n",
    "                     init_eval=100, init_size=100)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Generate adversarial samples"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "HopSkipJump: 100%|██████████| 100/100 [03:04<00:00,  1.84s/it]\n"
     ]
    }
   ],
   "source": [
    "x_test_adv = attack.generate(x_test)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Evaluate benign accuracy"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Accuracy on benign test samples 91.0%:\n"
     ]
    }
   ],
   "source": [
    "accuracy_test_benign = search.score(x_test, y_test)\n",
    "print('Accuracy on benign test samples {}%:'.format(accuracy_test_benign * 100))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Evaluate adversarial accuracy"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Accuracy on adversarial test samples 5.0%:\n"
     ]
    }
   ],
   "source": [
    "accuracy_test_adversarial = search.score(x_test_adv, y_test)\n",
    "print('Accuracy on adversarial test samples {}%:'.format(accuracy_test_adversarial * 100))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Inspect a benign test sample"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAQEAAAECCAYAAAD+eGJTAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjMsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+AADFEAAAODklEQVR4nO3df4xc5XXG8eeJvazjtWnsOHZcY3BDSBSSBlNtIJHbyhElJYmQQQltLNVypTSLWpCgitoiSxGW2qYU8aO0aZFMceNEhoTGUFDiprGstBSVOtiWAYNpTalLHW+9gNPaBPDP0z/2mm7J7ju7Oz/urM/3I61m5p479x5fzz773pl37zoiBCCvt9XdAIB6EQJAcoQAkBwhACRHCADJEQJAcrWEgO0rbP+L7edt31RHDyW299l+2vYu29u7oJ/1tods7x6xbK7tLbb3Vrdzuqy/tbZ/WB3DXbY/VWN/i21/3/Ye28/YvqFa3hXHsNBfR46hOz1PwPY0Sf8q6XJJ+yU9IWllRDzb0UYKbO+T1B8RL9fdiyTZ/kVJr0r6WkR8qFp2q6RDEXFLFaRzIuL3uqi/tZJejYjb6uhpJNsLJS2MiJ22Z0vaIekqSb+uLjiGhf5+RR04hnWMBC6R9HxEvBARxyR9Q9KKGvqYMiLiUUmH3rJ4haQN1f0NGn7R1GKM/rpGRAxGxM7q/hFJeyQtUpccw0J/HVFHCCyS9J8jHu9XB//B4xSSvmd7h+2BupsZw4KIGJSGX0SS5tfcz2iut/1UdbpQ2+nKSLaXSLpY0jZ14TF8S39SB45hHSHgUZZ129zlZRHxc5I+Kem6ariLiblb0vmSlkoalHR7ve1ItmdJ2iTpxog4XHc/bzVKfx05hnWEwH5Ji0c8PkfSgRr6GFNEHKhuhyQ9pOFTmG5zsDqXPH1OOVRzP/9PRByMiJMRcUrSPar5GNru0fA32MaIeLBa3DXHcLT+OnUM6wiBJyRdYPtnbJ8l6XOSHqmhj1HZ7qvenJHtPkmfkLS7/KxaPCJpdXV/taSHa+zlJ5z+5qpcrRqPoW1LulfSnoi4Y0SpK47hWP116hh2/NMBSao+6vgTSdMkrY+IP+x4E2Ow/R4N//SXpOmS7qu7P9v3S1ouaZ6kg5JulvQ3kh6QdK6kFyVdExG1vDk3Rn/LNTyMDUn7JF17+vy7hv5+XtI/Snpa0qlq8RoNn3fXfgwL/a1UB45hLSEAoHswYxBIjhAAkiMEgOQIASA5QgBIrtYQ6OIpuZLor1nd3F839yZ1tr+6RwJd/R8h+mtWN/fXzb1JHeyv7hAAULOmJgvZvkLSXRqe+feXEXFLaf2z3Bsz1Pfm4+M6qh71Tnr/7UZ/zenm/rq5N6n1/b2hH+tYHB3tl/cmHwKTuTjI2Z4bl/qySe0PwORti606HIdGDYFmTge4OAhwBmgmBKbCxUEANDC9ieeO6+Ig1UcdA5I0QzOb2B2AdmhmJDCui4NExLqI6I+I/m5+IwbIqpkQ6OqLgwAYn0mfDkTECdvXS/o7/d/FQZ5pWWcAOqKZ9wQUEZslbW5RLwBqwIxBIDlCAEiOEACSIwSA5AgBIDlCAEiOEACSIwSA5AgBIDlCAEiOEACSIwSA5AgBIDlCAEiOEACSIwSA5AgBIDlCAEiOEACSIwSA5AgBIDlCAEiOEACSIwSA5AgBIDlCAEiOEACSIwSA5AgBIDlCAEiOEACSm97Mk23vk3RE0klJJyKivxVNAeicpkKg8vGIeLkF2wFQA04HgOSaDYGQ9D3bO2wPtKIhAJ3V7OnAsog4YHu+pC22n4uIR0euUIXDgCTN0Mwmdweg1ZoaCUTEgep2SNJDki4ZZZ11EdEfEf096m1mdwDaYNIhYLvP9uzT9yV9QtLuVjUGoDOaOR1YIOkh26e3c19EfLclXQHomEmHQES8IOmiFvYCoAZ8RAgkRwgAyRECQHKEAJAcIQAkRwgAybXitwjTeOULHyvWz131fLH+3NCCYv3Y0Z5ifdH95frM/a8W66d2PVusIydGAkByhACQHCEAJEcIAMkRAkByhACQHCEAJMc8gQn43d+5r1j/TN+Pyhs4v8kGlpfL+068Vqzf9dLHm2xgavvB0HnFet/tP1WsT9+6o5XtdA1GAkByhACQHCEAJEcIAMkRAkByhACQHCEAJOeI6NjOzvbcuNSXdWx/rfbjz15arL/84XKmztlTPtY/+oCL9bM+/N/F+q0ferBYv/ztrxfr33ltVrH+6Znl6xU06/U4VqxvO9pXrC+fcbyp/b/3O9cW6+8beKKp7ddpW2zV4Tg06guMkQCQHCEAJEcIAMkRAkByhACQHCEAJEcIAMlxPYEJ6PvWtgb15rZ/dnNP15+9e3mx/gfLlpT3/w/lv5tw6/L3TrCjiZn++qlive+pwWL9nY9uKtZ/9qwGf7dhX7l+pmo4ErC93vaQ7d0jls21vcX23up2TnvbBNAu4zkd+KqkK96y7CZJWyPiAklbq8cApqCGIRARj0o69JbFKyRtqO5vkHRVi/sC0CGTfWNwQUQMSlJ1O791LQHopLa/MWh7QNKAJM3QzHbvDsAETXYkcND2QkmqbofGWjEi1kVEf0T096h3krsD0C6TDYFHJK2u7q+W9HBr2gHQaQ1PB2zfr+Er3s+zvV/SzZJukfSA7c9LelHSNe1sEuNz4r8OFut9m8r1kw223/etVybYUWsd/I2PFesfPKv8cr7t0PuL9SV/9UKxfqJYnboahkBErByjNHWvDgLgTUwbBpIjBIDkCAEgOUIASI4QAJIjBIDkuJ4Ausb08xYX619Z85VivcfTivW/vuuXivV3Dj5erJ+pGAkAyRECQHKEAJAcIQAkRwgAyRECQHKEAJAc8wTQNZ777UXF+kd6Xaw/c+z1Yn3us69NuKcMGAkAyRECQHKEAJAcIQAkRwgAyRECQHKEAJAc8wTQMUc//ZFifedn72ywhfJfsPrNG24o1t/+Tz9osP2cGAkAyRECQHKEAJAcIQAkRwgAyRECQHKEAJAc8wTQMS9+svwzZ5bL8wBW/vvlxfrM7z5ZrEexmlfDkYDt9baHbO8esWyt7R/a3lV9faq9bQJol/GcDnxV0hWjLL8zIpZWX5tb2xaATmkYAhHxqKRDHegFQA2aeWPwettPVacLc1rWEYCOmmwI3C3pfElLJQ1Kun2sFW0P2N5ue/txHZ3k7gC0y6RCICIORsTJiDgl6R5JlxTWXRcR/RHR39Pgt8AAdN6kQsD2whEPr5a0e6x1AXS3hvMEbN8vabmkebb3S7pZ0nLbSzX80es+Sde2sUdMEW+bPbtYX/ULjxXrh0+9UawPffk9xXrv0SeKdYyuYQhExMpRFt/bhl4A1IBpw0ByhACQHCEAJEcIAMkRAkByhACQHNcTQMvsXfvBYv3b8/6iWF+x9zPFeu9m5gG0AyMBIDlCAEiOEACSIwSA5AgBIDlCAEiOEACSY54Axu1/fu2jxfpTv/qnxfq/nTherL/6x+cU670aLNYxOYwEgOQIASA5QgBIjhAAkiMEgOQIASA5QgBIjnkCeNP0RT9drN/4pW8W670uv5w+9+SqYv1df8v1AurASABIjhAAkiMEgOQIASA5QgBIjhAAkiMEgOSYJ5CIp5f/uy/69v5i/ZpZrxTrG4/ML9YXfKn8M+dUsYp2aTgSsL3Y9vdt77H9jO0bquVzbW+xvbe6ndP+dgG02nhOB05I+mJEfEDSRyVdZ/tCSTdJ2hoRF0jaWj0GMMU0DIGIGIyIndX9I5L2SFokaYWkDdVqGyRd1a4mAbTPhN4YtL1E0sWStklaEBGD0nBQSCqfEALoSuMOAduzJG2SdGNEHJ7A8wZsb7e9/biOTqZHAG00rhCw3aPhANgYEQ9Wiw/aXljVF0oaGu25EbEuIvojor9Hva3oGUALjefTAUu6V9KeiLhjROkRSaur+6slPdz69gC023jmCSyTtErS07Z3VcvWSLpF0gO2Py/pRUnXtKdFtMxF7y+Wf3/+15va/J9/ufwSeMeTjze1fbRHwxCIiMckeYzyZa1tB0CnMW0YSI4QAJIjBIDkCAEgOUIASI4QAJLjegJnkGkXvq9YH/hGc/O5Llx/XbG+5Ov/3NT2UQ9GAkByhACQHCEAJEcIAMkRAkByhACQHCEAJMc8gTPIc79Vvur7lTPHfVW4UZ3z98fKK0Q0tX3Ug5EAkBwhACRHCADJEQJAcoQAkBwhACRHCADJMU9gCnnjykuK9a1X3t5gCzNb1wzOGIwEgOQIASA5QgBIjhAAkiMEgOQIASA5QgBIruE8AduLJX1N0rslnZK0LiLusr1W0hckvVStuiYiNrerUUgHlk0r1s+d3tw8gI1H5hfrPYfL1xPgagJT03gmC52Q9MWI2Gl7tqQdtrdUtTsj4rb2tQeg3RqGQEQMShqs7h+xvUfSonY3BqAzJvSegO0lki6WtK1adL3tp2yvt12+thWArjTuELA9S9ImSTdGxGFJd0s6X9JSDY8URp24bnvA9nbb24/raAtaBtBK4woB2z0aDoCNEfGgJEXEwYg4GRGnJN0jadTfbomIdRHRHxH9PeptVd8AWqRhCNi2pHsl7YmIO0YsXzhitasl7W59ewDabTyfDiyTtErS07Z3VcvWSFppe6mGPxnaJ+natnQIoK3G8+nAY5I8Sok5AVPMH71yYbH++C8vKdZj8OkWdoNuwYxBIDlCAEiOEACSIwSA5AgBIDlCAEiOEACSc3Twb8qf7blxqS/r2P4ADNsWW3U4Do0234eRAJAdIQAkRwgAyRECQHKEAJAcIQAkRwgAyXV0noDtlyT9x4hF8yS93LEGJo7+mtPN/XVzb1Lr+zsvIt41WqGjIfATO7e3R0R/bQ00QH/N6eb+urk3qbP9cToAJEcIAMnVHQLrat5/I/TXnG7ur5t7kzrYX63vCQCoX90jAQA1IwSA5AgBIDlCAEiOEACS+1/8tsxjstIf5QAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 288x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.matshow(x_test[0].reshape((28, 28)));"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Predicted label: 7\n"
     ]
    }
   ],
   "source": [
    "print('Predicted label:', search.predict(x_test[0:1])[0])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Inspect an adversarial test sample"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAQEAAAECCAYAAAD+eGJTAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjMsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+AADFEAAAZ2UlEQVR4nO3da4yc5XUH8P+Z6958Xd8WX7CxjTEgg2EhXNoCRaGQFpF8oAqVInpRHaUhSpqoSkQ/hKgXRU1CilKa1ikoREqoUoUkJKEEl0IJkIJtMNhmwRizvuDL2vi217mefvBQFtj3/ywee2bI8/9Jlnfn7Pu+z7w7c3ZmnvOex9wdIhKvVLMHICLNpSQgEjklAZHIKQmIRE5JQCRySgIikWtKEjCz683sFTPbbmZfasYYGDPrN7PNZrbJzDa0wHjuNbMBM9sy7raZZrbOzF6t/T+jxcZ3h5m9UTuHm8zsI00c30Ize8zM+sxsq5l9tnZ7S5xDMr6GnENrdJ2AmaUBbAPwYQB7AKwHcIu7v9TQgRBm1g+g190PNXssAGBmvwNgCMD33P382m3/AOCwu3+1lkhnuPsXW2h8dwAYcvevN2NM45lZD4Aed3/OzKYA2AjgowD+GC1wDsn4/hANOIfNeCVwKYDt7r7D3YsA/h3ATU0YxweGuz8B4PC7br4JwH21r+/DiQdNUySMr2W4+z53f6729SCAPgDz0SLnkIyvIZqRBOYD2D3u+z1o4B2eJAfwiJltNLM1zR5Mgrnuvg848SACMKfJ45nIbWb2Yu3tQtPeroxnZosBrAbwDFrwHL5rfEADzmEzkoBNcFur1S5f6e4XAbgBwKdrL3fl/fk2gKUALgSwD8A3mjscwMy6APwIwOfc/Xizx/NuE4yvIeewGUlgD4CF475fAGBvE8aRyN331v4fAPBjnHgL02oO1N5LvvWecqDJ43kHdz/g7hV3rwL4Dpp8Ds0sixNPsO+7+wO1m1vmHE40vkadw2YkgfUAlpvZEjPLAfg4gAebMI4JmVln7cMZmFkngOsAbOFbNcWDAG6tfX0rgJ82cSzv8daTq+ZjaOI5NDMDcA+APne/c1yoJc5h0vgadQ4bPjsAALWpjn8EkAZwr7v/XcMHkcDMzsKJv/4AkAHwg2aPz8zuB3A1gFkADgD4MoCfAPghgEUAdgG42d2b8uFcwviuxomXsQ6gH8An33r/3YTx/RaAXwHYDKBau/l2nHjf3fRzSMZ3CxpwDpuSBESkdahiUCRySgIikVMSEImckoBI5JQERCLX1CTQwiW5ADS+erXy+Fp5bEBjx9fsVwIt/YuAxlevVh5fK48NaOD4mp0ERKTJ6ioWMrPrAdyFE5V//+buX2U/n0u3e3tm6v9/X6yMIpduf/sHUjwneSYQT090bdK48R4bofF3K6GALPJv39DRxvc/VuQ7ND6+EM/n3vF9qTyMbKZz3P7r2j08w3eQGirQeLUr/47vS8VhZHOdCT/9/vfv+eyk9zWh9NuPn2JxGLl3jc2GRvn2WX780OMTo/z+oevt58KE4ytW+PaV5PhoZRDF6uiEv+AM32uyWnOQuzGuOYiZPciag7RnpuKKeX+UuE+f0kGPWermD6jidP5LavvZszQeYuedz+Mv7eDxXH0P4uryRTyere+FXaE7T+Odv3qFxod/e0Vdxw/tv7psIY2HlKfkaDz7a97XJjWPX2lcmTWVxrH5VRou955H47m9x/j+jw0mhn596D8SY/U8atQcROQ3QD1J4IPQHEREAk767QAm2RykNtWxBgDa0lPqOJyInA71vBKYVHMQd1/r7r3u3vuODwFFpCXUkwRaujmIiEzOSb8dcPeymd0G4Jd4uznIVrpNsYTy7j3J8SsuoMfMHuZTfLk9YzReCuw/pDiVf7rctvxMGrfjgSnKUpmGU0P8/pXn8bdbuT1H+f4L/PjWxqdIs4N8+3w/7+Duxv8mpd9M/vQbAIbOm0vjna/w4w9/eBXffgf/dH60h89utW+mYWSGS3z/Z82kcbfkePXJ5MduPZ8JwN0fAvBQPfsQkeZSxaBI5JQERCKnJCASOSUBkcgpCYhETklAJHJ1TRG+X5bNIjP3jMS4v9RPtw9dRVaew68yzPe9wbdfzOeZ82/yefrqC300PnJjfatIdfw3LcNAum+Yxqt5fpWgLV9C4+X9B2g8c4TXIXg7rzMYvexsGs89vJ7GO0cClwIX+KW8ubn8KsDRhTweqpOwDH+6jczjFbUdj/PHV2rm9OTYWHINgl4JiEROSUAkckoCIpFTEhCJnJKASOSUBEQipyQgErmG1gl4WxaFs+clxrPP8m6ztmU7jWdX1DfPPXYJ7wcQ6lZcueYiGg9107UpvB/A6JUraTz7yAYa98A8eXUqryPInL2UxkeXzKDxtv28jqF9x2Eat57kxw4ADK/mdSSZUd6yO7d5J42XPnQWj0/hT6dcD+9W3L6P95tIdfJ+BSMrk89P9XByp2u9EhCJnJKASOSUBEQipyQgEjklAZHIKQmIRE5JQCRyje0nUK4iezB5LtTL/Hrs8uV81dZKnue0jmN8Vd/ObXyeGt2873v6+ddovDrK+xFYkfedzwx103hq1Tl8/yO8TmA0sK6CPc3vX9su3i9gJNTX/9l+Gh+6dDHfPrAugGfTND7ay+sAMsO8ziBUJ4AjgfFtf53Gx669mMbzj72YGLNCcq8FvRIQiZySgEjklAREIqckIBI5JQGRyCkJiEROSUAkcg2tE8BYAdjenxj2C3jfeRgP537Jr6cfCvT9b3/kBRpP9/B1CfxoYP366y6g8a7N+2m8Wq7SeOrwII0Xl/Lr2dMFPg8e6pfAtwZSJafx8tIeGs8O8TqSYmjdiW38/LaXAvegys9/+okdNB46P5Wr+flNj/E9pJYtTozZ9uQakLqSgJn1AxjEiftXdvfeevYnIo13Kl4JXOPuh07BfkSkCfSZgEjk6k0CDuARM9toZmtOxYBEpLHqfTtwpbvvNbM5ANaZ2cvu/sT4H6glhzUA0Gb8gxsRaby6Xgm4+97a/wMAfgzgPR+/u/tad+91994ceDdbEWm8k04CZtZpZlPe+hrAdQC2nKqBiUhj1PN2YC6AH5vZW/v5gbs/zDaoTm3HyFXJ15R3bj9CD5ga4dfbI9C3v31/YP36gOo0/nZm9DxeRxBad6BwIe/rn3ky+XpxABi6gc8zh1iZz+NblcerOf43JTTPX+iu75ViqA5h6KIFNB4aX6rI6wSqV/E6kFSgDiNVDMQ3vkzjbqSQplBMDJ10EnD3HQD4vRaRlqcpQpHIKQmIRE5JQCRySgIikVMSEImckoBI5BraTyB1fBQd65Lnuv0c3ve9uuklHr9qNY3ndvF1BULXew8v4XUI+NRBGt65iq+bUE1eQh4A0LnsEhrvOMjvQbrA59Hzh3gdRXkKX5cgVCeQeXorjacLfF2EzIL5ND5y/hk0HqojyG3ZTePDly2h8Y6dx2ncKvz4xdm8DqUaWHcj81RyrR47sl4JiEROSUAkckoCIpFTEhCJnJKASOSUBEQipyQgErnGrjsQYLt5X3hcxte3z702QOOVg7wpsgfmqVN/wfd/3bw+Gj9ycz+Nj1b4PPwNM/i6CM8O834EX5nN5+lHqsnXnAPAeQ99msZz08ZovHgj//0FZfg8O3g7AHzmikdpfO0Dv0fjPU/zA5S6O/gAAkpd9T0dc13JdQZ2LPnvvV4JiEROSUAkckoCIpFTEhCJnJKASOSUBEQipyQgErmG1gl4ex5+bvJcdmo/X3cA/8v77vvZfJ48PWM6jZf3H6Dx9r9qp/H/XHo1jU/duJfGX/7bWTQ+sKSLxi+etovGv3jgQhpflH+Txn9/NT//p9vGQ3zdgItn7alr/8XpgXUFsqSvP4DsIN++3Mmfbl1beR3KyNmzaRwV1k8iucZCrwREIqckIBI5JQGRyCkJiEROSUAkckoCIpFTEhCJXEv1E6gc4vPU6Rkz+PbbXuPbr1jGBxCoE7CdfJ6/65XXabxyHq9jWHYrn4c/ciW/Hv9nc/n923cln+decXfg/pcDKzOM8X4MXuD9CqqDgzTedRlf9+HVr/B59DPyR2ncu/j9yx8q0XiqxLdvOzTEj5/nC0/kHl5P47RKwJNrGIKvBMzsXjMbMLMt426baWbrzOzV2v/82SkiLWsybwe+C+D6d932JQCPuvtyAI/WvheRD6BgEnD3JwC8e/2umwDcV/v6PgAfPcXjEpEGOdkPBue6+z4AqP0/59QNSUQa6bTPDpjZGjPbYGYbSuWR0304EXmfTjYJHDCzHgCo/Z94+ZO7r3X3XnfvzWbq68YqIqfeySaBBwHcWvv6VgA/PTXDEZFGM3fey93M7gdwNYBZAA4A+DKAnwD4IYBFAHYBuNnd3/3h4XtMtZn+Ibs2+VgX8/XXU8fqezthw6M0Xjkc6GcQ2v8Kvn69jfF55uL8aTQe6kufHQo03g+oZvnfBOdlBuh4mdcZ+NAwP34gPnLDBTR+/l/zOotn9i+i8Vk3bqPx9HT++ymvXEzjmb5+GrcpvA4iVEdQXJg8U79h/d04fnzPhL/BYLGQu9+SEEp+NovIB4bKhkUipyQgEjklAZHIKQmIRE5JQCRySgIikWtsP4GONti5ybUAhVm8r3/u+ZdpPDOH9+2vzuJXPPu+/TQO4xPlluI5NVQHkCoErtcP1AnUu759SO4I7wdQWtBN46mRqTz+Ol834PNf+wGNvzLWQ+P9nz+Dxm3eXBqvHj1G49l9vM6kfDavU7Aqr9nxDVtovLI0+fyzGg+9EhCJnJKASOSUBEQipyQgEjklAZHIKQmIRE5JQCRyDa0TsEIJqdeS54KrZ6zg268+h8YDs+zwjVt5/HJ+vToC19OPdOdpPFXi88BkCflJbV/NBgZYJw/0GyiG+h3k+Pa7v3Aujxf7aXzrEK8TqGzn60Ig1Fsjz3+/hSW8TiV7ZIwf/+UdNJyayuss0sXktQWM3DW9EhCJnJKASOSUBEQipyQgEjklAZHIKQmIRE5JQCRyDa0T8GoV1dHkudLOZ/vp9ha4nr+0ZB6NZ2bz9euHZ/F54OxgfX39Q/PQpSn1rStQzdb36wzVIdS77sHu3+Xnd8uf/hON3z/Ir/c/cMUgjYfOf0j5cr4uRu4N3m8A1eR5fAAoXs7rJDzw+M89k9xvw0aSn3d6JSASOSUBkcgpCYhETklAJHJKAiKRUxIQiZySgEjkGttPIJtFuid5rrc6cIhuX63wjgHZfI7GfTpf/7197zCNF2Z31Ld9YF2F/JsFvn2gX0G90qF1D5Cm0Uqex6+9/vn3OaJ3+ucdV9P4zGkH69q/F0s0br/m/SgqBf77S0/n605gAV8XIz8wxLdfRNZV2JFNDAVfCZjZvWY2YGZbxt12h5m9YWabav8+EtqPiLSmybwd+C6A6ye4/ZvufmHt30Ondlgi0ijBJODuTwA43ICxiEgT1PPB4G1m9mLt7QJ/MyMiLetkk8C3ASwFcCGAfQC+kfSDZrbGzDaY2YZiZeQkDycip8tJJQF3P+DuFXevAvgOgEvJz6519153782l+afrItJ4J5UEzGx8b+ePAeBrJotIywrWCZjZ/QCuBjDLzPYA+DKAq83sQpzolN8P4JOTOZgXiyj370o+1mp+vXb64FEaH1nJ+wm07wpd783D6bHAPHrgeu9qoO9+qA4gdL1+ivSdB8L9AELrHuQeXk/jmSVn0vhdZzxF49tKRRofXTeHxq2N9xOoHOGPn/RM/tGWT+2icWR4nQQOHaHhShvfvtoRqINZvzk55sk1DMEk4O63THDzPaHtROSDQWXDIpFTEhCJnJKASOSUBEQipyQgEjklAZHINbSfQEhqaJTGy3veoPG2QL+A6ms7abxyKe/7Dl4GgEJ3G4237+H9BkYXdPIDBITqEPKPJ88jA4AHrocPOXxZD40fqyb3vgeAbOD8zt7Ety+snE/j+T6+/6HeRTTe9ouNNJ6ZM4sfIFBH0rGN90MYW9xN43myroYdTn6q65WASOSUBEQipyQgEjklAZHIKQmIRE5JQCRySgIikWtsnYABliGHDKwfX7nmIhrP9PE6gpFrVtF4NTBR3bU+UGcwn88Tpwq8r312kPcLCNUp5Hbz69UD7RKCMgv4PPxdf/8tGp+W4nUUv/Ovn6HxxW8coHEcOU7DxXMW0HjnDt5vonjVBTweWHchd5TXYWR283U32rbtp/Hq/OQ6AQyqTkBEEigJiEROSUAkckoCIpFTEhCJnJKASOSUBEQi19A6AUulkeoi18wP8uvt04+9TuNDNyYuhAQAyB/mfe09MA+PNr4ugJUC6xIUeZ1A7iC//4V5vO+9lXidQahfgOX5/Ru8h/e9X5jm+39qbCqNL/oFn6cfXsGvp88OTaPxVIH/fobP4tuH1n0IKU7n5zf90hDfQYo/QFO5bHKwmlwlolcCIpFTEhCJnJKASOSUBEQipyQgEjklAZHIKQmIRK6hdQLelkN55eLEeOYQX1/ez+J97Tv7eN/24kK+/nypi5+O7GF+PfxYD5/Hz7/J91+ewufh83v59fJ+jMczi3lf/aP/wse3eibv13DH/g/T+OY7+fX4+Tl8Hj5/iNchVNv49fzVwPX+qSLvuBCKW5X3w0j9z/M07qvOofHqiy/TOI4m11m4J9fIBF8JmNlCM3vMzPrMbKuZfbZ2+0wzW2dmr9b+588wEWlJk3k7UAbwBXdfCeAyAJ82s3MBfAnAo+6+HMCjte9F5AMmmATcfZ+7P1f7ehBAH4D5AG4CcF/tx+4D8NHTNUgROX3e1weDZrYYwGoAzwCY6+77gBOJAsCcUz04ETn9Jp0EzKwLwI8AfM7d+SdQ79xujZltMLMNpRK/QEZEGm9SScDMsjiRAL7v7g/Ubj5gZj21eA+AgYm2dfe17t7r7r3ZbH2r7orIqTeZ2QEDcA+APne/c1zoQQC31r6+FcBPT/3wROR0m0ydwJUAPgFgs5ltqt12O4CvAvihmf0ZgF0Abg7tyCpVZA4nvyWovLqDb/8q33/gan5kZgSuxy/zed7SzA4azw+M0ng5cD15JtCXvtIXOAEhZB4ZAFZ38/H9wYxNNP43t/8JjXcc5P0cQnUaqSKvIyjM4uMP9QPoeGE3jVePB+pYzj2LxtF7Pg2nDvF32alAnUdlH1mXoZDciyCYBNz9SSQve3FtaHsRaW0qGxaJnJKASOSUBEQipyQgEjklAZHIKQmIRK6x/QRShmpX8lxuejZZXx1A9TifR033zKXx0Wn8ev3sf23k+1+2hMar03gdQebprTQeEuoHUN7J57l/vmcDjX/ryHIa/9Tjn6Dx5Xt4nUQxcP5Dit3tdW0f6gdQnTuTxm1sjMYrOd6vALwMBak8Pz82xutICtesSj70U48nH5fuVUR+4ykJiEROSUAkckoCIpFTEhCJnJKASOSUBEQi19A6AStVkD5wNDFePsjXDUivWEbjhTOm0nh+gLc347PIgJX49ejpI3z/pd6V/AAe6Fs/wOskXvv6h2j8a2+O0PiZ+UM03rOOP1wK3fX9Tckfrq/fQEg1GxhfJ5+nDx09tZGvC5Bq5+tW2PRpNF5a0E3j1Wxyz4DEZgDQKwGR6CkJiEROSUAkckoCIpFTEhCJnJKASOSUBEQi19A6AZgB2eRDWp73jUeFryyQ73uDxn1qYN2Bi8/jh9+yncbTs2fReLmTn+6253fS+PBlvJ9B38fvpvFtJT4Pv6mwgMY7DvDtM0M8XpjF+wGUpmRp3Mq8kqNjJ6+j8Bw//5U2Hrc2Ps/vx4f49jP49oUl/PGTe/41Gs92Jq/wlRopJcfoXkXkN56SgEjklAREIqckIBI5JQGRyCkJiEROSUAkcsE6ATNbCOB7AObhxCX3a939LjO7A8CfA3irCcDt7v4Q25eXSqjs3Z8YTy2aT8cyehbvC9+xjc8jF+fz67U9RS66BmBX8DqCdP+bNJ59hPf951UQQCV/Fo3/5d4raLwzw/vWP3d4IY3nNvfTeOXNwzTetuocGi9P5fPo2b5dNI4Z/PeL7Xz7bI7XKVSW8jqKTBuvcyn38+PnA+sOoIvXuZTOTF63w48mP9UnUyxUBvAFd3/OzKYA2Ghm62qxb7r71yexDxFpUcEk4O77AOyrfT1oZn0A+J9sEfnAeF+fCZjZYgCrATxTu+k2M3vRzO41sxmneGwi0gCTTgJm1gXgRwA+5+7HAXwbwFIAF+LEK4VvJGy3xsw2mNmGkvO13ESk8SaVBMwsixMJ4Pvu/gAAuPsBd6+4exXAdwBcOtG27r7W3XvdvTdr/IMfEWm8YBIwMwNwD4A+d79z3O09437sYwC2nPrhicjpNpnZgSsBfALAZjPbVLvtdgC3mNmFOLHgcj+AT56WEYrIaTWZ2YEnMXHXcloTMKGudpR7yVw7n6ZH/vHNNB6aZ88e4vPYoX4FvpJfz49R/plHupvXOYRUWF/5Sfj5Dl7nMP/OwPX8UwLHP3KMhv2V12k8O5WvGzF6yVJ+/MC6DZl5gToC4/fPM4E6kkC/g1C/jGrg8VlevZzG06PJPQNQTT43qhgUiZySgEjklAREIqckIBI5JQGRyCkJiEROSUAkcg1dd8AKJeRfG0iMVwYOJsaA8Pru5XMX03h6mPfFL83kffHz25PHDgDFZT00nl7fR+OFa1bR+IwX+Dzyjhv49eZndvN+AsiUabh6kPdLMLKmBACkZ3XT+Mj5Z/Dtx3gdR26A9/1Hid8/C8Qr+w7w7QN1AOVLVtK4Z/jf5FSR33/bmrwugY0l/+71SkAkckoCIpFTEhCJnJKASOSUBEQipyQgEjklAZHImQeuwT6lBzM7CGDnuJtmATjUsAG8fxpffVp5fK08NuDUj+9Md59wYYKGJoH3HNxsg7v3Nm0AARpffVp5fK08NqCx49PbAZHIKQmIRK7ZSWBtk48fovHVp5XH18pjAxo4vqZ+JiAizdfsVwIi0mRKAiKRUxIQiZySgEjklAREIvd/8/eYwT/KXIMAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 288x288 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "plt.matshow(x_test_adv[0].reshape((28, 28)));"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Predicted label: 9\n"
     ]
    }
   ],
   "source": [
    "print('Predicted label:', search.predict(x_test_adv[0:1])[0])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "L_Infinity-norm: 0.23704942932315898\n"
     ]
    }
   ],
   "source": [
    "print('L_Infinity-norm:', np.linalg.norm(x_test_adv[0] - x_test[0], ord=np.inf))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.7.7"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}