remove comment

elastic · Jan 25, 2024 · 3158306 · 3158306
1 parent 0ca0e68
commit 3158306
Showing 1 changed file with 0 additions and 1 deletion.
diff --git a/notebooks/search/tokenization.ipynb b/notebooks/search/tokenization.ipynb
@@ -201,7 +201,6 @@
    "source": [
     "We can observe:\n",
     "- There are special tokens `[CLS]` and `[SEP]` to model the the beginning and end of the text. These two extra tokens will become relevant below.\n",
-    "- All tokens are lower-cased.\n",
     "- Punctuations are they own tokens.\n",
     "- Compounds words are split into two tokens, for example `hitmen` becomes `hit` and `##men`.\n",
     "\n",