diff --git a/Tutoriel-geoparsing.ipynb b/Tutoriel-geoparsing.ipynb
index 5f81afae5cce877fbfe6ea0a4ed4e5a6fbbca7bb..65ce252e56515c07faeb068d468e3c4eb6462b5a 100644
--- a/Tutoriel-geoparsing.ipynb
+++ b/Tutoriel-geoparsing.ipynb
@@ -781,62 +781,146 @@
"metadata": {},
"source": [
"## 5. Reconnaissance d'Entités Nommées (NER)\n",
- "\n"
+ "\n",
+ "La reconnaissance d'entités nommées, *Named Entity Recognition* (NER) en anglais, est une tâche très importante et incontournable en traitement automatique des langues (TAL) et en compréhension du langage naturel (NLU en anglais). \n",
+ "Cette tâche consiste à rechercher des objets textuels (un mot, ou un groupe de mots, souvent associés aux noms propres) catégorisables dans des classes telles que noms de personnes, noms d'organisations ou d'entreprises, noms de lieux, quantités, distances, valeurs, dates, etc.\n",
+ "\n",
+ "Dans cet atelier nous allons expérimenter et comparer trois outils de NER. \n",
+ "\n",
+ "1. [Stanza](https://stanfordnlp.github.io/stanza/index.html)\n",
+ "2. [spaCy](https://spacy.io)\n",
+ "3. [Perdido](https://github.com/ludovicmoncla/perdido)"
]
},
{
- "cell_type": "code",
- "execution_count": null,
+ "cell_type": "markdown",
"metadata": {},
- "outputs": [],
- "source": []
+ "source": [
+ "### 5.1 Stanza NER\n",
+ "\n",
+ "`Stanza` est une librairie Python de traitement du langage naturel. Elle contient des outils, qui peuvent être utilisés dans une chaîne de traitement, pour convertir du texte en listes de phrases et de mots, pour générer les formes de base de ces mots, leurs parties du discours et leurs caractéristiques morphologiques, pour produire une analyse syntaxique de dépendance, et pour reconnaître les entités nommées. \n",
+ "\n",
+ "`Stanza` se base sur des modèles entrainés par des réseaux de neurones à partir de la bibliothèque [PyTorch](https://pytorch.org) et permet de traiter plus de 70 langues.\n",
+ "\n",
+ "Dans cette partie nous allons voir comment utiliser `Stanza` pour la reconnaissance d'entités nommées à partir de textes en français.\n"
+ ]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
- "### 5.1 Stanza NER"
+ "* Importer la librairie `Stanza` et télécharger le modèle pré-entrainé pour le français : "
]
},
{
"cell_type": "code",
- "execution_count": null,
+ "execution_count": 23,
"metadata": {},
- "outputs": [],
- "source": []
+ "outputs": [
+ {
+ "data": {
+ "application/vnd.jupyter.widget-view+json": {
+ "model_id": "b98f0029867448a199b879e25dace917",
+ "version_major": 2,
+ "version_minor": 0
+ },
+ "text/plain": [
+ "Downloading https://raw.githubusercontent.com/stanfordnlp/stanza-resources/main/resources_1.4.0.json: 0%| …"
+ ]
+ },
+ "metadata": {},
+ "output_type": "display_data"
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "2022-09-16 09:16:43 INFO: Downloading default packages for language: fr (French)...\n",
+ "2022-09-16 09:16:44 INFO: File exists: /Users/lmoncla/stanza_resources/fr/default.zip\n",
+ "2022-09-16 09:16:47 INFO: Finished downloading models and saved to /Users/lmoncla/stanza_resources.\n"
+ ]
+ }
+ ],
+ "source": [
+ "import stanza\n",
+ "\n",
+ "stanza.download('fr')"
+ ]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
- "* Importer la librairie `Stanza` et télécharger le modèle pré-entrainé pour le français : "
+ "* Instancier et paramétrer la chaîne de traitement :"
]
},
{
"cell_type": "code",
- "execution_count": null,
+ "execution_count": 24,
"metadata": {},
- "outputs": [],
+ "outputs": [
+ {
+ "data": {
+ "application/vnd.jupyter.widget-view+json": {
+ "model_id": "561ecbb0a447489e9ccf9dbe8dbf3b16",
+ "version_major": 2,
+ "version_minor": 0
+ },
+ "text/plain": [
+ "Downloading https://raw.githubusercontent.com/stanfordnlp/stanza-resources/main/resources_1.4.0.json: 0%| …"
+ ]
+ },
+ "metadata": {},
+ "output_type": "display_data"
+ },
+ {
+ "name": "stderr",
+ "output_type": "stream",
+ "text": [
+ "2022-09-16 09:16:56 WARNING: Language fr package default expects mwt, which has been added\n",
+ "2022-09-16 09:16:57 INFO: Loading these models for language: fr (French):\n",
+ "=======================\n",
+ "| Processor | Package |\n",
+ "-----------------------\n",
+ "| tokenize | gsd |\n",
+ "| mwt | gsd |\n",
+ "| ner | wikiner |\n",
+ "=======================\n",
+ "\n",
+ "2022-09-16 09:16:57 INFO: Use device: cpu\n",
+ "2022-09-16 09:16:57 INFO: Loading: tokenize\n",
+ "2022-09-16 09:16:57 INFO: Loading: mwt\n",
+ "2022-09-16 09:16:57 INFO: Loading: ner\n",
+ "2022-09-16 09:16:58 INFO: Done loading processors!\n"
+ ]
+ }
+ ],
"source": [
- "import stanza\n",
- "\n",
- "stanza.download('fr')"
+ "stanza_parser = stanza.Pipeline(lang='fr', processors='tokenize,ner')"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
- "* Instancier et paramétrer la chaîne de traitement :"
+ "* On utilise la variable `content` qui contient le texte chargé précédemment à partir du fichier"
]
},
{
"cell_type": "code",
- "execution_count": null,
+ "execution_count": 27,
"metadata": {},
- "outputs": [],
+ "outputs": [
+ {
+ "name": "stdout",
+ "output_type": "stream",
+ "text": [
+ "* ARQUES, (Géog.) petite ville de France, en Normandie, au pays de Caux, sur la petite riviere d'Arques. Long. 18. 50. lat. 49. 54.\n"
+ ]
+ }
+ ],
"source": [
- "stanza_parser = stanza.Pipeline(lang='fr', processors='tokenize,ner')"
+ "print(content)"
]
},
{
@@ -848,7 +932,7 @@
},
{
"cell_type": "code",
- "execution_count": null,
+ "execution_count": 25,
"metadata": {},
"outputs": [],
"source": [
@@ -864,9 +948,22 @@
},
{
"cell_type": "code",
- "execution_count": null,
+ "execution_count": 28,
"metadata": {},
- "outputs": [],
+ "outputs": [
+ {
+ "name": "stdout",
+ "output_type": "stream",
+ "text": [
+ "ARQUES LOC\n",
+ "(Géog LOC\n",
+ "France LOC\n",
+ "Normandie LOC\n",
+ "pays de Caux LOC\n",
+ "Arques LOC\n"
+ ]
+ }
+ ],
"source": [
"for ent in doc.ents:\n",
" print(ent.text, ent.type)"
@@ -876,7 +973,13 @@
"cell_type": "markdown",
"metadata": {},
"source": [
- "### 5.2 SpaCy NER"
+ "### 5.2 SpaCy NER\n",
+ "\n",
+ "\n",
+ "`spaCy` est également une librairie Python de traitement du langage naturel. \n",
+ "Elle se compose de modèles pré-entrainés et supporte actuellement la tokenisation et l'entrainement pour plus de 60 langues. Elle est doté de modèles de réseaux neuronaux pour le balisage, l'analyse syntaxique, la reconnaissance d'entités nommées, la classification de textes, l'apprentissage multi-tâches avec des transformateurs pré-entraînés comme BERT, ainsi qu'un système d'entraînement prêt pour la production et un déploiement simple des modèles. `spaCy` est un logiciel commercial, publié en open-source sous la licence MIT.\n",
+ "\n",
+ "Dans cette partie nous allons voir comment utiliser `spaCy` pour la reconnaissance d'entités nommées toujours à partir de notre exemple en français."
]
},
{
@@ -888,9 +991,54 @@
},
{
"cell_type": "code",
- "execution_count": null,
+ "execution_count": 29,
"metadata": {},
- "outputs": [],
+ "outputs": [
+ {
+ "name": "stdout",
+ "output_type": "stream",
+ "text": [
+ "Collecting fr-core-news-sm==3.4.0\n",
+ " Downloading https://github.com/explosion/spacy-models/releases/download/fr_core_news_sm-3.4.0/fr_core_news_sm-3.4.0-py3-none-any.whl (16.3 MB)\n",
+ "\u001b[2K \u001b[90mâ”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”â”\u001b[0m \u001b[32m16.3/16.3 MB\u001b[0m \u001b[31m10.7 MB/s\u001b[0m eta \u001b[36m0:00:00\u001b[0m00:01\u001b[0m00:01\u001b[0m\n",
+ "\u001b[?25hRequirement already satisfied: spacy<3.5.0,>=3.4.0 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from fr-core-news-sm==3.4.0) (3.4.1)\n",
+ "Requirement already satisfied: pydantic!=1.8,!=1.8.1,<1.10.0,>=1.7.4 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (1.9.2)\n",
+ "Requirement already satisfied: spacy-legacy<3.1.0,>=3.0.9 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (3.0.10)\n",
+ "Requirement already satisfied: langcodes<4.0.0,>=3.2.0 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (3.3.0)\n",
+ "Requirement already satisfied: spacy-loggers<2.0.0,>=1.0.0 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (1.0.3)\n",
+ "Requirement already satisfied: preshed<3.1.0,>=3.0.2 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (3.0.7)\n",
+ "Requirement already satisfied: tqdm<5.0.0,>=4.38.0 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (4.64.1)\n",
+ "Requirement already satisfied: srsly<3.0.0,>=2.4.3 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (2.4.4)\n",
+ "Requirement already satisfied: setuptools in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (65.3.0)\n",
+ "Requirement already satisfied: typer<0.5.0,>=0.3.0 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (0.4.2)\n",
+ "Requirement already satisfied: packaging>=20.0 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (21.3)\n",
+ "Requirement already satisfied: requests<3.0.0,>=2.13.0 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (2.28.1)\n",
+ "Requirement already satisfied: cymem<2.1.0,>=2.0.2 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (2.0.6)\n",
+ "Requirement already satisfied: pathy>=0.3.5 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (0.6.2)\n",
+ "Requirement already satisfied: numpy>=1.15.0 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (1.23.3)\n",
+ "Requirement already satisfied: wasabi<1.1.0,>=0.9.1 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (0.10.1)\n",
+ "Requirement already satisfied: thinc<8.2.0,>=8.1.0 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (8.1.1)\n",
+ "Requirement already satisfied: murmurhash<1.1.0,>=0.28.0 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (1.0.8)\n",
+ "Requirement already satisfied: jinja2 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (3.1.2)\n",
+ "Requirement already satisfied: catalogue<2.1.0,>=2.0.6 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (2.0.8)\n",
+ "Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from packaging>=20.0->spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (3.0.9)\n",
+ "Requirement already satisfied: smart-open<6.0.0,>=5.2.1 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from pathy>=0.3.5->spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (5.2.1)\n",
+ "Requirement already satisfied: typing-extensions>=3.7.4.3 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from pydantic!=1.8,!=1.8.1,<1.10.0,>=1.7.4->spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (4.3.0)\n",
+ "Requirement already satisfied: idna<4,>=2.5 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from requests<3.0.0,>=2.13.0->spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (3.3)\n",
+ "Requirement already satisfied: charset-normalizer<3,>=2 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from requests<3.0.0,>=2.13.0->spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (2.1.1)\n",
+ "Requirement already satisfied: urllib3<1.27,>=1.21.1 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from requests<3.0.0,>=2.13.0->spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (1.26.11)\n",
+ "Requirement already satisfied: certifi>=2017.4.17 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from requests<3.0.0,>=2.13.0->spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (2022.6.15.1)\n",
+ "Requirement already satisfied: confection<1.0.0,>=0.0.1 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from thinc<8.2.0,>=8.1.0->spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (0.0.1)\n",
+ "Requirement already satisfied: blis<0.10.0,>=0.7.8 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from thinc<8.2.0,>=8.1.0->spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (0.9.1)\n",
+ "Requirement already satisfied: click<9.0.0,>=7.1.1 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from typer<0.5.0,>=0.3.0->spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (8.1.3)\n",
+ "Requirement already satisfied: MarkupSafe>=2.0 in /opt/homebrew/Caskroom/miniforge/base/envs/tdm-geoparsing-py39/lib/python3.9/site-packages (from jinja2->spacy<3.5.0,>=3.4.0->fr-core-news-sm==3.4.0) (2.1.1)\n",
+ "Installing collected packages: fr-core-news-sm\n",
+ "Successfully installed fr-core-news-sm-3.4.0\n",
+ "\u001b[38;5;2m✔ Download and installation successful\u001b[0m\n",
+ "You can now load the package via spacy.load('fr_core_news_sm')\n"
+ ]
+ }
+ ],
"source": [
"!python -m spacy download fr_core_news_sm"
]
@@ -904,7 +1052,7 @@
},
{
"cell_type": "code",
- "execution_count": null,
+ "execution_count": 30,
"metadata": {},
"outputs": [],
"source": [
@@ -920,7 +1068,7 @@
},
{
"cell_type": "code",
- "execution_count": null,
+ "execution_count": 31,
"metadata": {},
"outputs": [],
"source": [
@@ -936,7 +1084,7 @@
},
{
"cell_type": "code",
- "execution_count": null,
+ "execution_count": 32,
"metadata": {},
"outputs": [],
"source": [
@@ -952,9 +1100,21 @@
},
{
"cell_type": "code",
- "execution_count": null,
+ "execution_count": 33,
"metadata": {},
- "outputs": [],
+ "outputs": [
+ {
+ "name": "stdout",
+ "output_type": "stream",
+ "text": [
+ "Géog MISC\n",
+ "de France LOC\n",
+ "Normandie LOC\n",
+ "pays de Caux LOC\n",
+ "Arques LOC\n"
+ ]
+ }
+ ],
"source": [
"for ent in doc.ents:\n",
" print(ent.text, ent.label_)"
@@ -969,9 +1129,47 @@
},
{
"cell_type": "code",
- "execution_count": null,
+ "execution_count": 34,
"metadata": {},
- "outputs": [],
+ "outputs": [
+ {
+ "data": {
+ "text/html": [
+ "<span class=\"tex2jax_ignore\"><div class=\"entities\" style=\"line-height: 2.5; direction: ltr\">* ARQUES, (\n",
+ "<mark class=\"entity\" style=\"background: #ddd; padding: 0.45em 0.6em; margin: 0 0.25em; line-height: 1; border-radius: 0.35em;\">\n",
+ " Géog\n",
+ " <span style=\"font-size: 0.8em; font-weight: bold; line-height: 1; border-radius: 0.35em; vertical-align: middle; margin-left: 0.5rem\">MISC</span>\n",
+ "</mark>\n",
+ ".) petite ville \n",
+ "<mark class=\"entity\" style=\"background: #ff9561; padding: 0.45em 0.6em; margin: 0 0.25em; line-height: 1; border-radius: 0.35em;\">\n",
+ " de France\n",
+ " <span style=\"font-size: 0.8em; font-weight: bold; line-height: 1; border-radius: 0.35em; vertical-align: middle; margin-left: 0.5rem\">LOC</span>\n",
+ "</mark>\n",
+ ", en \n",
+ "<mark class=\"entity\" style=\"background: #ff9561; padding: 0.45em 0.6em; margin: 0 0.25em; line-height: 1; border-radius: 0.35em;\">\n",
+ " Normandie\n",
+ " <span style=\"font-size: 0.8em; font-weight: bold; line-height: 1; border-radius: 0.35em; vertical-align: middle; margin-left: 0.5rem\">LOC</span>\n",
+ "</mark>\n",
+ ", au \n",
+ "<mark class=\"entity\" style=\"background: #ff9561; padding: 0.45em 0.6em; margin: 0 0.25em; line-height: 1; border-radius: 0.35em;\">\n",
+ " pays de Caux\n",
+ " <span style=\"font-size: 0.8em; font-weight: bold; line-height: 1; border-radius: 0.35em; vertical-align: middle; margin-left: 0.5rem\">LOC</span>\n",
+ "</mark>\n",
+ ", sur la petite riviere d'\n",
+ "<mark class=\"entity\" style=\"background: #ff9561; padding: 0.45em 0.6em; margin: 0 0.25em; line-height: 1; border-radius: 0.35em;\">\n",
+ " Arques\n",
+ " <span style=\"font-size: 0.8em; font-weight: bold; line-height: 1; border-radius: 0.35em; vertical-align: middle; margin-left: 0.5rem\">LOC</span>\n",
+ "</mark>\n",
+ ". Long. 18. 50. lat. 49. 54.</div></span>"
+ ],
+ "text/plain": [
+ "<IPython.core.display.HTML object>"
+ ]
+ },
+ "metadata": {},
+ "output_type": "display_data"
+ }
+ ],
"source": [
"displacy.render(doc, style=\"ent\", jupyter=True) "
]
@@ -992,7 +1190,7 @@
},
{
"cell_type": "code",
- "execution_count": null,
+ "execution_count": 35,
"metadata": {},
"outputs": [],
"source": [
@@ -1008,7 +1206,7 @@
},
{
"cell_type": "code",
- "execution_count": null,
+ "execution_count": 41,
"metadata": {},
"outputs": [],
"source": [
@@ -1024,9 +1222,22 @@
},
{
"cell_type": "code",
- "execution_count": null,
+ "execution_count": 42,
"metadata": {},
- "outputs": [],
+ "outputs": [
+ {
+ "name": "stdout",
+ "output_type": "stream",
+ "text": [
+ "ARQUES place\n",
+ "France place\n",
+ "Normandie place\n",
+ "Caux place\n",
+ "Arques place\n",
+ "Long . 18 . 50 . lat . 49 . 54 . latlong\n"
+ ]
+ }
+ ],
"source": [
"for ent in doc.named_entities:\n",
" print(ent.text, ent.tag)"
@@ -1041,9 +1252,52 @@
},
{
"cell_type": "code",
- "execution_count": null,
+ "execution_count": 43,
"metadata": {},
- "outputs": [],
+ "outputs": [
+ {
+ "data": {
+ "text/html": [
+ "<span class=\"tex2jax_ignore\"><div class=\"entities\" style=\"line-height: 2.5; direction: ltr\">* \n",
+ "<mark class=\"entity\" style=\"background: #ff9561; padding: 0.45em 0.6em; margin: 0 0.25em; line-height: 1; border-radius: 0.35em;\">\n",
+ " ARQUES\n",
+ " <span style=\"font-size: 0.8em; font-weight: bold; line-height: 1; border-radius: 0.35em; vertical-align: middle; margin-left: 0.5rem\">LOC</span>\n",
+ "</mark>\n",
+ " , ( Géog . ) petite ville de \n",
+ "<mark class=\"entity\" style=\"background: #ff9561; padding: 0.45em 0.6em; margin: 0 0.25em; line-height: 1; border-radius: 0.35em;\">\n",
+ " France\n",
+ " <span style=\"font-size: 0.8em; font-weight: bold; line-height: 1; border-radius: 0.35em; vertical-align: middle; margin-left: 0.5rem\">LOC</span>\n",
+ "</mark>\n",
+ " , en \n",
+ "<mark class=\"entity\" style=\"background: #ff9561; padding: 0.45em 0.6em; margin: 0 0.25em; line-height: 1; border-radius: 0.35em;\">\n",
+ " Normandie\n",
+ " <span style=\"font-size: 0.8em; font-weight: bold; line-height: 1; border-radius: 0.35em; vertical-align: middle; margin-left: 0.5rem\">LOC</span>\n",
+ "</mark>\n",
+ " , au pays de \n",
+ "<mark class=\"entity\" style=\"background: #ff9561; padding: 0.45em 0.6em; margin: 0 0.25em; line-height: 1; border-radius: 0.35em;\">\n",
+ " Caux\n",
+ " <span style=\"font-size: 0.8em; font-weight: bold; line-height: 1; border-radius: 0.35em; vertical-align: middle; margin-left: 0.5rem\">LOC</span>\n",
+ "</mark>\n",
+ " , sur la petite riviere d' \n",
+ "<mark class=\"entity\" style=\"background: #ff9561; padding: 0.45em 0.6em; margin: 0 0.25em; line-height: 1; border-radius: 0.35em;\">\n",
+ " Arques\n",
+ " <span style=\"font-size: 0.8em; font-weight: bold; line-height: 1; border-radius: 0.35em; vertical-align: middle; margin-left: 0.5rem\">LOC</span>\n",
+ "</mark>\n",
+ " . \n",
+ "<mark class=\"entity\" style=\"background: #ddd; padding: 0.45em 0.6em; margin: 0 0.25em; line-height: 1; border-radius: 0.35em;\">\n",
+ " Long . 18 . 50 . lat . 49 . 54 .\n",
+ " <span style=\"font-size: 0.8em; font-weight: bold; line-height: 1; border-radius: 0.35em; vertical-align: middle; margin-left: 0.5rem\">MISC</span>\n",
+ "</mark>\n",
+ " </div></span>"
+ ],
+ "text/plain": [
+ "<IPython.core.display.HTML object>"
+ ]
+ },
+ "metadata": {},
+ "output_type": "display_data"
+ }
+ ],
"source": [
"displacy.render(doc.to_spacy_doc(), style=\"ent\", jupyter=True)"
]
@@ -1057,9 +1311,347 @@
},
{
"cell_type": "code",
- "execution_count": null,
+ "execution_count": 44,
"metadata": {},
- "outputs": [],
+ "outputs": [
+ {
+ "data": {
+ "text/html": [
+ "<span class=\"tex2jax_ignore\"><div class=\"spans\" style=\"line-height: 2.5; direction: ltr\">\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " *\n",
+ " \n",
+ "<span style=\"background: #ddd; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "<span style=\"background: #ddd; top: 40px; height: 4px; border-top-left-radius: 3px; border-bottom-left-radius: 3px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ " <span style=\"background: #ddd; z-index: 10; color: #000; top: -0.5em; padding: 2px 3px; position: absolute; font-size: 0.6em; font-weight: bold; line-height: 1; border-radius: 3px\">\n",
+ " MISC\n",
+ " </span>\n",
+ "</span>\n",
+ "\n",
+ "\n",
+ "</span>\n",
+ "\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 77px;\">\n",
+ " ARQUES\n",
+ " \n",
+ "<span style=\"background: #ddd; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ "<span style=\"background: #ff9561; top: 57px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "<span style=\"background: #ff9561; top: 57px; height: 4px; border-top-left-radius: 3px; border-bottom-left-radius: 3px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ " <span style=\"background: #ff9561; z-index: 10; color: #000; top: -0.5em; padding: 2px 3px; position: absolute; font-size: 0.6em; font-weight: bold; line-height: 1; border-radius: 3px\">\n",
+ " LOC\n",
+ " </span>\n",
+ "</span>\n",
+ "\n",
+ "\n",
+ "</span>\n",
+ ", ( Géog . ) \n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " petite\n",
+ " \n",
+ "<span style=\"background: #ff9561; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "<span style=\"background: #ff9561; top: 40px; height: 4px; border-top-left-radius: 3px; border-bottom-left-radius: 3px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ " <span style=\"background: #ff9561; z-index: 10; color: #000; top: -0.5em; padding: 2px 3px; position: absolute; font-size: 0.6em; font-weight: bold; line-height: 1; border-radius: 3px\">\n",
+ " LOC\n",
+ " </span>\n",
+ "</span>\n",
+ "\n",
+ "\n",
+ "</span>\n",
+ "\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " ville\n",
+ " \n",
+ "<span style=\"background: #ff9561; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "</span>\n",
+ "\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " de\n",
+ " \n",
+ "<span style=\"background: #ff9561; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "</span>\n",
+ "\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 77px;\">\n",
+ " France\n",
+ " \n",
+ "<span style=\"background: #ff9561; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ "<span style=\"background: #ff9561; top: 57px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "<span style=\"background: #ff9561; top: 57px; height: 4px; border-top-left-radius: 3px; border-bottom-left-radius: 3px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ " <span style=\"background: #ff9561; z-index: 10; color: #000; top: -0.5em; padding: 2px 3px; position: absolute; font-size: 0.6em; font-weight: bold; line-height: 1; border-radius: 3px\">\n",
+ " LOC\n",
+ " </span>\n",
+ "</span>\n",
+ "\n",
+ "\n",
+ "</span>\n",
+ ", en \n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " Normandie\n",
+ " \n",
+ "<span style=\"background: #ff9561; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "<span style=\"background: #ff9561; top: 40px; height: 4px; border-top-left-radius: 3px; border-bottom-left-radius: 3px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ " <span style=\"background: #ff9561; z-index: 10; color: #000; top: -0.5em; padding: 2px 3px; position: absolute; font-size: 0.6em; font-weight: bold; line-height: 1; border-radius: 3px\">\n",
+ " LOC\n",
+ " </span>\n",
+ "</span>\n",
+ "\n",
+ "\n",
+ "</span>\n",
+ ", au \n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " pays\n",
+ " \n",
+ "<span style=\"background: #ff9561; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "<span style=\"background: #ff9561; top: 40px; height: 4px; border-top-left-radius: 3px; border-bottom-left-radius: 3px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ " <span style=\"background: #ff9561; z-index: 10; color: #000; top: -0.5em; padding: 2px 3px; position: absolute; font-size: 0.6em; font-weight: bold; line-height: 1; border-radius: 3px\">\n",
+ " LOC\n",
+ " </span>\n",
+ "</span>\n",
+ "\n",
+ "\n",
+ "</span>\n",
+ "\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " de\n",
+ " \n",
+ "<span style=\"background: #ff9561; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "</span>\n",
+ "\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 77px;\">\n",
+ " Caux\n",
+ " \n",
+ "<span style=\"background: #ff9561; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ "<span style=\"background: #ff9561; top: 57px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "<span style=\"background: #ff9561; top: 57px; height: 4px; border-top-left-radius: 3px; border-bottom-left-radius: 3px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ " <span style=\"background: #ff9561; z-index: 10; color: #000; top: -0.5em; padding: 2px 3px; position: absolute; font-size: 0.6em; font-weight: bold; line-height: 1; border-radius: 3px\">\n",
+ " LOC\n",
+ " </span>\n",
+ "</span>\n",
+ "\n",
+ "\n",
+ "</span>\n",
+ ", sur \n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " la\n",
+ " \n",
+ "<span style=\"background: #ff9561; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "<span style=\"background: #ff9561; top: 40px; height: 4px; border-top-left-radius: 3px; border-bottom-left-radius: 3px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ " <span style=\"background: #ff9561; z-index: 10; color: #000; top: -0.5em; padding: 2px 3px; position: absolute; font-size: 0.6em; font-weight: bold; line-height: 1; border-radius: 3px\">\n",
+ " LOC\n",
+ " </span>\n",
+ "</span>\n",
+ "\n",
+ "\n",
+ "</span>\n",
+ "\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " petite\n",
+ " \n",
+ "<span style=\"background: #ff9561; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "</span>\n",
+ "\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " riviere\n",
+ " \n",
+ "<span style=\"background: #ff9561; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "</span>\n",
+ "\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " d'\n",
+ " \n",
+ "<span style=\"background: #ff9561; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "</span>\n",
+ "\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 77px;\">\n",
+ " Arques\n",
+ " \n",
+ "<span style=\"background: #ff9561; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ "<span style=\"background: #ff9561; top: 57px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "<span style=\"background: #ff9561; top: 57px; height: 4px; border-top-left-radius: 3px; border-bottom-left-radius: 3px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ " <span style=\"background: #ff9561; z-index: 10; color: #000; top: -0.5em; padding: 2px 3px; position: absolute; font-size: 0.6em; font-weight: bold; line-height: 1; border-radius: 3px\">\n",
+ " LOC\n",
+ " </span>\n",
+ "</span>\n",
+ "\n",
+ "\n",
+ "</span>\n",
+ ". \n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " Long\n",
+ " \n",
+ "<span style=\"background: #ddd; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "<span style=\"background: #ddd; top: 40px; height: 4px; border-top-left-radius: 3px; border-bottom-left-radius: 3px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ " <span style=\"background: #ddd; z-index: 10; color: #000; top: -0.5em; padding: 2px 3px; position: absolute; font-size: 0.6em; font-weight: bold; line-height: 1; border-radius: 3px\">\n",
+ " MISC\n",
+ " </span>\n",
+ "</span>\n",
+ "\n",
+ "\n",
+ "</span>\n",
+ "\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " .\n",
+ " \n",
+ "<span style=\"background: #ddd; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "</span>\n",
+ "\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " 18\n",
+ " \n",
+ "<span style=\"background: #ddd; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "</span>\n",
+ "\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " .\n",
+ " \n",
+ "<span style=\"background: #ddd; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "</span>\n",
+ "\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " 50\n",
+ " \n",
+ "<span style=\"background: #ddd; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "</span>\n",
+ "\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " .\n",
+ " \n",
+ "<span style=\"background: #ddd; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "</span>\n",
+ "\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " lat\n",
+ " \n",
+ "<span style=\"background: #ddd; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "</span>\n",
+ "\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " .\n",
+ " \n",
+ "<span style=\"background: #ddd; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "</span>\n",
+ "\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " 49\n",
+ " \n",
+ "<span style=\"background: #ddd; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "</span>\n",
+ "\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " .\n",
+ " \n",
+ "<span style=\"background: #ddd; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "</span>\n",
+ "\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " 54\n",
+ " \n",
+ "<span style=\"background: #ddd; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "</span>\n",
+ "\n",
+ "<span style=\"font-weight: bold; display: inline-block; position: relative; height: 60px;\">\n",
+ " .\n",
+ " \n",
+ "<span style=\"background: #ddd; top: 40px; height: 4px; left: -1px; width: calc(100% + 2px); position: absolute;\">\n",
+ "</span>\n",
+ "\n",
+ " \n",
+ "</span>\n",
+ "</div></span>"
+ ],
+ "text/plain": [
+ "<IPython.core.display.HTML object>"
+ ]
+ },
+ "metadata": {},
+ "output_type": "display_data"
+ }
+ ],
"source": [
"displacy.render(doc.to_spacy_doc(), style=\"span\", jupyter=True)"
]
@@ -1096,7 +1688,8 @@
"cell_type": "markdown",
"metadata": {},
"source": [
- "## 6. Geoparsing / Geocoding"
+ "## 6. Geoparsing / Geocoding\n",
+ "\n"
]
},
{