"## Table 2 and 3: compute ACC, AUC and RMSE and DOA\n",
"\n",
"Warning : can be long to compute\n",
"Prerequisite : Running the makefile\n",
"Output : stored in `../../results/table_2`"
"**Warning** : can be long to compute\n",
"**Prerequisite** : Running the makefile\n",
"**Output** : stored in `../../results/table_2`"
],
"metadata": {
"collapsed": false
...
...
@@ -48,7 +48,15 @@
{
"cell_type": "markdown",
"source": [
"## Table 3: compute DOA"
"## Table 3: compute DOA\n",
"\n",
"**Warning** : can be long to compute\n",
"**Prerequisite** : Running the makefile\n",
"**Output** : printed in the notebook\n",
"\n",
"The doa metrics are computed for the dataset whose index is specified by the variable `i`, for CD-BPR and for all competitors simultaneously, and for each data splitting of the cross validation.\n",
"\n",
"The embeddings are given pre-computed in the `result` directory. However, for the sake of reproducibility, they will be overwritten by the ones computed in the previous cell. "
],
"metadata": {
"collapsed": false
...
...
@@ -62,35 +70,31 @@
"name": "stdout",
"output_type": "stream",
"text": [
"_create_directory() - handled error when creating a directory at ../experiments_logs/3: [Errno 17] File exists: '../experiments_logs/3'\r\n",
"dataset math_1\r\n",
"fold 0\r\n",
"model DINA\r\n",
"num_kc 11\r\n",
"model MCD\r\n",
"num_kc 11\r\n",
"model NCDM\r\n",
"num_kc 11\r\n",
"model MIRT\r\n",
"num_kc 11\r\n",
"model BPR\r\n",
"num_kc 11\r\n",
"fold 1\r\n",
"model DINA\r\n",
"num_kc 11\r\n",
"model MCD\r\n",
"num_kc 11\r\n",
"model NCDM\r\n",
"num_kc 11\r\n",
"^C\r\n",
"Traceback (most recent call last):\r\n",
" File \"/home/arthurb/Programmation/cd-bpr/code/./DOA.py\", line 161, in <module>\r\n",
" File \"/home/arthurb/anaconda3/envs/cdbpr-env/lib/python3.11/site-packages/pandas/core/ops/array_ops.py\", line 131, in comp_method_OBJECT_ARRAY\r\n",
" result = libops.scalar_compare(x.ravel(), y, op)\r\n",
" ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\r\n",
" File \"/home/arthurb/Programmation/cd-bpr/code/./DOA.py\", line 185, in <module>\r\n",
## Table 2 and 3: compute ACC, AUC and RMSE and DOA
Warning : can be long to compute
Prerequisite : Running the makefile
Output : stored in `../../results/table_2`
**Warning** : can be long to compute
**Prerequisite** : Running the makefile
**Output** : stored in `../../results/table_2`
%% Cell type:code id:f361888d67da2988 tags:
``` python
import os
cmd = 'cd code/binary_bpr && python ./script.py '
!{cmd}
```
%% Cell type:markdown id:d8116396a802bc7d tags:
## Table 3: compute DOA
**Warning** : can be long to compute
**Prerequisite** : Running the makefile
**Output** : printed in the notebook
The doa metrics are computed for the dataset whose index is specified by the variable `i`, for CD-BPR and for all competitors simultaneously, and for each data splitting of the cross validation.
The embeddings are given pre-computed in the `result` directory. However, for the sake of reproducibility, they will be overwritten by the ones computed in the previous cell.
File ~/anaconda3/envs/cdbpr-env/lib/python3.11/site-packages/plotly/io/_kaleido.py:267, in write_image(fig, file, format, scale, width, height, validate, engine)
251 raise ValueError(
252 """
253 Cannot infer image type from output path '{file}'.
(...)
261 )
262 )
264 # Request image
265 # -------------
266 # Do this first so we don't create a file if image conversion fails
--> 267 img_data = to_image(
268 fig,
269 format=format,
270 scale=scale,
271 width=width,
272 height=height,
273 validate=validate,
274 engine=engine,
275 )
277 # Open file
278 # ---------
279 if path is None:
280 # We previously failed to make sense of `file` as a pathlib object.
281 # Attempt to write to `file` as an open file descriptor.
File ~/anaconda3/envs/cdbpr-env/lib/python3.11/site-packages/plotly/io/_kaleido.py:133, in to_image(fig, format, width, height, scale, validate, engine)
131 # Raise informative error message if Kaleido is not installed
132 if scope is None:
--> 133 raise ValueError(
134 """
135 Image export using the "kaleido" engine requires the kaleido package,