...
| Model | MAP | NDCG | P@20 | NDCG@20 | P@100 | NDCG@100 | Notes | Date |
|---|---|---|---|---|---|---|---|---|
| classic tfidf | 0.3283 | 0.5816 | 0.6933 | 0.5462 | 0.5007 | 0.4996 | No parameters | 06/2730/17 |
| BM25 | 0.23723544 | 0.3963-6061+ | 0.2393-75 | 0.3176-5958+ | 0.1343-5067 | 0.32165182 | Sweep b, k1 | 06/2730/17 |
| QL (JM) | 0.27743367 | 0.50036016 | 0.32687233 | 0.4354+5713 | 0.17645007 | 0.4307+5017 | Sweep lambda | 06/2730/17 |
| QL (Dir) | 0. 29393677 (p-value=0.0526) | 0.51966169+ | 0.33756667 | 0.4524+5676 | 0.18365213 | 0.4554+5221 | Sweep mu | 06/27/1730/17 |
| No Format |
|---|
root@integration-1:~/biocaddie# Rscript scripts/new/compare.R test tfidf dir short biocaddie
Please enter run methods for comparison:
0: both are Indri
1: both are Lucene
2: from is Indri, to is Lucene
3: from is Lucene, to is Indri
1
[1] "map 0.3283 0.3677 p= 0.0526"
[1] "ndcg 0.5816 0.6169 p= 0.0408"
[1] "P_20 0.6933 0.6667 p= 0.9251"
[1] "ndcg_cut_20 0.5462 0.5676 p= 0.1533"
[1] "P_100 0.5007 0.5213 p= 0.2053"
[1] "ndcg_cut_100 0.4996 0.5221 p= 0.1162"
root@integration-1:~/biocaddie# Rscript scripts/new/compare.R test tfidf bm25 short biocaddie
Please enter run methods for comparison:
0: both are Indri
1: both are Lucene
2: from is Indri, to is Lucene
3: from is Lucene, to is Indri
1
[1] "map 0.3283 0.3544 p= 0.0825"
[1] "ndcg 0.5816 0.6061 p= 0.0239"
[1] "P_20 0.6933 0.75 p= 0.0612"
[1] "ndcg_cut_20 0.5462 0.5958 p= 0.0302"
[1] "P_100 0.5007 0.5067 p= 0.4072"
[1] "ndcg_cut_100 0.4996 0.5182 p= 0.1975"
root@integration-1:~/biocaddie# Rscript scripts/new/compare.R test tfidf jm short biocaddie
Please enter run methods for comparison:
0: both are Indri
1: both are Lucene
2: from is Indri, to is Lucene
3: from is Lucene, to is Indri
1
[1] "map 0.3283 0.3367 p= 0.2231"
[1] "ndcg 0.5816 0.6016 p= 0.0753"
[1] "P_20 0.6933 0.7233 p= 0.1356"
[1] "ndcg_cut_20 0.5462 0.5713 p= 0.1312"
[1] "P_100 0.5007 0.5007 p= 0.5"
[1] "ndcg_cut_100 0.4996 0.5017 p= 0.4441" |