...
Eg: Rscript scripts/new/compare.R test tfidf dir short biocaddie
4. Results
| Model | MAP | NDCG | P@20 | NDCG@20 | P@100 | NDCG@100 | Notes | Date |
|---|
| classic tfidf | 0. |
328358166933546250074996063035446061755958506751820630336760165713500750170630367705266169666756765221 | 07/05/17 |
| Rocchio | 0.4044+ | 0.6417 (p-value= p= 0.0533) | 0.6967 | 0.5403 | 0.492 | 0.4912 | Sweep b, k1, fbTerms, fbDocs, fbOrigWeight | 07/05 |
06/30
| No Format |
|---|
root@integrationthphan@biocaddie-1:~/biocaddie#dev:/data/thphan/biocaddie$ Rscript scripts/new/compare.R test tfidf dir short biocaddie
Please enter run methods for comparison:
0: both are Indri
1: both are Lucene
2: from is Indri, to is Lucene
3: from is Lucene, to is Indri
1
[1] "map 0.32833282 0.36773675 p= 0.05260548"
[1] "ndcg 0.58165824 0.61696163 p= 0.04080502"
[1] "P_20 0.69336867 0.66676567 p= 0.92519461"
[1] "ndcg_cut_20 0.54625478 0.56765664 p= 0.1533186"
[1] "P_100 0.50075013 0.5213 p= 0.20532168"
[1] "ndcg_cut_100 0.49965018 0.5221522 p= 0.11621401"
root@integration-1:~/biocaddie#
thphan@biocaddie-dev:/data/thphan/biocaddie$ Rscript scripts/new/compare.R test tfidf jm short biocadd ie
Please enter run methods for comparison:
0: both are Indri
1: both are Lucene
2: from is Indri, to is Lucene
3: from is Lucene, to is Indri
1
[1] "map 0.3282 0.3382 p= 0.1719"
[1] "ndcg 0.5824 0.6022 p= 0.0932"
[1] "P_20 0.6867 0.7233 p= 0.0831"
[1] "ndcg_cut_20 0.5478 0.571 p= 0.145"
[1] "P_100 0.5013 0.5 p= 0.5301"
[1] "ndcg_cut_100 0.5018 0.4996 p= 0.5552"
thphan@biocaddie-dev:/data/thphan/biocaddie$ Rscript scripts/new/compare.R test tfidf bm25 short biocaddie
Please enter run methods for comparison:
0: both are Indri
1: both are Lucene
2: from is Indri, to is Lucene
3: from is Lucene, to is Indri
1
[1] "map 0.32833282 0.35443543 p= 0.08250846"
[1] "ndcg 0.58165824 0.60616105 p= 0.02390148"
[1] "P_20 0.69336867 0.757467 p= 0.06120491"
[1] "ndcg_cut_20 0.54625478 0.59585917 p= 0.03020496"
[1] "P_100 0.50075013 0.5067506 p= 0.4072428"
[1] "ndcg_cut_100 0.49965018 0.51825186 p= 0.19752195"
root@integrationthphan@biocaddie-1:~/biocaddie#dev:/data/thphan/biocaddie$ Rscript scripts/new/compare.R test tfidf jmrocchio short biocaddie
Please enter run methods for comparison:
0: both are Indri
1: both are Lucene
2: from is Indri, to is Lucene
3: from is Lucene, to is Indri
1
[1] "map 0.32833282 0.33674044 p= 0.22310188"
[1] "ndcg 0.58165824 0.60166417 p= 0.07530533"
[1] "P_20 0.69336867 0.72336967 p= 0.13563785"
[1] "ndcg_cut_20 0.54625478 0.57135403 p= 0.13126276"
[1] "P_100 0.50075013 0.5007492 p= 0.56184"
[1] "ndcg_cut_100 0.49965018 0.50174912 p= 0.44416071" |