...
Model | MAP | NDCG | P@20 | NDCG@20 | P@100 | NDCG@100 | Notes | |
---|---|---|---|---|---|---|---|---|
QL (Dir) | 0.2837 | 0.5306 | 0.5667 | 0.5054 | 0.3981 | 0.4541 |
| |
Dir (Krovetz) | 0.2944+ | 0.5443+ | 0.5905+ | 0.5150 | 0.4033 | 0.4601 | Sweep mu, krovetz-stemmed queries | |
RM3 | 0.2982 | 0.5381 | 0.5476 | 0.5054 | 0.4038 | 0.4768+ | Sweep mu, fbDocs, fbTerms, and lambda | |
RM3 (stopped) | 0.3001 | 0.5423 | 0.5786 | 0.5150 | 0.3943 | 0.4534 | Stopped queries, RM3 | RM3 (krovetz) |
Pubmed | 0.3076+ | 0.5853+ | 0.5381 | 0.4855 | 0.4248 | 0.4501 | Use mu=2500 for pubmed query sweeping fbDocs, fbTerms, and lambda. Sweep mu for final retrieval. | |
Pubmed (Krovetz) | 0.3285+ | 0.6008+ | 0.5667 | 0.4821 | 0.4333+ | 0.4627 | Krovetz-stemmed queries. | |
Wikipedia | 0.2947 | 0.5956+ | 0.5738 | 0.4956 | 0.4062 | 0.4487 | Use mu=2500 for wikipedia query sweeping fbDocs, fbTerms, and lambda. Sweep mu for final retrieval. | |
SDM | 0.2874 | 0.5558 | 0.4833 | 0.4706 | 0.4019 | 0.4559 | Sweep mu, w1, w2, w3 | |
FDM | 0.293 | 0.5594+ | 0.5500 | 0.4960 | 0.3933 | 0.4560 | Sweep mu, w1, w2, w3 |
+ indicates significant improvement over QL (Dir) baselines (p < 0.05)
Model | MAP | NDCG | P@20 | NDCG@20 | P@100 | NDCG@100 | Notes |
---|---|---|---|---|---|---|---|
Dir (Krovetz) | 0.2944+ | 0.5443+ | 0.5905+ | 0.5150 | 0.4033 | 0.4601 | Sweep mu, krovetz-stemmed queries |
RM3 (krovetz) | |||||||
Pubmed (Krovetz) | 0.3285+ | 0.6008+ | 0.5667 | 0.4821 | 0.4333+ | 0.4627 | Krovetz-stemmed queries. |