...
Model | MAP | NDCG | P@20 | NDCG@20 | P@100 | NDCG@100 | Notes |
---|---|---|---|---|---|---|---|
QL (Dir) | 0.2853 | 0.5304 | 0.5667 | 0.5054 | 0.3986 | 0.4541 |
|
QL (Dir) | 0.2853 | 0.5304 | 0.5667 | 0.5054 | 0.3986 | 0.4541 | Sweep mu={50, 250, 500, 1000, 2500, 5000, 10000} |
RM3 | 0.2846 | 0.5381 | 0.5738 | 0.5054 | 0.4157 | 0.4710 | Sweep mu, fbDocs, fbTerms, and lambda |
RM3 | 0.2982 | 0.5381 | 0.5452 | 0.5152 | 0.4038 | 0.4768 | Sweep mu={100, 250, 500, 750, 1000, 2000, 3000}, fbDocs={10, 25, 50, 75, 100}, fbTerms={10, 25, 50, 75, 100}, and lambda=[0.0, 1.0] |
RM3 (stopped) | 0.3023 | 0.5471 | 0.5476 | 0.5064 | 0.3886 | 0.463 | Sweep mu, fbDocs, fbTerms, and lambda |
RM3 (stopped) | 0.3001 | 0.5423 | 0.5833 | 0.5150 | 0.3938 | 0.4534 | Sweep mu={100, 250, 500, 750, 1000, 2000, 3000}, fbDocs={10, 25, 50, 75, 100}, fbTerms={10, 25, 50, 75, 100}, and lambda=[0.0, 1.0] |
Pubmed | 0.3076+2945 | 0.58535998+ | 0.53815190 | 0.48554759 | 0.42484190 | 0.45014607 | Use mu=2500 for pubmed query sweeping fbDocs, fbTerms, and lambda. Sweep mu for final retrieval. |
Wikipedia | 0.2947 | 0.5956+ | 0.5738 | 0.4956 | 0.4062 | 0.4487 | Use mu=2500 for wikipedia query sweeping fbDocs, fbTerms, and lambda. Sweep mu for final retrieval. |
SDM | 0.2874 | 0.5558 | 0.4833 | 0.4706 | 0.4019 | 0.4559 | Sweep mu, w1, w2, w3 |
FDM | 0.293 | 0.5594+ | 0.5500 | 0.4960 | 0.3933 | 0.4560 | Sweep mu, w1, w2, w3 |
OKAPI Exp | 0.3011 | 0.5106 | 0.5071 | 0.4552 | 0.3871 | 0.4375 | OKAPI expansion assuming k1=1 and k3=1, for now |
...