...
| Model | MAP | NDCG | P@20 | NDCG@20 | P@100 | NDCG@100 | Notes | Date |
|---|---|---|---|---|---|---|---|---|
| TFIDF | 0.1661 | 0.3749 | 0.395 | 0.3234 | 0.2505 | 0.2962 | Sweep b and k1 | 5/1716/17 |
| Okapi | 0.28941348 | 0.5629+3279 | 0.56433225 | 0.4927+2558 | 0.4029212 | 0.45162547 | Sweep b, k1, k3 | 5/1716/17 |
| QL (JM) | 0.26611283 | 0.53113388 | 0.53812825 | 0.48532079 | 0.385223 | 0.4372508 | Sweep lambda | 5/1716/17 |
| QL (Dir) | 0.2976+1447 | 0.5656+3689 | 0.5643285 | 0.50042324 | 0.41192415 | 0.4572666 | Sweep mu | 5/1716/17 |
| QL (TS) | 0.2931+1606 | 0.5653+3724 | 0.571436 | 0.4827304 | 0.40242475 | 0.45072991 | Sweep mu and lambda | 5/1716/17 |
***No improvement over TFIDF baselines when using original queries.
Feedback/SDM models
Green rows are runs with Garrick's framework, all others are with Craig's framework.
...