Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

ModelMAPNDCGP@20NDCG@20P@100NDCG@100NotesDate
QL (Dir)0.2976+0.5656+0.56430.50040.41190.457

 

5/15/17
QL (Dir)0.28530.53040.56670.50540.39860.4541Sweep mu5/15/17
RM30.28460.53810.57380.50540.41570.4710Sweep mu, fbDocs, fbTerms, and lambda5/15/17
RM30.28460.53950.56190.50720.41570.4710Sweep mu, fbDocs, fbTerms, and lambda5/16/17
RM3 (stopped)0.302329480.547158340.547655710.506450040.388638050.4634599Sweep mu, fbDocs, fbTerms, and lambda5/17/17
RM3 (stopped)0.30230.54830.57380.51180.39050.4626Sweep mu, fbDocs, fbTerms, and lambda5/16/17
Pubmed0.29450.5998+0.51900.47590.41900.4607Use mu=2500 for pubmed query sweeping fbDocs, fbTerms, and lambda. Sweep mu for final retrieval.5/15/17
Wikipedia0.30510.5894+0.56190.48210.39480.4613Use mu=2500 for wikipedia query sweeping fbDocs, fbTerms, and lambda. Sweep mu for final retrieval.5/15/17
SDM0.28740.55580.48330.47060.40190.4559Sweep mu, w1, w2, w35/16/17
FDM0.2930.5594+0.55000.49600.39330.4560Sweep mu, w1, w2, w35/8/17
OKAPI Exp0.301132500.510658490.507158570.455248940.387142380.43754783OKAPI expansion assuming k1=1 and k3=1, for now5/17/17

+ indicates significant improvement over QL (Dir) baselines (p < 0.05)

...

ModelMAPNDCGP@20NDCG@20P@100NDCG@100NotesDate
Dir (Krovetz)0.2959+0.5443+0.5905+0.51500.4124+0.4655+ means significant improvement of Dir (unstemmed)5/15/17
RM3 (krovetz)0.285830290.559257340.56430.499947140.395240330.46054753
5/17/17
Pubmed (Krovetz)0.3285+0.6008+0.56670.48210.4333+0.4627+ means improvement of Dir (krovetz)

...