Using framework from https://opensource.ncsa.illinois.edu/jira/browse/NDS-836, run complete evaluation of RM1 and RM3 models using Wikipedia for expansion:
- Topics: queries.combined.short
- Using wikipedia index for expansion, sweep the following parameters (suggested values – may need tweaking):
- mu: 2500
- fbDocs : 5 10 20 50
- fbTerms : 5 10 20 50
- lambda : 0.0,0.1,0.20.3,0.4,0.5,0.6,0.7,0.8,0.9,1.0 (RM3 only)
- Using bioCaddie index for query run, sweep the following parameters:
- mu: 50 250 500 1000 2500 5000 10000
- Use cross-validation and t-test to compare results
- Document run results in Wiki