Uploaded image for project: 'National Data Service'
  1. National Data Service
  2. NDS-838

Evaluate RM1/RM3 with Wikipedia expansion

XMLWordPrintableJSON

    • Icon: Task Task
    • Resolution: Fixed
    • Icon: Normal Normal
    • None
    • None
    • None
    • NDS Sprint 25, NDS Sprint 26

      Using framework from https://opensource.ncsa.illinois.edu/jira/browse/NDS-836, run complete evaluation of RM1 and RM3 models using Wikipedia for expansion:

      • Topics: queries.combined.short
      • Using wikipedia index for expansion, sweep the following parameters (suggested values – may need tweaking):
        • mu: 2500
        • fbDocs : 5 10 20 50
        • fbTerms : 5 10 20 50
        • lambda : 0.0,0.1,0.20.3,0.4,0.5,0.6,0.7,0.8,0.9,1.0 (RM3 only)
      • Using bioCaddie index for query run, sweep the following parameters:
        • mu: 50 250 500 1000 2500 5000 10000
      • Use cross-validation and t-test to compare results
      • Document run results in Wiki

              willis8 Craig Willis
              willis8 Craig Willis
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved:

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Time Spent - 4 hours Remaining Estimate - 6 hours
                  6h
                  Logged:
                  Time Spent - 4 hours Remaining Estimate - 6 hours
                  4h