...
The following plots illustrate the effect of varying the Dirichlet mu parameter (a) and RM3 fbOrigWeights fbOrigWeight parameter for RM3 (b), PubMed RM3 (c), and Wikipedia RM(3). For the RM3 models, all other parameters are fixed at the their cross-validated valuevalues. The X axis shows the BioCADDIE topics, the Y-axis is the difference in NDCG from the cross-validated QL/Dirichlet baseline. The boxplots represent one point per parameter value – shared blue for low and red for high values. The green dots are the cross-validated parameter value fbOrigWeight values for the compared modelRM models.
Looking at a few examples:
...
|
|
|
|
| (a) Dirichlet (mu) | (b) RM3 (fbOrigWeight) | (c) PubMed RM3 (fbOrigWeight) | (d) Wikiepdia RM3 (fbOrigWeight) |
So, the next step is to see whether we can reliably predict when to apply one model or the other.